bug#64735: 29.0.92; find invocations are ~15x slower because of ignores

[Dmitry Gutov]

On 21/07/2023 18:48, Ihor Radchenko wrote:
> Dmitry Gutov <dmitry@gutov.dev> writes:
>
> > > Locally, AFAIU, running `find-lisp-find-files' without
> > > `file-name-handler-alist' is equivalent to running GNU find.
> > > (That was a reply to Eli's message that we cannot disable
> > > `file-name-handler-alist')
> >
> > But it's slower! At least 2x, even with file handlers disabled.
> > According to your own measurements, with a modern SSD (not to mention
> > all of our users with spinning media).
>
> Yes, but (1) there is room for optimization; (2) I have a hope that we
> can implement better "ignores" when using `find-lisp-find-files', thus
> eventually outperforming GNU find (when used with large number of
> ignores).

There are natural limits to that optimization, if the approach is to 
generate the full list of files in Lisp, and then filter it out 
programmatically: every file name will need to be allocated. That's a 
lot of unnecessary consing.

But you're welcome to try it and report back with results. Tramp is easy 
to disable, so you should be fine in terms of infrastructure.