[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Determination of file lists from selected folders without returning
From: |
Bernhard Voelker |
Subject: |
Re: Determination of file lists from selected folders without returning directory names |
Date: |
Tue, 18 Jul 2017 21:23:45 +0200 |
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 |
On 07/18/2017 05:37 PM, SF Markus Elfring wrote:
> Are there other programs (besides the tool “find”) which support
> such a data processing style?
Sorry you lost me. What are we talking about?
This discussion mentions constructs with globbing *.txt and passing
their basenames as parameter to another script ... while worrying
about the performance of stripping off the directories part of each
item.
When globbing in such shell, you easily hit the maximum command line
length of the shell, here:
$ xargs -r --show-limits </dev/null 2>&1 | grep '^Maximum .* actually use:'
Maximum length of command we could actually use: 2089058
Furthermore, many file systems do not scale very
well with several hundred thousand of files inside a directory.
So how many files do you have: thousands, millions?
And if the files are furtherly processed by an external script, why should
a simple `basename` or ${name##*/} hurt the performance?
AFAICS your best bet is still based on find(1).
Have a nice day,
Berny
- Re: Determination of file lists from selected folders without returning directory names, (continued)
Re: Determination of file lists from selected folders without returning directory names, Kaz Kylheku (Coreutils), 2017/07/17
- Re: Determination of file lists from selected folders without returning directory names, SF Markus Elfring, 2017/07/17
- Re: Determination of file lists from selected folders without returning directory names, Kaz Kylheku (Coreutils), 2017/07/17
- Re: Determination of file lists from selected folders without returning directory names, Eric Blake, 2017/07/17
- Re: Determination of file lists from selected folders without returning directory names, SF Markus Elfring, 2017/07/18
- Re: Determination of file lists from selected folders without returning directory names, Kaz Kylheku (Coreutils), 2017/07/18
- Re: Determination of file lists from selected folders without returning directory names, SF Markus Elfring, 2017/07/18
- Re: Determination of file lists from selected folders without returning directory names,
Bernhard Voelker <=
- Re: Determination of file lists from selected folders without returning directory names, SF Markus Elfring, 2017/07/18
- Re: Determination of file lists from selected folders without returning directory names, Bernhard Voelker, 2017/07/18
- Re: Determination of file lists from selected folders without returning directory names, SF Markus Elfring, 2017/07/19
- Re: Determination of file lists from selected folders without returning directory names, Eric Blake, 2017/07/19
- Re: Determination of file lists from selected folders without returning directory names, SF Markus Elfring, 2017/07/19
- Re: Determination of file lists from selected folders without returning directory names, Eduardo Bustamante, 2017/07/19