bug-findutils
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[bug #29512] [feature request] xargs parallel processing env-val improve


From: James Youngman
Subject: [bug #29512] [feature request] xargs parallel processing env-val improvement
Date: Sat, 10 Apr 2010 20:53:13 +0000
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US) AppleWebKit/533.2 (KHTML, like Gecko) Chrome/5.0.342.7 Safari/533.2

Update of bug #29512 (project findutils):

                Severity:              3 - Normal => 1 - Wish               
             Assigned to:                    None => jay                    

    _______________________________________________________

Follow-up Comment #1:

I believe I understand your use case.   However, whichever way you slice it,
xargs is the wrong tool for this job.

At the bottom end, this kind of job is best solved with a site- or task-
specific script (or for trivial cases, with ssh(1), batch(1) and taskset(1)). 
 At the top end, you need a much more sophisticated cluster management system
(because as N gets large, you start needing to worry about machine
replacement, storage bandwidth, workload repartitioning, etc.)

xargs just isn't going to evolve into anything resembling a job queueing
system, let alone a cluster-management system.

For the use cases you have outlined, I'd suggest you make use of some
purpose-built scripts.    If such scripts are made very unwieldy by xargs'
lack of a feature that is simple and yet likely to be generally useful, please
go ahead and suggest a specific change.



    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?29512>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/





reply via email to

[Prev in Thread] Current Thread [Next in Thread]