[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Some question about excute parallel
From: |
Ole Tange |
Subject: |
Re: Some question about excute parallel |
Date: |
Fri, 17 Jan 2020 03:57:43 +0100 |
On Thu, Jan 16, 2020 at 10:08 AM 王懿杰 <address@hidden> wrote:
:
> recently ,i use parallel to excute many jobs at same time. But there is
> something bothering me.
>
> i got a command-list file which contain about 35000 commands, and it
> should output 35000 results as i designed.
>
> Then i just type the command : parallel --jobs 100 < command-list
>
> after some time, i found i got more than 35000 results in my directory.
>
> Is my command wrong?
Please follow this. It makes it possible to help you:
Report bugs to <address@hidden> or
https://savannah.gnu.org/bugs/?func=additem&group=parallel
See a perfect bug report on
https://lists.gnu.org/archive/html/bug-parallel/2015-01/msg00000.html
Your bug report should always include:
· The error message you get (if any). If the error message is
not from GNU parallel you need to show why you think GNU
parallel caused these.
· The complete output of parallel --version. If you are not
running the latest released version (see
http://ftp.gnu.org/gnu/parallel/) you should specify why
you believe the problem is not fixed in that version.
· A minimal, complete, and verifiable example (See
description on http://stackoverflow.com/help/mcve).
It should be a complete example that others can run that
shows the problem including all files needed to run the
example. This should preferably be small and simple, so try
to remove as many options as possible. A combination of
yes, seq, cat, echo, and sleep can reproduce most errors.
If your example requires large files, see if you can make
them by something like seq 1000000 > file or yes | head -n
10000000 > file.
If your example requires remote execution, see if you can
use localhost - maybe using another login.
If you have access to a different system, test if the MCVE
shows the problem on that system.
· The output of your example. If your problem is not easily
reproduced by others, the output might help them figure out
the problem.
· Whether you have watched the intro videos
(http://www.youtube.com/playlist?list=PL284C9FF2488BC6D1),
walked through the tutorial (man parallel_tutorial), and
read the EXAMPLE section in the man page (man parallel -
search for EXAMPLE:).
If you suspect the error is dependent on your environment or
distribution, please see if you can reproduce the error on
one of these VirtualBox images:
http://sourceforge.net/projects/virtualboximage/files/
http://www.osboxes.org/virtualbox-images/
Specifying the name of your distribution is not enough as you
may have installed software that is not in the VirtualBox
images.
If you cannot reproduce the error on any of the VirtualBox
images above, see if you can build a VirtualBox image on
which you can reproduce the error. If not you should assume
the debugging will be done through you. That will put more
burden on you and it is extra important you give any
information that help. In general the problem will be fixed
faster and with less work for you if you can reproduce the
error on a VirtualBox.
/Ole