[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Many octave instances

From: Bart Verleye
Subject: Many octave instances
Date: Mon, 18 Nov 2013 09:39:56 +1300
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.0

Dear Octave developers,

We try to run about 8000 octave instances at the same time on our cluster. Running a single job goes perfectly, and takes about 15min. Running up to 300 jobs goes well too. However, more than that, and the program hangs.

From a little debugging, we think the cause is that every octave instance tries to read the directory it was called from, looking for .m files and functions. The directory contains quite a lot of files, and if 8k instances try to read the same file(s), concurrency issues come up (we use gpfs).

Do you think this explanation makes sense? Is there any way I can avoid octave from reading the files in that directory?

Thanks and kind regards,

Dr. Bart Verleye
Centre for e-Research
Level G, Room 409-G21
Auckland 1010
New Zealand
+64 (0) 9 923 9740 ext 89740

reply via email to

[Prev in Thread] Current Thread [Next in Thread]