[Beowulf] scheduler and perl
YXU11 at PARTNERS.ORG
Tue Aug 1 14:36:54 PDT 2006
Hi, Thanks, Joe.
I am not meaning to "ban" anything immediately, I am just curious how often
this happen to the HPC community.
Perl/shell is really strong tool, one example is to use loop to submit huge
mount of jobs and puts burden on scheduler server, the other example is to have
one job sit idle and frequently to use system call to detect the job status and
resubmit jobs again and again; the other example is that use system call and ssh
to each node and run stuff and bypass the scheduler... It just drives me crazy
How do you guys handle issue like this?
From: Joe Landman [mailto:landman at scalableinformatics.com]
Sent: Tuesday, August 01, 2006 5:24 PM
To: Xu, Jerry
Cc: beowulf at beowulf.org
Subject: Re: [Beowulf] scheduler and perl
Its generally a good idea to talk to your users, understand what it
is they are doing, and see if you can help them, rather than simply
"banning" things. The result of bans of deeply embedded practices
usually results in some ... exciting ... meetings, emails, and telephone
That said, we use, and our products quite a bit of Perl to submit
jobs, and it works fine. If you are running into particular issues, why
not discuss them here, and likely you will get lots of good answers back.
Xu, Jerry wrote:
> Hi, I am maintaining a cluster while lots user uses perl to submit tons of
> which seems to me like abusing the system.
> Does everybody meet the same situation? Many user us system call in the perl
> do "qsub", shall I ban this? I don't know exactly why it is bad, but it looks
> me really bad. Anybody can give me a good reason to ban it with better
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics LLC,
email: landman at scalableinformatics.com
web : http://www.scalableinformatics.com
phone: +1 734 786 8423
fax : +1 734 786 8452 or +1 866 888 3112
cell : +1 734 612 4615
More information about the Beowulf