[Beowulf] scheduler and perl

[Xu, Jerry]

Hi, Thanks, Joe.
 I am not meaning to "ban" anything immediately, I am just curious how often
this happen to the HPC community.
Perl/shell is really strong tool, one example is to use loop to submit huge
mount of jobs and puts burden on scheduler server, the other example is to have
one job sit idle and frequently to use system call to detect the job status and
resubmit jobs again and again; the other example is that use system call and ssh
to each node and run stuff and bypass the scheduler... It just drives me crazy
sometime. 

 How do you guys handle issue like this?

Jerry

-----Original Message-----
From: Joe Landman [mailto:landman at scalableinformatics.com]
Sent: Tuesday, August 01, 2006 5:24 PM
To: Xu, Jerry
Cc: beowulf at beowulf.org
Subject: Re: [Beowulf] scheduler and perl


Hi Jerry:

   Its generally a good idea to talk to your users, understand what it 
is they are doing, and see if you can help them, rather than simply 
"banning" things.  The result of bans of deeply embedded practices 
usually results in some ... exciting ... meetings, emails, and telephone 
calls.

   That said, we use, and our products quite a bit of Perl to submit 
jobs, and it works fine.  If you are running into particular issues, why 
not discuss them here, and likely you will get lots of good answers back.


Joe

Xu, Jerry wrote:
> Hi, I am maintaining a cluster while lots user uses perl to submit tons of
jobs
> which seems to me like abusing the system.
> 
> Does everybody meet the same situation? Many user us system call in the perl
to
> do "qsub", shall I ban this? I don't know exactly why it is bad, but it looks
to
> me really bad. Anybody can give me a good reason to ban it with better
> explanation?
> 
> Sincerely
> 
> Protein
> 
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf


-- 

Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics LLC,
email: landman at scalableinformatics.com
web  : http://www.scalableinformatics.com
phone: +1 734 786 8423
fax  : +1 734 786 8452 or +1 866 888 3112
cell : +1 734 612 4615