[Beowulf] what is the "best" file system

[Xu, Jerry]

Hi, all:

  We are going to build new cluster and we are thinking about various solutions
for file I/O. We have lots embarrassed parallel applications that read huge data
(giga byte) only in the beginning and write only at the end concurrently, and
each node run job independently. What is the best file storage system for case
like this?--- I really would like to listen to some experts..if there are some
warm-hearted guru.

Jerry


-----Original Message-----
From: Joe Landman [mailto:landman at scalableinformatics.com]
Sent: Tuesday, August 01, 2006 5:24 PM
To: Xu, Jerry
Cc: beowulf at beowulf.org
Subject: Re: [Beowulf] scheduler and perl


Hi Jerry:

   Its generally a good idea to talk to your users, understand what it 
is they are doing, and see if you can help them, rather than simply 
"banning" things.  The result of bans of deeply embedded practices 
usually results in some ... exciting ... meetings, emails, and telephone 
calls.

   That said, we use, and our products quite a bit of Perl to submit 
jobs, and it works fine.  If you are running into particular issues, why 
not discuss them here, and likely you will get lots of good answers back.


Joe

Xu, Jerry wrote:
> Hi, I am maintaining a cluster while lots user uses perl to submit tons of
jobs
> which seems to me like abusing the system.
> 
> Does everybody meet the same situation? Many user us system call in the perl
to
> do "qsub", shall I ban this? I don't know exactly why it is bad, but it looks
to
> me really bad. Anybody can give me a good reason to ban it with better
> explanation?
> 
> Sincerely
> 
> Protein
> 
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf


-- 

Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics LLC,
email: landman at scalableinformatics.com
web  : http://www.scalableinformatics.com
phone: +1 734 786 8423
fax  : +1 734 786 8452 or +1 866 888 3112
cell : +1 734 612 4615