Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] distributed file storage solution?

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Anand Vaidya anandvaidya.ml at gmail.com
Tue Dec 12 20:15:45 PST 2006


On Saturday 09 December 2006 10:36, samit wrote:
> hello list,
>
> i am looking for a application (most preferably, but not necessarily OSS or
> free software) and that can create distributed, reliable, fault tolerant,
> decentralized, high preformance file server. I've looked at few P2P file
> storing solutions that store multiple copies of file in different server
> for data reliability but i havent found any solution that would help me
> access a file as flexibly like the local file with high preformance. Cross
> platform solution would be even better as i want to aovoid the SMB overhead
> if its just a linux based solution!
>
> PLEASE RECOMENT ME SOMETHING!? feel free to suggest any solutions that even
> qualifies half of this criteria!

Have you considered G-FARM? http://datafarm.apgrid.org

OpenSource Grid filesystem by the Japanese researchers.

I did a proof-of-concept for my customer a year ago. There was also a talk on 
G-FARM by Osamu Tatebe at SC2006...

GFARM (Grid File System) stores metadata on an LDAP server and is able to 
replicate files on multiple data/file servers. They recommend you "bring" the 
compute job to the host containing (probably) large files rather than staging 
files in and out.


Regards
Anand


>
> -bipin

-- 
------------------------------------------------------------------------------
Regards,
Anand Vaidya



More information about the Beowulf mailing list