[Beowulf] Torrents for HPC

[Bernd Schubert]

On 06/09/2012 02:06 AM, Bill Broadley wrote:
>
> I've built Myrinet, SDR, DDR, and QDR clusters ( no FDR yet), but I
> still have users whose use cases and budgets still only justify GigE.
>
> I've setup a 160TB hadoop cluster is working well, but haven't found
> justification for the complexity/cost related to lustre.  I have high
> hopes for Ceph, but it seems not quite ready yet.  I'd happy to hear
> otherwise.
>

What about an easy to setup cluster file system such as FhGFS? As one of 
its developers I'm a bit biased of course, but then I'm also familiar 
with Lustre, an I think FhGFS is far more easiy to setup. We also do not 
have the problem to run clients and servers on the same node and so of 
our customers make heavy use of that and use their compute nodes as 
storage servers. That should a provide the same or better throughput as 
your torrent system.

Cheers,
Bernd