[Beowulf] distributed file storage solution?

[Robin Harker]

Hi Craig, 

>Do you have it running?  If so, how many nodes (targets) do you
have connected?  If you have it running in redundant mode, have you
measured the performance difference between RAID0 and RAID5?

The most targets we have tested was 27 (yes a strange number), and over a
single GigE saw 2.7GB/sec using IOZONE. The internal disc is RAID5 using
SATA HW RAID controllers, no RAID0 although it would of course work.

Using TG-HA (RapidScale-HA perhaps ;-)  ) you see about 30% drop in write
performance, but reads are similar to the standard product. 

The thing we have really noticed is the filesystem/meta-data performance
gains when using the XFS filesystem version. Remember it doesn't have a
metadata control node as with Lustre, soit scales as you add targets. 

Best regards

Robin


It's now called Rapidscale.  I heard that when they were bought out by 
Rackable, they had a name conflict in the US and had to change it.

Craig

Robin Harker
www.rackable.com
Tel: 01494 724498
Cell: 07802 517059
RapidScale - High Performance Storage - One Brick at a Time
 
 

-----Original Message-----
From: Craig Tierney [mailto:ctierney at hypermall.net] 
Sent: 12 December 2006 14:51
To: robin at workstationsuk.co.uk
Cc: Mark Hahn; beowulf at beowulf.org
Subject: Re: [Beowulf] distributed file storage solution?

Robin Harker wrote:
> TerraGrid is high performance, low CPU overhead and with the XFS version,
> (TG2) excellent metadata performance. e.g. gets use with real time
> databases, and can be designed with no single point of failure.
> 

Do you have it running?  If so, how many nodes (targets) do you
have connected?  If you have it running in redundant mode, have you
measured the performance difference between RAID0 and RAID5?

It's now called Rapidscale.  I heard that when they were bought out by 
Rackable, they had a name conflict in the US and had to change it.

Craig


> Robin
> 
> 
>> Mark Hahn wrote:
>>>> You can look into OpenAFS but be warned that you have to know
>>>> infrastructure software quite well (LDAP+kerberos). It's
>>>> cross-platform, can
>>>> be distributed but don't think it's up to multiple writes on different
>>>> mirrors though.
>>> and Lustre is parallel, high-performing and somewhat reliable/FT, but is
>>> not decent/distributed (it's client-server).
>> Lustre supports redundant meta-data servers (MDS) and failover for the
>> object-storage servers (OSS).  However, "high-performing" is relative.
>> Great at streaming data, not at meta-data.
>>
>> Craig
>>
>>
>>> _______________________________________________
>>> Beowulf mailing list, Beowulf at beowulf.org
>>> To change your subscription (digest mode or unsubscribe) visit
>>> http://www.beowulf.org/mailman/listinfo/beowulf
>>>
>> _______________________________________________
>> Beowulf mailing list, Beowulf at beowulf.org
>> To change your subscription (digest mode or unsubscribe) visit
>> http://www.beowulf.org/mailman/listinfo/beowulf
>>
> 
> 
> Robin Harker
> Workstations UK Ltd
> DDI: 01494 787710
> Tel: 01494 724498
> 
> 


__________ NOD32 1916 (20061212) Information __________

This message was checked by NOD32 antivirus system.
http://www.eset.com