[Beowulf] Storage Best Practices

Tim Cutts tjrc at sanger.ac.uk
Mon Feb 19 08:08:13 PST 2018

No policy here.  People can keep stuff as long as they like.  I don’t agree with that lack of policy, but that’s where we are.

We did propose a 90 day limit, about 10 years ago.  It lasted about, er, 90 days, before faculty started screaming.  ☺


On 19/02/2018, 15:31, "Beowulf on behalf of Skylar Thompson" <beowulf-bounces at beowulf.org<mailto:beowulf-bounces at beowulf.org> on behalf of skylar.thompson at gmail.com<mailto:skylar.thompson at gmail.com>> wrote:

For our larger groups, we'll meet with them regularly to discuss their space usage (and other IT needs). Even that's unlikely to be frequent enough, so we direct usage alerts to their designated "data manager" if they're getting close to running out of space. Aside from regularly clearing out scratch space, though, we try to stay out of deletion decisions, to avoid problems stemming from miscommunication between the group and IT, or even within the group (left hand doesn't know what the right hand is doing).

On Mon, Feb 19, 2018 at 6:12 AM, Richter, Brian J {BIS} <Brian.J.Richter at pepsico.com<mailto:BrianJ.Richter at pepsico.com>> wrote:
Hey All,

I was hoping to get some recommendations for Storage. Last year we set up our first HPC and I’m looking for a good strategy moving forward for Storage. We set up a dedicated space on the cluster for Storage that has 5.5 TB of space. This space can be quickly chewed up depending on the project the business is working on. Do you guys typically do a retention policy on the cluster to ensure there is always enough space? I was thinking anything older than a month should be cleaned up.


Brian J. Richter
Global R&D Senior Analyst • Information Technology
617 W Main St, Barrington, IL 60010
Office: 847-304-2356<tel:(847)%20304-2356> • Mobile: 847-305-6306<tel:(847)%20305-6306>
Brian.J.Richter at pepsico.com<mailto:Brian.J.Richter at pepsico.com>

Beowulf mailing list, Beowulf at beowulf.org<mailto:Beowulf at beowulf.org> sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

 The Wellcome Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20180219/5ef82f55/attachment.html>

More information about the Beowulf mailing list