<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>While I agree with you in principle, one also has to deal with
the reality as you find yourself in. In our case we have more
experience with Lustre than Ceph in an HPC and we got burned
pretty badly by Gluster. While I like Ceph in principle I haven't
seen it do what Lustre can do in a HPC setting over IB. Now it
may be able to do that, which is great. However then you have to
get your system set up to do that and prove that it can. After
all users have a funny way of breaking things that work amazingly
well in controlled test environs, especially when you have no
control how they will actually use the system (as in a research
environment). Certainly we are working on exploring this option
too as it would be awesome and save many headaches.<br>
</p>
<p>Anyways no worries about you being a smartarse, it is a valid
point. One just needs to consider the realities on the ground in
ones own environment.</p>
<p>-Paul Edmon-<br>
</p>
<br>
<div class="moz-cite-prefix">On 07/24/2018 10:31 AM, John Hearns via
Beowulf wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAPqNE2WNu-4cFHCAo=brNSWHCTmb7OGGBMb9kEmwUzMyq-jJbA@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=utf-8">
<div dir="ltr">
<div>Forgive me for saying this, but the philosophy for software
defined storage such as CEPH and Gluster is that forklift
style upgrades should not be necessary.</div>
<div>When a storage server is to be retired the data is copied
onto the new server then the old one taken out of service.
Well, copied is not the correct word, as there are
erasure-coded copies of the data. Rebalanced is probaby a
better word.</div>
<div><br>
</div>
<div>Sorry if I am seeming to be a smartarse. I have gone
through the pain of forklift style upgrades in the past when
storage arrays reach End of Life.</div>
<div>I just really like the Software Defined Storage mantra - no
component should be a point of failure.<br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Beowulf mailing list, <a class="moz-txt-link-abbreviated" href="mailto:Beowulf@beowulf.org">Beowulf@beowulf.org</a> sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit <a class="moz-txt-link-freetext" href="http://www.beowulf.org/mailman/listinfo/beowulf">http://www.beowulf.org/mailman/listinfo/beowulf</a>
</pre>
</blockquote>
<br>
</body>
</html>