[Beowulf] interesting article on HPC vs evolution of 'big data' analysis

Greg Lindahl lindahl at pbm.com
Wed Apr 8 18:56:43 PDT 2015


On Wed, Apr 08, 2015 at 03:57:34PM -0400, Scott Atchley wrote:

> There is concern by some and outright declaration by others (including
> hardware vendors) that MPI will not scale to exascale due to issues like
> rank state growing too large for 10-100 million endpoints,

That's weird, given that it's an implementation choice.

Presumably Intel is keeping the PathScale tiny rank state as a
feature?

Reliability, now that's a serious issue! And not one that's trivially
fixed for any problem that must be tightly-coupled.

-- greg



More information about the Beowulf mailing list