[Beowulf] [External] Spark, Julia, OpenMPI etc. - all in one place

Oddo Da oddodaoddo at gmail.com
Thu Oct 15 04:22:30 PDT 2020


On Tue, Oct 13, 2020 at 8:25 AM Benson Muite <benson_muite at emailplus.org>
wrote:

> A typical university cluster can run a data science workload with Spark,
> Hadoop etc., just requires Admins to make this possible. Systems like
> Comet are made for this kind of work:
> https://portal.xsede.org/sdsc-comet


Thank you, I was unaware of this.

Once jobs start using tens to hundreds of thousands of cores hours,
> taxpayer money (probably also the environment) is saved by writing in a
> low level language.
>

That's an interesting thought, thanks.

A small number of countries design entirely new systems and train their
> students write/port software for them - much as happened with bleeding
> edge systems 20 years ago:)
>

Can you provide some examples? I am curious about this. Thanks!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20201015/59c53b44/attachment.html>


More information about the Beowulf mailing list