[Beowulf] [External] Spark, Julia, OpenMPI etc. - all in one place

Guy Coates guy.coates at gmail.com
Tue Oct 13 05:52:14 PDT 2020


> .  mpi is becoming a bit
> like cobol.  everyone claims it's dead, but yet it's still around
>
>
Having just spent some time looking at parallelising some ML/AI workloads,
it was enlightening to see that as you scratch beneath the various
frameworks like pytorch or horovod, you find...MPI. And RDMA. And workloads
that can quickly become IO bound.  Plus ca change...

Guy
-- 
Dr. Guy Coates
+44(0)7801 710224
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20201013/b8abb80e/attachment.html>


More information about the Beowulf mailing list