[Beowulf] Docker in HPC

Bernard Li bernard at vanhpc.org
Tue Nov 26 15:49:15 PST 2013


Hi Joe:

You can also run Spark on Docker:

https://amplab.cs.berkeley.edu/2013/10/23/got-a-minute-spin-up-a-spark-cluster-on-your-laptop-with-docker/

Cheers,

Bernard

On Tue, Nov 26, 2013 at 4:04 PM, Joe Landman
<landman at scalableinformatics.com> wrote:
> I know there was some discussion of this previously, and I wanted to
> point out this update
>
> http://blog.docker.io/2013/11/docker-0-7-docker-now-runs-on-any-linux-distribution/
>
> Interesting that the AUFS dependence is now not blocking things.
>
> Hopefully I'll get a chance to play with it in a few weeks in an HPC
> context, to see what the container performance cost is (if anything).
> Hopefully quite low.
>
> If someone has already done this, please post a link.
>
> This is an OS level virtual system.  Not a hypervisor, or a paravisor,
> so it *should*, in theory, be lower latency.  It looks like we can
> generate Docker files trivially from a machine specification in Tiburon,
> though we are very JSON centric these days.
>
>
>
> --
> Joseph Landman, Ph.D
> Founder and CEO
> Scalable Informatics, Inc.
> email: landman at scalableinformatics.com
> web  : http://scalableinformatics.com
> twtr : @scalableinfo
> phone: +1 734 786 8423 x121
> cell : +1 734 612 4615
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf



More information about the Beowulf mailing list