[Beowulf] Create cluster : questions
bli at bcgsc.ca
Thu Sep 7 11:26:30 PDT 2006
For those who are interested in this discussion, I'd like to point you
to the openSUSE Build Service (in alpha stage):
They have a web GUI/CLI for performing automatic builds of packages and
they not only support SUSE Linux but also other distributions like
Fedora, Mandriva, Debian and Ubuntu in x86 and x86_64 configurations.
I am currently maintaining some HPC-related packages via the service.
> -----Original Message-----
> From: beowulf-bounces at beowulf.org
> [mailto:beowulf-bounces at beowulf.org] On Behalf Of Ed Hill
> Sent: Thursday, September 07, 2006 6:44
> To: Maxence Dunnewind
> Cc: beowulf at beowulf.org
> Subject: Re: [Beowulf] Create cluster : questions
> On Mon, 4 Sep 2006 21:23:03 +0200
> "Maxence Dunnewind" <maxenced at gmail.com> wrote:
> > Hi.
> > i'm a user of the Ubuntu Linux OS, and also a packager for this OS.
> > As you may know , packaging can be take a lot of time, mainly
> > during building process.
> > I would create a public cluster for help packagers. All Ubuntu
> > users can accept we use their computers on the cluster. But the
> > cluster system MUST only use free ressource of this computers (and
> > maybe user could set a quota)...
> > i want people only have to install some software (no kernel
> > compilation or other things).
> > I want know if beowulf could works in this case ????
> Hi Maxence,
> Have you looked at distcc? Its probably closest to what you're
> I help out with Fedora Extras so I can certainly appreciate the time
> that goes into compiling packages! It would be nice to have a
> distributed build system with per-compilation-unit (eg. per-object-
> file) granularity. But I'm afraid it may be a somewhat complicated
> task for, for instance, Fedora Extras since the FE build system uses
> a chroot-ed environment (the "mock" package) to ensure build
> cleanliness and the presence of all the needed dependencies. Maybe
> NFS-mounting the chroot would be sufficient...?
> If you split up the work on a per-package and per-architecture basis
> (i386, x86-64, ppc, etc.) then its relatively (!) straight-forward to
> build a cluster with the necessary hardware and perform builds of
> separate packages/arches on a simultaneous (each in different chroots
> on potentially different machines) basis. Thats exactly what the
> current Fedora Extras build system (called "plague") does. You can
> see some details at:
> And I only discuss Fedora Extras because its what I'm familiar with.
> I'd be curious to hear how build systems work for other distros!
> Edward H. Hill III, PhD | ed at eh3.com | http://eh3.com/
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe)
> visit http://www.beowulf.org/mailman/listinfo/beowulf
More information about the Beowulf