Compile farm?

[Jakob Østergaard]

On Fri, Nov 02, 2001 at 04:42:07PM -0400, David Bremner wrote:
> Ron Chen writes:
>  > What you need is a batch system.
>  > 
>  > There are 2 free batch systems, SGE and PBS.
>  > 
> [good info snipped]
> 
> It is not obvious that a batch system is the best answer to this 
> particular problem.
> 
> Mosix (www.mosix.org) may be more appropriate for providing a single
> system image.

I tried this with Mosix.

Problem is - mosix migrates jobs after a while. Initially a compiler
takes up a few megabytes of memory, but "after a while" it has grown
to hundreds of megabytes. When mosix decides to migrate the compiler
it will spend a long time on the netowrk to move the large process
image.

There's some patch to make that integrates it with Mosix, but I didn't
try that out.

Instead, I implemented  http://unthought.net/antsd  which will distribute your
compilers efficiently to the proper nodes.   It's not very sophisticated, but
it does the job for me at least  :)

-- 
................................................................
:   jakob at unthought.net   : And I see the elder races,         :
:.........................: putrid forms of man                :
:   Jakob Østergaard      : See him rise and claim the earth,  :
:        OZ9ABN           : his downfall is at hand.           :
:.........................:............{Konkhra}...............: