[Beowulf] transcode Similar Video Processing on Beowulf?

Adam DeConinck ajdecon at ajdecon.org
Tue Apr 15 18:21:45 PDT 2014


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Larry, (actually including the beowulf list this time)

> Are there standard packages to manage keeping a collection of daemon servers running on
> a cluster, and then managing the connections handled by those servers?

The Aurora scheduler from Twitter (now Apache) is apparently designed 
specifically to deal with long-running services in this manner. 
https://aurora.incubator.apache.org/
 
Interestingly, Aurora runs under the Mesos framework, which is sort of a
meta-cluster-manager for sharing hardware resources between different
types of compute clusters. For example, a Mesos cluster might manage a
Hadoop cluster, an Aurora cluster, and a Torque cluster and shift
resources between them depending on need. https://mesos.apache.org/

I haven't managed to set up either Mesos or Aurora yet to play with
them, but sometime when I get a free weekend... ;-)

Cheers,
Adam

- -- 
Adam DeConinck
Email: ajdecon at ajdecon.org | Twitter: @ajdecon
Web: https://www.ajdecon.org/
PGP key: https://www.ajdecon.org/ajdecon-key.txt

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.12 (Darwin)

iQEcBAEBCgAGBQJTTdsnAAoJEGqxms5cZfz0hvAH/3W/TjkcSrzX80iM0TBJxyDT
wUPi5AEMR+negGVE0Oz2kcY6iMIi3rpTOGg2OYs53hAbYFKI4pSq9DQmfvstZ1vI
ZWPTh0db9SUXYeI/vznJ4XAQzE17tLLWTJjtRRxT4Bn/MUFBiwSVrKAEhpuA8POR
+1kRPx2Labhwl1vyo3qaZfWmQ+UGtcuQrjvZnKX8EtYPlnUVMU+001FUpiHVebNe
ExIdbkOwK9+csfXwURvje/+h62FWUN+yzX9AJUplVRL4At4T/A2CMHK4D1AGeUcw
bOpiQrLA3Xs0kTUmwMSbD6L9iEdQZQM36Ubmrj/u2L1Vy87xcZdWIsXKgq9XfZo=
=Iett
-----END PGP SIGNATURE-----



More information about the Beowulf mailing list