[Beowulf] Power draw of cluster nodes under heavy load

[Michael Di Domenico]

I can't go into specifics.  with HPL i usually can't top 80-85% of
full power draw per cabinet.  we have cabinets ranging from 17kw,
25kw, and 35kw.  some of our user codes can push the machines to 90%
of full load.  this is shown on both amd 4-socket nodes and intel
dual-socket with gpu's.  we're running 208v three phase to the racks
and 208v single phase to each server

On Mon, Jul 28, 2014 at 1:29 PM, Jeff White <jaw171 at pitt.edu> wrote:
> Power draw will vary greatly depending on many factors.  Where I am at we
> currently have 16 racks of HPC equipment (compute nodes, storage, network
> gear, etc.) using about 140kVA but can use up to 160 kVA.  A single rack
> with 26 compute nodes each with 64 cores worth of AMD 6276 (Supermicro
> boxes) is using about 18 kW across the PDUs, 3 phase at 240 volts, with most
> of the nodes at 100% CPU usage.
>
> Jeff White - GNU+Linux Systems Administrator
> University of Pittsburgh - CSSD
>
>
> On 07/28/2014 10:51 AM, Prentice Bisbal wrote:
>>
>> Beowulfers,
>>
>> Are any of you monitoring the power draw on your clusters? If so, can
>> any of you provide me with some statistics on your power draw under
>> heavy load? Ideally, I'm looking for the power load for a worst-case
>> scenario, such as running HPL, on a per-rack basis. If you can provide
>> me with the power draw and a description of the hardware, that would be
>> great.
>>
>> I have some numbers from a friend who lurks on this list, but the more
>> data points I have, the better I can justify my power requirements for a
>> new cluster purchase I'm working on.
>>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
> http://www.beowulf.org/mailman/listinfo/beowulf