Difference between revisions of "BXadmin:Power"

From CCGB
Jump to: navigation, search
(PDUs)
 
(15 intermediate revisions by 2 users not shown)
Line 4: Line 4:
  
 
= PDUs =
 
= PDUs =
 +
{{Power/PDU/header|
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-3
 +
| ups = plugged into outlet CRP2-9
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-18
 +
| rack = Rack 3
 +
| ups = UPS-8
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-19
 +
| ups = UPS-8
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-20
 +
| ups = UPS-8
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-21
 +
| ups = UPS-7
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-23
 +
| ups = UPS-14
 +
}}
 +
 +
}}
  
 
= Measurements =
 
= Measurements =
 +
Conversions used:
 +
* 1 watt = 3.41214 BTU/h
 +
* 1 ton = 12,000 BTU/h
 +
 +
Therefor, 1 ton = 3516.854 watts
 +
 +
== Jun 02, 2010 ==
 +
 +
These measurements were performed by OPP area electricians on June 2, 2010.
  
== OPP Panel measurements ==
+
Panel CRP
=== Jun 02, 2010 ===
 
CRP
 
 
* A = 0
 
* A = 0
 
* B = 0
 
* B = 0
 
* C = 0
 
* C = 0
VA_total = 0
+
* VA_total = 0
  
CRP2
+
Panel CRP2
 
* A = 55A
 
* A = 55A
 
* B = 45A
 
* B = 45A
 
* C = 60A
 
* C = 60A
VA_total = 19200VA
+
* VA_total = 19200VA
  
P509
+
Panel P509
 
* A = 1.7A
 
* A = 1.7A
 
* B = 11A
 
* B = 11A
 
* C = 12.6A
 
* C = 12.6A
VA_total = 3036VA
+
* VA_total = 3036VA
  
SB5
+
Panel SB5
 
* A = 10A
 
* A = 10A
 
* B = 42A
 
* B = 42A
 
* C = 37A
 
* C = 37A
VA_total = 10680VA
+
* VA_total = 10680VA
 +
 
 +
VA was calculated assuming Line-Neutral voltage of 120V, and assuming no neutral current.
  
 
Room 509 VA_total = 32916 VA
 
Room 509 VA_total = 32916 VA
  
 
Assuming VA = W (PF should not affect heat dissipation)...
 
Assuming VA = W (PF should not affect heat dissipation)...
Room 509 BTU/h = 112309 BTU/h
+
 
Room 509 tons = 9.36 tons
+
* Room 509 BTU/h = 112309 BTU/h
 +
* Room 509 tons = 9.36 tons
 +
 
 +
== June 09, 2011 ==
 +
''''NOTE:'''' Many of the numbers in []'s (the currents) are estimates, and others are subject to changed based on machine workload. Numbers that were observed directly were taken from the no-load steady-state condition.
 +
 
 +
* RACK-1 = 3680W
 +
** PDU-18[8+5 @208] -> UPS-13 -> SB5/14-16 = 2704W
 +
** ((zeus[3.4 @120 + pc9[.5 @120]) -> PDU-14) + mulligan[3 @120] + jayne[1 @120]) -> UPS-12 = 940W
 +
 
 +
* RACK-2 = 2260W
 +
** (ift-1 + comandra) -> PDU-19 -> UPS-15 -> P509/5-7 = 1000W
 +
** xraid[2 @120] -> UPS-9 = 240W
 +
** (herbie[3 @120] + pc4[.5 @120] + horvitz[3 @120] + tortuga[2 @120]) -> UPS-10 = 1020W
 +
 
 +
* RACK-3 = 3536W
 +
** (galaxy nodes + pc8) -> PDU-20[11+6 @208] -> UPS-8 -> SB5/15-17 = 3536W
 +
 
 +
* RACK-4 = 5158W
 +
** (PDU-21[8+11 @208] + thumper[5.8 @208])-> UPS-7 -> SB5/21-23 = 5158W
 +
 
 +
* RACK-5 = 5784
 +
** 12*dell_nodes[2] -> PDU-17[@120] = 2880W
 +
** (1/2md1k-big[4] + 1/2s1-array[2] + 1/2md1k-1[2] + 1/2md1k-4[2] + 1/2md1k-5[2] + 1/2c14[1.6]) -> UPS-5[@120] = 1632W
 +
** (c8[2] + foundry[.5] + pc7[.5] + 1/2s1-array[2] + 1/2md1k-4[2] + 1/2md1k-6[2] + 1/2c14[1.6]) -> UPS-6[@120] -> CRP2-16 = 1272W
 +
 
 +
* RACK-6 = 8970W
 +
** (node007..node012)[6*1.5] -> PDU-6 -> CRP2-11 = 1080W
 +
** (node001..node006)[6*1.5] -> PDU-7 = 1080W
 +
** (node013 + node014 + node015..node018)[6*1.5] -> PDU-8 -> CRP2-1 = 1080W
 +
** (node025..node032)[8*1.5] -> PDU-9 -> CRP2-14 = 1440W
 +
** (node019..node024)[6*1.5] -> PDU-10 = 1080W
 +
** (1/2lux[1] + 1/2s2[1] + 1/2s3[1] + 1/2md1k-3[2] + 1/2linne[.75] + 1/2xraid[1]) -> UPS-2[@120] = 810W
 +
** (1/2xraid[1] + 1/2s2[1] + 1/2s3[1] + 1/2lux[1] + 1/2md1k-3[2] + 1/2md1k-2[2]) -> UPS-3 = 960W
 +
** (1/2md1k-2[2] + 1/2md1k-1[2] + 1/2md1k-5[2] + 1/2md1k-6[2] + 1/2md1k-big[4]) -> UPS-4 = 1440W
 +
 
 +
* RACK-7 = 8940W
 +
** (okinawa[4] + switch[.5]) -> PDU-4[@120] -> UPS-1 = 540W
 +
** (9 okinawa nodes)[9*4] -> PDU-5[@120] -> P509/6-8 = 4320W
 +
** (7 okinawa nodes)[7*4] -> PDU-22[@120] -> CRP2/15-17 = 3360W
 +
** (huck md1k[4] and PE2850[2]) -> CRP2/11[@120] = 720
 +
 
 +
* RACK-8 = 624W
 +
** PDU-23[2+1 @208] -> UPS-14 -> P509/9-11 = 624W
 +
 
 +
TOTAL = 38952W = 11.08 tons
 +
If we subtract linne (5760W = 1.63 tons), that number comes down to 33192W = 9.44 tons. Currently half of linne is powered down, meaning we're currently using ~10.3 tons.
 +
 
 +
= machine current reference =
 +
 
 +
* zeus = 1.7A x2 @120V
 +
* carbonite promise sata RAID = 0.75A x2 @120V
 +
* carbonite = 3.7A x2 @120V
 +
* v880 2/3 power supplies, 3 CPU boards = ~5A x2 @120V
 +
* v210 = .12A standby, 1.5A idle, 1.7A pk @120V
 +
 
 +
<pre>(10) PE 1950 - 2x Quad Core 2.83GHz, 16GB RAM, 146GB 15K 3.5" SAS, 1 PS
 +
        powered off - 0.26A @120V pk, 0.16A @120V avg
 +
        OS running, no load - 1.85A @120V pk, 1.73A @120V avg
 +
        OS running, make -j32 - 2.73A @120V pk, 2.25A @120V avg
 +
 
 +
(32) linne darwin compute node
 +
        powered off - 0.20A @120V pk, 0.10A @120V avg
 +
        OS running, no load - 1.40A @120V pk, 1.15A @120V avg
 +
        OS running, forked du -hs /scratch - 1.83A @120V pk, 1.65A @120V avg
 +
 
 +
(2) Xserve RAID
 +
        7.6A/3.6A
 +
 
 +
(4) MD1K - 12x 3.5" SATA
 +
        2x C13
 +
        2.00A @208V
 +
 
 +
Foundry EdgeIron
 +
        48W (.4A@120, .2A@208)
 +
 
 +
(10) Okinawa and compute nodes, 8x Xeon
 +
        4.0A@120, 2.0A@208
 +
 
 +
SunFire 480R - 2x 1.2GHz US3+, 8GB (pilica)
 +
        3.2A@120
 +
 
 +
StorEdge 3300
 +
        1.5A@120
 +
 
 +
OptiPlex GX240 (minidb)
 +
        3/1.5 ?
 +
 
 +
(10) PowerEdge 2650 (galaxy cnode)
 +
        2.5A@120, 1.25A@208
 +
 
 +
PE 2950 - 8x2.83GHz, 32gb, 6x 3.5" SATA (baker)
 +
        4A/2A
 +
 
 +
PE 2950 - 8x2.83GHz, 32gb, 4x 2.5" SAS (badger)
 +
        3.74A/1.87A
 +
 
 +
PE 2970 - 8xAMD 2356, 16gb, 6x 3.5" sata (apollo)
 +
        3.3A/1.65A
 +
 
 +
IBM x3550 - 4x3.0GHz Xeon 5160, 32gb (atlas)
 +
        ~3A/1.5A ?
 +
 
 +
(2) IBM x3550 - 8x3.16GHz Xeon 5460, 32gb (c10, c11)
 +
        ~4A/2A ?
 +
 
 +
IBM x3550 - 4x2.66GHz Xeon 5150, 32gb (frisell)
 +
        ~3A/1.5A ?
 +
 
 +
Relion 230 - 4x2.8GHz Xeon, 2gb, 6x 3.5" PATA (horvitz)
 +
        ~3/1.5A ?
 +
 
 +
Relion 140 - 4x2.8GHz Xeon, 3gb, 1x 146GB U320 scsi (tortuga)
 +
        ~2A/1A ?
 +
 
 +
Altus 3150 - 2xAMD 250, 4gb, bunch o' sata (herbie)
 +
        ~3A/1.5A ?
 +
 
 +
Relion 2000 - 4x2.8GHz Xeon, 4gb, 3ware 9500s-8 (8 3.5" sata) (scofield)
 +
        ~3/1.5 ?
 +
 
 +
Altus 1300 - 2xAMD 256, 8gb, 2x 3.5" sata (mulligan)
 +
        ~3/1.5 ?
 +
 
 +
IBM x3455 - 4x AMD 2218, 4gb, ? (coltrane)
 +
        ~3/1.5 ?
 +
 
 +
IBM DS4200 - 8x 3.5" SATA, 2x 4Gb FC RAID
 +
        ~4/2 ?
 +
 
 +
Sun x4540 (thumper)
 +
        10/5.8
 +
</pre>

Latest revision as of 12:58, 13 September 2012

Panels

UPSes

PDUs

PDU UPS Rack
PDU-3 plugged into outlet CRP2-9  ?
PDU-18 UPS-8 Rack 3
PDU-19 UPS-8  ?
PDU-20 UPS-8  ?
PDU-21 UPS-7  ?
PDU-23 UPS-14  ?

Measurements

Conversions used:

  • 1 watt = 3.41214 BTU/h
  • 1 ton = 12,000 BTU/h

Therefor, 1 ton = 3516.854 watts

Jun 02, 2010

These measurements were performed by OPP area electricians on June 2, 2010.

Panel CRP

  • A = 0
  • B = 0
  • C = 0
  • VA_total = 0

Panel CRP2

  • A = 55A
  • B = 45A
  • C = 60A
  • VA_total = 19200VA

Panel P509

  • A = 1.7A
  • B = 11A
  • C = 12.6A
  • VA_total = 3036VA

Panel SB5

  • A = 10A
  • B = 42A
  • C = 37A
  • VA_total = 10680VA

VA was calculated assuming Line-Neutral voltage of 120V, and assuming no neutral current.

Room 509 VA_total = 32916 VA

Assuming VA = W (PF should not affect heat dissipation)...

  • Room 509 BTU/h = 112309 BTU/h
  • Room 509 tons = 9.36 tons

June 09, 2011

'NOTE:' Many of the numbers in []'s (the currents) are estimates, and others are subject to changed based on machine workload. Numbers that were observed directly were taken from the no-load steady-state condition.

  • RACK-1 = 3680W
    • PDU-18[8+5 @208] -> UPS-13 -> SB5/14-16 = 2704W
    • ((zeus[3.4 @120 + pc9[.5 @120]) -> PDU-14) + mulligan[3 @120] + jayne[1 @120]) -> UPS-12 = 940W
  • RACK-2 = 2260W
    • (ift-1 + comandra) -> PDU-19 -> UPS-15 -> P509/5-7 = 1000W
    • xraid[2 @120] -> UPS-9 = 240W
    • (herbie[3 @120] + pc4[.5 @120] + horvitz[3 @120] + tortuga[2 @120]) -> UPS-10 = 1020W
  • RACK-3 = 3536W
    • (galaxy nodes + pc8) -> PDU-20[11+6 @208] -> UPS-8 -> SB5/15-17 = 3536W
  • RACK-4 = 5158W
    • (PDU-21[8+11 @208] + thumper[5.8 @208])-> UPS-7 -> SB5/21-23 = 5158W
  • RACK-5 = 5784
    • 12*dell_nodes[2] -> PDU-17[@120] = 2880W
    • (1/2md1k-big[4] + 1/2s1-array[2] + 1/2md1k-1[2] + 1/2md1k-4[2] + 1/2md1k-5[2] + 1/2c14[1.6]) -> UPS-5[@120] = 1632W
    • (c8[2] + foundry[.5] + pc7[.5] + 1/2s1-array[2] + 1/2md1k-4[2] + 1/2md1k-6[2] + 1/2c14[1.6]) -> UPS-6[@120] -> CRP2-16 = 1272W
  • RACK-6 = 8970W
    • (node007..node012)[6*1.5] -> PDU-6 -> CRP2-11 = 1080W
    • (node001..node006)[6*1.5] -> PDU-7 = 1080W
    • (node013 + node014 + node015..node018)[6*1.5] -> PDU-8 -> CRP2-1 = 1080W
    • (node025..node032)[8*1.5] -> PDU-9 -> CRP2-14 = 1440W
    • (node019..node024)[6*1.5] -> PDU-10 = 1080W
    • (1/2lux[1] + 1/2s2[1] + 1/2s3[1] + 1/2md1k-3[2] + 1/2linne[.75] + 1/2xraid[1]) -> UPS-2[@120] = 810W
    • (1/2xraid[1] + 1/2s2[1] + 1/2s3[1] + 1/2lux[1] + 1/2md1k-3[2] + 1/2md1k-2[2]) -> UPS-3 = 960W
    • (1/2md1k-2[2] + 1/2md1k-1[2] + 1/2md1k-5[2] + 1/2md1k-6[2] + 1/2md1k-big[4]) -> UPS-4 = 1440W
  • RACK-7 = 8940W
    • (okinawa[4] + switch[.5]) -> PDU-4[@120] -> UPS-1 = 540W
    • (9 okinawa nodes)[9*4] -> PDU-5[@120] -> P509/6-8 = 4320W
    • (7 okinawa nodes)[7*4] -> PDU-22[@120] -> CRP2/15-17 = 3360W
    • (huck md1k[4] and PE2850[2]) -> CRP2/11[@120] = 720
  • RACK-8 = 624W
    • PDU-23[2+1 @208] -> UPS-14 -> P509/9-11 = 624W

TOTAL = 38952W = 11.08 tons If we subtract linne (5760W = 1.63 tons), that number comes down to 33192W = 9.44 tons. Currently half of linne is powered down, meaning we're currently using ~10.3 tons.

machine current reference

  • zeus = 1.7A x2 @120V
  • carbonite promise sata RAID = 0.75A x2 @120V
  • carbonite = 3.7A x2 @120V
  • v880 2/3 power supplies, 3 CPU boards = ~5A x2 @120V
  • v210 = .12A standby, 1.5A idle, 1.7A pk @120V
(10) PE 1950 - 2x Quad Core 2.83GHz, 16GB RAM, 146GB 15K 3.5" SAS, 1 PS
        powered off - 0.26A @120V pk, 0.16A @120V avg
        OS running, no load - 1.85A @120V pk, 1.73A @120V avg
        OS running, make -j32 - 2.73A @120V pk, 2.25A @120V avg

(32) linne darwin compute node
        powered off - 0.20A @120V pk, 0.10A @120V avg
        OS running, no load - 1.40A @120V pk, 1.15A @120V avg
        OS running, forked du -hs /scratch - 1.83A @120V pk, 1.65A @120V avg

(2) Xserve RAID
        7.6A/3.6A

(4) MD1K - 12x 3.5" SATA
        2x C13
        2.00A @208V

Foundry EdgeIron
        48W (.4A@120, .2A@208)

(10) Okinawa and compute nodes, 8x Xeon
        4.0A@120, 2.0A@208

SunFire 480R - 2x 1.2GHz US3+, 8GB (pilica)
        3.2A@120

StorEdge 3300
        1.5A@120

OptiPlex GX240 (minidb)
        3/1.5 ?

(10) PowerEdge 2650 (galaxy cnode)
        2.5A@120, 1.25A@208

PE 2950 - 8x2.83GHz, 32gb, 6x 3.5" SATA (baker)
        4A/2A

PE 2950 - 8x2.83GHz, 32gb, 4x 2.5" SAS (badger)
        3.74A/1.87A

PE 2970 - 8xAMD 2356, 16gb, 6x 3.5" sata (apollo)
        3.3A/1.65A

IBM x3550 - 4x3.0GHz Xeon 5160, 32gb (atlas)
        ~3A/1.5A ?

(2) IBM x3550 - 8x3.16GHz Xeon 5460, 32gb (c10, c11)
        ~4A/2A ?

IBM x3550 - 4x2.66GHz Xeon 5150, 32gb (frisell)
        ~3A/1.5A ?

Relion 230 - 4x2.8GHz Xeon, 2gb, 6x 3.5" PATA (horvitz)
        ~3/1.5A ?

Relion 140 - 4x2.8GHz Xeon, 3gb, 1x 146GB U320 scsi (tortuga)
        ~2A/1A ?

Altus 3150 - 2xAMD 250, 4gb, bunch o' sata (herbie)
        ~3A/1.5A ?

Relion 2000 - 4x2.8GHz Xeon, 4gb, 3ware 9500s-8 (8 3.5" sata) (scofield)
        ~3/1.5 ?

Altus 1300 - 2xAMD 256, 8gb, 2x 3.5" sata (mulligan)
        ~3/1.5 ?

IBM x3455 - 4x AMD 2218, 4gb, ? (coltrane)
        ~3/1.5 ?

IBM DS4200 - 8x 3.5" SATA, 2x 4Gb FC RAID
        ~4/2 ?

Sun x4540 (thumper)
        10/5.8