Difference between revisions of "BXadmin:Power"

From CCGB
Jump to: navigation, search
(June 09, 2011)
(PDUs)
 
(8 intermediate revisions by 2 users not shown)
Line 4: Line 4:
  
 
= PDUs =
 
= PDUs =
 +
{{Power/PDU/header|
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-3
 +
| ups = plugged into outlet CRP2-9
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-18
 +
| rack = Rack 3
 +
| ups = UPS-8
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-19
 +
| ups = UPS-8
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-20
 +
| ups = UPS-8
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-21
 +
| ups = UPS-7
 +
}}
 +
 +
{{Power/PDU/entry
 +
| pdu = PDU-23
 +
| ups = UPS-14
 +
}}
 +
 +
}}
  
 
= Measurements =
 
= Measurements =
 +
Conversions used:
 +
* 1 watt = 3.41214 BTU/h
 +
* 1 ton = 12,000 BTU/h
 +
 +
Therefor, 1 ton = 3516.854 watts
 +
 +
== Jun 02, 2010 ==
 +
 +
These measurements were performed by OPP area electricians on June 2, 2010.
  
== OPP Panel measurements ==
 
=== Jun 02, 2010 ===
 
 
Panel CRP
 
Panel CRP
 
* A = 0
 
* A = 0
Line 42: Line 83:
 
* Room 509 tons = 9.36 tons
 
* Room 509 tons = 9.36 tons
  
= June 09, 2011 =
+
== June 09, 2011 ==
* RACK-1 =
+
''''NOTE:'''' Many of the numbers in []'s (the currents) are estimates, and others are subject to changed based on machine workload. Numbers that were observed directly were taken from the no-load steady-state condition.
** PDU-18[8+5 @208] -> UPS-13 -> SB5/14-16 =
 
** ((zeus + pc9) -> PDU-14) + mulligan + jayne) -> UPS-12 =
 
  
* RACK-2 =
+
* RACK-1 = 3680W
 +
** PDU-18[8+5 @208] -> UPS-13 -> SB5/14-16 = 2704W
 +
** ((zeus[3.4 @120 + pc9[.5 @120]) -> PDU-14) + mulligan[3 @120] + jayne[1 @120]) -> UPS-12 = 940W
 +
 
 +
* RACK-2 = 2260W
 
** (ift-1 + comandra) -> PDU-19 -> UPS-15 -> P509/5-7 = 1000W
 
** (ift-1 + comandra) -> PDU-19 -> UPS-15 -> P509/5-7 = 1000W
** xraid -> UPS-9 =  
+
** xraid[2 @120] -> UPS-9 = 240W
** (herbie[] + pc4[] + horvitz[] + tortuga[]) -> UPS-10 =  
+
** (herbie[3 @120] + pc4[.5 @120] + horvitz[3 @120] + tortuga[2 @120]) -> UPS-10 = 1020W
 +
 
 +
* RACK-3 = 3536W
 +
** (galaxy nodes + pc8) -> PDU-20[11+6 @208] -> UPS-8 -> SB5/15-17 = 3536W
  
* RACK-3 =  
+
* RACK-4 = 5158W
** (galaxy nodes + pc8) -> PDU-20[11+6 @208] -> UPS-8 -> SB5/15-17 =  
+
** (PDU-21[8+11 @208] + thumper[5.8 @208])-> UPS-7 -> SB5/21-23 = 5158W
  
* RACK-4 =
+
* RACK-5 = 5784
** (PDU-21[8+11 @208] + thumper[5.8 @208])-> UPS-7 -> SB5/21-23 =  
+
** 12*dell_nodes[2] -> PDU-17[@120] = 2880W
 +
** (1/2md1k-big[4] + 1/2s1-array[2] + 1/2md1k-1[2] + 1/2md1k-4[2] + 1/2md1k-5[2] + 1/2c14[1.6]) -> UPS-5[@120] = 1632W
 +
** (c8[2] + foundry[.5] + pc7[.5] + 1/2s1-array[2] + 1/2md1k-4[2] + 1/2md1k-6[2] + 1/2c14[1.6]) -> UPS-6[@120] -> CRP2-16 = 1272W
  
* RACK-5 =
+
* RACK-6 = 8970W
** 12*dell_nodes[2 @120] -> PDU-17 =
+
** (node007..node012)[6*1.5] -> PDU-6 -> CRP2-11 = 1080W
** (1/2md1k-big + s1-array + 1/2md1k-1 + 1/2md1k-4 + 1/2md1k-5 + 1/2c14) -> UPS-5
+
** (node001..node006)[6*1.5] -> PDU-7 = 1080W
** (c8 + foundry + pc7 + s1-array + 1/2md1k-4 + 1/2md1k-6 + 1/2c14) -> UPS-6 -> CRP2-16
+
** (node013 + node014 + node015..node018)[6*1.5] -> PDU-8 -> CRP2-1 = 1080W
 +
** (node025..node032)[8*1.5] -> PDU-9 -> CRP2-14 = 1440W
 +
** (node019..node024)[6*1.5] -> PDU-10 = 1080W
 +
** (1/2lux[1] + 1/2s2[1] + 1/2s3[1] + 1/2md1k-3[2] + 1/2linne[.75] + 1/2xraid[1]) -> UPS-2[@120] = 810W
 +
** (1/2xraid[1] + 1/2s2[1] + 1/2s3[1] + 1/2lux[1] + 1/2md1k-3[2] + 1/2md1k-2[2]) -> UPS-3 = 960W
 +
** (1/2md1k-2[2] + 1/2md1k-1[2] + 1/2md1k-5[2] + 1/2md1k-6[2] + 1/2md1k-big[4]) -> UPS-4 = 1440W
  
* RACK-6 =
+
* RACK-7 = 8940W
** (node007..node012) -> PDU-6 -> CRP2-11
+
** (okinawa[4] + switch[.5]) -> PDU-4[@120] -> UPS-1 = 540W
** (node001..node006) -> PDU-7
+
** (9 okinawa nodes)[9*4] -> PDU-5[@120] -> P509/6-8 = 4320W
** (node013 + node014 + node015..node018) -> PDU-8 -> CRP2-1
+
** (7 okinawa nodes)[7*4] -> PDU-22[@120] -> CRP2/15-17 = 3360W
** (node025..node032) -> PDU-9 -> CRP2-14
+
** (huck md1k[4] and PE2850[2]) -> CRP2/11[@120] = 720
** (node019..node024) -> PDU-10
 
** (1/2lux + 1/2s2 + 1/2s3 + 1/2md1k-3 + 1/2linne + 1/2xraid) -> UPS-2
 
** (1/2xraid + 1/2s2 + 1/2s3 + 1/2lux + 1/2md1k-3 + 1/2md1k-2) -> UPS-3
 
** (1/2md1k-2 + 1/2md1k-1 + 1/2md1k-5 + 1/2md1k-6 + 1/2md1k-big) -> UPS-4
 
  
* RACK-7 =
+
* RACK-8 = 624W
** (okinawa + switch) -> PDU-4 -> UPS-1
+
** PDU-23[2+1 @208] -> UPS-14 -> P509/9-11 = 624W
** (9 okinawa nodes) -> PDU-5 -> P509/6-8
 
** (7 okinawa nodes) -> PDU-22 -> CRP2/15-17
 
** (huck md1k and PE2850) -> CRP2/11
 
  
* RACK-8 =
+
TOTAL = 38952W = 11.08 tons
** PDU-23[2+1 @208] -> UPS-14 -> P509/9-11
+
If we subtract linne (5760W = 1.63 tons), that number comes down to 33192W = 9.44 tons. Currently half of linne is powered down, meaning we're currently using ~10.3 tons.
  
 
= machine current reference =
 
= machine current reference =
Line 88: Line 134:
 
* carbonite = 3.7A x2 @120V
 
* carbonite = 3.7A x2 @120V
 
* v880 2/3 power supplies, 3 CPU boards = ~5A x2 @120V
 
* v880 2/3 power supplies, 3 CPU boards = ~5A x2 @120V
 +
* v210 = .12A standby, 1.5A idle, 1.7A pk @120V
  
 
<pre>(10) PE 1950 - 2x Quad Core 2.83GHz, 16GB RAM, 146GB 15K 3.5" SAS, 1 PS
 
<pre>(10) PE 1950 - 2x Quad Core 2.83GHz, 16GB RAM, 146GB 15K 3.5" SAS, 1 PS

Latest revision as of 12:58, 13 September 2012

Panels

UPSes

PDUs

PDU UPS Rack
PDU-3 plugged into outlet CRP2-9  ?
PDU-18 UPS-8 Rack 3
PDU-19 UPS-8  ?
PDU-20 UPS-8  ?
PDU-21 UPS-7  ?
PDU-23 UPS-14  ?

Measurements

Conversions used:

  • 1 watt = 3.41214 BTU/h
  • 1 ton = 12,000 BTU/h

Therefor, 1 ton = 3516.854 watts

Jun 02, 2010

These measurements were performed by OPP area electricians on June 2, 2010.

Panel CRP

  • A = 0
  • B = 0
  • C = 0
  • VA_total = 0

Panel CRP2

  • A = 55A
  • B = 45A
  • C = 60A
  • VA_total = 19200VA

Panel P509

  • A = 1.7A
  • B = 11A
  • C = 12.6A
  • VA_total = 3036VA

Panel SB5

  • A = 10A
  • B = 42A
  • C = 37A
  • VA_total = 10680VA

VA was calculated assuming Line-Neutral voltage of 120V, and assuming no neutral current.

Room 509 VA_total = 32916 VA

Assuming VA = W (PF should not affect heat dissipation)...

  • Room 509 BTU/h = 112309 BTU/h
  • Room 509 tons = 9.36 tons

June 09, 2011

'NOTE:' Many of the numbers in []'s (the currents) are estimates, and others are subject to changed based on machine workload. Numbers that were observed directly were taken from the no-load steady-state condition.

  • RACK-1 = 3680W
    • PDU-18[8+5 @208] -> UPS-13 -> SB5/14-16 = 2704W
    • ((zeus[3.4 @120 + pc9[.5 @120]) -> PDU-14) + mulligan[3 @120] + jayne[1 @120]) -> UPS-12 = 940W
  • RACK-2 = 2260W
    • (ift-1 + comandra) -> PDU-19 -> UPS-15 -> P509/5-7 = 1000W
    • xraid[2 @120] -> UPS-9 = 240W
    • (herbie[3 @120] + pc4[.5 @120] + horvitz[3 @120] + tortuga[2 @120]) -> UPS-10 = 1020W
  • RACK-3 = 3536W
    • (galaxy nodes + pc8) -> PDU-20[11+6 @208] -> UPS-8 -> SB5/15-17 = 3536W
  • RACK-4 = 5158W
    • (PDU-21[8+11 @208] + thumper[5.8 @208])-> UPS-7 -> SB5/21-23 = 5158W
  • RACK-5 = 5784
    • 12*dell_nodes[2] -> PDU-17[@120] = 2880W
    • (1/2md1k-big[4] + 1/2s1-array[2] + 1/2md1k-1[2] + 1/2md1k-4[2] + 1/2md1k-5[2] + 1/2c14[1.6]) -> UPS-5[@120] = 1632W
    • (c8[2] + foundry[.5] + pc7[.5] + 1/2s1-array[2] + 1/2md1k-4[2] + 1/2md1k-6[2] + 1/2c14[1.6]) -> UPS-6[@120] -> CRP2-16 = 1272W
  • RACK-6 = 8970W
    • (node007..node012)[6*1.5] -> PDU-6 -> CRP2-11 = 1080W
    • (node001..node006)[6*1.5] -> PDU-7 = 1080W
    • (node013 + node014 + node015..node018)[6*1.5] -> PDU-8 -> CRP2-1 = 1080W
    • (node025..node032)[8*1.5] -> PDU-9 -> CRP2-14 = 1440W
    • (node019..node024)[6*1.5] -> PDU-10 = 1080W
    • (1/2lux[1] + 1/2s2[1] + 1/2s3[1] + 1/2md1k-3[2] + 1/2linne[.75] + 1/2xraid[1]) -> UPS-2[@120] = 810W
    • (1/2xraid[1] + 1/2s2[1] + 1/2s3[1] + 1/2lux[1] + 1/2md1k-3[2] + 1/2md1k-2[2]) -> UPS-3 = 960W
    • (1/2md1k-2[2] + 1/2md1k-1[2] + 1/2md1k-5[2] + 1/2md1k-6[2] + 1/2md1k-big[4]) -> UPS-4 = 1440W
  • RACK-7 = 8940W
    • (okinawa[4] + switch[.5]) -> PDU-4[@120] -> UPS-1 = 540W
    • (9 okinawa nodes)[9*4] -> PDU-5[@120] -> P509/6-8 = 4320W
    • (7 okinawa nodes)[7*4] -> PDU-22[@120] -> CRP2/15-17 = 3360W
    • (huck md1k[4] and PE2850[2]) -> CRP2/11[@120] = 720
  • RACK-8 = 624W
    • PDU-23[2+1 @208] -> UPS-14 -> P509/9-11 = 624W

TOTAL = 38952W = 11.08 tons If we subtract linne (5760W = 1.63 tons), that number comes down to 33192W = 9.44 tons. Currently half of linne is powered down, meaning we're currently using ~10.3 tons.

machine current reference

  • zeus = 1.7A x2 @120V
  • carbonite promise sata RAID = 0.75A x2 @120V
  • carbonite = 3.7A x2 @120V
  • v880 2/3 power supplies, 3 CPU boards = ~5A x2 @120V
  • v210 = .12A standby, 1.5A idle, 1.7A pk @120V
(10) PE 1950 - 2x Quad Core 2.83GHz, 16GB RAM, 146GB 15K 3.5" SAS, 1 PS
        powered off - 0.26A @120V pk, 0.16A @120V avg
        OS running, no load - 1.85A @120V pk, 1.73A @120V avg
        OS running, make -j32 - 2.73A @120V pk, 2.25A @120V avg

(32) linne darwin compute node
        powered off - 0.20A @120V pk, 0.10A @120V avg
        OS running, no load - 1.40A @120V pk, 1.15A @120V avg
        OS running, forked du -hs /scratch - 1.83A @120V pk, 1.65A @120V avg

(2) Xserve RAID
        7.6A/3.6A

(4) MD1K - 12x 3.5" SATA
        2x C13
        2.00A @208V

Foundry EdgeIron
        48W (.4A@120, .2A@208)

(10) Okinawa and compute nodes, 8x Xeon
        4.0A@120, 2.0A@208

SunFire 480R - 2x 1.2GHz US3+, 8GB (pilica)
        3.2A@120

StorEdge 3300
        1.5A@120

OptiPlex GX240 (minidb)
        3/1.5 ?

(10) PowerEdge 2650 (galaxy cnode)
        2.5A@120, 1.25A@208

PE 2950 - 8x2.83GHz, 32gb, 6x 3.5" SATA (baker)
        4A/2A

PE 2950 - 8x2.83GHz, 32gb, 4x 2.5" SAS (badger)
        3.74A/1.87A

PE 2970 - 8xAMD 2356, 16gb, 6x 3.5" sata (apollo)
        3.3A/1.65A

IBM x3550 - 4x3.0GHz Xeon 5160, 32gb (atlas)
        ~3A/1.5A ?

(2) IBM x3550 - 8x3.16GHz Xeon 5460, 32gb (c10, c11)
        ~4A/2A ?

IBM x3550 - 4x2.66GHz Xeon 5150, 32gb (frisell)
        ~3A/1.5A ?

Relion 230 - 4x2.8GHz Xeon, 2gb, 6x 3.5" PATA (horvitz)
        ~3/1.5A ?

Relion 140 - 4x2.8GHz Xeon, 3gb, 1x 146GB U320 scsi (tortuga)
        ~2A/1A ?

Altus 3150 - 2xAMD 250, 4gb, bunch o' sata (herbie)
        ~3A/1.5A ?

Relion 2000 - 4x2.8GHz Xeon, 4gb, 3ware 9500s-8 (8 3.5" sata) (scofield)
        ~3/1.5 ?

Altus 1300 - 2xAMD 256, 8gb, 2x 3.5" sata (mulligan)
        ~3/1.5 ?

IBM x3455 - 4x AMD 2218, 4gb, ? (coltrane)
        ~3/1.5 ?

IBM DS4200 - 8x 3.5" SATA, 2x 4Gb FC RAID
        ~4/2 ?

Sun x4540 (thumper)
        10/5.8