Multi-core CPU’s April 9, 2008. Multi-Core at BNL First purchase of AMD dual-core in 2006 First purchase of Intel multi-core in 2007 –dual-core in early.

Multi-core CPU’s

April 9, 2008

Multi-Core at BNL

• First purchase of AMD dual-core in 2006• First purchase of Intel multi-core in 2007

– dual-core in early 2007– quad-core in late 2007

• Motivated to migrate to multi-core – power, space issues– steep ramp-up for ATLAS

Expected Computing Capacity Evolution

010000200003000040000500006000070000

FY' 0

6

FY' 0

7

FY' 0

8

FY' 0

9

FY' 1

0

FY' 1

1

FY' 1

2

KSI2

K RHICUSATLAS

Recent SI2K ResultsCPU OS SI2K/server SI2K/Watt

Xeon 3.4 GHz SL 3.0.3 2690 8.86

Xeon 3.4 GHz SL 4.4 2818 9.28

Opteron 265 SL 3.0.5 4676 19.55

Opteron 2216 SL 4.4 5876 22.78

Opteron 2218 SL 4.4 6140 22.74

Opteron 2220 SE SL 4.4 7148 21.66

Woodcrest 5150 SL 4.4 10124 36.68

Clovertown 5355 SL 4.4 15968 47.24

Harpertown 5430 SL 4.4 21840 76.63

Evolution of Space Usage

0

1000

2000

3000

4000

5000

6000

7000

Usa

ge o

f Dat

a C

ente

r (s

q. ft

.)

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008(est.)

2009(est.)

2010(est.)

2011(est.)

2012(est.)

Capacity of current data center

Intel dual and quad-core deployed

Evolution of Power Usage

0

200

400

600

800

1000

1200

1400

1600

Pow

er U

sage

(kW

)

2003 2004 2005 2006 2007 2008(est.)

2009(est.)

2010(est.)

2011(est.)

2012(est.)

Existing UPS Capacity

Benchmark ComparisonCPU SpecInt2000 Gain

(%)ATLAS script (secs.)

Gain (%)

SpecRate ATLAS rate test (secs.)

Xeon 3.4 GHz 1409 (2 cores) -- 7738 -- 29.6 7891

Opteron 265 (1.8 GHz) 1169 (4 cores) -17.0 7889 -2.0 44.7 8006

Xeon 5150 (2.6 GHz) 2531 (4 cores) 116.5 4968 37.0 101 5145

Xeon 5335 (2.0 GHz) 1996 (8 cores) -21.1 6525 -31.3 148 7024

Xeon 5440 (2.8 GHz) 2862 (8 cores) 43.4 4121 36.8 212 4723

CPU SpecInt2000 Gain (%)

PHENIX/STAR apps (secs.)

Gain (%) SpecRate PHENIX/STAR apps (secs.)

Opteron 265 (1.8 GHz) 1169 (4 cores) -- 36838/9743 -- 44.7 /13726

Xeon 5345 (2.0 GHz) 2266 (8 cores) 93.8 23264/6155 36.8/36.8 164 24309/8521

Xeon 5430 (2.6 GHz) 2730 (8 cores) 20.5 17570/5243 24.5/14.8 199 18444*/7068

Multi-Core & Facility Operations

• Migration to multi-core has many advantages– physical consolidation– performance gains– virtualization

• And also some disadvantages– more complicated facility operations– cost of licensed software– network/memory requirements

Condor configuration for ATLAS

Virtualization

Software Stack on a Virtualized System

Application

Domain 0 (Basic OS for virtualization support)

Virtual Domain # 1

Virtual Domain # 2

Software Testbed

Application Application

Near-Term Developments

• 1st purchase of Intel quad-core Harpertown (5400 series) soon at the RACF

• AMD Barcelona quad-core available now (1 year late – competitive with Intel Clovertown)

• Incremental improvements to Harpertown in 2008• Intel Nehalem (next-generation chip on 45 nm

technology) available 2nd-half of 2008 – 1- 8 (or more) cores/cpu

• More info available by SC-08 in Austin (Nov. 08)

Summary

• Significant SI2K/Watt gains with multi-core• Performance improvements not linear with core

count• ATLAS/RHIC benchmark test results generally

differ somewhat from SI2K• Increasing network bandwidth requirements for

multi-core (gigE line rate for 8 cores/server)• Other challenges ahead with multi-core cpu’s