Why Data Center Design and Innovation Matters Michael Ponke Principal, DCE Practice Professional Services October 07, 2009
Why Data CenterDesign and Innovation Matters
Michael PonkePrincipal, DCE Practice Professional Services
October 07, 2009
Copyright © 2008 Sun Microsystems, Inc. 2
Agenda●The Eco Challenge● Data Center rEvolution
●Why Data Center Design and Innovation Matters●Close
Copyright © 2008 Sun Microsystems, Inc. 4
Powering a Server
Source: DOE, Paul Scheihing
Cooling Equipment
Server Load/Computing Operations
Power Conversions & Distribution
33 units delivered
35 units
100 units
Copyright © 2008 Sun Microsystems, Inc. 5
DataCenters
The IT Energy Spectrum
VolumeServers
OfficeComputersLaptops
Copyright © 2008 Sun Microsystems, Inc. 7
ClimateSaversCompu<ngTheGreenGrid
FacilityPowerInfrastructureCoolingInfrastructureITequipment‐largeservers‐storage,network,telephony“Insidethewalls”
ITequipment‐desktop,laptop‐PSUefficiency‐motherboardefficiency
‐Vendors‐Enterprise
users ‐Individualusers
Volumeservers
Copyright © 2008 Sun Microsystems, Inc. 8
EPA Report to Congress – Server & Data Center Energy Efficiency
Source: EPA Report to Congress on Server and Data Center Energy Efficiency
Copyright © 2008 Sun Microsystems, Inc. 9
Eco-Friendly Products and
Services
INNOVATE ACT SHARE
Environmentally Conscious Operations
Applying Transparency
and Open Source to
Environmental Challenges
Eco Responsibility at Sun
Copyright © 2008 Sun Microsystems, Inc. 10
Systems & Storage
Processor & Desktop
Sun Innovation: Driving Efficiency at Every Level
Datacenter
VIRTUALIZATION
Copyright © 2008 Sun Microsystems, Inc. 11
Act: Sustainability at Work at Sun●Open work–Reducing economic and ecological costs of commuting–Lowered annual CO2 emissions by est. 30,000 tons●Sun Ray Thin Clients–Desktop runs on shared server resulting in carbon savings and lower maintenance costs●Efficient Data Centers–Innovative modular design–Consolidation and virtualization–Technology upgrades
Copyright © 2008 Sun Microsystems, Inc. 13
Eco Ready KitsEco Services
SuiteDatacenter
Solutions BriefsSun Ray
Open Work
Broad solutions for Economicand Energy-Efficient Computing
Eco Expertise
Eco CommunityEco Partners
Eco Products Eco Computing
Innovating for Eco Computing
Sun Can Address Your Eco Challenges
Copyright © 2008 Sun Microsystems, Inc. 15
Moore’s Law in Action
Performance~150k tpm ~300k tpm
64 Threads in 1997E10K
128 Threads, 16 Cores5140
Size1&½ Footprint Full Rack
Power(Systems at peak utilization)9620 Watts 30 kWatts
Weight1,800 lbs. ~2200 lbs.
720Weach
30x42
2x per5140
zv
768 Cores, 28.5kW6048
Copyright © 2008 Sun Microsystems, Inc. 16
A different perspective
Server440 Watt Server3,942 kWh/year5.3 Tonnes CO2
Auto TravelToyota Camry15,000 m/year
5.3 Tonnes CO2
Air TravelCommercial Airliner
Vancouver-Toronto (7 trips)5.2 Tonnes CO2
A single server is responsible for about the same amount of CO2 as a typical automobile driven for a year
Usuallyon
24x7
Copyright © 2008 Sun Microsystems, Inc. 17
A different perspectiveA single server is responsible for about the same amount of CO2 as a typical automobile driven for a year
Usuallyon
24x7
=
Copyright © 2008 Sun Microsystems, Inc. 18
A different perspectiveA single server is responsible for about the same amount of CO2 as a typical automobile driven for a year
Usuallyon
24x7 BUTMoore's Law Mandates
Efficiency Gains
Automotive Equivalent Efficiency, 10 year period
163 MPG!
=
Copyright © 2008 Sun Microsystems, Inc. 19
Industry Average is Between 4-6kw/cabinet; 30kw Skyscrapers will be Integrated; Must Deal with mixed load environment
Reality: Heterogeneous Data Centers
Copyright © 2008 Sun Microsystems, Inc. 20
A group of racks or benches with a common hot or cold aisle used as a building block to simplify datacenter design for power, cooling, and
cabling
The POD Architecture
Vendor Independent, Slab or Raised Floor,Flexible, Scalable, High Density
Copyright © 2008 Sun Microsystems, Inc. 21
The POD Architecture
Vendor Independent,
Slab or Raised Floor, Flexible, Scalable, High
Density
Copyright © 2008 Sun Microsystems, Inc. 22
Sun Blueprint•First Chapter (Modularity) Released June 10, 2008•Second Chapter (Electrical) Released 03/2009•Total of nine chapters to be released over the next 12 months•Download: http://sun.com/blueprints
Copyright © 2008 Sun Microsystems, Inc. 23
China, India, UK, Czech Republic, Norway
Global Consolidation•64% Datacenter space compression> 202k ft2 to 74k ft2
•Scalable/Future Proof> 9MW to 21MW (SCA)•Largest Liebert/APC installs•15 Buildings to 2•152 Datacenters to 14•$1.2M Utility Rebates $250k Innovation Award•39% more efficient than ASHRAE std (.489 kW/ton)•Reduced opex 30%
Copyright © 2008 Sun Microsystems, Inc. 24
Typical Data Center
•573 kW less support power compared to industry PUE target (2)*•36% More efficient than the industry PUE target and almost 50% better that industry PUE average (2.5)*•$400,000 Annual opex savings compared to typical data center ($0.08/kWh)
SCA11-1500 Software Datacenter PUELoad kW % of Total Load
IT Load 798 78.02%Chiller Plant 126 12.28%RC/CRAC Loads 39 3.84%
UPS/Transformer Loss 39 3.86%Lighting 20 2.00%Total Load 1023Total Support Loads 225
PUE 1.28DciE 78%
Target Datacenter PUELoad kW % of Total Load*
IT Load 798 50.00%Chiller Plant 399 25.00%RC/CRAC Loads 192 12.00%
UPS/Transformer Loss 160 10.00%Lighting 48 3.00%Total Load 1596Total Support Loads 798
PUE 2.00DciE 50%
*Source: EYP Mission Critical Facilities Inc., New York
SCA11-1500 Power Use
IT Load
Lighting
UPS/Transformer Loss
RC/CRAC Loads
Chiller Plant
* Industry average & target from uptime institute: http://www.datacenterknowledge.com/archives/2008/Jan/22/case_study_ups_green_data_center.html
Power Usage Effectiveness (PUE)SCA11-1500 Data Center Efficiency Benchmark
IT Load
Lighting
UPS/Transformer Loss
RC/CRAC Loads
Chiller Plant
Copyright © 2008 Sun Microsystems, Inc. 25
China, India, UK, Czech Republic, Norway
Colorado DC Consolidation• 66% space compression• 496k ft2 to 126k ft2• Scalable/Future Proof>7MW to 10MW• First & Largest Liebert XD dynamic cooling installs• • • • •
•Largest, most complex & costly consolidation in Sun's history•66% Datacenter compression > 496k ft2 to 126k ft2
•Scalable/Future Proof> 7MW to 10MW•First & Largest Liebert XD dynamic cooling install•Water treatment saves 600k gallons a year, eliminates chemicals•Waterside economizer, free cooling > 1/3 of year.•Compressed 165k ft2 raised floor to <700 ft2 ($4M Cost Avoidance)•Flywheel UPS, eliminates batteries.•Chillers 32% more efficient at avg load than ASHRAE std•2 ACE Awards•Removed 1M kWh per month
Copyright © 2008 Sun Microsystems, Inc. 26
University of Laval; Quebec, Canada CLUMEQ
High Performance Computing Center • Size: 6,000sf
• Power Density: 24Kw per Rack
• Facility: Adaptive Reuse Renovation – Particle Accelerator Silo
• Design: Circular POD Compilation
• Innovation: Waste Heat Recapture to be utilized as heat source for other parts of building.
• Completion Date: August 2009
SiloFacilityRendering