NCCU 1 Copyright 2008 ITRI 工業技術研究院 1 Cloud Computing: Where Do We Go from Here? Tzi-cker Chiueh (闕志克) Cloud Computing Research Center for Mobile Applications (CCMA) 雲端運算行動應用研究中心
NCCU1
Copyright 2008 ITRI 工業技術研究院
1
Cloud Computing: Where Do We Go from Here?
Tzi-cker Chiueh (闕志克)
Cloud Computing Research Center for Mobile Applications (CCMA)雲端運算行動應用研究中心
NCCU2
Copyright 2008 ITRI 工業技術研究院
Cloud computing is hot!
But where is the $$ for Taiwan?
NCCU 3
Cloud Computing Basics
• “It’s cloud illusions I recall; I really don’t know clouds at all”
--- Both Sides Now, Joni Mitchell
• Our definition– Centralization of IT infrastructures– Usage-based resource allocation and charging
• Enabling technologies– HW/SW to build and run very large data centers
efficiently– Scalable, reliable and secure cloud services– Faster Internet connectivity
NCCU 4
Cloud Service Models
• Infrastructure as a Service (IaaS)– A set of virtual machines with storage space and external network
bandwidth unfurnished apartment
– Example: Amazon Web Service
• Platform as a Service (PaaS)– An operating environment including (application-specific) libraries
and supporting services (DBMS, AAA) furnished apartment
– Example: Google’s App Engine, Microsoft’s Azure, IBM’s XaaS
• Software as a Service (SaaS)– Turn-key software hosted on the cloud and accessible through the
browser hotel
– Example: salesforce.com, and all major desktop software vendors
NCCU 5
Cloud Computing Food Chain
End User
Cloud Service User
Enterprise IT DepartmentWeb Application DeveloperSaaS Provider
Enterprise UserConsumerSaaS User
Mega Data CenterSoftware Provider
Cloud Service Provider Mega Data Center OperatorCloud Application Platform Provider
IaaS, PaaS
SaaS
Mega Data CenterHardware Provider
HW SW
NCCU 6
Taiwan’s Positioning in CloudComputing Food Chain
• Just end user?• Sophisticated cloud service user or cloud application
developer? Exportable?• Operate its cloud service provider?
– Data confidentiality concern (especially for E-government service)
• Serve as a major cloud service provider in a geographical region?– Sufficient bandwidth and connectivity?– Climate and geology factors are against us
• Become a major HW/SW solution provider for cloud service providers?– data center hardware component total data center solution– ITRI/CCMA’s bet here
NCCU 7
Microsoft’s Container-based DataCenter in Chicago
NCCU 8
Inside the Container
NCCU 9
Cloud-Scale Data Center
• > 10,000 servers $50M USD apiece• Technology components:
– Container computer: Optimal HW building block for constructing a cloud data center
– Cloud OS: An end-to-end software stack that runs cloud applications and operates a cloud data center
– Non-ICT technology: seismic, fire, physical security, etc.– Integration/operation know-how: Operational
experiences and expertise for putting together and running a cloud-scale data center
NCCU 10
Data Center Solution Provider• Cloud Hardware Platform
– Servers (HP/Dell)– Storage arrays: primary and secondary (EMC/NetApp)– Network switches: LAN and SAN (Cisco/Juniper/Brocade)– Front-end Appliances:
• IPS/Firewall/NAT (Checkpoint)• Traffic Shaper (Packeteer)• Server Load Balancer (F5)• Multi-Homing Load Balancer (BIG-IP)
• Cloud Software Platform– Hypervisor (VMware, Citrix, Microsoft)– Virtualization management (VMware, Citrix, Microsoft)– Storage management (EMC, NetApp, HDS, IBM, Symantec)– Backup/replication (Symantec)– Data center automation + energy management (Tivoli, CA, BMC, HP)– Security (Symantec, Cisco, McAfee)
• Non-ICT – Power: Electricity distribution network (Delta/Emerson)– Cooling: Thermal management (APC)– Facilities: Fire, seismic, battery, physical security– Regulations
NCCU 11
Data Center Design Trends
• Containerization– Best HW packaging for cloud data centers
• Server Server rack container warehouse• Commodity HW only, not a supercomputer
– More efficient power distribution and thermal design– Unification of computing, memory, network and storage resources
• Virtualization of all HW resources: Software-definable boundaries
– Faster deployment: no on-premise installation needed– Requires light-out operation
• Google-style data center design– End-to-end redundancy
• Failure is a common case
NCCU 12
Missing Links
• Goal: Enable Taiwan to build data centers for the world • Container Computer 1.0
– Manageable container computer– Differences between a set of servers/switches/storage boxes and a
container computer? • Scalable storage/network architecture• System management software• Energy-efficient cooling
• Cloud Operating System 1.0– End-to-end data center software stack for supporting a AWS-like
service on a set of commodity HW– Tight integration of storage, resource, security and system/network
management
• First prototype of both expected at the end of 2010
NCCU 13
Container Computer 1.0
• Objective: Physical data center in a box• Architecture Design Principles:
– Commodity HW only• No storage box, appliance or accelerator
– System-wide optimization• Component vs. self-contained system• server container computer warehouse computer
• Major features:– All-layer-2 data center network architecture– Scalable internet appliance logic– Touch cooling-based thermal management
NCCU 14
Cloud Operating System 1.0Objective: Multiplexing virtual data centers on a physical data center
– No. of VM instances each with CPU performance and memory size requirement– Shared storage space requirement– External network bandwidth requirement– VPN setting– Firewall/IDS/IPS rules– Server load balancing policy– Public IP addresses– Network configuration, including DNS and DHCP– OS and application image
Design Goals: – Very very very very… easy to manage for both physical and virtual data
center administrators – Ability to hide HW failures from applications– Intelligent data center-wide power management– Multi-tenancy security– Scalability across all workloads
NCCU 15
Components in Cloud OS 1.0
Physical InfrastructureManagementTool (Dell)
Inter-PM Load Balancingand VM Fail-over (VMware)
Virtual Data Center Provisioning (VMware)
Power Management(Tivoli)
Inter-VM LoadBalancing (F5)
Network/SystemManagement
(Tivoli)
Security (Checkpoint)
Virtual Data Center Management Tool
Physical Compute Servers
All-layer-2 Network
Distributed Main/Secondary Storage
Primary/SecondaryStorage Management
(EMC)
NCCU 16
Cloud OS 1.0 Summary
• World’s first integrated data center software stack that – Integrates storage management, virtualization management,
system/network management, security, and power management – Targets at cloud-scale data centers and supports virtual data center-
based IaaS
• Competitions: – Virtual Computing Environment Coalition (Acadia): Cisco, EMC, and
VMware– Microsoft/HP Cloud Alliance
NCCU 17
Where CCMA Adds Value
IaaS
PaaS
Servers Storage Arrays Power DistributionSwitches
+Scalable System Architecture System Management Cooling
Cloud Hardware Platform
Hypervisor Virtualization Management Storage Management Security
Backup/Replication Data Center Automation Energy Management
Cloud System Software Platform
LAMP .NET WebSphere WebLogic Google App Engine
Cloud Application Middleware Platform
Local
ITRI
International
SaaS EMR Smart Grid Automated CloudificationApplications
NCCU 18
Evolution Path
Container Computer Component ODM
Container Computer OEM Container Computer ODM
Total Container Computer Solution Provider
Cloud Data Center System Integrator
Cloud Data Center System Integrator with Operator Know-how
Pow
er G
enerato
rP
ower
Plant
Total S
olutionP
rovider
Profit Margin
Taiwanese Companies’
World-wide IT Center
Asia Pacific Data and
Application Backup
NCCU 19
Success Criteria
• Bring up Taiwan’s computer HW industry to rise to the cloud computer era– A Taiwan-spec container computer that powers cloud-
scale data centers in the world
• Jump-start Taiwan’s systems software industry– A Taiwan-based cloud OS company that provide end-to-
end software stack solutions to cloud data centers in the world
• Container computer ODM Red Hat Huawei
NCCU 20
雲端運算產業發展方案15項計畫
FY98~FY10 /7.5 億元財政部14.優質經貿網絡-關港貿單一窗口計畫
FY99~ FY103/3.6億元經濟部國際貿易局11.推動貿易便捷安全雲端服務計畫
FY100~FY102/13.17億元財政部12.電子發票雲端服務
FY99~FY102/39.92億元財政部13.賦稅資訊系統整合再造更新整體實施計畫
FY99~FY103 / 7.78 億元國科會15.科技研發雲端運算服務平台計畫
FY99~FY103/6.98億元經濟部工業局5.雲端運算產業應用計畫
FY99~FY103/15億元經濟部技術處4.跨國企業研發中心及六大新興產業雲端服務旗艦計畫
計畫名稱 主責單位 期程/經費(共240億元)
1.雲端運算科技與產業技術發展計畫 經濟部技術處 FY99~FY103/37.2億元
2.研發實驗與公益用途資料中心 經濟部技術處 FY99~FY103/1.25億元
3.雲端運算旗艦公司計畫 經濟部技術處 FY99~FY103/10億元
6.建置政府雲端網路基礎服務 行政院研考會 FY100~FY103/65億元
7.防救災業務雲端服務 內政部消防署 FY100~FY103/4億元
8.教育雲端服務 教育部 FY99~FY103/16.5億元
9.全國路網車速資訊交通雲計算基礎建設 交通部 FY100~103/6億元
10.推動中小企業運用雲端服務 經濟部中小企業處 FY100~FY103/6.1億元
NCCU 21
International Competition Landscape• United States:
– Holds dominant position in all cloud computing segments– No industrial development policy
• European Union– Leverages strength in telecom equipment/service business and focuses
on “cloud service systems”for carriers• Japan
– Digital Japan Creation Project; Kasumigaseki cloud– NEC, Fujitsu, Hitachi enter the Cloud Infrastructure space
• Korea– National Computing and Information Agency : 40 agencies’IT
departments consolidated by December 2007 – Carefully chosen cloud applications/services: IPTV, Green Internet Café,
Mobile device, Smart Grid, On-line gaming, Tele-commuting, etc. • China
– Being formulated – Huawei has already grabbed most of China Mobile’s data center
businesses
NCCU 22
Conclusion
• Cloud computing is all about consolidation of IT infrastructures and usage-based resource allocation
• Most on-premise applications will eventually be cloudified
• Cloud-scale data center industry is emerging
• ITRI’s integrated data center solution, Container Computer 1.0 + Cloud OS 1.0, is expected to provide 80% of the functionalities at 1/2 cost of current market-leading solutions