© 2009 IBM Corporation Cloud Computing and Service Management BSRE Krakow July 2009 Juergen Schneider, Distinguished Engineer, Tivoli Service Process Automation Development
© 2009 IBM Corporation
Cloud Computing and Service Management
BSRE Krakow July 2009
Juergen Schneider, Distinguished Engineer, Tivoli Service Process Automation Development
© 2008 IBM Corporation
Tivoli Software
Agenda
Cloud Computing and Service Management– Definition and major concepts
– Cloud Service Lifecycle
– Cloud Scenarios
– Cloud Computing Architecture
© 2008 IBM Corporation
Tivoli Software
....service oriented and service managed
Attributes
Cloud Computing …
VISIBILITY CONTROL AUTOMATION
“Cloud” is an emerging consumption and delivery model for many IT-based services, in which the user sees only the service, and has no need to know
anything about the technology or implementation
Metering & Billing
Rapid provisioning
Flexible pricing Elastic
scaling
Advanced virtualization
Standardized, consumable
web-delivered services Service
Catalog Ordering
© 2008 IBM Corporation
Tivoli SoftwareCloud Computing deployments and services
4
Infrastructure as a service(virtualized servers, storage, networking)
Applications, Processes and Information as a service
Software platforms as a service(optimized middleware – application servers, database servers, portal servers, etc.)
Public Clouds(provider - Internet)
Enterprise Clouds(data center - Intranet)
Hybrid Clouds(public and private)
Services
© 2008 IBM Corporation
Tivoli Software
Enabling Innovation
Organizations with extensive integration of business & technology grew 5% faster than their peers
Source: IBM Global CEO Study 2006
78% of CEOs believe integrating business and technology is fundamental for innovation
Business and technology integration addresses many top inhibitors to innovation:
ü Limited funding for investmentü Government restrictions
ü Inflexible physical and IT infrastructure
ü Process immaturity
ü Insufficient access to information
IBM Confidential
Definition of the Business Services and IT Strategie
Business Services
Analysis of the App., Infrastructure- und SLA-
Dependencies
Classification
Definition of the Build & Management Plans based
on Best Practices
Service-Design
An Integrated IBM Play
Lifecycle Management of IT Services
Lifecycle Mgmt Lifecycle-Management
TPM
TSM
Director
TSA
ITM/ ITCAM
…
Offering
Sub-scription
Instan-tiation Pro-
ductionTermination
DITS LifecycleManagement for
Application Landscapes
Cross System VirtualizationStack
(Ensembles and Hybrid Systems)
Virtualization
Business Applications & Services
Business Applications & Services
Dynamic Infrastructure and Cloud Computing
System Management
Service Management
What is a ‘Service’
It is likely to be a service…. o if its description and design highlight separate roles for customers, users, providers
and suppliers.
o if the “what” has been separated from the “how”, and we can change the underlying assets - processes, technologies, data – as well as suppliers yet still provide the promised business outcomes and value.
o if it is offered with a pre-defined value proposition stating specific price points and performance metrics tied to business (not just IT operational) outcomes.
o if it is something that makes sense as a customer/user selectable item, with corresponding service requests available in a menu or service catalog.
o if it makes business sense
‘A means of delivering value to customers by facilitating outcomes customers want to achieve without the ownership of specific costs and risks.’
ITIL V3 Glossary
© 2008 IBM Corporation
Tivoli Software
Service Management is at the Heart of the Cloud
Service Processes
• A Process Platform to manage the virtual infrastructure
• Service Processes that deliver the user experience
The effectiveness and efficiency of a cloud implementation is predicated on the interaction of these components
Process Platform
Delivering Cloud services requires 2 components:
© 2008 IBM Corporation
Tivoli Software
ITIL and Tivoli Service Automation Management
• Framework of Build- and Management Plans for phases of the service lifecycle
• Portfolio of supported Service Classes
• Tools for design and development of new Service Definitions incl. Service Topology
• Tools for design and development of Build- and Management Plans (i.e. processes)
• Build- and Management Plans for creation of Service Instances
• Build- and Management Plans for modification of Service Instances
• Simple self-service-like Build- and Management Plans for fulfillment of Service Requests
• Integrated Event Management (ITM) with bridge to Incident Management
© 2008 IBM Corporation
Tivoli Software
Adds CPUs
Tivoli Service Automation Manager§ Selects resource from pool (CMDB)§ Executes Management Plans to install
image
John, Test Center ManagerRequests Capacity f or a specif ic test through a self -serv ice GUI
Specifies Parameters: §Project Name, Owner§# of Servers, #CPUs, Mem,§Type of VM (AIX LPAR or VMWare)§SW stack (or Image – work in progress)
John, Test Center ManagerReceiv es ready to use Test SystemGiv es testers access
zVM
Linux
SW Stack
Anne, Bob, Linda, TestersUse Test System to run tests
Tw o more testers are assigned to projectAdd‘l tests required, more capacity needed
John, Test Center ManagerRequests more CPU
Tivoli Service Automation Manager
§ Selects resources from pool
§ Executes Management Plans to add CPUs
Specifies Parameters: §Project Name, Owner§# add‘l CPUs,
Pass Parameters
System CreatedNotification
Run TestsGrant Access
Run add’l Tests
Pass Parameters
zLinux
SW Stack
Tivoli Provisioning Manager
§ Deploy system
Scenario: Simple Deployment Scenario: Test Center– simply automated request fulfillment process
© 2008 IBM Corporation
Tivoli Software
Adds CPUs
Tivoli Service Automation Manager§ Selects resource from pool (CMDB)§ Executes Management Plans to install
image John, Test Center ManagerRequests Capacity f or a specif ic test through a self -serv ice GUI
Specifies Parameters: §Project Name, Owner§# of Servers, #CPUs, Mem,§Type of VM (AIX LPAR or VMWare)§SW stack (or Image – work in progress)§Start and Stop Date and Time
John, Test Center ManagerReceiv es ready to use Test SystemGiv es testers access
zVM
Linu
SW Stack
Anne, Bob, Linda, TestersUse Test System to run tests
Tw o more testers are assigned to projectAdd‘l tests required, more capacity needed
John, Test Center ManagerRequests more CPU
zLinux
SW StackTivoli Service Automation
Manager§ Selects resources from
pool§ Executes Management
Plans to add CPUs
Specifies Parameters: §Project Name, Owner§# add‘l CPUs,
Pass Parameters
System Ready
Run TestsGrant Access
Run add’l Tests
Pass Parameters
Marion, Data Center AdminApprov es request
Additional user customized processes supported
Pass Parameters
Tivoli Provisioning Manager
§ Deploy system
Scenario: Test Center– with complex request fulfillment process + reservationFulfillment Flow
© 2008 IBM Corporation
Tivoli Software
Scenario : Complex Scenario with Extended Manageability and complex Applications
John, LoB ManagerReceives ready to use Test SystemGives testers access
Anne, Bob, Linda, App OwnersUse System to deploy App
Grant Access
§ Deploy & configure ITM agents
ITMITPA
Incident & Problem AnalystsL1, L2 & L3
End UserProblem
OmnibusTBSM
Tivoli Service Automatiom Manager
§ Good Management Practices for the specif ic service created
§ Correlate w ith information about service, proposed Mgmt. Plans, etc.
SRM/CCMDB§ Open Ticket § Do Impact Analysis
Change Configuration
Tivoli Provisioning Manager
§ Adapt systems§ Configure WAS
ISM Job Plan Execution§Add WAS Cluster Member§Provision ITM agent§Manual Step ...§Adapt WAS Heap Size
p6
Linu
SW Stack
Production
AIX
WAS
AIX
WAS
zOS
DB2
Tivoli Service Automation Manager§ Selects resource from pool (CMDB)§ Executes Management Plans to install
image John, Lob ManagerRequests a WAS Platf orm f or a prduction through a self -serv ice GUI
Specifies Parameters: §Project Name, Ow ner§ WAS Golden M aster§Start and Stop Date and Time
Pass Parameters
Marion, Data Center AdminApprov es request
Additional user customized processes supported
Pass Parameters
Tivoli Provisioning Manager
§ Deploy system
Fulfillment Flow
© 2008 IBM Corporation© 2008 IBM Corporation13 Tivoli Service Automation Manager Solutions
Tivoli Service Automation Manager
Concepts of Cloud Management...
Script Lib JavaLib
TPM WF
Automationassets
---------------------
Service Definition
------------------------------------------
Service Definition
---------------------
Service Definition (Template) Open Cardinalities Variants No assignment of components
Topology Template of best practices Topology Node represents one or more IT resources which can be provisioned and managed
Management PlanOrchestrates operationsDefines Control Flow (what comes next as well as the data flowMapping of data to operations
Operation Implementation Executes e.g provisioning Integration of external systems Intgration of customer scripts
OS
Database
WebSphere
Service Requester
Roles and Responsibilities Open concept of user and roles Different views on the service based on roles
© 2008 IBM Corporation© 2008 IBM Corporation14 Tivoli Service Automation Manager Solutions
Tivoli Service Automation Manager
Concepts of Cloud Management
Script Lib JavaLib
TPM WF
Automationassets
---------------------
Service DefinitionTest
---------------------
Transfer & execute
Scripts for provisioning
Data Center Resources
Dis p a tc he r
W e b Sp he re Po rta lPorta l Se a rc hCon te n t App s
W e b Sp he re Po rta lPorta l Se a rc hCo n te n t App s
HT T P Se rv e rDe p lo y m e n t M grDa ta ba s e Se rv e r
W e b Sp he re Po rta lPo rta l Se a rc hCo n te n t App s
W e b Sp h e re Po rta lPo rta l Se a rc hCo n te n t Ap p s
HTT P Se rv e rDe pl oy m e nt M grDa ta ba s e Se rv e r
Da ta ba s e Se rv e rPro du ction Clu ste r A
Production Cluste r B
Dis pa tc he r
Test 2Di s p a tc he r
W e b Sp he re Po rta lPo rta l Se a rc hCo n te n t App s
W e b Sp he re Po rta lPorta l Se a rc hCon te n t App s
HT T P Se rv e rDe p loy m e n t M grDa ta ba s e Se rv e r
W e b Sp he re Po rta lPorta l Se a rc hCon te n t App s
W e b Sp he re Po rta lPo rta l Se a rc hCo n te n t Ap p s
HT T P Se rv e rDe p loy m e n t M grDa ta ba s e Se rv e r
Da ta ba s e Se rv e rPro du ction Clu ste r A
Production Cluste r B
Dis pa tc he r
Test 1
---------------------
Service Instance Test 2
---------------------
---------------------
Service Instance Test 1
---------------------
Instantiation Execution of a special management plan The Initial Management Plan is responsible to create instances in the mgmt infrastructure and in the reality Other Management Plans then can change (manage) the instances.
Managed Application environment is build up by executing automation assets orchstrated by initial management plan
Service Instance (Deployment) Representation of the application environment and its resource in the real world
...from definition to deployed instances
Tivoli Development Lab Boeblingen | We Innovate – We Integrate – We Deliver |
© 2008 IBM CorporationIBM Software Group | Tivoli software
Orchestration of Technology, Processes, People & Data to fulfill end-user requests and operational tasks
Cloud Management Base Architecture
Technology
ServiceDefinition
Tools
ServicePublishing
Tools
ServiceFulfillment &Configuration
ToolsUI, Fulfillment, Data, MetaData
ServiceMonitoring
ToolsKPIs
ServicePlanning
Infrastructure & Virtualization VM
EnsembleManagement
Platform Management Services
Provisioning Services
Workload mgmt Services
Usage & Accounting Services
Monitoring Services
Security Services
ServiceCreator/Planner
Tivoli Process Automation Engine
C
M
STopologiesMgmt Plans
Assets, CIsIntegration
DCMReservations
Service Reqmts
Solution Content
SRMCatalog
RPMData Loader/TPM CCMDB
Solution Runtime
Topology Allocation Reservation
Image Mgmt
Maximo Admin GUI
Service Requester
Service Operator
SAP
Storage Network
WAS NDPortal
In YE08 Release
Tech Preview availab le
Top Candidate for 2009
Customer Engaged Dev
LEGENDA:
Web 2.0 Self Service GUI IT Service (Infrastructure & Application) Provider
Tivoli Development Lab Boeblingen | We Innovate – We Integrate – We Deliver |
© 2008 IBM CorporationIBM Software Group | Tivoli software
Cloudburst Architecture & Components
Midplane
AMM
2AM
M2
Midplane
Customer SAN NetworkCustomer Ethernet Network
x3650 M2
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
HS
22 Blade
24 pt 1Gps Ethernet Sw
24 pt 1Gps Ethernet Sw
10G BNT Enet SwitchMSIM-L Bay 9
10G BNT Enet SwitchMSIM-L Bay 7
20pt FC SM 20pt FC SMBay 3 Bay 4
PDU
1
PDU
2
Cntl A Cntl BDS3400
3650 M2 Server
Windows 2003 R2 Enterprise
IBM
Dire
ctor
6.1
.0
Tool
sCen
ter
S
QL
Ser
ver
V
irtua
l Cen
ter 2
.5
BO
FM
IBM
Sto
rage
Mgr
VMWare ESXi 3.5 U4 Hypervisor
SUSE 10 SP2 & NFS
TPM 7.1
ITM6.2.1
WAS ND 6.1.0.13
DB2 ESE 9.5
ITDS 6.1.0.1
BlueCloud 1.6.1
TSM
© 2009 IBM Corporation
Backup…
Tivoli Development Lab Boeblingen | We Innovate – We Integrate – We Deliver |
© 2008 IBM CorporationIBM Software Group | Tivoli software
What the Customer Wants (?)
Tivoli Development Lab Boeblingen | We Innovate – We Integrate – We Deliver |
© 2008 IBM CorporationIBM Software Group | Tivoli software
The Challenge of Do-It-Yourself
IBM Tivoli
20IBM Confidential
Basic Principles to address Customer Needs
Integrate
Manage according to Best Practices
Manage in the context of the Service
•Automated Deployment incl. Mgmt. Infrastructure•Correlate situations with impacted application and SLAs•Structured Integration with Service Desk and Incident Mgmt•Offer but don‘t mandate automation solutions for change
•Implement Red Books into Technology•Templates, Policies, Scripts, Thresholds•Can be changed by customer
ServiceManager
TemplatesPoliciesScripts
Thresholds
TPAP
IBM Software Group | Tivoli software
IBM Confidential © 2009 IBM Corporation 21
Customer Pain & the new IT challenge (Image Sprawl) Proliferation of virtual images in customer environments (just copy a file). Customer need a way or
organizing, managing deploying these images to the various virtualized platforms in a scalable manner. Dormant images need maintenance too. (E.g. security patches) Customers need a way of managing the virtual images once they are deployed. This includes monitoring, updating,
tracking changes etc. Customers need to manage the virtual images created by them in addition to any vendor bought images. Customers needs to integrate their images that are deployed with their processes and management tools.
21
Industry – wide change to Image Management Images fast becoming the core object for deployment in datacenters– bypasses installation problems, provides faster
time to value Easy way to boot, store, distribute, copy software- OS & Applications Installation is as simple as a copy operation. (Configuration still needed) Fundamental mechanism for deploying cloud services (e.g. Amazon) Companies beginning to ship images to solve installation problems.
It contains binary data that can be used to boot a virtual machine or LPAR when available to the CPU via storage or network connection. This also includes some metadata for configuration, instantiation and startup.
What is an image
IBM Software Group | Tivoli software
IBM Confidential © 2009 IBM Corporation 22
Image Lifecycle Management
22
Store Deploy ManageBuild
Tooling to build virtual images and associate metadata with them. This can be done by capturing existing system or by creating a new image structure. Images can represent single system or composite application.
Store the images in a repository. Manage multiple image repositories using a Library. They also need to be accessible from a deployment system. It includes offline operations capability including query and search. Repositories can be distributed and replicated for scale.
Deployment requires platform specific tools to take images from Store and use the appropriate mechanism (network or storage) to create an instance of the image for booting the system ( VM or LPAR) and attaching data images where needed. This includes customization of image for deployed instance.
Use information from the build and deployment stage to better manage the deployed service. Management system needs to monitor, patch and update the deployed system. It also needs to include capture of a running system. The captured image can be modified for deployment in other locations or simply restored in its original location.
Design
Tooling to design the stack of OS and applications in a virtual image. This can be done by modifying existing system image or by creating a new image structure. Images can represent single system or group of images can represent a composite application.
Manage
Other discussion points Standards : Open Virtualization Format Specification (OVF) Governance : Control of images across the lifecycle steps Storage media : Impact of Storage hardware on Image Management *Security (including integrity, signing and access control) of images
IBM Software Group | Tivoli software
IBM Confidential © 2009 IBM Corporation
IBM Software Group | Tivoli software
IBM Confidential © 2009 IBM Corporation
Service Management (Cloud Computing) Runtime
CMS
Image Operator
and Admin
Image Operator
and AdminBase ImageMgmtFunctions
Migrations(P2V V2P, V2V, P2P)
DeployDiscover
Image Repository Image Inventory data/
cache
Design & Build
Image Mgmt Reference Architecture
Storage infrastructure iSCSINAS
DAS SCSI FC SAN
VMFS/other NFS
IP networkIP network
CMDB
Graphical design environment
for virtual images
Graphical design environment
for virtual images
Build tooling &Metadata editingBuild tooling &Metadata editing
Heterogeneous Image Management Runtime
Image Library Versioning control SearchImage
metadata
In-house & externalIT resources
VM
EC2/RC2/XY2
Machine D
VM VM VM
Machine C
Machine BMachine A
VM host
VM VM
VM host
VM VM VM VM
VM host VM host
VM VM
VM host
VM VM
VM host
Capture Save Query
VersioningUpdates
Access Control
Backup Restore
Base Image Management Runtime
Offline Updates
Operations UI Reports
Enterprise MgmtFunctionsSPOC
SPOC for Base Image Actions
Composite Images Actions
Query Checkin/ Checkout
Integration with Build Tools
Build images rep.
Reporting
User Mgmt
Security
ServiceRequestor
Service Operator
and Admin
Define
Versioning control Discover
Images as partof the bigger
Service Management
Governance Flows including composite
Images actions
Request Driven Deployment
Query
Integration with Build Tools
Service Templates
Reporting
User Mgmt
Service DefinitionService Definition
Service Configuration
Service Configuration
Service PublishingService Publishing
Compliance License Security