Summer School Delivering On-Demand Shared Middleware Services

Delivering On-Demand and Shared Middleware Services

Chris Haddad

Asanka Abeysinghe

Read more about PaaS at http://blog.cobia.net/cobiacomm

Try StratosLive https://stratoslive.wso2.com/

Delivering On-Demand and Shared Middleware Services

• Services instead of Servers

• Disruptors

①Topology

②Project funding and investment

③ IT as a Business

④Shared policy and automated governance

⑤Development services

⑥Your Business as a Service and Ecosystem Platforms

Cloud Services instead of Servers

Existing IT infrastructure

Platform as a Service Architecture What is a tenant? • An isolated or personalized run-time environment context that cannot be

shared across PaaS consumers

• Tenant specific personalization can occur across multiple personalization dimensions • Information access privileges • Information aggregation and composition • Business processes and rules • Service levels and Quality of Service • Security policies, subscriber entitlements, and social network access privileges • Monetization rates

• Personalization may require loading code, configuration files, or data

• Tenant isolation dictated by expected performance, security requirements, and legacy technology. • PaaS security managers, code deployers, and tenant-aware load balancing

influences required container-level isolation

Platform as a Service Architecture

What is a container? • A standalone, Internet addressable node offering

application platform services • Web application hosting, API management, integration

endpoint hosting, ESB mediation, registry services, identity management, relational database

• Containers host tenant resources and context

• Code, configuration files, data, process definitions, rules, policies, entitlements

• Containers may serve

• a single tenant at a time (dedicated), or • multiple-tenants at a time (shared)

Partitioning and Tenancy Implications

Tenant Context

Container

Tenant Partition

Application Solution Tenant Traffic

Tenant-1

AS-1

Tenant-1

ESB-1

Tenant-1

Tenant-2

AS-2

Tenant-2

ESB-2

Tenant-2

Tenant-3

ESB-3

Tenant-3

Five (5) Container Instances

Partitioning and Tenancy Implications

Tenant Context

Container

Service Partition

Application Solution Tenant Traffic

ESB

ESB-1

Tenant-1 Tenant-3

ESB-2

Tenant-2

Web Applicati

on

AS-1

Tenant-1 Tenant-2

Three (3) Container Instances

Cloud Application Platform Shared Middleware Services

How to size an infrastructure

• Expected Maximum TPS

– Any max latency requirements

• Work done per transaction

• Size of messages

• Availability

• Deployment needs (e.g. specific setup might need based on the infrastructure policy etc.)

Cloud Capacity Planning

• Service types

• System load – Per service type

– Administration

• Scaling – Static

– Dynamic

• PaaS system and deployment architecture

• Limitation of IaaS

• Stratos Controller

- Management, Governance, Monitoring component - System security

• Stratos Service Cluster - Worker nodes provide the runtime for application logic / services - Administrator nodes to create, manage, govern the application

logic / services

Controller

Service Cluster

1:M

WSO2 Stratos Component Architecture

• Cloud enabled Carbon runtime to host various services

- Multi-tenanted - Dynamically scaled

Stratos Service Cluster : Worker Node

• Front by a load-balancer • Dynamically scale horizontally by the load-balancer

Scaling Worker Nodes

• Web based management, configuration and monitoring

console to create, manage and govern the Cloud services

Stratos Service Cluster : Admin Node

• Read/Write node for the service cluster • Load-balancer will not route any work requests to the

admin node

Stratos Service Cluster : Admin Node

Adding Service Types

Stratos

Manager

Stratos Identity

BAM

Data Collector

BAM

Summarizer

Self Service Portal

System user management & SSO

Syslogd

OS utility to manage logs (syslog format)

System storage

Stratos Controller

Scaling the Stratos Controller

i – Number of WSO2 Carbon instances x – Number of worker nodes per service cluster y – Number of service clusters In most cases each service node will not have equal number of worker nodes.

i = 2 + (2 +x) y

i = 2 + (2 + x1) + (2 + x2) + …….. + (2 + xn)

Stratos Controller

LB + Admin Node

Z

Stratos Controller instances.

Formula for Static Scaling

Project Funding and Investment – Service TCO

TCO sharing benefits when running ESB as a Service • Infrastructure • License • Management • Ownership • Governance ESB infrastructure immediately ready for projects

WSO2 Total Cost of Ownership Advantage

• Rapid elasticity

• Containers shared across multiple tenants

• Capacity managed per service, not per tenant

• Single, flat container partition space enables maximum sharing

• Containers may be partitioned by service

• Resource Pooling

• Application footprint lower than single tenant, dedicated container deployment

• Lazy loading further minimizes footprint

WSO2 Total Cost of Ownership Advantage

• Measured Service and Pay Per Use

• Cloud infrastructure investment recaptured after 4 tenants subscribe (at full-time usage per tenant)

• Can meter and bill based on business transaction usage, application count

• On-demand self-service

• Application teams do not have to specify infrastructure topology (i.e. server count)

• Subscribe to application platform services instead of application server instances

http://wso2.com/whitepapers/cloud-native-advantage-multi-tenant-shared-container-paas/

Project Funding and Investment – Service TCO Use Case 2: ESB-as-a-Service, Low Tenant Count

PaaS

Tenant Tenant Tenant

API API API

IaaS

• Publish same API • Publish same API in

different forms • Customer specific

policies, plans • Scale based on the

customer tier • Billing and usage reports

Business APIs

Federated Deployment : Traditional

Master Datacenter

Regional Datacenter

Regional Datacenter

Regional Datacenter

Regional Datacenter

Store Store Store Store

PaaS

Tenant Tenant Tenant

IaaS

• Remove the regional datacenters

• Provide isolated environments for processes, policies and data

• Shared processes, policies and data

• Centrally manage and governed

• Ability scale based on the demand

Federation with Multitenancy

Super Tenant

Store Store Store Store

Increasing project agility via Development services

Potential Development Services • Issue tracking • Source Code Management • Automated Software development LifeCycle

Governance – approval, workflow, • Service Store, API Store • Policy definition • Code Build • Integration Test • Continuous delivery

WSO2 App Factory

6/27/2012 28

WSO2AppFactory

Existing IT infrastructure

Scalable Private Cloud infrastructure

CIO/Management Dashboard

Workflow managedbuild and deploy

Stratos Multi-tenant elasticintegration and ESB runtime

Governanceand Identity

API Management

Lightweight High PerformanceIntegration

Partner and Mobile applications

WSO2 AppFactory

Your Business as a Service and Ecosystem Platforms

• Beyond APIs – because it creates a shared governance model and runtime

• An opportunity to add significant value to partners: • A complete environment that they can customize

• Not just the look and feel but also the behaviour

• An ideal platform for shared revenue

• A shift in business models enabled by cloud technology

Beyond APIs: “Your Business As A Service”

PaaS / Stratos

Existing business systems as APIs

Tenant

Apps

Tenant

Apps

Tenant

Apps

Tenant

Apps

Eco

syst

em O

wn

er

Part

ne

rs

Use

rs

API Management / API Store

Tenant / Consumer Personalization Dimensions

• Information access privileges

• Information aggregation and composition

• Social network access privileges

• Business processes and rules

• Service levels and Quality of Service

• Security policies

• Monetization rates

Getting Started

To shift from servers to services • Size the application platform service cloud • Implement multi-tenant container sharing and

reduce total cost of ownership • Build extensible, configurable applications,

services, and APIs • Establish a federated architecture and

institutionalize best practices with governance • Adopt development services and increase project

agility • Facilitate partner extensions with WSO2

AppFactory

Resources • Try StratosLive right now:

– https://stratoslive.wso2.com/

• Read about Stratos: – http://wso2.com/cloud/stratos/ – Source Download available

• White Paper – Selecting Platform as a Service – Platform as a Service TCO: multi-tenant shared container

• Blog Articles – What is Platform as a Service? – PaaS Evaluation Framework for CIOs and Architects – How to simplify Platform as a Service Complexity – Searching for Cloud Reference Architecture

• Contact us: – [email protected]

Contact us:

http://wso2.com/contact/

Follow us:

http://twitter.com/#!/wso2 http://twitter.com/#!/cobiacomm

Follow us:

http://twitter.com/#!/wso2

lean . enterprise . middleware