Www.neresc.ac.uk Dynasoar Dynamic Deployment of Web Services on a Grid or the Internet or Why its good to be Jobless Paul Watson School of Computing Science.

www.neresc.ac.ukwww.neresc.ac.uk

Dynasoar Dynamic Deployment of Web Services

on a Grid or the Internetor

Why it’s good to be Jobless

Dynasoar Dynamic Deployment of Web Services

on a Grid or the Internetor

Why it’s good to be Jobless

Paul WatsonSchool of Computing Science

University of Newcastle

Paul WatsonSchool of Computing Science

University of Newcastle

The Dynasoar team: Chris Fowler, Paul Watson, Charles Kubicek, Arijit Mukherjee, John Colquhoun, Savas Parastatidis, Mark HewittThe GridShed team: Isi Mitrani, Jennie Palmer, Paul McKee (BT) & Mike Fisher (BT)

www.neresc.ac.ukwww.neresc.ac.uk 2

Why Jobs & Services?

• Grid applications are being built from Web Services• If the computational requirements can’t be met by the

service hosting environment then a job must be created

• Do we need both jobs and services?

• Dynasoar• a service-only approach to building grid applications• an infrastructure for the dynamic deployment of web services

www.neresc.ac.ukwww.neresc.ac.uk 3

Dynasoar Components

• Web Service Provider (WSP)• exposes service endpoints• accepts the incoming SOAP message sent to the endpoint• chooses a Host Provider and passes the message to it• holds a copy of service code

• Host Provider (HP)• manages computational resources (e.g. a cluster or a grid)• accepts the message from the WSP• dynamically deploys the service if necessary• processes the message and returns any response

Consumer

C WSP HP

req

res

req

res

www.neresc.ac.ukwww.neresc.ac.uk 4

Routing to an Existing Service Deployment

C WSP

req

res

Host Provider

node 1s2, s5

…

node 2

node ns2

Web Service Provider

Consumer

A request for s2 is routed to an existing

deployment of the service

www.neresc.ac.ukwww.neresc.ac.uk 5

Dynamic service deployment

C WSP

req

res

1

Host Provider

node 1s2, s5

…

node 2

node ns2

Web Service Provider

3

2: service fetch &deploy

Consumer

R

The deployed service remains in place andcan be re-used - unlike job scheduling

A request to s4 cannot be met by an existing deployment of the service

www.neresc.ac.ukwww.neresc.ac.uk 6

Dynasoar Advantages

• Simplicity: just services• Efficiency: a deployed service can process many

messages• Support a range of new e-science/ e-business models:

• defining the interactions between the major components allows them to be distributed in a variety of ways

www.neresc.ac.ukwww.neresc.ac.uk 7

Dynamic Outsourcing

• Biocorp are experts in writing bioinformatics services• They don’t want to manage their own compute resources• Therefore, they use Hosting Inc to process messages sent to

their services• In e-science, BioCorp could be a research group writing specialist

e-science services, and Hosting Inc the NGS

HPWSP

C

C BioCorp Hosting Inc

…..

BioCorpCustomers

www.neresc.ac.ukwww.neresc.ac.uk 8

The National Grid Service as a Host Provider

• A researcher writes their own services but does not have sufficient local compute resources

• They deploy a local WSP, and configure it so that it sends messages to the National Grid Service• their services are then transparently deployed on the NGS as

required

C WSP

National Grid

node …... node

Researcher’sLocal Resources

..node node

Quarantine Nodes

www.neresc.ac.ukwww.neresc.ac.uk 9

A Marketplace for Matching Web Service Providers to Host Providers

HP1WSP1

Marketplace

HPnWSPn

......

......

Web Service Providers

Host Providers

www.neresc.ac.ukwww.neresc.ac.uk 10

A Marketplace for e-Science

HP1WSP1

Marketplace

HPnWSPn

......

......

Web Service Providers

Host Providers

LocalCampusGrid

NationalGridService

www.neresc.ac.ukwww.neresc.ac.uk 11

Moving Computation to Data

• In many e-science applications analysis services operate on data extracted from a data store (e.g. OGSA-DAI, SRB…)• often large amounts of data are transferred• this may severely limit the performance

C

req

resAnalysis Service

DatabaseService

req

res

www.neresc.ac.ukwww.neresc.ac.uk 12

Moving Computation to Data

• The data owner provides compute resources close to a database• Researchers can write services and deploy them on their own

WSP• The service is dynamically deployed close to the database when

requests are sent to the WSP

C WSP

req

res

1

Host Provider

node 1

…

node 2

node n

Web Service Provider

offering the Analysis Service

3

2: service fetch &deploy

Consumer

Database Service

High PerformanceNetwork

www.neresc.ac.ukwww.neresc.ac.uk 13

Results for Deploying a Service Close to a Database

www.neresc.ac.ukwww.neresc.ac.uk 14

Service Provider

QoS Policies

Deployed Service Registry

Web ServiceCode Store

Host Provider

Code Store SOAP interface

Security Policies

SOAP Endpoints

Message Handler

Computational resourcesHosting deployed services

Host Provider Registry

DynasoarHost Provider

Interface

Host Provider Endpoint

Service ProviderEndpoint

Current Implementation

GridShed ClusterManagement

www.neresc.ac.ukwww.neresc.ac.uk 15

New Host Provider Architecture

• Layer as high-level infrastructure over lower level grid fabric• Use OMII Job Submission and Monitoring Service to provide

stable interface to different underlying fabrics• Newcastle Grid (Condor), National Grid Service, local clusters,….

Host ProviderComputational resources

Hosting deployed services

DynasoarHost Provider

Interface

OMII Job Submission and Monitoring Service

(WS-JDML)

www.neresc.ac.ukwww.neresc.ac.uk 16

Current Work

• Exploring Virtual Machines as a general service deployment mechanism• Freeze services and their environments in a VM• Store in Service Store• Dynamically Deploy as required

• Use of QoS to enhance decisions on where to deploy a service

• Exploring tripartite security model• Consumer, Web Service Provider and Host Provider express

policies that are enforced at run-time• A HP may only accept messages from WSPs that it trusts to not send

malicious code• A WSP may only deploy services on HPs it trusts won’t use the service

without paying

• Dynamic database deployment• ogsa-dai, ogsa-dqp

www.neresc.ac.ukwww.neresc.ac.uk 17

Conclusions

• It is possible to build grid applications entirely from services• jobless grid computing• simpler conceptual model• performance improvements due to sharing the cost of service

deployment over multiple requests

• Separating the Web Service Provider from the Host Provider opens a range of deployment options

• Dynasoar can be built as a high-level infrastructure on top of existing grid fabrics

• Ongoing work on VMs, QoS, Security, dynamic db deployment

• Technical Report on-line: Newcastle CS-TR-890…• http://www.cs.ncl.ac.uk/research/pubs/trs/papers/890.pdf

www.neresc.ac.ukwww.neresc.ac.uk 18

Thanks

• The Dynasoar team• Chris Fowler, Charles Kubicek, Arijit Mukherjee, John

Colquhoun, Savas Parastatidis, Mark Hewitt

• The GridShed team• Isi Mitrani, Jennie Palmer

• BT• Paul McKee & Mike Fisher

• This work is supported by the DTI, EPSRC, Core e-Science Programme & CodeWorks