Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect for all members of the OGSA-DAI team Director of National e-Science Centre www.nesc.ac.uk 3 rd September 2002 UK e-Science All Hands Meeting Sheffield Hallam University
25
Embed
Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect
Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect for all members of the OGSA-DAI team Director of National e-Science Centre www.nesc.ac.uk 3 rd September 2002 UK e-Science All Hands Meeting Sheffield Hallam University. Overview. - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Databases and the Grid
OGSA-DAIArchitecture & Status
Malcolm AtkinsonOGSA-DAI Chief Architect
forall members of the OGSA-DAI team
Director of National e-Science Centrewww.nesc.ac.uk
3rd September 2002UK e-Science All Hands Meeting
Sheffield Hallam University
Overview
Database Task Force & GGF DAIS-WGOGSA-DAI Project
Scope, Scale, Participants, PlansArchitectureStatusRelationship with OGSA
Norman Paton (Manchester Uni.)Leanne Guy (CERN)Dave Pearson (Oracle UK)
ActivityBoF GGF4 TorontoWG Meeting GGF5 EdinburghWorkshops & Mail lists
GoalsAgree Standards for Database Access & IntegrationFreely available reference implementations
OGSA-DAI one source & focus for discussions
CambridgeOxford
Glasgow
Cardiff
Southampton
London
Belfast
Daresbury Lab
RALHinxton
OGSA-DAI Partners
EPCC & NeSC
Newcastle
IBMUSA
IBM Hursley
Oracle
Manchester
EPCC & NeSCIBM UKIBM USAManchester e-SCNewcastle e-SCOracle $5 million, 18 months, started 1st February 2002
OGSA-DAI Scope
Definition and development of generic Grid data services which provide access to and integration of data held in databases, and the management of data within a distributed environment. Database
A stored, structured collection of dataAccessed using an API that takes account of the structure of the data stored
IncludesRelational and object databasesXML repositoriesAdequately described & managed collections of files
OGSA-DAI Plan
Two PhasesPhase 1: Started Feb 02 ends 30th SeptemberDetailed Plan –
Requirements, Designs & Prototypes 6 Work Packages Project Management (Oracle, EPCC) Architecture (NeSC, DBTF) XML Data Management (NeSC & EPCC) Distributed Query Systems (Manchester & Newcastle) Metadata & Registries (NeSC & EPCC) Relational Databases (IBM UK)
Phase 2: 12 months Structure and Objectives to be Refined in Major Review GGF5 DAIS WG meeting a major input
OGSA-DAI Time Line
Feb ’02 May ’02 Jul ’02 Sep ’02 Dec ’02 Feb ’03 May ’03 Sep ’03
Ship Alpha Release for GT3 Integration
RDB + GT2 / OGSA Prototypes Available
XML + OGSA Prototype Available
Design Documents & Demos for DAIS WG @ GGF5
XML + OGSA Prototypes for Early Adopters
WS + GSI UK support ( > 100 downloads)
Phase 2 StartsPhase 1 Starts
Presentation & Beta @ GGF7
GGF6 WG Papers & Prototypes
Productisation, RAMPS &Extension
DAI Key Components
GridDataService GDS Access to data & DB operations
GridDataServiceFactory GDSF Makes GDS
GridDataServiceRegistry GDSR Discovery of GDS(F) & Data
GridDataTransportVehicle GDTV Connects components + Moves Data
GridDataTransportDepot GDTD GDTV with persistence
OGSA Relationship
Class GridService Registry NotificationConsumer NotificationProducer
GDS Mandatory Optional Normal
GDSF Mandatory Optional Normal
GDSR Mandatory Mandatory Normal
GDTS Mandatory
GDTV
GDTD Mandatory Optional Normal
DAI portType Usage
Class GridDataService GridDataTransport Factory
GDS Mandatory Normal
GDSF Optional Normal Mandatory
GDSR Optional
GDTS Optional Mandatory
GDTV
GDTD Optional Mandatory
OGSA-DAI Architecture
1requestforfactory
DSR
GDSF
client
OGSA-DAI Architecture
2responsewithGDSFsGSHs
1requestforfactory
DSR
GDSF
client
OGSA-DAI Architecture
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
client
4creation of 3GDSs
OGSA-DAI Architecture
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
4creation of 3GDSs
OGSA-DAI Architecture
5responsewith 3GSHs
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
4creation of 3GDSs
OGSA-DAI Architecture
6scriptsrequestingDB actions
5responsewith 3GSHs
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
4creation of 3GDSs
OGSA-DAI Architecture
6scriptsrequestingDB actions
5responsewith 3GSHs
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
7transfer databatch to GDS2
stream to GDS3
4creation of 3GDSs
OGSA-DAI Architecture
6scriptsrequestingDB actions
5responsewith 3GSHs
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
7transfer databatch to GDS2
stream to GDS3
8stream datato GDS2
4creation of 3GDSs
OGSA-DAI Architecture
6scriptsrequestingDB actions
5responsewith 3GSHs
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
9transfer databatchto client
7transfer databatch to GDS2
stream to GDS3
8stream datato GDS2
OGSA-DAI Architecture4creation of 3GDSs
6scriptsrequestingDB actions
5responsewith 3GSHs
2responsewithGDSFsGSHs
1requestforfactory
3script for 3GDSs
DSR
GDSF
GDS1
GDS2
GDS3
client
9transfer databatchto client
7transfer databatch to GDS2
stream to GDS3
8stream datato GDS2
10stream datato specifieddestination
Status
Teams & project coordination effectiveRelationship with Early Adopterswith Grid Support Centre with Globus
High rates of interaction
XML GDS & GDSF prototypes availableRDB demo availableDistributed Query demo availablePapers & designs presented at GGF5
www.nesc.ac.uk
Functional Scope & Architecture for Phase 2
Drafts & Intensive discussions
OGSA-DAI & OGSA <((-:}
Description, e.g. portType Works WellExpect to make extensive use of
Data Service Elements Special to DBs: Static & Dynamic