The Interoperability Process Pilot Projects (IP3) Stefano Nativi [email protected] GEO Architecture & Data Committee 23 May 2008
Jan 04, 2016
The Interoperability Process Pilot Projects (IP3)
Stefano [email protected]
GEO Architecture & Data Committee23 May 2008
Content
• Origins and goals• 2007 accomplishments• 2008 activities & evolution of IP3 framework• The Model Web• Schedule• Summary & Conclusions
AR-07-01 Task Description
• Prototype and validate the implementation of the “Core” GEOSS infrastructure (registries, Clearinghouse, Web Portal) and the processes for contributing and linking systems using the Interoperability Process Pilot Projects.
EGU GA 4/08 # 4
Origins and Goals of the IP3
• In 2006 the GEO Architecture and Data Committee produced a document outlining the “Process for reaching interoperability arrangements”
• The “Interoperability Process Pilot Project” (IP3) was conceived as a way to begin implementing the GEOSS infrastructure and testing the GEOSS interoperability process
• A series of projects involving several initially identified GEOSS components was initiated, with the aim of producing a suite of demonstrations for the GEO Summit in November.
Sources
• The ADC identified four areas as sources for the pilot projects.
• This selection was based on– the desire to involve diverse disciplines– commitments of representatives from the disciplines
to actively support the process
• Recommendations for additional communities to participate are welcome
Interoperability Process Pilot Project (IP3) Status
• Report on 2007 IP3 activities now available• Plan for IP3-2008 submitted as Position Paper to
Architecture Workshop under Biodiversity area– But will involve other disciplines as well
EGU GA 4/08 # 7
The Challenge
• Utilization of earth observation data for cross-disciplinary basic and applied research requires infrastructure that supports diverse data sources
• The key to GEOSS’ utility and effectiveness is the implementation of interoperability process for integrating data and information systems
• Interoperability must be addressed not only through conceptual solutions but through prototypes and demonstration of functionality
EGU GA 4/08 # 8
FDSN
Exotic event catalog
Surface melt, ice velocity
Seismic Trigger
Precip, soil moisture (TIGGE)
IPCC model data (NCAR)
Species data
Precip (TIGGE), Land Use
2007 IP3 Scenarios and Data Flows
CEOP centers
Seismic Events from Ice Sheet Disintegration
Scenario
Landslide Risk Scenario
Meningitis Early Warning System
Seismic Events from Ice Sheet Disintegration
Scenario
Species Response to
Climate Change ScenarioGBIF
WHO
NSIDC
WISWGISS Test Facility
CC & Bio IP3 Working Group• GBIF Secretariat
– Éamonn O Tuama, Tim Robertson, Dave Martin, Donald Hobern • IEEE
– Siri Jodha Khalsa, Reece. H. Lumsden• Italian National Research Council (CNR-IMAA) & Univ. of Florence
– Stefano Nativi, Paolo Mazzetti, Lorenzo Bigagli, Enrico Boldrini, Valerio Angelini, Ugo Mattia
• NCAR– Eric Nienhouse, Luca Cinquini
• UNIDATA/UCAR – Ben Domenico
• University of Colorado– Robert Robert Penn Guralnick, Chris Ray
• University of Helsinki– Hannu Saarenmaa
• University of Jena– Roman Gerlach
• University of Ottawa– Jeremy Kerr
• University of Tokyo– Motomi Ito
• WMO– David Thomas
GEOSSStandards & Special
Arrangements Registry
Users
GEO CommonInfrastructure
GEONETCast
GEO Main Web Site
GEOSS Common Infrastructure
GEOSSComponent Registry
Service Registry
GEOSSClearinghouse
GEOSSClearinghouse
GEOSSClearinghouse
GEO Web PortalGEO Web PortalGEO Web Portal
Requirements Registry
Best Practices Wiki
External Resources
Catalogue
ServicesWebsites/Webportals
Documents
RSS
GEOSS Registered Components
Catalogue
ServicesWebsites/Webportals
Documents
RSS
references
links
accesses
accesses
searches
links
Accesses all RegisteredCommunity Resources
Links to OtherCommunity Resources
External Resources Access Clearinghouse
EGU GA 4/08 # 11
Evolution of IP3 Framework
• We will develop additional multi-disciplinary use cases where1. Users interact with a Geo-portal to submit queries
2. Query is passed to Catalog service able to distribute the query against the following standard resource types:• International Standard (OGC CS-W, WMS, WCS)
• Community Standards (THREDDS/OPeNDAP, GBIF, MerSea SeaDataNet CDI)
3. The discovered and downloaded datasets are ingested into a model server
4. The model server generates output which is served through a standard resource server (becoming searchable)
Dataset resource Provider
… .
… .
OGC Access Standards
THREDDS/OPeNDAPArrangements
CSW/ebRIM.
CIM
Catalog server(GI-cat)
Dis
trib
uti
on
Mediation
Services:- Distribution˗ Message Mangmnt;˗ Messaging;˗ Persistence˗Mediation
.. .
Other InternationalStandards
GEO Portal
users
11
22
33
4a4a
ProcessingComponent
Discipline….
ModelServer
. ...
Discipline….
ModelServer
OtherDiscipline
ModelServers
ClimateChange ModelServer
ClimateChange ModelServer
ENMServerENM
Server
Model Resource Provider
ProcessingComponentworkflow
Component
4b4b
workflowComponent
GEOSS Components
GEOSS Components
GEOSS Components
GEOSS Components
CSW/ISO
CS-W Appl. Profiles
GBIF Arrangements
Other specific Arrangements
GEOSS Components
GEOSS Components
The Multidisciplinary Interoperability Process
• Registering a new disciplinary component:1. Resource provider registers component which
instantiates well-known services (standard / best practice)
2. The infrastructure catalog component discovers the new service instance and associates specific mediation and access capabilities with it
3. The infrastructure catalog register is updated adding the new registered resource and the new mediation functionalities -where needed
Service Registry
Interoperability Process
International Standard / Special Interoperability Arrangement Registry
Distributed catalog
Earth System Science
Community
PROCESSPROCESS
11 22 33
EGU GA 4/08 # 15
Model Interoperabililty
• Simulation models are generally built in isolation and do not easily interoperate with others
• Result: lost opportunities to address important questions
• Barriers to interoperability are both technical and cultural
• For IP3 we will develop and register model interoperability arrangements along with specific mediation solutions and possibly recommendations for new standards.
April 2008
The Model Web initiative
or
or
• Improve existing models
• Create new models
• Increase model interoperability
Model Web
Model A
Model B
Model CDataset 1
Dataset 2
Model D
Model E
Model F
Dataset 3
Dataset 4
Model G
Gary GellerNASA JPL California Institute of Technology
• Distributed network of interoperating models (and datasets and sensors)
• Using Service-Oriented Architecture
• Data format and terminology issues resolved
• Multi-disciplinary scope
• Grows organically within framework of broad goals and data exchange standards
• Models and datasets maintained, operated, and served independently
• Web access provided to researchers, managers, public…
Model Web: 5-10+ Year Vision
CC and Species Distribution
Global ClimateModel
RegionalClimate Model
FireModel
LandscapeModel
Species distribution
As the climate changes, can rare species Xstill exist within my park in 2057?
TOPS
Species Distribution Model
Human Health
Global ClimateModel
RegionalClimate Model
InfectionRate Model
Human Population Density and Distribution Model
Vector NicheModel
Infection Rates
How will CC affect infection rateof dengue fever in Vietnam?
SocioeconomicFossil Fuel UseModel
Deforestation/Disturbance Model
Observational Data(environment &vector distribution)
Schedule
• July 2008 - Initial prototype
• September 2008 – Report to ADC
• November 2008 – Demonstration to GEO
Plenary
Successes
• Component registration forms completed for FDSN, CEOP, WIS
• In addition to WIS, forms also completed for these subsystems:– World Weather Watch Global Observing System - GOS– Global Atmosphere Watch - GAW– World Hydrological Cycle Observing System - WHYCOS– World Climate Programme - WCP– Global Climate Observing System - GCOS– Global Ocean Observing System - GOOS– Global Terrestrial Observing System - GTOS
Other Successes
• Document Successful Data Integration Projects– CEOP presentation to follow
• GEOSS Standards Register created– Web query form functional– ISO 29350 interface shortly
• Also pending– Collection of service information from the candidate
systems awaits availability of prototype service registry.
Meeting, Presentation, Workshop
• At the European Geosciences Union (EGU) General Assembly 2007 Vienna, Austria– IP3 Meeting: Monday, 15 April 2007, 10:30 – 12:00, Room SM4– IP3 Paper: Session US10, Thursday, 19 April 2007, 11:30,
Lecture Room 29 on
• At the International Symposium on Geosciences and Remote Sensing (IGARSS) 2007 Barcelona, Spain– GEOSS Workshop: Sunday 22 July 2007, 08:30 – 18:30– The User and the GEOSS Architecture XIV, Topic: GEOSS
Interoperability and Applications to Biodiversity
Meeting, Presentation, Workshop
• At the American Geophysics Union (AGU) Fall Meeting, 2007 San Francisco, USA– Processes for Achieving Interoperability in GEOSS, Thursday 13
December 2007, 13:30 – 15:30
• At the European Geosciences Union (EGU) General Assembly 2008 Vienna, Austria
– IP3 Paper: Session ESSI10, Wednesday, 17 April 2008, 14:00 - 18:00
• The manuscript “Predicting the Impact of Climate Change on Biodiversity – a GEOSS scenario” was published on the Full Picture book (GEO editor)
• The manuscript “The GEOSS Interoperability Process Pilot Project (IP3)” was submitted to IEEE TGRS
Summary & Conclusions
• The Interoperability Process Pilot Projects are performing a vital function in GEOSS development by exercising the core GEOSS components and processes
• Possible only through the efforts of individuals contributing their time and expertise to the process.
• Input and participation from other GEO committees invited
• Innovative information technologies are required to fully realize potential of contributions to GEOSS
• The IP3 is demonstrating the benefits of engaging diverse disciplinary communities in the building of infrastructure to support interoperability
EGU GA 4/08 # 26
Links for More Information
• http://earthobservations.org/– Main GEO website
• http://ieee-earth.org/See: GEOSS → Architecture & Data → Architecture
• http://geossregistries.info/– Access to GEOSS registries
GI-Cat
Discovery&Query
getC ontentgetM etadataquery
1
Messaging
publishsubscribeunsubscribe
Session
com m itin itlogin
Distribution
addrem ove
Persistency
purgestore
Mediation&Access
getM appingsetM apping
logoutrollback
0..1 0..1 0..1 0..1 0..1
• Extended model for Distributed Catalog service (federated architecture)– Extended functionalities
Extended General Model for distribution & mediation
Stateful behaviorTransaction
Asynchronous interaction
Caching Federation of new service instances
Mappingheterogeneous service modesl to the federation one
Distributed Catalog Service
GI-Cat
Discovery & Query
getC ontentgetM etadataquery
1
Messaging
publishsubscribeunsubscribe
Session
com m itin itlogin
Distribution
addrem ove
Persistency
purgestore
Mediation & Access
getM appingsetM apping
logoutrollback
0..1 0..1 0..1 0..1 0..1
Distributed Catalog Service
CSW/ISOserver
CSW/ISOserver
CSW/ebRIMFGDC serverCSW/ebRIMFGDC server
CSW/ebRIMCIM server
CSW/ebRIMCIM server
THREDDSserver
THREDDSserver
WMSserverWMS
serverGBIF
serverGBIF
serverWCS
serverWCS
server
Resource Access
CDI catalogserver
CDI catalogserver
WMS Access WCS AccessCSW/ebRIM Access CSW/ISO Access THREDDS Access GBIF Access CDI Access