Top Banner
Third Workshop on the use of GIS/OGC Standards in Meteorology 15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal Uwe Voges (con terra GmbH) Michael Schick (EUMETSAT)
16

15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

May 22, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Third Workshop on the use of GIS/OGC Standards

in Meteorology15-17 November 2010 at the Met Office,

Exeter, UK

Implementation and Use of

OGC/HMA/WMO/ISO & Inspire Standards

in EUMETSAT EO Portal

Uwe Voges (con terra GmbH)

Michael Schick (EUMETSAT)

Page 2: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Agenda

Å EO-Portal

Å Project History / Project Status

Å Information Models

Å System Overview

Å Product Navigator

Å UserManagement/IdP-Concept

Å Clearinghouse

Å WMS-Service / -Client (another presentation from Michael Schick)

Å Next steps

Page 3: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Å EO Portal provides single access point to EUMETSAT data and dissemination services

ï Past: several applications with self contained user management

ï Users had to register with every application and to memorise different user ids and passwords

Å EO Portal encapsulates the legacy applications and offers a harmonised user interface to discover, search, order / subscribe to data and services

Å Clearinghouse: Users

Discover, search,

register, order and

subscribe

Subscribe to

services

Discover/search

productsRegister to

messages

Distributed search,

remote order

Order/ subscription

products

Subscribe to

services

GEONETCast

Catalogue

EUMETCast/

GEONETCast

Unified

Meteorological

Archive

(U-MARF)

EUMETSAT

Partner Agencies/

GMES, WMO

User Notifcations

(UNS)

EUMETCast /

GEONETCast

Other

Dissemination

Services

Registration

Discovery (Product Navigator)

Order Followup

Access to applications & data

EUMETSAT EO

Portal

EO Portal

ï will allow users to access data and services of partner agencies (e.g. CNES, NOAA, WMO, ESA)

ï vice versa: allows partner agencies to discover, search, order and subscribe to EUMETSAT data and services via a set of programmatic, interoperable services

Services based on OGC/HMA/ISO, WMO and INSPIRE EU specifications

Page 4: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Project History / Project Status

Å 2008:

ï Started with architectural design phase accomplished by con terra

ï Implementation of Collection Catalogue (Product Navigator) with con terra´s terraCatalog

ï Sophisticated security concept including IdentityProvider (IdP)- and UserManagement Prototype based on SUNs OpenSSO

Å 2009:

ï first release of Clearinghouse launched:

integrating legacy systems for orchestrated user administration

Successful Experiment to check interoperability with ESA/HMA UserManagement

HMA Product Search (EOP) realized and integrated into Clearinghouse

Started with HMA Order Service Implementation

Å 2010:

ï Realization of the Order Service providing HMA Order Service Interface

ï Z39.50/SRU Adaptor implementing WMO/WIS z39.50/SRU interface

ï WMS Server and WMS Client

ï Study on federated collection search

ï Started development of Product Navigator 2.0

Page 5: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Information Models

Å Different types of information are involved

Å Metadata for EO Collections and EO Products (as reflected within ESA's HMA and WMO/WIS):

ï EO Product

set of EO data, identifiable e.g. by spatial / temporal extent, specific band. Located within larger dataset

based on ñOGC GML Application Schema for EO Productsò

ï EO Collection: EO Products sharing same product specification

based on ISO19115-2 and ISO19139(-2)

specific EUMETSAT requirements (e.g. distribution channels) in ISO conformant extension to ISO191(15|39)-2

XSD dedined, brought into ISO process

Å Ordering / Subscription Information

ï based on information model of OGC/HMA Order Services

Å User and Role Data

Å Data Model for WMS:

ï Layer, LayerGroups, Thematic Hierarchies

Å Important: mappings between ISO-/OGC-/HMA-models and legacy models had to be done

eum:MD_EUMDistributor

-onLine [1..n]: CI_OnlineResource

gmd:MD_DigitalTransferOptions

-name [1] : CharacterString

-version [1] : CharacterString

gmd:MD_Format

-availability [1] : CharacterString

-aggregateIdentifier [0..1]: CharacterString

-eumetcastChannels [0..1]: CharacterString

eum:MD_EUMDigitalTransferOptions

- 1

-digitalTransfers

0..*

eum:MD_EUMDigitalTransfer

-availability 1

- *

-

1-format

1..*

Average File Size mapped to

averageFileSizeUnits and averageFileSize

-typicalFilename [0..n] : CharacterString

-averageFileSizeUnits [0..1]: CharacterString

-averageFileSize [0..1]: Real

-frequency [0..1] : CharacterString

-fileFormatDescription [0..1] : CharacterString

eum:MD_EUMFormat

-distributorContact

gmd:MD_Distributor

In an aggregate, aggregateIdentifier

is the fileIdentifier of the aggregate

metadata entry.

-identifier[1] : MD_Identifier

-description [1] : CharacterString

gmi:MI_Platform

-0..1] : CI_OrbitTypeCode

eum:MI_EUMPlatform

gmi:MI_Metadata

gmd:MD_DataIdentification

gmd:MD_Distribution

1

-distributionInfo

0..1

0..*

-distributor

0..*

gmd:MD_Metadata

gmi:MI_AcquisitionInformation

1

-acquisitionInformation0..*

1

-platform

0..*

1

-identificationInfo1..*

used as root node within

EUMETSAT metadata

used as defined

in ISO19115

Page 6: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

System Overview

Å EO WebPortal: main webïinterface

Å Product Navigator UI: web-interface

Å EO Product Search/Order/Subscription: web-interface for discovery, order-ing/subscription, Order-Follow-Up

Å UserManagement/IdP

Å Clearinghouse: provides OGC/HMA-, WMO-,INSPIRE- and EUMETSAT-inter-faces. Communicates with legacy systems and external partner agencies

Å WMSService / WMSClient: visualization of satellite products via WMS with date/time support

Å PN-MapServer: WMS for definition of spatial filters and visualization of spatial extends of items found

Å Data Centre/EAT/UNS: EUM legacy systems for Product Discovery, Order/Subscription

Å EO Portal Datastore: Database Components (RDBMS, LDAP, files)

Page 7: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Product Navigator (navigator.eumetsat.int)

Å Management and Discovery of Metadata for EO Collections (called Products)

Å Metadata Management

ï Web based Metadata Editor

ï Batch-import of XML encoded metadata files

ï Periodical automatic harvesting of single XML metadata files from known locations

ï possible to automatically harvest metadata from other Catalogues

ï Export of metadata

Å Web-UI for browse/search/discovery

Å Collection Catalogue Server

ï server-side processing (query-generator,db-storage/retrieval, harvesting, brokeringé)

ï discovery / management via programmatic service interfaces (OGC, INSPIRE,é)

Page 8: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Product Navigator (navigator.eumetsat.int)

Å Web Search UI

ï Simple-search

ï Advanced search: by number combinations of metadata attributes:

collection type, sba, product provider, time extent, satelliteé

spatial extent defined on OGC WMS based map

ï Live Search

ï metadata entries shown to user where he has access rights

ï Instead searching: discovery of collections by browsing through collection tree

Page 9: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Product Navigator (navigator.eumetsat.int)

ï Search Results

ranked by access frequency

presents important attributes abstract, title, thumbnailé

Bookmark record

ï Metadata details view

URLs lead user to various services as offline product search/order or online registration

full XML metadata

browse image

spatial extentshown in a geographical representation of the world

Page 10: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

UserManagement/IdP-Concept

Å Background:

ï some Services require user details passed using security concepts

ï harmonization of various EUMETSAT user management functions

offering a single registration and subscription mechanism for all services

ï centralized authentication, while user has different credentials at different providers

advantage: business entities maintain own user accounts, no global unique ID required

Å con terra developed together with EUMETSAT a sophisticated security concept

ï including (federated) IdentityProvider (IdP) - and UserManagement

ï build up on OASIS SAML 2 and implemented with SUNs (Oracle) OpenSSO

Å concept differentiates between SSO at web applications and the way how web services are secured

Å For SSO between web service consumer (WSC) and web service no global security token required

ï WSC can request new token for business entity at STS

ï via SAML2 AuthnRequest and private/public key mechanism

Å Trust in requesting entity at web service requires:

ï valid and trusted signature of request

ï valid and trusted security token from an IdP

Å Integration of ESA/HMA User Management

Page 11: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Clearinghouse

Å Main goals :

ï Integration of legacy-systems

ï Provision of (standardized) programmatic interfaces to allow to discovery, search and ordering of EO Data

ï Integration of partner agencies

Interfaces based on OGC/ESA/HMA-,WMO- and INSPIRE-web-service specifications

ï Integration with new User-Management / IdP-Concepts

services secured by WS-Security and expect SAML2 tokens

for interaction with protected services in other domains Clearinghouse requests SAML token from EO-Portal Security Token Service (STS)

ï Concept and implementation by con terra and EUMETSAT

Page 12: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Clearinghouse

Å Programmatic Interfaces implemented as ñAdaptorsò:

ï translate request sent to interface, route it via ñConnectorsò to legacy or external system

ï Connector ñspeaksò interface language of legacy or external system

ï response send back via interface to requestor

Å If more than one system of same type integrated ï a broker comes into play

ï Handles requests to and responses from backend systems

ï broker concept tested with UserAdminBroker

Å retrieval and management of user-information within legacy systems

Å Implementation based on Java, XSLT, ApacheCXF, Mule 2

Å Mule 2: lightweight Java-based messaging framework that allows to connect applications and enables them to exchange data

Å Mule is based on ideas from Enterprise Service Bus (ESB) architectures.

Page 13: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Clearinghouse

Å Programmatic interfaces

ï OGC/HMA EO Catalogue

Implements:

- OGC 06-080, GML Appli-cation Schema for EO Products

- OGC 06-131, EO ProductsExtension Package for ebRIM Profile of CSW 2.0

based on Data Centre UAPI

mapping between EO GML and Data Centre EO Product information model done

Integrated in ESA SSE and OGC FedEO Clients

Problems:

complex interface

individual tailorings to different confor-mance levels and queryables/returnables

Page 14: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Clearinghouse

ï OGC/HMA Order

Ordering/subscription/access to EOProducts

Implements OGC 06-141 Ordering Services for EO Products

based on Data Centre UAPI

mappings between Order Services and ñData Centreò order model

ï WMO/WIS Catalogue

implements WMO/WIS z39.50/SRUinterface

implemented in Mule 2 as proxy on top of PN CSW interface.

Integrated in WMO/WIS Training Form

- OGC/HMA UserManagement

Implements OGC 07-118 User Management

Page 15: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Clearinghouse

Å Overview of supported OGC/ESA/HMA, WMO, INSPIRE Standards:

ï OGC 07-006r1, OpenGIS Catalogue Service 2.0.2 (Dublin Core information model)

ï OGC 07-045 , OpenGIS Catalogue Service 2.0.2 ï ISO Metadata Application Profile 1.0

ï OGC 06-131 , EO Products Extension Package for ebRIM Profile of CSW 2.0

ï OGC 06-080 , GML Application Schema for EO Products

ï OGC 06-141 , Ordering Services for Earth Observation Products

Å Diverging product options and scene selections will make clients complicated

ï OGC 03-109r1, OGC Web Map Service 1.3.0

ï OGC 07-063r1, OpenGIS WMS EO Application Profile (partial)

ï OGC 07-118 , OGC/HMA User Management

ï INSPIRE Metadata Implementing Rules: Technical Guidelines based on EN ISO 19115 and EN ISO 19119 1.2 (full implementation with PN 2.0)

ï INSPIRE DS: Technical Guidance to implement INSPIRE Discovery Services (full implementation with PN 2.0)

ï WMO/WIS z39.50/SRU ISO19115

Å Only working draft -> should be standardized in a standardization organization like OGC

ï EO Portal SOAP WS-S

ï SAML 2.0 ECP Profile with SOAP Binding

ï SAML 2.0 Web Browser SSO Profile with HTTP Redirect/Post Binding

ï 2011: OGC 07-038r3, OGCÊ Cataloguing of ISO Metadata (CIM) using the ebRIM profile of CS-W

Page 16: 15-17 November 2010 at the Met Office, Exeter, UK...15-17 November 2010 at the Met Office, Exeter, UK Implementation and Use of OGC/HMA/WMO/ISO & Inspire Standards in EUMETSAT EO Portal

Next steps

Å Next development steps include:

ï Enhancement of OGC W*S Operational Services to provide data access via WCS

ï ProductNavigator (PN)

adaptation of PN to terraCatalog 3.0, resulting in PN 2.0

ï Clearinghouse Enhancements

Collection Search via HMA CIM

ï Connector sitting on top of INSPIRE interface of PN

Ordering

ï implement latest spec

ï support of HMA UserManagement

ï Advanced Identity-/UserManagement

Adaptation to HMA UserManagement 0.0.6 (e.g. current STS be replaced with a WS-TRUST STS)

ï Data Centre Ordering Application

to support discovery, search and ordering products from partner organisations

start integrating partners based on OGC, WIS/WMO and INSPIRE_DS interfaces