M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010.

M. Lautenschlager, H. Ramthun1 Metafor Review 5 / 2010

METAFOR:WP 6: CIM Creation Tools

M. Lautenschlager, H. Ramthun2 Metafor Review 5 / 2010

WP6 - CIM Creation Tools, Metadata

- Metadata sources- community:

- ESG Publisher database - CMIP5 questionnaire

- local:- modelling environment (e.g. ESMF, IMDI)- legacy datamangement (e.g. CERA)

- human

- Metadata capture methods- access to legacy databases (e.g. ESG Publisher)- XML output of CMIP5 questionnaire- GeoNetwork (view and edit)

M. Lautenschlager, H. Ramthun3 Metafor Review 5 / 2010

WP6 - CIM MetadataActivity:

dataProcessing * from CMIP5 questionnaire

ensemble * from ESG Publisher

numericalExperimentsimulationComposite *

simulationRun *Software:

deployment * modelComponent *

processorComponentData:

dataObject * *Grid:

gridSpecCIM objects:

CIMRecordSet (some objects of the list) CIMRecord (one object of the list)

M. Lautenschlager, H. Ramthun4 Metafor Review 5 / 2010

WP6 - Metadata data flow

ESG publisherESG Data Node

Metadata Capture

model environmentdatamanagement

human

CIM dataObject

Questionnaire

Completion / Repositoryfor Metafor / IS-ENES / ESG

CIM Model / SIM

ESG Gateway

CIM ingestion

CIM population

Database /THREDDS APIAPI

Intermediate CIM XML

M. Lautenschlager, H. Ramthun5 Metafor Review 5 / 2010

GUI for interactive CIM completion

WP6 - CIM XML Architecture

CIM XML (instance) - provided on OAI server- transfer with FTP/Atom

Intermediate CIM XML

CIM complete?

YES

NO

CIM repository

Metadata sources

CIM correct?

YES

NO

GeoNetwork (DKRZ/MPI)Create/UpdateCIM instances

M. Lautenschlager, H. Ramthun6 Metafor Review 5 / 2010

CIM world CIM repository(Central CIM db)

WP6 - CIM world(detailed metadata flow)

data files(archive)

Metadata Capturing

MetadataDatabase

Intermediate CIM XML

ESG publisherTHREDDS

rdb access

GeoNetwork

CMIP5 questionnaire

portal

viewer

query

compare

GUI

ESG (RDF)

M. Lautenschlager, H. Ramthun7 Metafor Review 5 / 2010

<dataObject> … <content> <topic>CF-Topic from ESG database</topic> <unit value=“unit from ESG database"> <server>default controlled vocabulary server</server> </unit> <aggregation>aggregation from ESG database</aggregation>… </content>… </dataObject>

WP6 – THREDDS to CIM

data files(archive with CMIP5 structure)

Intermediate CIM XML

ESG Publisher

modeloutput

Postgres RDBMS

THREDDS Catalog

THREDDS to CIM API- python script- access / transform with lxml- into intermediate CIM XML

CMOR2

controlled by esg.ini

CIM dataObject template

M. Lautenschlager, H. Ramthun8 Metafor Review 5 / 2010

WP6 – GeoNetwork (features)Technology

Ajax (Asynchronous JavaScript Technology and XML) http://geonetwork-opensource.org/

Implementation at: http://cera-www.dkrz.de/geonetwork

Advantages Java + JavaScript capability simple and advanced search (on Lucene index) CV implementation by XML / RDF file access database MySQL, Oracle, postgresSQL XML handling (with XSLT) document view types: flat, advanced, XML schematron rules OAI server included multiple schemas User administration (incl. LDAP and Shibboleth)

M. Lautenschlager, H. Ramthun9 Metafor Review 5 / 2010

WP6 – GeoNetwork (query)

some text

any

any

Text to be searched in all text fields

M. Lautenschlager, H. Ramthun10 Metafor Review 5 / 2010

WP6 – GeoNetwork (result)

M. Lautenschlager, H. Ramthun11 Metafor Review 5 / 2010

WP6 – GeoNetwork (example: dataObject)

incomplete mandatory field

M. Lautenschlager, H. Ramthun12 Metafor Review 5 / 2010

WP6 – GeoNetwork (example: modelComponent)

incomplete mandatory field

M. Lautenschlager, H. Ramthun13 Metafor Review 5 / 2010

WP6 – GeoNetwork (example: simulationRun)

incomplete mandatory field

M. Lautenschlager, H. Ramthun14 Metafor Review 5 / 2010

WP6 – GeoNetwork (issues for CIM completion)

performance of XML document loading implementation of:

complete Metafor CV helptext (from questionnaire)

Atom support OpenID support

M. Lautenschlager, H. Ramthun15 Metafor Review 5 / 2010

WP6 - Next steps

GeoNetwork issues:

- complete integration of Metafor controlled vocabulary (CV)- complete integration of Metafor helptext- implementation of Atom- implementation of OpenID authentification

CIM service:

- tool / service to access THREDDS catalog

CIM service:

- tool / service for upload XML into questionnaire

M. Lautenschlager, H. Ramthun16 Metafor Review 5 / 2010

WP6 – ...

Thank You!