End-to-end Data Management for Operational Observation Systems Presented to the Summit on Long-Term Monitoring of the Gulf of Mexico Hypoxic Zone Sharon.

End-to-end Data Management for Operational Observation Systems

Presented to the

Summit on Long-Term Monitoring of the Gulf of Mexico Hypoxic

Zone

Sharon Mesick, NCDDCEcosystem Program Manager

January 2007

Overview

• End-to-end data management projects

– SEAMAP / Gulf of Mexico Hypoxia Watch (pg 3)

– WCO – NODC Conduit (Appendix B)

• Adopting best practices for an Operational

Observation System

Five Data Management Functions

• Discover– Look, find and get data, data products and information

• Access– To data and information

• Archival– Storage and maintenance

• Products– Quality Assurance, development and maintenance

• Outreach– Facilitate stakeholder awareness

SEAMAP / Gulf of Mexico Hypoxia Watch

• Partnership project

– NMFS, CoastWatch, NCDDC

• Manual data development process

– Interoperable standards addressed

• Metadata, geospatial

– Discovery, access, archive requirements

met

• Multiple public access points

Hypoxia Watch Data Management Flow

ProductsGIS & JPEG

NODCArchival

NCDDCMetadataCatalog

NCDDCClearinghouse

NodeMERMAid

NCDDC Data Development-------------------------

• Receive / QC data• Geospatially enable• Generate contours• Generate metadata• GIS Integration• Product generation

Multiple Public Access Points

• Direct Data Access

– Ocean Archive System

• Data Access

Applications

– Internet GIS

• Metadata Search

– NCDDC Portal

– FGDC Clearinghouse

– Geospatial One Stop

• General Access

– Hypoxia Web site

Gulf of Mexico Hypoxia Watch Program

http://www.ncddc.noaa.gov/ecosystems/hypoxia

West Coast Observing System

• Partnership project– NMSP, CeNCOOS, PISCO, NODC, NCDDC, others

• Operational, end-to-end system– Automated, extensible system

– Interoperable standards addressed• OPeNDAP, metadata, geospatial

– Discovery, access, archive requirements met• Multiple public access points

End-to-End Data Management

Multiple Public Access Points

• Direct Data Access

– NODC OPeNDAP Server

– OPeNDAP.org

– Ocean Archive System

• Data Access

Applications

– Internet GIS

– WCOS Portal

• Metadata Search

– NCDDC Portal

– FGDC Clearinghouse

– Geospatial One Stop

• General Access

– SIMoN (Sanctuary

Integrated Monitoring

Network)

– CeNCOOS OceanObs

Access Catalog Holdings

Publish

HypoxiaCatalogWebsite

NCDDCFTP

Server

NODCRetrievalProcessHypoxia

Catalog

NCDDC WCO-NODC Conduit

-------------------------

HypoxiaWatch

LUMCON

NGoM/CI

Other

NODCOPeNDAP

Server

NODCArchival

NCDDCMetadataCatalog

NCDDCClearinghouse

NodeMERMAid

•Determine new data•Retrieve new data and metadata•Convert data•Call XML-RPC server to generate and publish metadata•Package results and send to FTP site

XML-RPC Server----------------

•Convert metadata to FGDC XML•Publish to various systems

Send Retrieve

Publish

Publish Publish Ingest

Send Metadata forConversion and Publishing

Retrieve newData and Metadata

End-to-End Hypoxia Data Management

Summary

• WCOS – demonstrates an operational, automated system– Readily extensible

• Coral Reef Early Warning System• Flower Garden Banks, other NMS

• Proposed hypoxia data management system ensures a strong integrated approach– Consistent data standards and procedures– Engages regional partners in data assembly– Supports discovery, access, delivery, and archive– Real-time, NRT and collections

Contacts:

Russ Beard, NCDDCActing Director

[email protected]

Sharon Mesick, NCDDCEcosystem Program Manager

[email protected]