Interoperable Information System of Systems for HTAP Rudolf B. Husar and Rich Scheffe With Erin Robinson Presented at HTAP Workshop, WMO, Geneva, January.

Interoperable Information System of Systems

for

HTAP

Rudolf B. Husar and Rich Scheffe

With Erin Robinson

Presented at

HTAP Workshop, WMO, Geneva, January 26, 2006

Approach: HTAP as a Learning Organization

Information System Approach:• Guiding Idea: Refine, solidify, evangelize the System of Systems idea• Methods and Tools: Develop, promote, use standards; SoS use cases• Infrastructure: Maintain middleware; embrace Web 2.0

Based on P. Senge et. al, 1994: Architecture of Learning Organizations(Link)

Guiding Idea: System of Systems

Methods, Tools: Standards, Use Cases

Infrastructure: Middleware, Web 2.0

Domain of ActionOrganizational Architecture

The HTAP - GEOSS• Stakeholders are autonomous countries, organizations• Diverse perspectives on the issues, solutions• Recognition of the need to understand, act • Pollution sources and impacts are hemispheric• Observations and models are ready for integration• Information integration is key to success

Hence

GEOSS is a good system model for HTAPHTAP is a suitable use case for GEOSS

Some Characteristics of System of Systems (SoS)

• Autonomous constituents managed independently• Independent evolution of each constituent• Displays emergent (novel, unpredictable) behavior

Generic Decision Support for Air Quality Decisions

Global Earth Observing System of Systems

GEOSS

Architecture Framework

Knowledge into the Minds of

Policy Analysts

Knowledge into the Minds of

Technical Analysts

Observations

Reports:Models, Forecasts,

Obs. Evidence

Models

DecisionsKnowledge

into the Minds of

Decision- making managers

Decision Support System

Interoperability: Connecting Machines and People

IP – Internet Protocol

Open Architecture Data Standards Service Based

Amplify Individuals Connect Minds

Interoperability Stack: Key concept of the Web System components have to be interoperable at each layer

Interoperability – Necessary for SoS

What few things must be the same so that everything else can be different?

WCS/WMS

App

App

App

AppAre WCS/WMS Space-

Time-Parameter queries a Convergence Protocols?

Convergence Protocols

Value-Adding Processes in HTAP

Integrated DataDatasets

Std

. In

terf

ace

Data ViewsS

td.

Inte

rface

Data

Control

Reports

Reports

Obs. & Models Decision Support System

Analyzing

Filter/IntegrateAggregate/FuseAssimilate

Organizing

DocumentStructureFormat

Exploring

Display BrowseCompare

Valu

e-A

dd

ing

P

rocesses

Data Manager Technical Analysts

DB System Analysis System Reporting System

Loosely Coupled Data Access through Standard ProtocolsOGC Web Coverage Service (WCS)

Client request Capabilities

Server returns Capabilities and data ‘Profile’

Client requests data by ‘where, when, what’ query

Server returns data ‘cube’ in requested format

GetCapabilities

GetData

Capabilities, ‘Profile’

Data

Where? When? What? Which Format?

Server

Back End S

td.

Inte

rface

Client

Front EndS

td.

Inte

rface

Query GetData Standards

Where? BBOX OGC, ISO

When? Time OGC, ISO

What? Temperature CF

Format netCDF, HDF.. CF, EOS, OGC

T2T1

Integrated DataDatasets

Std

. In

terf

ace

Data ViewsS

td.

Inte

rface

Data

Control

Reports

Reports

Obs. & Models Decision Support System

Web Services and Workflow for Loose Coupling

Integrated DataDatasets

Std

. In

terf

ace

Data ViewsS

td.

Inte

rface

Data

Control

Reports

Reports

Obs. & Models Decision Support System

Service Broker

Service Provider

PublishFind

BindServiceUser

Web Service Interaction Service Chaining & Workflow

Collaborative Reporting and Dynamic Delivery

Integrated DataDatasets

Std

. In

terf

ace

Data ViewsS

td.

Inte

rface

Data

Control

Reports

Reports

Obs. & Models Decision Support System

Co Writing - Wiki

Screencast

Analysis Reports:

Information supplied by manyNeeds continuous program feedbackReport needs many authorsWiki technologies are for collaborative writing

Dynamic Delivery:

Much of the content is dynamicAnimated presentations are compellingMovies and screencasts are for dynamic delivery

NSF: The Fifth Cyber-Dimension

Characteristics of a 5D World

• The 5D World is Flat– Information is the primary driver for progress

– Time and place are no longer barriers to participation

– Access is open to specialists and non-specialists alike

• The 5D World is Expanding– New capabilities, resources, mechanisms

– More spaces for learning and innovation

– More opportunities for collaboration (emergence)

From GADS to IGOS/GEOSS Information Systems

Example

AeroCom

1990 2006 2012?

Recognize, exploit SoS Characteristics:

No stakeholder has complete SoS insightCentral control is limited -> distributedUsers involved throughout the life of SoS

Approach

Use and build on existing systemsTransform data to information for societyUse open standards, shared architecture

Imagine 1012 A 20-fold increase in Earth Science Capabilities?

• More Data 2x sensor x 6x networking = 12x• Powerful Tools 2x power x 3x workflow = 6x • Better Ideas 1x individ. x 2x group = 2x

Individually: 5x collectively: 20x

…again the confluence! Knowledge creation will be driven by the

combination of data, tools and ideas

Some changes will be driven by the digital revolution.. but the networking, workflow and group creativity

is in the hands of the

atmospheric science community

Imagine…More Shared Global Obs & Models

2012More Global Data & Models

2006Global Data & Models

Imagine…More Local Obs., Models, Knowledge

2012More Local Obs., & Models

Tacit Knowledge

2006Obs & Models

Imagine…more tools

Apparent divergences?Organizations have different missions

NPSProtect ecosystems, AQ WQ

NASAExplore fundamental Earth System Properties

USDAProtect/optimize Ag and forest resources

EPA (Protect human health & envi.

Improve air, water, ecosystem

CDCTo promote health and quality of life ….

NOAATo understand and predict changes in the Earth’s environment and …

Collaboration (culture) empire building?

Observation technologies {e.g., satellites}

Computational power

Science, talent{embodied in AQ models and young geniuses}

Budgets, agency collaboration resource/program accountability

Accountability, ↓ regulatoryassessments {e.g., NAS, CASAC}

Information technologies{e.g., data sharing protocols}

Alignment

Stars aligned?Confluence, again..

HTAP 2005 Workgroup Summary Goal: Advance AQ model-observation system to level of met FDDA systems

• General Approach– Build Organizational frameworks : IGACO-EMEP efforts– Adopt model evaluation/fusion as a design principle

• Harness communities around tools, platforms and programs – AQ modeling platforms (GEOS-chem, MOZART, CMAQ,….more), Satellite

Instruments (MODIS, OMI), Surface (AIRNow) and aircraft programs– Integration efforts (AEROCOM), Earth Science Information Partners (ESIP)

• Integration of disparate data bases– Integration & fusion of ground, aircraft and satellite obs. platforms)– Data base unification, QA/QC; Requirements; Metadata– Use cases: AeroCom, NAM model/obs comparison (2006-)

• Technologies (2006-):– Develop, testing of Convergence Protocols for SoS– Data access by space-time query (WCS)– Naming conventions (C. Textor)