Proposed “Water Portal” Project

Proposed “Water Portal” Project

WGISS-29 meetingMay 18, 2010

Satoko Horiyama MIURAJAXA/MOSS

Contents

2

1. Introduction2. Status on JAXA system3. Project Implementation Plan4. Discussion and Approval !!

3

Introduction

4

Name of the Portal/Project“Water CoP Portal” => Beyond the

current CEOS/WGISS functionsWater Portal => Unclear…CEOS Water Portal => Sounds good ?WGISS Water Portal => ?

5

Overall PlanTarget: Researchers, Staffs for Water

Management, etcHow to collaborate within WGISS ?

Option 1: Portal, including link information to “Water related services” of WGISS participants

Option 2: Collaboration with IDN teamOption 3: Cross search for Water Related Satellite

data (Collaboration with WADC)Option 4: Collaboration between Water related

servicesOthers ??

6

Expecting(potential) membersJAXA : LeadNOAANASANSAUOthers ?

7

(Expecting) Milestones May 2010 (WGISS-29) : Project Team Approval May 2010 (WGISS-29) ~ : Coordination among

participants on “Options”. ~Sep. 2010 (WGISS-30) : Implementation Plan Update Oct-Nov. 2010 (CEOS Plenary & GEO Plenary) : First beta

version of “CEOS Water Portal (tentative name)” ~May 2011(WGISS-31) : IP re-update Oct-Nov. 2011 (CEOS Plenary & GEO Plenary): Second

beta version of the portal

8

Project Implementation Plan

9

Status of JAXA system

1. Introduction1.1 What is “JAXA Distributed Data Integration System” ?

10

1) Originally developed for CEOP project (CEOP : Coordinated Energy and Water Cycle Observations Project http://www.ceop.net/)

2) The system (aka WTF-CEOP system, http://jaxa.ceos.org/wtf_ceop/) is developed aiming to integrate various CEOP data stored in “distributed” data centers, where such system architectures as examined in CEOS/WGISS is applied.

1.2 Feature of CEOP Data and Distribution of CEOP Reference Sites

11Phase II period (2007-2011) : 52 CEOP Reference Sites

Phase I period (2002-2004) : 35 CEOP Reference Sites

[Data Type] - In-situ data, - Satellite data, - Model output

(1) Major Feature of CEOP Data

(2) Global Distribution of CEOP Reference Sites

[Location] - CEOP Reference Sites

[Period] - Phase I : 2002 - 2004, - Phase II : 2007 - 2011

Web Browser

User

JAXA’s Distributed SystemPrototype for CEOP

MPI

MOLTS

GriddedModel

UT(University of Tokyo)

UCAR

Request

Data

XML Catalog DB

Satellite

In-situ

• Currently, Satellite data, In-situ data and Model Output data (MOLTS and gridded) stored in distributed CEOP Archive Centers are available for users through JAXA’s Distributed Data Integration System Prototype.

CGI (Perl)

Ferret

OPeNDAP

CEOP Archive Centers

http://ceop.restec.or.jp/

1.3 System Structure

12

OP

eND

AP

OP

eND

AP

Jblo

bht

tp (t

ailo

red)

(Max Planck Institute for Meteorology)

(University Corporation for Atmospheric Research)

Standard Access Protocol (=>OPeNDAP)

1.4 System Summary of JAXA Distributed Data Integration SystemData Integration (in-situ, satellite, and model output)

(1) CEOP Archive Centers in remote locations are connected using standard data access protocol : --OPeNDAP(2) Single user interface - Spatial Data Integration - Temporal Data Integration - Consistent data variable names

Functions to facilitate Easy Access

(1) Select Data by - time range (start time / stop time) - CEOP Reference Site, Station name - height or depth - variable name(2) View data (plot and view values on the screen) (3) Compare Model output data and In-situ Data in a single chart(4) Download data (NetCDF, ascii)

13

2. Status and User Requests

14

(2) Users Requests• Enhancement of current data services is requested from users towards

comprehensive hydrological data service for water community.

(1) Status

• We would like to enhance both Data and Services of the JAXA Distributed Data Integration System as a portal for water community.

• The system has been operational for five years. • CEOP phase I data (2004-2004) can be accessed via the system.• CEOP phase II data (2007- ) will be incorporated in this year.

- Precipitation- Run off/River discharge- Groundwater- Flux

Requested Hydrological Data: GTN-H data

3.1 Various Hydrological Data

15< Station Map of GRDC/GTN-R >

< GPCC Monthly Precipitation Data >

< IGRAC Groundwater Map >

3.2 Requested Data from Users

16

Primary target data in this current first phase.

• Very important and essential, but missing in the current system.

One of Requested Data for Hydrological Application = River Basin Data

Requested data are sumarized

Water Portal(extension of JAXA Distributed

Data Integration System)

.. So on

・ GRDC・ GPCC

User

MPI UCAR

DIAS/UT・ GEOSS/AWCI

Data ： CEOP Phase I (2002-2004), Phase II (2007-2011) data (Global Runoff Data Center)

【 GTN-H Members】(Global Precipitation Data Center)

UT

GTN-H

: Current JAXA Distributed Data Integration System

3.3 Future System Structure- Networks with Various Systems

17

・ IGRAC(International Groundwater Resource Assessment Center)

River Discharge DataIn Asian Countries

Climate In-situ SatelliteModel Output

GEOSS ・ DA-09-01ARiver Discharge Data

Collection of Global Climate In-situ Data

・ DIAS Partners

Present Network Future Plan

・ FLUXNET・ NSIDC(National Snow and Ice Data

Center)

User Potential Partners of New Collaboration

4. 1 Options for interface betweenWater portal and Data Partners (1/2)

18

Type 1

Type 2

Type 3

Type 4

User Water Portal Data Partners•Get Dataset Info•View/Obtain Data

DatasetMeta

Data

Data

Data

DatasetMeta

DatasetMeta

Data ServerClient

• Home Page• FTP Site

DatasetMeta

•Get Dataset info•View/Obtain data

•Get Dataset info•View/Obtain data

•Get Dataset Info

•Jump

•Transfer data on-the-fly(via CEOP Interface)

•Transfer data on-the-fly(via Cooperator’s Interface)

Data ServerClient

Client

Client

4.1 Options for interface betweenWater portal and Data Partners (2/2)Category

Merit Demerit AccessMethod IF Server

BuilderRemarks

・User can selcetDataset via WaterPortal.・User can jump to dataprovider's website byfollowing links .

Influence onUser Service

・User can selectDataset, select Data,and View/ Obtain Datavia Water Portal.

Necessary Worksin Data Partner

System Feature

・User can selectDataset, select Data,and View/ Obtain Datavia Water Portal.

None

None

-

URL Link

IF used inWTF-CEOP(OPeNDAP

etc)

-

Cooperater

Water Portal

Server/Client

Type 1

Type 2

Server/Client

・User can notselect Data norView/ Obtain Datavia Water Portal.

・Some limitationsmay take place.

・User can selectDataset, select Data,and View/ Obtain Datavia Water Portal.

IF used inCooperater's

SystemCooperater

- -

・Create Metadataabout Dataset

・Data is archivedinside the WaterPortal.

（E.g. Non timeseries data）

Type 3

Type 4

・Detail discussionshould be held tostep forward

・Create Metadataabout Dataset・Build Data Server

・Provide Informationof IF to Water Portal・Discuss technically

・For limitednumber of data

・Create Metadataabout Dataset・Provide Data toWater Portal

19

4.2 Current Data Services in GTN-H Members

Data Type TimeSeries

Data AccessMethod Data Select & Get Flow Remarks Access

TypeFTP Select Product

-> Select year and grid size-> Download zip file of 12 months

Download Station Catalogue-> Select Station-> Select Period and Interval(Monthly/ Daily)-> Fill in the order- sheet, writeresearch explanation-> Send Email/ Fax

Type 1,Type 3, orType 4

Type 1,Type 3, orType 4

YesRiverDischarge(In- situ)

GRDC

MonthlyPrecipitation

(Grid)

GPCC Yes

NSIDC

FLUXNET

IGRAC No

TBD

TBD TBD

WatergroundThematic

Maps(shapefile)

FLUX Data(In- situ)

・Station Catalogue is inExcel. Also, KMZ forviewing location andmean value graph ofeach station.

Data Obtain viaMapService

FTP

Select Area with the Map-> Select Atrribute Category-> Select Atrribute Item-> View Map, and Download Data

・GGMN (GlobalGroundwater MonitoringNetwork) Web Servicefor In- situ data isavailable only forIGRAC member.

（Type 3 incase withGGMN）

Off- line

Type 1,Type 2, orType 4

Select Product-> Immediate FTP, or FTP CartService with Email Notice

TBD TBD

TBD TBD TBD

20(Data and services of each GTN-H member are surveyed using its website.)

21

5. User Service Concept of the New System5.1 User Service Concept

In order to achieve quick and smooth “find and view” of various hydrological data, some key points were identified and reflected into the User Interface plan.

• GUI Plan for users to Select and Access Easily

- Data Type (Grid, Location Time Series)- Hydrological Variables (Precipitation, river discharge, groundwater, flux ..)- Time Range, Observation Interval- Space Range - Format

• Portal are to be capable of handling various datasets and adding more datasets flexibly afterward.<Various Datasets>

22

5. User Service Concept of the New System(Cont’)• GUI Plan and identified Key Points

GUI Plan Key Points

(A) Dataset Selection Page -Available Dataset is easy to select, by Water Cycle categories and/or by map.

(B) Dataset Information Page - Dataset information is given to understand dataset.

（C)

Data Parameter Selection Page -

Dataset parameters (hydrological variables, period, area, etc) are clearly given to identify data granule easily.

　 　 - Within several simple steps, selection can be made.

(D) Data View Page - Data can be viewed in Web Map and Graph.

　 　 - River Basin information is available in the map and data selection.

　 　 - Easy to access another related data sequentially.

23

5. User Service Concept of the Water CoP Portal (Cont’)5.2 User Interface and Use Case Example

Select/Zoom in to certain region/river basin

(3) Select dataset, select parameter, then view/obtain each data

(e.g. using station maps of CEOP, AWCI, GRDC, and so on)

(e.g. referencing GRDC Basins GIS Data)

(e.g. using GPCC data)

(2) View available images and In-situ stations’ location

• Detail of services is under examination from the viewpoint that how they will be realized in GUI.

Sample Use Case and GUI under development “See precipitation image first, next, select river basin, then view multiple hydrological variable data plots in that basin to think about water flow.“

(1) View precipitation image

… Following slides show parts of GUI.

24

5.2 Use Case Example

Select/Zoom in certain region (or river basin) in the Web Map.

(1) View precipitation image, at the “(A) Dataset Selection Page”

View image in the Web Map.

Precipitation in June 200*

25

5.2 Use Case Example (Cont’)(2)View available images and In-situ stations’ location, “(A) Dataset Selection Page”

(e.g. using GRDC Basins GIS Data, station location info of CEOP, GRDC, and so on)

Available datasets and their location info come up in the Web Map and Menu. Station info appears which may has

a link to a profile of that station.

GRDC In-situCEOP In-situ

Image LayerGPCC Precipitation ImageGRDC River Basin Image

・・・

View Data

View Data

26

5.2 Use Case Example (Cont’)(3) Select dataset, select parameters, and then view/obtain each data

GRDC In-situ

CEOP In-situImage Layer

GPCC Precipitation Image・・・

View Data

i) Select dataset, at the “(A) Dataset Selection Page”

View Data

ii) Select parameters, at the “(C) Data Parameter Selection Page”

iii) View chart, “at the (D) View Page”

27

[Dataset ] GRDC River Discharge Data for GTN-H

[Time]

[Place (Area/Location)]

[Hydrological Variable]

View Graph Obtain Data

Available places

Available variables

→ Selected place:

→ Selected variable: Parameter A

Place A

Available Time (Range)→ Selected Time: Start Day End Day～

River X, Station AAA

River discharge

2004 June

■View Product Information

2006 June～

- Link to dataset metadata- Link to provider’s

website

- Link to existing site search site

(E.g. FLUXNET Site Search Page)

5.2 Use Case Example (Cont’)ii) Select parameters, at the “(C) Data Parameter Selection Page”

■Open Site Search

System provides links if there is any complementary website which helps to learn dataset and select parameters.

28

■Add Graph[Graph]1| 2 | 3 … >> (Paging)

Station A, River XGTN-R River Discharge Jun 2004 – June 2006

- Select New Dataset

- Select Same Dataset but different Option

Station B, River XCEOP Precipitation Jun 2004 – June 2006

Station B, River XCEOP Air TemperatureJun 2004 – June 2006

( → Go to Product Selection Page ）

5.2 Use Case Example (Cont’)iii) View chart, “at the (D) View Page”

System provides multiple graphs to view different data at a time.

( → Go to Parameters Selection Page ）

6. Way Forward

29

Current Milestone• [Status] - Conceptual study is going-on - Start surveying data and services of potential partners • [Short Term Target] - Develop first prototype targeting Nov 2010

First Water Portal Prototype

Extension of First Prototype

2010 2011Nov

develop

developsurvey, design

30

Discussion and Approval