Top Banner
Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng ,Li Xiang ,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai, (National Meteorological Centre,CMA) 22 - 24 February, 2010, Geneva,Swiss
13

Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Dec 13, 2015

Download

Documents

Stephany James
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Progress of CMA TIGGE Archive Data center

(updated)

Bian Xiaofeng ,Li Xiang ,Sun Jing

(National Meteorological Information Centre,CMA)

Chen Jing Hu Jiangkai,

(National Meteorological Centre,CMA)

22 - 24 February, 2010, Geneva,Swiss

Page 2: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Archive Centre

Current Data Provider

NCAR NCEP

CMC

UKMO

ECMWFMeteoFrance

JMAKMA

CMA

BOMCPTEC

IDD/LDM

HTTP

FTP

Archive Centre

Current Data Provider

NCAR NCEP

CMC

UKMO

ECMWFMeteoFrance

JMAKMA

CMA

BOMCPTEC

IDD/LDM

HTTP

FTP

TIGGE Archive Centers and data providers

Courtesy of Steve Worley, NCAR

UPDATE: TC CXML Providers:• CMA – yes ECMWF – yes Met Office - yes• JMA - yes NCEP – yes CMC - yes (via

NCEP)• KMA - yes

CMA hosts Asia TIGGE Center

Page 3: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

3

Platform (Hardware & Software)

• Linux Cluster (named “Purple Haze”)

• 7 Nodes (IBM X series)• 1 node for Management• 3 node for exchanging data with ECMWF, NCAR,

CPTEC, CMC via LDM• 1 node for data processing • 1 node for MARS server (testing), 1 node for

MARS client• 2 node for ftp server• Connected via GB Ethernet

• Storage: Disk Array• Physical Capacity: < 30 TB• Interface: 4GB-FC

• GPFS:• installed on each node • configured for sharing data within the cluster

Page 4: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

TIGGE Platform Update since 2009

• Apr.2009 Increasing EMS Memory of Nodes,– LDM ---32GB,– Others ---- 16GB

• Jun.2009 : the real-time updates of the TIGGE information on monitoring and requests.

• Jan.2010: expanding 15TB disk array

Page 5: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

CenterForecast Length

(Hour, Day) Members Le vel time Start dateGB/Day

Total(GB)

egrr(UKMO) 0000-0360, 15 24 pl, pt, pv, sl 2(00,12 11/2006 24 28,464

babj(CMA) 0000-0240, 10 15 pl, sl 2(00,12) 02/2007 28 30,660

ecmf(ECMWF) 0000-0360, 15 51 pl, pt, pv, sl 2(00,12)03/200701/2010

150332

157,130

kwbc(NCEP) 0000-0384, 16 21 pl, pt, pv, sl 4 (00,06,12,18) 04/2007 12 12,764

rjtd(JMA) 0000-0216, 9 51 pl, sl 1(12) 05/2007 7 6,990

ammc(BoM) 0000-0240,10 33 pl, sl 2(00,12) 05/2007 8 8,048

cwao(CMC) 0000-0384,16 21 pl, sl 2(00,12) 10/2007 7.5 6,220

lfpw(Meteo France) 0000-0060, 2.5 11 pl, pv, sl1(18)

2(06, 18)10/200712/2009

0.22

286

rksl(KMA) 0000-0240,10 17 pl, sl 2(00,12) 01/2008 5 3,659

sbsj(CPTEC) 0000-0360, 15 15 pl, sl 2(00,12) 02/2008 12 9,340

total 437 260,560

TIGGE Data at CMA : 260TB until 15 Nov.2009

Note:PL = Pressure Level, PT = 320K θ Level, PV = ± 2 Potential Vorticity Level, SL = Single/Surface Leveln

Page 6: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Update of TIGGE data provider :

• LFPW(Meteo France) : since 8 Dec. 2009 , increasing 29274 fields at 06Z and 35152 fields at 18UTC

• RKSL(KMA) : since 18 Dec 2009, increasing 3009 fields at 00Z and 12UTC

• ECMWF: increasing model resolution from N200 to N320, data up to 330GB/day

Page 7: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

CMA portal offers services:

- Access to online & offline data

- Aggregation along any axis (date, level, parameter, origin, ensemble, …)

- Product Generation on Webpage

- Request Monitoring and Query

- User Management and Access Control

- Sub-area selection

- Reduces volumes to be downloaded by many order of magnitude ( Divided into more small tar files )

Page 8: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Request Monitoring and Query

Page 9: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Access control– Administrator: access the whole system and all services

– Common users

• Super Member: access both Data Catalogue and Product Catalogue

• Data Member: access Data Catalogue

• Product Member: access Product Catalogue

Common users are denied access to the User Admin component, and can only monitor or query the status of their own requests.

User Admin Data Product Request Monitoring/Query

Product Member partial

Data Member partial

Super Member partial

Administrator all

Page 10: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

10

TIGGE Data Service by Dec. 2009Supporting 2008 Beijing Olympic Gameweather

serviceTwo trainings for TIGGE users from chinese

research institutes, universities, national and regional meteorological center in 2009

User accessing:Online: data for the last one month.

Offline : data for one month ago

Produce special dataset for research projects

– For example, service dataset during flood seasons in 2007-2008 ( include ecmf 、 kwbc 、 babj 、 rjtd, et al )

– 40 TB data services until 12 2009 for researchers in China

– To reorganize the list and put on the website

Page 11: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

TC CXML data Receiving status at CMA TIGGE Archive Center

centerCentercode

AccessingLagged hours

CMC cwao FTP 11.5h

CMA babj FTP 8.5h

ECMWF ecmf FTP00Z: 7h12Z: 16h

JMA rjtdDSS of

NCAR00Z: 12h12Z: 24h

KMA rksl FTP 8h

UKMO egrr FTP 8.5h

NCEP kwbc FTP 7.5h

Page 12: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

12

2010 key services : TIGGE Data Services For WMO Shanghai EXPO 2010 RDP and FDP projects

Page 13: Progress of CMA TIGGE Archive Data center (updated) Bian Xiaofeng,Li Xiang,Sun Jing (National Meteorological Information Centre,CMA) Chen Jing Hu Jiangkai,

Thank you for your attention