Status of CNGrid and Interests on International Testbed Depei Qian Sino-German Joint Software Institute (JSI) Beihang University SC12 BoF on Computing.

Status of CNGrid and Interests on International Testbed

Depei QianSino-German Joint Software Institute (JSI)

Beihang University

SC12 BoF on Computing Research Testbeds as a Service Salt Lake City, USA

Nov. 13, 2012

863 key projects on HPC and Grid: 2006-2010

“High productivity Computer and Grid Service Environment” Period: 2006-2010 (extended to now) 940 million Yuan from the MOST and

more than 1B Yuan matching money from other sources

CNGird is one of the major outcomes of the project

CNGrid environment 14 sites

SCCAS (Beijing, major site) SSC (Shanghai, major site ) NSCTJ (Tianjin) NSCSZ (Shenzhen) NSCJN (Jinan) Tsinghua University (Beijing) IAPCM (Beijing) USTC (Hefei) XJTU (Xi’an) SIAT (Shenzhen) HKU (Hong Kong) SDU (Jinan) HUST (Wuhan) GSCC (Lanzhou)

The CNGrid Operation Center (based on SCCAS)

CNGrid sitesCPU/GPU

Storage

SCCAS 157TF/300TF

1.4PB

SSC 200TF 600TB

NSCTJ 1PF/3.7PF 2PB

NSCSZ 716TF/1.3PF

9.2PB

NSCJN 1.1PF 2PB

THU 104TF/64TF 1PB

IAPCM 40TF 80TB

USTC 10TF 50TB

XJTU 5TF 50TB

SIAT 30TF/200TF 1PB

HKU 23TF/7.7TF 130TB

SDU 10TF 50TB

HUST 3TF 22TB

GSCC 13TF/28TF 40TB

THUTHUIAPCMIAPCM NSCTJNSCTJ

NSCJNNSCJN

SSCSSC

USTCUSTC

NSCSZNSCSZ

HKUHKUSIATSIAT

HUSTHUST

SCCASSCCAS

GSCCGSCC

XJTUXJTU

SDUSDU

CNGrid Resources

14 sites >3PF

aggregated computing power

>15PB storage

CNGrid GOS Architecture

Tomcat(Apache)+Axis, GT4, gLite, OMII

Dynamic DeployService

CA Service

System Mgmt Portal

Hosting Environment

Core

System

Tool/App

Message Service

Agora

User Mgmt Res MgmtAgora Mgmt

Naming

HPCG App & Mgmt Portal

GSML Browser

ServiceControllerOther

RController

BatchJob mgmt

MetaScheduleAccount mgmt

File mgmt

metainfo mgmt

HPCG Backend

Resource Space

GOS System Call (Resource mgmt，Agora mgmt, User mgmt, Grip mgmt, etc）GOS Library (Batch, Message, File, etc)

Other Domain Specific Applications

Grip Runtime

Grip Instance MgmtSecurity

Res AC & Sharing

Other 3rd software &

tools

Java J2SE

GridWorkflowDataGrid

IDE Compiler

GSML Composer

GSML Workshop.

Debugger

Grip

Gsh & cmd tools

VegaSSH

Cmd Line Tools

DB ServiceWork Flow

Engine

Grid Portal, Gsh+CLI, GSML Workshop and Grid Apps

OS (Linux/Unix/Windows)

PC Server (Grid Server)

J2SE(1.4.2_07, 1.5.0_07)

Tomcat(5.0.28) +Axis(1.2 rc2)

Axis Handlers for Message Level Security

Core, System and App Level Services

Domain application Grid

Introducing Cloud Computing concept into CNGrid CNGrid—as IaaS and partially PaaS Domain application Grids—as SaaS and partially PaaS

Taking advantages of aggregating distributed heterogeneous resources by Gird and of applying the business model of cloud computing

Prototype domain application Grids Simulation and optimization

automobile industry aircraft design steel industry

Scientific computing Bio-information application computational chemistry

Domain application Grid (cont’d) Using CNGrid as virtual

resources which can be dynamically requested and allocated

End users obtain resources and services via domain application grids

Business model defined between CNGrid and domain application grids

Accounting Billing policies

Promote usage of CNGrid

Exploring sustainable development of CNGrid

业务逻辑层

文件管理 应用社区管理 作业管理 用户管理

流程管理资源管理 交易管理 问题管理

GOS层作业批处理

认证服务

元信息服务

社区管理数据传输 记帐服务

消息服务 元调度服务

用户映射

资源层 CNGrid资源

上海超算

社会资源数据资源

魔方（曙光5000A）

…

西安交大

数据资源…

…...

数据资源…

用户访问层工业社区

社区支撑环境

监控服务

工业社区portal

Domain applications (Grid)

Drug Discovery Weather forecasting Scientific data Grid and its application in research Water resource Information system Grid-enabled railway freight Information system Grid for Chinese medicine database applications HPC and Grid for Aerospace Industry (AviGrid) National forestry project planning, monitoring and

evaluation

Status of e-Infrastructure

Still far behind in many aspects Especially weak in applications Need multi-disciplinary research Shortage in cross-disciplinary talents

Sustainable development is crucial Lack of regular budget for e-Infrastructure Always competing funding with other

disciplines

The 12th 5-year plan

China’s high-tech program has identified priority topics in both HPC and cloud computing

A key project on cloud computing has been launched “Key technologies and systems of cloud

computing (1st phase) Network operating systems Network search engines Network based language translation

Cloud system management Prototype cloud systems

The 12th 5-year plan (cont’d)

A new key project on “high productivity computer and application service environment” launched (2011-2015)

Emphasis on balanced development on high productivity computers, application environment, and HPC applications

Cooperation with EU and US

EU FP6/FP7 EUChinaGRID EchoGRID Bridge Chain EPIKH Chain-Read

US Cooperation with the Condor team China-US cooperation on software (to be initiated)

Extreme scale software Emerging software architechtures Trustworthy software

Interests on international testbed

Experiments and evaluation on new technologies

Coordinating research efforts and exchanging R&D experiences

Joint development on some topics with common interests

Issues to be addressed

Interoperability of existing software and development of new software for testbed

Cost/Funding Network bandwidth

Thank you!