Challenge in Building Challenge in Building National Scale Grid National Scale Grid Infrastructure Infrastructure Somsak Sriprayoonsakul Somsak Sriprayoonsakul Thai National Grid Center Thai National Grid Center Software Industry Promotion Agency Software Industry Promotion Agency (SIPA) (SIPA) Ministry of Information and Ministry of Information and Communication Communication
40
Embed
Challenge in Building National Scale Grid Infrastructure Somsak Sriprayoonsakul Thai National Grid Center Software Industry Promotion Agency (SIPA) Ministry.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Challenge in Building Challenge in Building National Scale Grid National Scale Grid InfrastructureInfrastructure
Somsak SriprayoonsakulSomsak SriprayoonsakulThai National Grid CenterThai National Grid CenterSoftware Industry Promotion Agency (SIPA)Software Industry Promotion Agency (SIPA)Ministry of Information and CommunicationMinistry of Information and Communication
Thai National Grid ProjectThai National Grid Project• A 4 years project
under Ministry of Information and Communication Technology
• 5.5 Million US$ program
• Start from 13 universities and 1 government organizations
• Extending rapidly
MinisterMICT
National Grid Committee
DirectorSIPA Board
SIPA
AdminStaffs
Member Institutes
DirectorThai National Grid Center
Researchers
BoardThai National Grid Center Associate Director
Thai National Grid Center
Partner InstitutesPartner Institutes
Bangkok
Chaingmai University (CMU)
Chulalongkorn University (CU)Kasetsart University (KU)King Mongkut’s Institute of Technology North Bangkok (KMITNB)King Mongkut’s University of Technology Thonburi (KMUTT)King Mongkut’s Institute of Technology Ladkrabang (KMITL)Mahidol Unversity (MU)Silpakorn University (SU)Meteorological Department of Thailand (TMD)
•Pilot Grid and Cluster infrastructure•Interoperable Middleware•Basic computational Grid•Basic Data Grid•POC applications
•Stable Grid and Cluster infrastructure•Interoperable Middleware and basic services•Basic computational Grid•Basic Data Grid•Grid Portal•Grid applications
8 Private Universities13 Mahachulalongkorn Rajawitayalai9 Other agencies9 Rajamangala Institue of Technology (44 Campus) Ministry of Education (for Under Higher Education)
2. Site deployment• Install NPACI Rocks 4.1• Install ThaiGrid Roll
3. Site setup• Grid CA setup• Setup of Grid services• Register site with Grid Control Center node
4. Site Certify
Site firewall compliance Site firewall compliance testtest
• ThaiGrid using Globus 4.0 software that comes with NAPCI Rocks
• Focus on using Pre-WS Grid component – 2119 – Globus Gatekeeper– 2811 – Grid FTP– 2135 – Globus MDS– 80 – For web access– 22 – For SSH access– 10001 – 20000 – reserved for applications
• Firewall is a nightmare for Grid deployment– A Firewall testing tools is needed to identify firewall
problem
Firewall testing toolFirewall testing tool
• A firewall tester program “TGCheckport” is developed.
[bank@tgcc TGcheckport-1.3]$ ./TGcheckport.sh maeka.ku.ac.thStart testing maeka.ku.ac.thTue May 16 16:48:31 ICT 2006determining globus-gatekeeper service [2119] ... Passdetermining gsiftp service [2811] ... Passdetermining globus-mds service [2135] ... Passdetermining scmsweb service [80] ... Passdetermining globus-mpi-required-spare-port service [10001-20000] ... PassCongratulation, you pass all the test. Your system is ThaiGrid FirewallCompliance.Finish testingTue May 16 16:48:32 ICT 2006[bank@tgcc TGcheckport-1.3]$
• Site deployment process– OS installation using – Grid core middleware (Globus) installation– Grid additional middleware installation
• MPICH-G2, ninf-G, GSI-ssh
ChallengeChallenge
• All these must be done on every cluster nodes to ensure compatibility for all components
• Manual installation is time consuming, costly, and error prone
• Rocks simplify all of these process due to the roll concept– OS and Middleware installation are highly automatic
ChallengeChallenge
• Many Grid middleware components are needed– SGE/NINF-G/GLOBUS/MPICH/SCE– Each has already been packed into Rocks Roll– Nevertheless, to completely install all software require many
rolls
• Solution: every software are bundled to a new ThaiGrid Roll– A Jumbo Roll bundle all standard Grid software together
ThaiGrid Roll
HPC Grid
SGE
Java
Ninf-G
SCE
Site Setup for ThaiGridSite Setup for ThaiGrid
• Setup host certificates for Grid• Metadata Service Setup• Enable some services
– Jobmanager-sge– Grid-FTP– GSI-SSH
• Joining with Grid Control Center– Currently using SCMSWeb for central web-base monitoring– Technical contact of each site will send an e-mail with URL of
cluster monitoring nodes– Grid meta-scheduler on GCC will distribute jobs to each
institutes cluster• Setup Grid user
Site SetupSite Setup
• Traditional Grid setup are based on manual setup– Complicate– Error prone
• ROCKS 4.1 provide mechanism for automatic grid installation and configuration– Rocks has already configured almost every services for basic
Grid system
• Anyway, some additional manual setup is needed• We currently use a well-documented admin guide to
provide a step-by-step to join ThaiGrid
Thai Grid Control CenterThai Grid Control Center
• Grid Control Center Software– Monitoring
• Automatic testing• Service Monitoring• Accounting• System monitoring• Netwwork Bandwidth
– Grid-level Job scheduling
Thai Grid Control Center Thai Grid Control Center (con’t)(con’t)• Automatic Grid services status monitoring• Command line for immediate status checking
• ThaiGrid Drug Discovery Infrastructure• Grid based data assimilation using RS data• Implicit Narrowband Level Set Method for Fire
Spread Model• The Parallel Simulation Model for Thin Film Dep
osition Using the DSMC Method• Medical Grid
• Access Grid
ThaiGrid Drug Discovery ThaiGrid Drug Discovery InfrastructureInfrastructure
• Partners:– Dr. Jak Saengma, KU– Somsak Sriprayoonsakul, TNGC– IBM Thailand
• Challenges– From over 10000 active compounds available
from Thai medicinal plants database, find a smallest set of compounds that has a potential to be used as a drug
– Very compute intensive. Several month of computing time
• Solution: Use grid to increase computing power to 10-100 times
– Distributed screening process to hundred of hosts on the Grid
• Benefit– Speeding up time to results– Allow scientists to spend more time analyzing
results
Grid based data assimilation Grid based data assimilation using RS datausing RS data
• Dr. Kiyoshi Honda, AIT• Dr. Putchong Uthayopas, THNC• Challenges
– Using GA based data assimilation for agricultural monitoring
– Very long computation time from months to years
– Large amount of RS data needed to be moved around and process
• Solution: – Using Grid to harvest more
computing power– Hide data assimilation process
behind the service using MPI, GridRPC (ninf-g)
• Benefit– Speeding up the calculation
User
Portal
Cluster A
Cluster B Cluster C
Host DSWAP-SERVICE
SWAP-SERVICE
SWAP-SERVICESWAP-SERVICE
Grid
Implicit Narrowband Level Implicit Narrowband Level Set Method for Fire Spread Set Method for Fire Spread Model Model
Dr. Pallop HuabsomboonMahidol University
• Challenges– Simulation of large scale firespred
for forest fire– Very time consuming process
• Solution– Distribute the computation on the
Grid
• Benefit– Expect 10x faster simulation speed– Ability to model much larger
problem within a reasonable time
• Part of TNGP/ Hewlett Packard Join Research Program
The Parallel Simulation Model for Thin FiThe Parallel Simulation Model for Thin Film Deposition Using the DSMC Methodlm Deposition Using the DSMC Method
Dr. Rardchawadee SilapuntDr. Tiranee AchalakulKMUTT, Thailand• Thin film deposition process is
used for many manufacturing industries including very large scale integrated circuits, optics, magnetic, hard and corrosion resistant coatings, micro-mechanics.
• Grid system will be used to accelerate the computation and
simulation process • Part of TNGP/ Hewlett
Packard Join Research Program
simulation domain S
ub
-D
om
ain
Processor
Processor
Processor
MP
IM
PI
Su
b-
Do
ma
inS
ub
-D
om
ain
Medical GridMedical GridSuwachai Sieanoon, Somkiat
Chatchuenyot, Dr. Panjai Tantasnawong
Computer Science Department, Silpakorn University
• To build and develop a distributed information management system using DataGrid technology.
• Apply the distributed information management system to test on exchanging and managing the Patient Records System, which is record complexity and, different format and large size of data.
Grid Services(Internet)Option
Hospital_E
Grid Services
MetadataHospital_A
MetadataHospital_B
MetadataHospital_C
Data Agent
Hospital_F
Hospital_D
GRID Services
Data Agent
Service Registr
y
Meta Data(HL7)
XML
IMAGE
Access Grid Access Grid
• First APEC Virtual Symposium on Pandemic Preparedness using Access Grid, January 20, 2006
• Presentation from Medical Organization in many economies– China, Taiwan, USA,
Vietnam, Thailand, Singapore, Philippine
• Access Grid are used as a key communication infrastructure
Grid: What and WhyGrid: What and Why• Grid is a technology that incorporates distributed
computing systems into a massive computing and storage pool with efficient resource sharing.
• Grid can strengthen national competitiveness in ICT industries as well as promote sciences and engineering research.
• Grid benefits several application domains:– E-commerce, E-government, E-learning– Digital Media and Animation– Geoinformatics, Bioinformatics– Financial Analysis– Etc.
Solving network problemSolving network problem
• General problem– Firewall Compliance– Dealing with smart intrusion detection system– Running Grid on Shared REN/Service network– Network underutilized, unbalance bandwidth
• Develop a network measurement infrastructure – Collaboration PSU/TNGC/KU/Uninet
• Collaboration with network provider (Uninet)
Network Bandwidth OUT (Mbps)
0
5
10
15
20SPIRIT(CU)
GRIDCMU(CMU)
ENQUEUE(KMITNB)
INCA(KMUTT)
SRITHAN(KKU)RDCGRID1(NECTEC)
RDCGRID2(NECTEC)
PSU-GRID(PSU)
SUTGRID(SUT) Network Bandwidth IN (Mbps)
0
20
40
60
80SPIRIT(CU)
GRIDCMU(CMU)
ENQUEUE(KMITNB)
INCA(KMUTT)
SRITHAN(KKU)RDCGRID1(NECTEC)
RDCGRID2(NECTEC)
PSU-GRID(PSU)
SUTGRID(SUT)
ThaiGrid Central ThaiGrid Central MonitoringMonitoring• ThaiGrid currently use OpenSCE to monitor the whole
ThaiGrid• OpenSCE is installed during Rocks installation using
SCE Roll• Each cluster provides monitored information through