Cindy Zheng, Geon Workshop, 7/20/2006 PRAGMA Grid A Multi-Application Route-Use Global Grid Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly University of California, San Diego San Diego Supercomputer Center http://www.pragma-grid.net http://goc.pragma-grid.net
27
Embed
PRAGMA Grid A Multi-Application Route-Use Global Grid
PRAGMA Grid A Multi-Application Route-Use Global Grid. Cindy Zheng PRAGMA Grid Coordinator P acific R im A pplication and G rid M iddleware A ssembly University of California, San Diego San Diego Supercomputer Center http://www.pragma-grid.net http://goc.pragma-grid.net. Overview. - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Cindy Zheng, Geon Workshop, 7/20/2006
PRAGMA GridA Multi-Application Route-Use Global Grid
Cindy Zheng
PRAGMA Grid Coordinator
Pacific Rim Application and Grid Middleware AssemblyUniversity of California, San DiegoSan Diego Supercomputer Center
– Open international organization– Grid applications, practical issues– Build international scientific collaborations
• Members and community– 28 institutional members, 11 countries – >38 inst. >14 countries are actively involved
• Characteristics– No central funding, but mutual interests– Build friendship, trust, help, community– Do, act
• Working groups– Bio, data, resources, telescience,
geosciences, …• Semi-annual Workshops
Cindy Zheng, Geon Workshop, 7/20/2006
The PRAGMA Steering Committee
http://www.pragma-grid.net/steering_committee.htm
Cindy Zheng, Geon Workshop, 7/20/2006
Pragma Grid testbed and Routine-basis Experiements
• 2004 -• Goal – make grid easier for scientists to use, by improving
– middleware interoperability– Global grid usability and productivity
• Method– For applications. Let applications drive– More organized testbed operation– Full-scale and integrated testing/research– Long application runs– Learn issues, develop/research/test solutions
• Manners– Grass-roots– Voluntary, contribute of resources and work– long term, persistent– Inclusion: don’t have to be PRAGMA member or pacific rim– General science grid
• Developed by AIST, Japan• Support GridRPC model which will be a GGF standard• Integrated to NMI release 8 (first non-US software in NMI)• Ninf roll for Rocks 4.x is also available• 3 applications ran in PRAGMA grid and 1 ran on GIN testbed
(multi-grids)– TDDFT– QM/MD– FMO
• Achieved long runs (1 week ~ 50 days)• Improved fault-tolerance (papers) - hang• Simplified deployment procedures• Speed-up development cycles
Cindy Zheng, Geon Workshop, 7/20/2006
Nimrod/G http://ninf.apgrid.org
• Developed by Monash University, Australia• Supports large scale parameter sweeps on Grid
infrastructure• Easy user interface - portal• 3 applications ran in PRAGMA grid and 1 will run in GIN
- Developed by AIST, Japan- High performance, scalable grid file system- Support Linux, Solaris; also scp, gridftp, SMB- Meta-server, file replication, Gfarm-FUSE- Ease user/application setup, file sharing (CSA), fault tolerance- 6 sites, 3786 GBytes, 1527 MB/sec (70 I/O nodes)- Tested with iGAP, large number of files, performance up >10x
Cindy Zheng, Geon Workshop, 7/20/2006
SCMSWebhttp://www.opensce.org/components/SCMSWeb
• Developed by Kasetsart University, Thailand• Web-based monitoring system for clusters and grid
– System usage, functional/performance metrics, job/queue status• Easy user interface, rapid support• Testing in PRAGMA grid, get user feedbacks and sites help
– Speed-up development, enhancement, platform support expansion– Improve fault tolerance, functionalities, user interface– Popularize the software
– TDDFT/Ninf-G• Lead: Yoshio Tanaka, Yusuke Tanimura (AIST, Japan)• Deployed and run
– PRAGMA - AIST, NCSA, SDSC– TeraGrid – ANL
• Working on deployment to EGEE, OSG and NorduGrid– Savanah Study
• Lead: Colin Enticott (MU, Australia)
• Infrastructure testing matrix– Cindy Zheng (SDSC, USA) and Somsak Sriprayoonsakul (KU,
Thailand)• Use SCMSWeb
Cindy Zheng, Geon Workshop, 7/20/2006
Lessons Learned• Differences among grids
– Organization structures– Authentication (GSI, VOMS)– Job submission (GRAM, Gridftp)– Software stacksTakes a lot of learning to understandTakes a lot of work to interoperate
• Resolved some problems (GSI-VOM, GT2-GT4)• Stimulated new initiatives (Cross grid monitoring)• Learned some from each other (Community Software
Area)• Many more still yet to work on (File sharing, easy user
access, direction and standards)
Cindy Zheng, Geon Workshop, 7/20/2006
Forward• More resources
– More computational resources• GUCAS, China; UMC, USA; …
• More grids interoperation– More grids– More applications– More collaboration on grid technology research and development
Cindy Zheng, Geon Workshop, 7/20/2006
One Possible Collaboration with AIST
Cindy Zheng, Geon Workshop, 7/20/2006
Collaborations with GSCAS and CNIC
• GSCAS (Shi Yaolin, Huai Zhang), U Missouri (Mian Liu), UCSD (Chaitan Baru, Cindy Zheng), CNIC (Kai Nan)– Develop PRAGMA/iGEON Node at GSCAS– Develop initial parallel finite element codes– Run a geodynamics models on this cluster and then
the PRAGMA testbed – Ensure user-friendly, Web interfaces to access and
execute finite element codes developed by China on PRAGMA grid as well as TeraGrid
Cindy Zheng, Geon Workshop, 7/20/2006
Collaborations with U Hyderabad
• Collaborators A. Agarwal, K.V. Subbarao (U Hyderabad) and Chaitan Baru (UCSD)
• Establish GEON node at U Hyderabad
• Experiment with sharing data
• Register new datasets
Cindy Zheng, Geon Workshop, 7/20/2006
Other Collaborations
• Exchanges: – Calit2– Students (PRIME)– GEON willing to