GRID COMPUTING AND SOME RESEARCH ISSUES IN DEVELOPMENT GEOGRID AT VAST Dao Van Tuyet [email protected] Department for Computational & Knowledge Engineering
Mar 27, 2015
GRID COMPUTING AND SOME RESEARCH ISSUES IN DEVELOPMENT GEOGRID AT VAST
Dao Van [email protected] for Computational & Knowledge Engineering
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Outline
High-Performance Computing in Vietnam1
Development of GEOGRID at IAMI/VAST2
Problems and Proposal in future plan3
Conclusion4
22
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Grid Computing
33
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Grid Computing systems can be reached in to global
Efficient utilization of resources of different organizations
Users do not need to know where the resources is
need to build the Distributed Supercomputing
Grid Computing
44
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Grid Computing centers in Vietnam2008: 6 centers
Hanoi University of Technology HCM University of Technology Vietnamese National University in Hanoi Vietnamese Institute of Information Technology (IOIT)
• Ha noi
• Ho Chi Minh
Vietnamese Military Technical Academy (VMTA)
2009: one more Hanoi University of Education
55
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
TEIN-2 and VINAREN network
66
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Colaboration with PRAGMA
77
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
PRAGMAGrid Members Using Globus Toolkit in the grid infrastructure
Now IAMI
88
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
PRAGMAGrid Members
99
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
EUAsiaGrid Members Using gLite in the grid infrastructure
1010
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
1111
Applications and Middleware in Pragma testbedApplications and Middleware in Pragma testbed http://goc.pragma-grid.net/applications/default.html
Open to applications of all scientific disciplinesOpen to applications of all scientific disciplines– Climate simulationClimate simulation
Savannah/Nimrod (MU, Australia)Savannah/Nimrod (MU, Australia) MM5/Mpich-Gx (CICESE, Mexico; MM5/Mpich-Gx (CICESE, Mexico;
KISTI, Korea)KISTI, Korea)– Quantum-mechanics, quantum-chemistry:Quantum-mechanics, quantum-chemistry:
TDDFT, QM-MD, FMO/Ninf-G (AIST, TDDFT, QM-MD, FMO/Ninf-G (AIST, Japan)Japan)
– GenomicsGenomics iGAP/Gfarm/CSF (UCSD, USA; AIST, iGAP/Gfarm/CSF (UCSD, USA; AIST,
Japan; JLU, China)Japan; JLU, China) HPM: genomics (IOIT-HCM, Vietnam)HPM: genomics (IOIT-HCM, Vietnam) mpiBlast/Mpich-G2 (ASGC, Taiwan)mpiBlast/Mpich-G2 (ASGC, Taiwan)
– Organic chemistryOrganic chemistry Gamess-APBS/Nimrod (UZurich, Gamess-APBS/Nimrod (UZurich,
Switzerland)Switzerland)– Molecular simulationMolecular simulation
Siesta/Nimrod (UZurich, Switzerland; Siesta/Nimrod (UZurich, Switzerland; MU, Australia)MU, Australia)
Amber/Rsh ( USM, Malaysia)Amber/Rsh ( USM, Malaysia)– Computer ScienceComputer Science
Load Balancer (IOIT-HCM, Vietnam)Load Balancer (IOIT-HCM, Vietnam) GriddLeS (MU, Australia)GriddLeS (MU, Australia)
2 applications from Vietnam2 applications from Vietnam
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Grid Computing Activities at IAMI Collaboration with Pasteur Institute in HCM City
Danh sách mẫu bệnh phẩmDanh sách mẫu bệnh phẩm
1212
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Scientific Linux 4.5 OS Java JDK 1.6 or later gLite UI installed and configured AMGA 1.3.0 or later Apache Tomcat 5.5 Apache Ant 1.7.0 or later Ant contrib 1.0b3 Apache Axis 1.4 Gridsphere 3.0.8 or later DCMTK (Dicom toolkit) 3.5.4 or later PostgreSQL
Grid Computing activities at IAMI
http://ui.ioit-hcm.vngrid.org:8080/gridsphere1313
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Terra View Tool – Open Source using TerraLib library
Grid Computing Activities at IAMI
1414
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Grid Computing Activities at IAMI
Using Terraview in some applications
1515
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
The Summary in 5th VAST-AIST Workshop
Grid Computing Use PRAGMA as an international collaborative
framework (Japan and Vietnam are the members of PRAGMA)
National Project on GRID (VN GRID) since early 2008, using TEIN2 (5 nodes in Vietnam)
VN Grid should be the substantial body to work with PRAGMA
PRAGMA 17 meeting will be in Hanoi Oct 2009 and it will organized by VAST (IOIT) and AIST is willingness to join and support
HOPE (Hospital Open Software Platform for E-Health)
1616
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
5 presentations 2 from AIST
• Dr. Handa • Dr. Sekiguchi
3 from VAST• Ms. Nguyen Thi Phuong Thao (IOIT)• Mr. Dao Van Tuyet (IAMI) with 2 presentations
Topics 1 on Multilingual support on TaiViet, ChuNom and Cham
(AIST) based on Open Source Software on LINUX 2 on Natural Language Processing (VAST): Statistical
Machine Translation and spelling, grammar checking 2 on GRID Computing (AIST and VAST): 1 on
Telemedicine application on GRID and 1 on programming environment for GRID
The Summary in 5th VAST-AIST Workshop
1717
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
GEO Grid
GEO Grid introductionThe GEO (Global Earth Observation) Grid is aiming at providing an
E-Science Infrastructure for worldwide Earth Sciences communities to accelerate GEO sciences based on the concept that relevant data and computation are virtually integrated with a certain access control and ease-of-use interface those are enabled by a set of Grid and Web service technologies.
Applications
Disaster Disaster MigrationMigration
GeosciencesGeosciences
Environment Environment ConservationConservation
Statelite DataStatelite Data
Geology DataGeology Data
Geo Contents
GIS DataGIS Data
In-situ DataIn-situ Data
GIS WEB Technologie
s
GIS WEB Technologie
s
IT ResourcesIT Resources
1818
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
A Workflow example
1919
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
A Workflow example (cont.)
2020
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
GEO Grid as E-science system design
ASTER Complete Data Set Online Handling large (>200TB) data archive for satelite imagery Accessible as a service
Data Access Policies Retaining data owner’s publication policies without increasing
management cost
Data Intergration Handling wide diversification of data types, associated metadata,
prodcts and services
On-Demand data processing capability Use workflow for composing complex applications Run on “Grid managed” resources
2121
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Predict problems
2222
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
IOIT-HCM
VN Digital Map on Grid (using google map)VN Digital Map on Grid (using google map)
2323
GEO
GR
ID,
PR
AG
MA
17
, IO
IT –
HA
NO
I, V
IETN
AM
Encountered Issues
High performance Computingand Grid computing rest in academic research
Not yet: HPC centers of TeraFlops. A common networking infrastructure to
connect HPC centers HPC/GC large scale applications
2424