Application of the EDG Application of the EDG Testbed Testbed Bockjoo Kim*, Soo-Bong Kim Seoul National University (SNU) Kihyeon Cho, Youngdo Oh, Dongchul Son Center for High Energy Physics (CHEP) Kyungpook National University Jysoo Lee KISTI, Supercomputing Center International HEP DataGrid Workshop 9 Nov 2002
30
Embed
Application of the EDG Testbed Bockjoo Kim*, Soo-Bong Kim Seoul National University (SNU) Kihyeon Cho, Youngdo Oh, Dongchul Son Center for High Energy.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Application of the EDG Application of the EDG TestbedTestbed
Bockjoo Kim*, Soo-Bong KimSeoul National University (SNU)
Kihyeon Cho, Youngdo Oh, Dongchul SonCenter for High Energy Physics (CHEP)
Kyungpook National University
Jysoo LeeKISTI, Supercomputing Center
International HEP DataGrid Workshop
9 Nov 2002
OutlineOutline
LHC Computing Challenge
European DataGrid
European DataGrid (EDG) testbed in Korea
The EDG testbed and tests
The GDMP (Datamanagement) and tests
Possible Immediate Application of the EDG Testbed
Summary
LHC HEP computing, key LHC HEP computing, key parametersparameters
All LHC experiments at CERN: 10 Peta Bytes/yr data storage; disk: 2 P Byte
Multi-experiment Tier 1: 3 Peta Byte/yr; disk: 0.5 P Byte
RB : Resource Broker : Core of job schedulingSE : Any storage system: accessible via ftp, nfs, etc & GSIWN : Worker CPU hidden underneath CE ~ clusters
ProfilesProfiles
An EDGAn EDG TestbedTestbed
Listens updateListens update
All the machines are linux red hatAll the machines are linux red hat
EDG Important IngredientsEDG Important Ingredients
X.509 Authentication + Users certs on LDAP Grid Information Index Service (GIIS): not fully used. RB does the job
Virtual Organization(VO) : CMS, Atlas, etcVirtual Users and Groups for VOLDAP services for VO, authentication list with edg schema
Replica Catalog (RC) uses also LDAP server with edg schema
Replica Management uses GDMP (grid data mirroring pkg.)
VO ManagementVO Management
Data ManagementData Management
Resource Locating Resource Locating
Security Security
EDG Testbed in KoreaEDG Testbed in Korea
The EDG testbeds are installed at KNU and at SNUThe globus simple CA is managed at KNU and at SNU to sign certsIn addition to the default VO’s in EDG, a cdf VO is constructedAuthentication and VO LDAP server is running at SNU A replica catalog (RC) LDAP server is running at SNUSee the Korean EDG testbed description web site athttp://neutrino.snu.ac.kr/~bockjoo/EDG_testbed/ and EDG
Data Management using GDMPData Management using GDMPSE SE SubscriptionSubscription
File Creation on File Creation on SESE
Check File on SECheck File on SE
Register and Register and PublishPublish
Check catalog on Check catalog on se2se2
LDAP :RC for se1LDAP :RC for se1
Replicate from se1 to Replicate from se1 to se2se2
LDAP: RC for se1 and LDAP: RC for se1 and se2se2
Check catalog on Check catalog on se1se1
Example Application of EDGExample Application of EDG
Currently running Experiment
Existing Resources
Matter of adding ques and hacking : examples exist
Some works are in progress to include the existing node as a WN for different VO’s within a testbed site
CEVOuser
SEVOuser
WNVOuse
r
디스크
NFS
GSIFTP
MAP on diskWith maximum
security
grid-security
NFS
GSIFTP
NFS
GSIFTP
NFS
GSIFTP
빅 팻 디스크
Big FatDisk
GDMP server
(with new VO)
GDMP client(with new
VO)
GDMP client(with new
VO)
EDG testbed at SNU
UIReal user
RB
Que
Que
CDFSoftwa
re
QueK2K
Software
At the moment, the EDG testbed is operated at EC
EDG testbeds are constructed and working at KNU and SNU in KoreaFor Data Management, an LDAP for RC is constructed and the GDMP is used within Korea. This is working.
The testbed is also operational between KNU and SNUA possible HEP application for currently running experiments is illustrated and we are moving toward that direction
The EDG testbed will be constructed for other institutions in Korea New VO will be tested extensively for a few months
Hopefully, we would like to learn other testbeds and test crossgrid functionalities
2nd : via USA Korea FERMILAB CERN % We will use Fermilab’s storage as buffer.
3rd : via Japan and USA Korea KEK Fermilab CERN 2Gbps >1Gbps 2 Gbps
Participation to iVDGL anables 2nd and 3rd route.
Contribution : 2003 CMS summer production We will provide significant CPU power and storage.
Future bandwidth requirement on the Future bandwidth requirement on the networknetwork
Korea – Japan – USA Connection
for experiments in Japan ~ 400Mbps by 2006 ~ 650Mbps after 2006 CDF experiment ~40Mbps by 2004 ~230Mbps after 2004 CMS experiment ~800Mbps ( 1PB/year )
Including other traftic and Japan’s, at least 2Gbps required. Should evaluate to Lambda (10Gbps) connection to USA, Japan, Europe