New HellasGrid – The National Grid Initiative in Greece · 2018. 11. 17. · EGI SEE Workshop 3 Athens, 19 April 2006 GRNET Dual Mission ¡The EU e-Infrastructure vision: Integrated

Fotis KarayannisFotis KarayannisHellasGridHellasGrid Scientific CoordinatorScientific Coordinator

GRNETGRNET

HellasGrid –The National Grid Initiative in Greece

www.hellasgrid.gr

EGI SEE Workshop Athens, 19 April 20062

OutlineOutline

GRNET dual mission:Research Networking and Grid infrastructure

The HellasGrid National Grid initiativeInfrastructureOrganisationApplications communities

HellasGrid as part of the European effortsNetworking and Grid projects

Challenges/Experiences


GRNET Dual MissionGRNET Dual Mission

The EU e-Infrastructure vision: Integrated Networking + Grid infrastructures

GRNET was one of the first NRENs* in Europe adopting the EU e-Infrastructure initiative:

Providing both networking and grid infrastructures * NREN: National Research and Education Network

Being infrastructure-oriented and application-neutral serving all user eScience communitiesExpanding its scope to e-Business and e-Government

GÉANT+SEEREN+other

EGEE+ SEE-GRID +other

Pan-European e-Infrastructure

Source: European Commission

Unit F3: Research Infrastructures


GRNET strategic projects and fundingGRNET strategic projects and fundingResearch Network projects

GRNET2 project, 2000-2005, 20 MEuro• 2,5 Gbps leased lambda backbone network• Pilot dark fiber acquisition projects (15

years lease) + optical equipment• Pilot Grid node @ Demokritos (Isabella)

Access project (called “105”), 2005-2008, 10 MEuro

• 1 Gigabit Access for ~50 institutes

GRNET3 project, 2005-2008, 30 MEuro(recently approved!)

• Dark fiber research back-bone network in Greece

• Optical MANs for Athens, Thessaloniki (the rest to be covered by regional MANs(called “93”)

• Optical equipment RFI already published

PanEuropean connectivity & integration project: GEANT2, 2004-2008Regional Support Projects: SEEREN-SEEREN2, Eumedconnect

Grid projectsHellasgrid Task Force, 2002-2004, (support money)

• Hellasgrid Strategy Document• Pilot Grid node @ Demokritos (0,5M by

GRNET2)

Hellasgrid Project, 2004-2007, ~2 MEuro• ~800 CPUs, ~ 90TB storage (30TB

disks + 60 TB tape libraries), 4 advanced video-conferencing Access Grid nodes

Grid Applications Call, 2006-2007,~0,5MPanEuropean integration projects: EGEEProject, 2004-2006, 1,3MEuros EGEE-II, 2006-2008, 1,8M Euros

• Supported operations, training, policies

Regional Support projects: SEEGRID, SEEGRID2, Eumedgrid, EuChinaGridOther projects: GridCC, e-IRGSP


The GRNET NetworkThe GRNET Network

932 km of dark fibre932 km of dark fibre

Backbone is currently based on 2,5 Gbps leased lambdasDark fiber has been acquired for 3 network spans (pilot phase)Dark fiber tender for the whole backbone on-going (one offer received)International connectivity 2 * 10 Gbps any day (currently 2* 2,5 Gbps)


The The HellasGridHellasGrid National Grid InitiativeNational Grid InitiativeHellasGrid Task Force appointed by the Ministry of Economy and Finance at the end of 2002 (MNEC is running the national InfoSocprogramme)

A strategy group supported by a scientific committee• Produced a strategy document

The Task Force prepared the National Integration ProposalThe HellasGrid MoU was signed at the end of 2003

Pilot Phase (Phase I): 2003-2004GRNET Pilot Infrastructure installation

• Isabella site: 64 CPUs, 10 TB SAN, 12 TB Tape LibraryParticipation in EGEE proposal, Coordination of SEE-GRID

Consolidation Phase (Phase II): 2004-2006HellasGrid project implementation

• Extension of Grid infrastructure (~800 CPUs, 30TB disks, 60TB tape libraries) –(~2 MEuros)

• Integration in EGEE• The HellasGrid MoU was used to form a Joint Research Unit (JRU)• GRNET provided a recognition letter by the Ministry after EC request• Further application support (~0,5M – 1M Euros)• Investigation for further infrastructure support (~1 MEuros)


The The HellasGridHellasGrid membersmembersCoordinator

National Research and Education Network, GRNET –www.grnet.gr

Universities (10)Aristotle University of Thessaloniki, AUTH www.auth.grAthens University of Business, AUEB www.aueb.grNational Technical University of Athens, NTUA www.ntua.grUniversity of the Aegean www.aegean.grUniversity of Athens, UoA www.uoa.grUniversity of Crete, UoC www.uoc.grUniversity of Ioannina, UoI www.uoi.grUniversity of Macedonia, UoM www.uom.grUniversity of Patras UPATRAS www.upatras.grUniversity of Pireus UNIPI www.unipi.gr

Research Centres (8)Research and Academic Computer Technology Institute, CTI www.cti.grCentre for Research and Technology Hellas, CERTH www.certh.grInstitute of Computer Science – FORTH, www.ics.forth.grInstitute of Accelerator Systems and Applications, IASA www.iasa.grInstitute of Communication and Computer Systems, ICCS www.iccs.ece.ntua.grNational Meteorology Service, EMYwww.emy.grNational Observatory of Athens, NOA www.noa.grResearch Centre Demokritos, DEMOKRITOS www.demokritos.gr


HELLASGRID HELLASGRID infrastructureinfrastructure

• HG-01 cluster @ Demokritos: 64 CPU, 10TB FC SAN, 12TB Tape Library, EGEE LCG2 middleware

• HG02-HG06 clusters located in:•Athens (NDC/EKT, IASA)•Thessaloniki (AUTH)•Crete (ICS-FORTH)•Patras (CTI)

~800 CPUs (x86_64, 2 GB RAM, 80GB

HDD, 2x Gbit)

~30 TBytes total raw SAN storage capacity~80TBytes Tape Library

• 4 Access Grid nodes

http://www.hellasgrid.gr/infrastructure


HG HG organisationorganisation: Teamwork!: Teamwork!

Overall coordination: GRNET headquartersCooperation with HellaGrid partners:

Main site + ROC operator : HG-01-GRNET (Isabella, cslab@ICCS/NTUA)HG-02…HG-06 sites + operation centers (NDC, IASA, AUTH, FORTH, CTI)5 smaller private sites (AUTH, UoM, FORTH, Demokritos, HEP-NTUA)HG CA and VOMS (GridAUTH, Dept. of Physics, AUTH)HG helpdesk (CTI)Regional monitoring tools (ICS-FORTH)HG user support/apps (Demokritos + all site teams)4 AccessGRID sites

HG membership: ~18 members (10 Universities + 8 Research Institutes)

6 HellasGrid+5 private sites > 900 CPUs in total


HGHG--0101--GRNET IsabellaGRNET Isabella


HellasGrid Infrastructure, Phase II, EKT (2/2006)HellasGrid Infrastructure, Phase II, EKT (2/2006)

National Documentation Center (EKT)


HG Local Users distribution per DisciplineHG Local Users distribution per Discipline


CPU Hours per SiteCPU Hours per Site


HellasGrid CA statistics:HellasGridHellasGrid CACA statistics:statistics:


CPU time: distribution of overall EGEE VOs CPU time: distribution of overall EGEE VOs usage of HG infrastructureusage of HG infrastructure

Normalised CPU Time

28%

10%12%

40%

8% 2% atlas biomed cms lhcb see others


HellasGridHellasGrid as part of European effortsas part of European efforts

Leased lambda 2,5 Gbps PoSAthens MAN (2,5 Gbps PoS)

Dark Fibre (not yet lit)

Patra

Larissa

Heraclion

Syros

Athens

Chania

Rethymnon

Xanthi

Thessaloniki

Ioannina

Leased lambda 1,25 Gbps Gigabit Ethernet

HG-03-AUTH

HG-02-IASA

HG-06-EKT

HG-04-CTI-CEID

HG-01-GRNETIsabella @Demokritos

HG-05-ICS-FORTH

Hellasgrid Grid Node(1 Gbps uplink)

Scale> 170 sites in 39

countries> 17 000 CPUs> 5 PB storage> 10 000 concurrent

jobs per day> 60 Virtual

Organisations


SEE Europe promoting the NGI/EGI modelSEE Europe promoting the NGI/EGI model

NGI: National Grid InitiativeInfrastructure oriented & application neutral• Not driven by applications

GRNET acts as an early champion for the SEE area

One partner per country since EGEE Phase I!

EGEE-SEE and SEE-GRID countries adopted the same model!


Challenges/Experiences/ConclusionsChallenges/Experiences/Conclusions

Building the HG infrastructure proved difficult Housing, SLAs with local institutes are slow, tedious and expensive!

Getting applications /users to exploit the infrastructure is slow!

Training/education and dissemination is importantApplication projects and funding are essential!

• Received 45 proposals in last Grid-Applications call!

Sustainability of the infrastructure and servicesEquipment will need to be changed after 3-5 years

Local “incubators” for GRID technology needed:Experts in local sites

Operators should have appropriate mentality (shifts, support)Gained a lot from networking experience (NOCs, NOC-ROC cooperation)

Regional, Pan-European and International collaborations are vital

Our European friends lead the way: Middleware, VOs, support projects


www.hellasgrid.gr

www.egee-see.orgmailto:[email protected]

For more:

New HellasGrid – The National Grid Initiative in Greece · 2018. 11. 17. · EGI SEE Workshop 3 Athens, 19 April 2006 GRNET Dual Mission ¡The EU e-Infrastructure vision: Integrated

Documents