MD-GRID NGI. International and regional projects for Grid technologies development

The SEE-GRID initiative is co-funded by the European Commission under the FP6 and FP7 Research Infrastructures

www.grid.md

SEE-GRID

MD-GRID NGI. International and regional

projects for Grid technologies development

Dr. Petru Bogatencov,RENAM

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 2

Outline

SEE-GRID-1 project May 2004 - May 2006: results

SEE-GRID-2 project May 2006 - May 2008: Objectives Results

SEE-GRID-SCI Objectives

Recommendations for regional initiatives

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 3

Contribute to building a worldwide Infrastructure by expanding the “eInfrastructure inclusion” into South-East Europe

SEEREN

SEEREN

> http://www.see-grid.eu

The SEE-GRID initiative

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 4

Grids: regional expansion 2004-2009

EGEE

EELA, RedCLARAEUMEDGRID, EXPRESS

EUChinaGrid

peer cooperationsSEE-GRIDBalticGrid

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 5

EGEE project

EGEE-II aims to build on the work of the EGEE project, which was conceived as the first two-year phase of a four-year programme, to provide a production quality Grid infrastructure across the European Research Area and beyond.Researchers in academia and industry already benefit from the EGEE e-Infrastructure, which simultaneously supports many applications from diverse scientific areas, providing a common pool of resources, independent of geographic location, with round-the-clock access to major storage, compute and networking facilities.

The EGEE-II project will significantly extend and consolidate this infrastructure, which links national, regional and thematic Grid efforts, as well as interoperate with other Grids around the globe. The resulting high capacity, world-wide infrastructure greatly surpasses the capabilities of local clusters and individual centres, providing a unique tool for collaborative computeintensivescience (“e-Science”).

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 6

EGEE project

The EGEE Grid is built on the EU Research Network GÉANT and exploit Grid expertise generated by many EU, national and international Grid projects to date.

Funded by the European Commission, the EGEE project community has been divided into 12 partner federations, consisting of over 90 contractors and over 30 non-contacting participants covering almost all Europe

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 7

SEE-GRID-1 key results: infrastructure

Large, distributed infrastructure spanning all countries: Including EGEE-SEE sites, without GR

and HU: 30 sites, 450 CPUs 150 CPUs in 20 non-EGEE-SEE sites

LCG-2 MW on Scientific LinuxSupport the SEE-GRID Virtual OrganizationInterconnection of SEE sites by P-GRADE portalCatch-all SEE-GRID CA operationalOverlap with EGEE production Operations centre management solutions deployed: a number of monitoring tools, helpdesk, sites database, etc…

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 8

SEE-GRID and EGEE

Infrastructure overlapping and complementing to EGEESEE-GRID open to new “fresher” sitesSEE-GRID open to new applications

EGEE-SEE Grid SEE-GRID Grid

EGEE-wide VOs

EGEE-SEE core servicesSEE-GRID VOs

SEE-GRID core services

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 9

SEE-GRID-1 key results: applications

2 regional grid applications developed: Search Engine for South-East

Europe (SE4SEE) for Grid-aided web-crawling & data indexing.

Volumetric Image Visualization Environment (VIVE) for medical images and other static or time-dependent scalar and vector 3D fields

Both have been extensively tested and used in the SEE-GRID infrastructure

EGEE applications are deployed on the sites which have been included in EGEE-SEE ROC and thus support these VOs (HEP, BioMed + other EGEE VOs!)

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 10

SEE-GRID-1 key results: - human network

The Human Network that will outlive the project

Dissemination Policy and concertation Conferences and publications Relationships with other projects Donations

NGIs

Trainings

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 11RoEduNet2008 11 ITSEC V.Sidorenco 11

SEE-GRID2www.see-grid.eu

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 12

SEE-GRID-2 project partners: expansion

ContractorsGRNET GreeceCERN SwitzerlandSZTAKI Hungary IPP-BAS BulgariaICI RomaniaTUBITAK TurkeyASA/INIMA AlbaniaUoBL Bosnia-HerzegovinaUKIM FYR of MacedoniaUOB SerbiaUoM MontenegroRENAM MoldovaRBI Croatia

3 types of countries

Third Parties27 universities / research centres

Start date: 01/05/2006Duration: 24 monthsTotal Budget: 2,028,886 Є

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 13

SEE-GRID-2: new directions

Policy-focused deployment strategy Shift priority from a “top-down” approach (i.e. from regional project

execution to national implementation) towards a a “bottom-up” approach (from national priorities, cooperation, and innovation to regional cohesiveness)

Achieve Grid uptake and buy-in beyond the “usual suspects” of the R&E community (-> government, policy-makers, dialogue with industry…)

Growth of infrastructure Expand regionally to include new countries/areas and widen the SEE eInfra

community Expand nationally to include new sites/institutes and strengthen

collaboration in each countryApplication-driven deployment approach serve the needs of diverse and multi-disciplinary communities extend the user-base – USE the grid, USE the network, USE the

Infrastructure

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 14

SEE-GRID-2 objectives:ensure sustainable development

Clear NGI strategy

National government commitment and support for incubating NGIs

Build solidarity and cooperation with research and academic organizations at national level

Engage regional and national user communities

Build long-term operational solutions: operations centres, CAs, etc, in each country

Ioannina

Mytilini

Chios

Samos

Syros

Komotini

Athens

Rhodos

Agrinio

Preveza

Florina Thessaloniki

Patra

Iraklio

Larissa

Drama

Beroia

Lamia

Livadia

Bucharest

Skopje

Tirana

Belgrade

Banja Luka

Xanthi

Plovdiv

Sofia

Ruse

VelikoTarnovo

Bitola

Serres

Gjirokastra

Vranje

Nis

Kragujevac

Pirot

Novi-Sad

Subotica

Craiova

Timisoara

Turnu Severin

Resita

Chania

Kardzali

Edessa

PrilepTitov Veles

Sevlievo

Elbasan

Ohrid

TepeleneKorce

Arad

Cluj-Napoca

Targo-Mures

Brasov

Ploiesti

Oradea

Szeged

Slatina Pitesti

Zvornik

Bjeljina

Brcko

Doboj

Derventa

Sabac

Vlasenica

Sarajevo

Budapest

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 15

SEE-GRID-2 objectives: upgrade SEE grid infrastructure

Upgrade the capacity of the regional pilot infrastructureGuarantee stability and interoperability of the infrastructure Support the accreditation of national Grid CAs. Strengthen operations at national levelDeploy portal technology for accessing the grid and supporting application development and deploymentDraw upon deployment experience/results of other grid projects (EGEE/EGEE-II, EUMEDGRID, BalticGrid, EELA, etc)

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 16

SEE-GRID-2 objectives:strengthen the human network

Liaise with and beyond SEE user communitiesTraining events at regional level for site

admins and end-users at national-level

Dissemination events at regional level for

policymakers and public at large

at national-level

Regional eInfra projects Policy Workshop – September in Geneva!

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 17

SEE-GRID-2 - infrastructure

Number of Countries: 11Number of Sites: 31Number of CPUs: 540TBs of Storage: 80

Migrating from LCG to gLite

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 18

Infrastructure management: monitoring

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 19

Infrastructure management: Helpdesk, database, wiki

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 20

Using the infrastructure

Going to website www.seegrid.euTalking to the SEEGRID representative in the countryObtaining a certificate from SEE-GRID catch-all CAJoining the SEE-GRID VOAsking local country Grid team to provide support

More than 10+ new applications were developed, ~20 in the course of the project

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 21

Strategic priority: NGIs

Formation of stable NGIs is the key to long-term sustainability

National Grid Initiatives are concertated efforts taken at National level in order to deploy, operate, and expand grid infrastructures in a coherent and coordinated way

Usually involves the inter-connection and inter-operation of academic and research-based resource centers under an umbrella of a national program aiming to integrate the available resources in order to establish an e-Infrastructure for the benefit of the R&E (e-Science) community, and in the long-term for the society at large

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 22

MD-Grid NGI Kick-Off – May 2007

Establishment MD-Grid NGI in Moldova uses the model of Joint Research Unit (JRU) Consortium belonging to NREN, recognized as Coordinating body and based on:

Recognition and support by Ministry of Information Development of Moldova

Recognition and support by the Academy of Sciences of Moldova

Signed and adopted Agreement with NGI participants, that applied Letters of Intent to attend MD-Grid NGI Joint Research Unit

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 23

www.grid.md

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 24

MD-Grid NGI Members

RENAM - CoordinatorFaculty of Radioelectronics and Telecommuni-cations of Technical University of MoldovaInstitute of Mathematics and Computer Science of Academy of Sciences of MoldovaInstitute of Geophysics and Seismology of ASM State Hydrometeorological ServiceSchool of Public Health. State Medical and Pharmacy University of MoldovaInstitute of Applied Physics of ASM

Potential MD-Grid extensionState University of MoldovaInstitute of Ecology and Geography of ASMAcademy of Economical Studies Institute of Economy, Financing and Statistics of the Ministry of Economy and Trade …The list is open for any others …. Welcome!

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 25

MD-Grid NGI Aims and Tasks

MD-Grid NGI participates in strategic European Programs for the development of transnational grids and in initiatives for the completion of SEE eInfrastructures. The operation of the MD-Grid NGI implements the general EU policy on the development of national initiatives for the coordination of actions related to eInfrastructures and Grids.The integration of Grid actions (infrastructures, middleware and applications) with the broadband research and technology network into a standard e-Infrastructures system. Optimization of exploitation of advanced network resources and services of RENAM which can serve the new e-Science generation and will attract the greater users community of the Information Society to the mass adoption of advanced services provided by Grid architectures.Permanent development and administration of Grid sites infrastructure in Moldova

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 26

SEE-GRID-SCI: e-Infrastructure for regional e-science

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 27

SEE-GRID-SCI Participants

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 28

www.see-grid-sci.eu

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 29

SEE-GRID-SCI project partners

ContractorsGRNET GreeceCERN SwitzerlandSZTAKI Hungary IPP-BAS BulgariaICI RomaniaTUBITAK TurkeyASA/INIMA AlbaniaUoBL Bosnia-

HerzegovinaUKIM FYR of MacedoniaUOB SerbiaUoM MontenegroRENAM MoldovaRBI CroatiaIIAP-NAS-RA Armenia - newGRENA Georgia - new

Third Parties30 universities / research centres

Start date: 01/05/2008Duration: 24 monthsTotal Budget: 2,499,969 Є

GRNET.gr

SEE-GRID-SCI partnership

MTA SZTAKI .hu

IPP .bg

ICI .ro

TUBITAK.tr

UPT.al

UKIM.mk

UoBL.ba

RBI.hr

UOB.rs

RENAM.md

UOM.me

GRENA.ge

IIAP-NAS-RA.am

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 30

Applications area

The project is focusing on forming regional research teams that are engaged in elaboration large scale applications of common interest. Three SEE-wide user communities were proposed:

Seismology VO Meteorology VO Environmental VO

The work programme envisages analysis of the mentioned VOs requirements, their gridification and run-time support of the target applications. These three strategic Virtual Organisations will bring together users across the region within a common research space, enabling them to share data, applications, tools and results of their work.

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 31

New communities integration in the regional eInfastructure

GRNET.gr

MTA SZTAKI .hu

IPP .bg

ICI .ro

TUBITAK.tr

UPT.al

UKIM.mk

UoBL.ba

RBI.hr

UOB.rs

RENAM.md

UOM.me

GRENA.ge

IIAP-NAS-RA.am

SEEFIRE + Geant Support

SEE-GRID

SeismologyVO

MeteorologyVO

EnvironmentalVO

SeismologyVO

MeteorologyVO

EnvironmentalVO

SEE-SCI

e-Infrastru

cture

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 32

MD-Grid Consortium in SEE-GRID-SCI

Moldova participates in the project as MD-Grid JRU Consortium with RENAM as Contractor and following third parties - JRU members: FRT TUM - Faculty of Radioelectronics and Telecommunications of Technical University of Moldova IGS ASM - Institute of Geology and Seismology of Academy of Sciences of Moldova SHMS - State Hydrometeorological Service of Moldova

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 33

Distribution of applications according to contributing countries

AL: 4

AM: 1

BA: 2

BG: 7

GE: 1

GR: 3HR: 2HU: 2

MD: 3

ME: 1

MK: 3

RO: 3

RS: 3

TR: 5

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 34

Evolution

Testbeds UtilityProductive Use

National

Global

34www.eu-egi.eu

European e-Infrastructure

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 35Slide courtesy of Kyriakos Baxevanidis, EC

Broad scale test-beds

Production quality

facilities

Sustainable

e-Infrastructures

(utility model)

Sustainable grid/data-based e-

Infrastructures (utility model)

Towards sustainable grid-empowered e-Infrastructures

35www.eu-egi.eu

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 36

European Grid Initiative

Goal:Long-term sustainability of grid infrastructures in Europethrough establishment of a new federated model bringing together NGIs to build the EGIorganization

EGIOrganization:Coordination and operation of a common multi-national, multi-disciplinary Grid infrastructure to enable and support international Grid-based collaboration,to provide support and added value to NGIs, and to liaise with corresponding infrastructures outside Europe

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 37

EGI Vision Paperhttp://www.eu-egi.org/vision.pdf

Provide global services and support that complement and/or coordinate national services (Authentication, VO-support, security, etc); Coordinate middleware development and standardization to enhance the infrastructure by soliciting targeted developments from leading EU and National Grid middleware development projects; Advise National and European Funding Agencies in establishing their programmes for future software developments based on agreed user needs and development standards; Integrate, test, validate and package software from leading Grid middleware development projects and make it widely available; Provide documentation and training material for the middleware and operations. (NGIs may wish to make the material available in turn in their local language); Take into account developments made by national e-science projects which were aimed at supporting diverse communities. Link the European infrastructure with similar infrastructures elsewhere; Promote Grid interface standards based on practical experience gained from Grid operations and middleware integration activities, in consultation with relevant standards organizations; Collaborate closely with industry as technology and service providers, as well as Grid users, to promote the rapid and successful uptake of Grid technology by European industry.

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 38

38 European NGIs

+ Asia, US, Latin America

+ PRACE

+ OGF-Europe

+ …

38www.eu-egi.eu

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 39

www.eu-egi.eu

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 40

Terminology

“European Grid Initiative (EGI)” = the EGIorganization+ the NGIs

“EGI Organization” = the team with central responsibility, including the management structure

“EGI Council” = the governing body of the EGI and successor to the EGI Policy Board

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 41

EGI Grid Infrastructure

… should bea large-scale, production Grid infrastructure built on national grids that interoperate seamlessly at many levels, offering reliable and predictable services to a wide range of applicationscreation and cooperation of Specialized Support Centers

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 42

www.eu-egi.eu

EGI Infrastructure

…

International Scientific and Research CollaborationInternational Scientific and Research Collaboration

NationalGrid

Initiative 1

NationalGrid

Initiative 1

NationalGrid

Initiative 2

NationalGrid

Initiative 2

NationalGrid

Initiative N

NationalGrid

Initiative N

Mid

dle

wa

re

A

Mid

dle

wa

re

B

Mid

dle

wa

re

B

Mid

dle

wa

re

X

gL

ite

UN

ICO

RE

AR

C

EGI.orgEGI.org European-level Grid Services

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 43

NGI Resources for Operation

Estimated effort for NGI to be part of EGISize of NGI EGI.org Effort

(FTE)

Small 3-6

Medium 7-10

Large 16-18

Financing long-term vision: Membership fees from NGIs according to an EGI-key agreed by the EGI CouncilProject grants, from EU and other funding bodiesService charges, from NGIs and other buying specific services from EGI.org

Initial phase:Only membership fees and project grantsStrong support from EC required to establish EGI model and to keep it at the leading edge of technology

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 44

Further recommendations

Carry out complementary but coordinated actionsTraining!NGI development, but allow for separate national strategies / agendas of NGIsBroad partnerships through MoUs and joint work: EGEE, SEEGRID, other regionsUse EC financing as seed money – seek other sources

Organize in federations with clear relations and modus operandi; scalable structure neededDistribute Grid and management services to spread the know-how and ensure joint responsibility and controlAim to have possibility of stand-alone operations, independent on related federated Grids and projectsAdopt good technical solutions but also pursue alternativesHave clear/quantified target/criteria for migrating to EGEETo be involved in EGI

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 45

MD-GRID NGI - long-term strategy

Strategic success metrics of NGI: not Gbps/sec not the number of nodes not the TBs of storage

The initiatives are puzzle pieces of RTD efforts to sustain national and regional development

Increasing the retention of talented scientists in the region Pursuing joint R&D efforts among countries in the region Making available the benefits of the Information Society for citizens Easing the digital divide between the region and the countries at other side

of spectrum Improvement of regional competitiveness in all market sectors Regional political stability and cohesiveness The basis for new applications and national GRID infrastructure

developmentThe sustainable status can be achieved by national RTD efforts combining with EC co – finding

SEE-GRID: Advancing South-East Europe into the eInfrastructure era 46

Conclusions

SEE-GRID projects help to deploy a sustainable Grid infrastructure, which, coupled with human networking activities will be of particular societal, educational, and political importance to the SEE region and to Moldova especially.

Such modernization is a key goal of eEurope - which aims on accelerating the development of the Information Society in Europe and ensuring its availability to everyone.

Regional and National Grid infrastructures deployment will have a significant impact on the SEE region by helping the participating countries to achieve the goal to be a part of eEurope and align their national priorities with the EU recommendations and guidelines.