Top Banner
www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t- Infrastructure Claudio Cherubino INFN - Catania Tutorial on grid, visualization and high performance calculation Mexico City, 23-26 October,2007
30

Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

Dec 13, 2015

Download

Documents

Norman Logan
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

GILDA t-InfrastructureClaudio Cherubino

INFN - Catania

Tutorial on grid, visualization and high performance calculation

Mexico City, 23-26 October,2007

Page 2: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

2

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

• Grid INFN Laboratory for Dissemination Activities

• Demonstrate/disseminate grid computing

• Adopted by several Grid projects worldwide

• It runs the latest production (stable) version of LCG grid middleware but it is also adopting gLite in order to make the transition to the new middleware smoother and easier

• It is free

Getting started

Page 3: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

The GILDA Project – web portal

https://gilda.ct.infn.it

Page 4: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

Why t-Infrastructure?

• Avoid disruption of production systems of Grid projects

• Prepare participants for future middleware releases

• Easy entry point for new users/communities

• Provide guaranteed response for tutorials

Page 5: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

5

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

GILDA Test-bed

~ 20 sites in 4 continents

Page 6: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

6

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

All gLite services on GILDA

MIDDLEWARE VERSION: gLite 3.0.0

Page 7: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

7

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Sponsors (https://gilda.ct.infn.it/sponsors.html)

Page 8: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

8

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Training Strategy (1)

Page 9: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

Before trying GILDA…

• First Steps:

1

2

3 4

1. Ask for a GILDA personal certificate2. Load the certificate in your browser3. Accept Use Policy4. Subscribe to the GILDA Virtual Organisation

Page 10: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

10

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Certification Authority(https://gilda.ct.infn.it/CA)

Page 11: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

11

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Training Strategy (2)

Page 12: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

12

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA VOMS(https://voms.ct.infn.it:8443/voms/gilda/)

Page 13: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

13

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Training Strategy (3)

Site Managers Beginners

ApplicationDevelopers

Page 14: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

14

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Tutorial: Beginners

BeginnersUSER INTERFACE

PLUG AND PLAY

USER INTERFACE

VIRTUAL MACHINE

USER INTERFACE

REAL (gLite-tutor)

GENIUS

WEB PORTAL

https://glite-tutor.ct.infn.it

[glite-tutor] /home/giorgio > voms-proxy-init --voms gildaCannot find file or dir: /home/giorgio/.glite/vomsesYour identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Emidio Giorgio/[email protected] GRID pass phrase:Your proxy is valid until Mon Jan 30 23:35:51 2006Creating temporary proxy.................................DoneContacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected]] "gilda"Creating proxy ...................................... DoneYour proxy is valid until Mon Jan 30 23:35:51 2006

Page 15: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

15

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Tutorial: Site Managers

Site Managers

HOST

CERTS

GILDA TESTBED

( SERVICES AND

SITES )

GILDA VIRTUAL

SERVICES MACHINES

GILDA MONITORING

SYSTEMS

HOST

CERTSHOST

CERTS

Page 16: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

16

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Tutorial: Application DevelopersApplication

Developers

GILDA

DEMONSTRATOR

https://glite-demo.ct.infn.it GILDA USE CASES

HOW TO USE CLI/API/WEB

SERVICES in gLite

GILDA TEAM SUPPORT FOR

APPLICATION INTEGRATION

(GENIUS ALSO) Demonstrative Applications

Page 17: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

17

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Some of the Applications ported on GILDA

• 8 Virtual Organizations supported: – Biomedicine (Biomed)– Earth Science Academy (ESR)– Earth Science Industry (CGG)– Astroparticle Physics (MAGIC)– Computational Chemistry (GEMS)– Grid Search Engines (GRACE)– Astrophysics (PLANCK)– Computation Archaeology (ARCHAEOGRID)

• Development of complete interfaces with GENIUS for 3 Biomed Applications: GATE, hadronTherapy, and Friction/Arlecore

• Development of complete interfaces with GENIUS for 4 Generic Applications: EGEODE (CGG), MAGIC, GEMS, and CODESA-3D (ESR) (successfull demos of EGEODE and GEMS at EGEE review)

• Development of complete interfaces with GENIUS for 16 demonstrative applications available on the GILDA Grid Demonstrator (https://grid-demo.ct.infn.it)

• Development of complete interface with CLI for NEMO

Page 18: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

18

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Training Material(https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome)

Page 19: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

19

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Support System

http://gilda-support.ct.infn.it

Page 20: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

20

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Ticket Creation (1/2)

Page 21: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

21

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Ticket Creation (2/2)

Page 22: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

22

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Standard tutorial layout

Local site

User Interface

Resource Broker

BDII

Students’Room

ssh

Worker nodes

Worker nodes

CE

LFC

SE

VOMS

GILDA t-Infrastructure

UserDesktop

VirtualUI

VirtualUI

VirtualUI

Page 23: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

28

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Stats

• Used in more than 180 tutorials• 7693 certificates issued• > 3 TB of videos and Virtual Grid

services downloaded• Web portal: 768.880 hits in 2006

Page 24: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

29

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Stats

Page 25: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

30

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Non EU countries benefited by GILDA courses

Basic / user tutorial

Advanced / sysadmin

Application Porting

Page 26: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

31

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Non EU countries benefited by GILDA courses

Basic / user tutorial

Advanced / sysadmin

4 71

Application Porting

Page 27: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

32

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The Future of Grids

• Increasing the number of infrastructure users by increasing awareness– Dissemination and outreach– Training and education– Grids offer new opportunities for collaborative work

• Increasing the number of applications by improving application support and middleware functionality– Increase stability, scalability, and usability

Major efforts needed particularly on VO management, security infrastructure, data management, and job management

– High level grid middleware extensions

• Increasing the grid infrastructure– Increase manageability of Grid services – Reducing the cost of operation– Ensuring interoperability between infrastructures

• Protecting user investments– Better involvement of industry – Move towards a sustainable grid infrastructure

Page 28: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

33

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Summary and conclusions

• GILDA is a virtual laboratory for dissemination of grid computing:

– It is a “de facto” standard t-Infrastructure adopted both by EGEE and many EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, EUINDIAGRID, ICEAGE, etc.)

– It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE Infrastructure

– GILDA runs latest production version of the gLite middleware to make the transition from the t-Infrastructure to the e-Infrastructure easy and transparent

Page 29: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

34

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Links

• GILDA home page– https://gilda.ct.infn.it

• GILDA Certification Authority– https://gilda.ct.infn.it/CA/

• GILDA Virtual Organization– https://voms.ct.infn.it:8443/voms/gilda/

• GILDA Support System– http://gilda-support.ct.infn.it

• GILDA Form for Bookings– http://gilda-support.ct.infn.it

• GILDA Repository of Training Material– https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome

• GILDA Virtual Services– https://gilda.ct.infn.it/VirtualServices.html

Page 30: Www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 GILDA t-Infrastructure Claudio Cherubino.

35

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Questions …