Top Banner
The DataGrid Project http://www.eu-datagrid.org/ NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 http://www.dutchgrid.nl
21

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Dec 18, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

The DataGrid Project

http://www.eu-datagrid.org/

NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

http://www.dutchgrid.nl

Page 2: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Presentation “a quatre mains”

NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

EDG and the testbed KorsJob submission (slides) JeffJob submission (hands on) David100 Atlas jobs on the Grid Stan

…… and all this in 20’

Page 3: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

The Project status

at 2/3 of its lifetime

second EU review February 4 and 5 2003

writing started on a follow-up project in the 6th FP for 2005

LHC has accepted grid technology for its computing challenge: LCG

EDG software release 1.4 on the testbed

on the testbed: CERN, CNAF, CCIn2P3, NIKHEF, RAL prime sites

currently stress tested by Atlas and CMS with their prod.programs

others, D0, Earth Observ, biologists, etc. are testing as well

EDG tutorials given everywhere, last week at NIKHEF

Page 4: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

What we will show you

the layout of the testbed

how to submit a job on the Grid

what modules/services are involved in job submission

how to get/look at the output of your job

how to deal with in- and output- files

Security is very important, but will not be shown

We assume Authentication and Authorisation are done

Once authorised a user can access all resources on the grid

Authentication: once a year, Authorisation: once per session

Page 5: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Current EDG Testbed

CERNLyon

RAL

Manchester NIKHEF

Reference site CERN

Testbed1 EDG sites NorduGrid

21 sites

8 sites are in Europe

About 340 machines are available.

Some of them are dual processor.

Some machines are only used for

EDG.

They are split into:

- Production

- Development

NorduGrid is as a Grid infrastructure in the Nordic countries

CNAF

Tutorial and Core site

Page 6: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A 3 Tier ArchitectureA 3 Tier Architecture

Client Application Server

Data Server

Request

ResultData

Request

User Interface

Computing Element/Worker Nodes

Storage Element

On the EDG testbed:On the EDG testbed:

Page 7: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

EDG Logical Machine Types

1. User Interface (UI)

2. Resource Broker (RB)

3. Information Service (IS)

4. Computing Element (CE) Gatekeeper

(Front-end Node)

Worker Nodes (WN)

5. Storage Element (SE)

6. Replica Catalog (RC)

Page 8: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Job Submission Scenario

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement CE)Element CE)

Information Service (IS)

ReplicaCatalogue(RC)

Page 9: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job SubmitEvent

Input Sandbox

Job Status

submitted

Page 10: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

Page 11: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

Page 12: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService(JSS)

StorageElement (SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

BrokerInfo

scheduled

Page 13: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

scheduledInput Sandbox

running

Page 14: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

scheduled

Job Status

running

Page 15: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping

ResourceBroker

Job SubmissionService

StorageElement

ComputeComputeElementElement

Information Service

ReplicaCatalogue

submitted

waiting

ready

scheduled

running

Job Status

done

Job Status

Page 16: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping

ResourceBroker

Job SubmissionService

StorageElement

ComputeComputeElementElement

Information Service

ReplicaCatalogue

submitted

waiting

ready

scheduled

running

done

Job Status

Job Status

outputready

Output Sandbox

Page 17: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Output Sandbox

cleared

submitted

waiting

ready

scheduled

running

done

Job Status

outputready

Page 18: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

The End

Page 19: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Sites Used in this Demo

CERN Production test bed RB, II, CE, SE and a couple of worker nodes

CNAF Bologna CE, SE and worker nodes

Rutherford Appleton Lab (GridPP) CE, SE and worker nodes

CC IN2P3 Lyon CE and worker nodes

NIKHEF UI, CE, SE, worker nodes, Replica Catalogue

Page 20: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Local Application Test Bed

ui02 (a.k.a. tbn08)

ce02

node18-*.farmnet.nikhef.nl

se02edgmds.dutchgrid.nl

lxshare0382

grid-vo.nikhef.nlRC

application test bed

ui01,ce01,se01RB IS

CERN

Page 21: The DataGrid Project  NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .

Higgs analysis at Atlas

Example of a Higgs analysis

Search in 4-electron channel Choose decay via HZZ e+e-

e+e-

~80% of background given by qq ZZ e+e-e+e-

Fast Atlfast simulation Pythia event generation Parameterization detector response

Selection criteria on ‘Reconstructed’ Electron cluster

EM Calorimeter information All electrons pT>7 GeV 2 electrons pT>20 GeV Even number of electrons Al least 1 Z with |91.175-m(Z*)|<15 GeV Both Z’s: m(Z*)>20 GeV

Cross sections: Background: BR ~ 17

fb

Signal (mH=130-200): BR ~ 1-3 fb

Luminosity:

One grid job of 500 events corresponds to approximately 1 year of running (low luminosity, 30 fb-1) with LHC