The EDGeS project receives Community research funding 1 EDGeS Bridge technology to interconnect EGEE and BOINC grids Peter Kacsuk [email protected] MTA.

The EDGeS project receives Community research funding

1

EDGeS Bridge technology to interconnect EGEE and BOINC

grids Peter Kacsuk

[email protected] SZTAKI

2

The problem we The problem we addressaddress

Desktop grids (DGs)(volunteer DGs – home computers,

organizational DGs – institutional desktops)

• Inexpensive,

• very large number of CPUs (~100K – 1M)

• Bag of task appls

Cluster based service grids (SGs)(EGEE, OSG, etc.)

• Moderately expensive,

• moderate number of sites and CPUs

• any appls

Supercomputer based SGs

(DEISA, TeraGrid)

• Very expensive,

• small number of sites and large number of CPUs

• MPI applsOGF GIN

EDGeS

3

What is EDGeS?What is EDGeS?

EDGeS: Enabling Desktop Grids for e-ScienceEDGeS: Enabling Desktop Grids for e-Science1.1. EDGeS is a 2-year FP7 project started on EDGeS is a 2-year FP7 project started on

the 1the 1stst of January 2008 of January 2008• Research on integrating (bridging) SGs and DGs• Creates infrastructure• Provides services

2.2. EDGeS is an infrastructureEDGeS is an infrastructure• EDGeS VO interconnected with various DGs• Application repository

3.3. EDGeS is a service forEDGeS is a service for• Application porting and validation

4

Project partnersProject partnersPartic. No. Participant name Participant short

nameCountry

1 Computer and Automation Research Institute of the Hungarian Academy of Sciences

MTA SZTAKI Hungary

2 Centro de Investigaciones Energéticas Medio Ambientales y Tecnológicas

CIEMAT Spain

3 Foundation for the Development of Science and Technology in Extremadura

Fundecyt Spain

4 The French National Institute for Research in Computer Science and Control

INRIA France

5 University of Westminster UoW UK

6 Cardiff University CU UK

7 Faculty of Sciences and Technology of the University of Coimbra

FCTUC Portugal

8 Stichting AlmereGrid AlmereGrid The Netherlands

9 Centre National de la Recherche Scientifique - Institut National de Physique Nucleaire et de Physique des Hautes Energies

IN2P3 France

5 v2.0

SG interoperation/interoperability: Task of OGF GIN

EDGeS

gLite(EGEE)

ARC(NorduGrid)

Boinc(Berkeley)

XtremWeb(INRIA/IN2P3)

Xgrid(Apple)

Unicore(DEISA)

VDT(OSG)

Current

Future

Integration of SG and Integration of SG and DG systemsDG systems

Solving the DG-SG Solving the DG-SG • interoperation (EDGeS)interoperation (EDGeS)• interoperability (EDGeS and PGI)interoperability (EDGeS and PGI)

Generic Grid-Grid (3G) Bridge to Generic Grid-Grid (3G) Bridge to integrate SGs and DGsintegrate SGs and DGs

Job

Han

dle

r In

terf

ace

Job sourceBOINC client

Job sourceEGEE GRAM

Job sourcegUSE submitter

Job source PGI client

Job Database

Queue Manager

Gri

dH

and

ler

Inte

rfac

e

DC

-AP

IP

lug

in

Xtr

emW

eb

Plu

gin

EG

EE

Plu

gin

BOINC

EGEE

XtremWeb

BOINC

EGEE

gUSE/WS-

PGRADE portal

3G Bridge

7

Production DGProduction DG--EGEE EGEE InfrastructureInfrastructure

voms

lb wmsbdii

gLite based service grid VO

XtremWeb-EGEEbridge

XtremWeb-based DGs

IN2P3 local DG

(200)

IN2P3 public DG

(300)

AR

UI/bridgeCore

serviceResource

SZTAKI 16 cpus CIEMAT 20 cpus

ce ce

CNRS 1554 cpus

ce ce

BOINC-EGEEbridge

BOINC-based DGs

UoW (1.700), Corr.

Systems (10) local DGs

SZDG (72.000) Almere

(1.000) IberCivis (14.000)public DGs

8

Oct. Nov. Dec. Jan. Feb.

EDGeS VO activity according to EGEE Accounting Portal

CPU > 1 Day/Week

CPU > 1 Month/Week

CPU > 1 Year/Week

9

GlobalDEG

LocalDEG

LocalDEG

LocalDEG LocalDEG

University DG

Volunteer DG

Service Grid

EGEE

EGEE User access to EGEE User access to various gridsvarious grids

EDGeS

Appl. Repository

10

GlobalDEG

LocalDEG

LocalDEG

LocalDEG LocalDEG

University DG

Volunteer DG

Service Grid

EGEE

User access to various User access to various gridsgrids

WS-PGRADE

EDGeS

Appl. Repository

gUSE

Accessing EDGeS by Accessing EDGeS by WS-PGRADE portalWS-PGRADE portal

EDGeS VO

UI machine

WMSMachine

Other EGEEservices

EDGeS CE1 machine

LCG-CE

WN

WN

WNWN

WN

WN

BOINC server

DBQM

DC

-AP

I p

lug

in

QM WS client

QM

EG

EE

plu

gin

JW C

lien

tUI machine

WS

In

terf

ace

WS-PGRADE

gU

SE

D

G

sub

mi

tter

12

Applications ported by EDGeS

ApplicationApplication OrganisationOrganisation Runs on Runs on Desktop Desktop GridGrid

Runs on Runs on EGEE EGEE (EDGes VO)(EDGes VO)

Video Stream Analysis in a Grid Environment (VISAGE)

Correlation Systems Ltd - Israel

√√ √√

Digital Alias-free Signal Processing

University of Westminster √√ √√

Protein Molecule Simulation using Autodock

University of Westminster √√ √√

E-Marketplace Model Integrated with Logistics (EMMIL)

SZTAKI √√ √√

13

Applications ported by EDGeS

ApplicationApplication OrganisationOrganisation Runs on Runs on Desktop Desktop GridGrid

Runs on Runs on EGEE EGEE (EDGes VO)(EDGes VO)

Anti-cancer Drug Design (CancerGrid)

SZTAKI √√ √√Cellular Automata based Laser Dynamics (CALD)

University of Seville and University of Westminster

√√ √√

Signal and Image Processing using GT4 Tray

Forschungszentrum Karlsruhe √√

Analysis of Genotype Data (Plink)

Atos Origin √√

14

Applications ported by EDGeS

ApplicationApplication OrganisationOrganisation Runs on Runs on Desktop Desktop GridGrid

Runs on Runs on EGEE EGEE (EDGes VO)(EDGes VO)

Distributed Audio Retrieval using TRIANA(DART)

Cardiff University √√ √√

Fusion Plasma Application (ISDEP)

BIFI √√3-D Video Rendering using Blender

University of Westminster √√

Profiling Hospitals in the UK based on Patient Readmission Statistics

University of Westminster √√

15RI-211727 NA3

version: 1.0IntroductionAuthor: Ad Emmen

NA1: MoUs with other NA1: MoUs with other projectsprojects

Signed MoU with EGEE IIISigned MoU with EGEE IIIJointly select EGEE applications that should be migrated to EDGeS

Collaboration in porting these appls to EDGeS

EGEE support for the establishment and operation of the EDGeS VO

Organizing joint events (summer school, user forum meetings)

Signed MoU with EELA-2Signed MoU with EELA-2

Prepared MoUs with Prepared MoUs with IberCivis DG

SEE-GRID-SCI

Univ. of Houston (Virtual Prairie DG)

15

16

SummarySummary• EDGeS connects EDGeS connects

– BOINC or XtremWeb DGs – and gLite based SGs

• EDGeS is an open infrastructure:EDGeS is an open infrastructure: – Any BOINC or XtremWeb DG can join– Any gLite based SG can join

• Any EGEE user can access EDGeSAny EGEE user can access EDGeS• Any EGEE VO can be extended with DGs Any EGEE VO can be extended with DGs

based on EDGeS bridge technologybased on EDGeS bridge technology• EDGeS helps any EGEE user community in EDGeS helps any EGEE user community in

porting their applications into EDGeSporting their applications into EDGeS

17

For more information please visit the EDGeS Website:

Join the EDGeS User & Industry Forum here!

http://www.edges-grid.eu/

Please contact us if you need support in porting your application to EDGeS!

Email: [email protected]

Thank you for your Thank you for your attention …attention …

Anyquestions?