IDGF I nternational D esktop G rid F ederation

1

IDGFIDGF

IInternationalnternational DDesktopesktop GGridrid FFederationederation

How can you benefit from joining IDGF?How can you benefit from joining IDGF?

Hannover, 17.08.2011Hannover, 17.08.2011

Peter Kacsuk, MTA SZTAKI, [email protected] Kacsuk, MTA SZTAKI, [email protected]

EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556.EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556.

2EDGI NA2 21/04/23 2

IDGF in a nutshellIDGF in a nutshell

Objectives– Build a community of those people who are

interested in any form of desktop grids including

• Different technology developers and users (BOINC, Condor, XtremWeb, OurGrid, etc.)

• Service grid providers who would like to extend their resources with DG resources

• Scientists who want to build campus grid

– Create forum for this community

3EDGI NA2 21/04/23 3

How to get benefit of joining IDGF?How to get benefit of joining IDGF?

Different type of communities can get different kind of benefits

In order to understand the potential benefits first we summarize the potential business models of using DG systems

4EDGI NA2 21/04/23 4

Typical current business model for Typical current business model for volunteer desktop grids volunteer desktop grids

VDG

DG project administrator defines the input data to be processed by the appl

BOINC project runs 1 appl that runs for years

5EDGI NA2 21/04/23 5

Superlink@Technion business model for Superlink@Technion business model for volunteer desktop grids volunteer desktop grids

VDG

• Many end-users can access the project via a web interface

• end-users define the input data to be processed by the appl

Portal• BOINC project runs one appl (genetics research)

• The appl runs if a user gives input data

6EDGI NA2 21/04/23 6

EDGeS, DEGISCO and EDGI business EDGeS, DEGISCO and EDGI business model for volunteer desktop grids model for volunteer desktop grids

VDG

• Many end-users can access the project via a web interface

• end-users define the input data to be processed by the appls

Portal• BOINC project runs several appls

• An appl runs if a user gives input data

7EDGI NA2 21/04/23 7

DEGISCO business model for volunteer DEGISCO business model for volunteer desktop grids desktop grids

VDG

• Many end-users can access the project via a web interface

• end-users define the input data to be processed by the appls

Portal• BOINC project runs several appls

• An appl runs if a user gives input data

DEGISCO provides SG VO resources

SG VO

8EDGI NA2 21/04/23 8

EDGI business model for volunteer EDGI business model for volunteer desktop grids desktop grids

VDG

• Many end-users can access the project via a web interface

• end-users define the input data to be processed by the appls

Portal• BOINC project runs several appls

• An appl runs if a user gives input data

EDGI provides cloud resources for QoS

Cloud

9EDGI NA2 21/04/23 9

EDGI business model for volunteer EDGI business model for volunteer desktop grids desktop grids

VDG

• Many end-users can access the project via a service grid VO UI

• end-users define the input data to be processed by the appls

• BOINC project runs several appls

• An appl runs if a user gives input data

EDGI provides cloud resources for QoS

SG VO

Cloud

10EDGI NA2 21/04/23 10

Benefits for potential Benefits for potential DG communitiesDG communities

Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg

Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg

IDGFIDGF

IInternationalnternational DDesktopesktop GGridrid FFederationederation

11EDGI NA2 21/04/23 11

Benefit for new volunteer BOINC Benefit for new volunteer BOINC systemssystems

It takes several years until a new volunteer BOINC system can collect substantial number of resources

IDGF will give access to the large set of SG VO resources that were created in the EDGeS and later in the DEGISCO project

It contains ~2000 computers

12EDGI NA2 21/04/23 12

Extending current business model of Extending current business model of volunteer desktop grids with the DEGISCO volunteer desktop grids with the DEGISCO business modelbusiness model

VDG

DG project administrator defines the input data to be processed by the appl

BOINC project runs 1 appl that runs for years

SG VO

The SG VO maintained by DEGISCO (and later by IDGF) provides ~2000 computers to support a VDG

13EDGI NA2 21/04/23 13

Supporting many volunteer desktop grids Supporting many volunteer desktop grids by the DEGISCO business modelby the DEGISCO business model

VDG

SG VO

The SG VO maintained by DEGISCO (and later by IDGF) provides ~2000 computers to support VDGs

VDG

14EDGI NA2 21/04/23 14

Desktop Grid VO Desktop Grid VO Statistics

15EDGI NA2 21/04/23 15

16EDGI NA2 21/04/23 16

17EDGI NA2 21/04/23 17

Examples of volunteer BOINC systems Examples of volunteer BOINC systems supported by the DEGISCO business supported by the DEGISCO business modelmodel

SLinCA@home (Ukraina) Yoyo@home (Germany) IberCivis (Spain and Portugal) CAS@home (China) Optima@home (Russia) Poem@home (Germany) Univ. of Westminster Campus Grid (UK)

18EDGI NA2 21/04/23 18

SLinCA@home (over 1 TFlop/s)

19EDGI NA2 21/04/23 19

Yoyo@home (over 1 TFlop/s)

20EDGI NA2 21/04/23 20

21EDGI NA2 21/04/23 21

Attracting more participants for Attracting more participants for volunteer desktop gridsvolunteer desktop grids

EDGI introduces a new architecture where desktop grids (BOINC, XtremWeb) can be extended with cloud resources for QoS

However, in order to get cloud resources the user needs credits

In order to collect credit either the user or her organization should provide resources for volunteer DGs belonging to IDGF

If you joined to IDGF those who would like to earn more credit will support your DG system

22EDGI NA2 21/04/23 22

Benefits for those who would like to Benefits for those who would like to build a campus gridbuild a campus grid

There are several technologies (BOINC, Condor, OurGrid, XtremWeb, etc.) to build a campus grid

IDGF provides forum to– discuss and compare these technologies– make them popular to the scientific communities– elaborate the interconnection methods of campus grids built

on these technologies IDGF provides support to build the campus grid

– Technology selection support– Installation, configuration and testing support– User interface (e.g. portal) provision support– Application porting support

23EDGI NA2 21/04/23 23

Benefits for those who would like to Benefits for those who would like to port applications to DG systemsport applications to DG systems

Porting applications to volunteer DG is not easy IDGF members have expertise in this field and can

provide support for newcomers– Application porting technology selection support– Providing best practice case studies of application porting– Assistance in porting an application

24EDGI NA2 21/04/23 24

Application porting experience in Application porting experience in EDGIEDGI

Application Organization Status

CORSIKA: Cosmic Ray Simulation

Karlsruhe Institute for Technology, UoW

Ported to BOINC, in AR, validated , deployed at UoW

BWA: alignment of DNA sequences

Academic Medical Center of the University of Amsterdam, UoW

Ported to BOINC, in AR, validated, deployed at AMC and UoW

AutoDock Vina: molecular docking

University of Westminster

Ported to BOINC, in AR, under validation, deployed at UoW

GATE: Hadrontherapy simulation

Creatis CNRS, SZTAKI

Ported to BOINC, in AR, under validation

25EDGI NA2 21/04/23 25

Application porting experience in Application porting experience in EDGIEDGI

Application Organisation Status

Conformer Generator (Tinker), molecular modelling

Biological Research Center (BRC) of the Hungarian Academy of Sciences, SZTAKI

Ported to BOINC, in AR, under validation

Classification: R based classification of patients

Academic Medical Center of the University of Amsterdam, UoW

Ported to BOINC, in AR, under validation, deployed at UoW

Mental Ray: commercial rendering engine

University of Westminster

Ported to BOINC, in AR, under validation, deployed at UoW

Guineapig++: simulate beam-beam interactions in high-energy colliders

CNRS/IN2P3 Ported to XW HEP, in AR, under validation, deployed at IN2P3

26EDGI NA2 21/04/23 26

Ported applications available @ EGI AppDB

27EDGI NA2 21/04/23 27

Benefits for those who would like to Benefits for those who would like to extend SG VO with DGextend SG VO with DG

The EDGI business model and architecture is a good example how to extend a SG VO with DGs

Small SG VOs can get additional resources for parameter sweep (PS) applications

IDGF members have expertise in this field IDGF provides support to extend a SG VO with DGs

– Technology selection support– Installation, configuration and testing support– User interface (e.g. portal) provision support– Application porting support

28EDGI NA2 21/04/23 28

Balanced usage of SG and DG systems Balanced usage of SG and DG systems within a countrywithin a country

With the technology provided by EDGI and DEGISCO processing load can be transferred towards the less loaded systems– Overloaded SGs can transfer jobs to DGs– Overloaded DGs can transfer WUs to SGs

29EDGI NA2 21/04/23 29

Benefit for technology and application Benefit for technology and application developer organizations of the European developer organizations of the European Chapter Chapter

IDGF will participate in FP7 and FP8 EU projects The work allocated for IDGF in these projects will be

distributed among the member organizations of the European Chapter

To take IDGF as partner in EU projects will be attractive since IDGF will represent a large community (see the HealthGrid experience)

30EDGI NA2 21/04/23 30

ConclusionsConclusions

Joining IDGF is worth for both SG and DG community members

DG community members can extend their DG with SG resources

SG community members can extend their SG VO with DG resources

Both communities can get application porting support

IDGF can significantly impact the community and can attract additional financial resources

31

http://http://

desktopgridfederation.desktopgridfederation.eueu

Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg

Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg

IDGFIDGF

IInternationalnternational DDesktopesktop GGridrid FFederationederation