Adaptive Grid Computing

www.globus.org

Adaptive Grid Computing

Detecting and Adjusting for Dynamic Grid Conditions

www.globus.org

Experiments with a Grid-Enabled Computational Framework

Dave Angulo, Ian FosterChuang Liu, Matei Ripeanu, Michael Russell, Lingyun Yang

Distributed Systems Laboratory

University of Chicago & Argonne National Laboratory

Gabrielle Allen, Thomas Dramlitsch,

Gerd Lanferman, Ed Seidel, Thomas RadkeMax-Planck-Institut für Gravitationsphysik

www.globus.org

Acknowledgements

This work was supported in part by the NSF-funded Grid Application Development Software project under Grant No. 9975020.

We are grateful to our GrADS project colleagues for discussions on the topics discussed here.

www.globus.org

Research Goals

Investigate methods and structures for efficient Grid execution via in-depth study of a demanding application, including– Constructs for adapting to heterogeneity

– Constructs for dynamic resource acquisition Create testbed for GrADSoft components,

as they emerge Investigate utility of computational

frameworks as facilitator of Grid computing

www.globus.org

Migrate to “faster/ cheaper” system– When better system

discovered

– When requirements change

– When characteristics change (e.g., competition)

Adaptation to Dynamic Grid Environments

www.globus.org

Migrate to “faster/ cheaper” system– When better system

discovered

– When requirements change

– When characteristics change (e.g., competition)

Adaptation to Dynamic Grid Environments

www.globus.org

External Processes / Services

Cactus Worm Architecture

Cactus “flesh”

CactusWormServer

Cactus WormMigrationThorn

Resource Selector Client Thorn

App & other thorns

Performance Degradation Detection

Globus Toolkit™GRAM

Resourceselector

GlobusToolkit™

GIIS

GlobusToolkit™

GRISs

GlobusToolkit™

GRISsResources

NWS Migration Logic Manager

(Under Development)

www.globus.org

Migration Demonstration

GIIS Running on jupitor.isi.edu

Cluster at UIUC Cluster at UCSD

Resource Selector Service Running on

hamachi.cs.uchicago.edu

Cactus Worm Server Running on

amajor.cs.uiuc.edu

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Computational application begins run

NetLogger records performance and displays

visual graph

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Competing application on one node steals

CPU cyclesNetLogger

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Resource Selector Service contacted

NetLogger

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

resource list sent to Worm Server

NetLogger

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Worm Server shuts down app

NetLogger

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Worm Server starts app on new resouces

NetLogger

www.globus.org

Performance Results

www.globus.org

Gabrielle Allen; Dave Angulo; Ian Foster; Gerd Lanfermann; Chuang Liu; Thomas Radke; Ed Seidel; John Shalf. The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment. In International Journal of High-Performance Computing Applications Volume 15, Number 4, 2001

http://people.cs.uchicago.edu/~dangulo/papers/

This presentation: http://www.cs.uchicago.edu/~dangulo/scdemo.ppt