Top Banner
www.globus.org Adaptive Grid Computing Detecting and Adjusting for Dynamic Grid Conditions
16

Adaptive Grid Computing

Jan 17, 2016

Download

Documents

CAI

Adaptive Grid Computing. Detecting and Adjusting for Dynamic Grid Conditions. Experiments with a Grid-Enabled Computational Framework. Dave Angulo, Ian Foster Chuang Liu, Matei Ripeanu, Michael Russell, Lingyun Yang Distributed Systems Laboratory - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Adaptive Grid Computing

www.globus.org

Adaptive Grid Computing

Detecting and Adjusting for Dynamic Grid Conditions

Page 2: Adaptive Grid Computing

www.globus.org

Experiments with a Grid-Enabled Computational Framework

Dave Angulo, Ian FosterChuang Liu, Matei Ripeanu, Michael Russell, Lingyun Yang

Distributed Systems Laboratory

University of Chicago & Argonne National Laboratory

Gabrielle Allen, Thomas Dramlitsch,

Gerd Lanferman, Ed Seidel, Thomas RadkeMax-Planck-Institut für Gravitationsphysik

Page 3: Adaptive Grid Computing

www.globus.org

Acknowledgements

This work was supported in part by the NSF-funded Grid Application Development Software project under Grant No. 9975020.

We are grateful to our GrADS project colleagues for discussions on the topics discussed here.

Page 4: Adaptive Grid Computing

www.globus.org

Research Goals

Investigate methods and structures for efficient Grid execution via in-depth study of a demanding application, including– Constructs for adapting to heterogeneity

– Constructs for dynamic resource acquisition Create testbed for GrADSoft components,

as they emerge Investigate utility of computational

frameworks as facilitator of Grid computing

Page 5: Adaptive Grid Computing

www.globus.org

Migrate to “faster/ cheaper” system– When better system

discovered

– When requirements change

– When characteristics change (e.g., competition)

Adaptation to Dynamic Grid Environments

Page 6: Adaptive Grid Computing

www.globus.org

Migrate to “faster/ cheaper” system– When better system

discovered

– When requirements change

– When characteristics change (e.g., competition)

Adaptation to Dynamic Grid Environments

Page 7: Adaptive Grid Computing

www.globus.org

External Processes / Services

Cactus Worm Architecture

Cactus “flesh”

CactusWormServer

Cactus WormMigrationThorn

Resource Selector Client Thorn

App & other thorns

Performance Degradation Detection

Globus Toolkit™GRAM

Resourceselector

GlobusToolkit™

GIIS

GlobusToolkit™

GRISs

GlobusToolkit™

GRISsResources

NWS Migration Logic Manager

(Under Development)

Page 8: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS Running on jupitor.isi.edu

Cluster at UIUC Cluster at UCSD

Resource Selector Service Running on

hamachi.cs.uchicago.edu

Cactus Worm Server Running on

amajor.cs.uiuc.edu

Page 9: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Computational application begins run

NetLogger records performance and displays

visual graph

Page 10: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Competing application on one node steals

CPU cyclesNetLogger

Page 11: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Resource Selector Service contacted

NetLogger

Page 12: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

resource list sent to Worm Server

NetLogger

Page 13: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Worm Server shuts down app

NetLogger

Page 14: Adaptive Grid Computing

www.globus.org

Migration Demonstration

GIIS

Cluster at UIUC Cluster at UCSD

Resource SelectorService

Cactus WormServer

Worm Server starts app on new resouces

NetLogger

Page 15: Adaptive Grid Computing

www.globus.org

Performance Results

Page 16: Adaptive Grid Computing

www.globus.org

Gabrielle Allen; Dave Angulo; Ian Foster; Gerd Lanfermann; Chuang Liu; Thomas Radke; Ed Seidel; John Shalf. The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment. In International Journal of High-Performance Computing Applications Volume 15, Number 4, 2001

http://people.cs.uchicago.edu/~dangulo/papers/

This presentation: http://www.cs.uchicago.edu/~dangulo/scdemo.ppt