G-monitor: A Gridbus Web Portal for Monitoring and Steering Application Execution on Global Grids

G-monitor: A Gridbus Web Portal for Monitoring and Steering

Application Execution on Global Grids

Martin Placek and Rajkumar Buyya

Grid Computing and Distributed Systems

(GRIDS) Lab.Dept. of Computer Science and Software

Engineering The University of Melbournehttp://www.gridbus.org

WW Grid

2

G-Monitor

Introduction Architecture Implementation Notes Gmonitor Snapshots Conclusion

3

Introduction

Functionality/Requirements Experiment Management and Control

Job control Broker QoS Experiment status

Job status Resources status

Run from anywhere

4

Architecture - System

W eb Browser(clients)

Grid Nodes

GridNodes

GridNodes

Nimrod-G and GridbusServers

W eb Servers(G-monitor)

G rid Service Providers(G SP)

G rid Broker

5

Architecture - Gmonitor

W eb client

W eb Server

Apache

Perl scripts (G-monitor)

Nim rod-G and G ridbus Server

mod: CGI mod.....

6

Implementation

Technologies Apache Web Server (CGI) Perl JavaScript Nimrod-G Protocol

Issues Timezones issue, as webclient, webserver and

nimrod server can all be in different Timezones! (Fix:UTC)

Scalability - Handles large scale experiments (1000’s of Jobs,100’s of Resources.)

7

G-monitor Usage: HPC Challenge Demo @ SC 2002

GMonitor

@ SC 2002/Baltimore

Grid MarketDirectory

Australia

Melbourne+Monash U:

VPAC, Physics

Solaris WS

Gridbus+Nimrod-G

Europe

ZIB: T3E/OnyxAEI: Onyx CNR: ClusterCUNI/CZ: OnyxPozman: SGI/SP2Vrije U: ClusterCardiff: Sun E6500Portsmouth: Linux PCManchester: O3KCambridge: SGIMany others

Asia

AIST, Japan: Solaris ClusterOsaka University: ClusterDoshia: Linux clusterKorea: Linux cluster

North America

ANL: SGI/Sun/SP2NCSA: ClusterWisc: PC/clusterNRC, CanadaMany others

InternetWW Grid

MEG Visualisation

8

G-monitor - Login

9

G-monitor - QoS

Deadline Budget Optimisation Algorithm Start/Stop Experiment

10

G-monitor - QoS

11

G-monitor - Job Status & Resource Status

Job execution status Further Attributes Job Control

Resource Availability Resource Cost (G$)

12

G-monitor - Job Status

13

G-monitor - Resource Status

14

G-monitor - Experiment Status

Deadline (Assigned/Spent/Remaining) Budget Job Status Summary Host Status Summary

Jobs Completed/Jobs Assigned

15

G-monitor - Experiment Status

16

Conclusion

G-Monitor Web based implementation

provides easy to use and ubiquitous interace to the Grid.

Easy to setup. Scalable and places low overhead on the network Try it and Download from http://www.gridbus.org/

Future Work Integrate G-monitor into a HTML framework (Eg.

WebGUI) Integrate further job/experiment statistics. Integrate further job/experiment control.