1 Grid Computing Grid Computing Mahesh Joshi Mahesh Joshi [email protected][email protected]Presentation for Graduate Course in Presentation for Graduate Course in Advanced Computer Architecture Advanced Computer Architecture 28 28 th th April 2005 April 2005 28th April 2005 28th April 2005 Grid Computing Grid Computing 2 Objective Objective Overview of the concept and related Overview of the concept and related aspects aspects Some practical implications and Some practical implications and implementations implementations Wherever possible, tying the concepts Wherever possible, tying the concepts to what we learned in the course to what we learned in the course
17
Embed
Grid Computing - University of Minnesota Duluthjoshi031/files/grid-computing.pdf1 Grid Computing Mahesh Joshi [email protected] Presentation for Graduate Course in Advanced Computer
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Presentation for Graduate Course inPresentation for Graduate Course inAdvanced Computer ArchitectureAdvanced Computer Architecture
2828thth April 2005 April 2005
28th April 200528th April 2005 Grid ComputingGrid Computing 22
ObjectiveObjective Overview of the concept and relatedOverview of the concept and related
aspectsaspects Some practical implications andSome practical implications and
implementationsimplementations Wherever possible, tying the conceptsWherever possible, tying the concepts
to what we learned in the courseto what we learned in the course
2
28th April 200528th April 2005 Grid ComputingGrid Computing 33
OverviewOverview Why Grid ComputingWhy Grid Computing What is Grid ComputingWhat is Grid Computing Aspects of Grid ComputingAspects of Grid Computing Is this for real?Is this for real? ReferencesReferences
28th April 200528th April 2005 Grid ComputingGrid Computing 44
Why Grid ComputingWhy Grid Computing Various architectural enhancements exist forVarious architectural enhancements exist for
increasing computer as well as network speedsincreasing computer as well as network speedsand storage capacityand storage capacity
How effectively is the resulting computing powerHow effectively is the resulting computing powerutilized?utilized?•• Surprisingly low utilization:Surprisingly low utilization:
Mainframes are un-used 40% of the time!Mainframes are un-used 40% of the time! UNIX® Servers UNIX® Servers ““serveserve”” less than 10% of the time! less than 10% of the time! Desktops produce Desktops produce ““useful workuseful work”” less than 5% of the less than 5% of the
time!time!
We have fast computers and fast means toWe have fast computers and fast means toconnect them connect them –– why not utilize them why not utilize themconstructively?constructively?
3
28th April 200528th April 2005 Grid ComputingGrid Computing 55
Why Grid Computing ..contd.Why Grid Computing ..contd. Not all problems are solved efficientlyNot all problems are solved efficiently
by today's super-computersby today's super-computers Numerically as well as data intensiveNumerically as well as data intensive
problems that require a variety ofproblems that require a variety ofheterogenous resources not availabeheterogenous resources not availabeon a single computeron a single computer
Grid Computing offers a solutionGrid Computing offers a solution
28th April 200528th April 2005 Grid ComputingGrid Computing 66
What is Grid ComputingWhat is Grid Computing Simply stated Simply stated –– distributed computing taken distributed computing taken
to next levelto next level ““The goal is to create the illusion of a simpleThe goal is to create the illusion of a simple
yet large and powerful self managing virtualyet large and powerful self managing virtualcomputer out of a large collection ofcomputer out of a large collection ofconnected heterogeneous systems sharingconnected heterogeneous systems sharingvarious combinations of resources.various combinations of resources.””
Driving force is the emerging standardizationDriving force is the emerging standardizationfor sharing resources and higher networkfor sharing resources and higher networkbandwidthbandwidth
4
28th April 200528th April 2005 Grid ComputingGrid Computing 77
What is Grid Computing ..contd.What is Grid Computing ..contd.
Voluntary use of under-utilizedVoluntary use of under-utilizedresources available over the networkresources available over the network
Balancing out the utilization byBalancing out the utilization byexploiting parallelismexploiting parallelism
Providing a means for solving highlyProviding a means for solving highlyintensive problems in quasi real time.intensive problems in quasi real time.
28th April 200528th April 2005 Grid ComputingGrid Computing 88
What Grid Can DoWhat Grid Can Do
Exploiting underutilized resourcesExploiting underutilized resources Parallel CPU capacityParallel CPU capacity Virtual resources and virtualVirtual resources and virtual
organizations for collaborationorganizations for collaboration Access to additional resourcesAccess to additional resources Resource balancingResource balancing Reliability and ManagementReliability and Management
5
28th April 200528th April 2005 Grid ComputingGrid Computing 99
What Grid Cannot DoWhat Grid Cannot Do
Not a Silver Bullet!!Not a Silver Bullet!! Cannot achieve more withoutCannot achieve more without
additional hardware or resourcesadditional hardware or resources Cannot introduce parallelism inCannot introduce parallelism in
applicationsapplications Takes more than just one-clickTakes more than just one-click
installation, configuration is importantinstallation, configuration is important
28th April 200528th April 2005 Grid ComputingGrid Computing 1010
Distributed ComputingDistributed Computing•• Homogeneous vs. heteregenousHomogeneous vs. heteregenous
Cluster ComputingCluster Computing•• Centralized control vs. distributed controlCentralized control vs. distributed control
Peer To Peer (P2P)Peer To Peer (P2P)•• Merging streamsMerging streams
6
28th April 200528th April 2005 Grid ComputingGrid Computing 1111
Towards Grid Computing: aTowards Grid Computing: aconceptual viewconceptual view
Image Source: Grids and Grid technologies for wide-area distributed computingGrids and Grid technologies for wide-area distributed computing
28th April 200528th April 2005 Grid ComputingGrid Computing 1212
Aspects of Grid ComputingAspects of Grid Computing Types of GridsTypes of Grids General issues in Grid realizationGeneral issues in Grid realization Fundamental components of a GridFundamental components of a Grid Architectural considerationsArchitectural considerations Design FeaturesDesign Features Grid topologiesGrid topologies
7
28th April 200528th April 2005 Grid ComputingGrid Computing 1313
Types of GridsTypes of Grids Compute Grid / ComputationalCompute Grid / Computational
Services GridServices Grid Information Grid / Data GridInformation Grid / Data Grid Enterprise GridEnterprise Grid
28th April 200528th April 2005 Grid ComputingGrid Computing 1414
Data GridData Grid
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
8
28th April 200528th April 2005 Grid ComputingGrid Computing 1515
General Issues in GridGeneral Issues in GridRealizationRealization
CPU ConsiderationsCPU Considerations•• Parallelizable?Parallelizable?•• Parameter space problem?Parameter space problem?
Data considerationsData considerations•• Amount of data and time to send itAmount of data and time to send it•• Shared data issuesShared data issues
28th April 200528th April 2005 Grid ComputingGrid Computing 2020
CPU Considerations CPU Considerations ––ParallelizingParallelizing
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
11
28th April 200528th April 2005 Grid ComputingGrid Computing 2121
CPU Considerations CPU Considerations ––Parallization not possibleParallization not possible
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
28th April 200528th April 2005 Grid ComputingGrid Computing 2222
Design FeaturesDesign Features
Administrative hierarchyAdministrative hierarchy Communication servicesCommunication services Information servicesInformation services Naming servicesNaming services Distributed file systems and cachingDistributed file systems and caching Security and authorizationSecurity and authorization System status and fault toleranceSystem status and fault tolerance
12
28th April 200528th April 2005 Grid ComputingGrid Computing 2323
Design Features ..contd.Design Features ..contd.
Resource management and schedulingResource management and scheduling Computational economy and resourceComputational economy and resource
tradingtrading Programming tools and paradigmsProgramming tools and paradigms User and administrative GUIUser and administrative GUI
28th April 200528th April 2005 Grid ComputingGrid Computing 2424
Grid TopologiesGrid Topologies
IntragridsIntragrids•• Single organizationsSingle organizations•• No partner integrationNo partner integration•• A single clusterA single cluster
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
14
28th April 200528th April 2005 Grid ComputingGrid Computing 2727
An IntragridAn Intragrid
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
28th April 200528th April 2005 Grid ComputingGrid Computing 2828
An ExtragridAn Extragrid
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
15
28th April 200528th April 2005 Grid ComputingGrid Computing 2929
An IntergridAn Intergrid
Image Source: Introduction to Grid Computing with Introduction to Grid Computing with GlobusGlobus –– IBM Redbook IBM Redbook
28th April 200528th April 2005 Grid ComputingGrid Computing 3030
Is This For REAL?Is This For REAL?
Very Much!!Very Much!! Real GridsReal Grids
•• NASA IPG, the World Wide Grid, and theNASA IPG, the World Wide Grid, and theNSF TeraGridNSF TeraGrid
An intragrid example: developed atAn intragrid example: developed atUniversity of Wisconsin and availableUniversity of Wisconsin and availableat UMDat UMD•• Condor - http://Condor - http://www.cs.wisc.eduwww.cs.wisc.edu/condor//condor/
16
28th April 200528th April 2005 Grid ComputingGrid Computing 3131
Is This For REAL? ..contd.Is This For REAL? ..contd. Grid ForumsGrid Forums
•• Global Grid Forum (http://www.ggf.org/)Global Grid Forum (http://www.ggf.org/)
Grid StandardsGrid Standards•• Open Grid Services Architecture, anOpen Grid Services Architecture, an
industry blueprint for standards basedindustry blueprint for standards basedGrid ComputingGrid Computing
•• Implemented by: the IBM Globus Toolkit.Implemented by: the IBM Globus Toolkit.Provides a set of tools for applicationProvides a set of tools for applicationprogramming (APIs) and systemprogramming (APIs) and systemdevelopment kits (SDKs)development kits (SDKs)
28th April 200528th April 2005 Grid ComputingGrid Computing 3232
ReferencesReferences Introduction to Grid Computing with Globus Introduction to Grid Computing with Globus –– IBM Redbook IBM Redbook
Grid Explained, IBM Whitepaper, Jan. 2005Grid Explained, IBM Whitepaper, Jan. 2005
Grids and Grid technologies for wide-area distributedGrids and Grid technologies for wide-area distributedcomputingcomputing, Mark Baker, Rajkumar , Mark Baker, Rajkumar BuyyaBuyya and Domenico and Domenico
LaforenzaLaforenza, Appeared in Journal of Software Practice and, Appeared in Journal of Software Practice andExperience Softw. Pract. Exper. 2002; (in press) (DOI:Experience Softw. Pract. Exper. 2002; (in press) (DOI:
10.1002/spe.488)10.1002/spe.488)
The Grid: A New Infrastructure for 21st Century ScienceThe Grid: A New Infrastructure for 21st Century Science, Ian, IanFoster, Feature Arcticle, Physics Today, VOL 55, ISSUE 2, Pg 42Foster, Feature Arcticle, Physics Today, VOL 55, ISSUE 2, Pg 42
Scooped, AgainScooped, Again, Jonathan Ledlie, Jeff Shneidman, Margo, Jonathan Ledlie, Jeff Shneidman, MargoSeltzer, John Huth. Harvard UniversitySeltzer, John Huth. Harvard University
17
28th April 200528th April 2005 Grid ComputingGrid Computing 3333
Any Questions?Any Questions?
28th April 200528th April 2005 Grid ComputingGrid Computing 3434