1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of.

1

Teaching Grid Computing across North Carolina and Beyond

Dr. Clayton FernerUniversity of North Carolina

Wilmington

Dr. Barry WilkinsonUniversity of North Carolina

Charlotte

Education Program Plenary Session

Sunday, Nov. 13th, 2011, 8:30 am -10:00 am

SC11 Int. Conf. for High Performance Computing, Networking, Storage and Analysis, Seattle, WA

Undergraduate Grid Computing Course

Key features: Distributed computing resources – Production-level Grid

platform set up between UNC-Charlotte and UNC-Wilmington Distributed students – Taught on North Carolina Research

and Education televideo network across North Carolina Undergraduate level – perhaps first such course.

Fall 2004: 8 sites 43 students Fall 2005: 12 sites 32 students Spr. 2007: 3 sites 19 students Fall 2008: 5 sites 35 students Spr. 2010: 8 sites 73 students Fall 2011: 6 sites 67 students

Grid Computing Course Participants

16 institutions - major research universities, comprehensive universities, several minority serving schools, 4-year colleges, private and public.

Fall 2011 Course Virtual Organization

Sites originally scheduled to receive course:

•Six sites in North Carolina•Universidad Católica del Norte, Antofagasta, Chile

Continuing student unrest in Chile so had to drop – Plan will pursue in future.

University of Arkansas Fayetteville as a site also explored

www.vacationstogo.com

Course Grid Structure - Primary Sites

UNC-W

UNC-C

Course portal

torvalds.cis.uncw.edu(Cluster of 15 machines)

coit-grid01.uncc.educoit-grid02.uncc.educoit-grid03.uncc.educoit-grid04.uncc.educoit-grid05.uncc.educoit-grid06.uncc.educoit-grid07.uncc.edu

• Certificate Authorities on both UNCC cluster and UNCW cluster

• Globus (GT4)• Gridsphere Portal, Purse, MyProxy• Condor • CUDA on two Fermi GPU servers in

UNCC cluster, grid06 and grid07

• Job management, schedulers

• Workflow editor• Grid infrastructure design• Grid computing security• Portal software design• Grid-enabling applications• Intro to distributed

computing using pattern-programming HPC cloud computing

• 7 hands-on assignments

Topics

Some assignments require students to install significant software on their computer (Globus core, GridNexus workflow editor, GridSphere, ...)

2011 course home pagehttp://coitweb.uncc.edu/~abw/ITCS4146F11

Course Portal

Portal provides single sign-on to all grid resources.

8

Assignment 1Using a Grid Portal – registration step

New User

PURSe on-line registration form

CA/SystemAdministrator

Create accounts, set access control, sign certificate, …

Fill in formProvide password and other information

Email confirmation, Acknowledgement

Pass information to other sites to set up remote sites

Assignment 1Simple Distributed Job thro Portal

Computation: Compute mulch to cover flowerbed to depth of 4 inches.

Flowerbed

File staging and job executionUNC-C UNC-W

This computation is repeated using the Globus command line, a GUI workflow editor, and Condor DAGman in other

assignments for comparison, together with other tasks.

10

Assignment 2 Using command-line

Students submit jobs through command-line

Proxy obtained from MyProxy server (or manual process of getting certificate signed and creating a proxy from it)

Submit various jobs with globusrun-ws

Repeat flowerbed computation but using the command line

xml job description files with automatic input/output file staging/cleanup

11

Assignment 3 GridNexus

Get proxy

Create and execute flowerbed computation

Assignment requires students to install GridNexus on their computer

12

Assignment 4 Using Condor

Submit jobs and check status

Using different Condor universes (Vanilla/C, Java)

Test email acknowledgment feature

Creating ClassAds to select suitable resources

Creating DAGMAN workflows, for flowerbed computation and other workflows

13

Assignment 5Creating and deploying a Grid Service

Create, deploy, and test simple GT4 Grid Services with clients

Add functionality Re-name services

Need to modify WSDL and other files

Assignment requires students to install Globus core and associated packages on their computer

14

Assignment 6 GridNexus web service workflows

Create various web/grid service workflows.

Flowerbed computation using web/grid services for each part

Assignment done of students own computer, which acts a client to remote services

15

Create/deploy portletsFinal design - create portlet interface for distributed application.

Assignment 7JSR 168 Portlets in Gridsphere

Assignment requires students to install GridSphere on their computer

© copyright 2008, Barry Wilkinson, UNC CharlotteClayton S. Ferner, UNC Wilmington

Information on course offering, publications, etc. http://coitweb.uncc.edu/~abw/gridcourse

Course Text – direct outcome of courseHome page:http://coitweb.uncc.edu/~abw/GridComputingBook/

18

AcknowledgementsSupport for the work described here was provided by the National Science Foundation under grants 0410667/0533334 and 0737318/0737269/0737208, and two grants from University of North Carolina Office of the President.

SummaryPerhaps the first course to have both distributed resources and distributed students to teach Grid computing at the undergraduate level.

Many universities participated

Special features include many hands-on assignments, comparing a portal, command line, a GUI workflow editor (developed at UNC-Wilmington) and workflow with a job scheduler, and portlet interface design.

Also resulted in the first Grid computing course textbook at the undergraduate level.