Top Banner
Grid Programming on Grid Programming on Taiwan Unigrid Taiwan Unigrid Platform Platform
30

Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Jan 03, 2016

Download

Documents

Virginia French
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Grid Programming on Grid Programming on Taiwan Unigrid PlatformTaiwan Unigrid Platform

Page 2: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

Page 3: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Introduction (1)Introduction (1)The purpose of grid computing is

to integrate various resources within a large network environment.

The purpose of the UniGrid project is to build a platform for academic research using grid-related technologies in Taiwan.

Page 4: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Introduction (2)Introduction (2)8 institutes join to

develop the system◦國網中心◦清華大學資工系◦中研院資科所◦東華大學資工系◦東海大學資科系◦中華大學資工系◦興國管理學院電子商務學系◦靜宜大學資訊管理系

Page 5: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Introduction (3)Introduction (3)

台灣大學電機系 台灣大學資工系 台灣師大資工系 淡江大學資工系 德明技術學院資科系 交通大學資工系 新竹教育大學資工所 逢甲大學資工系 台中教育大學資科系 國家高速網路與計算中心中群

修平技術學院資管系

彰化師大資工系 中正大學資工系 成功大學電機系 成功大學資工系 台南大學數位學習科技系 長榮大學資管系 立德管理學院資管系 中山大學電機系 義守大學資工系 高雄大學資工系 台東大學資訊管理學系

Over 20 institutes provides their resource and join the Unigrid platform

Page 6: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Introduction (4)Introduction (4)All institutes that participate in

the UniGrid project contribute some resources.

These resources can be used in collaboration for large scale applications.

Page 7: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Introduction (5)Introduction (5)

Page 8: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Portal DemoPortal Demohttp://www.unigrid.org.tw/

Page 9: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Page 10: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

LoginLoginConnect to http://www.unigrid.org.tw/Choose the Workflow Submition tab to

login

Page 11: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.
Page 12: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Page 13: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Data Storage SystemData Storage System Press the Data Storage button

◦ Your computer required to have java runtime environment (jre) installed

Choose trust to any prompt window

Page 14: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Data Storage SystemData Storage System

Your data storage spaceYour local diskUpload file

Download file

Page 15: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

When upload, always use 01_iisgridxx_IISAS series

Data Storage SystemData Storage System

Page 16: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Page 17: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Structure of a workflowStructure of a workflow

sequentialexecution

parallelexecution

Workflow

Page 18: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Create WorkflowCreate WorkflowTo execute program, first thing is

to create the workflowThen create the StageThen create the Job and fill in

proper job descriptionNow we are ready for workflow

submission

Page 19: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Edit WorkflowEdit WorkflowChoose EditWorkflow in the left hand siteFill in the workflow name your like and press

send

Page 20: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Create StageCreate Stage A new workflow with the specified name will appear in

the bottom of all existing workflows Press the edit this flow, a new text field will appear

to create new stage with the specified stage name

Page 21: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Create jobCreate jobPress add new job of the specified stage to

fill in the job description

Page 22: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Job Description-1Job Description-1 Scheduler:

◦ Using default ”Condor” JOB name :

◦ The name of this job Job Profile :

◦ This profile determined which machine will be allocated, you can try None, CPU_Bound, or Memory_Bound

Run Type :◦ Choose this wisely according to which kind of your

program is Binary Filename :

◦ The filename of your program Argument :

◦ The arguments required by your program

Page 23: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Job Description-2Job Description-2 Data Filename:

◦ The input file name if required Note that the specified binary and data file must

exist on date storage system before press the submission button

Output filename : ◦ If your program generate output files, specify the

output file name tell the grid system to transfer the output file back to date storage system while job complete.

Number of processors : ◦ Required number of processors

Machine Select: ◦ Select machine manually by specify the cluster

name and required number of processors

Page 24: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Job Description-3Job Description-3SRB Directory :

◦ It tells the grid where the Binary file and data file located

◦ Choose it always while execute your program

Note that if you upload your program/date in a specified folder, please also add the relative path to the binary/date filename textfield◦ EX. You build xxx directory in storage

system and put in the file test.exe,then you must fill in the binary filename as ./xxx/test.exe and check the SRB directory checkbox

Page 25: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Page 26: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Submit WorkflowSubmit Workflow Select the function Workflow Find out the workflow by the workflow name then

press the submit

Page 27: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

OutlineOutlineIntroduction to Taiwan UnigridHow to use Taiwan Unigrid

◦Login◦Upload Program/Data◦Create Workflow◦Submit◦Check Job Status

Page 28: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Check Job StatusCheck Job Status Choose function Job Status You can see all the submitted workflows as a tree structure

in the JobStatus page by ascending order of submit time. The detailed job result will show on the right side.

Page 29: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Job Result DescriptionJob Result Description Job name

◦ The same as you specified in workflow Job ID

◦ A unique ID for each job Executable name

◦ The program name specified in binary filename field of workflow

Job Start/Finish Time◦ The time that this job actually start execution and end

execution Machine List

◦ List the cluster name and number of processor used in this cluster

Job Result◦ The screen output of the program

Job Log◦ Used for debug, don’t care

Page 30: Grid Programming on Taiwan Unigrid Platform. Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid.

Any Question?Any Question?