Ryan Taylor - ISGC, Mar. 22, 2013 1 Adding IaaS Clouds to the ATLAS Computing Grid Ashok Agarwal, Frank Berghaus, Andre Charbonneau, Mike Chester, Asoka de Silva, Ian Gable, Joanna Huang, Colin Leavett-Brown, Michael Paterson, Randall Sobie, Ryan Taylor
34
Embed
Adding IaaS Clouds to the ATLAS Computing Grid · Ryan Taylor - ISGC, Mar. 22, 2013 17 III. Powered by Cloud Scheduler Cloud Scheduler is a simple python package for managing VMs
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Ryan Taylor - ISGC, Mar. 22, 2013 1
Adding IaaS Clouds to the ATLAS Computing Grid
Ashok Agarwal, Frank Berghaus, Andre Charbonneau, Mike Chester, Asoka de Silva, Ian Gable, Joanna Huang, Colin Leavett-Brown, Michael
Paterson, Randall Sobie, Ryan Taylor
Ryan Taylor - ISGC, Mar. 22, 2013 2
Outline
I. Motivation
II. Building a “Grid of Clouds”
III. Powered by Cloud Scheduler
IV. New Development: Dynamic Squids
V. Summary
Ryan Taylor - ISGC, Mar. 22, 2013 3
Announcement of boson discovery
I. Motivation
Ryan Taylor - ISGC, Mar. 22, 2013 4
Announcement of boson discovery
“Just-in-time computing” ?
I. Motivation
Ryan Taylor - ISGC, Mar. 22, 2013 5
I. Motivation
1. Allow commercial cloud bursting for urgent deadlines● Costs $$$, but on-time discovery announcements are priceless
2. Augment steady-state grid capacity with non-commercial cloud resources● Both public and private
3. Enable WLCG sites that wish to convert to cloud● e.g. Australia-ATLAS T2 on
● Scope of this talk: ● Adding extra cloud resources, not changing existing grid sites● MC production jobs only (light I/O)
Ryan Taylor - ISGC, Mar. 22, 2013 6
II. Building a “Grid of Clouds”Using Condor and Cloud Scheduler
Ryan Taylor - ISGC, Mar. 22, 2013 7
Grid Job Flow
Ryan Taylor - ISGC, Mar. 22, 2013 8
Grid Job Flow
● Compute Element is tightly coupled to batch system
Ryan Taylor - ISGC, Mar. 22, 2013 9
Cloud Job Flow (on the Grid)
● Cloud Scheduler is loosely coupled to cloud interface