Slide Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow GridPP24 Collaboration Meeting 14 th April 2010 GridPP24 – Data!
Mar 28, 2015
Slide Slide David Britton, University of Glasgow IET, Oct 09 1
Prof. David BrittonGridPP Project leaderUniversity of Glasgow
GridPP24 Collaboration Meeting14th April 2010
GridPP24 – Data!
Slide Slide
Data Arrives!
David Britton, University of Glasgow 3PPRP
Slide Slide
The Long Road…
David Britton, University of Glasgow GridPP24 4
24th GridPP Collaboration Meeting, RHUL, 14-15 April 2010 - Data.23rd GridPP Collaboration Meeting, University of Cambridge , 8-9 September 2009 – Final Steps22nd GridPP Collaboration Meeting, UCL, 1-2 April 2009 - Service Resilience21st GridPP Collaboration Meeting, Swansea University, 3-4 September 2008 - 21: Coming of Age20th GridPP Collaboration Meeting, Trinity College, Dublin, 11-12 March 2008 - Unreasonableness?19th GridPP Collaboration Meeting, Ambleside, 29-31 August 2007 – The end of (GridPP2) as we know it18th GridPP Collaboration Meeting, Glasgow, 20-21 March 200717th GridPP Collaboration Meeting, NeSC, Edinburgh, 1-2 November 200616th GridPP Collaboration Meeting, QMUL, 27-29 June 200615th GridPP Collaboration Meeting, RAL, 11-12 January 200614th GridPP Collaboration Meeting, University of Birmingham, 6-7 September 200513th GridPP Collaboration Meeting, Grey College Durham, 4-6 July 200512th GridPP Collaboration Meeting, Brunel, 31 January-1 February 200511th GridPP Collaboration Meeting, Liverpool, 14-15 September 200410th GridPP Collaboration Meeting, CERN, Geneva, 2-4 June 2004 9th GridPP Collaboration Meeting, NeSC, Edinburgh, 4-5 February 2004 8th GridPP Collaboration Meeting, Bristol, 22-23 September 2003 7th GridPP Collaboration Meeting, Oxford, 30 June-2 July 2003 6th GridPP Collaboration Meeting, Coseners House, 30-31 January 2003 5th GridPP Collaboration Meeting, Imperial College, 16-17 September 2002 4th GridPP Collaboration Meeting, Manchester, 9-10 May 2002 3rd GridPP Collaboration Meeting, Cambridge, 14-15 February 2002 2nd GridPP Collaboration Meeting, Edinburgh, 5-6 November 2001 1st GridPP Collaboration Meeting, Coseners House, 24-25 May 2001
383 PMB Meetings
Slide Slide
… to the Start!
David Britton, University of Glasgow GridPP24 5
Slide Slide
The Time is Now
David Britton, University of Glasgow GridPP24 6
Slide Slide
First Data
Tier-1 Review
RCUK International Review of e-Science
Tier-1 Opening
… and of course the GridPP4 proposal!
Since GridPP23
David Britton, University of Glasgow 7GridPP24
Slide Slide
First Data
David Britton, University of Glasgow GridPP24 8
From an Atlas presentation to wLCG MB
Slide Slide
Tier-1 Review
David Britton, University of Glasgow GridPP24 9
Third in a series of annual reviews of the Tier-1. Reviewers included three people from CERN.
It was noted that the weekly Tier-1/experiments meeting had enhanced communications.
The out-of-hour service had been successfully developed.
The excellent performance of RAL during STEP09 was noted.
The management processes had been successfully developed.
Many (but not all) of the problems last autumn were related to the new building R89.
The Tier-1 was encouraged to develop staff-agility to provide more cover.
Concerns were voiced about the CASTOR upgrade path (GridPP24 discussion).
Slide Slide
RCUK e-Science Review
David Britton, University of Glasgow 10
Report explicitly mentions:• GridPP’s expertise in large-scale distributed data management and analysis.• Our work with start-up companies.• The substantial secondary economic benefit arising from the ability to rapidly screen drugs "in-silico”. GridPP resources were used in this way to screen potential agents in the fight against bird-flu and malaria.
“NGS and GridPP have been highly successful, providing many users with access to more computing power than they could otherwise easily obtain. Looking forward, we recommend that these efforts, including enhanced capacity and function of distributed storage, be sustained and expanded.” RAL Tier-1
Slide Slide
Tier-1 Opening
David Britton, University of Glasgow GridPP24 11
Slide Slide
GridPP4 Time Line
David Britton, University of Glasgow GridPP24 12
Nov 5th – invitation to bid. Dec 10th – Face-to-face PMB to agree structure Dec 11th – CB meeting to agree structure Jan 15th – Face-to-face PMB to agree draft v6 Jan 21st – CB meeting to discuss v6. Jan 28th – Submission of draft to Oversight Committee Feb 4th – Meeting with Oversight Committee + STFC Feb 12th – Near-final draft incorporating feedback Feb 22nd – Final comments/typos/corrections done Feb 24th – Submitted! Mar 4th – Last possible submission date Apr 15th - PPRP May 14th – PPRP Visiting Panel.
12 Weeks
3 Weeks
Slide Slide
Proposal Structure
David Britton, University of Glasgow 13
WP-A: Tier-1 infrastructure and manpower;
WP-B: Tier-2 infrastructure and manpower;
WP-C: Grid deployment, operations and support;
WP-D: Experiment-specific technical support;
WP-E: Management team;
WP-F: Impact Plan (Economic Impact, Knowledge Transfer and Outreach)
WP-G: Travel and other costs.
In the midst of writing the proposal we were told to reduce the project by 20%. This was very complex but is now built into submitted document.
GridPP24
Slide Slide
Project Map
David Britton, University of Glasgow 14GridPP24
Slide Slide
Project Deliverables
David Britton, University of Glasgow RCUK e-Science Review 15
Slide Slide
Hardware Requirements
David Britton, University of Glasgow 16
LHC Schedule
Experiment
Computing Models
Global Resource
Requirements
UK Resource Requirement
s
Hardware Costings
UK Resource Request
Scrutiny by C-RSG (April 2010), CRRB, LHCC (May
2010).
UK Collaboration
sizes
A complex and evolving situation requiring constant management. Historically we have seen the integrated requirements are reasonably “good-and-improving” estimates of actual needs.
Experience with real data(March+ 2010)
Chamonix 2010 (Jan 2010)
GridPP24
Slide Slide
Hardware Scaling
David Britton, University of Glasgow 17
Tier-1 CPU Capacity
KSI2K vs Year Hardware requirements have increased exponentially – fortunately Moore’s Law has held true with about the same time constant.
Logarithmic scaleRAL CPU costs
Ramp for LHC start
~2-year Moore’s Law
GridPP24
Slide Slide
Hardware Costs
David Britton, University of Glasgow 18
Comparing predictions is even more difficult…
For CPU, there is a remarkably good (in fact, too-good) agreement between the CERN and GridPP predictions.
For Disk, factoring in different RAID strategies etc, estimates agree at about 5% level, which is better than the exchange-rate uncertainty alone.
Conclude: GridPP’s empirical approach leads to the same costing as an extensive top-down investigation of market and technology trends suggesting the Moore’s law assumption continues to be valid over the this time period.
27 pages
GridPP24
Slide Slide David Britton, University of Glasgow 19
The EGI/NGI Structure
EGI.euEGI.eu
EMIEMIEGI.inspire
EGI.inspire
European Framework-7 proposals
GridPP
NGSNGI
Operations
NGI Operations Coordinator
(John Gordon)
SecurityAccounting
and Monitoring
Training/
Outreach
Helpdesk and Regional Support
NGI Management Board
GridPP operates the largest scientific Grid in the UK and must ensure the UK NGI meets the needs of the large community we serve.
We have identified certain tasks that are absolutely required by GridPP and wLCG, which have wider UK applicability and would sensibly be done in close collaboration as part of a larger team within a UK NGI.
We have used this as a way to optimize our manpower, our leadership, and our influence in these areas. We believe that JISC is committed to funding an NGI at some level (signed up to EGI) but we have examined alternative scenarios and included in contingency.
GridPP24
Slide Slide
A UK NGI
David Britton, University of Glasgow RCUK e-Science Review 20
GridPP4
funded
NGS4 and EGI
funded
EGI not
funded
NGS4 not
funded
Slide Slide
Risks Register
David Britton, University of Glasgow 21
… 22 high level risks analysed in proposal.
Covered by:
W.A. (0.5 FTE)
WP-D Expt. Support
WP-C Data Man.
Old (atlas) building and other measuresTier-2 strategy
W.A. (0.5 FTE)
WP-C security team
WP-C security team
W.A. (1.0 FTE)
GridPP24
Slide Slide
Risks Register - 2
David Britton, University of Glasgow 22PPRP
These risks are covered by the Contingency
Slide Slide
Publications
David Britton, University of Glasgow 23
Maintain a list of publications (best-effort basis, so incomplete) on the GridPP website at: http://www.gridpp.ac.uk/papers/.
Currently 220 publications (2001 – 2009).
2009 papers: 22 papers,105 (~70 unique) authors
GridPP24
Slide Slide
In Summary
David Britton, University of Glasgow 24PPRP