Deploying the Deploying the AstroGrid: AstroGrid:
Science Use for the Science Use for the Black Hole CensusBlack Hole Census
Nicholas WaltonInstitute of Astronomy,
The University of Cambridge
A PPARC funded project
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p2 Printed: 08/11/04
X-ray cluster: Chandra X-ray (Mullis) overlaid on a deep BRI image (Clowe & Luppino).
ES
O
Multiple large image sources:registration &association
Source ID from multiplexed spectral data
Multi-TB λCDMmodels, e.g.Millennium Sim
Generate Shear Mapsc.f. CDM models> DM distributionwith redshift Remove stars
correlate galswith z
Colour-Colourrelationshipsclassification in multi-phase space
Automatic clusterfinding techniques
NA
SA
Recap: New & Improved Science:Recap: New & Improved Science:CosmologyCosmology
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p3 Printed: 08/11/04
Supernova Remnant Cassiopeia-A – a 300
year old Supernova
The Challenge and Opportunity of multi-
Wavelength data:Shocks seen in the X-ray Chandra image
Heavy elementsseen in the optical
Dust shows in the IR
Images from Chandra Science Centre
Mapping e¯s in the magnetic field as revealed by Radio data
N A Walton: AstroGrid SAG : Meeting 1 : IoA : June 19, 2003 p4 Printed: 08/11/04
The Need for Virtual Observatories: The Need for Virtual Observatories: Managing Technological ChangeManaging Technological Change
● The massive Growth of Data● Number + size of telescopes
● Optical: ESO's 4x8m VLT, 2x8m Gemini ● X-ray: XMM-Newton● sub-mm: ALMA
● Increase in size and multiplex capabilities of instrumentation:● Infra-Red: VISTA > 100 GB/nights● Radio: e-Merlin > data rates ~320 Gbps
● All sky at 0.1 arcsec – 100 TB
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p5 Printed: 08/11/04
AstroGrid (VO) Key GoalsAstroGrid (VO) Key Goals
Enable Science by:● Improving the quality, ease, speed and cost effectiveness
of on-line astronomy● Making comparison and integration of data from diverse
sources seamless and transparent● Removing data analysis barriers to multiwavelength
analysis● Enabling access and manipulation of large data sets
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p6 Printed: 08/11/04
AstroGrid 'Ten' Key Science DriversAstroGrid 'Ten' Key Science Drivers
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p7 Printed: 08/11/04
Partnerships in Partnerships in EuropeEuropedelivering technology delivering technology for the Astrophysical for the Astrophysical Virtual ObservatoryVirtual Observatory
AstroG
rid: Technology lead in the A
VO
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p8 Printed: 08/11/04
The International Virtual Observatory The International Virtual Observatory Alliance (IVOA) Alliance (IVOA)
agreeing vital low level standardsagreeing vital low level standards
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p9 Printed: 08/11/04
Deployment StrategyDeployment Strategy● Goal: provide rapid operational feedback to ongoing
development process● AstroGrid has an iterative release cycle● Each release is deployed during the following 'iteration'● Deployment
– Release s/w components installed on the AstroGrid Testbed– Associated release documentation and walk throughs– Dedicated feedback reporting system– In use with 'beta-testers'
● Integration of AstroGrid testbed with EU Astrophysical Virtual Observatory activities
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p10 Printed: 08/11/04
The AstroGrid TestbedThe AstroGrid Testbed
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p11 Printed: 08/11/04
AstroGrid nodes: AstroGrid nodes: connected to fast backboneconnected to fast backbone
2.5Gbit/s
>1 Gbit/sec
10 Gbit/s
AGnode
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p12 Printed: 08/11/04
Iteration 05 Deployment ReleaseIteration 05 Deployment Release● Conforms to IVOA
standards ● Single sign in● User MySpace
– secure● Query building
– Standard queries● Build up workflow
– reusability
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p13 Printed: 08/11/04
Iteration 05 Deployment ReleaseIteration 05 Deployment Releasecomplex workflowscomplex workflows
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p14 Printed: 08/11/04
Itn05: use in AVO Demo: Jan 2004Itn05: use in AVO Demo: Jan 2004discovering distant quasars from multi-discovering distant quasars from multi-λ dataλ data
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p15 Printed: 08/11/04
New Science with the AVO Demo ToolNew Science with the AVO Demo Tool
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p16 Printed: 08/11/04
11stst Science from the AVO Science from the AVOenabling mass scale data mining enabling mass scale data mining
● Search for high luminosity Type 2 QSO's – Optically obscured due to viewing thru the dust torus
● Use of deep multicolour data – GOODS– HST ACS, XMM/ChandraX-Ray
● Use of AVO demonstrator tool – Revealed 4 times more Type-2 quasars in sample– Tool demonstrates ease of access to data
● Enabled via interoperability standards– Enhancement: Workflow to enable mass scale redshifts
● Padovani et al: astro-ph/0406056
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p17 Printed: 08/11/04
Iteration 06 Deployment ReleaseIteration 06 Deployment Release● More complex IVOA
standard implementation– SIAP interface
● Query builder: interface● Workflow: programmable● Registry: harvesting● Applications: varied● Data: image and tabular
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p18 Printed: 08/11/04
Movie Maker WorkflowMovie Maker Workflow
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p19 Printed: 08/11/04
AstroGrid Itn06: use in AVO Demo 2005AstroGrid Itn06: use in AVO Demo 2005
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p20 Printed: 08/11/04
AstroGrid: Helper ApplicationsAstroGrid: Helper Applications● Range of externally provided applications: tools to analyse
and visualise end and intermediate data products– VOPlot: handles VOTable data– VOPlot3D: handles VOTable data – 3D visualisation– Topcat: tabular data and manipulation – VOSpec: spectral plotting and analysis package– Specview: spectral plotting and analysis package– Aladin: data visualisation and catalogue access
● MySpace browser capability (read-only)● See http://wiki.astrogrid.org/bin/view/Astrogrid/VoResources
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p21 Printed: 08/11/04
The Next Steps: The Next Steps: Participant in VO Science Demos 2005Participant in VO Science Demos 2005● AstroGrid: Consortium meeting: mid Dec 2004
— Brown dwarf discovery— Solar coronal mass ejections
● Euro-VO: ESAC, Madrid: 25-26 Jan 2005— Star formation histories— AGB to PN transitions
● A Widening range of capabilities, data, applications — Increasing scientific usefulness
GOAL: end 2005 – science papers enabled by VOs
N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p22 Printed: 08/11/04
AstroGrid Version 1 Release: Jan 2005AstroGrid Version 1 Release: Jan 2005Prototype Virtual Observatory for the UKPrototype Virtual Observatory for the UK
http://www.astrogrid.org/release
Deploying the Deploying the AstroGrid: AstroGrid:
Science Use for the Science Use for the Black Hole CensusBlack Hole Census
http://www.astrogrid.org
A PPARC funded project