Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.

Deploying the Deploying the AstroGrid: AstroGrid:

Science Use for the Science Use for the Black Hole CensusBlack Hole Census

Nicholas WaltonInstitute of Astronomy,

The University of Cambridge

A PPARC funded project

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p2 Printed: 08/11/04

X-ray cluster: Chandra X-ray (Mullis) overlaid on a deep BRI image (Clowe & Luppino).

ES

O

Multiple large image sources:registration &association

Source ID from multiplexed spectral data

Multi-TB λCDMmodels, e.g.Millennium Sim

Generate Shear Mapsc.f. CDM models> DM distributionwith redshift Remove stars

correlate galswith z

Colour-Colourrelationshipsclassification in multi-phase space

Automatic clusterfinding techniques

NA

SA

Recap: New & Improved Science:Recap: New & Improved Science:CosmologyCosmology


Supernova Remnant Cassiopeia-A – a 300

year old Supernova

The Challenge and Opportunity of multi-

Wavelength data:Shocks seen in the X-ray Chandra image

Heavy elementsseen in the optical

Dust shows in the IR

Images from Chandra Science Centre

Mapping e¯s in the magnetic field as revealed by Radio data

N A Walton: AstroGrid SAG : Meeting 1 : IoA : June 19, 2003 p4 Printed: 08/11/04

The Need for Virtual Observatories: The Need for Virtual Observatories: Managing Technological ChangeManaging Technological Change

● The massive Growth of Data● Number + size of telescopes

● Optical: ESO's 4x8m VLT, 2x8m Gemini ● X-ray: XMM-Newton● sub-mm: ALMA

● Increase in size and multiplex capabilities of instrumentation:● Infra-Red: VISTA > 100 GB/nights● Radio: e-Merlin > data rates ~320 Gbps

● All sky at 0.1 arcsec – 100 TB


AstroGrid (VO) Key GoalsAstroGrid (VO) Key Goals

Enable Science by:● Improving the quality, ease, speed and cost effectiveness

of on-line astronomy● Making comparison and integration of data from diverse

sources seamless and transparent● Removing data analysis barriers to multiwavelength

analysis● Enabling access and manipulation of large data sets


AstroGrid 'Ten' Key Science DriversAstroGrid 'Ten' Key Science Drivers


Partnerships in Partnerships in EuropeEuropedelivering technology delivering technology for the Astrophysical for the Astrophysical Virtual ObservatoryVirtual Observatory

AstroG

rid: Technology lead in the A

VO


The International Virtual Observatory The International Virtual Observatory Alliance (IVOA) Alliance (IVOA)

agreeing vital low level standardsagreeing vital low level standards


Deployment StrategyDeployment Strategy● Goal: provide rapid operational feedback to ongoing

development process● AstroGrid has an iterative release cycle● Each release is deployed during the following 'iteration'● Deployment

– Release s/w components installed on the AstroGrid Testbed– Associated release documentation and walk throughs– Dedicated feedback reporting system– In use with 'beta-testers'

● Integration of AstroGrid testbed with EU Astrophysical Virtual Observatory activities


The AstroGrid TestbedThe AstroGrid Testbed


AstroGrid nodes: AstroGrid nodes: connected to fast backboneconnected to fast backbone

2.5Gbit/s

>1 Gbit/sec

10 Gbit/s

AGnode


Iteration 05 Deployment ReleaseIteration 05 Deployment Release● Conforms to IVOA

standards ● Single sign in● User MySpace

– secure● Query building

– Standard queries● Build up workflow

– reusability


Iteration 05 Deployment ReleaseIteration 05 Deployment Releasecomplex workflowscomplex workflows


Itn05: use in AVO Demo: Jan 2004Itn05: use in AVO Demo: Jan 2004discovering distant quasars from multi-discovering distant quasars from multi-λ dataλ data


New Science with the AVO Demo ToolNew Science with the AVO Demo Tool


11stst Science from the AVO Science from the AVOenabling mass scale data mining enabling mass scale data mining

● Search for high luminosity Type 2 QSO's – Optically obscured due to viewing thru the dust torus

● Use of deep multicolour data – GOODS– HST ACS, XMM/ChandraX-Ray

● Use of AVO demonstrator tool – Revealed 4 times more Type-2 quasars in sample– Tool demonstrates ease of access to data

● Enabled via interoperability standards– Enhancement: Workflow to enable mass scale redshifts

● Padovani et al: astro-ph/0406056


Iteration 06 Deployment ReleaseIteration 06 Deployment Release● More complex IVOA

standard implementation– SIAP interface

● Query builder: interface● Workflow: programmable● Registry: harvesting● Applications: varied● Data: image and tabular


Movie Maker WorkflowMovie Maker Workflow


AstroGrid Itn06: use in AVO Demo 2005AstroGrid Itn06: use in AVO Demo 2005


AstroGrid: Helper ApplicationsAstroGrid: Helper Applications● Range of externally provided applications: tools to analyse

and visualise end and intermediate data products– VOPlot: handles VOTable data– VOPlot3D: handles VOTable data – 3D visualisation– Topcat: tabular data and manipulation – VOSpec: spectral plotting and analysis package– Specview: spectral plotting and analysis package– Aladin: data visualisation and catalogue access

● MySpace browser capability (read-only)● See http://wiki.astrogrid.org/bin/view/Astrogrid/VoResources

http://wiki.astrogrid.org/bin/view/Astrogrid/VoResources


The Next Steps: The Next Steps: Participant in VO Science Demos 2005Participant in VO Science Demos 2005● AstroGrid: Consortium meeting: mid Dec 2004

— Brown dwarf discovery— Solar coronal mass ejections

● Euro-VO: ESAC, Madrid: 25-26 Jan 2005— Star formation histories— AGB to PN transitions

● A Widening range of capabilities, data, applications — Increasing scientific usefulness

GOAL: end 2005 – science papers enabled by VOs


AstroGrid Version 1 Release: Jan 2005AstroGrid Version 1 Release: Jan 2005Prototype Virtual Observatory for the UKPrototype Virtual Observatory for the UK

http://www.astrogrid.org/release

Deploying the Deploying the AstroGrid: AstroGrid:

Science Use for the Science Use for the Black Hole CensusBlack Hole Census

http://www.astrogrid.org

A PPARC funded project

Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.

Documents

sc2004 pittsburgh

integration of data

astrogrid sag

astrogrid nodes

astrogrid testbedn

science use

radio data n

new science