WFAU Science Archives surveys.roe.ac.uk WFAU Demonstration Nick Cross, Rob Blake, Ross Collins, Mike Read, Eckhard Sutorius, Mark Holliman, Stellios Voutsinas,

MWAWFS - RAS

WFAU Science Archivessurveys.roe.ac.uk

WFAU DemonstrationNick Cross, Rob Blake, Ross Collins, Mike Read, Eckhard Sutorius, Mark Holliman,

Stellios Voutsinas, Dave Morris

30/03/2015

Using the WFAU Archives

30/03/2015 MWAWFS - RAS

• Coverage Maps• Archive Listing• GetImage / MultiGetImage• Region• Cross ID (now includes Synoptic Source)• Freeform SQL (enhanced)• ADQL

WFAU Archives - Information• Data Overview• Schema Browser + Glossary• SQL cookbook• Monitor page• Release history• Known Issues• Publications – Hambly et al. (2008), Cross et al. (2009), Cross et al.

(2012)

30/03/2015 MWAWFS - RAS

MWAWFS - RAS

VSA – schema browser

30/03/2015

MWAWFS - RAS30/03/2015

Coverage Maps

30/03/2015 MWAWFS - RAS

Archive Listing

30/03/2015 MWAWFS - RAS

Get Image

30/03/2015 MWAWFS - RAS

Cross ID

30/03/2015 MWAWFS - RAS

Survey table parameters

Input file:Novae from Strobe et al. 2010

Suggested formats

Use crossID match file in queries with vvvVariability to get variability stats for VVV light-curves of 16 sources

93 Novae, find 16 good matches to vvvSource.

Freeform SQL Examples• Selecting transients • Viewing light curves• Using X-match tables• Using user generated tables– MAR enhancements

• Use COUNT_BIG(*) – necessary for tables with > 2G rows– e.g. vvvDetection, vvvTilePawprints,

vvvSourceXDetectionBestMatch– vhsDetection, gpsDetection

30/03/2015 MWAWFS - RAS

MWAWFS - RAS

Provenance and data links.• All the data is linked to its antecedants and to the curation processes • Image Provenance:

– Tile –> Stack –> Normal. – DeepTile –> DeepStack –> Stack –> Normal

• Catalogue Provenance– vvvSource –> vvvDetection –> MultiframeDetector -> Multiframe– vvvVariability –> vvvSourceXDetectionBestMatch –> vvvDetection …

• vvvDetection (tiles) -> vvvTilePawprints -> vvvDetection (pawprints)• RequiredTile –> ProgrammeFrame -> Multiframe• vvvSource -> vvvSourceXwise_allskysc -> WISE..wise_allskysc• SchemaBrowser is useful – primary and foreign key constraints.

– Papers discuss data model design, and show ERMs connecting different tables.

30/03/2015

Selecting transients

30/03/2015 MWAWFS - RAS

Use variability stats to select sources with point sources with mag>2 with >=6 epochs, 13<Ks<18 in cleaner pointings. Get mean, ampl, nEpochs, colours.

Load results into TOPCAT

(H-Ks) vs Ks for ~20000 transients

Light curves

30/03/2015 MWAWFS - RAS

Light curve params

Join tables

Variability parameter selection as temporary table

MWAWFS - RAS

X-matching

• Neighbour tables include all matches out to a joinCriterion (see RequiredNeighbours)

• Simple Options:– Nearest match only (out to a particular radius)– All matches in a radius

• SchemaBrowser lists available neighbour tables, e.g. vvvSourceXDR4gpsSource

30/03/2015

X-matching

30/03/2015 MWAWFS - RAS

wise_allskysc in separate DB, WISE, need prefix “WISE..”

Enhanced Queries

30/03/2015 MWAWFS - RAS

Use CrossID form

Output to VO table/FITS file

Load up table of matches as #userTable – used as a standard table

MWAWFS - RAS

3D Extinction Maps

30/03/2015

Function to get nearest pixelFast CROSS APPLYSOON v.fast matched table

Filter extinction coefficients

Select extinction at 8.5kpc

Select certain variables within 1<l<2.5, -0.5<b<1

30th March 2015 MW Astrophysics from WF Surveys 18

Galactic Plane and Bulge from VISTA and WFCAM

VVV + GPS mosaic ~ 1 billion starshttp://djer.roe.ac.uk/vsa/vvv/iipmooviewer-2.0-beta/lb.html

Useful for finding nebulae / clustersProduce team only ones for VMC.

Not completely automated yet.

MWAWFS - RAS

Suggestions• Understand DB design – see main papers:– Hambly et al. (2008), Cross et al. (2009, 2012)– How the data are linked (ERM diagrams).

• Use the schema browser to understand attributes, and SQL cookbook if new.

• Freeform-SQL and TOPCAT is very powerful.• Ask us at• Range of technical and scientific support.

[email protected]

30/03/2015