Top Banner
VO access to Gaia DR1: TAP, Cone Search, COOSYS and HiPS Thomas Boch, on behalf of the CDS team Trieste Interop, Apps2
45

VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

Feb 01, 2018

Download

Documents

vutram
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

VOaccesstoGaiaDR1:TAP,ConeSearch,COOSYSandHiPS

ThomasBoch,onbehalfoftheCDSteamTriesteInterop,Apps2

Page 2: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1

• ReleasedSeptember14th2016

• Content

• gaia_source:positionandflux(Gband) for1billionsources

• TGAS:position,flux,propermotionsandparallax for2millionsources

• lightcurvesforRRLyraeandCepheid

• QSOs

2

Page 3: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Whodistributesthedata?

3

Officialarchive GaiaarchiveatESAC VOTable TAP SAMP

Partnerdatacenters

AIP VOTable SAMP

ARI VOTable TAP CS SAMP

ASDC VOTable

CDS VOTable TAP CS SAMP

Externaldatacenters

IRSA VOTable TAP CS

GAVO VOTable TAP

Page 4: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Whodistributesthedata?

3

Officialarchive GaiaarchiveatESAC VOTable TAP SAMP

Partnerdatacenters

AIP VOTable SAMP

ARI VOTable TAP CS SAMP

ASDC VOTable

CDS VOTable TAP CS SAMP

Externaldatacenters

IRSA VOTable TAP CS

GAVO VOTable TAP

Page 5: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS

• VizieR

• TAPVizieR

• Cross-matchservice

• Aladin

• HiPScatalogue

http://cds.unistra.fr/gaia

4

Page 6: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

Page 7: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

Page 8: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

Page 9: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

Page 10: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

Page 11: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

3+ million querieslast month

Page 12: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieRTAP

• GaiaDR1tablesavailableinTAPVizieR

• UserscanqueryGaiatablesandcomplement/jointhemwithanyavailableVizieRtable(notablyHipparcos,Tycho,largesurveyslike2MASS,SDSS,etc)

• Webinterface:http://tapvizier.u-strasbg.fr/adql/

• TAPendpoint:http://tapvizier.u-strasbg.fr/TAPVizieR/tap/

6

Page 13: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieRTAP

• GaiaDR1tablesavailableinTAPVizieR

• UserscanqueryGaiatablesandcomplement/jointhemwithanyavailableVizieRtable(notablyHipparcos,Tycho,largesurveyslike2MASS,SDSS,etc)

• Webinterface:http://tapvizier.u-strasbg.fr/adql/

• TAPendpoint:http://tapvizier.u-strasbg.fr/TAPVizieR/tap/

6

Page 14: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieRTAP

• GaiaDR1tablesavailableinTAPVizieR

• UserscanqueryGaiatablesandcomplement/jointhemwithanyavailableVizieRtable(notablyHipparcos,Tycho,largesurveyslike2MASS,SDSS,etc)

• Webinterface:http://tapvizier.u-strasbg.fr/adql/

• TAPendpoint:http://tapvizier.u-strasbg.fr/TAPVizieR/tap/

6

Page 15: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

Page 16: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

Page 17: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

Page 18: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

Stats: 130M positions submitted from 200+ different IPs

Page 19: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:Aladin

• DedicatedformtoaccessGaiadatainAladinDesktop

• Visualizationofpropermotions

8

Page 20: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:Aladin

• DedicatedformtoaccessGaiadatainAladinDesktop

• Visualizationofpropermotions

8

Page 21: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:Aladin

• DedicatedformtoaccessGaiadatainAladinDesktop

• Visualizationofpropermotions

8

Page 22: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:HiPScatalogue

• HiPSprogressivecataloguebuiltfromGaiadatahttp://cds.unistra.fr/Gaia/DR1/AL-visualisation.gml

9

Page 23: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:HiPScatalogue

• HiPSprogressivecataloguebuiltfromGaiadatahttp://cds.unistra.fr/Gaia/DR1/AL-visualisation.gml

9

Page 24: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaiadata:thegood,thebad,theugly

10

Page 25: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:thegood

• Dataavailablethroughnumerousservices

• Servicesdoworkfine

• SamecolumnnamesinallTAPservices

• user-friendly

• allowsforeasyre-launchofthesamequeryondifferentservices

11

Page 26: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:theugly

12

• PoormetadatadescribingoutputFIELDs

• noUCD

• nounit

• non-standardnon-parseableunits

Page 27: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:theugly

12

unit="Angle[deg]"

unit="Time[Julian Years]"

• PoormetadatadescribingoutputFIELDs

• noUCD

• nounit

• non-standardnon-parseableunits

Page 28: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:theugly

• Unitparser/validator:http://www.astro.gla.ac.uk/users/norman/ivoa/unity/

• UCDtools:http://cds.unistra.fr/UCD/tools.htx

12

unit="Angle[deg]"

unit="Time[Julian Years]"

• PoormetadatadescribingoutputFIELDs

• noUCD

• nounit

• non-standardnon-parseableunits

Page 29: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:thebad

• (Lackof)definitionofcoordinatesysteminVOTableoutput

• examples

• nodescriptionatall

• inaccuratedescription

• accuratedescription

13

Page 30: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

Page 31: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

Page 32: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

Coordinate system?

Page 33: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

Coordinate system?

Epoch?

Page 34: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

Page 35: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

Page 36: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

Page 37: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

Page 38: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

Page 39: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

But Gaia positions are in ICRS!

Page 40: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

Page 41: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

Page 42: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

Page 43: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

Page 44: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

Based on Referencing STC in VOTable note v2.0

Page 45: VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

IVOA Interop - Trieste 2016 - Apps II

Howtoimprovedescriptionofcoordinates?

• InBanff(nov2014):

• only1serviceprovider(outof20tested)wasdescribingcoordinatesaccordingtotheReferencingSTCinVOTablenote

• only1clientwasparsingthedescriptionasexpected

• suggestiontoun-deprecateCOOSYSasatemporarysolutiontoincreasenumberofservicesandclientssupportingcoordinatesdescription/parsing

• COOSYSnotenough,can’tdescribeeverything(eg:differentepochforeachsource)

• Howshallwegoon?

17