VO access to Gaia DR1 - WebHome < IVOA < TWikiwiki.ivoa.net/.../InteropOct2016Apps/Apps2-TBoch-VO-access-GaiaDR… · VO access to Gaia DR1: TAP ... 5. IVOA Interop - Trieste 2016

VOaccesstoGaiaDR1:TAP,ConeSearch,COOSYSandHiPS

ThomasBoch,onbehalfoftheCDSteamTriesteInterop,Apps2

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1

• ReleasedSeptember14th2016

• Content

• gaia_source:positionandflux(Gband) for1billionsources

• TGAS:position,flux,propermotionsandparallax for2millionsources

• lightcurvesforRRLyraeandCepheid

• QSOs

2

IVOA Interop - Trieste 2016 - Apps II

Whodistributesthedata?

3

Officialarchive GaiaarchiveatESAC VOTable TAP SAMP

Partnerdatacenters

AIP VOTable SAMP

ARI VOTable TAP CS SAMP

ASDC VOTable

CDS VOTable TAP CS SAMP

Externaldatacenters

IRSA VOTable TAP CS

GAVO VOTable TAP

IVOA Interop - Trieste 2016 - Apps II

Whodistributesthedata?

3

Officialarchive GaiaarchiveatESAC VOTable TAP SAMP

Partnerdatacenters

AIP VOTable SAMP

ARI VOTable TAP CS SAMP

ASDC VOTable

CDS VOTable TAP CS SAMP

Externaldatacenters

IRSA VOTable TAP CS

GAVO VOTable TAP

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS

• VizieR

• TAPVizieR

• Cross-matchservice

• Aladin

• HiPScatalogue

http://cds.unistra.fr/gaia

4

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieR

• VizieRwebinterface

• Querybyposition +constraintsonfields

• ConeSearchinterface

• Lightcurvesvisualization

5

3+ million querieslast month

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieRTAP

• GaiaDR1tablesavailableinTAPVizieR

• UserscanqueryGaiatablesandcomplement/jointhemwithanyavailableVizieRtable(notablyHipparcos,Tycho,largesurveyslike2MASS,SDSS,etc)

• Webinterface:http://tapvizier.u-strasbg.fr/adql/

• TAPendpoint:http://tapvizier.u-strasbg.fr/TAPVizieR/tap/

6

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieRTAP

• GaiaDR1tablesavailableinTAPVizieR

• UserscanqueryGaiatablesandcomplement/jointhemwithanyavailableVizieRtable(notablyHipparcos,Tycho,largesurveyslike2MASS,SDSS,etc)

• Webinterface:http://tapvizier.u-strasbg.fr/adql/

• TAPendpoint:http://tapvizier.u-strasbg.fr/TAPVizieR/tap/

6

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:VizieRTAP

• GaiaDR1tablesavailableinTAPVizieR

• UserscanqueryGaiatablesandcomplement/jointhemwithanyavailableVizieRtable(notablyHipparcos,Tycho,largesurveyslike2MASS,SDSS,etc)

• Webinterface:http://tapvizier.u-strasbg.fr/adql/

• TAPendpoint:http://tapvizier.u-strasbg.fr/TAPVizieR/tap/

6

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:xmatchservice

• Fastpositionalcross-identificationofGaiasourceswithanyVizieRtablewithposition (oruser-uploadedtable)

• Webinterface:http://cdsxmatch.u-strasbg.fr/xmatch

• HTTPAPI

• astroquery

• Topcat

7

Stats: 130M positions submitted from 200+ different IPs

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:Aladin

• DedicatedformtoaccessGaiadatainAladinDesktop

• Visualizationofpropermotions

8

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:Aladin

• DedicatedformtoaccessGaiadatainAladinDesktop

• Visualizationofpropermotions

8

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:Aladin

• DedicatedformtoaccessGaiadatainAladinDesktop

• Visualizationofpropermotions

8

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:HiPScatalogue

• HiPSprogressivecataloguebuiltfromGaiadatahttp://cds.unistra.fr/Gaia/DR1/AL-visualisation.gml

9

IVOA Interop - Trieste 2016 - Apps II

GaiaDR1atCDS:HiPScatalogue

• HiPSprogressivecataloguebuiltfromGaiadatahttp://cds.unistra.fr/Gaia/DR1/AL-visualisation.gml

9

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaiadata:thegood,thebad,theugly

10

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:thegood

• Dataavailablethroughnumerousservices

• Servicesdoworkfine

• SamecolumnnamesinallTAPservices

• user-friendly

• allowsforeasyre-launchofthesamequeryondifferentservices

11

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:theugly

12

• PoormetadatadescribingoutputFIELDs

• noUCD

• nounit

• non-standardnon-parseableunits

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:theugly

12

unit="Angle[deg]"

unit="Time[Julian Years]"

• PoormetadatadescribingoutputFIELDs

• noUCD

• nounit

• non-standardnon-parseableunits

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:theugly

• Unitparser/validator:http://www.astro.gla.ac.uk/users/norman/ivoa/unity/

• UCDtools:http://cds.unistra.fr/UCD/tools.htx

12

unit="Angle[deg]"

unit="Time[Julian Years]"

• PoormetadatadescribingoutputFIELDs

• noUCD

• nounit

• non-standardnon-parseableunits

IVOA Interop - Trieste 2016 - Apps II

VOaccesstoGaia:thebad

• (Lackof)definitionofcoordinatesysteminVOTableoutput

• examples

• nodescriptionatall

• inaccuratedescription

• accuratedescription

13

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

Coordinate system?

IVOA Interop - Trieste 2016 - Apps II

Nodescription

14

Coordinate system?

Epoch?

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

IVOA Interop - Trieste 2016 - Apps II

Inaccuratedescription

15

But Gaia positions are in ICRS!

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

IVOA Interop - Trieste 2016 - Apps II

Accuratedescription

16

Based on Referencing STC in VOTable note v2.0

IVOA Interop - Trieste 2016 - Apps II

Howtoimprovedescriptionofcoordinates?

• InBanff(nov2014):

• only1serviceprovider(outof20tested)wasdescribingcoordinatesaccordingtotheReferencingSTCinVOTablenote

• only1clientwasparsingthedescriptionasexpected

• suggestiontoun-deprecateCOOSYSasatemporarysolutiontoincreasenumberofservicesandclientssupportingcoordinatesdescription/parsing

• COOSYSnotenough,can’tdescribeeverything(eg:differentepochforeachsource)

• Howshallwegoon?

17