DSD-INT 2014 - OpenGIS Workshop - OpenGIS Services, Fedor Baart

OpenGIS Ser-OpenGIS Ser-vicesvices

@ Delft Software Days 2014

OpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

1 of 148 04/11/14 10:29


2 of 148 04/11/14 10:29

Fedor Baart

[email protected]


3 of 148 04/11/14 10:29


4 of 148 04/11/14 10:29

AgendaAgenda09:00 - 09:15 Introduction, Fedor Baart09:15 - 10:30 PostGIS and Qgis, Frank Keppel10:30 - 11:00 !

11:00 - 12:30 Gridded data, Giorgio Santinelli12:30 - 14:00 "

14:00 - 15:30 Visualizing with KML, Kees den Heijer15:30 - 16:00 !

16:00 - 17:30 Services, Fedor Baart17:30 - 18:30 #


5 of 148 04/11/14 10:29


6 of 148 04/11/14 10:29

HistoryHistoryOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

7 of 148 04/11/14 10:29


8 of 148 04/11/14 10:29

Open Source GISOpen Source GIS1980 Lagrid @ Westervelt

1983 Proj4 @ Evenden

1983 GRASS GIS @ CERL

1994 www

1994 Open Geospatial Consortium


9 of 148 04/11/14 10:29


10 of 148 04/11/14 10:29

First mapFirst map

1993 @ Xerox


11 of 148 04/11/14 10:29


12 of 148 04/11/14 10:29

MapserverMapserver

1994 @ NASA/ForNet (open source since 1999)


13 of 148 04/11/14 10:29


14 of 148 04/11/14 10:29

First processFirst process

1995 @ Berkeley


15 of 148 04/11/14 10:29


16 of 148 04/11/14 10:29

Location based services: rout-Location based services: rout-inging

1996 @ Mapquest & Multimap


17 of 148 04/11/14 10:29


18 of 148 04/11/14 10:29

Spatial queryingSpatial querying

2000 @ Geoserver


19 of 148 04/11/14 10:29


20 of 148 04/11/14 10:29

NASA World WindNASA World Wind

2003 @ NASA


21 of 148 04/11/14 10:29


22 of 148 04/11/14 10:29

OpenStreetMapOpenStreetMap

2004 @ Steve Coast


23 of 148 04/11/14 10:29


24 of 148 04/11/14 10:29

OpenStreetMapOpenStreetMap2004 @ Steve Coast


25 of 148 04/11/14 10:29


26 of 148 04/11/14 10:29

StylingStyling

2005 @ Mapnik


27 of 148 04/11/14 10:29


28 of 148 04/11/14 10:29

Google MapsGoogle Maps

2005 @ Google


29 of 148 04/11/14 10:29


30 of 148 04/11/14 10:29

TilecacheTilecache

src: renderfast.com

2006 @ Metacarta


31 of 148 04/11/14 10:29


32 of 148 04/11/14 10:29

StreetviewStreetview

2007 @ Google


33 of 148 04/11/14 10:29


34 of 148 04/11/14 10:29

SensorsSensors

2007 @ OGC


35 of 148 04/11/14 10:29


36 of 148 04/11/14 10:29

INSPIREINSPIRE

2007 @ EU


37 of 148 04/11/14 10:29


38 of 148 04/11/14 10:29

StylesheetsStylesheets

2008 @ Mapnik & Tilemill


39 of 148 04/11/14 10:29


40 of 148 04/11/14 10:29

Model as a serviceModel as a service

2010 @ ESMF (Saint)


41 of 148 04/11/14 10:29


42 of 148 04/11/14 10:29

Earth EngineEarth Engine

2010 @ Google


43 of 148 04/11/14 10:29


44 of 148 04/11/14 10:29

Vectors and 3DVectors and 3Dtransitions

2011 @ W3


45 of 148 04/11/14 10:29


46 of 148 04/11/14 10:29

Vectors and 3DVectors and 3D

2011 @ W3


47 of 148 04/11/14 10:29


48 of 148 04/11/14 10:29

AnimationsAnimations

2011 @ W3


49 of 148 04/11/14 10:29


50 of 148 04/11/14 10:29

AnimationsAnimations

2011 @ W3


51 of 148 04/11/14 10:29


52 of 148 04/11/14 10:29

Map Content ManagementMap Content Management

2011 @ CartoDB


53 of 148 04/11/14 10:29


54 of 148 04/11/14 10:29

Interactive modelsInteractive models

2014 @ 3Di


55 of 148 04/11/14 10:29


56 of 148 04/11/14 10:29

OpenEarth stackOpenEarth stackOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

57 of 148 04/11/14 10:29

2013 @ TUDOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

58 of 148 04/11/14 10:29

FutureFutureSensorsPush/MessagesGlobal processingModel setup


59 of 148 04/11/14 10:29


60 of 148 04/11/14 10:29

OGC ServiceOGC ServiceOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

61 of 148 04/11/14 10:29


62 of 148 04/11/14 10:29

Web Map ServicesWeb Map ServicesGet map in bitmap formGet information for 1 locationCustom bounding boxMap rendered by server on requestQuery by time and elevationCoordinate transformation


63 of 148 04/11/14 10:29


64 of 148 04/11/14 10:29

GetCapabilitiesGetCapabilities<wms_capabilities> <service> <title>OpenEarth test server</title> <maxwidth>2048</maxwidth> </service> <capability> <request> <getmap> <format>image/png</format> <dcptype><http><get><onlineresource xlink:type="simple" xlink:href </getmap> </request> <layer> <crs>EPSG:4326</crs> <title>daily averaged meteo parameter.</title> </layer> </capability></wms_capabilities>


65 of 148 04/11/14 10:29


66 of 148 04/11/14 10:29

ImplementationsImplementationsGeoserverMapserverncWMSADAGUC


67 of 148 04/11/14 10:29


68 of 148 04/11/14 10:29

GetMapGetMaphttp://geoport.whoi.edu/thredds/wms/bathy/srtm30plus_v6?

service=WMS&

request=GetMap&

layers=topo&

version=1.3.0&

CRS=epsg:4326&

bbox=50,0,55,10&

width=256&height=256&

styles=&

format=image/png


69 of 148 04/11/14 10:29


70 of 148 04/11/14 10:29

ExampleExamplehttp://geoport.whoi.edu/thredds/wms/bathy/srtm30plus_v6


71 of 148 04/11/14 10:29


72 of 148 04/11/14 10:29

ExtensionsExtensionsCOLORSCALERANGELOGSCALE


73 of 148 04/11/14 10:29


74 of 148 04/11/14 10:29

WMTSWMTSOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

75 of 148 04/11/14 10:29


76 of 148 04/11/14 10:29

UTFGridUTFGridOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

77 of 148 04/11/14 10:29


78 of 148 04/11/14 10:29

ChallengesChallengesVideo

Streaming

Voxels


79 of 148 04/11/14 10:29


80 of 148 04/11/14 10:29

VectorVectorOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

81 of 148 04/11/14 10:29


82 of 148 04/11/14 10:29

Everything is a featureEverything is a featureOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

83 of 148 04/11/14 10:29


84 of 148 04/11/14 10:29

The question "What is a feature?" leads directlyto a philosophical rabbit hole which deposits theunwary questioner in a wonderland from which

it is difficult to return.

Nordgren, 2006


85 of 148 04/11/14 10:29


86 of 148 04/11/14 10:29

Web Feature ServiceWeb Feature ServiceGet list of featuresGet table with feature infoCustom bounding boxNot renderedCoordinate transformation


87 of 148 04/11/14 10:29


88 of 148 04/11/14 10:29

GetFeatureGetFeaturehttp://geo.vliz.be/geoserver/wfs?

request=GetFeature&

service=wfs&

typeName=World:worldcities&

bbox=51,2,55,5&


89 of 148 04/11/14 10:29


90 of 148 04/11/14 10:29

CoveragesCoveragesFeature that acts as a function to return valuesfrom its range for any direct position within its

spatiotemporal domain

a grid


91 of 148 04/11/14 10:29


92 of 148 04/11/14 10:29

Web Coverage ServiceWeb Coverage ServiceGet a grid fileCustom bounding boxNot renderedCoordinate transformation


93 of 148 04/11/14 10:29


94 of 148 04/11/14 10:29

GetCoverageGetCoveragehttp://geoport.whoi.edu/thredds/wcs/bathy/srtm30plus_v6?

request=GetCoverage

&version=1.0.0

&service=WCS

&format=geotiff

&coverage=topo

&BBOX=0,50,10,55


95 of 148 04/11/14 10:29


96 of 148 04/11/14 10:29

OPeNDAP vs WCSOPeNDAP vs WCSarray or spatial?

10.1111/j.1467-9671.2012.01312.x


97 of 148 04/11/14 10:29


98 of 148 04/11/14 10:29

Other servicesOther servicesSensor Observation ServiceOpen Model InterfaceCatalogue Service for the WebOPeNDAP


99 of 148 04/11/14 10:29


100 of 148 04/11/14 10:29

Client librariesClient librariesOGR/GDAL (C,python,R)OWSLib (python)geotools (java)


101 of 148 04/11/14 10:29


102 of 148 04/11/14 10:29

Client softwareClient softwareQGis (desktop)uDig (desktop)Leaflet (web)OpenLayers (web)


103 of 148 04/11/14 10:29


104 of 148 04/11/14 10:29

Web ProcessingWeb ProcessingServicesServices


105 of 148 04/11/14 10:29


106 of 148 04/11/14 10:29

ProcessesProcessesCall a functionDefine input variables/filesDefine output variables/filesCustom bounding boxCan be rendered or notStart processChain processes


107 of 148 04/11/14 10:29


108 of 148 04/11/14 10:29

Typical examplesTypical examplesSpatial operationsConversionsProcess @ dataSimple modelsFacade to complex models


109 of 148 04/11/14 10:29


110 of 148 04/11/14 10:29

OperationsOperationsGetCapabilitiesDescribeProcessExecute


111 of 148 04/11/14 10:29


112 of 148 04/11/14 10:29

Tide ExampleTide ExampleOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

113 of 148 04/11/14 10:29


114 of 148 04/11/14 10:29

OSU Tidal constituentsOSU Tidal constituentsOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

115 of 148 04/11/14 10:29


116 of 148 04/11/14 10:29

Tidal predictTidal predictOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

117 of 148 04/11/14 10:29


118 of 148 04/11/14 10:29

GetCapabilitiesGetCapabilities <wps:capabilities service="WPS" version="1.0.0"> <ows:serviceidentification> <ows:title>OpenEarth WPS server</ows:title> <ows:accessconstraints>none</ows:accessconstraints> </ows:serviceidentification> <ows:serviceprovider> <ows:providername>Deltares</ows:providername> </ows:serviceprovider> <wps:processofferings> <wps:process wps:processversion="0.1"> <ows:identifier>tidal_predict</ows:identifier> <ows:title>Tidal prediction tool</ows:title> </wps:process> </wps:processofferings></wps:capabilities>


119 of 148 04/11/14 10:29


120 of 148 04/11/14 10:29

DescribeProcessDescribeProcess <wps:processdescriptions service="WPS" version="1.0.0" xml:lang="en-CA"> <processdescription> <ows:identifier>tidal_predict</ows:identifier> <ows:title>Tidal prediction tool</ows:title> <datainputs> ...<identifier>startdate</identifier>... </datainputs> <processoutputs> <output> <ows:identifier>tide</ows:identifier> <ows:title>Calculated water level for requested locations and date</ows:title> <complexoutput> ...<mimetype>text/csv</mimetype>... </complexoutput> </output> </processoutputs> </processdescription></wps:processdescriptions>


121 of 148 04/11/14 10:29


122 of 148 04/11/14 10:29

Input/OutputInput/OutputTitle/AbstractDescriptionUnitDefaultMin/max occurance

TypesTypesLiteral (string, number)Bounding BoxComplex (raster, vector)


123 of 148 04/11/14 10:29


124 of 148 04/11/14 10:29

ExecuteExecute <wps:executeresponse><wps:process wps:processversion="0.1"> <ows:identifier>tidal_predict</ows:identifier> <wps:status creationtime="2014-11-02T19:50:39Z"> <wps:processsucceeded>PyWPS Process tidal_predict successfully calculated</ </wps:status> <wps:processoutputs> <wps:output> <ows:title>Calculated water level for requested locations and date</ows:title <wps:data> <wps:complexdata mimetype="text/csv">date,h,lat,lon2014-11-02 19:50:37,0.3735264572229592,3.0,52.0 </wps:complexdata> </wps:data> </wps:output> </wps:processoutputs></wps:process></wps:executeresponse>


125 of 148 04/11/14 10:29


126 of 148 04/11/14 10:29

Server ImplementationsServer ImplementationsZooPyWPSGeoserver52North


127 of 148 04/11/14 10:29


128 of 148 04/11/14 10:29

Tools and languagesTools and languagesJTSGRASSOrfeoSextantepython, R, java


129 of 148 04/11/14 10:29


130 of 148 04/11/14 10:29

Implementing a processImplementing a processclass Process(WPSProcess): def __init__(self): WPSProcess.__init__(self, "tidal_predict", title="Tidal prediction tool") def execute(self): """execute a tidal prediction""" date = self.date.getValue() location = self.location.getValue() df = openearthtools.physics.tide.predict(location, date=date) self.tide.setValue(df.to_json())


131 of 148 04/11/14 10:29


132 of 148 04/11/14 10:29

Client ImplementationsClient ImplementationsOpenLayersOWSLibGeotools (unsupported)


133 of 148 04/11/14 10:29


134 of 148 04/11/14 10:29

Client ExampleClient Example // OpenLayers exampleclient = new OpenLayers.WPSClient({ servers: { opengeo: 'http://demo.opengeo.org/geoserver/wps' }}); intersect = client.getProcess('opengeo', 'JTS:intersection'); intersect.configure({ inputs: { a: features, b: geometry }, success: function(outputs) { map.baseLayer.addFeatures(outputs.result); }});


135 of 148 04/11/14 10:29


136 of 148 04/11/14 10:29

Setting up a serverSetting up a serverGet OSX/linux computer with VirtualBox1. Install ansible2. Install vagrant3. Download OpenEarth stack @ github4. $ vagrant up wps5.


137 of 148 04/11/14 10:29


138 of 148 04/11/14 10:29

Missing featuresMissing featuresStop a processRESTSpatial types (everything is complex)Layout hints/classesVariable relationsPush/notifications


139 of 148 04/11/14 10:29


140 of 148 04/11/14 10:29

Planned in WPS 2Planned in WPS 2Fall of 2014?

Pause,Resume,DismissREST?


141 of 148 04/11/14 10:29


142 of 148 04/11/14 10:29

ExcercisesExcercisesOpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

143 of 148 04/11/14 10:29


144 of 148 04/11/14 10:29

WMS + WFSWMS + WFSwfs/wms client

WPSWPSwps client


145 of 148 04/11/14 10:29


146 of 148 04/11/14 10:29

##OpenEarth http://siggyf.github.io/presentations/gis2014/?print-pdf#/

147 of 148 04/11/14 10:29


148 of 148 04/11/14 10:29

DSD-INT 2014 - OpenGIS Workshop - OpenGIS Services, Fedor Baart

Science

openearth http

nasafornet open source

fedor baart09

fedor baart17

open source gis1980

steve coast23

steve coast25

evenden1983 grass gis