Implementing INSPIRE Download Services

Demonstrating how to Implement INSPIRE Download Services

Debbie Wilson

Sunday 24th June – 16:00

Beylerbeyi Hall 1

Workshop Objectives• Provide overview of requirements of INSPIRE Download

Service Technical Guidance v3.0 (12th June 2012)• http://inspire.jrc.ec.europa.eu/documents/Network_Services/Technical_Guid

ance_Download_Services_3.0.pdf

• Practical Demonstration how to create and publish EEA Natura 2000 data (reported 2009) via each option:– ATOM Feed for pre-defined datasets– WFS for pre-defined datasets– WFS for pre-defined datasets and spatial objects (features)

http://inspire.jrc.ec.europa.eu/documents/Network_Services/Technical_Guidance_Download_Services_3.0.pdf

http://inspire.jrc.ec.europa.eu/documents/Network_Services/Technical_Guidance_Download_Services_3.0.pdf

INSPIRE Download ServicesTechnical Guidance

What is an INSPIRE Download Service? “mechanism by which users can access the information contained

within the spatial data set related to an Annex theme”

…enabling copies of spatial data sets, or parts of such sets, to be downloaded and, where practicable, accessed directly (INSPIRE Directive)

Types of INSPIRE Download Service1. Pre-Defined Download Service

– One or more files representing either the full dataset or subsets

– These files are accessed via a file or data repository (e.g. FTP)

– Downloaded in their entirety and the content cannot be changed (i.e. encoding, CRS)

2. Direct Access Download Service– Users define a set of request criteria that subsets the data to return only the

features needed:

• Select all data within a bounding box

• Select only feature type x and y

• Select feature by identifier

• Select all features that are valid between T1 and T2 within and area of interest

Non-Interoperable vs Interoperable Download Services1. Non-Interoperable : Provide access to your data as you provide it today

2. Interoperable : Data provided conforms to relevant INSPIRE data specification(s)

Deadline for Implementation

Annex I & II: 28th Dec 2012Annex III: 3rd Dec 2013

Technical Requirements

Implementing Rule and Technical Guidance

Legal Requirements for Download Services

Operation Type of Download Service

Get Download Service Metadata All

Get Spatial Dataset All

Describe Spatial Dataset All

Link Download Service All

Get Spatial Object* Direct Access

Describe Spatial Object Type Direct Access

• Get Spatial Object operation should support the following request criteria:

• Unique Resource Identifier

• CRS

• Filter expressions: logical, comparison, spatial (bbox), temporal

Mandatory Operations:

Legal Requirements for Download ServicesQuality of Service requirements:

QoS Operation Requirement

Performance Get Download Service Metadata

Initial response ≤ 10 seconds

Get Spatial Data Set/Get Spatial Object(BBOX request)

Initial response ≤ 30 seconds Then sustained response > 0.5 Mb/s or > 500 objects/sec.

Describe Spatial Data Set/Describe Spatial Object

Initial response ≤ 10 seconds Then sustained response > 0.5 Mb/s or > 500 objects/sec.

Capacity > 10 simultaneous requests per second. The number of requests processed in parallel may be limited to 50.

Availability Shall be available 99 % of the time.

Options for INSPIRE Download Services• 3 options for implementing INSPIRE Download Services*:

1. ATOM Feed providing access to pre-defined datasets

2. OGC WFS 2.0 serving pre-defined datasets

3. OGC WFS 2.0 serving features (Direct Access)

Conformance Class Obligation

1. Atom Feed C (M, if WFS (Predefined) is not

conformed to)

2. Pre-defined WFS C (M, if Atom Feed is not

conformed to)

3. Direct access WFS O

4. Quality of Service M

* Additional service types (e.g. OGC WCS/SOS) will be added once Annex II & III themes published

Demonstration:Implementing Interoperable INSPIRE Download Services

Scenario• Publish Natura 2000 data reported to EEA in 2009

• Data transformed into INSPIRE Annex I – Protected Sites Full Application Schema

• Demonstrate full process for implementing INSPIRE Download Service

Oracle XE

Publishing data via INSPIRE Download Services

Step 1

•Configure INSPIRE Download Service:•Define

chunking scheme for generating pre-defined datasets, if applicable (e.g. Country)

•Update schema transformation mapping

•Capabilities metadata

•Output format/deployment

Step 2

•Create INSPIRE ISO metadata:•Upda

te dataset metadata and create series metadata

•Create service metadata

Step 3

•Deploy Download Service and associated metadata

Step 4

•Publish metadata into INSPIRE Discovery Service


Step 1


chunking scheme for generating pre-defined datasets, if applicable (e.g. Country)




Step 2

•Create INSPIRE ISO metadata:•Up

date dataset metadata and create service metadata

Step 3

•Deploy Download Service and associated metadata

Step 4



Step 1


chunking scheme for generating pre-defined datasets, if applicable (e.g country)




Step 2



Step 3

•Deploy INSPIRE Download Service and associated resources

Step 4



Step 1


chunking scheme for generating pre-defined datasets, if applicable (e.g Country)




Step 2



Step 3

•Deploy INSPIRE Download Service and associated resources

Step 4


Schema Transformation

GO Publisher Desktop GO Publisher Agent GO Publisher WFS

Legacy Database Schema or

INSPIRE Database Schema

Metadata Dataset

describes

ATOM Feed

Dataset Feature

Direct Access WFS

Pre-defined WFS

Data & metadata

ATOM Feed

GO Publisher


GO Publisher Desktop



Metadata Dataset

describes

ATOM Feed

GO Publisher


GO Publisher Desktop GO Publisher Agent



Metadata Dataset

describes

ATOM Feed

Data & metadata

ATOM Feed

GO Publisher


GO Publisher Desktop GO Publisher Agent GO Publisher WFS



Metadata Dataset

describes

ATOM Feed

Dataset Feature

Direct Access WFS

Pre-defined WFS

Data & metadata

ATOM Feed

GO Publisher

Demo 1: ATOM Feeds

ATOM Feeds

• XML based web content and metadata syndication format

• Application-level protocol for publishing and editing web resources belonging to periodically updated websites

• ATOM feeds push links to updated content to subscribed users

• Removes need for user to repeatedly return to source to check for updates

• Minimal implementation cost and complexity

Feed readers• To subscribe to ATOM Feeds you will need either:

1. Web Browser (e.g. Firefox, Opera, IE, Safari, Chrome)• Automatically check for feeds when you visit a website• Add feeds as a browser favourite or bookmark folder, automatically

updating them with the latest content

2. Web-based feed reader (e.g. Google Reader, Hootsuite)• User subscribes to feeds• Displays any new content as they are added

3. Desktop feed reader• Typically integrated into email (e.g. MS Outlook)• Displays any new content as they are added

Content of an ATOM Feed• An ATOM feed contains:

1. Descriptive metadata describing the feed itself

2. One or more entries that describes the content (i.e. pre-defined dataset)

INSPIRE Requirements for ATOM Feeds

Elements required to describe the feedBasic Descriptive Metadata:

Title ID Author

Links to related metadata and resources:

Update Rights(Top feed)

Subtitle GeoRSS polygon(Dataset Feed)

Spatial object description(Dataset Feed)

OpenSearch Description (Top Feed)

INSPIRE ISO Metadata

Service(Top Feed)

Dataset(Top Feed)

Self Referencing Link

Optional link to alternate representations of feed

(language, format)

Elements required to describe the feedBasic Descriptive Metadata:

Title ID Author

Links to related metadata and content:

Update Rights(Top feed)

Subtitle GeoRSS polygon(Dataset Feed)

Spatial object description(Dataset Feed)

OpenSearch Description (Top Feed)

INSPIRE ISO Metadata

Service(Top Feed)

Dataset(Top Feed)

Self Referencing Link

Optional link to alternate representations of feed

(language, format)

Each link requires the following attributes:

• @href: URL of resource

• @rel: relationship of resource

• @type: mime type

• @title: title use to describe linked resource (optional)

• @hreflang: language used in resource (optional)

Example: Top Level Download Service Feed

Example: Dataset Feed

Elements required to describe entries

Title ID

Author

Update

RightsSubtitleGeoRSS polygon

Category (CRS)(Dataset Feed)

Link(s) to Content

URL for Dataset Feed(Top Feed)

URL for Dataset(Dataset Feed)

Example: Entry in Top Level Feed

Example: Entry in Dataset Feed

Demo 1: ATOM Feeds

Workflow for Atom Feed INSPIRE Download Service

Publish Pre-defined Datasets

CRS: ETRS89

CRS: WGS84

Create ISO19139 Metadata (Data & Service)

Create ATOM feed(incl Open Search)

Demo 1: ATOM Feeds

Validating Metadata

Subscribing to Download Service feeds

Demo 2: Pre-defined and Direct Access WFS

OGC Web Feature Service• Web Feature Service is a much more sophisticated web

service for downloading and directly access data online• Supports the ability for users to retrieve only the data

they are interested in • An OGC Web Feature Service provides access to

features (aka INSPIRE spatial objects) not datasets.

OGC WFS must support Get Spatial Dataset operation

Must support Get DataSet By ID Stored Query

Optional support for ad hoc queries for user-defined queries

Conformance Classes for OGC WFS• INSPIRE Pre-Defined WFS Conformance Class :

– Implement ISO 19142 ‘Simple WFS’– Implement HTTP Get– Implement GetDatasetByID Stored Query– Implement INSPIRE Extended Capabilities

• Optionally support INSPIRE Direct Access Conformance Class:– Implement ISO 19142 ‘Basic WFS’– Separate endpoint shall be established for each INSPIRE dataset


Workflow for WFS INSPIRE Download Service

Configure mapping

Configure GetCapabilities

Create ISO19139 Service metadata

Generate WFS

Deploy WFSCreate Stored

QueryTest

Configuring the WFS• It’s really easy to configure the WFS to serve individual

features• Much more of a challenge to get the WFS to serve pre-

defined datasets• What should be the payload of response to the pre-

defined dataset Stored Query within WFS?• Protected Sites? Or• INSPIRE SpatialDataSet?

Awaiting clarification as no guidance in TG

Configuration OptionsOption 1: Set up the WFS as a Pre-Defined Download

Service only• Update mapping to publish Protected Sites contained within the

INSPIRE SpatialDataset

Pro’s Con’s

• Easy to set up • Cannot retrieve individual features

• GetCapabilities feature list contains on SpatialDatasets

Configuration OptionsOption 2: Configure WFS to serve both datasets and

features (Pre-defined & Direct Access WFS)• Protected Sites are configured as individual features• INSPIRE SpatialDataSet contains pre-defined set of Protected

Sites (via Xlink not inline)

Pro’s Con’s

• Supports ability to request both individual features and pre-defined datasets

• SpatialDataSet contains a list of identifiers to the individual features

• This list must be resolved in the response

• WFS should support resolve• Resolve should be a default parameter in

the GetDataSetByID stored query

Configuration OptionsOption 3: Configure WFS to serve only features• Define GetDatasetByID Stored Query to retrieve pre-defined

subset of features based on common property such as country code or geographic extent

• By publishing each dataset as a separate endpoint ensure dataset id are unique for each dataset

Pro’s

• Supports ability to request both individual features and pre-defined datasets

• Easy to set up

• Doesn’t require any complex WFS request parameters


Conclusion• There are currently three options for INSPIRE Download

Services:– Pre-defined Atom Feeds– Pre-defined WFS– Pre-defined WFS (& Direct Access WFS)

• Deadlines are soon for implementing your INSPIRE Download Service(s):– Annex I & II: 28th Dec 2012 (6 mths)– Annex III: 3rd Dec 2013 (18 mths)

• Tools are available now that implement the INSPIRE Download Service Technical Guidance

Contact us:

Debbie Wilson [email protected]

Any Questions?

mailto:[email protected]

mailto:[email protected]

Implementing INSPIRE Download Services

Documents

predefined download

download service metadataall

download service1

publishing data

seconds metadata

iso metadata

update dataset metadata

predefined datasets