The story of sharing environmental data - Metla · Environmental Information System, which consists of various subsystems including information on, among other things, monitoring

The story of sharing environmental data

Kallio, Pyhälahti, Harju, Teiniranta, Lahtinen, Finnish Environment Institute SYKE

OKFestival , Finnish Open Data, 18. Sep 2012

● Call for environmental knowledge ● Who are we ? ● GIS / EO / data sharing history ● Data policy and sharing advantages ● User statistics ● Metadata portal ● General user interface for the EO datasets ● EO products and services ● The development of EO / GIS solutions ● Algorithm and software development with open source tools

2

Contents

Call for environmental knowledge is increasing

1983

National Board of Waters

1995

SYKE

1986

National Board of Waters and the Environment

Ministry of the Environment

Increasing environmental

awareness

Decade of water protection

From water protection to environmental protection

Interdisciplinarity, internationalisation

Global challenges

Climate change mitigation • Green economy • Sustainable use of natural resources • Biodiversity •

Ecosystem services • Baltic Sea •

1970

Finnish Environment Institute Data and Information Centre Geoinformatics

5

Data sharing progress at the Environmental Administration

Oldest observations from 1800s on Tornio river ice melt !

Sharing principles and advantages

6

● SYKE was one of the first govermental institutes having free data policy

● SYKE has a very open data policy ○ all datasets can be used free-of-charge by anyone ○ also commercial use is allowed

● Through network self services no fees are charged ● Sensitive data is filtered from open datasets (like personal

data, detailed location of threatened species, …) Benefits of sharing ● Better environmental decisions ● Transparency ● Research and development projects rise when the data is

available for free ● No duplicate work ● Data validated by users

7

32 INSPIRE themes in national

GIS portal, which offers a possibility to

browse dozens of map levels, produced by

different organizations, on different themes

www.paikkatietoikkuna.fi/web/en/

Data sharing required according to the EU INSPIRE directive standards

INSPIRE directive aims to create a European Union (EU) spatial data infrastructure. This will enable the sharing of environmental spatial information among public sector organisations and better facilitate public access to spatial information across Europe.

SYKE – Spatial Datasets

● Over 100 datasets covering the whole of Finland ● A lot of data from other producers in our GI-

system

I Protected sites: Natura2000 sites, Nationally designated sites I Hydrography: River network, Lake database, River basins and catchments

II Geology: Groundwater II Elevation: Bathymetry II Land Cover: Corine2000, National Corine2000

III Land Use:Land Use plans, Land Use Regulations plans Environmental monitoring facilities Area management/restriction/regulation zones and reporting units Natural risk zones, Sea regions, Bio-geographical regions, Habitats and biotopes, Species distribution

Annex I

Annex II Annex III

● Environmental Information System, which consists of various subsystems including information on, among other things, monitoring of water quantity and quality, environmental protection, biological diversity, land use and environmental loading.

● Map interface for viewing the data (gis + observations)

● Use via wms-interfaces ● File download system ● Data download for certain areas

(municipal, rectangle..) via map winodw?

● (WMS, download and regional download GIS services)

29.1

1.20

13

9

Direct access to environmental data systems through OIVA www.ymparisto.fi/oiva

● The user shall have a non-exclusive, non-transferrable license to use the material

● The source of material must be mentioned in connection with the presentation of a report or other material, including service name and date when downloaded from the service

● Copyright and ownership to the material shall remain with the Finland’s environmental administration

● OIVA is for registered users at the moment, registration removed in the near future

● WMS services available with no authentication

29.1

1.20

13

10

Terms of use in OIVA service

Statistics on environmental data download

11

>30 downloadable GIS datasets GIS software is needed to use the datasets

Themes of data download

12

LifeData project 2011-2015 Opening research data for multiple use in the organizations of the project represent LYNET, Finnish Partnership for Research on Natural Resources and the Environment

•Finnish Forest Research Institute Metla •Finnish Environment Institute SYKE •Finnish Game and Fisheries Research Institute RKTL •Agrofood Research MTT

To be opened in the internet 2012. Content: •Spatial data •Services •EO products •Environmental information systems •Research data Not only spatial data, even the ISO standard 19115 is followed

13

Metadata portal

Delivery solutions for the EO datasets

14

● Calendar search ● Near Real Time products ● Time series and seasonal averages ● Map services for individual projects ● Tests to deliver EO products in the MMEA project Snow

Covered Area and Snow Water Equivalent WCS services ● View service for operative RS is planned to be built during

2013 from datasets in WMS interfaces

● Mapping and monitoring of land cover ● Fractional snow cover monitoring using Earth observation

data

The environmental variables monitored with remote sensing

15

Water •Sea Surface Temparature •Algal Blooms in the Baltic Sea •Water quality in lakes and coastal waters •Turbidity •Chlorophyll-a •Oil spill detection

18 20 22 24 26 28 30 32 34 36 38-10

0

10

20

30

40

50

60

70

80

Week number

Chl

orop

hyll

a co

ncen

tratio

n ( µ

g/l)

Mean and std chlorophyll a concentration from weekly mean composites from Hankoniemi

Mean EO chl-aMean insitu chl-a

New approach to operational data processing: Saukko

16

Saukko processing system concept (Saukko, Lutra Lutra; otter in Finnish) •Version control system extension for creating operatively available data processing software from scientific and expert-defined models

•Scientific development of models is a continuous relatively uncontrollable process •Scientists are typically not software engineers – why should they? •Think of DevOps…

•Processing framework for controlled on-demand & scheduled distributed processing chains

•Processing phases in different servers, service provider systems, organisations

Saukko is being developed in EU Life+ project GisBloom: To be released in open source (EUPL) in full scale during 2013

29.1

1.20

13

Scientific software encapsulated or embedded in standardized part of a generic processing chain

Assisting data processing using inter-connected models in routine work

29.1

1.20

13

Processor

29.1

1.20

13

Processor: Optimized version of model for

operative processing in pipe

20

Data sharing progress at the Environmental

” We have the skills, ambition and courage to open new avenues for improving the environment.”

www.environment.fi/syke

Thanks!