Feb 23, 2016
Interoperability at workGIS Workshop 17 June 2014
Jan Bliki [email protected]
MONITORING
DATA
INFORMATION
ASSESSMENT
REPORTING
waterNet soilNet airNet
soilBase
airBase
waterBase
measure & record
store & manage
analyse & understand
explain & communicate
national databases
ETC Topic Databases
European databases
EEA data warehouse
indicators
graphs & maps visualize & describe
The EEA framework to provide policy relevant information
(Source EEA, 1999)
ReportNet
Reporting activity for EEA priority dataflows(Source EEA, 1999)
• Number of envelopes: 17,073• Number of releases envelops: 16,230• Number of files: 214,511• Number of feedbacks: 54,546• 120-150 GB data per year
TN:Transport
networks
EL:Elevation
BU:Buildings
SO:Soil
PF:Production and industrial facilities
AF:Agricultural and aquaculture
facilities
ER:Energy Resources
HB:Habitats and biotopes
SD:Species distribution
AM:Area management/ restriction/ regulation zones & reporting units
PD: Population Distribution
US: Utilities and Governmental
Services (Waste Management)
Urban Planning
Waste Management Plans
Environmental Impact Assessment
Risk Management
…
PRTR
SEVESO
Waste
INSPIRE data Data from other sectors
Cross-sector data interoperability(EEA, 2014)
Social Media
Software as a Service (SaaS)Linked data
Web sites
TAB
XMLTXT
JSON
WMS
WFS REST
SQL
XLS
MDB
ATOM
HTML
SMTPKML
ZIP GML
INSPIREFTP
GDB
RDF
Internet of things(EEA, 2014)
Server constellation for GIS content (EEA, 2013)
HTTP
ArcGis ServerSQL Server
ArcGis online
Microsoft Azure
Active Batch
python
Rest-api’s, WMS, WFS, CSW (Web Services)
PLONE
DAVISMap applicationsArcGis online
Web mapsArcGis online
ReportNet
RDF
HTTP
http://maps.discomap.eea.europa.eu
http://www.eea.europa.eu http://cr.eionet.europa.eu/http://eea.maps.argis.com
http://discomap.eea.europa.eu
Geo-networks
http://sdi.eea.europa.eu
Automation of the entire process(EEA, 2014)
ArcGis Modal Builder
Microsoft SQL ServerPython Scripting
10,000+ lines of code400+ SQL procedures100+ Modals
Maintenance and complexity(EEA, 2014)
Effor
t (tim
e)
Ability
strategical experience
documented
not d
ocum
ente
d
obvious thingsVisual development tools
Scripting environments
EEA needed to search for graphical ETL toolsETL = Extract-Transform-Load
1. Visual Flow and Self-Documentation2. Can handle data clean-up3. Is robust4. Is obvious and easy to learn5. Customizable6. Strongly GIS oriented7. Multiple formats8. Supports INSPIRE formats9. Server oriented10. Is well integrated with EEA SDI Soft.
Our choice(EEA, 2014)
FME Server
FME Workbench (Desktop)
Server constellation for GIS content (Updated)
(EEA, 2014)
HTTP
ArcGis Server
FME Server
SQL Server
ArcGis online
Microsoft Azure
Active Batch
python
Rest-api’s, WMS, WFS, CSW (Web Services)
PLONE
DAVISMap applicationsArcGis online
Web mapsArcGis online
ReportNet
RDF
HTTP
http://maps.discomap.eea.europa.eu
http://www.eea.europa.eu http://cr.eionet.europa.eu/http://eea.maps.argis.com
http://discomap.eea.europa.eu
Geo-networks
http://sdi.eea.europa.eu
Results (march 2014 – may 2014)
Natura 2000 exports formats
Total development time : 5 working daysPrevious scripts : 24 working days for partial solutionMaintenace cost : Reduced to 80%
Example Natura 2000(march 2014 – may 2014)
Natura 2000 exports formats
Total development time : 5 working daysPrevious scripts : 24 working days for partial solutionMaintenace cost : Reduced to 80%
Example generic download option(march 2014 – may 2014)
Any web map must have a download
Total development time : 15 working daysReads: Map/Feature/Raster services (REST,WFS,CSW)Filters: Boundingbox, Attributes, Timeline, VisibleOuput: Shape, KML, GML, SQLLite
Example customization(march 2014 – may 2014)
EEA Specific formats integrated
• One time created, used many• Plug and play• Easy to use by none developers