Top Banner
Data Hub Alpha Presentation & Demonstration Christopher Kraft Viderum NextGEOSS Summit, Helsinki at FMI
21

Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Aug 17, 2021

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Data Hub AlphaPresentation & Demonstration

Christopher KraftViderum

NextGEOSS Summit, Helsinki at FMI

Page 2: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Table of Contents

1. Data Hub

2. Achievements

3. Data Hub Presentation/Demo

4. Development until Open Beta

5. Q&A (hopefully...)

Page 3: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Data Hub1

Page 4: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Data Hub - Introduction

Why?

§ Encourage innovation and business

§ Add value to existing infrastructure

§ Geo data needs to be accessible

Page 5: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Data Hub - Introduction

How?

§ Cloud technology

§ Using open source technology for the Data Hub (CKAN)

§ Making data more accessible

§ Building on recent EuroGEOSSwork

§ User oriented approach

Page 6: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

• Using CKAN for the NextGEOSS

data hub

• CKAN development started over

10 years ago

• CKAN specialized to make data

discoverable

• PLUS: Has many features

specially for geospatial data

• Very strong API

• Many updates available

(version 2.7 is coming!)

• Open Source technology

• Active CKAN community

• Proven technology used by

many

Data Hub - CKAN

Page 7: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data
Page 8: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

• Covering some important

regarding Data Hub

• Requirements come from many

different directions

• Ongoing process

• Important: Speaking about

requirements of the hub, not of

NextGEOSS globally

• Multi faceted search

capabilities

• Common information model

• Measure quality of service

• Big spectrum of data

• No stored data on the data hub

• Join the EuroGEOSS ecosystem

• Easy UI

Data Hub – Key Requirements

Page 9: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

• Big spectrum of data

• No stored data on the data hub

• Join the EuroGEOSS ecosystem

• Easy UI

Data Hub – Key Requirements

Page 10: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

• CIM = Common Information

Model

• Finding a way to catalogue the

data is needed

• CIM seems to be a good

approach

This means:

• Using basic information

available for every dataset

• Setup the schema in CKAN

after this model

• Dublin Core as orientation

• Original schema will stay

attached

Data Hub – CIM

Page 11: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

• Only meta data is available on

the data hub

• Real data is linked from the

harvested source

• Original meta data schema gets

interpreted

• As second steps gets

transformed into CIM

Data Hub – Data

• Download will be done through

data providers

• Important to make it clear,

where data is coming from

Page 12: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Data Hub – Harvester

§ CKAN has a strong harvesting engine

§ Improving harvester during the project

§ Created a standardised workflow for this approach

§ Harvester is checking sources for new or updated data regularly

Page 13: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Achievements

Time to shine!

2

Page 14: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Achievements

1. Showable and useable data hub Alpha version

Page 15: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Achievements

2. Integrated design

Page 16: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Achievements

3. First data available (Sentinel)

Page 17: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Data Hub DemonstrationThe presented version is a restricted alpha version and still under development.

Press here to access the portal

3

Page 18: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Development until Open Beta4

Page 19: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Development until Open Beta

• Finish design integration

• Integrate more data sources

• Deploy data hub on NextGEOSS cloud

• Integrate Single Sign-on

• Integrate user feedback tool

• Quality of Service tool

Page 20: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Development until Open Beta

• Extending search capabilities

• Data validation

• Secure high download speed

• Integrate Geo Dab

Page 21: Data Hub Alpha Presentation & Demonstrationnextgeoss.eu/.../uploads/NextGEOSS-Summit-Data-Hub-Pres.pdfNextGEOSSSummit, Helsinki at FMI Table of Contents 1.Data Hub 2.Achievements 3.Data

Thank you!

Q & A