Top Banner
Flysafe infrastructure Flysafe Final Presentation | 29 May 2009
15

SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

Aug 01, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

Flysafe infrastructure

Flysafe Final Presentation | 29 May 2009

Page 2: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

Flysafe Final Presentation | 29 May 2009

Scope

Networking, processing and storage infrastructure

Continuous data absorption from various sensors

Timely processing and ingestion of content

Well-defined data model per sensor

Distribution of all data types via single access point

Flexible DataBase for ad hoc data exploration/analysis

Flexible Visualisation tools for data exploration/analysis

Flexible User management and permissions interface

Page 3: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

Flysafe Final Presentation | 29 May 2009

Access control

Push or pull mechanism

Encryption

File integrity

Storage and backup

File arrival trigger

Bookkeeping

network & storage

Page 4: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

bookkeeping interface

Flysafe Final Presentation | 29 May 2009

Page 5: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

processing

Flysafe Final Presentation | 29 May 2009

File arrival trigger

File import libraryRobin formatGRIBHDF5(others)

Data model definitionsTailored for flysafeOne for each sensor type

ProcessingTranslation to data modelCalculation of direct results and quality parameters

Storage of direct results

Database insertion

Page 6: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

distribution

Flysafe Final Presentation | 29 May 2009

Operational product spin-off

Current products generated:Hourly migration modelSpatial distribution model

Product upload to webserver

Access for researchDatabase queriesSpatial selectionsTemporal selectionsModel development

Access controlSpecified per userSpecified per sensorProtected by user passwordRestricted by IP address

User management interface

Page 7: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

user administration interface

Flysafe Final Presentation | 29 May 2009

Page 8: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

current Flysafe services

Two identical systems in high-availability failover configuration

Rack-based systems that meet SARA standards for project servers

Daily dual backup to SARA tape libraries in Amsterdam and Almere

Database volume currently almost 300 Gigabytes

Database volume expected to grow to 500 Gigabytes in 2012

Flysafe Final Presentation | 29 May 2009

Page 9: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

visualisation (production)

Flysafe Final Presentation | 29 May 2009

Page 10: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

visualisation (production)

Flysafe Final Presentation | 29 May 2009

Page 11: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

visualisation (for analysis)

Flysafe Final Presentation | 29 May 2009

Page 12: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

visualisation (for analysis)

Flysafe Final Presentation | 29 May 2009

Page 13: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

visualisation (for analysis)

Flysafe Final Presentation | 29 May 2009

Page 14: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

Virtual Lab for Bird Migration Modeling

Flysafe Final Presentation | 29 May 2009

Collaborative working environment to support:model development and improvement(re-)analysis of combined data setssustained product improvement

Page 15: SARA Flysafe Final Presentation 290509 Current Services (SARA).pdfFlysafe Final Presentation |29 May 2009 Scope Networking, processing and storage infrastructure Continuous data absorption

Infrastructure -- Summary

Flysafe Final Presentation | 29 May 2009

Detailed design

Networking & storage

Processing

Tailored data models

Database distribution

User management

Visualisation

Collaborative environment