Stefano Nativi 1 Co-authors Paolo Mazzetti 1 , Valerio Angelini 1 Marco Verlato 2 , Mirco Mazzucato 2 CYCLOPS: an EGEE SSA Implementation of Geosciences services on Grid platform for GMES applications 1 CNR - IMAA 2 INFN
Stefano Nativi 1 Co-authors Paolo Mazzetti 1, Valerio Angelini 1 Marco Verlato 2, Mirco Mazzucato 2 CYCLOPS: an EGEE SSA Implementation of Geosciences.
Mar 27, 2015
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Stefano Nativi1
Co-authorsPaolo Mazzetti1, Valerio Angelini1
Marco Verlato2, Mirco Mazzucato2
CYCLOPS: an EGEE SSAImplementation of Geosciences services on Grid platform for GMES applications
1 CNR - IMAA 2 INFN
Outline
CYCLOPS Overview– Rationale– Objectives– Main Activities
Architectural Framework Spatial Data Infrastructure Services
implementation
CYber-Infrastructure for CiviL protection Operative ProcedureS (CYCLOPS)
Specific Support Action of EGEE Duration: 24 months (01/06/2006 – 31/05/2008) Web site: www.cyclops-project.eu Contact persons:
– [email protected] (Project Manager)– [email protected] (Technical Manager)
Keywords: GMES, GRID, Geospatial information, Civil Protection
Collaborations with: – PREVIEW, Risk EOS, RISK-AWARE, BOSS4GMES,
EGEE, DEGREE
Participants
Civil Protection Agencies– CP-CH (Civil Protection of Chania Prefecture)– DDSC (Direction de la Défense et de la Sécurité Civiles)– DPC (Dipartimento della Protezione Civile)– SNBPC (Serviço Nacional de Bombeiros e Protecção
Civil)
Scientific/Technological partners– EMA (Ecole des Mines d' Ales )– IMAA-CNR (Istituto di Metodologie per l’Analisi
Ambientale del Consiglio Nazionale delle Ricerche)– INFN (Istituto Nazionale di Fisica Nucleare)– TEI-CR (Technological Educational Institute of Crete)
Rationale
Civil Protection and GMES applications/systems have specific requirements:
– to access infrastructure, run models and search information in a real-time (RT) or near-real-time (NRT) way
privileging time of response instead of accuracy – to control sensors networks and acquisition systems and
modify their acquisition strategy and processing chain– to share geospatial information that has complex
characteristics: Huge amounts of remotely-sensed observations, which are
multidimensional and frequently updated– To formalise the knowledge required to analyse data and
provide decision-makers with effective information – To implement the strict data policy and the security
requirements typical of dual systems (civil/military);
Why to use Grid Platform for GMES applications?
1. Provide physical resources to support application workloads
a. Provide the computational power for working out simulation
tasks or tasks for critical missions (see job management)
b. Provide near real time access to data resources (see data
management)
2. Virtual Organization management
a. Grid information system
b. Resource cataloguing and sharing
3. Provide a security infrastructure
4. Provide a quality of service agreement & monitoring
infrastructure
5. Provide an infrastructure to distribute VO policy
management on its nodes
Objective & Research Strategies
Conceive a complete Grid-based platform supporting Civil Protection/GMES applications
– The CYCLOPS platform Many open issues must be addressed
– Integration & Interoperability (with EGEE platform) Implement Spatial Data Infrastructures (SDI) services in the
EGEE platform Integrate sensor networks and acquisition systems in the
EGEE platform– Define specific services for GMES/CP applications
Define advanced services (knowledge-based services, Quality-of-Service management, etc.)
Define Data Policy and Security services Define generic Business Logic, Presentation and Fruition
services
CYCLOPS Main Activities
Definition of research and innovation strategies– Analysis of CP systems– EGEE Request for Enhancements– Research strategies for enabling CP applications on Grid
infrastructure– Guidelines for CP innovation towards the adoption of
Grid technologies
Cross-dissemination between GRID (EGEE) community and GMES (Civil Protection) community.
– Seminars, workshops, tutorials directed to CP personnel– Reports to EGEE Working Groups
Standardization Communities
GRID community– test and validate, the middleware re-engineered by
EGEE and EGEE-2 in compliance with the current open standards (GGF, OMII Europe)
Geospatial Information community– INSPIRE (The INfrastructure for SPatial InfoRmation in
Europe )– GEOSS (Global Earth Observation System of Systems)– OGC/ISO (Open Geospatial Consortium)
Risk and Crisis Management Sensor Web Enablement Earth Observation OWS: WCS, WFS, CS/W, CTS, WPS, …
Civil Protection community– GMES (Global Monitoring for Environment and Security)
Selected use case:Flood Forecast
Involves heavily meteorology and hydrological modelling
Involves many sensors (floods gauges, rain radars, meteo sats)
Linked to GMES flash flood anticipation service
Selected use case : Large forest fire propagation
Propagation models used on the field are simplistic due to computational limitations
More sophisticated models require heavy computations, large number of field and meteo parameters
French research project PAREFEU, link with GMES service PREVIEW
After Sero-Guillaume et al.
Communities Interoperability
GMES & CP Communities
Geospatial Community
GRID Community
StrategicApplicationsStrategic
Applications
GeospatialInformation
services
GeospatialInformation
services
ResourcesProvision
ResourcesProvision
Semantic Level
Spatial Data Infrastructure tiers
WFS
WCS
WMS
Access and
Download servicesDiscovery services
based on
ISO 19115 profiles
CS-W WMS
Thematic
Portals
Viewservices
Viewservices
Presentation
servicesResources
Processing S
ervicesP
rocessing Services
CYCLOPS Platform
CYCLOPS Infrastructure
Spatial Data Infrastructure Services
CYCLOPS Architectural Framework
Processing Systems Infrastructure
Data Systems
GRID Platform (EGEE)
Se
curit
y In
fra
stru
ctu
re
Real Time and Near Real Time Applications for Civil Protection
(Data integration, high-performance computing and distributed environment for simulations)
Real Time and Near Real Time Applications for Civil Protection
(Data integration, high-performance computing and distributed environment for simulations)
Inte
rop
era
bili
ty P
latf
orm
Sensor Element Services
Advanced Grid Services
Business logic Services
Presentation and Fruition Services
En
viro
nm
en
tal M
on
itorin
gR
eso
urc
e I
nfr
ast
ruct
ure
Geospatial Resources Services
Implementing OWS on the top ofa Grid Platform
Web over Grid Grid-enabling OWS
– Build OWS implementations which make use of Grid capabilities
Grid over Web Gridifying OWS
– Expose OWS as Grid computational elements (CE) which run native calls to external WS
Grid-enabling OWS
netCDF
HDF
GRIB
Others...
..
SE CE
OWS implementation Software(published via GRIS)
SRM interface Resource
Broker/ WM proxy
From OWS request to
JDL
Portal/ submission tool
on Grid User
Interface
DLS (Data Location Service)
based on LFC
Geospatial Information
GRID platform
--- SE
Host File Block
Dataset File
Coverage/Layer/Map ---
Log
ica
l Ag
gre
ga
tion
Lev
el
Host name LFN for a file block
netCDF
HDF GRIB
Grid-enabling OWS
Data Aggregation levels (semantic levels)
Grid-enabling OWS:OWS function Vs. Grid job
(OWS Server)Service Provider
Service Consumer
Service Register
1. OWS server URL2. OWS.function request 3. OWS.function response document
1. OWS server URL LFN for file block
2. OWS.function request Grid job fora. CEs publishing the required software tag;
b. CEs close to the SEs containing a LFN replica
3. OWS.function response document URL to get job
status & job output document
netCDF
HDF GRIB
Grid-enabling WCS
A prototype of Grid-enabled WCS on top of EGEE Platform
Implementation of basic WCS functionalities like subsetting, resampling and interpolation using GRID capabilities
Expected advantages:– Grid support of file replicas– Use of mobile code instead of mobile data– High performances working on large datasets– Scalability
Traditional WCS
WCS interface
DataSubsettingSubsetting
ResamplingResampling
DataData EncodingEncoding
Request Response
GRID WCS
WCS interface
DataSubsettingSubsetting
ResamplingResampling
DataData EncodingEncoding
EGEE Grid Interface
Request
CE
Async. response
SE SE
EGEE Grid Interface
CE
EGEE Grid Interface
CE
EGEE Grid Interface
Workload Manager
S
SR R RD
R
R
R D
WCS Interface
Result
Result URL
GRID WCS : Technologies
EGEE Grid Interface
CE
SE SE
EGEE Grid Interface
CE
EGEE Grid Interface
CE
EGEE Grid Interface
Workload Manager
WCS Interface
WEB
Application Layer(Java)
EGEE GRID
Computing Layer(Java)
RequestAsync. response
Result
HTTP/SOAPHTTP/SOAP
S
R
R
R D
JDLJDL
Java
Ser
ializ
atio
nJa
va S
eria
lizat
ion
SR R RD
Gridifying OWS
Run application software which calls OWS external services– Implement a Grid application which makes
use of OWS service chaining– Possible use of all Grid job types: collection,
DAGs, Parametrics, MPI, etc.
Minimal case: Run an existing OWS function as a Grid job
netCDF
HDF GRIB+ + Grid Job
Gridifying OWS
SE CE Resource Broker/ WM
proxy
WSDL
netCDF HDF GRIB Others...
Native call
OWSOWS
OWS
Virtualize Sensors Two approaches:
– A new Grid sensor element Instrument Element (like GridCC?)
– Make use of OGC Sensor Web Enablement services
CYCLOPS Infrastructure
Spatial Data Infrastructure Services
Processing Systems Infrastructure
Data Systems
GRID Platform (EGEE)
Sensor Element Services
Advanced Grid Services
En
viro
nm
en
tal M
on
itorin
gR
eso
urc
e I
nfr
ast
ruct
ure
Geospatial Resources Services
Related Documents
