Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006.

Budapest 2006

Grid Activities inGrid Activities inUkraineUkraine

Nataliya Kussul

Space Research Institute

NASU-NSAU, Ukraine

WGISS 21, Budapest 2006

Budapest 2006

Main issues:Main issues:

• Infrastructure– Hardware resources– Technologies

• Applications– Numerical Weather Prediction– Meteosat Data Processing Services

• Cloud Mask• Cloud Motion• Fractal Feature Extraction

• Current State of Grid

• Projects involved

• Prospects

Budapest 2006

Current InfrastructureCurrent Infrastructure

Budapest 2006

Hardware resourcesHardware resources

• Cluster SKIT-1– 24x2 Intel Xeon (2.6 GHz)– Infiniband interconnect

• Cluster SKIT-2– 32x2 Intel Itanium II (1.4 GHz)– SCI interconnect

• Development cluster– 2x2 AMD Opteron (2.2 GHz)– Gigabit Ethernet interconnect

Budapest 2006

Hardware resourcesHardware resources

• LustreFS NAS: 14TB storage• iSCSI SAN: 2TB storage• Gigabit Ethernet inter-cluster connection• A number of UNIX-based workstations• Condor pool of MS Windows workstations

Budapest 2006

SKIT-1 SKIT-2 Development cluster

Budapest 2006

Cluster load reportsCluster load reports

WRF model load profile

Budapest 2006

TechnologiesTechnologies

• Globus Toolkit v4 – Grid middleware

• Karajan – workflow description language

• UNM MapServer – OGC-compliant software for geospatial data presentation

• Torque – local cluster scheduler

• OpenMPI & Scaly – MPI standard implementations

• Ganglia – monitoring tool

• Ruby – scripting language

Budapest 2006

ApplicationsApplications

• Meteosat cloud mask extraction• Cloud motion estimation• Fractal features extraction• Numerical Weather Prediction (WRF model)

Budapest 2006

WRF run subsystem (1)WRF run subsystem (1)

• Configured for territory of Ukraine• Input & boundary condition from GFS• 3 day forecasts every 6 hours• 10 km horizontal grid, 200x200 gridpoints• 31 vertical levels• One run takes 3.5 hours on 2x2 Opteron

system

Budapest 2006

WRF run subsystem (2)WRF run subsystem (2)

Budapest 2006

WRF run subsystem (2)WRF run subsystem (2)

Budapest 2006

WRF visualizationWRF visualization• UMN MapServer based• Available at http://cosmogis.org.ua/?option=com_wrf

Budapest 2006

Meteosat visualizationMeteosat visualization• UMN MapServer based• Available at http://cosmogis.org.ua/?option=com_mapserver

Budapest 2006

Cloud motion estimationCloud motion estimation

– useful as the source data for Numerical Weather Prediction models

– temporary interpolation/extrapolation of image sequences for now casting

– based on adapted optical flow techniques

Budapest 2006

Fractal features extraction

– Based on modeling of Meteosat images by Generalized Brownian Motion processes

– Useful for detecting turbulent areas

Budapest 2006

Current stateCurrent state

• At the moment Grid middleware is being deployed on SKITs frontend node.

• SKITs are using proprietary local scheduler

• An adapter between Globus GRAM and scheduler should be developed

Budapest 2006

Projects involved (1)Projects involved (1)

• “Cosmogis” project supported by Ukrainan National Space Agency

• STCU project “Grid technologies for environmental monitoring using satellite data” (started on December, 2005)

• Innovative project of National Academy of Science of Ukraine ”Development of pilot project of Ukrainian GEOSS/GMES segment” (2006)

Budapest 2006

Projects involved (2)Projects involved (2)

• INTAS-CNES-NSAU call – Project “Data Fusion Grid Infrastructure” is

under preparation -

Practical way to initiate cooperative activity of agencies on Grid creation

• We are looking for partners!

Budapest 2006

Plans: TechnologyPlans: Technology

• To develop Grid-enabled archive for geospatial data based on OGSA-DAI

• To establish data assimilation of MSG and ATOVS data into modeling process

• To use Grid infrastructure to perform a model automatic adaptation experiment

• To work out patterns for inter-domain security policy

Budapest 2006

Plans: organizationalPlans: organizational

• To connect to European academic network GEANT

• To connect to Ukrainian academic network URAN

• To become a regional center of GEOSS/GMES

• To participate in the development of WAG• To include Ukrainian databases into ECHO

system

Budapest 2006

Thank you!