PIONIER 2003, Poznan, 11.04.2003, PROGRESS Grid Access Environment for SUN Computing Cluster Poznań Supercomputing and Networking Center Cezary Mazurek.

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESSGrid Access Environment for SUN Grid Access Environment for SUN

Computing ClusterComputing Cluster

Poznań Supercomputing and Networking CenterPoznań Supercomputing and Networking Center

Cezary MazurekCezary Mazurek

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Duration: December 2001 – May 2003 Deployment: June 2003-December 2003 Project Partners

SUN Microsystems PolandPSNC IBCh PoznańCyfronet AMM, KrakówTechnical University Łódź

Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Project is testbed oriented Three bioX applications will be enabled within

the grid-portal architectureTwo of them are already available

Distributed cluster of SF6800 is a pilot testbed installationDedicated channels through PIONIER network (1 Gb/s)

will come in the 3Q2003 Tools and services for grid processing and data

management in PROGRESS grid-portal framework

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS ArchitectureArchitecture

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Pilot installation Poznan-Krakow3 SUN Fire 6800

• Poznań: SUN Fire Link

2 Data ServersFront-end for portal access

Distributed processing in distributed framework

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS - ApplicationsPROGRESS - Applications

DNA Assembly BranchBound1 DNA Assembly Heuristic2 DNA Assembly Heuristic3 Prediction of protein secondary structure - module A1 Prediction of protein secondary structure - module A2 Prediction of protein secondary structure - module B Prediction of protein secondary structure - module C Prediction of protein secondary structure - module D

Logical workflow applications:• LAD – learning: A1->B->C• LAD – testing: A2->D

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS HPC WindowPROGRESS HPC Window

GRID user interfaces are independent of the information processing layer bioX computational portalMigrating Desktop application

PROGRESS computational portalAccessing applications collected in the application

factoryForming and running jobs Accessing data stored in the Data Management SystemProviding information services

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Content P

rovider

Webservice

Session B

ean

Entity B

eans

SOAP

SOAP/XML

ComputingPortal

GRID Service Provider

Content ProviderData presentationUser interaction

Service ProviderRealization of

services functionsServices data storage

and access

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

4 – tier architecture for grid-portal environment

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS CommunicationCommunication

SGESGE

HTTP/HTTPSHTTP/HTTPS

DataManagement

GLOBUSGLOBUS

Po

rtal

GridBroker

CORBA

Web

serv

ice

FTP

HTTP/HTTPS

Service Provider

Grid F

TP

Webservice

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS Service ProviderPROGRESS Service Provider

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS Grid BrokerPROGRESS Grid Broker

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS Grid brokerPROGRESS Grid broker

Grid Broker in Progress:Job submission, monitoring and controllingDifferent scheduling and resource

management strategiesFlexible job description language (XRSL)Heterogeneous and service based

environment

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS Data Management SystemData Management System

INTERNET

DBFile System

Data Broker

Data Storage

Mirror & Proxy

Data Storage Data Storage

MetadataManagement

SRS

UniTree

WS

GASSFTPGrid FTP(...)

Clients

PortalPortal

Grid brokerGrid broker

Migrating desktop

Migrating desktop

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESSData Management SystemData Management System

Provides seamless access to data and information for grid computing

Uses metadata repository for describing stored data

Stores data on various media such as files, tapes and databases

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS SecurityPROGRESS Security

Intrusion Detection and Security Management SystemReliable and dynamic information sourcesPossibility to automatically react to detected

attacksPossibility to apply different analysis methodsModular architecture

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

PROGRESS at Supercomputing 2002, Baltimore, USAPROGRESS at Supercomputing 2002, Baltimore, USA

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESSPortalPortal

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – job listPROGRESS – job list

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – job menuPROGRESS – job menu

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – job tasksPROGRESS – job tasks

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – task requirementsPROGRESS – task requirements

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – data managementPROGRESS – data management

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – application PROGRESS – application factoryfactory

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS - newsPROGRESS - news

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

ConclusionsThe PROGRESS project has provided some

components and services for flexible grid-portal environment, which might be deployed in other projects and environments

PROGRESS team has been working on additional functionality for Solaris OS in the area of checkpointing and security

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS

http://progress.psnc.pl/

http://progress.psnc.pl/portal

[email protected]