Polish Infrastructure Polish Infrastructure for Supporting Computational Science for Supporting Computational Science in the European Research Space in the European Research Space EUROPEAN UNION PL-Grid: PL-Grid: National Grid Initiative in National Grid Initiative in Poland Poland Structure and Status Structure and Status Jacek Kitowski Jacek Kitowski Institute of Computer Science AGH-UST Institute of Computer Science AGH-UST ACK CYFRONET AGH ACK CYFRONET AGH in collaboration with in collaboration with PL-Grid Representatives PL-Grid Representatives HP-CAST Madrid, May 10-13, 2009 BigView BigView
30
Embed
PL-Grid : National Grid Initiative in Poland Structure and Status
PL-Grid : National Grid Initiative in Poland Structure and Status. BigView. Jacek Kitowski Institute of Computer Science AGH-UST ACK CYFRONET AGH in collaboration with PL-Grid Representatives. HP-CAST Madrid, May 10-13, 2009. Outline. PL-Grid Consortium - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
in the European Research Spacein the European Research Space
EUROPEAN UNION
PL-Grid:PL-Grid:National Grid Initiative in PolandNational Grid Initiative in Poland
Structure and StatusStructure and Status
Jacek KitowskiJacek KitowskiInstitute of Computer Science AGH-USTInstitute of Computer Science AGH-UST
ACK CYFRONET AGHACK CYFRONET AGH
in collaboration within collaboration withPL-Grid RepresentativesPL-Grid Representatives
HP-CAST
Madrid, May 10-13, 2009
BigViewBigView
PL-Grid Consortium Systematic approach establishing the Consortium and NGI Motivation Rationales Foundations International Collaboration
PL-Grid Project in a nutshell Status
PL-Grid Project Infrastructure Workpackages
Summary
OutlineOutline
MotivationMotivation E-Science approach to research Integration activities ongoing in the world
3
Need for e-Science ApproachNeed for e-Science Approach E-Science: collaborative research supported by advanced distributed computations
Multi-disciplinary, Multi-Site and Multi-National Building with and demanding advances in Computing/Computer Sciences
Goal: to enable better research in all disciplines System-level Science: beyond individual phenomena, components interact
and interrelate to generate, interpret
and analyse rich data resources• From experiments, observations
and simulations• Quality management, preservation
and reliable evidence to develop and explore models and simulations
• Computation and data at all scales• Trustworthy, economic, timely and relevant results
to enable dynamic distributed collaboration• Facilitating collaboration with information
and resource sharing• Security, trust, reliability, accountability, manageability and agility
M. Atkinson, e-Science (...), Grid2006 & 2-nd Int.Conf.e-Social Science 2006, National e-Science Centre UKI. Foster, System Level Science and System Level Models, Snowmass, August 1-2, 2007
Thanks to CYFRONET activity
five High Performance Computing Polish Centres analysed according to: Participation in International and National Projects and Collaboration Need by Polish Scientific Communities Computational resources to date European/Worldwide integration Activities National Network Infrastructure ready (thanks to Pionier National Project)
Porta Optica, RINGRid, Phosphorus, QoSCoSGrid, Intelligrid, K-WfGrid, Unicore...
Other Activities – Collaboration and DisseminationOther Activities – Collaboration and Dissemination EGI_DS – CYFRONET activity
Policy Board (deputy: M. Turala), NGI Observers -- „Polish Experts” (WP3, WP5) participation in Workshops, resulted in EGI_DS
draft deliverables, use-cases ... EGEE
From Cyfronet: chairing Resource Allocation Group in EGEE-III – trying to influence EGI• Group has a mandate to manage current process of resource allocation in EGEE and
propose better model for future• Operate CE ROC • More: https://twiki.cern.ch/twiki/bin/view/EGEE/RAG
EU Unit F3 „Research Infrastructure” Experts in Program Committee, nominated by the Polish Ministry of Science and High Education (since 2007) from CYFRONET
ENPG seminar in Cracow (2008) Others
CGW 2007 and 2008 Cyfronet Users’ Annual Conference (2008 and 2009) Cyfronet Open Day (2007, 2008) ICCS 2008 Conference
Other ActivitiesOther Activities
Computational Chemistry (VO) in EGEE Third CPU power consumer
• Nearly 3 million of jobs executed during 2007 Lead by Cyfronet since 2006
• Recently management of Computational Chemistry Cluster of Excellence In parallel current effort include:
• Grid ports of commercial and non commercial software packages with particular focus on their parallel version
• Development of “experiment centric” grid web portal for chemists
EGEE III / CE ROC
EGEE-IIIEGEE-III / CE ROC / CE ROC• CE ROC – coordinator: ACK CYFRONET-AGH
Motivation E-Science approach to research EGI initiative ongoing in collaboration with NGIs
Creation of Polish Grid (PL-Grid) Consortium: http://plgrid.pl Consortium Agreement signed in January 2007
PL-Grid Project (2009-2012) Application in Operational Programme Innovative Economy, Activity 2.3 (in Sept. 2008) Get funded March 2, 2009 (via European Structural Funds)
Consortium made up of five largest Polish supercomputing and networking centres (founders) ACK CYFRONET AGH (Cracow) – Coordinator
Polish Infrastructure for Supporting Computational Science in the European Research Space
Response to the needs of Polish scientists and ongoing Grid activities in Poland, other European countries and all over the world
• Academic Computer Center Cyfronet AGH (ACK CYFRONET AGH) Coordinator • Poznań Supercomputing and Networking Center (PCSS)• Wrocław Centre for Networking and Supercomputing (WCSS)• Academic Computer Center in Gdańsk (TASK)• Interdisciplinary Center for Math. and Computat. Modelling, • Warsaw University (ICM)
GEANT2GEANT2
Grid infrastructure (Grid services)PL-Grid
App
licat
ion
App
licat
ion
App
licat
ion
App
licat
ion
Clusters High Performance Computers Data repositories
National Computer NetworkPIONIER
DomainGrid
Advanced Service Platforms
DomainGrid
DomainGrid
DomainGrid
Assumptions Polish Grid is going to have a common base infrastructure – similar to solutions adopted in
other countries. Specialized, domain Grid systems – including services and tools focused on specific types of
applications – will be built upon this infrastructure. These domain Grid systems can be further developed and maintained in the framework of
separate projects. Such an approach should enable efficient use of available financial resources. Creation of a Grid infrastructure fully compatible and interoperable with European and World
Grids thanks to cooperation with teams involved in the development of European Grid systems (EGEE, DEISA, OMII, C-OMEGA, ESFRI).
Plans for HPC and Scalability Computing enabled.
PL-Grid InfrastructurePL-Grid Infrastructure
Users
Nationalcomputernetwork
Grid Application
Programming Interface
Virtual organizations and
security systems
Basic Grid services
Gridservices
LCG/gLite(EGEE)
UNICORE(DEISA)
OtherGrids
systems
Gridresource
s
Distributedcomputationa
l resources
Grid portals, development tools
Distributed data
repositories
The PL-Grid Project is split into several workpackages
Planned Realization of AimsPlanned Realization of Aims
Main Project Indicators: • Peak Perf.: 215 Tflops • Disk Storage: 2500 TB
ChallengesChallenges Short term
To start – establishing PL-Grid VO using Partners’ local and EGEE resources To provide resources for covering operational costs To select computational/storage resources for PL-Grid infrastructure
Long term – continously To provide the necessary infrastructure (!!)
• Computer rooms, electrical power, many organizational issues Be prepared / work on approaching paradigms and integration development
• HPC – Scalable Computing• Clouds (internal-external, computing clouds, data clouds)• SOA paradigm, knowledge usage …
in the European Research Spacein the European Research Space
EUROPEAN UNION
PL-Grid:PL-Grid:National Grid Initiative in PolandNational Grid Initiative in Poland
Structure and StatusStructure and Status
Jacek KitowskiJacek KitowskiInstitute of Computer Science AGH-USTInstitute of Computer Science AGH-UST
ACK CYFRONET AGHACK CYFRONET AGH
in collaboration within collaboration withPL-Grid RepresentativesPL-Grid Representatives
HP-CAST
Madrid, May 10-13, 2009
Technical IssuesTechnical Issues
Grid infrastructure (Grid services) PL-Grid
App
licat
ion
App
licat
ion
App
licat
ion
App
licat
ion
Clusters High Performance Computers Data repositories
National Computer Network PIONIER
DomainGrid
Advanced Service Platforms
DomainGrid
DomainGrid
DomainGrid
Assumptions Polish Grid is going to have a common base infrastructure – similar to solutions adopted in
other countries. Specialized, domain Grid systems – including services and tools focused on specific types of
applications – will be built upon this infrastructure. These domain Grid systems can be further developed and maintained in the framework of
separate projects. Such an approach should enable efficient use of available financial resources. Creation of a Grid infrastructure fully compatible and interoperable with European and World
Grids thanks to cooperation with teams involved in the development of European Grid systems (EGEE, DEISA, OMII, C-OMEGA, ESFRI).
Plans for HPC and Scalability Computing enabled.
PL-Grid InfrastructurePL-Grid Infrastructure
Elements and FunctionalityElements and Functionality
PL-Grid software will comprise: user tools (portals, systems for
applications management and monitoring, result visualization and other purposes, compatible with the lower-layer software used in PL-Grid);
Coordination of Operation Management and accounting EGI and DEISA collaboration
(HPC and Scalability Computing) Users’ requirements More spectacular (using
researchand test infrastructures) Computational Cloud Data Cloud Internal and External
Clouds
WP4: Grid Software and Users Tools WP4: Grid Software and Users Tools
Workpackage on Development/Research• Analysis of users’ requirements• Software repository (different tools and components developed by Partners)• Reengineering of tools and applications (legacy codes, APIs, SOA applications)• Virtual Laboratory (component applications, workflows, applications monitoring) – from
EU FP6 Virolab Project• High-level virtual organizations using knowledge (semi-automatic creation using
contract, semantic description of resources, monitoring of SLA due to QoS), data access – FiVO from EU FP6 Gredia Project
• Tools for management, proactive monitoring and security (Bazaar, Permis)
WP5: Support and TrainingWP5: Support and Training
Users’ support Making commercial software available for the users (license activity) Training, education
WP6: SecurityWP6: Security
Users’ support • Authorization, authentication, ...• Certificates ...
ACK: Irena Roterman, Jagiellonian University, Tomasz Szepieniec
ActivitiesActivities Short term
To start – establishing PL-Grid VO using Partners’ local and EGEE resources To provide resources for covering operational costs To select computational/storage resources for PL-Grid infrastructure
Long term – continously To provide the necessary infrastructure (!!)
• Computer rooms, electrical power, many organizational issues • Towards Cloud Computing (internal, external)• Towards HPCaaS and Scalable computing