[email protected] ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT CRESCO Seminario Portici 05 Febbraio 2009.

• Slide 1

[email protected] ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT CRESCO Seminario Portici 05 Febbraio 2009 Slide 2 [email protected] Contents ENEA-GRID infrastructure (www.afs.enea.it/project/eneagrid) CRESCO project and the Virtual Lab (www.cresco.enea.it) Silvio Migliori, Giovanni Bracco, Salvatore Podda Andrea Quintiliani ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM) ENEA-GRID and CRESCO project Slide 3 [email protected] ENEA-GRID Sensor nets ENEA-GRID Born in 1998 with 6 Italian geographic clusters Main aim Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software Build an homogeneous ICT infrastructure but with a distributed and delegated control Integrate the ENEA-GRID with National and International GRIDS www.afs.enea.it/project/eneagrid Data archives Colleagues & 3D Software catalogs Computers Application Fabric Connectivity Resource Collective User Slide 4 [email protected] ENEA-GRID from the user point of view Main feature: Access from any kind of connection Sharing data in world wide areas (geographical file system AFS) Access to the data from any kind of digital device client Running any kind of programs Access to National and International GRIDS Sensor nets Data archives Computers Portic i ( Roma-1 Bologna EU BrindisiRoma-2 Trisaia Software catalogs Computers Sensor nets ENEA-GRID Slide 5 [email protected] ENEA-GRID from application point of view Potentiality: Running all Software Model for any kind of computer architecture Only one installation for each software for all geographical computers All authorized users can have access the software from local site Any application can share the data in the common geographical file system All sensors can share the data easily using the geographical file systems Sensor nets Computers Portic i ( Roma-1 Bologna EU BrindisiRoma-2 Trisaia Software catalogs Computers Sensor nets ENEA-GRID Software Model 1 Software Model 2 Software Model 3 Software Model.. Rules Computers Slide 6 [email protected] AFS Geographical cross platform & File System AIX SGI SUN HP WinLinux Linux Alpha LSF User programs and commercial codes LSF multi-cluster as integrator XTERM Graphical User Interface Application Portal (ICA-Protocol) ICAWEB Quality of service Monitoring, Automatic recovery Accaunting ENEA GRID Slide 7 [email protected] Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 5 ( Portici) & File System Load LevelerLSF Graphic User Interface Telnet ICA WEB Cluster 6 ( Brindisi) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 2 (Casaccia) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 4 (Trisaia ) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 3 (Frascati) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 1 ( Bologna) A Simple view of ENEA GRID 7 Slide 8 [email protected] CASACCIA FRASCATI S.Teresa Saluggia Ispra BOLOGNA PORTICI TRISAIA BRINDISI Manfredonia ENEA-GRID Computational & 3D Centers 90 2750 400 140 30 #CPU/Core 45 Slide 9 [email protected] ENEA-GRID Computational Resources Computational resources of Portici (NA), Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575) Frascati(4), Portici(34),Trisaia(4), Brindisi(4) 10046Windows 32/64 Frascati(1), Trisaia(13) 6014Mac OS X Trisaia(4), Casaccia(2), Bologna(2) 108Solaris Frascati(8), Casaccia(4), Portici(1),Trisaia(8), Brindisi(1), Bologna(5) 4026IRIX Casaccia 30064Linux IA64 (Altix) Frascati(140), Casaccia(54), Portici(2700), Trisaia(20), Brindisi(84) 25000>3000 Linux x86 32/64 Frascati(258), Bologna(24), Portici(18),Brindisi(2) 3000>300AIX Gflops # CPU/Core OS Slide 10 [email protected] HPC CRESCO INFRASTRUCTURE Portici LAN Interconnections InfiniBand 4XDDR SERVERS GPFS 4 Nodi IBM 3650 IBFC High speed disc 2 GByte/s 160 TByte IBM/DDN 9550 Backup system 300 TByte IBM Tape Library TS3500 with 4 drives SERVERS BACKUP 3 Nodi IBM 3650 FCIB GARR (WAN) Section 1 (Large memory) 42 Nodi SMP IBM x3850-M2 with 4 Xeon Quad-Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton Section 3 (Special) 4 Nodi blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each. 6 Nodi IBM x3755, 8 Core AMD 8222 FPGA VIRTEX5 4 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2 4 Nodi windows 8 core 16 Byte RAM Double interconnection at 1 Gbit & 1 network at 1 Gbit for management Section 2 (MPP) 256 Nodi blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MH z/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown 4x10 Gbits 1000 Mbits 35 Node for services Servers for : Front-end installations AFS CRESCO 17 TFlops 1000 Mbits Slide 11 [email protected] CRESCO HPC hall Slide 12 [email protected] CRESCO HPC details Sections 1 & 3 Section 2 & DDN Control room backup system network: IB/GB Corridor hot Sections 1 &2 Slide 13 [email protected] Computational ability ENEA-GRID & CRESCO An heterogeneous system with more than 3000 CPU/cores CodeRisorsa SerialSection 1 & ENEA-GRID Parallel hardly coupledSection 2 Embarrassing parallelSection 1, 2, ENEA-GRID System with several parallel codes Section 1, 2, Section 1+2 Special ( FPGA, GB, CELL)Section 3 windows (serial and parallel)Section 3 Not LINUXENEA-GRID Large date Data BaseSection 1,2,3 e GPFS Slide 14 [email protected] Jack Dongarra 2002 CRESCO in the Top500 List June 2008 Italy (06/2008) 90CINECA 125ENEA 131ENI 135CILEA 156CINECA 226Telecom Nov. 08 ENEA-180 Slide 15 [email protected] DB_1 CPUS ENEA GRID WEB ICA SSH DNA Sequence system ( ABI Prism 3700) Trisaia DB_3 DB_2 Electron Microscope (Brindisi) 300 KeV (sept. 2004) ENEA GRID and experimental facilities Controlled Nuclear Fusion: FTU Frascati Tokamak Upgrade Video Acquisition Slide 16 [email protected] GARR PI2S2 GARR Others Entity La ENEA-GRID interoperability with others GRID ENEA has been developing the shared proxy solution Maintain the GRID internal architecture and autonomy Allow multiplatform impementations Under production on EGEE Under production on GRISU Required by EFDA for EGEE EFDA EGEE ? Slide 17 [email protected] CASACCIA FRASCATI S.Teresa Saluggia Ispra BOLOGNA PORTICI BRINDISI Manfredonia ENEA-GRID & GRISU & IGI ENEA-GRID SPACI TRISAIA GRISU INFN-GRID IGI Italian GRID Infrastructure Slide 18 [email protected] CRESCO for EUROPEAN FUSION Cresco 25 Tflops peak System for development and test of computational codes for ITER (EFDA contract) 1 Tflops peak IB Slide 19 [email protected] Accesso Client Accesso WEB sp5-1.frascati.enea.it boquad.bologna.enea.it dafne.casaccia.enea.it 2 0 0 8 GEANT infocal.trisia.enea.it Gateway to EGEE & GRISU Portici Brindisi Kleos.portici.enea.it ercules.brindisi.enea.it Accesso Diretto www.afs.enea.it/project/eneagrid Slide 20 [email protected] ENEA-GRID & CRESCO CRESCO is totally integrate in ENEA-GRID Slide 21 [email protected] Submissions options Fluent options Example of use of FLUENT on ENEA-GRID External Users Sicurezza industriale Sicurezza ENEA Slide 22 [email protected] ENEA-GRID & Virtual Lab architecture Li ENEA University and research institute Enterprise New collaborations Slide 23 [email protected] Per lavorare con CRESCO www.cresco.enea.it Slide 24 [email protected] ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT