CCIN2P3 Site report

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 1

CCIN2P3Site report

Wojciech A. Wojcik

IN2P3 Computing Center

e-mail: [email protected] URL: http://ccweb.in2p3.fr

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 2

Supported platforms Supported platforms:

• AIX 4.3.2• HP-UX 10.20• Solaris 2.6 (2.7 in preparation)• Linux (RedHat 6.1)

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 3

Disk space Need to make the disk storage

independent of the operating system. New disk server based on:

• A3500 from Sun with 3.4 TB• VSS from IBM with 2.2 TB• ESS from IBM with 7.2 TB• 7700E from Hitachi with 6.0 TB

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 4

Mass storage Supported medias (all in the STK robots):

• 3490• DLT4000/7000• 9840 (Eagles)• Limited support for Redwood

HPSS – local developments:• Interface with RFIO:

– API: C, Fortran (via cfio)– API: C++ (iostream, in progress)

• bbftp – secure parallel ftp using RFIO interface

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 5

Mass storage HPSS – usage:

• BaBar - usage via ams/oofs• EROS II – already 1.6 TB in HPSS• Other experiments on tests

HPSS – test and production services:• $HPSS_TEST_SERVER:/hpsstest/in2p3.fr/…• $HPSS_SERVER:/hpss/in2p3.fr/…

Fiber Channel (soon in test):• Test with 2 * 9840 drives on FC• Migration for ADSM from 3490 9840• Migration from ADSM TSM (Tivoli)

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 6

Networking - LAN

Fast Ethernet (100 Mb full duplex) --> to interactive and batch services

Giga Ethernet (1 Gb full duplex) --> to disk servers and Objectivity/DB server

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 7

Networking - WAN Academic public network “Renater 2”

based on virtual networking (ATM) with guaranteed bandwidth (VPN on ATM)

Lyon CERN at 34Mb (155 Mb in June 2001)

Lyon US is going through CERN Lyon STAR TAP, 30-40 Mb, reserved

for the traffic to/from SLAC, in Nov 2000.

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 8

BAHIA - interactive front-end

Based on multi-processors: AIX 4.3.2 -> 6 * F40 HP-UX 10.20 -> 7 * HP9000/780/J282 Solaris 2.6 -> 3 * Ultra-4/E450 Linux (RedHat 6.1) -> 10 * PentiumII450

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 9

Batch system - configuration

Batch based on BQS (developed at CCIN2P3 system).

AIX 4.3.2 -> 29 * RS390 + 20 * 43P-B50 HP-UX 10.20 -> 52 * HP9000/780 Solaris 2.6 -> 25 * Ultra60 Linux (RedHat 6.1) -> 96 * dual PIII

750MHz

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 10

Batch system – cpu usage

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 11

Batch system – Linux cluster

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 12

Support for big experiments BaBar

• Objectivity/DB servers (v.5.2 on Solaris 2.6)– 4 on 450 and 2 on 4500

• Disk space for Objectivity database– Total of 7.0TB

• HPSS with interface to Objectivity (ams/oofs)• Import/export using bbftp

D0• SAM server (on Linux)• bbftp for import/export with FNAL• Usage of HPSS (on test)

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 13

Local software developments

Implementation of LDAP at IN2P3 (presented at the last HEPiX)

• IN2P3 global directory (with replication)• Roaming services• Globus services

Monitoring – GMS (see the presentation by Ph. Olivero)

JBQS – Java interface for BQS (see the presentation by B. Chambon)

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 14

Local software developments

Migration of RFIO to RFIO 64bits:• The same RFIO interface for xtage, HPSS and

CASTOR

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 15

Present actions Computing and data storage for about 30

experiments Regional Center services for:

• EROS II• BaBar• D0• AUGER

Participation in new projects (Castor, GRID)

W.A.Wojcik/CCIN2P3, HEPiX@JLAB, Nov 1, 2000 16

Future actions Regional Center services for the LHC

experiments (Alice, CMS, ATLAS, LHCb) Regional Center services for: STAR,

SNovae, Virgo (?), …