Hardware & Software GrADS Project Athena Technical Issues.

COMPUTING INFRASTRUCTURE

Hardware & Software

GrADS

Project Athena Technical Issues

IGES Computing Requirements

Large model runs done offsiteRequires high bandwidth connectivity to

remote sites In house focus on data analysis

Must provide shared access to dataRequires large disk spaceCompute servers for analysis

Network Public Internet

T-3 ~ 20Mb/s Internet 2

1Gb/s

Firewall for all networking Internal

Gigabit EthernetInfiniband

Servers Dell hardware (linux) Public servers

www.iges.orgwww.wxmaps.orgwww.monsoondata.org

Front end servers (cola##)8 cpu32GB ramPublic network

Compute servers (cpu#)8 cpu24-32GB ramPrivate network

Data storage Dell Intel servers

(linux) with direct attached disk

Disks in RAID 6Dual drive

redundancy

Gluster file-systemHigh speed clustered

file-systemOpen-sourceData is stored on

standard Linux file-systems (XFS)

Shared over Infiniband network

Data access Gluster

6 servers○ 24 disk bricks

No metadata server100% scaling~2 GB/s aggregate

throughput~400 MB/s single

stream

IGES DATA accessibility Single name space

for storage, 191TB Mounted to every

server

All users have access to all data

Saves on duplicate data sets

Reliability / Backups No single point of

failureDual drive

redundancy4 hour or NBD

support contractsSpare parts onsite

Bacula for backupsAll data backed up

weekly500 Slot Quantum

i2000 tape loader3 LTO-4 tape drives

2 copies of everything

Future plans - hardware Data archiving

2 copies of data to tape Increased disk storage CPU servers with more cpu cores and

large amounts of memory analysis24 cores / 128 GB memory

Software stack Open source software

whenever possible Servers run identical

software Example open source

packagesRFlint

On each serverOperating systemCompilersGrADSHome directoryData directory

Questions…