COMPUTING INFRASTRUCTURE
Hardware & Software
GrADS
Project Athena Technical Issues
IGES Computing Requirements
Large model runs done offsiteRequires high bandwidth connectivity to
remote sites In house focus on data analysis
Must provide shared access to dataRequires large disk spaceCompute servers for analysis
Network Public Internet
T-3 ~ 20Mb/s Internet 2
1Gb/s
Firewall for all networking Internal
Gigabit EthernetInfiniband
Servers Dell hardware (linux) Public servers
www.iges.orgwww.wxmaps.orgwww.monsoondata.org
Front end servers (cola##)8 cpu32GB ramPublic network
Compute servers (cpu#)8 cpu24-32GB ramPrivate network
Data storage Dell Intel servers
(linux) with direct attached disk
Disks in RAID 6Dual drive
redundancy
Gluster file-systemHigh speed clustered
file-systemOpen-sourceData is stored on
standard Linux file-systems (XFS)
Shared over Infiniband network
Data access Gluster
6 servers○ 24 disk bricks
No metadata server100% scaling~2 GB/s aggregate
throughput~400 MB/s single
stream
IGES DATA accessibility Single name space
for storage, 191TB Mounted to every
server
All users have access to all data
Saves on duplicate data sets
Reliability / Backups No single point of
failureDual drive
redundancy4 hour or NBD
support contractsSpare parts onsite
Bacula for backupsAll data backed up
weekly500 Slot Quantum
i2000 tape loader3 LTO-4 tape drives
2 copies of everything
Future plans - hardware Data archiving
2 copies of data to tape Increased disk storage CPU servers with more cpu cores and
large amounts of memory analysis24 cores / 128 GB memory
Software stack Open source software
whenever possible Servers run identical
software Example open source
packagesRFlint
On each serverOperating systemCompilersGrADSHome directoryData directory
Questions…
Top Related