Hardware & Software GrADS Project Athena Technical Issues.
-
Upload
giana-shillingford -
Category
Documents
-
view
220 -
download
0
Transcript of Hardware & Software GrADS Project Athena Technical Issues.
![Page 1: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/1.jpg)
COMPUTING INFRASTRUCTURE
Hardware & Software
GrADS
Project Athena Technical Issues
![Page 2: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/2.jpg)
IGES Computing Requirements
Large model runs done offsiteRequires high bandwidth connectivity to
remote sites In house focus on data analysis
Must provide shared access to dataRequires large disk spaceCompute servers for analysis
![Page 3: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/3.jpg)
Network Public Internet
T-3 ~ 20Mb/s Internet 2
1Gb/s
Firewall for all networking Internal
Gigabit EthernetInfiniband
![Page 4: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/4.jpg)
Servers Dell hardware (linux) Public servers
www.iges.orgwww.wxmaps.orgwww.monsoondata.org
Front end servers (cola##)8 cpu32GB ramPublic network
Compute servers (cpu#)8 cpu24-32GB ramPrivate network
![Page 5: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/5.jpg)
Data storage Dell Intel servers
(linux) with direct attached disk
Disks in RAID 6Dual drive
redundancy
Gluster file-systemHigh speed clustered
file-systemOpen-sourceData is stored on
standard Linux file-systems (XFS)
Shared over Infiniband network
![Page 6: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/6.jpg)
Data access Gluster
6 servers○ 24 disk bricks
No metadata server100% scaling~2 GB/s aggregate
throughput~400 MB/s single
stream
![Page 7: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/7.jpg)
IGES DATA accessibility Single name space
for storage, 191TB Mounted to every
server
All users have access to all data
Saves on duplicate data sets
![Page 8: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/8.jpg)
Reliability / Backups No single point of
failureDual drive
redundancy4 hour or NBD
support contractsSpare parts onsite
Bacula for backupsAll data backed up
weekly500 Slot Quantum
i2000 tape loader3 LTO-4 tape drives
2 copies of everything
![Page 9: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/9.jpg)
Future plans - hardware Data archiving
2 copies of data to tape Increased disk storage CPU servers with more cpu cores and
large amounts of memory analysis24 cores / 128 GB memory
![Page 10: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/10.jpg)
Software stack Open source software
whenever possible Servers run identical
software Example open source
packagesRFlint
On each serverOperating systemCompilersGrADSHome directoryData directory
![Page 11: Hardware & Software GrADS Project Athena Technical Issues.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5516f351550346f5558b4b7f/html5/thumbnails/11.jpg)
Questions…