Trust & File Systems Rick Wagner HPC Systems Manager.
-
Upload
buddy-brown -
Category
Documents
-
view
218 -
download
0
Transcript of Trust & File Systems Rick Wagner HPC Systems Manager.
Trust & File SystemsRick WagnerHPC Systems Manager
IDI: Building the Digital University
Rick Wagner Frank K. Wuerthwein Rob Knight
“…integrates compute & storage resources at SDSC with instruments and labs across campus…”
2 Focuses• Integrative Omics • Seamless Data & Computing
3 Components• High-performance, scalable, central storage• Campus backbone and the Prism network as a Science DMZ• Core and embedded IT staff in a tiered model
Why Will This Succeed?
Tiered Staffing ModelProject funds central storage engineers and lab admins
Labs are not customers, they’re part of the team!
storage engineer
lab admin lab admin
researcher
researcher
researcher researcher
researcher
researcher
Project Team
Lab A Lab B
On Campus c = ∞
Parallel File System
Lab ALab B
Comet
ScienceDMZ
Lab A Lab B
CometScalable Parallel File System
OSS
OSS
MDS
ost0/labA-ost0
ost0/labB-ost0
ost0/comet-ost0
ost1/labA-ost1
ost1/labB-ost1
ost1/comet-ost1
mdt0/labA-mdt0
mdt0/labB-mdt0
mdt0/comet-mdt0
Lab A
Lab B
Comet
/oasis/projects/labA
/oasis/projects/labB
/oasis/comet/scratch
/oasis/projects/labA
/oasis/projects/labB
NID0
NID1
ZFS is magical!
zpoo
lda
tase
t
Lack of Trust
Lustre nodemap
Steve Simms, IULUG2015
+shared keys!
Lab A
Lab B
CometScalable Parallel File System
Lab C
virtual cluster
FIONA
FIONAF
ION
A
Lab A
Lab B
CometScalable Parallel
File System
Lab C
virtual cluster
Lab D c != ∞ ∴ streaming IO
FIONA
FIONA
FIONA
FIO
NA