FY07 SAN Plans Rich Loft Tom Bettge SAN Team Oct 3, 2006.
-
Upload
beatrix-anderson -
Category
Documents
-
view
216 -
download
0
Transcript of FY07 SAN Plans Rich Loft Tom Bettge SAN Team Oct 3, 2006.
FY07 SAN Plans
Rich Loft
Tom Bettge
SAN Team
Oct 3, 2006
High-speed Shared File System – Fall 2006
CDP(dataportal)Sun V880
DSS(huron)
Sun V880
Mc DataSwitch
MetaData
Servers
Storage device
Storagedevice
Internet
DSS(bison)
Sun V880
TIGGE(ultrazone)Sun V890
TERAGRID(datagrid)Sun V890
Teragrid
2007
Storagedevice
Storagedevice
TIGGE Load Tests
• Question: Can TIGGE load coexist on SAN with DSS workload?
• Bill Anderson simulated this by measuring SAN performance as function of TIGGE process count for various numbers of “background” DSS threads.
• Results in all cases exceeded “mean” throughput requirements of TIGGE
• Decision: locate DSS workspace on SAN.
SAN Load Test Performance Results
Mean Aggregate Throughput of Tigge Workload (MB/sec)
0
20
40
60
80
100
120
140
160
180
0 5 10 15 20 25
number of concurrent streams in Tigge workload
throughput (MB/sec)
Tigge workload only
4 additional I/O streams
8 additional I/O streams
16 additional I/O streams
average throughput required for Tigge workload ( ~24 MB/sec)
Each stream wrote or read a 1 GB sized file using a request size of 64 KB.
SAN Filesystem to Physical Hardware Mapping Plan
AB112 TB
AB212 TB
SB216 TB
SB216 TB
/dsstmp:16 TB/cdp1: 7.5 TB
/gridbgc: 4.5 TB
/dsszone: 16 TB /tigge: 6 TB
/esg-cdp: 10 TB
SB316 TB
SB416 TB
/narccap: 16 TB /dsswork: 6 TB
/TBD: 10 TB
1, Purchase two SATABeasts…
5.1 TB of dss work files
5.1 TB of dss work files
2. Transfer dss work files to SB4…
/dsszone: 28 TB
3. Merge File Systems
Other Infrastructure
• In order to accommodate additional filesystems (8 will fill up the slots available in our current infrastructure) we will have to buy another metadata storage unit.
• The impact on machine room power is expected to be minimal, but we will have to verify this.
FY07 SAN Costs
• NARCCAP funds will cover SB3.
• Core Equipment funds will cover SB4.
• Estimated $15K for additional metadata infrastructure.
• Total (estimated) upgrade costs ~$65K.
Other Outcomes
• SE-3 in DSG will be cross trained on SAN management (Andersen)
• SAN mail list augmented with a cast of thousands: [email protected] (Arnold)
• Datasan Wiki setup on VETS Basecamp project management system. (Scheitlin)
• This plan of record ppt presentation created (Loft)
• Monthly team meetings scheduled (Bettge)