Post on 25-Dec-2015
1
Dave Shafer, ITS Systems & Platforms
June 25, 2010
2
Central File Storage
• Individuals: 1-5 GB• Departments: 1 GB per FTE
Base Entitlement
• Asynchronous replication to identical system at remote data center
4 Hour Recovery Objectives
• < 1 hour of downtime in the past year99.97% Uptime
• 33K of 37K eligible users89% Participation
June 25, 2010
3
The Effect
“One price fits all” network file storage
Lower-cost network file storage
Lowest-cost bare server storage
June 25, 2010
4
Storage TiersHigh Performance Enterprise SAN
Central File Storage
Low Cost SAN
Target Users Centrally managed servers
End users or distributed servers
Distributed servers
Funding Model Centrally funded Base entitlement, pay for more
Pay for use
Monthly Price per Gigabyte
N/A $0.12 – $0.25 $0.03 – $0.14
http://its.uiowa.edu/spa/storage/
June 25, 2010
5
Moving Forward
Interviewed partners,
peers
Categorized storage
Analyzing data
Storage Services Roadmap
• 11 peer institutions• 17 campus units• 2.7 petabytes of campus storage
June 25, 2010
6
Peer Institutions
1. Indiana
2. Iowa State
3. Michigan
4. Michigan State
5. Minnesota
6. Northern Iowa
7. Northwestern
8. Ohio State
9. Penn State
10. Purdue
11. Wisconsin
June 25, 2010
7
Campus Units
1. College of Education
2. College of Engineering
3. College of Law
4. College of Liberal Arts and Sciences
5. College of Nursing
6. College of Pharmacy
7. College of Public Health
8. Department of Biology
9. Department of Psychology
10. Division of Mathematical Sciences
11. Graduate College
12. International Programs
13. Office of the Vice-President for Research
14. College of Business
15. Information Technology Services
16. Institute for Clinical and Translational Science
17. University of Iowa Libraries
June 25, 2010
8
Campus Storage by Provider
Information Technology
Services42%
College of Engineering27%
Institute for Clinical and Translational
Science12%
College of Public Health
8%
UI Libraries4%
Other7%
June 25, 2010
9
Storage by University Mission
Administration & Overhead
35%
Research51%
Teaching11%
Public Service4%
June 25, 2010
10
Storage by Access Type
Backup72%
Online24%
Archive4%
June 25, 2010
11
Issues
Research storage• Fragmented• Poor data protection
Backup storage• Inefficient• No central service
Archival storage• Few options• Shifts to online or
backup storage
Cost
June 25, 2010
12
Common Solutions Group Survey
1. Carnegie Mellon
2. Chicago
3. Colorado
4. Columbia
5. Cornell
6. Duke
7. Georgetown
8. Illinois
9. Iowa
10. Michigan State
11. Minnesota
12. NYU
13. Princeton
14. UC Berkeley
15. UC San Diego
16. USC
17. Virginia
18. Virginia Tech
19. Washington
20. Wisconsin
21. Yale
June 25, 2010
13
CSG: Central Storage Services
Other
Digital repository/archive
Desktop backups
Storage for distributed servers
Departmental file space
Backups for distributed servers
Individual file space
0 5 10 15 20 25
6
10
11
17
18
18
21
Iowa
June 25, 2010
14
CSG: Biggest Storage Challenge
• “Bootstrapping a funding plan for central storage services where growth is explosive.”Data growth
• “As Central IT, our biggest challenge is fighting the misconception that storage is ‘cheap.’”
Perception of cost
• “Well by volume it is research data storage and particularly data generated by instruments like telescopes and sequencers.”
Research storage
June 25, 2010
15
Possible Next Steps
Identify and promote research solutions
Build central backup service
Build, promote archival solutions
June 25, 2010
16
Research Storage
Low cost
• Commodity server hardware
• Inexpensive disks
High capacity
• Scale out capability
Service broker vs. provider
• Partner with existing campus providers
June 25, 2010
17
Central Backup Service
Focus on distributed
servers
Engage potential
users
Define requirements
Identify possible solutions
June 25, 2010
18
Archival/Repository Solutions
June 25, 2010
19
Next Steps
Census
• Share data with the campus
Roadmap
• Propose future directions
Projects
• Initiate projects according to roadmap
Services
• Roll out new services
June 25, 2010
20
Feedback
• What other data do we need?• What changes should ITS make to
existing services?• What new services should ITS offer?• http://its.uiowa.edu/spa/storage
June 25, 2010
21
Contact Information
Dave Shafer
Enterprise Storage Manager
ITS Systems & Platforms
david-shafer@uiowa.edu
June 25, 2010