IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy...
-
Upload
armani-rank -
Category
Documents
-
view
225 -
download
6
Transcript of IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy...
IT Matters
Data Storage 2014
University of Adelaide 2
Topics
• Current Storage Infrastructure• Backup and Restore• Handy Information and Techniques• Storage Future
University of Adelaide 3
Current Storage Infrastructure
• Mainly consists of NetApp Storage (www.netapp.com)– FAS 6240’s
• Home/Shared Folders (U:\ and S:\)• Staff Email (Exchange Mailboxes)• TRIM Records Management• MyMedia Streaming Data• Majority Server Storage• Uptime is vital!
– FAS 3250’s• Databases (Peoplesoft/Access Adelaide/MyUni)• Uptime is vital!
– FAS 2240’s• Lower Cost Storage
University of Adelaide 4
Current Storage Infrastructure
• FAS 6240
University of Adelaide 5
Current Storage Infrastructure
• FAS 3250
University of Adelaide 6
Current Storage Infrastructure
• FAS 2240
University of Adelaide 7
Current Storage Infrastructure
• How much data?– Total Capacity: 1000TB+ usable.– Data Transfer Rates: 880MB/s.– Usage Numbers:
• 20TB of Email (Staff) – 128,368,337 emails.• 49TB of Home Folders – 84,763,414 files and folders.• 26TB of Shared – 39,266,782 files and folders.
University of Adelaide 8
Current Storage Infrastructure
• Enterprise Support – 24/7 – Substantial Cost– Proactive Maintenance
• Guaranteed Compatibility– The storage system is guaranteed to integrate
effectively with other components of our IT infrastructure.
University of Adelaide 9
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)– Deduplication
Duplication Enabled
U:\ Drive Storage
University of Adelaide 10
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)– Thin Provisioning
Storage AdminUsers
Wow, so much storage! :D
Only going to buy enoughstorage to store actualdata! This should do:
Saved Data
Money Saved!
Saved Data
CRAP!
University of Adelaide 11
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)– Thin Provisioning– Capacity on Demand (COD)
Storage AdminUsers
Wow, so much storage! :D
Only going to buy enoughstorage to store actualdata! This should do:
Saved DataSaved Data
CrisisAverted!
Lets save all the data!
Data increasing.. Stress rising! Better enableCOD.
University of Adelaide 12
Current Storage Infrastructure
• Data Protection– Has a whole topic coming next!
• High Reliability– Hardware Redundancy (two of everything)
• Plus many more..– Performance– Manageability (Provisioning/Monitoring/Reporting)
University of Adelaide 13
Backup and Restore
What is a Backup?
A second copy of data!
Main purpose:Recover data from large scale corruption, equipment failure or disaster scenarios...
University of Adelaide 14
Backup and Restore
Disasters won’t happen to us? Think again!
University of Adelaide 15
Backup and Restore
Any other uses?!
Alternate usage:Recover individual emails or files from particular points of time in the past. Alternate usage, but most common.
University of Adelaide 16
Backup and Restore - Tape
• Backup-To-Tape:– Long term retention.– Slow to restore data.
University of Adelaide 17
Backup and Restore - Tape
• Backup-To-Tape:– Long term retention.– Slow to restore data.
U:\ Drive
S:\ Drive
Email Tape Library
GeographicallyRemote
Data Centre 1 Data Centre 2
Aged 8 weeks
University of Adelaide 18
Backup and Restore – “Local” Disk• Backup-To-Disk:
– Reduced disk cost and smart software making this possible.– Fast to access!– We utilise backup-to-disk in a couple ways, Local and Remote backups.
“Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.
Storage without Snapshots
Time (Days)
1010101 1010101011110
101010111110011
10101001010100100
101010101001010100110011
10101
“Bugger”
University of Adelaide 19
Backup and Restore – “Local” Disk• Backup-To-Disk:
– Reduced disk cost and smart software making this possible.– Fast to access!– We utilise backup-to-disk in a couple ways, Local and Remote backups.
“Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.
Storage with Snapshots
Time (Days)
1010101 1010101011110
101010111110011
10101001010100100
101010101001010100110011
10101
Snapshot 1 Snapshot 2 Snapshot 3 Snapshot 4 Snapshot 5
Snapshots protect the data!
“Bugger”“Snapshots!”
University of Adelaide 20
Backup and Restore – “Remote” Disk#1 “Remote” Disk Backups: Quick Disaster Recovery!Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre.
U:\ Drive
Primary DataCentre
S:\ Drive
Active Connections
FAS 6240
U:\ Drive
Secondary DataCentre
S:\ Drive
FAS 6240
Changes made toData are copied to
Secondary Data Centre(Twice a day)
Active Connections
Data is a maximum of 24 hours out of date.
University of Adelaide 21
Backup and Restore – “Remote” Disk#2 “Remote” Disk Backups: Making File and Email Restores easy!Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre.
U:\ Drive
Primary DataCentre
Active Connections
FAS 6240
U:\ Drive
Secondary DataCentre
FAS 2240
Changes made to data, copied to Secondary Data Centre (Once a day)
Manual Connections
Efficient Backup Software
Email Admin
University of Adelaide 22
Backup and Restore
• Important:– Missing Data? Call Service Desk as soon as possible.– Never delete required data, assuming it’ll just get restored from
backup.– Local Computer Hard Disc, not backed up!
University of Adelaide 23
Handy Information and Techniques• Secure Data Transfers and Remote File Access
– AARnet CloudStor (https://cloudstor.aarnet.edu.au/sender/)• Secure data transfer to anyone with an email address.
– University Virtual Private Network (https://vpn.adelaide.edu.au/)• Secure data access to R:\, S:\ and U:\ drives for all UofA affiliated users.
University of Adelaide 24
Handy Information and Techniques• Big Datasets
– AARnet CloudStor+ (https://cloudstor.aarnet.edu.au/plus)
– eResearchSA (http://www.ersa.edu.au/data)
• Data Collaboration– AARnet CloudStor+– Shared Data Drive (S:\)– Low Cost Storage (R:\)
• More information on research data management:
http://libguides.adelaide.edu.au/researchdata
University of Adelaide 25
Handy Information and TechniquesWhat about Cloud Storage?
• Would the Cloud provider tell you if they were hacked and your data was stolen?
• Is your data being backed up?
• Is your data being shared with advertising companies?
• What happens if the Cloud provider goes bankrupt or is taken over?
• Are employees of the Cloud provider allowed to view and share your data?
University of Adelaide 26
Handy Information and TechniquesWhat about Cloud Storage?
Some privacy policies:
“When you upload or otherwise submit content to our Services, you give Google (and those we work with) a worldwide license to use, host, store, reproduce, modify, create derivative works … communicate, publish, publicly perform, publicly display and distribute such content.” – Google, April 2014
“In the event of a reorganization, merger, or sale we may transfer any and all personal information we collect to the relevant third party.” – Apple, March 2014
“If we are involved in a reorganization, merger, acquisition or sale of our assets, your information may be transferred as part of that deal. We will notify you (for example, via a message to the email address associated with your account) of any such deal and outline your choices in that event.” – DropBox, March 2014
More information about keeping data secure:http://www.adelaide.edu.au/technology/secureit/data/
University of Adelaide 27
Storage Future
• What’s on the horizon.
– Bigger S:\ drive allocations
– Smarter Archiving
– Cloud Integration for Data Storage• Ability to access your files any device, any time, any way.• Ease of collaboration.
– Research Data Reforms (via eResearch Strategy)• Associate Director Research IT Strategy (David Munro)
– Identify-Classify-Protect! (Data Classification Campaign - Secure IT)
Questions?IT Matters – 2014 Storage
IT Matters
THANKS FOR LISTENING!