IST Storage & Backup Group 2011

Jack Shnell (jshnell@berkeley.edu), SupervisorJoe Silva (silvaj@berkeley.edu), Senior Storage AdministratorDennis Leong (spgdxl@berkeley.edu), Storage AdministratorJim Neal (jrneal@berkeley.edu), Senior Backup AdministratorTatiana Moll (tmoll@berkeley.edu), Backup AdministratorJohn Torres-O’Callaghan (jocallaghan@berkeley.edu), Backup

Administrator

storageteam@lists.berkeley.edustorage-ticket@lists.berkeley.eduucbackup@berkeley.eduucbackup-ticket@berkeley.edu

IST SAN - 2011

• Installations at Earl Warren Hall and SDSC

• High-availability enterprise arrays and Fiber Channel (FC)

networks

• 3 PB total capacity SAS and SATA disk, 1000+ FC fabric

ports

• 125+ SAN hosts, 850+ Virtual Private Servers, 7 Host OS

platforms

• FC, iSCSI and NAS host connectivity

• Thousands of campus users

Nov

-07

Dec

-07

Jan-

08Fe

b-08

Mar

-08

Apr-

08M

ay-0

8Ju

n-08

Jul-0

8Au

g-08

Sep-

08O

ct-0

8N

ov-0

8D

ec-0

8Ja

n-09

Feb-

09M

ar-0

9Ap

r-09

May

-09

Jun-

09Ju

l-09

Aug-

09Se

p-09

Oct

-09

Nov

-09

Dec

-09

Jan-

10Fe

b-10

Mar

-10

Apr-

10M

ay-1

0Ju

n-10

Jul-1

0Au

g-10

Sep-

10O

ct-1

0N

ov-1

0D

ec-1

0Ja

n-11

Feb-

11M

ar-1

1Ap

r-11

May

-11

Jun-

11Ju

l-11

Aug-

11

0

100000

200000

300000

400000

500000

600000

700000

800000

900000

Low Tier

Mass Tier (Discon-tinued)

Economy Tier

Standard Tier

Mid Tier (Discon-tinued)

High Tier

Allocated Capacity by Tier - GB

IST SAN – New Tier Rates

• High $.60/GB/month, RAID-10 Serial Attach SCSI (SAS)

• Standard $.30/GB/month, RAID-5 SAS • Economy $.10/GB/month, RAID-10 Serial ATA (SATA) • Low $.05/GB/month, RAID-6 SATA• New rates in effect October 1• 25%-38% reductions from current rates

Nov

-07

Jan-

08

Mar

-08

May

-08

Jul-0

8

Sep-

08

Nov

-08

Jan-

09

Mar

-09

May

-09

Jul-0

9

Sep-

09

Nov

-09

Jan-

10

Mar

-10

May

-10

Jul-1

0

Sep-

10

Nov

-10

Jan-

11

Mar

-11

May

-11

Jul-1

1

Sep-

11

Nov

-11

Jan-

12

$0.00

$0.50

$1.00

$1.50

$2.00

$2.50

$3.00

$3.50

$4.00

$4.50

Rates by Tier, $/GB/Month

High Tier

Mid Tier (Discontinued)

Standard Tier

Economy Tier

Mass Tier (Discontinued)

Low Tier

IST SAN – Evolving Technology

Over the last four years total allocated capacity for SBG services has increased over 8X, while tier pricing has been reduced 40%-85%. Improvements in infrastructure technology have been primarily responsible.• Modular arrays replacing USP “frame”• Symmetric array controllers replacing dual-active• Introduction of SATA disk technology, SAS replacing

FC• Virtual Tape Library replacing physical tape• 10 Gbps Ethernet for IP network storage connectivity

IST Disaster Recovery

In February, IST began the build-out of the new Disaster Recovery facility at San Diego Supercomputing Center, serving not only UCB but other UC campuses as well. • Secure remote site for UCBackup data storage and

recovery• Virtual Private Servers support failover of critical

campus database and application systems.• At this facility IST offers most of its standard

services, including Storage, Backup, Virtual Servers, etc.

IST Network Attached Storage

SBG is implementing new NetApp clusters at both UCB and SDSC. Available by December, these will support expanded NAS services at UCB, as well as BR support at SDSC for other UC campuses.

• NFS, CIFS and iSCSI protocols, full AD integration• Multiple 1/10 Gbps Ethernet client-side interfaces• 1 TB “FlashCache” SSD read cache per controller• SnapVault repositories will provide BR backup for UC

campuses and units using NetApp filers in their IT operations

Desktop Backup AlternativesIn April, at the request of O.E., SBG conducted a survey of commercial backup/recovery service providers, specifically to support campus personal systems (desktops and laptops). Following is a partial list of the desired features. • Simple client installation and configuration • Both onsite and remote backup/recovery of systems• Quick backup and recovery of large data volumes

(throughput)• Efficient storage capacity utilization (compression,

deduplication)• Client encryption of backup data before transmission• Ability to share files between users

Desktop Backup AlternativesThe survey distinguished between “campus” and “cloud” solutions, with several vendors providing both types. NAS – Campus solution, good throughput, lowest cost. Simple, no client so no user

installation or configuration needed. Best file sharing environment. Not the best support for remote backup/recovery. No encryption or compression.

CrashPlan Pro – Cloud service available, but campus solution preferred. Comparatively

low cost, full-featured. Good support for remote access to campus deployment.

Carbonite – Lowest cost cloud (only) service. No Linux or Solaris client. No client-side data compression.

SDSC/Cloud - SDSC is currently rolling out a “private cloud” storage solution for the UC system that might be adapted to provide a service like DropBox or other commercial cloud file sharing solutions.

There is a proposal to support backup/recovery services for campus as a “Common Good” expense.

UCBackup Update•New UCBackup capacity rate $0.14/GB/month, effective October 1. Account fee remains at $2.00/month•Currently supporting 2,000 Clients, 700 TB data•LBNL IT moving to UCBackup for their server systems•TSM server replatform from AIX to Linux is nearing completion•New customer report formats•New client installer for Windows available, Mac soon!•UCBackup website remodeled

Comments and Questions•How can we further improve the UCBackup service, what new features would you like to see?

•Claudia W. - Ways to save money.  We have switched most users to IMAP, moved users photos and music to local machines and have begun an awareness campaign

•Any questions for us?