EMC IT's Best Practices

26
1 © Copyright 2009 EMC Corporation. All rights reserved. EMC IT’s Best Practices: Cal State University 2/18/2009 2004 - Today

Transcript of EMC IT's Best Practices

Page 1: EMC IT's Best Practices

1© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT’s Best Practices:

Cal State University2/18/2009

2004 - Today

Page 2: EMC IT's Best Practices

2© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT’s Infrastructure Challenges

Cost

Availability

Security

Project Delivery

Scalability

Agility

Compliance

Business Partnership2

Page 3: EMC IT's Best Practices

3© Copyright 2009 EMC Corporation. All rights reserved.

Our Environment and Portfolio

• Portfolio of 414 Applications & Tools

• Data Centers:

– 2 enterprise

– 3 regional

• 5,200 Data Center & Field Office Servers

• 230 PBX’s

• 219,000 Data Ports / 87,000 Voice Ports

• 460 “3rd Parties” Connected To EMC (3,900 users)

• 48,000+ Internal Users of IT Services

• 61 Countries & 398 Offices

• 20 Languages Supported By Helpdesk

• 1,100 System Changes / Month

• 39,000 Support Requests/ Month

• 150+ Ongoing Active Initiatives

• 6 PB Storage (across 5 tiers)

• 2,500 DB Instances

• 8,500 App Enhancements (2008)

• 950k B2B Transactions (2008)

• 23,000 Devices Monitored

Page 4: EMC IT's Best Practices

4© Copyright 2009 EMC Corporation. All rights reserved.

NetworkIntelligence

Since 2003 approximately $7 Billion Invested in ≈40 Strategic Acquisitions

EMC Strategic Acquisitions: 2003 – 2008

Services

Virtualization /Data Mobility

ResourceManagement

ContentMgmt

Availability /Archiving

InformationSecurity

Cloud Infrastructureand Services

Authentica

RSA TablusVerid

Documentum

AcartusAsk Once X-HiveDocumentSciences

Rainfinity

ProActivity

Captiva

Acxiom

VMware Akimbi

Valyd

IndigoStone

Dolphin Internosis GeniantInterlink

Astrum Smarts nlayers Voyence

BusinessEdge

Infra

Legato Kashya Avamar Illuminator

Consumer /Small Business

Dantz

Mozy

Pi

Iomega

1/03 1/04 1/07 1/081/05 1/06 1/09

WysDM

Conchango

Zephyr

SourceLab

Page 5: EMC IT's Best Practices

5© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT’s Guiding Principles

Architect for the Future– Centralize, Consolidate and Virtualize to drive utilization up, become more agile and

responsive, and improve service quality.– Classify and Tier applications, environments and data to optimize TCO.– Leverage de-duplication and archiving to “shrink the base”– Automate operations to drive efficiency and service quality up.– Replace custom dedicated solutions with “shared utility infrastructure”; building the

private cloud.

Change the conversation with the Business from “How” to “What”– Deliver services and service levels, not technologies– Provide cost transparency to drive better decisions

Reinforce “the new way” via strong IT Governance– Solution architecture control– Portfolio management

Page 6: EMC IT's Best Practices

6© Copyright 2009 EMC Corporation. All rights reserved.

Driving Bottom-Line Results

$47.5M in Infrastructure saved over 3 years

While business demand for IT doubled

Page 7: EMC IT's Best Practices

7© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT 2004: Islands of Information

High-end storage

Mid-tierstorage

SANfabric

Data Center A Data Center B Data Center C

Data Center D Data Center E

Page 8: EMC IT's Best Practices

8© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT in early 2004:

Raw Capacity 962 TB

Data Centers 5

SAN Fabrics 63 management points

Hi-end Storage 115 (896 TB); many older, low-density

Mid-tier Storage 90 (66 TB)

Switches 70

DAS 105 (included in above)

Storage Tiers 2

Backup Solutions 4

88

Page 9: EMC IT's Best Practices

9© Copyright 2009 EMC Corporation. All rights reserved.

Mirror: ~257 TB

1Data center storage.2Excludes 40 TB unassigned space.

Remote Replica: ~25 TB

~63% Allocation2

3%

27%

13%

12%

~50% Utilization

Host Free Space: ~120TB

Host Utilized: ~118 TB

8%

A Close Look

Local Replica: ~80 TB

Current Raw Capacity1

962 TB

Page 10: EMC IT's Best Practices

10© Copyright 2009 EMC Corporation. All rights reserved.

Unallocated, System Overhead, and Unused Legacy

Storage: 362 TB

Local Replica: ~80 TB

Remote Replica: ~25 TB

Mirror: ~257 TB

~50% Utilization

Host Free Space: ~120TB

Host Utilized: ~118 TB

8%

3%

27%

13%

12%

37%

~63% Allocation5

1Data center storage.5Excludes 40 TB unassigned space.

...Plus Miscellaneous

Current Raw Capacity1

962 TB

Page 11: EMC IT's Best Practices

11© Copyright 2009 EMC Corporation. All rights reserved.

Local Replica: ~70–90 TB

Unallocated, System Overhead, and Unused Legacy Storage:

~175–220 TB

2004 Raw Capacity962 TB

Consolidated Raw Capacity@ 700 - 750 TB

Host Free Space: ~120 TB

Host Utilized: ~118 TB

Mirror: ~257 TB

Local Replica: ~80 TB

Remote Replica: ~25 TB

Mirror: ~230 - 271 TB

Host Free Space: ~ 51 TB

Host Utilized: ~118 TB

Remote Replica: ~20–35 TB

75%Allocation

70%Utilization

50%Utilization

Unassigned: ~40TB

63%Allocation

Unallocated, System Overhead, and Unused Legacy Storage:

~362 TB

The ILM Optimization Plan

Page 12: EMC IT's Best Practices

12© Copyright 2009 EMC Corporation. All rights reserved.

2008 Raw Capacity

3.6 PB

750 TB

962 TB

Consolidated Raw Capacity

2.4 PB

Mirror: ~230–271 TB

Unassigned

Host Free Space: ~ 51 TB

Host Utilized: ~ 118 TB

Local Replica: ~ 70–90 TBRemote Replica: ~ 20–35 TB

750 TB (TBC)

Mirror

Host Free Space

Host Utilized

Local Replica

Remote Replica

75%Allocation

Unallocated, System Overhead, andUnused Legacy Storage:

~175–220 TB

Unallocated, System Overhead, and Unused Legacy Storage

CostAvoidance

1.2 PB

Making the Business Case

$42 Million Five-Year Cost Avoidance assuming 30% annual data growth

70%Utilization

Page 13: EMC IT's Best Practices

13© Copyright 2009 EMC Corporation. All rights reserved.

Storage Growth - All Tiers (TB)

0

1000

2000

3000

4000

5000

6000

7000

Q306 Q406 Q107 Q207 Q307 Q407 Q108 Q208 Q308 Q408

70%

20%

Better Utilization Slows Storage Growth

Page 14: EMC IT's Best Practices

14© Copyright 2009 EMC Corporation. All rights reserved.

Business Important SANMission-Critical SAN

Tier 1 Tier 2 Tier 3 Tier 4 Tier 5

TapeATA, CASMid-tierHigh-end/Mid-tierSoftware-based local

replication

High-endArray-based replication

EMC’s Tiered Capability and Service Catalog

AVAILABILITY (Unplanned Downtime) Seconds to

minutes Hours Hours Hours to days Minutes to hours

RECOVERY POINT Seconds Seconds to minutes Minutes to hours Up to 24 hours Up to 72 hours

PERFORMANCE (Workload) Dynamic workload Highest transaction

volume

High performance for constant workloads

Moderate performance Primarily read access

Internet performance Primarily read access

N/A

Page 15: EMC IT's Best Practices

15© Copyright 2009 EMC Corporation. All rights reserved.

Oracle ERP “Before” on High-End Storage

Tier 1 Tier 2 Tier 3 Tier 4 Tier 5

N/A0 TB0 TB0 TB20.5 TB

DB1400 GB

RDF1400GB

ERP120 GB

Share-plex1:2000 GB

Share-plex2:2000 GB

Test:3500 GB

Dev: 300 GB

Production Refresh1400 GB

Scheduler275 GB

RDF120 GB

RDF275 GB

System Test:

3500 GB

System Test:

3500 GB

Archive150 GB

Backup Staging1100 GB

TOTAL CAPACITY

Page 16: EMC IT's Best Practices

16© Copyright 2009 EMC Corporation. All rights reserved.

TOTAL CAPACITY

ERP Oracle “After” Resides on More Cost-Effective Tiers

Tier 1 Tier 2 Tier 3 Tier 4 Tier 5

N/A1.51 TB8.7 TB6.8 TB3.5 TB

DB1400 GB

RDF1400GB

ERP120 GB

Share-plex1:2000 GB

Share-plex2:2000 GB

Test:3500 GB

Dev: 300 GB

Production Refresh1400 GB

Scheduler275 GB

RDF120 GB

RDF275 GB

System Test:

3500 GB

System Test:

3500 GB

Archive150 GB

Backup Staging1100 GB

Page 17: EMC IT's Best Practices

17© Copyright 2009 EMC Corporation. All rights reserved.

Data Growth Absorbed by Lowest TCO Tiers

Tiered storage infrastructure and an application alignment process enable over 75% of data growth to reside on tiers 3 & 4.

Storage by Tier

0

1000

2000

3000

4000

5000

6000

7000

2004 2005 2006 2007 2008 2009 est

TB

Tier 1 Tier 2 Tier 3 Tier 4

Page 18: EMC IT's Best Practices

18© Copyright 2009 EMC Corporation. All rights reserved.

Mitigating the “multiplier effect” – Email Archiving

EDL

2 TB mirrored

2 TB Clone 2 TB Clone

2 TB Replicated

Prod DR

Tape90 Days

EDLEDLEDLEDLEDLEDLEDLEDLEDL10 copies

Prod DR

1.2 TBMirrored

1.2TB Replicated

1TBBefore Archive After Archive

1TB8 TB Tier 1 10TB EDL 15 TB Tape 2.4 TB Tier 4

33 TB while in Exchange Mailbox

CompressedDe-duplicated

2.4 TB after Archive

2 TB mirrored

Page 19: EMC IT's Best Practices

19© Copyright 2009 EMC Corporation. All rights reserved.

Oracle 11i ArchivingOracle 11i1 TB of Transactional Data

Tape Backup of Prod90 TB

5TB (Prod, Splx, SBY, ACT, Bkup) DR

3TB (Dev, Test, Training, Perf, etc) RAID

5TB (Prod, Splx, SBY, ACT, Bkup) Mirror

5TB (Prod, Splex, SBY, ACT, Bkup)

12TB (Dev, Test, Training, Perf)

5TB (Prod, Splx, SBY, ACT, Bkup) Mirror

0.5 TB Arch RAID

2TB Archving

98.37%Capacity Reduction

Backup of (Prod, Splx, Dev, Test, etc) Onto EDL with RAID

28 TB

“Shrinking the Base” through Archiving

5 TB

10 TB

15 TB

20 TB

32 TB

35 TB

63 TB

153 TB

2.5 TB

Page 20: EMC IT's Best Practices

20© Copyright 2009 EMC Corporation. All rights reserved.

Optimized Power Consumption on Lower Storage Tiers

1 TB Data on Different Capacity/Performance Drives

15K 73 GB 15K 146 GB 10K 300 GB 7.2K 500 GB

787 kWh/yr1,434 kWh/yr

3,048 kWh/yr

6,096 kWh/yr

94%

87%

73%

7.2K 750 GBSATA II

525 kWh/yr

50%

7.2K 1 TBSATA II

393 kWh/yr

25%

High Capacity Disks Consume Less Energy

Page 21: EMC IT's Best Practices

21© Copyright 2009 EMC Corporation. All rights reserved.

Server Virtualization

Virtualize existing applications as servers reach EOSL

– ~500 servers reach end-of-service-life each year; need to be replaced or virtualized

– Over past two years, avoided purchase of >800 servers through use of VMware

– Density ranges from 2:1 to 18:1

Design and build a virtual, shared, tiered application hosting platform for future projects

– Implement service-based model for application hosting– Design horizontally scalable and tiered service farms– Expect average consolidation ratio in excess of 40:1.

Sweep the Floor in 2009– Remove 1600 physical servers– Extend useful life of Data Centers indefinitely

Page 22: EMC IT's Best Practices

22© Copyright 2009 EMC Corporation. All rights reserved.

~2000 Servers Avoided and Eliminated so far.

22

EMC IT O/S Images

0

1000

2000

3000

4000

5000

6000

7000

2004 2005 2006 2007 2008 2009 Est.

Servers Virtual Servers

Page 23: EMC IT's Best Practices

23© Copyright 2009 EMC Corporation. All rights reserved.

Architect for the Future

Future-State EMC IT Infrastructure Architecture

100% Virtualized

Tiered Storage

FCOE

FLASH

Tiered VMs

DR for Mission Critical Apps

Regional DCs in EMEA (Cork) and APJ (Bangalore)

Global MPLS Network

WAN Acceleration (WAAS)

Hopkinton Ex Westborough

Page 24: EMC IT's Best Practices

24© Copyright 2009 EMC Corporation. All rights reserved.

Architect for the Future

Future-State EMC IT Client Architecture

100% Virtualized {3 year plan}

Online, Offline, Synch

Centralized administration and maintenance

Universal deployment: Employees, Contractors and Partners

Enabler to “BYOPC” model

Page 25: EMC IT's Best Practices

25© Copyright 2009 EMC Corporation. All rights reserved.

Business Value Delivered

Category Actual Results

Hard Benefits

Consolidation – Driving storage utilization up, slowing growth, saving data center space, power, HVAC, optimizing staff efficiency. >1.2 petabytes of storage avoided.

Classification & Tiering – Driving data growth to the right tier; minimal growth in tier 1 storage despite significant data growth.

Archiving – Slowing data growth and eliminating backup costs. >$2m in backup tape savings alone.

Virtualization – Driving server utilization up, avoiding server purchases, saving data center space, power, HVAC, optimizing staff efficiency. Over 1000 server purchases avoided over last 2 years.

Remote Office Backup – Eliminate tape costs, slow data growth, Avoided tech refresh on edge equipment.

Soft Benefits

Availability, Scalability and Agility Compliance, E-Discovery Information protection Operational efficiencies

Page 26: EMC IT's Best Practices

26© Copyright 2009 EMC Corporation. All rights reserved.

Key Lessons Learned

Overall

ILM is a critical foundation for building an information infrastructure

ILM is much more than technology—it’s about people, process, and culture

Application Classification (in terms of service levels) is a make-or-break step

Executive sponsorship and management support is critical

Engaging support throughout all levels of organization throughout a major transformation is paramount

Deployment

Transition from tape to backup-to-disk is surprisingly painless with no impact to applications

“Archiving” is often a dirty word when viewed as offsite tape repositories, however, “active archiving” is transparent to users and keeps data available— reducing the size of production databases has multiplier effects

Financial Focus on highest return efforts, depending on state of current IT infrastructure

Considerable hard and soft savings