EMC IT's Best Practices
-
Upload
webhostingguy -
Category
Documents
-
view
510 -
download
7
Transcript of EMC IT's Best Practices
1© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT’s Best Practices:
Cal State University2/18/2009
2004 - Today
2© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT’s Infrastructure Challenges
Cost
Availability
Security
Project Delivery
Scalability
Agility
Compliance
Business Partnership2
3© Copyright 2009 EMC Corporation. All rights reserved.
Our Environment and Portfolio
• Portfolio of 414 Applications & Tools
• Data Centers:
– 2 enterprise
– 3 regional
• 5,200 Data Center & Field Office Servers
• 230 PBX’s
• 219,000 Data Ports / 87,000 Voice Ports
• 460 “3rd Parties” Connected To EMC (3,900 users)
• 48,000+ Internal Users of IT Services
• 61 Countries & 398 Offices
• 20 Languages Supported By Helpdesk
• 1,100 System Changes / Month
• 39,000 Support Requests/ Month
• 150+ Ongoing Active Initiatives
• 6 PB Storage (across 5 tiers)
• 2,500 DB Instances
• 8,500 App Enhancements (2008)
• 950k B2B Transactions (2008)
• 23,000 Devices Monitored
4© Copyright 2009 EMC Corporation. All rights reserved.
NetworkIntelligence
Since 2003 approximately $7 Billion Invested in ≈40 Strategic Acquisitions
EMC Strategic Acquisitions: 2003 – 2008
Services
Virtualization /Data Mobility
ResourceManagement
ContentMgmt
Availability /Archiving
InformationSecurity
Cloud Infrastructureand Services
Authentica
RSA TablusVerid
Documentum
AcartusAsk Once X-HiveDocumentSciences
Rainfinity
ProActivity
Captiva
Acxiom
VMware Akimbi
Valyd
IndigoStone
Dolphin Internosis GeniantInterlink
Astrum Smarts nlayers Voyence
BusinessEdge
Infra
Legato Kashya Avamar Illuminator
Consumer /Small Business
Dantz
Mozy
Pi
Iomega
1/03 1/04 1/07 1/081/05 1/06 1/09
WysDM
Conchango
Zephyr
SourceLab
5© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT’s Guiding Principles
Architect for the Future– Centralize, Consolidate and Virtualize to drive utilization up, become more agile and
responsive, and improve service quality.– Classify and Tier applications, environments and data to optimize TCO.– Leverage de-duplication and archiving to “shrink the base”– Automate operations to drive efficiency and service quality up.– Replace custom dedicated solutions with “shared utility infrastructure”; building the
private cloud.
Change the conversation with the Business from “How” to “What”– Deliver services and service levels, not technologies– Provide cost transparency to drive better decisions
Reinforce “the new way” via strong IT Governance– Solution architecture control– Portfolio management
6© Copyright 2009 EMC Corporation. All rights reserved.
Driving Bottom-Line Results
$47.5M in Infrastructure saved over 3 years
While business demand for IT doubled
7© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT 2004: Islands of Information
High-end storage
Mid-tierstorage
SANfabric
Data Center A Data Center B Data Center C
Data Center D Data Center E
8© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT in early 2004:
Raw Capacity 962 TB
Data Centers 5
SAN Fabrics 63 management points
Hi-end Storage 115 (896 TB); many older, low-density
Mid-tier Storage 90 (66 TB)
Switches 70
DAS 105 (included in above)
Storage Tiers 2
Backup Solutions 4
88
9© Copyright 2009 EMC Corporation. All rights reserved.
Mirror: ~257 TB
1Data center storage.2Excludes 40 TB unassigned space.
Remote Replica: ~25 TB
~63% Allocation2
3%
27%
13%
12%
~50% Utilization
Host Free Space: ~120TB
Host Utilized: ~118 TB
8%
A Close Look
Local Replica: ~80 TB
Current Raw Capacity1
962 TB
10© Copyright 2009 EMC Corporation. All rights reserved.
Unallocated, System Overhead, and Unused Legacy
Storage: 362 TB
Local Replica: ~80 TB
Remote Replica: ~25 TB
Mirror: ~257 TB
~50% Utilization
Host Free Space: ~120TB
Host Utilized: ~118 TB
8%
3%
27%
13%
12%
37%
~63% Allocation5
1Data center storage.5Excludes 40 TB unassigned space.
...Plus Miscellaneous
Current Raw Capacity1
962 TB
11© Copyright 2009 EMC Corporation. All rights reserved.
Local Replica: ~70–90 TB
Unallocated, System Overhead, and Unused Legacy Storage:
~175–220 TB
2004 Raw Capacity962 TB
Consolidated Raw Capacity@ 700 - 750 TB
Host Free Space: ~120 TB
Host Utilized: ~118 TB
Mirror: ~257 TB
Local Replica: ~80 TB
Remote Replica: ~25 TB
Mirror: ~230 - 271 TB
Host Free Space: ~ 51 TB
Host Utilized: ~118 TB
Remote Replica: ~20–35 TB
75%Allocation
70%Utilization
50%Utilization
Unassigned: ~40TB
63%Allocation
Unallocated, System Overhead, and Unused Legacy Storage:
~362 TB
The ILM Optimization Plan
12© Copyright 2009 EMC Corporation. All rights reserved.
2008 Raw Capacity
3.6 PB
750 TB
962 TB
Consolidated Raw Capacity
2.4 PB
Mirror: ~230–271 TB
Unassigned
Host Free Space: ~ 51 TB
Host Utilized: ~ 118 TB
Local Replica: ~ 70–90 TBRemote Replica: ~ 20–35 TB
750 TB (TBC)
Mirror
Host Free Space
Host Utilized
Local Replica
Remote Replica
75%Allocation
Unallocated, System Overhead, andUnused Legacy Storage:
~175–220 TB
Unallocated, System Overhead, and Unused Legacy Storage
CostAvoidance
1.2 PB
Making the Business Case
$42 Million Five-Year Cost Avoidance assuming 30% annual data growth
70%Utilization
13© Copyright 2009 EMC Corporation. All rights reserved.
Storage Growth - All Tiers (TB)
0
1000
2000
3000
4000
5000
6000
7000
Q306 Q406 Q107 Q207 Q307 Q407 Q108 Q208 Q308 Q408
70%
20%
Better Utilization Slows Storage Growth
14© Copyright 2009 EMC Corporation. All rights reserved.
Business Important SANMission-Critical SAN
Tier 1 Tier 2 Tier 3 Tier 4 Tier 5
TapeATA, CASMid-tierHigh-end/Mid-tierSoftware-based local
replication
High-endArray-based replication
EMC’s Tiered Capability and Service Catalog
AVAILABILITY (Unplanned Downtime) Seconds to
minutes Hours Hours Hours to days Minutes to hours
RECOVERY POINT Seconds Seconds to minutes Minutes to hours Up to 24 hours Up to 72 hours
PERFORMANCE (Workload) Dynamic workload Highest transaction
volume
High performance for constant workloads
Moderate performance Primarily read access
Internet performance Primarily read access
N/A
15© Copyright 2009 EMC Corporation. All rights reserved.
Oracle ERP “Before” on High-End Storage
Tier 1 Tier 2 Tier 3 Tier 4 Tier 5
N/A0 TB0 TB0 TB20.5 TB
DB1400 GB
RDF1400GB
ERP120 GB
Share-plex1:2000 GB
Share-plex2:2000 GB
Test:3500 GB
Dev: 300 GB
Production Refresh1400 GB
Scheduler275 GB
RDF120 GB
RDF275 GB
System Test:
3500 GB
System Test:
3500 GB
Archive150 GB
Backup Staging1100 GB
TOTAL CAPACITY
16© Copyright 2009 EMC Corporation. All rights reserved.
TOTAL CAPACITY
ERP Oracle “After” Resides on More Cost-Effective Tiers
Tier 1 Tier 2 Tier 3 Tier 4 Tier 5
N/A1.51 TB8.7 TB6.8 TB3.5 TB
DB1400 GB
RDF1400GB
ERP120 GB
Share-plex1:2000 GB
Share-plex2:2000 GB
Test:3500 GB
Dev: 300 GB
Production Refresh1400 GB
Scheduler275 GB
RDF120 GB
RDF275 GB
System Test:
3500 GB
System Test:
3500 GB
Archive150 GB
Backup Staging1100 GB
17© Copyright 2009 EMC Corporation. All rights reserved.
Data Growth Absorbed by Lowest TCO Tiers
Tiered storage infrastructure and an application alignment process enable over 75% of data growth to reside on tiers 3 & 4.
Storage by Tier
0
1000
2000
3000
4000
5000
6000
7000
2004 2005 2006 2007 2008 2009 est
TB
Tier 1 Tier 2 Tier 3 Tier 4
18© Copyright 2009 EMC Corporation. All rights reserved.
Mitigating the “multiplier effect” – Email Archiving
EDL
2 TB mirrored
2 TB Clone 2 TB Clone
2 TB Replicated
Prod DR
Tape90 Days
EDLEDLEDLEDLEDLEDLEDLEDLEDL10 copies
Prod DR
1.2 TBMirrored
1.2TB Replicated
1TBBefore Archive After Archive
1TB8 TB Tier 1 10TB EDL 15 TB Tape 2.4 TB Tier 4
33 TB while in Exchange Mailbox
CompressedDe-duplicated
2.4 TB after Archive
2 TB mirrored
19© Copyright 2009 EMC Corporation. All rights reserved.
Oracle 11i ArchivingOracle 11i1 TB of Transactional Data
Tape Backup of Prod90 TB
5TB (Prod, Splx, SBY, ACT, Bkup) DR
3TB (Dev, Test, Training, Perf, etc) RAID
5TB (Prod, Splx, SBY, ACT, Bkup) Mirror
5TB (Prod, Splex, SBY, ACT, Bkup)
12TB (Dev, Test, Training, Perf)
5TB (Prod, Splx, SBY, ACT, Bkup) Mirror
0.5 TB Arch RAID
2TB Archving
98.37%Capacity Reduction
Backup of (Prod, Splx, Dev, Test, etc) Onto EDL with RAID
28 TB
“Shrinking the Base” through Archiving
5 TB
10 TB
15 TB
20 TB
32 TB
35 TB
63 TB
153 TB
2.5 TB
20© Copyright 2009 EMC Corporation. All rights reserved.
Optimized Power Consumption on Lower Storage Tiers
1 TB Data on Different Capacity/Performance Drives
15K 73 GB 15K 146 GB 10K 300 GB 7.2K 500 GB
787 kWh/yr1,434 kWh/yr
3,048 kWh/yr
6,096 kWh/yr
94%
87%
73%
7.2K 750 GBSATA II
525 kWh/yr
50%
7.2K 1 TBSATA II
393 kWh/yr
25%
High Capacity Disks Consume Less Energy
21© Copyright 2009 EMC Corporation. All rights reserved.
Server Virtualization
Virtualize existing applications as servers reach EOSL
– ~500 servers reach end-of-service-life each year; need to be replaced or virtualized
– Over past two years, avoided purchase of >800 servers through use of VMware
– Density ranges from 2:1 to 18:1
Design and build a virtual, shared, tiered application hosting platform for future projects
– Implement service-based model for application hosting– Design horizontally scalable and tiered service farms– Expect average consolidation ratio in excess of 40:1.
Sweep the Floor in 2009– Remove 1600 physical servers– Extend useful life of Data Centers indefinitely
22© Copyright 2009 EMC Corporation. All rights reserved.
~2000 Servers Avoided and Eliminated so far.
22
EMC IT O/S Images
0
1000
2000
3000
4000
5000
6000
7000
2004 2005 2006 2007 2008 2009 Est.
Servers Virtual Servers
23© Copyright 2009 EMC Corporation. All rights reserved.
Architect for the Future
Future-State EMC IT Infrastructure Architecture
100% Virtualized
Tiered Storage
FCOE
FLASH
Tiered VMs
DR for Mission Critical Apps
Regional DCs in EMEA (Cork) and APJ (Bangalore)
Global MPLS Network
WAN Acceleration (WAAS)
Hopkinton Ex Westborough
24© Copyright 2009 EMC Corporation. All rights reserved.
Architect for the Future
Future-State EMC IT Client Architecture
100% Virtualized {3 year plan}
Online, Offline, Synch
Centralized administration and maintenance
Universal deployment: Employees, Contractors and Partners
Enabler to “BYOPC” model
25© Copyright 2009 EMC Corporation. All rights reserved.
Business Value Delivered
Category Actual Results
Hard Benefits
Consolidation – Driving storage utilization up, slowing growth, saving data center space, power, HVAC, optimizing staff efficiency. >1.2 petabytes of storage avoided.
Classification & Tiering – Driving data growth to the right tier; minimal growth in tier 1 storage despite significant data growth.
Archiving – Slowing data growth and eliminating backup costs. >$2m in backup tape savings alone.
Virtualization – Driving server utilization up, avoiding server purchases, saving data center space, power, HVAC, optimizing staff efficiency. Over 1000 server purchases avoided over last 2 years.
Remote Office Backup – Eliminate tape costs, slow data growth, Avoided tech refresh on edge equipment.
Soft Benefits
Availability, Scalability and Agility Compliance, E-Discovery Information protection Operational efficiencies
26© Copyright 2009 EMC Corporation. All rights reserved.
Key Lessons Learned
Overall
ILM is a critical foundation for building an information infrastructure
ILM is much more than technology—it’s about people, process, and culture
Application Classification (in terms of service levels) is a make-or-break step
Executive sponsorship and management support is critical
Engaging support throughout all levels of organization throughout a major transformation is paramount
Deployment
Transition from tape to backup-to-disk is surprisingly painless with no impact to applications
“Archiving” is often a dirty word when viewed as offsite tape repositories, however, “active archiving” is transparent to users and keeps data available— reducing the size of production databases has multiplier effects
Financial Focus on highest return efforts, depending on state of current IT infrastructure
Considerable hard and soft savings