Post on 01-Dec-2014
description
1© Copyright 2012 EMC Corporation. All rights reserved.
EMC BACKUP AND RECOVERY SOLUTIONS
Deduplication Based Backup Solutions
Jean-Philippe SchwartzTechnology ConsultantEMC Switzerland - Backup & Recovery SystemsJeanPhilippe.Schwartz@emc.com
2© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
3© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
4© Copyright 2012 EMC Corporation. All rights reserved.
Avamar Disk Libraryfor mainframe
EMC Backup and Recovery Solutions
NetWorker Data ProtectionAdvisor
Data Domain
5© Copyright 2012 EMC Corporation. All rights reserved.
Centera Atmos
EMC Archive Solutions
SourceOneData DomainArchiver
6© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Market Leadership#1 in deduplication backup software and storage worldwide
Source: Worldwide Tape Automation 2010–2014 Forecast and Analysis and 2009 Vendor Shares, IDC Doc #223182, May 2010
0
200
400
600
800
1 000
1 200
1 400
1 600
1 800
EMC Symantec IBM Oracle Quantum CA
Data protection and recovery softwarePurpose-built backup appliances
Tape automation (est.)
$ M
ILLI
ON
S
7© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
8© Copyright 2012 EMC Corporation. All rights reserved.
DATA DELUGE BUDGET DILEMMA
INFRASTRUCTURE SHIFT
IT Trends Impacting Backup and Recovery
Transformation
20090.8 Zettabytes
202035.2 Zettabytes
9© Copyright 2012 EMC Corporation. All rights reserved.
Disaster RecoveryStorage
Backup Applications
Onsite Backup Storage
Backup Evolution Over TimeFrom tape to disk to deduplication
Deduplication StorageBackup
Software
Deduplication Backup Software and System
TransformationalDisk-Centric
Backup Software
VTL VTL/Tape
Backup Software
Tape TapeTraditional
Tape-Centric Backup failuresRecovery timeStorage costComplexity
Decrease
10© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
11© Copyright 2012 EMC Corporation. All rights reserved.
Deduplication Dramatically Reduces Storage Capacity Requirements
Deduplication10–30 times less data stored versus fulls + incrementals with typical retention policies
0
10
20
30
1 5 10 15 20
Weeks in Use
Dat
a S
tore
d
Deduplication storage
Traditional storage
12© Copyright 2012 EMC Corporation. All rights reserved.
Second Friday Full Backup
B C D E F L G H
Data Deduplication: Technology OverviewStore more backups in a smaller footprint
A B C D E F G H I J
Friday Full Backup
A B C D A E F G
Mon Incremental A B H
Tues Incremental C B I
Thurs Incremental A C K
Weds Incremental E G J
Backup Estimated Data Logical Reduction Physical
Monday Incremental 50 GB 7–10x 5 GB
Tuesday Incremental 50 GB 7–10x 5 GB
K L
Wednesday Incremental 50 GB 7–10x 5 GB
Thursday Incremental 50 GB 7–10x 5 GB
Second FRIDAY FULL 1 TB 50–60x 18 GB
TOTAL 2.2 TB 7.6x 288 GB
FRIDAY FULL 1 TB 2–4x 250 GB
13© Copyright 2012 EMC Corporation. All rights reserved.
Retain: Store More for Longer with LessOver one year of retention in 3U of Data Domain deduplication storage
Week 1
Backup Cumulative Estimated PhysicalData Logical Reduction
April 14 3.4 TB 10x 326 GB
April 21 4.6 TB 13x 364 GB
April 28 5.8 TB 14x 402 GB
May 26 10.6 TB 19x 554 GB
June 23 15.4 TB 21x 706 GB
TOTAL 15.4 TB 21x 706 GB
April 7 2.2 TB 8x 288 GB
Week 2
Week 3
Month 1
Month 2
Month 3
First Full 1 TB 4x 250 GB
14© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
15© Copyright 2012 EMC Corporation. All rights reserved.
Avamar Backup and DeduplicationUnlike anything else in the industry
Reduce:• Data moved by 95%• Network interface card usage at the client by 95%• Backup windows by 90%• Client CPU usage by 80%• Disk access at the client by 50%• Memory usage at the client by 50%
Network
Avamar Data Store
16© Copyright 2012 EMC Corporation. All rights reserved.
B
A
C C
D
D
B
A
B
A
CB
A C
B
C
D
DA
B
A
B
A
C
D
Avamar:
1. Divides data into sub-file segments
2. Determines if segments are unique or duplicate
3. Backs up only data that is unique
4. Sends data compressed and encrypted
Deduplication is the Enabler
Network
Avamar Data Store
17© Copyright 2012 EMC Corporation. All rights reserved.
Every backup is a “full” backup; restore single files or full directories directly to the client
Recover in One StepAvamar daily full backups eliminate need to restore last full/incremental
1
18© Copyright 2012 EMC Corporation. All rights reserved.
Avamar’s Flexible Physical and Virtual Deployment Options
SECONDARY SITE
PRIMARY DATA CENTER
Direct to Avamar Virtual Edition;Replicate to main data store
Direct to local Avamar Data Store; Replicate to main data store
Avamar agents only; Direct to main data store
SMALL REMOTE OFFICE
DESKTOPS AND LAPTOPS LARGE REMOTE OFFICE
DISTRIBUTED VIRTUALIZATION SITE
VMware ESX
19© Copyright 2012 EMC Corporation. All rights reserved.
• Application-specific agent within each VM ensures consistent state for hot backup
• Deduplicates within and across virtual machines• Reduces resource contention and speeds backups• Provides file-level restore for Windows,
Linux, and Solaris• Control cost with zero-dollar agents
Avamar for VMware Guest-Level Backup
Resource Pool
VMware Virtualization Layer
x86 Architecture
Physical server
Virtual machines
AvamarData StorePhysical server
20© Copyright 2012 EMC Corporation. All rights reserved.
• Deduplication within and across VMDK files• Changed Block Tracking (CBT) reduces backup time and minimizes
recovery time• File-level recovery from image backup (Windows)• Flexible restore to original, existing, or new virtual machine• Proxy server load balancing for superior throughput
Resource Pool
VMware Virtualization Layer
x86 Architecture
Physical server
Virtual machines
Storage AvamarData Store
Mount
Physical server
Avamar for VMware Image-Level BackupAvamar integration with VMware vStorage API for Data Protection
21© Copyright 2012 EMC Corporation. All rights reserved.
• Leverages existing ESX servers and storage– Either 0.5TB, 1 TB or 2 TB licensed
capacity running on VMware ESX Server
• Replication (of applications and storage)• Facilitates rapid, cost-effective deployment
and return on investment• Supports vMotion for deployment and
flexibility• Up to two Avamar Virtual Edition for
VMware virtual appliances per VMware ESX server for scalability
AvamarVM
AvamarVM
AvamarVM
Resource Pool
VMware Virtualization Layer
x86 Architecture
Avamar Virtual Edition for VMwareAvamar Server deployed as a Virtual Appliance
22© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
23© Copyright 2012 EMC Corporation. All rights reserved.
EMC Data Domain: Leadership and InnovationA history of industry firsts
First deduplication NAS
First deduplication volume replication
Largest deduplication
array
First deduplicationdirectory replication
First deduplication virtual tape library
First deduplication nearline storage
Fastest backupcontroller
Cascaded replication
2003 2004 2005 2006 2007 2008 2009 2010 2011
First long-term retention
system for backup and
archive
First distributed processing
24© Copyright 2012 EMC Corporation. All rights reserved.
Data Domain BasicsEasy integration with existing environment
Replication
CIFS, NFS, NDMP, DD Boost
Ethernet
Virtual Tape Library (VTL) over
Fibre ChannelDD890 appliance
Control Tier Target Tier Disaster Recovery Tier
2U 2 to 14 ports 10 and 1 Gigabit Ethernet; 8 Gb/s Fibre Channel RAID 6 Up to 285 TB usable capacity with shelves 2 TB or 1 TB 7.2K rpm SATA HDD in shelf File system NVRAM N+1 fans and redundant, hot-plug power supplies
DD890 appliance
Backup and Archive Applications
EMC
Symantec
CommVault
IBM
HP
Veeam
Quest
25© Copyright 2012 EMC Corporation. All rights reserved.
Data Domain Infrastructure and EcosystemSupports a variety of workloads and data types
VMwareMicrosoftMicrosoft SharePointOracleSAP
Backup Midrange andMainframe
EMC Bus-Tech
Archive
NAS, SAN, DAS
EMCSymantecCommVault
CAHPVizioncore
Backup ApplicationsEMCF5 NetworksSymantecCommVault
Archive Applications
IBMAtempoBakBone
Primarystorage
NetworkDisaster Recovery
Replicationover WAN
IBM i
26© Copyright 2012 EMC Corporation. All rights reserved.
Methodology: Inline vs. Post-Process Deduplication
POST-PROCESSDeduplication After Storing
The more processes, the more resource contention
− Copy to tape: Too slow to stream tape− Recovery: Service level agreement predictability− Replication: Poor time-to-disaster-recovery− Deduplication: If interleaved with backup or restore
More administration to fight these issues
DeduplicationStore
3x disk accesses to shared store
Other activities unimpeded− Predictable− Simpler
INLINEDeduplication Before Storing
Deduplication
27© Copyright 2012 EMC Corporation. All rights reserved.
Performance: CPU-Centric vs. Spindle-Bound
Thro
ughp
ut M
B/s
50
6,000
Number of Disk Spindles
50 100 150 200
Data Domain
Fibre Channel SATA
Mostdeduplication
vendors
28© Copyright 2012 EMC Corporation. All rights reserved.
Data Integrity: Data Invulnerability Architecture
OtherRAID 6NVRAMSnapshots
End-to-end data verificationChecksumDeduplication, write to diskVerify
Self-healing file systemCleaningExpired dataDefragVerify
Deduplication
Local Compression
RAID
File System
GenerateChecksum
VerifyData
Verify the file system metadata integrity
Verify user data integrity
Verify stripe integrity
End-to-end data verification
29© Copyright 2012 EMC Corporation. All rights reserved.
Network-Efficient Replication for True Disaster RecoveryLowers WAN costs; improves service level agreements
95–99% cross-site bandwidth reduction
Source:Remote sites
Destination:Data Center Hub Supports hundreds
of remote sites
1–5%
1–5%
1–5%
Archive data
Backup data
Data Domain Global Deduplication Array
Data Domain system
Flexible replication One-to-many Many-to-one Bi-directional System-to-system Cascaded
Home
DB
WAN
Home
Data Domain system
Data Domain system
30© Copyright 2012 EMC Corporation. All rights reserved.
DD Boost Software• Distributes parts of deduplication process to backup
server or application clients– Licensable software works across Data Domain portfolio
• Supports majority of backup software market– EMC Avamar and NetWorker– Symantec NetBackup and Backup Exec
• Speeds backups by up to 50 percent
• Process more backups with existing resources– 20–40% less overall impact to backup server– 80–99% less LAN bandwidth
• Enables Data Domain replication management from the backup application
DDBoost
31© Copyright 2012 EMC Corporation. All rights reserved.
Data Domain Replicator• Network-efficient and encrypted
• Transfers only compressed, deduplicated data over the WAN
• Consolidate up to 270 remote sites into a single system
Additional Data Domain Software Options
Data Domain Virtual Tape Library• Easily integrates with Fibre Channel
• Emulates multiple tape libraries
• Supports open systems and IBM i operating environments
Data Domain Encryption• Inline encryption of data at rest
• Satisfies internal governance rules and compliance regulations
• Protects against theft or loss of a physical system
Data Domain Retention Lock• File locking to satisfy IT governance
and compliance policies
• Electronic data shredding
32© Copyright 2012 EMC Corporation. All rights reserved.
Industry’s Most Scalable Inline Deduplication Systems
DD160 DD620 DD640 DD670 DD860 DD890Global Deduplication Array
DD Archiver
Speed (DD Boost) 1.1 TB/hr 2.4 TB/hr 3.4 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 26.3 TB/hr 9.8 TB/hr
Speed (other) 667 GB/hr 1.1 TB/hr 2.3 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 10.7 TB/hr 4.3 TB/hr
Logical capacity 40–195 TB 83–415 TB 0.32–1.6 PB 0.6–2.7 PB 1.4–7.1 PB 2.9–14.2 PB 5.7–28.5 PB 5.7–28.5 PB
Usable capacity Up to 3.98 TB Up to 8.3 TB Up to 32.2 TB Up to 55.9 TB Up to 142 TB Up to 285 TB Up to 570 TB Up to 570 TB
Software options:DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock, and DD Encryption
DD160Appliance
DD600 Appliance Series
DD ArchiverGlobal DeduplicationArray
DD800Appliance Series
33© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
34© Copyright 2012 EMC Corporation. All rights reserved.
Unified managementBring together a full range of traditional and next-generation data protection—from backup-to-disk to replication to tape—under a common management interface
High performanceAccelerate backup and recovery with industry-leading speed, security, and scalability to meet demanding service levels
Leading deduplicationIntegrate with Avamar and Data Domain to transform your backup and recovery with industry-leading deduplication
Maximum flexibilityBackup mission-critical business applications in physical and virtual environments
EMC NetWorkerUnified backup and recovery software
NetWorker
35© Copyright 2012 EMC Corporation. All rights reserved.
Managing Deduplication with NetWorker
• Single solution with industry- leading deduplication– Avamar– Data Domain
• Integrated software and hardware– Simplicity– Predictability– Supportability
File systems and applications
AvamarData
Domain
NetWorker
36© Copyright 2012 EMC Corporation. All rights reserved.
• In-guest and centralized proxy-based backup
• Application-consistent guest-level backup
• Integration with VMware vStorage API for Data Protection
– Image and file-level recovery with a single backup
– Physical and virtual proxy support
– Changed Block Tracking (CBT) incremental backup support
• Auto discovery and visualization simplifies management of large environments
OFF-HOST
IN-GUEST
NetWorker Integration with VMware
37© Copyright 2012 EMC Corporation. All rights reserved.
Backup and Recovery Agenda
• BRS Portfolio & EMC Leadership
• Backup Market Evolution
• Deduplication Fundamentals
• Avamar
• Data Domain
• NetWorker
• Q & A
38© Copyright 2012 EMC Corporation. All rights reserved.
Questions and Answers