Tape Sucks for Long-Term Retention Time to Move … · Tape Sucks for Long-Term Retention Time to...

Post on 21-Aug-2018

217 views 0 download

Transcript of Tape Sucks for Long-Term Retention Time to Move … · Tape Sucks for Long-Term Retention Time to...

Tape Sucks for Long-Term Retention Time to Move to the Cloud How Cloud is Transforming Legacy Data Strategies

Dell - Internal Use - Confidential 2

• Tapes suck for long term retention (LTR) – Unknown content – Locked in proprietary format – Sensitive corporate records on transportable, degradable media – No support for retention or privacy policies – Hidden costs to find, manage, access legacy data

INTRODUCTION

Dell - Internal Use - Confidential 3

YOUR PRESENTERS

Mark Sanders Global Senior Director

Dell EMC Mark.F.Sanders@dell.com

Jim McGann Vice President Index Engines

Jim.McGann@indexengines.com

Dell - Internal Use - Confidential

LONG TERM RETENTION: A NECESSARY EVIL

Industry Typical Data Retention Requirements

Healthcare • Patient lifetime

Pharma • 75 – 100 years for R&D records, applications

Energy • Oil field lifetime

• >50 years for subsurface exploration data

Government • >100 years

Finance • Lifetime of the life insurance policy, plus 6-10 years

Aerospace • >30 years for design records (lifetime of aircraft)

Retain Data 1-6 Years

38%

Retain Data 6 + Years

20%

Dell - Internal Use - Confidential

LONG TERM RETENTION: A NECESSARY EVIL

Retain Data 1-6 Years

38%

Retain Data 6 + Years

20%

• LACK OF AGILTY: Data retrieval needs to be planned / scheduled ahead of time, no transparent on-demand access

• HIGH OPERATING COSTS: Tape management and backup admin & audit cost far exceeds the perceived low media cost

• RISK & POOR RELIABILITY: Tape media, hardware, software, and human error increase restore failure rates

CHALLENGES WITH TAPE AS LTR STRATEGY

Dell - Internal Use - Confidential

DATA DOMAIN CLOUD TIER

SIMPLE: – Automated, native tiering to public, private or hybrid cloud

COST EFFECTIVE: – Send, store, and retrieve only unique data – Store LTR for fractions of a penny per GB

OPEN: – Broad ecosystem and flexible deployment options

SECURE: – Data encryption In-Flight / @ Rest

Highly Scalable, Efficient, Secure, & Native Tiering of LTR to the Cloud

Dell - Internal Use - Confidential

CLOUDBOOST

SIMPLE: – Software integrated tiering to public, private or hybrid cloud

COST EFFECTIVE: – Dedupe, compression & WAN optimization boost performance

while reducing bandwidth & cloud consumption

FLEXIBLE: – Available standalone or as part of the Data Protection Suite – Supports In-Cloud Protection and Direct to Cloud Backup

SECURE: – Data encryption In-Flight / @ Rest

Efficient, Secure & Integrated LTR to the Cloud

Dell - Internal Use - Confidential

LONG TERM RETENTION IN THE CLOUD

Value Statement ECS

DELL EMC Cloud Storage offers unmatched capabilities than tape…

Better usability and agility (intrinsic to cloud storage)

Ease of operations (simple scaling, self-healing, no offsite vaulting)

Reliable data recovery (geo-protection, strong consistency)

…with better economics

Lower TCO

Advantage Disadvantage

Dell - Internal Use - Confidential 9

HIGH COSTS OF TAPE FOR EDISCOVERY

Search and extract from backup tapes

$2500 / tape 100 tapes = $250,000 (1000 tapes = $2.5M)

Monthly Hosting $15 / GB 500 GB x 12 months = $90,000

Legal Review $2,500 / GB 100 GB = $250,000

Total: $590,000 for 100 tapes!

Dell - Internal Use - Confidential 10

• Transforming the use of tape for LTR – Solve the LTR use case going forward with Dell EMC via Data

Domain Cloud Tier or CloudBoost w/ ECS/VSC – Leverage Index Engines to either migrate only relevant data that sits

on tape today or create a single instance copy of existing tape based data and move it to the cloud.

• Reduce risks and costs associated with LTR and eliminate the costs associated with maintaining legacy Backup SW infrastructure.

DELL EMC & INDEX ENGINES

How to Migrate Legacy Tape Data to Cloud

Dell - Internal Use - Confidential 12

• Software & services company supporting tape data mgmt

• Phase 1: Ingest & manage legacy backup catalogs: – Retire legacy/non-production backup applications – Reduce infrastructure costs and eliminate maintenance costs – Consolidate multiple legacy catalogs

• Phase 2: Migration of LTR data from tape to ESC/VSC: – No need for the original backup software – Stop using tape for LTR, cloud storage is less expensive – Recoup offsite storage expense and go tapeless

INDEX ENGINES’ VALUE PROPOSITION

Dell - Internal Use - Confidential 13

INDEX ENGINES’ DIRECT TAPE ACCESS

Create Original

Environment

Restore 100% of

Tape Content

Index Restored Content

Dedupe Results

Search for Relevant

Data

Extract Relevant

Data (<5%)

Traditional Restore Process

Direct Indexing of Tape Content

Search for DeDuped/Relevant

Data Extract Relevant

Data (<5%)

Automated Approach

100% of Data Moves from Tape

Relevant Data (<5%) Moves from Tape

Dell - Internal Use - Confidential 14

Ingest Catalog

•Capture catalog metadata

•Rebuild catalog from tapes

•Retire media server and non-production s/w

Report & Classify Data

•Report on age, location, owner, type, etc.

•Eliminate redundancy

•Define data migration policy

Index & Restore Data

•Index email databases & content

•Restore data w/o need for original s/w

•Migrate data of value from tape to disk/cloud

INDEX ENGINES’ WORKFLOW

Dell - Internal Use - Confidential 15

REPORT – MANAGE – MIGRATE – PRESERVE

Dell - Internal Use - Confidential 16

1 Migrate to New Data Protection SW – Need Access to Legacy Data

Current solution no longer fits within DR strategy

Legal/regulatory/LTR requirements for legacy data

2 Go Tapeless – Eliminate Tape

Already backing up to disk, but archiving tapes off the backend

Eliminate costs and management of tape infrastructure

3 Stop Using Tape as an Archive for LTR

Preserving data on tape to support legal and compliance

Painful and costly to find, manage and restore data from tape

USE CASES

Dell - Internal Use - Confidential 17

CURRENT ENVIRONMENT

Backup Software

TSM NBU CV

Backup to Disk

Offsite Tape Storage - LTR

Migrate to new backup software Multiple vendors under maintenance

Backing up to tape for DR Backing up to disk, then tapes for DR

Archiving tapes in offsite storage Tapes used for LTR of sensitive data

Dell - Internal Use - Confidential 18

TRANSFORMED ENVIRONMENT

Backup Software

TSM NBU CV

Backup to Disk

Offsite Tape Storage - LTR

Dell EMC Backup Solution

Data Domain

Cloud Tiering CloudBoost

ECS/VSC for LTR

Ingest and consolidate catalogs Index Engines manages access

Profile & classify legacy tape data Migrate data of value to ECS

Go tapeless Stop archiving DR tapes for LTR

Sea

rch/

Rep

ort/

Man

age/

Gov

ern

Dell - Internal Use - Confidential 19

TRANSFORMED ENVIRONMENT - ROI

Backup Software

TSM NBU CV

Backup to Disk

Offsite Tape Storage - LTR

Ingest and consolidate catalogs Index Engines manages access

Profile & classify legacy tape data Migrate data of value to ECS

Go tapeless Stop archiving DR tapes for LTR

Retire legacy backup software Eliminate multiple vendors

Retire tape infrastructure/libraries Stop purchasing tapes

Eliminate offsite tape storage Reduce risk of using tape for LTR

Sea

rch/

Rep

ort/

Man

age/

Gov

ern

Dell - Internal Use - Confidential 20

• Index Engines profiles and classifies data on tape

• Content is scanned and a document signature generated

• Migrate unique files and email or content of value based on metadata

Filter out redundant data

Eliminate aged data outside of retention

policy

Ignore types of files (ie DBs)

Relevant files & email

COMPRESSING/MIGRATION OF LEGACY DATA

Dell - Internal Use - Confidential 21

Approximately 10,000 Legacy Tape Environment Hardware Servers 2 Media Servers (Maintenance & Support) $9,600

Libraries 1 LTO Library (Maintenance & Support) $12,000

Resources Manpower ¾ Person $93,600

Floor Space Power, Cooling, Space, UPS, Fire, Security, etc. $13,200

Backup Software Maintenance Backup Software Maintenance & Support $96,000

Infrastructure Maintaining Old Servers (NDMP) and Operating Systems for Restores

$12,000

Tape Storage Offsite Tape Storage $33,600

Tape Purchases Purchase New Tapes for DR $50,000

Risk & Liability eDiscovery 1 Tape Event per Year (Use of 3rd Party for Restores) $590,000

Long Term Risk Hidden Liability $$$$$$

TOTAL $910,000

FINANCIAL JUSTIFICATION – ANNUAL COSTS

Dell - Internal Use - Confidential 22

• 3 year costs to maintain tapes = $2.73M

• With Dell EMC/Index Engines Backup Migration – Save costs – typically less than a two year ROI – Retire legacy applications - $$ – Go tapeless and retire tape infrastructure - $$ – Transform LTR and eDiscovery process - $$$ – Manage long term risk of hidden content - $$$$$

FINANCIAL JUSTIFICATION – 10,000 TAPES

Dell - Internal Use - Confidential 23

• Simple per tape pricing – bundled software/services

• IE Legacy Data Migration Assurance Program – On premise - remote management of tape migration – IE manages the migration process remotely, client provides

hardware and loads tapes

• IE Data Processing Lab – Off premise – turnkey services – IE manages the migration process in IE lab based on clients

migration requirements

IE BACKUP MIGRATION SERVICES

Dell - Internal Use - Confidential 24

Before After Technical Financial Long backup windows with

NetBackup Tape environment growing

rapidly, increasing risk of data loss and recoverability

Overhead costs associated with managing tape

Contention on NetApp NAS filer for resources (used for production data and ~20% for backup)

Increased use of storage with backup strategy

Need clearly defined data type requirements for long-term retention of data

Ingested NetBackup catalog with Index Engines

NetWorker is sole backup application now

Oracle writing directly to DD via Boost

NetBackup infrastructure and tape libraries can be shut down

Alleviated pressure on primary storage

Backup assessment showed over 1000 tapes in use for a 32 TB environment, with over

60% set for indefinite retention.

Tape out process was taking up to 20 hours to complete

Tape management costs were reduced by 20% initially; more cost savings to be seen as tapes are ingested or rolled off

VALIDATE THE VALUE: A SPACE, DEFENSE, AEROSPACE AND MEDICAL MARKETS COMPANY DP SUITE, DATA DOMAIN & INDEX ENGINES

KPIs

75% Management

100%

Risk

60%

Rack Space

66% Power

20%

TCO

Dell - Internal Use - Confidential 25

• Start with catalog ingestion – Assessment and classification of legacy data – Develop a data migration policy (single instance, email based on

timeframe, types of files, users, etc.)

• Migration project plan defined – Resources, timeframe, etc.

• Migration executed – On/Off premise – Eliminate legacy infrastructure/costs

GETTING STARTED

Dell - Internal Use - Confidential 26

• Submit them in the questions box

• Contact your EMC representative

• Email us – Mark.F.Sanders@dell.com – Jim.McGann@indexengines.com

QUESTIONS?