Copy data management

22
Paresh Motiwala Copy Data Management Fue un muy buen viaje

Transcript of Copy data management

Page 1: Copy data management

Paresh Motiwala

Copy Data Management

Fue un muy buen viaje

Page 2: Copy data management

Paresh Motiwalacirclesofgrowth.com

781 254 [email protected]

: @PareshMotiwala

: Paresh Motiwala : Paresh Motiwala

• From DBA to a PM in 75 minutes• Why are DBAs afraid of tools?• Tempdb• Digital Forensics• Database Forensics• SSRS• SSIS• Time Management• Discrimination• Network or Perish• SQL Best Practices Document

Page 3: Copy data management

Copy

Dat

a M

anag

emen

t

Page 4: Copy data management

Copy

Dat

a M

anag

emen

t

Page 5: Copy data management

Copy

Dat

a M

anag

emen

tWho Should attend:

1.DBAs2.Infrastructure folks3.Systems, DB, Infrastructure

Managers, IT Directors, CIOs4.Network Admins5.Anyone who doesn’t have a life

Page 6: Copy data management

Copy

Dat

a M

anag

emen

tAgenda for the day

1.What is Copy Data2.DevOps3.Copy Data Sprawl4.Methods of Getting Copy Data5.Copy Data Virtualization6.Compare Multiple Methods7.Summary8.Bibiliography9.Q&A

Page 7: Copy data management

Copy

Dat

a M

anag

emen

tWhat is Copy Data

1. Copy of Production Database for DR2. Copy of Production Database for DevOps3. Copy of Production Database for BI4. Copy of Production Database for Archiving

Page 8: Copy data management

Copy

Dat

a M

anag

emen

tCopy Data Sprawl

CopiesPurpose Size (TB)1Production 11Backup 11Remote Backup 12Replicated 21DR 1

1800Archived Copies(5 years) 18006Devops 6 Total 1812

Page 9: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy Data

1. Replication2. Transaction Log Shipping3. Mirroring4. Snapshot5. Block Level Replication6. Tapes

Page 10: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy Data

ReplicationFeature Pros ConsSetup Easy Can’t repair

Trouble Shooting - Tough

Space Same amount

Network Bandwidth

Low High Initially

Repointing Apps if for DR

DNS switch -

Devops Yes/no Yes/no

Cost -- Difficult to maintain

DaAS No

Self Service No

Page 11: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy DataTransaction Log ShippingFeature Pros Cons

Setup Easy Easy to restart, if within reason

Trouble Shooting Easy -

Space - Same amount or more

Network Bandwidth

Low High initially

Repointing Apps if for DR

DNS Switch Have to reverse it.

Devops - No – kind of.

Cost - Difficult to maintain

DaAS - No

Self Service No

Page 12: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy DataMirroring - Deprecated

Feature Pros Cons

Setup Easy Easy to restart, if within reason

Trouble Shooting Easy

Space Same amount

Network Bandwidth

Low High initially

Repointing Apps if for DR

DNS Switch Reverse it

Devops - No

Cost - -

DaAS - No

Self Service No

Page 13: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy DataBlock Level Replication

Feature Pros Cons

Setup Easy Easy to restart, if within reason

Trouble Shooting Easy

Space Same amount

Network Bandwidth

Low High initially

Repointing Apps if for DR

DNS Switch Reverse it

Devops - No

Cost - 20-25K per site

DaAS - No

Self Service No

Page 14: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy DataSnapshotFeature Pros Cons

Setup Easy -

Trouble Shooting Easy -

Space Same amount

Network Bandwidth

Low -

Repointing Apps if for DR

DNS Switch -

Devops Yes -

Cost

DaAS Yes -

Self Service No

Page 15: Copy data management

Copy

Dat

a M

anag

emen

tMethods of Getting Copy DataCopy Data Virtualization

Feature Pros Cons

Setup - Not the easiest

Trouble Shooting Easy -

Space Virtually none extra -

Network Bandwidth

Low -

Repointing Apps if for DR

DNS Switch -

Devops yes -

Cost - Expensive to start with

DaAS Yes -

Self Service Yes

Page 16: Copy data management

Copy

Dat

a M

anag

emen

tCopy Data Virtualization

ProductionMaster Copy

Clone

D

E

V

O

P

S

Page 17: Copy data management

How CDV Works.

SQL SERVERFC / iSCSI

DedupSnapshot

1.Mount Staging Disk on Server

- Mounted via FC or iSCSI2.Copy Incremental

Changes- Microsoft VSS + Actifio

CBT Driver3.Unmount Staging Disk

on Server4.Snapshot Staging Disk

on ActifioDAS

STORAGE ARRAY

NAS/FILESERVER

App APIs

Copy

Dat

a M

anag

emen

t

Page 18: Copy data management

C D V- E n a b l e d P R O C E SS Any Size Database, any Number of Copies

Minutes

18

Change Management RequestSLA 1–2 weeks

Server Admin

makes data availableSLA 1 week

Storage provisioningSLA 1 week

DBA creates dev/test db and masks data20+ hours

T R A D I T I O N A L P R O C E SS Single Copy for Database Refresh

2–4 Weeks

COPYRIGHT © 2014 ACTIFIO

Accelerates application development and testCo

py D

ata

Man

agem

ent

Page 19: Copy data management

Copy

Dat

a M

anag

emen

tComparing Multiple Methods

Feature TXN Repl SnapShot Mirror BLR CDV

Setup Easy Not the easiest

Easy Easy Easy Vendor Driven

Trouble Shooting

Easy Not the easiest

Easy Easy Easy Easy

Space Same as prod

Same as prod Same as prod

Same as prod Same as prod

Almost zero

Network Bandwidth

Medium Medium N/A Medium High Almost Zero

Repointing Apps if for DR

DNS Switch

DNS Switch DNS Switch DNS Switch or automated

DNS Switch

Devops yes No(sort of) Yes No Yes

Cost No new tech

No new tech No new tech

No new tech MIE HIE

Time Lag Lag No Lag Little Lag Little Lag Almost Instant

DaAS May Be Yes Yes No No Yes

Self Service No No No No No Yes

Page 20: Copy data management

Copy

Dat

a M

anag

emen

tSummary

1. What is Copy Data 2. DevOps3. Copy Data Sprawl4. Methods of Getting Copy Data5. Copy Data Virtualization6. Summary Comparision

Page 22: Copy data management

Copy

Dat

a M

anag

emen

tQ&A

1.Muchos Gracias2.Remember, Paresh

for President 2016