Copy data management
-
Upload
paresh-motiwala-pmp -
Category
Data & Analytics
-
view
227 -
download
0
Transcript of Copy data management
Paresh Motiwala
Copy Data Management
Fue un muy buen viaje
Paresh Motiwalacirclesofgrowth.com
781 254 [email protected]
: @PareshMotiwala
: Paresh Motiwala : Paresh Motiwala
• From DBA to a PM in 75 minutes• Why are DBAs afraid of tools?• Tempdb• Digital Forensics• Database Forensics• SSRS• SSIS• Time Management• Discrimination• Network or Perish• SQL Best Practices Document
Copy
Dat
a M
anag
emen
t
Copy
Dat
a M
anag
emen
t
Copy
Dat
a M
anag
emen
tWho Should attend:
1.DBAs2.Infrastructure folks3.Systems, DB, Infrastructure
Managers, IT Directors, CIOs4.Network Admins5.Anyone who doesn’t have a life
Copy
Dat
a M
anag
emen
tAgenda for the day
1.What is Copy Data2.DevOps3.Copy Data Sprawl4.Methods of Getting Copy Data5.Copy Data Virtualization6.Compare Multiple Methods7.Summary8.Bibiliography9.Q&A
Copy
Dat
a M
anag
emen
tWhat is Copy Data
1. Copy of Production Database for DR2. Copy of Production Database for DevOps3. Copy of Production Database for BI4. Copy of Production Database for Archiving
Copy
Dat
a M
anag
emen
tCopy Data Sprawl
CopiesPurpose Size (TB)1Production 11Backup 11Remote Backup 12Replicated 21DR 1
1800Archived Copies(5 years) 18006Devops 6 Total 1812
Copy
Dat
a M
anag
emen
tMethods of Getting Copy Data
1. Replication2. Transaction Log Shipping3. Mirroring4. Snapshot5. Block Level Replication6. Tapes
Copy
Dat
a M
anag
emen
tMethods of Getting Copy Data
ReplicationFeature Pros ConsSetup Easy Can’t repair
Trouble Shooting - Tough
Space Same amount
Network Bandwidth
Low High Initially
Repointing Apps if for DR
DNS switch -
Devops Yes/no Yes/no
Cost -- Difficult to maintain
DaAS No
Self Service No
Copy
Dat
a M
anag
emen
tMethods of Getting Copy DataTransaction Log ShippingFeature Pros Cons
Setup Easy Easy to restart, if within reason
Trouble Shooting Easy -
Space - Same amount or more
Network Bandwidth
Low High initially
Repointing Apps if for DR
DNS Switch Have to reverse it.
Devops - No – kind of.
Cost - Difficult to maintain
DaAS - No
Self Service No
Copy
Dat
a M
anag
emen
tMethods of Getting Copy DataMirroring - Deprecated
Feature Pros Cons
Setup Easy Easy to restart, if within reason
Trouble Shooting Easy
Space Same amount
Network Bandwidth
Low High initially
Repointing Apps if for DR
DNS Switch Reverse it
Devops - No
Cost - -
DaAS - No
Self Service No
Copy
Dat
a M
anag
emen
tMethods of Getting Copy DataBlock Level Replication
Feature Pros Cons
Setup Easy Easy to restart, if within reason
Trouble Shooting Easy
Space Same amount
Network Bandwidth
Low High initially
Repointing Apps if for DR
DNS Switch Reverse it
Devops - No
Cost - 20-25K per site
DaAS - No
Self Service No
Copy
Dat
a M
anag
emen
tMethods of Getting Copy DataSnapshotFeature Pros Cons
Setup Easy -
Trouble Shooting Easy -
Space Same amount
Network Bandwidth
Low -
Repointing Apps if for DR
DNS Switch -
Devops Yes -
Cost
DaAS Yes -
Self Service No
Copy
Dat
a M
anag
emen
tMethods of Getting Copy DataCopy Data Virtualization
Feature Pros Cons
Setup - Not the easiest
Trouble Shooting Easy -
Space Virtually none extra -
Network Bandwidth
Low -
Repointing Apps if for DR
DNS Switch -
Devops yes -
Cost - Expensive to start with
DaAS Yes -
Self Service Yes
Copy
Dat
a M
anag
emen
tCopy Data Virtualization
ProductionMaster Copy
Clone
D
E
V
O
P
S
How CDV Works.
SQL SERVERFC / iSCSI
DedupSnapshot
1.Mount Staging Disk on Server
- Mounted via FC or iSCSI2.Copy Incremental
Changes- Microsoft VSS + Actifio
CBT Driver3.Unmount Staging Disk
on Server4.Snapshot Staging Disk
on ActifioDAS
STORAGE ARRAY
NAS/FILESERVER
App APIs
Copy
Dat
a M
anag
emen
t
C D V- E n a b l e d P R O C E SS Any Size Database, any Number of Copies
Minutes
18
Change Management RequestSLA 1–2 weeks
Server Admin
makes data availableSLA 1 week
Storage provisioningSLA 1 week
DBA creates dev/test db and masks data20+ hours
T R A D I T I O N A L P R O C E SS Single Copy for Database Refresh
2–4 Weeks
COPYRIGHT © 2014 ACTIFIO
Accelerates application development and testCo
py D
ata
Man
agem
ent
Copy
Dat
a M
anag
emen
tComparing Multiple Methods
Feature TXN Repl SnapShot Mirror BLR CDV
Setup Easy Not the easiest
Easy Easy Easy Vendor Driven
Trouble Shooting
Easy Not the easiest
Easy Easy Easy Easy
Space Same as prod
Same as prod Same as prod
Same as prod Same as prod
Almost zero
Network Bandwidth
Medium Medium N/A Medium High Almost Zero
Repointing Apps if for DR
DNS Switch
DNS Switch DNS Switch DNS Switch or automated
DNS Switch
Devops yes No(sort of) Yes No Yes
Cost No new tech
No new tech No new tech
No new tech MIE HIE
Time Lag Lag No Lag Little Lag Little Lag Almost Instant
DaAS May Be Yes Yes No No Yes
Self Service No No No No No Yes
Copy
Dat
a M
anag
emen
tSummary
1. What is Copy Data 2. DevOps3. Copy Data Sprawl4. Methods of Getting Copy Data5. Copy Data Virtualization6. Summary Comparision
Copy
Dat
a M
anag
emen
tBibliography
1. http://www.delphix.com/2015/08/20/new-research-reveals-data-issues-represent-the-biggest-challenge-to-devops-initiatives/
2. www.actifio.com3. www.rubrik.com
Copy
Dat
a M
anag
emen
tQ&A
1.Muchos Gracias2.Remember, Paresh
for President 2016