2017 AWS DB Day | Amazon Database Migration Service (DMS) 소개 및 실습
-
Upload
amazon-web-services-korea -
Category
Technology
-
view
1.264 -
download
0
Transcript of 2017 AWS DB Day | Amazon Database Migration Service (DMS) 소개 및 실습
AWS Database Migration ServiceDatabase Modernization with Minimal Downtime
John WinfordSr. Technical Program Manager
Time : 15:30 – 17:20
AWS Database Migration ServiceDatabase Modernization with Minimal Downtime
AGENDA• How does the cloud help?• How do I get there?• When should I use it?• How does it work?• What else can I do?• What have others done?
Cloud benefits
• Multi-engine support: Aurora, MySQL, MariaDB, PostgreSQL, Oracle, SQL Server
• Automated provisioning, patching, scaling, backup/restore, failover
• High availability with RDS Multi-AZ– 99.95% SLA for Multi-AZ deployments
Amazon RDS
• Lower TCO because we manage the muck
• Get more leverage from your teams
• Focus on the things that differentiate you
• Built-in high availability and cross region replication across multiple data centers
• Available on all engines, including base/standard editions, not just for enterprise editions
• Now even a small startup can leverage multiple data centers to design highly available apps with over 99.95% availability.
The Cloud makes things cheaper, easier, better
The journey
How can I get to the cloud?How will my on-premises data migrate to the cloud?
How can I make it transparent to my users?
Afterwards, how will on-premises and cloud data interact?
How can I integrate my data assets within AWS?
Can I get help moving off of commercial databases?
Migration used to be cost + complexity + time
Commercial data migration and replication software
Complex to set up and manage
Application downtime
Database-engine-specific application code
What are DMS and SCT?
AWS Database Migration Service (DMS) easily and securely migrates and/or replicate your databases and data warehouses to AWS
AWS Schema Conversion Tool (SCT) converts your commercial database and data warehouse schemas to open-source engines, Amazon Aurora and Redshift. Converts and loads data warehouse data into Amazon Redshift
We have migrated over 25,000 unique databases. And counting…
Migration options
If you’re not switching engines and can take downtime:
- SQL Server: bak file import
- MySQL: read replicas
- Oracle SQL Developer, Data Pump, Export/Import
- PostgreSQL: pg_dump
- SAP ASE: bcp
When should I use it?
When to use DMS and SCT?
Modernise Migrate Replicate
Modernise your database tier –
• Commercial to open-source
• Commercial to Amazon Aurora
Modernise your Data Warehouse –
• Commercial to Redshift
• Migrate business-critical applicat
ions
• Migrate from Classic to VPC
• Migrate data warehouse to Reds
hift
• Upgrade to a minor version
• Consolidate shards into Aurora
• Create cross-regions Read Replicas
• Run your analytics in the cloud
• Keep your dev/test and production
environment sync
When to use SCT?
Modernise your Database Tier• Commercial to open-source
• Commercial to Amazon Aurora
• S3 target
Modernise your Warehouse• Commercial to Redshift
Amazon Redshift
Amazon Aurora
When to use DMS*?
Migrate• Migrate business-critical applicatio
ns
• Migrate from Classic to VPC
• Migrate data warehouse to Redshif
t
• Upgrade to a minor version
• Consolidate shards into Aurora
• Migrate from NoSQL to SQL, SQL t
o NoSQL or NoSQL to NoSQL
Sources:
Targets:
Amazon Dynamo DB
Amazon Redshift
Amazon S3
Amazon Aurora
*DMS is a HIPAA certified service
Why use DMS and SCT?
Secure
Cost Effective
Remove Barriersto Entry
Allow DBFreedom
Keep a Leg inthe Cloud
Easy to Use, butSophisticated…
Near-ZeroDowntime
How does it work?
Database migration processStep 1: Convert or Copy your Schema
Source DB or DW
AWS SCT
Native Tool
Destination DB or DW
Step 2: Move your data
Source DB or DW
AWS SCT
Destination DB or DW
AWS DMS
AWS Schema Conversion Tool
Customerpremises
Application users
AWS
Internet
VPN
Start a replication instanceConnect to source and target databasesSelect tables, schemas, or databases
® Let AWS DMS create tables, load data, and keep them in sync
® Switch applications over to the target at your convenience
Keep your apps running during the migrationAWSDMS
Load is table by table
Replication instanceSource Target
Change data capture (CDC) and apply
Replication instanceSource Target
Update
t1 t2
t1
t2
Transactions Change apply after bulk load
What else can I do?
Source
Target
What else can I do?
Source
Source
Replication instance
What else can I do? Target
Source Target
Target
Replication instance
Homogenous or heterogeneous
SQL Server Aurora
Oracle Oracle
Oracle S3
New SCT data extractorsExtract Data from your data warehouse and migrate to Amazon Redshift
• Extracts through local migration agents
• Data is optimized for Redshift and Saved
in local files
• Files are loaded to an Amazon S3 bucket
(through network or Amazon Snowball) a
nd then to Amazon RedshiftAmazon RedshiftAWS SCT S3 Bucket
New NoSQL support with DMS
Migrate to AWS• Move from MongoDB to Amazon DynamoDB
• Move from MongoDB to relational db’s
Move between NoSQL and SQL• Change technologies
Amazon Aurora
DynamoDB
DynamoDB
RDS
Demo
What have others done?
Our customers…
Who is saying What about DMS and SCT?
"We migrated hundreds of our clients from our in-house data-center to Amazon RDS Oracle 12c using the AWS Data Migration Service (DMS). Due to this service, we could live-replicate the databases between our data-center and RDS before the migration. That kept the migration down-time to the very minimum. We are very happy with DMS and are planning to use it for Oracle to MySQL migration next”.
”The SCT Assessment Report was the key enabler to allow us to understand the scope of effort required to complete an Oracle to PostgreSQL migration. What was originally thought to be a largely manual task that no one was particularly excited about having to do became a very straight-forward quick and easy process."
“We are in the process of migrating some databases to Amazon Aurora. The ease by which we can do this using the AWS Database Migration Service has simplified this process for us and enabled us to accelerate our migration efforts. The ability to closely monitor the process, the detailed logging feature, and the support we received from AWS have given us a great deal of confidence in a successful migration.”
Heterogeneous migration
Oracle private DC to RDS PostgreSQL migrationUsed the AWS Schema Conversion Tool to convert their database schemaUsed on-going replication (CDC) to keep databases in sync until they reached the cutover windowBenefits:
• Improved reliability of the cloud environment• Savings on Oracle licensing costs• SCT Assessment Report let them understand th
e scope of the migration
Scale-up migration
RDS MySQL to Amazon Aurora MigrationUsed DMS with on-going replication (CDC) to migrate the dataBenefits:
• Aurora handles their larger data storage requirements. Per regulations they are storing 120 TB of data for 2 years
• Reduced cost and improved performance when compared to large MySQL instances
Homogeneous migration
RDS MySQL on EC2 Classic to VPCDatabase ran an end-user application so could not take downtime70 RDS instances have been migratedBenefits:
• Leveraging CDC, they could decrease outage per database to less than 5 mins
• 70 RDS instances have been seamlessly migrated
Split migration35 million members on it’s siteMany interdependent applications built over the last 15 years with unique High IOPS requirementsMigration from legacy cloud service to AWSCombination of migration to MySQL on EC2 and Amazon AuroraBenefits:
• DMS reduced the time required to migrate our databases by 40 percent
• Realized 55 percent cost savings by moving some db’s to Amazon Aurora
Wrapping up
Other database migration use cases
Migration of business-critical applicationsMigration from Classic to VPCCheap Read Replicas for OracleRead Replicas for other enginesCross-region Read Replicas for Oracle and SQL ServerAnalytics in the cloudDev/test and production environment syncOngoing replication for BIMinor version upgrade
AWS database migration partners
Thank you!
Learn more..aws.amazon.com/dms