AWS October Webinar Series - Introducing AWS Import / Export Snowball
-
Upload
amazon-web-services -
Category
Technology
-
view
3.354 -
download
1
Transcript of AWS October Webinar Series - Introducing AWS Import / Export Snowball
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Henry Zhang, Senior Product Manager, AWS StorageErik Durand, Business Development Manager, AWS Storage
October 2015
Introduction to AWS Import/Export Snowball
Accelerating Large-Scale Data Ingest into AWS Storage Services
What is Snowball? Petabyte scale data transport
E-ink shipping label
Ruggedizedcase
“8.5G Impact”
All data encrypted end-to-end
50 TB10G network
Rain & dust resistant
Tamper-resistant case & electronics
How does it work?
Question 1:
Question 1: You have heard of networks, right?
Question 1: You have heard of networks, right?
• Yes
Question 1: You have heard of networks, right?
• Yes• However, for certain use cases networks are:
Too slowInelasticToo expensive
Question 1: You have heard of networks, right?
• Yes• However, for certain use cases networks are:
Too slowInelasticToo expensive
Bandwidth is growing more slowly than storage volumes
Question 1: You have heard of networks, right?
• Snowball
FastElasticCost effective
10G network50TB capacity
Question 1: You have heard of networks, right?
• Snowball
FastElasticCost effective
10G network50TB capacity
Question 1: You have heard of networks, right?
• Snowball• Parallelize as needed
5X Snowballs 50G & 250TB
Question 2:
Question 2: Can I drop it?
Question 2: Can I drop it?
• No (please don’t)
Question 2: Can I drop it?
• No (please don’t)• Snowball is its own box• Has had many drop tests already• Can handle 8.5G impacts• Designed for shipping
How fast is that truck full of drives?
• Less than 1 day to transfer 50TB via a 10G connection with Snowball, less than 1 week including shipping
• Number of days to transfer 50TB via the internet at typical utilizations
Internet Connection SpeedUtilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 19 38 63 12650% 9 19 32 6375% 6 13 21 42
How fast is that truck full of drives?
• Less than 1 day to transfer 250TB via 5x10G connections with 5 Snowballs, less than 1 week including shipping
• Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection SpeedUtilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211
How is my data transported securely?
• 256-bit encryption• Data is encrypted by the
Snowball client before it reaches the Snowball appliance
• Keys are managed by KMS and are never sent to the Snowball
How is my data transported securely?
• Strong chain of custody• Tamper-resistant case• Tamper-resistant electronics
(TPM)• Each Snowball is erased
according to NIST 800-88 media sanitization guidelines between every job
From Where can it go? Import to Amazon S3, Export coming soon
Amazon EMRAmazon
Redshift
Amazon S3
Amazon Glacier
Amazon DynamoDBAmazon RDSAmazon EBS
US-EAST-1(Virginia)
US-WEST-2(Oregon)
What does it cost?
• $200 / job plus shipping• Includes 10 days to fill the device at your site• $15/day after the tenth day on site• Standard Amazon S3 charges apply• $0.03/GB to transfer data out• $0.00/GB to transfer data in
What does it cost?
Example 1:• 40TB loaded on to 1 Snowball• 2 days at your site• $200 plus shippingExample 2:• 30TB loaded on to 1 Snowball• 12 days at your site• $200 + 2*$15/day = $230 plus shipping
What does it cost?
Example 3:• 140TB loaded on to 3 Snowballs• 8 days at your site• 3 * $200 = $600 plus shippingExample 4:• 30TB exported on to 1 Snowball• 8 days at your site• $200 + 30TB * $0.03/GB = $1,121.60 plus shipping
Overview
Step 1: Create a job
Step 1: Create a job
Step 1: Create a job
Step 1: Create a job
Step 2: Install client & await arrival
Step 3: Plug in your Snowball appliance
Step 4: Get your credentials
Step 5: Connect client to the Snowball appliance
From a terminal: snowball start -i 192.0.2.0 -m
/Downloads/JID2EXAMPLE-0c40-49a7-9f53-916aEXAMPLE81-manifest.bin -u 12345-abcde-12345-ABCDE-123
snowball start -i [Snowball IP Address] -m [Path/to/manifest/file] -u [29 character unlock code]
Step 6: Copy your data
From terminal: snowball cp --recursive /Logs/April
s3://MyBucket/Logs/April
snowball cp [options] [path/to/data/source] s3://[path/to/data/destination]
Step 7: Unplug your Snowball appliance & notify UPS
Step 7: Wait for import to complete
Thank you!