S3 + Snowball
-
Upload
amazon-web-services -
Category
Technology
-
view
805 -
download
0
Transcript of S3 + Snowball
![Page 1: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/1.jpg)
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Guy Farber, AWS Business Development
11/18/2015
S3 and Data Ingest Update
![Page 2: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/2.jpg)
Increased 120% YoY(Q2 2014 vs Q2 2015)
Amazon S3 Momentum - Data Transfer Growth
2014 Q2 2014 Q3 2014 Q4 2015 Q12014 Q2 2015 Q2
![Page 3: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/3.jpg)
Introducing S3 Standard-Infrequent Access
Standard Standard-IA Glacier
The newest storage class in Amazon S3
![Page 4: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/4.jpg)
Standard-Infrequent Access (SIA) Definition
What’s the same?
Access: Almost identical to S3 Standard with same buckets and URLs
Durability: 11 9’s, same as S3 Standard
Performance: Same characteristics as S3 Standard; low latency, high
throughput
What’s different?
Availability: Designed for 99.9%, SLA of 99%
Cost: Lower capacity fees, retrieval fees, minimum object size and
retention
![Page 5: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/5.jpg)
Selecting the right Storage class for your needs
S3
S3-IA
Glacier
L
i
f
e
c
y
c
l
e
AvailableS3: 99.99%
S3-IA: 99.9%
PerformantLow Latency
High Throughput
SecureSSE, client
encryption, IAM
integration
Event
NotificationsSQS, SNS, and
Lambda
VersioningKeep multiple
copies
automatically
Cross Region
Replication
Common
NamespaceDefine storage
class per object
Durable99.999999999%
ScalableElastic capacity
No preset limits
“Hot” DataActive and/or
Temporary Data
“Warm” DataInfrequently
Accessed Data
“Cold” DataArchive and
Compliance Data
![Page 6: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/6.jpg)
Selecting the right Storage class for your needs
S3
S3-IA
Glacier
L
i
f
e
c
y
c
l
e
AvailableS3: 99.99%
S3-IA: 99.9%
PerformantLow Latency
High Throughput≥ 30 Days≥ 128K
≥ 90 Days
Durable99.999999999%
ScalableElastic capacity
No preset limits
> 0K$0.007/GB per month
$0.0125/GB per month
“Hot” DataActive and/or
Temporary Data
“Warm” DataInfrequently
Accessed Data
“Cold” DataArchive and
Compliance Data
≥ 0 Days> 0K$0.0275 - $0.03/GB per
month
3 – 5 Hrs
$0.01/GB retrieval
$0.01/GB retrieval < 5%
![Page 7: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/7.jpg)
Object Storage Use Cases
S3
S3-IA
Glacier
Cloud
Applications
Big Data
Analytics
Content
DistributionPrimary Data
File Sync &
Share
Active
Archive
Enterprise
BackupMedia
Transcoding
Disaster Recovery /
Geo Redundancy
Deep /
Offline
Archives
Tape Vaulting
Replacement
WORM
Compliant
Data
Temporary &
Small
Objects
![Page 8: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/8.jpg)
New S3 Features
![Page 9: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/9.jpg)
S3 Storage Metrics
Monitor and set alarms on
Amazon S3 storage usage
through CloudWatch
Supported metrics include:Total bytes for Standard Storage
Total bytes for Reduced-Redundancy Storage
(RRS)
Total bytes for Reduced-Redundancy Storage
(S3-IA)
Total number of objects for a given S3 bucket.
![Page 10: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/10.jpg)
Migrating Large
Volumes of Data
![Page 11: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/11.jpg)
Never underestimate
the bandwidth of a
FedEx truck
![Page 12: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/12.jpg)
Shipping Physical Media Today
Manage Data and
Physical Media
![Page 13: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/13.jpg)
Manage Data and
Physical Media
Need to Manage Multiple
Drives for Large Imports
Shipping Physical Media Today
![Page 14: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/14.jpg)
Apply Some
‘Inside The Box’ Thinking…
![Page 15: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/15.jpg)
Amazon Snowball
Highly secure, storage appliance
Shipping now, starting at 50TB
![Page 16: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/16.jpg)
Simplified, Secure Data Transfer in Large Scale
Secure
EnclosureStrong Encryption,
End-to-End
50TB, Shipped
in Parallel
Simplified
Logistics
![Page 17: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/17.jpg)
Complex Customer Requirements
![Page 18: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/18.jpg)
Snowball – Petabyte Scale Data Transport
Service
50 TB
E Ink Shipping Label
Ruggedized Case “8.5G Impact”
Rain & Dust Resistant
Tamper Resistant Case & Electronics
All Data Encrypted End-to-end
Encryption Keys Managed Off-Device
![Page 19: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/19.jpg)
How it works
![Page 20: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/20.jpg)
What does it cost?
• $200 / job plus shipping
• Includes 10 days to fill the device at your site
• $15/day after the tenth day on site
• Standard Amazon S3 charges apply
• $0.03/GB to transfer data out
• $0.00/GB to transfer data in
![Page 21: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/21.jpg)
How fast is that truck full of drives?
• Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping
• Number of days to transfer 250TB via the Internet at typical
utilizations
InternetConnectionSpeed
Utilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 632
50% 47 95 158 316
75% 32 63 105 211
![Page 22: S3 + Snowball](https://reader030.fdocuments.net/reader030/viewer/2022021422/587064981a28ab48378b4a7d/html5/thumbnails/22.jpg)
Thank you!