![[AWS re:invent 2013 Report] Amazon AppStream](https://static.fdocuments.net/doc/165x107/5565fd22d8b42aa6628b45b3/aws-reinvent-2013-report-amazon-appstream.jpg)
(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS re:Invent 2014
20
-
Upload
amazon-web-services -
Category
Technology
-
view
570 -
download
2
description
Learn from the Amazon Cloud Drive team how Amazon Cloud Drive services are built on top of AWS core services using Amazon S3, Amazon DynamoDB, Amazon EC2, Amazon SQS, Amazon Kinesis, and Amazon CloudSearch. This session will cover design and implementation aspects of large-scale data uploads, metadata storage and query, and consistent and fault-tolerant services on top of the AWS stack. The session will provide guidance and best practices about how and when to leverage and integrate AWS infrastructure and managed services for scalable solutions. This session will also cover how Cloud Drive services teams innovated to attain high throughputs.
Transcript of (ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS re:Invent 2014
Amazon S3 Amazon CloudFront
Amazon DynamoDB Amazon CloudSearch
Amazon SQS Elastic Transcoder
ElastiCache
Amazon Route 53
Amazon Kinesis Amazon EC2
Amazon EMR AWS Data PipelineAmazon RedshiftAmazon
CloudWatch
Elastic Load
Balancing
Content Storage, Delivery
& Sharing
Metadata Storage,
Indexing & Querying
Content Ingestion &
Transformation
Analytics, Monitoring &
ManagementAWS CloudFormation
Amazon Cloud Drive Services
Indexing &
Search
AnalyticsAsynchronous
PipelineMetadata
Store
Content
Repository
Apps Route 53Users
ELBCloudFront
Elastic
Cache Kinesis
StreamMessage
Queue EMR RedshiftCloud
Search
EC2
Management
Data
Pipelines
Cloud
WatchCloud
Formation
S3
λ
– Amazon S3
– DynamoDB
– Amazon CloudSearch
– Amazon Redshift
– Amazon Kinesis
– Amazon SQS
Users
Cloud Drive Service
Amazon Kinesis
DynamoDB
CloudSearch
publish
(pk, v)
validate
(pk, v)
Resilient workflow SQS
write
(pk, v)
Merge
recent updates
(cid, q)
query results
(cid, q)
CloudSearch
update batch
batch
Backup,
Recovery
Notifications
Per-customer
processing
HashKey GSI fields Additional Attributes
CustomerID:
NodeID
CID lastModified kind parents revision name status content
A08072:8TLrd A08072 1385438973435 FILE [Cgppb,…] 6 p1.jpg AVAILABLE size,MD5…
A08072:Cgppb A08072 1385449492345 ALBUM [NULL] 2 Rainier AVAILABLE -
developer.amazon.com/public/apis/experience/cloud-drive
amazon.com/clouddrive
amazon.com/clouddrive/primephotos
developer.amazon.com/public/apis/experience/cloud-drive
Please give us your feedback on this session.
Complete session evaluations and earn re:Invent swag.
http://bit.ly/awsevals
![[AWS re:invent 2013 Report] Amazon WorkSpaces](https://static.fdocuments.net/doc/165x107/5565fe62d8b42a2a4d8b4cca/aws-reinvent-2013-report-amazon-workspaces.jpg)
![[AWS re:invent 2013 Report] AWS CloudTrail](https://static.fdocuments.net/doc/165x107/5463ce9baf79596f338b4620/aws-reinvent-2013-report-aws-cloudtrail.jpg)
