AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB...

20
Every Document of Your Life Access your documents wherever they are. Find them in seconds whenever you need them.

description

doo collects all of your documents and intelligently organizes and secures them for you. Finding a document is a matter of seconds. Share and collaborate with colleagues, friends and family on your favorite device. Speaker: Frank Thelen, Founder & CEO, doo GmbH

Transcript of AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB...

Page 1: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Every Document of Your LifeAccess your documents wherever they are.Find them in seconds whenever you need them.

Page 2: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Agenda

1. Our Mission

2. doo Applications

3. Why we love AWS

Page 3: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Our Mission

Page 4: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

CommunicationVideoMusicPhoto

• Today we have the technology and infrastructure to provide new distribution models, user experiences and revolutionize the use of information.

• There are great digital solutions for photo, music, video, communication, ...

A new “digital experience”

Page 5: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

... however, many of our documents are still paper-based: receipts, invoices, contracts and so forth. We spend hours organizing and archiving documents and still can’t retrieve them when needed.

Not to mention the cost of producing, transporting, processing and archiving paper-based documents.

The problem with paper documents

Page 6: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Cloud ServicesEmailsFilebrowserWeb Interfaces

www.webinterfaces.com/?id=qiv302

www.your!les.com

/user=pref

www.bankingstatements.com/user=idquip

• In the digital sphere, we are facing the challenge of an ever increasing amount of documents scattered across an ever increasing number of “document sources” and “storage locations” - locally and in the cloud.

• There is no solution providing access to all our documents or helping us to get and keep them organized.

The problem with our digital documents

Page 7: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

+ Text extraction

+ Language detection

+ OCR

+ Auto-tagging algorithms

= The most advanced document search

• Intelligent tags

• Type-ahead search

• Dynamic tag scope

Find any documentin seconds...

Access alldocuments.

Cloud services

Email

Local documents

Web Interfaces

www.webinterfaces.com/?id=qiv302

www.your!les.com

/user=pref

www.bankingstatements.com/user=idquip

Page 8: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Find any documentin seconds...

Access alldocuments.

Cloud services

Email

Local documents

Web interfaces

www.webinterfaces.com/?id=qiv302

www.your!les.com

/user=pref

www.bankingstatements.com/user=idquip

...whenever youneed it.

Always in sync

Page 9: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

• Full TLS/SSL encryption up to 256-Bit 

• OAuth2 authentication

• Server-side encryption

• ISO 27001 certified data center, Amazon S3

Legally safe document transfer

Page 10: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

doo Applications

Page 11: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Mac OS X

Page 12: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Windows 8

Page 13: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

iOS

Page 14: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Android

Page 15: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Why we love AWS

Page 16: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Our learnings from experience

• Using own hardware leads to lack of flexibility for seasonal peaks • 6-8 weeks to have newly ordered hardware up and running • Huge challenges associated with setups in foreign regions

• Expensive hardware is under-utilized outside of seasonal peaks

• Storage and bandwidth are problems for file transferring services

• We needed to rethink hosting options for a new business

Page 17: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

AWS services doo uses and howThe important ones

• EC2 • As many instances as needed• Dependent on needs and pricing: reserved, on-demand or spot• Flexible sizing from small as web box to huge SSD as DB server

• S3 Storage as main storage • As much storage as needed

• Upload and download scale very well

• Fairly priced

• Server Side Encryption

• CloudFront• Best content delivery network

• Dynamo DB• High-performance key value store for many purposes

• Virtual Private Cloud

• Secure network in the virtual world

Page 18: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

AWS services doo uses and howAdditional helpful services

• Elastic Load Balancer

• Flexible load balancing solution

• SSL termination

• IAM (Identity and Access Management)

• Highly granular permission management

• Security groups as Firewall

• Simple configuration of firewalls

• CloudWatch

• Optimal monitoring

• Route 53

• DNS service flexible and simple to configure

• S3 as static web server

Page 19: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL
Page 20: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

@frank_thelen

fb.com/frank42

sk8.de/xing

sk8.de/linkedin

Frank Thelen | CEO

doo.net @doo

@alexkoche42

xing.com/profile/Alex_Koch

de.linkedin.com/in/alexkoche42/

Alex Koch | CTO

fb.com/alekseko