Building and Maintaining Bulletproof Systems with DataStax

27
Tim Vincent Solution Engineering Team Lead Welcome and Introduction to DSE Building and Maintaining Bullet Proof Systems

Transcript of Building and Maintaining Bulletproof Systems with DataStax

Page 1: Building and Maintaining Bulletproof Systems with DataStax

Tim Vincent Solution Engineering Team LeadWelcome and Introduction to DSEBuilding and Maintaining Bullet Proof Systems

Page 2: Building and Maintaining Bulletproof Systems with DataStax
Page 3: Building and Maintaining Bulletproof Systems with DataStax

© DataStax, All Rights Reserved. 3

Feedback

• Please use the Event App to give us your feedback• Everyone who submits feedback will be entered in the prize draw for a UE BOOM 2 by

Ultimate Ears Bluetooth Waterproof Portable Speaker• Winner will be notified via email

Page 4: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

4

MDM: Customer 360, Product CatalogPersonalization and RecommendationInternet of Things and Time SeriesFraud DetectionList ManagementMessagingInventory ManagementAuthentication

DataStax Use Cases

Page 5: Building and Maintaining Bulletproof Systems with DataStax

© DataStax, All Rights Reserved. 5

EpicScale

RealTimeValue

Page 6: Building and Maintaining Bulletproof Systems with DataStax

© DataStax, All Rights Reserved. 6

Numerous Endpoints Geographically DistributedContinuous AvailabilityInstantaneously ResponsiveImmediately DecisivePredictably Scalable

Cloud Applications

Page 7: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

7

Architecture of a Cloud Application

Web App Queue Ingest Operational

Database

Page 8: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

8

Architecture of a Cloud Application

Web App Queue Ingest Operational

Database

Solr

Page 9: Building and Maintaining Bulletproof Systems with DataStax

9

Architecture of a Cloud Application

© 2015 DataStax, All Rights Reserved.

Web App Queue Ingest Operational

Database

Hadoop

Solr

Queue

Hive

Search

Batch Processing

Page 10: Building and Maintaining Bulletproof Systems with DataStax

10

Architecture of a Cloud Application

© 2015 DataStax, All Rights Reserved.

Web App Queue Ingest

Spark Streaming

Operational

Database

Hadoop

Solr

Queue

Hive

Search

Batch Processing

Page 11: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

11

IBM Real-time Analytics Reference Architecture

Source: Explore the advanced analytics platform (http://ibm.co/1PLAneB)

Page 12: Building and Maintaining Bulletproof Systems with DataStax

Oracle Real-time Analytics Reference Architecture

Source: Big Data in Financial Services and Banking (http://bit.ly/1GP8mmE)

Page 13: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

13

Hadoop Real-time Analytics Reference Architecture

Source: Designing Fraud-Detection Architecture That Works Like Your Brain Does (http://bit.ly/1OeAnDb)

Page 14: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

14

“70% of Hadoop deployments will not meet cost savings and

revenue generation objectives due to skills and integration

challenges.”

Source: Hadoop promises not yet paying off (http://tek.io/1MrHtSx)

Page 15: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

15

Page 16: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

16

DSE Real-time Analytics Reference Architecture

HTTP Application Message Queue

Streaming

Analytics

BatchAnalytics

Real-time

Page 17: Building and Maintaining Bulletproof Systems with DataStax

 

• Distributed NoSQL Database• Google Big Table• Amazon Dynamo

• Continuous Availability• Disaster Avoidance

• Linear Scale Performance• Add nodes to scale

• Runs on Commodity Hardware• Cloud or on Premise

San Francisco

New York

London

Under Pinned by Apache Cassandra

Page 18: Building and Maintaining Bulletproof Systems with DataStax

18

BatchAnalytics

Indexing& Search

StreamingAnalytics

Graph

DSE Integrated Multi-Model Platform

© 2015 DataStax, All Rights Reserved.

Page 19: Building and Maintaining Bulletproof Systems with DataStax

© DataStax, All Rights Reserved. 19

DataStax Enterprise Added Value

Page 20: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved.

20

OpsCenterDrag picture to placeholder or click icon to add• Monitoring

• Provisioning• Management Services

• Backup/Restore• Capacity Planning• Performance • Best Practices

Page 21: Building and Maintaining Bulletproof Systems with DataStax

21

Netflix Ensures Constant Uptime with DataStax EnterpriseWorld’s leading streaming media provider with digital revenue $1.5BN+95% of all Netflix data stored in DSEIntroduction of ‘Profiles’ drove throughput to over 10M transactions per secondDoes 1 trillion transactions/day with DSEReplaced Oracle in six data centers, worldwide, 100% in the cloud

Page 22: Building and Maintaining Bulletproof Systems with DataStax
Page 23: Building and Maintaining Bulletproof Systems with DataStax

© DataStax, All Rights Reserved. 23

EpicScale

RealTimeValue

Page 24: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved. 24

Build Real Time Value Live Search and Indexing Streaming and Batch Analytics Advanced Replication

Page 25: Building and Maintaining Bulletproof Systems with DataStax

© 2015 DataStax, All Rights Reserved. 25

Operate at Scale OpsCenter Security and Auditing Services and Best Practices

Page 26: Building and Maintaining Bulletproof Systems with DataStax

© DataStax, All Rights Reserved. 26

DataStax Enterprise is the database for cloud applications.

Page 27: Building and Maintaining Bulletproof Systems with DataStax