IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC...
-
Upload
in-memory-computing-summit -
Category
Data & Analytics
-
view
91 -
download
0
Transcript of IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC...
![Page 1: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/1.jpg)
Tap Into Your EnterpriseWhy Database Change and IMC Are an Ideal Match
Steve Wilkes – Striim Founder / CTO
See all the presentations from the In-Memory Computing Summit at http://imcsummit.org
![Page 2: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/2.jpg)
EnterpriseApplicatio
ns
You All Have Enterprise Applications• Finance• eCommerce• Supply Chain• HR• Inventory• CRM• Manufacturing• Support
![Page 3: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/3.jpg)
EnterpriseApplicatio
ns
And Those Applications Use Data-bases
• Oracle• MySQL• SQL Server• DB2• Postgres• HP NonStop• Mainframe
![Page 4: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/4.jpg)
How Do You Tap Into That Data For IMC?
IMC
![Page 5: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/5.jpg)
And Deliver Processed Data To Any-where?
IMC
Databases / ODS / EDWFiles For Up-Stream ProcessingMessage Queues / Kafka for Data As a ServiceCloud for Elastic Storage and ScalabilityHadoop / NOSQL for Data Lake
![Page 6: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/6.jpg)
SQL?
IMC
SQLQueries
SQL Queries Against Production DatabasesAre Forbidden by Most DBAs
![Page 7: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/7.jpg)
Replicas and SQL?
IMC
SQLQueries
Read Only Replicas are Expensive andRequire a lot of Extra Resources
Replicate
![Page 8: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/8.jpg)
Use Change Data Capture (CDC)
IMC
CDC Enables Non-Intrusive Collectionof Streaming Database Change
CDC
![Page 9: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/9.jpg)
Delete
Insert
When DML Operations Occur They Are Written to the Log and Captured as Events by CDC
Databases Write All Operations to a Set ofTransaction Logs for Recovery / Other Purposes
Instead of Using Timestamps or Triggers CDC Directly Reads These Logs and Collects Operations
Update
How Does CDC Work?
IMCCDC
DMLInser
tUpdateDelete
TransactionLogs
110100001101010011
Insert
![Page 10: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/10.jpg)
Use CDC Only Without IMC?
CDC
Works for Certain Use-Cases But CDC DataOften Needs Pre-Processing Before It Is Useful
IMC
![Page 11: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/11.jpg)
What IMC Processing Can You Do?
CDC
Filter Out Unnecessary DataAggregate to Remove Redundancyand Obtain Trends Over Time
Transform to the Format You Need
![Page 12: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/12.jpg)
What IMC Processing Can You Do?
CDC
Enrich Streaming Data With Context LoadedInto IMDG Without Slowing Processing
![Page 13: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/13.jpg)
What IMC Analytics Could You Do?
CDC
Once You Have Streaming CDC Data You CanPerform Complex In-Memory Analytics in Real-Time
Search for Patterns
Identify Anomalies
Correlate in Time& Space
Visualize & Analyze
Alert on Issues
Trigger BusinessProcesses / Workflows
Analytics
![Page 14: IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Database Change and IMC Are an Ideal Match](https://reader035.fdocuments.net/reader035/viewer/2022070601/5882b6a51a28abd75a8b74e9/html5/thumbnails/14.jpg)
One Thing to Remember
Change Data Capture & Streaming Integration
should be part ofyour IMC & Enterprise
Data Strategy