Intuit Analytics Cloud 101
22
Intuit Confidential and Proprietary 1 Tilmann Bruckhaus Group Engineering Manager Intuit Data Engineering and Analytics (IDEA) Intuit Analytics Cloud 101
-
Upload
hadoop-summit -
Category
Technology
-
view
240 -
download
0
Transcript of Intuit Analytics Cloud 101
Intuit Confidential and Proprietary 1
Tilmann Bruckhaus Group Engineering ManagerIntuit Data Engineering and Analytics (IDEA)
Intuit Analytics Cloud 101
Intuit Confidential and Proprietary 2
Tilmann BruckhausGroup Engineering Manager Intuit
Follow me on twitter: @tillirix
Intuit’s big vision for dataTransform the lives of our customers by unleashing the power of data
CustomerInspired
Era of Windows Era of Web Era of the CloudEra of DOS
Spanning three decades of data
Compliantdata
Mobile First
1980s 1990s 2000s
• Employees: 150• Customers: 1.3M customers• Revenue: $33M
• Employees: 4,500 • Customers: 5.6M • Revenue: $1.04B
• Employees: 7,700• Customers: 37M• Revenue: $4.2B
20162010
Regulatory data Transactional data Batch data Real time data Complex, secure data
The Intuit Analytics Cloud (IAC)
Data-Driven Users Data-Driven Products
CG SBG GenericData products derive value from IAC
Intu
it A
naly
tics
Clo
ud
Real Time Ingest
Batch Ingest
IAC = Data + Infrastructure + Foundational Services
Business Lookup Unified Profile Personalization A/B Testing …
Real Time Data Layer
Intermediate Data
Source Data
Online Accountant
Use Case 1: Tax Personalization & Ease of Use
Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
The Big Data Lake Journey at Intuit
On Premise
First Generation IAC
Batch BatchCloudLift & Shift
˝
The Big Data Lake Journey at Intuit
Real-Time IAC in the Cloud
On Premise
First Generation IAC
Batch BatchCloudLift & Shift
Re-Architect
Cloud Streaming
˝
The Big Data Lake Journey at Intuit
Real-Time IAC in the Cloud
Cloud Challenges❏ Service Security❏ Whitelisting❏ Restacking❏ Auto Deploy❏ Service Monitoring
On Premise
First Generation IAC
Batch BatchCloudLift & Shift
Re-Architect
Cloud Streaming
˝
The Big Data Lake Journey at Intuit
Real-Time IAC in the Cloud
Cloud Challenges❏ Service Security❏ Whitelisting❏ Restacking❏ Auto Deploy❏ Service Monitoring
Streaming Challenges❏ Stateful processes❏ Performance❏ Elastic scaling❏ Replay❏ Event ordering
On Premise
First Generation IAC
Batch BatchCloudLift & Shift
Re-Architect
Cloud Streaming
IAC Real-Time Ingest Architecture
IAC Architecture in the cloud
Event -Ingest Architecture
File -Ingest Architecture
