Kafka, Killer of Point-to-Point Integrations, Lucian Lita
16
Kafka, Killer of Point-to-Point Integrations Lucian Lita @datariver Intuit Data Team
-
Upload
confluent -
Category
Engineering
-
view
694 -
download
2
Transcript of Kafka, Killer of Point-to-Point Integrations, Lucian Lita
Kafka, Killer of Point-to-Point Integrations
Lucian Lita @datariver
Intuit Data Team
@datariver
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
DataPlaBorm&Services
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
login
login
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
login
change descrip1on (1,2)
descrip1on
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
login
invoice
change descrip1on (1,2,3)
invoice
@datariver
1.2B
800M
400M
Taxfilingclickstreamac1vityinTurboTax
Requirements?
ü highvolume–billionsofevents/dayü hybrid:cloud&coloü robust&reliable/HAü nearreal1meü secure:encryp1on,accessü scalable:upanddown
- seasonal:traffic>10,00x- highburst:upto250ktps
Oct
April15thearlyFeb
Dec
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
Star1ngState:ServiceFragmenta1on
10+15+
5+10+
7+
5+
15+
0
10+
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
Star1ngState:Point-to-PointIntegra1ons
10+15+
5+10+
7+
5+
15+
0
10+
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
TargetState
@datariver
CompanyProfiles
DeepAnaly1cs
A/BTes1ng
Predic1veModeling
UserProfiles
Graph
Search
RealTimeAnaly1cs
DataCapture
CoreDataPlaBorm&Services
@datariver
ZoomOut:SmallBusiness
Accoun1ng
Payroll
Payments
Inventory
Invoices
Repor1ng
3rdPartyApps
SmallBusiness
SmallBusiness
Tax
PersonalFinance
Accountants
ZoomOut:Intuit
@datariver
@datariver
Thankyou!
IntuitDataTeam
Lucian Lita @datariver
