Post on 07-Feb-2017
Seth Familian Founder + Principal, Familian&1
AUTOMATING BIG DATA
INTRODUCTION
SETH FAMILIAN FOUNDER + PRINCIPAL, FAMILIAN&1
2
Corporate Strategy User Experience Design
Creative ProcraftinationTeaching + Education
Growth Hacking
AUTOMATING BIG DATA
THE ANALYTICS PROCESS
3
“Long” Data
AUTOMATING BIG DATA
THE “OLD SCHOOL” APPROACH4
Raw “Header”
File2
1
Affiliates Lookup File
Update Loop
Summary Index
saved searches
scheduled searches
TRANSFORM
InstantlyGenerates
EXTRACT LOAD
ChannelDashboards
AUTOMATING BIG DATA
SEGMENT-CLEARBIT ENRICHMENT5
RAW DATA EXTRACT
Core Website
Enrichment of email addresses
AUTOMATING BIG DATA
“NEW SCHOOL” EXAMPLE 16
RAW DATA EXTRACT LOADTRANSFORM
Traffic Sources & Session Stats
RAW DATA
Behavioral Segments, Funnels, Retention & LTV
EXTRACT
Additional aggregation and data refinement
Core Website
Social Engagement Footprint
Unified socialfootprint metrics
Enrichment of email addresses
CRM data store for easy segmentation + analysis
Additional context on Twitter followers
More flexible segments, funnels + retention metrics
AUTOMATING BIG DATA
“NEW SCHOOL” EXAMPLE 27
LOADCustom dashboards synced with 70+ APIs
Traffic Sources & Session Stats
Realtime (RT)
TRANSFORMRAW DATA EXTRACT
Core Website
Social Engagement Footprint
heavy-duty query tools already in place
App Databases
Custom aggregation scripts
Postgres or Redshift DB
Daily Pull
Internally-reported metrics summarized for triangulation
Daily CSV
Behavioral segmentation + in-app messaging
RT
Behavioral Segments, Funnels, Retention & LTV
RT
Unified socialfootprint metrics
Unified app downloads & ratings metrics
App Store Activity
email address enrichment
AUTOMATING BIG DATA 8
MORE ADVANCED AUTOMATION
DISCUSSION TIMEWORKING WITH BIG DATA 9
QUESTIONS · FEEDBACK · IDEAS · INSIGHTS
A BIT ABOUT ME 10MY GENERAL ASSEMBLY WORKSHOPS