ThingsCon Amsterdam 2015 - Martijn The

28
TELEMETRY FOR CONTINUOUS PRODUCT IMPROVEMENT OR, OUR JOURNEY TOWARDS COLLECTING INSIGHTS FROM PRODUCTS IN THE FIELD MARTIJN THÉ SOFTWARE ENGINEER / BLUETOOTH LEAD @ PEBBLE.COM

Transcript of ThingsCon Amsterdam 2015 - Martijn The

Page 1: ThingsCon Amsterdam 2015 - Martijn The

TELEMETRY FOR CONTINUOUS PRODUCT IMPROVEMENT OR, OUR JOURNEY TOWARDS COLLECTING INSIGHTS FROM PRODUCTS IN THE FIELD

MARTIJN THÉ SOFTWARE ENGINEER / BLUETOOTH LEAD @ PEBBLE.COM

Page 2: ThingsCon Amsterdam 2015 - Martijn The

QUIZ TIME!

Page 3: ThingsCon Amsterdam 2015 - Martijn The
Page 4: ThingsCon Amsterdam 2015 - Martijn The
Page 5: ThingsCon Amsterdam 2015 - Martijn The

why it no work?

Page 6: ThingsCon Amsterdam 2015 - Martijn The

ABOUT ME

martij[email protected]

Page 7: ThingsCon Amsterdam 2015 - Martijn The

PEBBLE STORY

2008

2012

2009

Page 8: ThingsCon Amsterdam 2015 - Martijn The

PEBBLE STORY

2015

Page 9: ThingsCon Amsterdam 2015 - Martijn The

PEBBLE STORY

2015

Page 10: ThingsCon Amsterdam 2015 - Martijn The
Page 11: ThingsCon Amsterdam 2015 - Martijn The

TELEMETRY

Page 12: ThingsCon Amsterdam 2015 - Martijn The

Wikipedia:

“Telemetry is an automated communications process by which measurements are made

and other data collected at remote or inaccessible points and transmitted to receiving

equipment for monitoring.”

Page 13: ThingsCon Amsterdam 2015 - Martijn The

WHY TELEMETRY?KEY TO CONTINUOUS PRODUCT IMPROVEMENT

Page 14: ThingsCon Amsterdam 2015 - Martijn The
Page 15: ThingsCon Amsterdam 2015 - Martijn The

Mobile

App

Pebble

FlashLogs

fetched when user

creates support request Support Request

Emailsupport@…

Page 16: ThingsCon Amsterdam 2015 - Martijn The

Mobile

App

Pebble

FlashLogs

fetched when user

creates support request

Support Request Email

support@…

RAM“Debug Stats”:

– notification count – awake secs count – sleep secs count – stop secs count

Page 17: ThingsCon Amsterdam 2015 - Martijn The
Page 18: ThingsCon Amsterdam 2015 - Martijn The

Mobile

App

Pebble

Flash

Core Dump

Support Request Email support@…

RAM

Logs

upon crash: store all of

RAM to flash

Page 19: ThingsCon Amsterdam 2015 - Martijn The
Page 20: ThingsCon Amsterdam 2015 - Martijn The
Page 21: ThingsCon Amsterdam 2015 - Martijn The
Page 22: ThingsCon Amsterdam 2015 - Martijn The
Page 23: ThingsCon Amsterdam 2015 - Martijn The

Cloud

Data Warehouse

Relational Database

Table

Mobile

App

Pebble

FlashAnalytics Storage

RAM

sent opportunisti-

cally, only when user consent is

given

Analytics Storage

Analytics Counters (reset & stored hourly)

sent opportunisti-

cally, only when user consent is

given

Page 24: ThingsCon Amsterdam 2015 - Martijn The
Page 25: ThingsCon Amsterdam 2015 - Martijn The

INSPIRE SET GOALS DEVELOP MEASURE EVALUATE

…REPEAT…

Page 26: ThingsCon Amsterdam 2015 - Martijn The

Median'Bu*on'Clicks/Launch'

Sustaine

d'Usage'Inde

x'

0'

0.1'

0.2'

0.3'

0.4'

0.5'

0.6'

0.7'

0.8'

0.9'

0' 5' 10' 15' 20' 25'Median'Bu*on'Clicks/Launch'

Sustaine

d'Usage'Inde

x'

0'

0.1'

0.2'

0.3'

0.4'

0.5'

0.6'

0.7'

0.8'

0.9'

0' 5' 10' 15' 20' 25'Median'Bu*on'Clicks/Launch'

Sustaine

d'Usage'Inde

x'

0'

0.1'

0.2'

0.3'

0.4'

0.5'

0.6'

0.7'

0.8'

0.9'

0' 5' 10' 15' 20' 25'

SHARING ANALYTICS INSIGHTS WITH PEBBLE APP DEVELOPERS

0"

0.5"

1"

1.5"

2"

2.5"

6/29/15"

7/6/15"

7/13/15"

7/20/15"

7/27/15"

8/3/15"

8/10/15"

8/17/15"

8/24/15"

8/31/15"

9/7/15"

9/14/15"

9/21/15"

Usage&Rate&

App w/o pin

App w/ pin

Start incorporating Timeline pins

0"

0.5"

1"

1.5"

2"

2.5"

6/29/15"

7/6/15"

7/13/15"

7/20/15"

7/27/15"

8/3/15"

8/10/15"

8/17/15"

8/24/15"

8/31/15"

9/7/15"

9/14/15"

9/21/15"

Usage&Rate&

0"

0.5"

1"

1.5"

2"

2.5"

6/29/15"

7/6/15"

7/13/15"

7/20/15"

7/27/15"

8/3/15"

8/10/15"

8/17/15"

8/24/15"

8/31/15"

9/7/15"

9/14/15"

9/21/15"

Usage&Rate&

0"

0.5"

1"

1.5"

2"

2.5"

6/29/15"

7/6/15"

7/13/15"

7/20/15"

7/27/15"

8/3/15"

8/10/15"

8/17/15"

8/24/15"

8/31/15"

9/7/15"

9/14/15"

9/21/15"

Usage&Rate&

0"

0.5"

1"

1.5"

2"

2.5"

6/29/15"

7/6/15"

7/13/15"

7/20/15"

7/27/15"

8/3/15"

8/10/15"

8/17/15"

8/24/15"

8/31/15"

9/7/15"

9/14/15"

9/21/15"

Usage&Rate&

0"

0.5"

1"

1.5"

2"

2.5"

6/29/15"

7/6/15"

7/13/15"

7/20/15"

7/27/15"

8/3/15"

8/10/15"

8/17/15"

8/24/15"

8/31/15"

9/7/15"

9/14/15"

9/21/15"

Usage&Rate&

Page 27: ThingsCon Amsterdam 2015 - Martijn The

TELEMETRY LOGGING

CORE DUMPS ANALYTICS

Page 28: ThingsCon Amsterdam 2015 - Martijn The

QUESTIONS?