Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat&...

37
Going Beyond the Device Heart Beat Balwinder Kaur, Principal Software Engineer

Transcript of Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat&...

Page 1: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Going  Beyond  the  Device  Heart  Beat  

Balwinder  Kaur,    Principal  Software  Engineer

Page 2: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Agenda

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 2

• Introduction• The  Basics• An  IoTWorld

o Device  Visibilityo Application  Visibility

• Best  Practices  for  End  to  End  Performance  Monitoring• Unique  Challenges  of  IoT• Q&A• SummaryDisclaimer:  "Opinions  expressed  are  solely  my  own  and  do  not  express  the  views  or  opinions  of  my  employer."

Page 3: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Introduction

Page 4: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Connected  Things  Disrupt  Business  Models

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 4

Oslo  Smart  Lighting

Page 5: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 5

“IoT devices  directly,  or  indirectly,  impact  the  

bottom  line  of  a  business."

Page 6: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Making  the  headlines

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 6

Page 7: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 7

How  do  I  prevent  an  NYT  moment?

Page 8: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

The  Basics

Page 9: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

The  Device

Page 10: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

What  is  an  IoT Device?

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 10

Traditional  Embedded  Device+

Connectivity+  

Cloud  Services

Page 11: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Are  all  IoT “Things”  equal?

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 11

• No• A  very  fragmented  space• Classify  to  manage

GatewayEndpoints

w/Routing

Endpoints  w/o

RoutingSensor  Rich  |Touches  the  Physical  WorldDigital

Page 12: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

The  Cloud

Page 13: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

IT  Teams  Monitor  Cloud  Services

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 13

Infrastructure  Monitoring• Server  Monitoring• Network  Monitoring

Application  Performance  Monitoring  (APM)  Systems

• Web  applications  &  containers• Database  Performance• Byte  Code  Injection  is  popular

Log  Files Crash  Reports

Page 14: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Application  Performance  Monitoring  System

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 14

“One  of  the  most  important  steps  in  any  application  performance  monitoring  initiative  is  combining  data  from  disparate  monitoring  "silos"  into  a  correlation  engine and dashboard.  The  dashboard  makes  data  logs  easier  to  read  and  saves  IT  staff  from  memory-­‐dependent   and  error-­‐prone  manual  correlation  and  analysis.”

• Source:  http://searchenterprisedesktop.techtarget.com/definition/Application-­‐monitoring-­‐app-­‐monitoring

Page 15: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

An  IoT World

Page 16: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

End  to  End    IoT Solution  Architecture  Diagram

Page 17: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Changing  Business  Models

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 17

• Performance  monitoring  must  be  extended  to  cover  the  IoTDevices

IoT Device Cloud  Services

End  to  End  Reliability

Page 18: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Device  Visibility

Page 19: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 19

IoT Device  Visibility

Device  Management  

Systems

Device  Management

Device  Health

Application  Performance  Management

Application  Health(on  device)

Application  Health(transactions)

Not  operational

data

On  device;    closely  related

Main  Focus  Area

Page 20: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Device  Health

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 20

System    Performanceü CPU  Usageü Memory  Usageü Power  Levelü Uptime  ü Disk  I/Oü Network  Healthü Location  Information

Fast  Moving  Data

Device  Configurationü OSü Modelü Manufacturerü Hardware,  Firmware,  S/W  

Version

Slow  Moving  Data

Page 21: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Application  Visibility

Page 22: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

IoT Device Cloud  Services

End  to  End  Reliability

Application  Transaction  Health

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 22

1) Calls  per  minute2) Errors  per  minute

3) Latency  (in  milliseconds)4) Crash  Reporting

Measurement  Metrics

Page 23: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Two  Classes  of  Problems

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 23

ü Transaction  Health  is  goodü Device  Health  is  

deteriorating

ü Device  Health  is  good.ü Transaction  Health  is  poor

ü Network  Problemsü S/W  Version  mismatchü S/W-­‐ H/W  version  mismatch

Device  Management  System Application  Performance  Management  Systems

Page 24: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Key  Performance  Indicator  -­‐ MTTR

24

.Trapped  Metrics

Manual  Correlation

ManualRemediation

Copyright  ©  2015  AppDynamics.  All   rights   reserved.

Major  Reasons  Contributing  to  a  Poor  MTTR  (Mean-­‐Time-­‐to-­‐Resolution)

Gap  between  Operations  

and  Engineering

Page 25: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Unified  Dashboard

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 25

Unified  Monitoring

Device  Health Application  Health Infrastructure  Health

IoT Device Cloud  Services

Device  Management  Systems APM  Systems

Page 26: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

End-­‐to-­‐End  Performance  MonitoringBest  Practices  for  IoT

Page 27: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Top  Five  Features

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 27

Performance

Correlation

Remediation

Analytics

Availability

Page 28: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Device  Side  Instrumentation

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 28

Capture  and  report  Device  Metrics

Capture  and  report  Device  Events

Page 29: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Unified  Monitoring  System

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 29

AggregatesMetrics  and  Events

Correlates  Events   Alerts Remediates

Page 30: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Unique  Challenges  that  IoT brings(aka  devil  is  in  the  details)

Copyright  ©  2015   30

Page 31: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Choosing  Instrumentation  Agents  for  IoT Devices

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 31

Web  Agent Embedded  Agent

Message  Payload Format JSON ProtoBuf,  CBOR. BSON  

Application  Layer HTTP/HTTPS MQTT/MQTT-­‐SN,CoAP

Security TLS DTLS

Transport  Layer TCP/UDP UDP

Network  Layer IPv4/IPv6 IPv6/  6LowPAN

Link  Layer Ethernet, 802.11 802.15.4

Page 32: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Choosing  Instrumentation  Agents  for  IoT Devices  (contd)

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 32

• Small  static  and  runtime  memory  footprint• Small  disk  usage.  • Meets  or  exceeds  security  requirements  of  the  IoT Device

• Support  for  your  favorite  programming  language.

Page 33: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

OPEN  DISCUSSION

Copyright  ©  2015   33

Page 34: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

SUMMARY

Copyright  ©  2015   34

Page 35: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Best  Practices

ü Monitor  Device  Healthü Understand  what  device  data  is  importantü Understand  what  device  applications  are  importantü Monitor  End  Devices  and  Gatewaysü Monitor  Application  Transactions  Healthü Monitor  Cloud  Servicesü Embedded  Agents  should  meet  power,   security  and  privacy  requirementsü Unified  View  of  the  world   reduces  MTTR

Page 36: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Copyright  ©  2015  AppDynamics.  All   rights   reserved. 36

A  Heart  Beat  is  Important.But  do  not  be  on  Life  Support.

Stay  IoT [email protected]

Page 37: Going&Beyond&the&Device&Heart&Beat& · Going&Beyond&the&Device&Heart&Beat& Balwinder*Kaur,*Principal*Software*Engineer

Thank  You

Copyright  ©  2015   37