The Future of APM and Why It Requires Analytics Everywhere!
-
Upload
new-relic -
Category
Data & Analytics
-
view
695 -
download
2
Transcript of The Future of APM and Why It Requires Analytics Everywhere!
![Page 1: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/1.jpg)
Presenter Name, Title and or DateThe Future of APM…and why it requires analytics everywhere!Patrick Lightbody, VP, Product Management@plightbo ©2008-15 New Relic, Inc. All rights reserved.
![Page 2: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/2.jpg)
©2008-15 New Relic, Inc. All rights reserved.
![Page 3: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/3.jpg)
ApplicationPerformanceManagement
©2008-15 New Relic, Inc. All rights reserved.
![Page 4: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/4.jpg)
Are the servers ok?
©2008-15 New Relic, Inc. All rights reserved.
![Page 5: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/5.jpg)
Average CPU Utilization
©2008-15 New Relic, Inc. All rights reserved.
![Page 6: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/6.jpg)
Average CPU Utilization
©2008-15 New Relic, Inc. All rights reserved.
Database servers
Web servers
![Page 7: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/7.jpg)
Per Server Load Average
©2008-15 New Relic, Inc. All rights reserved.
East Coast
West Coast
![Page 8: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/8.jpg)
©2008-15 New Relic, Inc. All rights reserved.
Dimension ExamplesHost ecomm-ws-1.acmecorp.com
Cluster ecomm-web-server, ecomm-db, etc.
Region East Coast, West Coast, etc.
Application Storefront, Inventory Service, etc.
Instance Type Micro, Small, Large, etc.
Availability Zone east-coast-1, west-coast-2, etc.
Operating System Linux vs. Windows (with version)
Purpose Internal vs. External
Attributes
![Page 9: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/9.jpg)
Is the software ok?
©2008-15 New Relic, Inc. All rights reserved.
![Page 10: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/10.jpg)
Application Response Times (ms)
©2008-15 New Relic, Inc. All rights reserved.
![Page 11: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/11.jpg)
Transaction Response Times (ms)
©2008-15 New Relic, Inc. All rights reserved.
Other
Checkout
Login
Add to Cart
![Page 12: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/12.jpg)
Checkout Transaction Breakdown (ms)
©2008-15 New Relic, Inc. All rights reserved.
REST
Database Cach
eJava
![Page 13: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/13.jpg)
©2008-15 New Relic, Inc. All rights reserved.
Dimension ExamplesTransaction Name Checkout, Add To Cart, Login, etc.
Total Response Time (total time spent running the transaction)
Tier Response Time 152ms calling a REST service, 593ms calling the DB, etc.
Response Code 404 Not Found, 500 Server Error, etc.
Error Message NullPointerException
Transaction Type Page View, Ajax, Message Queue, etc.
HTTP Verb POST vs. GET
Browser Chrome, Safari, IE, Mobile or Desktop?
More attributes
![Page 14: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/14.jpg)
Are the customers ok?
©2008-15 New Relic, Inc. All rights reserved.
![Page 15: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/15.jpg)
©2008-15 New Relic, Inc. All rights reserved. By Andrew Malone (Blank stare Uploaded by Markos90) [CC BY 2.0], via Wikimedia Commonshttps://commons.wikimedia.org/wiki/File%3ABlank_stare.jpg
![Page 16: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/16.jpg)
Customer Breakdown
©2008-15 New Relic, Inc. All rights reserved.
REST
Database Cach
eJava
Mary buys 2 green widgets
Carlos buys 3 blue
widgets
Anita buys 1 green widget
Acme Corp. buys 10,000 purple
widgets
![Page 17: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/17.jpg)
Customer Breakdown
©2008-15 New Relic, Inc. All rights reserved.
REST
Database Cach
eJava
Mary buys 2 green widgets
shipping to Boston
Carlos buys 3 blue widgets
shipping to Portland
Anita buys 1 green widget
shipping to London
Acme Corp. buys 10,000 purple
widgets shipping to Dallas
![Page 18: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/18.jpg)
Customer Breakdown
©2008-15 New Relic, Inc. All rights reserved.
REST
Database Cach
eJava
Mary buys 2 green widgets
shipping to Bostonusing her credit card
Carlos buys 3 blue widgets
shipping to Portlandusing his credit card
Anita buys 1 green widget
shipping to Londonusing a gift card balance
Acme Corp. buys 10,000 purple
widgets shipping to Dallas
using a corporate P.O.
![Page 19: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/19.jpg)
©2008-15 New Relic, Inc. All rights reserved.
![Page 20: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/20.jpg)
Even more attributes
©2008-15 New Relic, Inc. All rights reserved.
Dimension ExamplesCustomer ID “Mary” or email address or 823562
Account Name Acme, Globex, Initech, Hooli, etc.
Customer Type Free, Trial, Paid, Premium, etc.
Item Quantity …
Item Details Color, Size, etc.
Cart Value $100 or S, M, L, XL
Shipping Address City, State, Zip Code, Country, etc.
Payment Mechanism Credit card type, gift card, PO, etc.
![Page 21: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/21.jpg)
©2008-15 New Relic, Inc. All rights reserved.
Virtually every business
is now asoftware business
![Page 22: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/22.jpg)
Managing Software Requires Context
©2008-15 New Relic, Inc. All rights reserved.
![Page 23: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/23.jpg)
©2008-15 New Relic, Inc. All rights reserved.
Relational DataApp Server
Customer Web ServerBrowser
23
Public Cloud
NoSQL data store
Private Cloud
API Micro Services
Private Cloud
Application Data
Business DataCustomer Experience
Data
Mobile / Apps / Browser
Managing Software has become a
Big Data Problem
![Page 24: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/24.jpg)
620,448,401,733,239,439,360,000
©2008-15 New Relic, Inc. All rights reserved.
![Page 25: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/25.jpg)
Managing software requires LOSSLESS data
©2008-15 New Relic, Inc. All rights reserved.
OR
![Page 26: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/26.jpg)
Managing software requires DIMENSIONAL data
©2008-15 New Relic, Inc. All rights reserved.
▪App service/transaction, time ▪Error Code▪Instance Type, Server,
Container▪Script, Error, Page, Location,
Server
• App service/transaction, Time
• Geography, Network• Browser, Action, Page,
Session• Device, Crash, Action,
Session
▪Customer ID, New/Existing, Type▪Product ID, Category Type, Content
Type▪Revenue, Cart Size, Traffic, Ad
Impressions
24 dimensions =620 sextillion
different combinations
BusinessSuccess
ApplicationPerformance
CustomerExperience
![Page 27: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/27.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. FOR INTERNAL USE ONLY 27
Managing software requires data at SCALE
Time
Dat
aLossless business outcomes
Lossless customer experienc
e
Lossless performanc
e
Lossy customer
experience
Lossy app performanc
e
![Page 28: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/28.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. FOR INTERNAL USE ONLY 28
Managing software requires ITERATIVE exploration
Dive into
root of cause
Start here➔
Customers report bad experience
Which companies?
Which individuals?
Revenue impact?
How slow?
Bottlenecked at frontend, network, or backend?
Different by geography?
Different by device?Slow frontend assets?
Network bottlenecks?
Which backend app?
Which portion of backend code?
Database bottlenecks?
Backend error?
![Page 29: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/29.jpg)
Dev
Confidential ©2008-15 New Relic, Inc. All rights reserved. FOR INTERNAL USE ONLY 29
Managing software requires COMMON DATA
Eliminate silos for a collaborative, data-driven organization.
OpsProductSoftware
Data
![Page 30: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/30.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. FOR INTERNAL USE ONLY 30
Managing software requires software analytics
How are customers engaging?
Am I open for business
How is my business doing? Lossless data
With many dimensions
Can be iteratively explored
Common across teamsApplicationPerformanc
e
CustomerExperienc
e
BusinessSuccess
![Page 31: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/31.jpg)
Secure, Elastic, Multi-tenant Cloud Solution
©2008-15 New Relic, Inc. All rights reserved.
Secure, Elastic, Multi-tenant Cloud Solution
![Page 32: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/32.jpg)
Analytics Everywhere!
©2008-15 New Relic, Inc. All rights reserved.
Announcing… every Pro & Enterprise customer of APM, Browser or Mobile gets Insights with 8 Days of data retention
![Page 33: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/33.jpg)
©2008-15 New Relic, Inc. All rights reserved.
![Page 34: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/34.jpg)
©2008-15 New Relic, Inc. All rights reserved.
![Page 35: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/35.jpg)
©2008-15 New Relic, Inc. All rights reserved.
![Page 36: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/36.jpg)
36
MAKING VIDEO ADS PERSONAL
Tony ChongVP Engineering
![Page 37: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/37.jpg)
37
Who We are?
- Vungle's mission is to ensure no two users have the same video ad experience
- 6 Countries, 160+ Employees- Android and iOS SDK- Node.js backend- 1000+ EC2 instances in AWS- 2.5B requests per day
![Page 38: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/38.jpg)
38
New Relic
- APM for application health- Initially used for 1 QA instance of our Dashboard tool,
moved to Prod fleet in a few weeks- Goto tool for Production issues
- Insights for traffic intelligence- What type of data do we have?- How many types of requests are we serving per day?
per month?- Is there something wrong?
![Page 39: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/39.jpg)
39
APM
- Response Time- Deployments- Error Rate- Throughput- Transactions
![Page 40: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/40.jpg)
40
![Page 41: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/41.jpg)
41
Insights
- Custom Dashboards- NRQL- Different perspectives
![Page 42: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/42.jpg)
42
Insights - Custom Dashboards
![Page 43: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/43.jpg)
43
Insights - Custom Dashboards
![Page 44: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/44.jpg)
44
Insights - NRQL
![Page 45: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/45.jpg)
45
Insights - Different Perspectives
![Page 46: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/46.jpg)
Jason DominaSr. Director, Technical Operations
![Page 47: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/47.jpg)
All content copyright © CafePress. All rights reserved.4747
Who are we?• Created ‘Print On Demand’ in 1999• High volume retail site• Average 600,000 sessions daily• But peak at 4-5 million during the holidays
• If you’re interested/passionate about something, we’ve got a t-shirt, mug, etc… for it. Lot’s of them in fact.
• No, seriously, like millions of them.
![Page 48: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/48.jpg)
All content copyright © CafePress. All rights reserved.4848
CORGI-ZILLA
![Page 49: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/49.jpg)
All content copyright © CafePress. All rights reserved.4949
We care a lot about who’s viewing what
![Page 50: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/50.jpg)
All content copyright © CafePress. All rights reserved.5050
How Fast are we going? Where, Who, How?
![Page 51: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/51.jpg)
All content copyright © CafePress. All rights reserved.5151
Whoa, what happened?
![Page 52: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/52.jpg)
All content copyright © CafePress. All rights reserved.5252
Wait, there’s a difference between Mac and PC users?
![Page 53: The Future of APM and Why It Requires Analytics Everywhere!](https://reader035.fdocuments.net/reader035/viewer/2022062822/5883b7331a28ab5c378b4c0f/html5/thumbnails/53.jpg)
©2008-15 New Relic, Inc. All rights reserved.