How to Use Big Data to Transform IT Operations

23
How to Use Big Data to Transform IT Operations Jesse Rothstein, CEO, ExtraHop Doug McMartin, Director of Product Development Standards, McKesson

Transcript of How to Use Big Data to Transform IT Operations

Page 1: How to Use Big Data to Transform IT Operations

How to Use Big Data to Transform IT OperationsJesse Rothstein, CEO, ExtraHopDoug McMartin, Director of Product Development Standards, McKesson

Page 2: How to Use Big Data to Transform IT Operations

Introduction

Doug McMartinDirector of Product Development Standards

Jesse RothsteinCEO

Data Gravity

Signal-to-Noise

Motion of Data

Page 3: How to Use Big Data to Transform IT Operations

Agenda

• The next-generation IT Big Data approach• Moving toward real-time observational

data• Key considerations for IT Big Data• IT Big Data use cases• Q&A

Page 4: How to Use Big Data to Transform IT Operations

A Tool-Centric Approach = IT Silos

NetworkAdministrators

Virtualization Team

Database Administrators

VDIAdministrators

Application Owners

Business Analysts

Storage Administrators

Security Operations

Page 5: How to Use Big Data to Transform IT Operations

A Tool-Centric Approach = IT Silos

NetworkAdministrators

Virtualization Team

Database Administrators

VDIAdministrators

Application Owners

Business Analysts

Storage Administrators

Security OperationsBig Data

for IT

Page 6: How to Use Big Data to Transform IT Operations

Data-Driven Ops: “See with Data”

BUSINESS & OPERATIONS ANALYTICS

OPTIMIZATION & CONTINUOUS IMPROVEMENT

PROACTIVE MONITORING & REMEDIATION

PERVASIVE SECURITY MONITORING & COMPLIANCE

Page 7: How to Use Big Data to Transform IT Operations

Tapping New Sources of Visibility

Driven byBig Data

Technology

Machine Data

Wire Data

Page 8: How to Use Big Data to Transform IT Operations

Wire Data

All communicationon the network from packets to payload

1000 x biggerthan machine data

Definitivesource of truth

Data youalready have

Page 9: How to Use Big Data to Transform IT Operations

Wire Data: Real-Time Observational Analysis

A small sample of what wire data contains…

All L2-L7 communication on the network

From Unstructured PacketsTo Structured Wire Data

Extracting real-time insight from all

communication and data streams

Business DataProduct ID

Customer ID

Shopping Cart ID

Cart Items

Cart Values

Discounts

Order ID

Abandoned?

Application DataPOST Content

AJAX Data

Section

Sub-Section

Page Title

Session Cookie

Proxied IP Address

Error Message

Availability DataHTTP status codes

Application errors

Connection resets

Heartbeats

SSL certificate validity

Synthetic pingers

SNMP traps

Authentication errors

Capacity DataThroughput

Transactions

Dropped packetsApplication stallsApplication slowdowns

Geolocation/IP mapping

Storage Access (reads/writes)

SSL Offload

Security DataCommand and ControlShadow IT (SaaS, cloud)Network traversalUnauthorized outbound connections & protocolsStorage/DB accessBlacklisted traffic

Brute force attacks

Surreptitious tunneling

Performance MetricsCaching Behavior

Compression Behavior

Base HTML Load Time

Round Trip Time

Client Request Time

Server Reply Time

Server Send Time

Total Time Taken

Page 10: How to Use Big Data to Transform IT Operations

Self Reporting + Observation = Insight• Self-reported data

(machine data)– “What are your symptoms?”– “When did this start?”– “Does this hurt?”

• Observational data (wire data)– MRI– Blood tests– Heart rate, pupil dilation,

appearance, etc.

Page 11: How to Use Big Data to Transform IT Operations

IT Operations Analytics SurveyExtraHop and TechValidate partnered to survey 88 respondents from 65 organizations that use the ExtraHop platform.• 65% of respondents are combining data sources for ITOA now, or plan to do so

within one year• 54% of respondents are currently integrating wire data and machine data in

some manner• 67% of respondents saw ITOA capabilities as important for IT security

Page 12: How to Use Big Data to Transform IT Operations

Key Considerations for IT Big Data

Moving data around can be expensive

Data Gravity

Pull out more of the signal, filter out more of the noise

Signal-to-Noise

Understand when real-time access to data is

important

Motion of Data

Page 13: How to Use Big Data to Transform IT Operations

Data Gravity

more expensive

DATA

Page 14: How to Use Big Data to Transform IT Operations

Signal-to-Noise Ratio

Signal

• Garbage in; garbage out• Examples of data

sources with poor quality– Threat detection– Verbose logging

• Time is required to separate signal from noise

Page 15: How to Use Big Data to Transform IT Operations

Motion of DataData at Rest (Batch processing)Example: MapReduce in Hadoop

Data in Motion (Stream processing) Example: Apache Spark, ExtraHop

DB

DB

DBData mart

user

report

query

source

source

source

Batch 1Batch 2

user

Page 16: How to Use Big Data to Transform IT Operations

SOLUTION

CHALLENGE

McKesson Managed ServicesBACKGROUND

“ ExtraHop enables us to solve incredibly complex problems in a

matter of hours. Extrapolated across our business, we’re saving

at least $400,000 annually in terms of time spent troubleshooting.”

─ Scott Checkoway, Director of Application Hosting

• Citrix application launch times dropped 75% (40 to 12 sec)• Staff optimization: from 2.6 to 1 engineer for every 4

hospitals - $260,000 savings in first year• Reduced MSFT SQL licenses - $200,000 savings annually• Understand the impact of application updates

• Complex: Hospitals’ and McKesson’s IT environments• Equip IT generalists; lessen reliance on specialists• High coordination costs, slow troubleshooting processes• Operational costs increased while user satisfaction

decreased

• Hosted healthcare applications for hospitals• 7x24x365 mission critical operations• Rapidly growing customer base• Stringent and costly performance-based SLAs

Page 17: How to Use Big Data to Transform IT Operations

Citrix Environments Are Complex!• Is there latency between the user and web server?• Slow Active Directory server?• Network issues in the Citrix cluster?• Contention in the SAN?

Page 18: How to Use Big Data to Transform IT Operations

See across Citrix, web, database, storage, LDAP, DNS, etc.

Visibility on the WireCorrelate activity across all tiers with wire data

Monitor SLAs in real time.

Drill into critical KPIs (launch, load times, etc.) per user.

Page 19: How to Use Big Data to Transform IT Operations

Visibility Into Citrix Application Delivery

McKesson improved Citrix application launch times by

75% with ExtraHop.

McKesson avoided more than $260,000 in staffing costs in its first year with ExtraHop.

Page 20: How to Use Big Data to Transform IT Operations

Understand the Impact of Application Updates

• Improved user experience

• Fewer surprises for IT Ops

• Faster feedback for app teams

BENEFITDrill down to see how SQL queries are performing.

Compare performance across versions and across time periods.

Page 21: How to Use Big Data to Transform IT Operations

Identify Active/Inactive Databases

Saved $200,000 annually in reduced database license costs.

BENEFIT

See all database transactions.

Show all activity by every database and degree of usage.

Page 22: How to Use Big Data to Transform IT Operations

Operations Analytics: Real-Time Patient Tracking

Observe admittance, discharge, and transfers (ADTs) in real time.

Who and how many are being admitted right now? Do we need to adjust staff?

Track admissions by location and gender.

Why are so many males being admitted in Kent? Is it an epidemic?

• Optimize processes and staffing for improved patient quality.

• Identify potential epidemics.

BENEFIT

Page 23: How to Use Big Data to Transform IT Operations

Questions?

Explore the Power of Real-Time Operational

Intelligence

www.extrahop.com/demo