Copyright © 2015 Splunk Inc.

Splunk in integration testingBetter not to make a mess than to clean it up

2

Splunk in integration testing

Better not to make a mess than to clean it up

3

Leading Cable TV and internet company of the NetherlandsRecently acquired by Liberty Global

Internet, Cable TV, mobile network, Telephony

4

My backgroundProgramme test manager (contracter)Experience in both test and operationsAuthor of a book on performance testing (available on Amazon)Joined a running programme in the integration phaseMy favorite Splunk tee-shirt tag line: Put that in your | and Splunk it

5

Testing

6

And the winner is

7

Exploratory testingTesting isn’t just creating and running some scripts

Simultaneous: learn / design executeNo up front scriptsFast, effectiveRelies on feedback what about logs?

8

Testing not the same

Testing or checking?Changed scene– Agile / devops / continuous delivery– SOA: chain or web?– Change based specs vs system based

9

Testers

Spider in the web (integration)Manage RCAMediate solutionsLooking for troubleTrouble shooting...

Ring a bell?

10

The situationLarge programme

Multiple vendorsInternal and off shore developmentInternal and off shore testing

Many new componentsMultiple teams and suppliers (off shore)Delays in integration (ticket ping pong)

Splunk guru in the team

11

Introduced SplunkTibco messages indexed in SplunkCore systems logs indexed in SplunkOrder tables (rising column)Created dashboards

Screenshot here

12

Application errors

12

13

Validations

13

14

Oracle (ORA) errors

14

15

Dreaded time-outs

15

16

The whip

16

17

Results

Solved the integration issuesTesters very happy:Insight in the total flowSelf service on test data issuesIssues assigned to the right teamFind the overlooked issues Jump started the integration phaseAfter care was cancelled due to NO reported issues

Team rule: no issue logged that hasn't been Splunked

17

18

Today’s challenges

18

19

Data’s story

19

DateTime Status CustI CorID Product Unit09/30/2015 10:45:00 Success B254788 CorID12548687 Apple 1

09/30/2015 10:45:01 Pending B356489 CorID12548688 Carrot 5

09/30/2015 10:45:02 Failed B366547 CorID12548689 Banana 5

CO12548689 2015-30-9 10:43:58.001 Order placed 5 Bananas

CO12548689 2015-30-9 10:44:20.001 Reply from logistics Bananas not by piece

CO12548689 2015-30-9 10:45:02 Order registered in Order DB Status failed

20

Why we do it

Testers: access, insight and first time right

(test) Management: facts and figures on quality and performance

Company: prevent embarrassing incidents, lower costs, faster time to market

20

21

Do’s

Get business process information in SplunkSOA messagesOrder tables (rising column)Logs, logs, logs

Get a Splunk expert on board.Create dashboards for test teams (detail)Create dashboards for management (pretty pictures)Train testers and admins

21

22

Splunk in test

Speeds up test phasesPrevents incidents in productionAn answer to today’s test challenges Facts and figures on qualityIncrease time to market Benefits increase exponentially with complexity

22

23

So why in test?

first time righthandle agile development handle complexityspeed up integration

23

24

Find a question?

24

Diagrams, Icons and Templates

25

26

Splunk Icons

Search Bar chart Lock Cloud Cloud – alt Folder Envelope

Storage - 3Storage

Server Indexer Forwarder Search head

Datacenters

Splunk serverFirewall

Desktop Laptop

Failed server

Hadoop storage Datacenter

27

Splunk Icons

Application - alt Virtual machine Virtual server Network www or Global Tools

Log file Router Load balancer Script

Pie chart Gears/Settings Gear Messaging Tag/ticket

Document

Application

Analyze

Network Switch

Shield

Active Directory

28

Splunk Icons

Checkmark InfoAlert StopiPhoneiPadAndroid

Twitter Facebook LinkedIn RSS You Tube Shopping cartGPS Tower

Healthcare Hospital Office building VoIP Phone Support POS Card Reader RFID

29

Splunk Icons

Forwarder - AIX Forwarder- Datastore Forwarder- Free BSD Forwarder- Linux Forwarder- Windows Forwarder- Web Forwarder- OSX

Forwarder- Solaris Splunk server - AIX Splunk server - Datastore

Splunk server - Gear

Splunk server - Linux

Splunk server - Network

Splunk server - Web

Splunk server - OSX Splunk server – Free BSD

Splunk server – Solaris Splunk search Failed Splunk server

30

Splunk Icons

31

Splunk Icons

Pivot

Cluster management

Analytics Store Data model

Forwardermanagement

HomeMaps

Predictiveanalytics

Simpledashboard

Webframework

Customdashboard

Enhanced search

32

Arrows

33

Boxes

34

Assign Default Object Style

35

Splunk Object Style and Color

Hardware ProductBusiness/Corporate

Highlight OnlyGenericVirtualization

Generic

These are suggested uses for colors only.

36

Applying Splunk Object Style

To apply the Splunk object style to any shape:1. Select the shape (Object A) with the desired style2. Click on Format Painter (paintbrush) tool in toolbar3. Click on new shape (Object B) to apply style

37

Logos

Corporate logo Product logo Product logo with Version Number

38

Logos

39

Logos

40

App Icons

41

Splunk Enterprise Overview

AlertsMessages Metrics ChangesScriptsConfigurationsLog Files

Indexes Any Data from Any Source

DatabasesNetworks Servers Virtual Machines

Smartphones and Devices

CustomApplicationsSecurity

Tickets

WebServerSensors

42

Splunk Enterprise ScalabilityEnterprise-class Scale, Resilience and Interoperability

Send data from thousands of servers using any combination of Splunk forwarders

Auto load-balanced forwarding to Splunk Indexers

Offload search load to Splunk Search Heads

43

Integrated Analytics Platform for Hadoop Data

43

Full-featured, Integrated Product

Insights for Everyone

Works with What You Have Today

Explore Visualize Dashboards ShareAnalyze

Hadoop (MapReduce &

HDFS)

NoSQL Data Stores

44

Industry Leading Platform for Machine DataAny Machine Data Operational Intelligence

HA Indexes and Storage

Search and Investigation

Proactive Monitoring

Operational Visibility

Real-time Business Insights

CommodityServers

Online Services Web

Services

ServersSecurity GPS

Location

StorageDesktops

Networks

Packaged Applications

CustomApplicationsMessaging

TelecomsOnline

Shopping Cart

Web Clickstreams

Databases

Energy Meters

Call Detail Records

Smartphones and Devices

RFID

45

Table ExampleColumn Title Column Title Column Title Column Title

Text Text Text Text

Text Text Text Text

Text Text Text Text

Text Text Text Text

Text Text Text Text

46

Quote Box

Our mission is to make machine data accessible, useable and valuable to everyone.

Thank You