Performance Testing Obiee

8/3/2019 Performance Testing Obiee

1/35

Robin Moffatt, WM Morrisons plc http://rnm1978.wordpress.com


2/35

Oracle BI specialist at Morrisons plc

Big IT development programme at its earlystages implementing OBIEE, OBIA, ORDM, allon Oracle 11g & HP-UX


3/35

A Performance Tuning Methodology

OBIEE techie stuff

Learn from my mistakes!


4/35

Response times

Report

ETL batch OLTP transaction

System impact Resource usage

Scalability


5/35

Check that your system performs

Are the users going to be happy?

Baseline How fast is fast?

How slow is slow?

Validate system design

Do it right, first time

Capacity planning


6/35

Its never too late

Youll never catch all your problems in pre-

production testing. Thats why you need a reliableand efficient methodfor solving the problems thatleak through your pre-production testingprocesses.

Cary Millsap - Thinking Clearly About Performance
http://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performance


7/35

Because it makes you better at your job

At the very least, your performance test plan willmake you a more competent diagnostician (andclearer thinker) when it comes time to fix theperformance problems that will inevitably occur

during production operation.

Cary Millsap - Thinking Clearly About Performance
http://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performancehttp://method-r.com/downloads/doc_details/44-thinking-clearly-about-performance


8/35

Quantifying response times

System impact

User expectations Problem diagnosis

Design validation


9/35

Define

Measure

Analyse

Review

Implement

Timebox!Evaluate design /config options

Do it rightDont fudge it

Do more testing

Redefinetest Do more testing

D fi


10/35

Define what are you going to test Aim of the test

Scope Assumptions

Specifics

Data, environment, etc

Build how are you going to test it OBIEE specific

Define

Measure

Analyse

Review

Implement

E.g. :Check that the system performs

Baseline performanceProve system capacityValidate system design

D fi


11/35

More components = more complex = more variables = larger margin of errorFewer components = easier to manage = more precise = more efficient

Define

Measure

Analyse

Review

Implement

Define


12/35

Database

PresentationServices

BI Server

Report /Dashboard

Logical SQL

Physical SQLstatement(s)

Data set(s)

Data set

Renderedreport

Excludes App/Web server & presentationservices plug-in

Define

Measure

Analyse

Review

Implement

Define


13/35

Database


BI Server

nqcmd

SQL Client

PhysicalSQL

LSQL

PhysicalSQL

User &Stopwatch

Load Testing tool(eg. LoadRunner,

OATS)

Define

Measure

Analyse

Review

Implement

Define


14/35

Database

BI Server

nqcmd

PhysicalSQL

LSQL

Define

Measure

Analyse

Review

Implement

Define


15/35

Define

Measure

Analyse

Review

Implement

Usage Trackingor NQQuery.log

Test

scrip

t

BIServer

Data

nqcmd

LogicalSQL

LogicalSQL Logical

SQL

Define


16/35

Mastertestscript

Define

Measure

Analyse

Review

Implement

Test

script

BIServer

Data

nqcmd

LogicalSQL

Test

script

nqcmd

Test

script

nqcmd

Test

script

nqcmd

Define


17/35

Simulates user interaction HTTP traffic

Powerful, but can be difficult to set up Ajax complicates things

Do you really need to use it?

Tools Fiddler2

FireBug

Reference: My Oracle Support Doc ID 496417.1

http://rnm1978.wordpress.com/category/loadrunner

Define

Measure

Analyse

Review

Implement

Define


18/35

Be very clear what the aim of your test is You probably need to define multiple tests

Different points on the OBIEE stack tointerface

Pick the most appropriate one

Write everything down!

Measure

Analyse

Review

Implement


19/35

Define

Measure

Analyse

Review

Implement

Define


20/35

Database


BI Server

PresentationServices plug-in

App Server

Web ServerApache log

OAS log

Analyticslog

sawserver.log

NQServer.log

NQQuery.log

systemsmanagement

Enterprise

ManagerBI Management Pack

UsageTracking

PerfMon(windows

only)

jConsole etc

Presentationservices

EnterpriseManager

ASH, AWR,SQL Monitor

Measure

Analyse

Review

Implement

Server metricse.g. : IO, CPU, Memory

PerfMon(Windows)

Oracle OSWatcher

(unix)

EnterpriseManager(Oracle)

Define


21/35

Measure

Analyse

Review

Implement

Define


22/35

Lots of different ways to measure

Build measurement into your test plan Automate where possible

Easier

Less error

Measure

Analyse

Review

Implement


23/35

Define

Measure

Analyse

Review

Implement

Define


24/35

Measure

Analyse

Review

Implement

Define


25/35

Measure

Analyse

Review

Implement

Define


26/35

Response time

1

1

9

3

2

10

2

1

23

Response time

1

1

1

2

2

2

3

3

9

10

Average(mean)

3.4

50th percentile(Median)

2

90th percentile

9.1

Measure

Analyse

Review

Implement

Define


27/35

Measure

Analyse

Review

Implement

Dashboard

Requests

ORA_HASH(QUERY_TEXT)Logical SQL

SQL IDsPhysical SQL

Execution plan hash idExecution plan

Define


28/35

S_NQ_ACCTSTART_TSROW_COUNTTOTAL_TIME_SECNUM_DB_QUERYQUERY_TEXTQUERY_SRC_CDSAW_SRC_PATHSAW_DASHBOARD

OBIEE_REPLAY_STATEMENTSqt_ora_hashquery_textsaw_pathdashboard

OBIEE_REPLAY_STATStestidtestenvqt_ora_hash

start_tsresponse_timerow_countdb_query_cnt

Measure

Analyse

Review

Implement


29/35

Define

Measure

Analyse

Review

Implement

Evaluate design /config options


Timebox!


30/35

Define

Measure

Analyse

Review

Implement

Redefinetest

Continuetesting

Implement

Define


31/35

Measure

Analyse

Review

Implement


32/35

Define

Measure

Analyse

Review

Implement


33/35

You wont get your testing right first time Theres no shame in that Dont cook the books

Better to redefine your test than invalidate its results

Stick to the methodology Dont move the goalposts Very tempting to pick off the low-hanging fruit

If you do, make sure you dont get indigestion

Timebox

Test your implementation!


34/35

Define

Measure

Analyse

Review

Implement

Evaluate design /config options


Do more testing

Redefine

test Do more testing

[email protected] http://rnm1978.wordpress.com http://twitter.com/rnm1978


35/35

Performance Testing Obiee

Documents

Transcript of Performance Testing Obiee