RDA and Diags

8/12/2019 RDA and Diags

1/73

Remote Diagnostic Agent & DBA Diagnostics

Tom Wright

Proactive Support Education

[email protected]


2/73

This document is for informational purposes. It is not acommitment to deliver any material, code, or functionality, and

should not be relied upon in making purchasing decisions. The

development, release, and timing of any features or

functionality described in this document remains at the sole

discretion of Oracle. This document in any form, software or

printed matter, contains proprietary information that is the

exclusive property of Oracle. This document and information

contained herein may not be disclosed, copied, reproduced or

distributed to anyone outside Oracle without prior written

consent of Oracle. This document is not part of your license

agreement nor can it be incorporated into any contractual

agreement with Oracle or its subsidiaries or affiliates.

This presentation is for informational purposes only and may not be incorporated into a contract or agreement.


3/73


4/73

Remote Diagnostic Agent

RDA is a set of command line, diagnostic and data collection scripts

RDA is used to gather detailed diagnostic information about an Oracle

environment

Oracle Support encourages the use of RDA because it provides acomprehensive picture of the customer's environment. It collects useful

data for Oracle Support only and a security filteris provided if required.
https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&id=314422.1https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&id=314422.1


5/73

Why use RDA?

ProactiveProblem Avoidance

Reduce cycle time to Service Request resolution.

RDA is essential for the following types of Service Requests: Acquired company product issues

Developer issues

Installation/configuration issues

ORA-600, ORA-7445, ORA-3113, and ORA-4031 errors

Oracle Database issues

Oracle Application Server/Fusion Middleware issues

Oracle Collaboration products (Oracle Collaboration Suite and Oracle Beehive)

Oracle Application issues

Other corrective issues

Performance issues

Upgrade, migration, and linking issues

Other corrective issues


6/73

Why use RDA? (contd)

Characteristics

Compact File Size - < 5MB*

PortableMulti-platform / OSs

Secure coding standards (password encryption)

Security Filterfilters out sensitive data (hostnames, IPs etc)

Execution Modes

Profile Options

Modular Options

Full


7/73

Products Supported OLAP Products (Express Server, Financial Analyzer, and Demand Planning Server)

Oracle Application Server (iAS 1.0.2.x/9.0.x/10.1.2.x/10.1.3.x,10.1.4.x,WebLogic Server (WLS) Release 9.x and 10.x,11g

(WLS), HTTP Server,WebCache,J2EE/OC4J)

Oracle Billing and Revenue Management products Oracle BPEL Process Manager

Oracle Collaboration Suite (Email Server,Calendar,Discussions,Content Services,Workspaces,WebClient,and Wireless)

Oracle Data Integrator

Oracle Developer (Forms and Reports)

Oracle Ebusiness Suite 11i and 12

Oracle Enterprise Content

Oracle Enterprise Single Sign-on

Oracle Enterprise performance management (Hyperion) products

Oracle Guardian

Oracle Identity Management products

Oracle JDBC/PRO *C/ODBC and other development client related information

Oracle Management Server and Intelligent Agent (Grid Server, Agent Server, DB Control)

Oracle Networking products

Oracle RAC Cluster (Single/Multiple Nodes, Automatic Storage Management, Oracle Cluster File System, Data Guard)

Oracle RDBMS Server (Standard and Enterprise Editions) Oracle Retail (Retek)

Oracle SQL*Plus/iSQL*Plus

Oracle Universal Archive (11g)

PeopleSoft

Siebel


8/73

Platforms Supported Apple Mac OS X/Darwin

HP OpenVMS Alpha 7.3-2 and above

HP OpenVMS Itanium

HP Tru64 UNIX

HP-UX Itanium

HP-UX PA-RISC (32 and 64 bit)

IBM AIX on POWER Systems(32 and 64 bit)

IBM Dynix/Ptx

IBM Linux on POWER

IBM zSeries Based Linux

Linux Itanium

Linux x86 (32 and 64 bit)

Microsoft Windows 2000 Workstation and Server

Microsoft Windows 2003 Server

Microsoft Windows 2008

Microsoft Windows Vista Microsoft Windows XP Professional

Sun Solaris Intel

Sun Solaris SPARC (32 and 64 bit

Following Platforms are NOT Supported:

IBM Z/OS (OS/390)


9/73

RAC Cluster / Multi Node

Starting from release 4.2, RDA has the capability to perform remote

data collections. Only UNIX and Windows nodes are supported.

RDA can be also installed on shared disk. In a shared diskcontext, all nodes must be able to write in that directory.

The collecting node could be outside the cluster if that node has a

database connection to get the cluster topology RDA against Oracle RAC cluster has been successfully tested torun on the following Supported platforms:

IBM AIX

Intel Linux (Oracle Enterprise, RedHat, and SuSE)

HP-UX (10.* and 11.*)

HP Tru64 Mac OS X/Darwin

Microsoft Windows (requires Cygwin or MKS)

Sequent Dynix/Ptx

Sun Solaris (2.6 - 2.10)


10/73

Security Filters

RDA provides you with a default filter, which currently

filters out the information in the list below.

Domain names

Group names

Host names IPv4 and IPv6 addresses

LDAP domain components

Network masks

User names


11/73

Oracle Configuration Manager

HealthCheck recommendations based on Support best practices

when using configuration auto-collection Improves Oracle's understanding of your business needs

Personalized access to best practices and the Oracle Knowledge

base

Pro-active configuration-specific notification of Security andGeneral Alerts

Project cataloging of key milestones and contacts associated with

your configurations

Secure, automated configuration collection

Simplified Service Request logging, tracking and reporting

For troubleshooting information or to learn more about Oracle

Configuration Manager see the following MOS Article 369619.1


12/73

Oracle Diagnostic Assistant

The Diagnostic Assistant (DA) tool provides a

common, light-weight interface to multiple diagnostic

collection tools (ADR, RDA, OCM, Explorer).

To learn more about Diagnostic Assistant see the

following Oracle Knowledge 201804.1.

For your benefit, Oracle created an RDA/OCM

bundle. This bundle contains RDA, OCM, and DA

software and it allows customers to install OCM and

DA as part of the RDA data collection process.


13/73

RDA 4.27

Internal and External Release

Note: 414970.1


14/73

What is new with RDA 4.27? New - CS module:

Collects Oracle Communications Calendar Server Information

New - MES module:

Collects Oracle Messaging Exchange Server Information

New - MYCL module:

Collects Oracle MySQL Cluster Information

New - MYSQ module:

Collects Oracle MySQL Server Information

New - NCC module:

Collects Network Charging and Control Information

New - OIA module:

Collects Oracle Identity Analytics Information

New - OSSO module:

Collects Oracle OpenSSO Information

New - OW module:

Collects Oracle Waveset Information

Profile-related Changes

New - Com_NCC profile:Oracle Communications Network Charging and

Control problems

Collects OS, PROF, PERF, NET, ONET, DB, DBA, NCC

information

New - MySQLCluster profile:Oracle MySQL Cluster problems

Collects OS, PROF, PERF, NET, MYSQ, MYCL information

New - MySQLDatabase profile:Oracle MySQL Server problems

Collects OS, PROF, PERF, NET, MYSQ information

RDA Engine Changes

Separated the report abbreviation and report prefix concepts

Extended the Heath Check Validation Engine (HCVE)

Introduced an opt-out mechanism

Added support for single-entry menu choice

Resolved variable in text at rule evaluation time instead of at reporting

time

Added a HKCU abbreviation for accessing Windows registry information

Improved cross buffer boundary operations in HTML and XML parsers

Extended conversion to native paths

100+ Improvements to existing modules
https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=391983.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=330760.1


15/73

Using RDA Proactively Most customers use RDA reactively after logging a Service Request.

Proactive Benefits Eliminate Service RequestsProblem Avoidance

Automate or schedule on a daily, weekly, or monthly basis

Track changes in the environment

Keep a fresh RDA available in case you need to log a Service Request

Shorten the time to resolution

Software Configuration Manager, configuration profiles

Research performance issues

Viewing RDA Report Output Files

RDA output is not encrypted and can be viewed by anyone. You can view

the RDA report files using almost any web browser.

We recommend using Mozilla 1.x ( or Higher), Netscape 4.x (or higher), orInternet Explorer 4.x (or higher).


16/73

Bundled RDA tools

Run the following modules with the -Tmode option

diffCompares Systems

emRuns the Enterprise Manager Tool

jrocktCollects Oracle JRockit Process Information

hcveExecutes HCVE Tests

mergeMerges Alert Log and Trace Files

naRuns the Network Advisor

ora600Diagnoses ORA-600 Oracle Internal Errors

oraddcRuns the Oracle Database Diagnostic Collector

rootCollects System Log and Executes Commands as root User secureIdentifies Potential Security Risks

siebelCollects Siebel Crash Information

sosCollects siga/sosreport/sysreport


17/73

Bundled RDA tests

Run the following modules with the -Tmode option

alertAnalyzes alert.log

cellTests Connection to Exadata Cells

coreTests Stack Trace Extraction

dbTests Local Database Access

dbiTests Oracle Database Access Using the Database Interface

dstDaylight Saving Time Tool Box

envTests the Environment

eventExtracts Event Log Information

invTests Oracle Home Inventory Content

ocmTests Configuration Manager Discovery Information

odbcTests Oracle Database Access Using ODBC

odiDisplays the Current Oracle Data Integrator Module Setup

sqlTests SQL Settings

ssdAnalyzes System State Dumps

sshTests Remote Connectivity and Operations

vmsVerifies Current User Environment for VMS


18/73

My Oracle Support

&

RDA Report Sample


19/73

RDA 4.x - References

Main RDA 4.10 Overview - Note: 392719.1

Remote Diagnostic Agent (RDA) 4 - RAC cluster Guide

Note: 359395.1

Remote Diagnostic Agent (RDA) 4 - HP OpenVMS Guide

Note: 171748.1

Remote Diagnostic Agent (RDA) 4 - Training

Note:330344.1

Remote Diagnostic Agent (RDA) 4 - Troubleshooting Guide Note:330362.1

Remote Diagnostic Agent (RDA) 4 - FAQ

Note:330363.1

Remote Diagnostic Agent (RDA) 4 - Main Man Page

Note:330364.1

Reporting Problems or FeedbackDiagnostics Community in My Oracle Support

Important Note:If you have issues with the Remote Diagnostic Agent (RDA) , you can file a SR by selectingOSS Support Toolsfrom the product list of values on the Create a SR screen. Click on "Expand the ProductList" button to see the full set of products. Select the "Remote Diagnostic Agent (RDA) Issue" type andcomplete the SR.
https://metalink.oracle.com/metalink/plsql/f?p=130:3:528119044322258850::::p3_database_id,p3_docid,p3_show_header,p3_show_help,p3_black_frame,p3_font:NOT,392719.1,1,0,1,helveticahttps://metalink.oracle.com/metalink/plsql/f?p=130:3:528119044322258850::::p3_database_id,p3_docid,p3_show_header,p3_show_help,p3_black_frame,p3_font:NOT,392719.1,1,0,1,helveticahttps://metalink.oracle.com/metalink/plsql/f?p=130:3:528119044322258850::::p3_database_id,p3_docid,p3_show_header,p3_show_help,p3_black_frame,p3_font:NOT,392719.1,1,0,1,helveticahttp://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=359395.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=171748.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=330344.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=330362.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=330363.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=330363.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=330362.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=330344.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=171748.1http://metalink.oracle.com/metalink/plsql/showdoc?db=NOT&id=359395.1https://metalink.oracle.com/metalink/plsql/f?p=130:3:528119044322258850::::p3_database_id,p3_docid,p3_show_header,p3_show_help,p3_black_frame,p3_font:NOT,392719.1,1,0,1,helveticahttps://metalink.oracle.com/metalink/plsql/f?p=130:3:528119044322258850::::p3_database_id,p3_docid,p3_show_header,p3_show_help,p3_black_frame,p3_font:NOT,392719.1,1,0,1,helveticahttps://metalink.oracle.com/metalink/plsql/f?p=130:3:528119044322258850::::p3_database_id,p3_docid,p3_show_header,p3_show_help,p3_black_frame,p3_font:NOT,392719.1,1,0,1,helvetica


20/73

Performance Tuning Tools

Hang File GeneratorGathers Systemstate and HangAnalyze Trace files

Note:362094.1 OS WatcherGathers common operating system and network level metrics

Note:301137.1

Lightweight Transaction On-Board Monitor - provides an integrated solution

for detecting and collecting trace files for system performance issues

Note:352363.1

Oracle Performance Diagnostic Guide (OPDG)

Intended to help you resolve query tuning, hang/locking, and slow database issues.

The guide is not an automated tool but rather seeks to show methodologies,

techniques, common causes, and solutions to performance problems

Note:390374.1


21/73

Characteristics:

Different tools that you can use to monitor,

diagnose and solve performance issues before and

after issue appears

Performance tools

Value :

Analyze pre-existent Problems

Resolution time Reduction

Very useful on the SRs follow up

Systems MonitorAdventages:

No aditional Cost.Available to monitor:

Data Base

Operating System

Network


22/73

Oracle Performance Diagnostic Guide


23/73

Letsstart on MOS over the Knowledge

Browser and Diagnostic Tools

Lets start here


24/73

Characteristics:

This guide is intended to help you resolve query

tuning, hang/locking, and slow database issues

OPDG(Oracle Performance Diagnostic Guide)

Value :

Provide you with an step by step

methodology to isolate the problemand guide you to use our different

tools set.

Advantages:

Provide you with:Issue Classification Section

Examples

Links to use other oracle tools


25/73

Categories:

Classification.- This category will assist you with

determining which type of performance issue you are

encountering.

Query Tuning.- involves issues where a particular query isrunning too slow.

Hang/Locking.- involves issues where the entire database

or many sessions are not responding

Slow Database.- involves issues where many sessions arerunning slowly

OPDG(Oracle Performance Diagnostic Guide)


26/73

Oracle Performance Diagnostic GuideClassification


27/73

Oracle Performance Diagnostic GuideQuery Tuning


28/73



29/73



30/73



31/73



32/73



33/73



34/73

Oracle Performance Diagnostic GuideHang/Locking


35/73



36/73



37/73



38/73



39/73



40/73

Oracle Performance Diagnostic GuideSlow Database


41/73



42/73



43/73



44/73



45/73


Performance Tools


46/73

Use

Performance Tools

OPDG Benefits : Help to Identify and Isolate Performance

problems.

Help to improve your performanceknowledge skills

Help to guide you step by step our oracleperformance tools and documents to solve aproblem


47/73

LTOM (The On-Board Monitor)

Embedded Real-Time Data Collection and DiagnosticsPlatform



48/73

Characteristics:

Real time monitoring and diagnostic tool

Proactive rather than reactiveLTOM runs on the customer's UNIX

server

Provide with a graphical system profiler

Support for RAC

LTOM (The On Board Monitor)



49/73

Value :

LTOM does automatic problem detection and collects the necessary

diagnostic traces in real-time while the database/system performanceproblem is occurring. LTOM provides services for:

System Profiler

Automatic Hang Detection

Automatic Session Tracing

LTOM (The On Board Monitor)

Advantages :

Provides an integrated view of operating system and database

Collect performance metrics and produces a html report

Proactive


50/73


Supported Platforms:Solaris

Linux

HP-UX

AIX

Tru64



51/73

Complete Reference Guide:

Go to MOS Note:352363.1- LTOM - The On-BoardMonitor User Guide

Will find

Documentation

Installation Process

Samples

Features

( )

https://metalink.oracle.com/metalink/plsql/f?p=130:14:7720938610913735037::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:NOT,352363.1,1,0,0,helveticahttps://metalink.oracle.com/metalink/plsql/f?p=130:14:7720938610913735037::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:NOT,352363.1,1,0,0,helvetica


52/73


Directory Structure

Performance Tools


53/73

Use

Performance Tools

System Profiler:

When to use it? The system profiler is useful to frame performance

issues where a bottleneck may be outside Oracle.

Benefits: Collect data up to just seconds prior to hang or crash

Collect Operating Systemdata in additional to oracleperformance data.

Collect statistical data down to 1 second increments Displays SQL currently executing.

RCA timeline.

Performance Tools


54/73

Use

Performance ToolsSystem Profiler:

Performance Tools


55/73

Use

Performance Tools

Automatic Hang Detection:

When to use it? Any problem involving hangs/slowdowns when the

necessary information collected at the initial outage isinsufficient to diagnose the problem.

Benefits: Collect systemstates and hanganalyze files during the

actual hang without operator intervention

Hang data collection 24x7

Hangs automatically detected

Email notification of hang

Performance Tools


56/73

Use

Performance Tools

Automatic Session Tracing:

When to use it? should be considered for situations where specific

sessions experience performance problems.

Benefits: Collect 10046 trace only when a performance

problem occurs

Collect SQL associated with a session's performanceproblem

Tie data collection to a specific Oracle wait event orCPU utilization

Session tracing for only problematic sessions


57/73

OSWatcher

OSWatcher


58/73

Characteristics:

OSW consists of a series of shell scripts.Data collection intervals are configurable.

OSW invokes distinct operating system utilitiesps

top

mpstat

iostat

netstat

traceroutevmstat

OSWatcher

OSWatcher


59/73

Simple Installation:

OSWatcher

uncompress osw.tar.Z

tar xvf osw.tar

More information. Note:301137.1

OSWatcher


60/73

Use

OS

OSW Benefits:

Simple tool that use pre existent OperatingSystem commands

Easy to use


61/73

Trace Analyzer TRCANLZR

Interpreting Raw SQL Traces with Binds and/or Waitsgenerated by EVENT 10046



62/73

Characteristics:

Given a Raw SQL Trace with Binds and/orWaits, generated by EVENT 10046 Levels 1, 4,

8 or 12

Generates a comprehensive report that can beused to troubleshoot common SQL performance

issues, or functional issues requiring to find the

values of bind variables


http://localhost/var/www/apps/conversion/tmp/scratch_6/NOTE_224270.HTMLhttp://localhost/var/www/apps/conversion/tmp/scratch_6/NOTE_224270.HTML


63/73

Installation:


You should unload and uncompress the

TheTRCANLZR file and then execute some

configuration steps.

The tools can be executed on a different

database where the raw file was generated

More information available Note:224270.1

https://metalink.oracle.com/metalink/plsql/f?p=130:14:7720938610913735037::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:NOT,224270.1,1,0,0,helvetica


64/73

Use

y

TRCANLZR Beneffits:

Simple tool that generate a comprehensiveoutput to analyze raw files including bindvariables, wait events

The Trace Analyzer provides an accurateSUM of CALLs

SQL Tuning Scripts


65/73

SQL Tuning Scripts

PL / SQL Profiler

Helps to identify the lines of PL/SQL code which are taking longer to process

Note:243755.1

SQLTXPLAIN.SQL

Generates comprehensive diagnostic files normally used in the area of SQL

analysis and tuning.

Note:301137.1

Trace Analyzer -TRCANLZR Reads and parses one or several SQL traces and produces a comprehensive report

with performance related details.

Output report includes all the details found on TKPROF, plus additional information

normally used for a process performance analysis

Note:224270.1


66/73

SQLTXPLAIN

Enhanced Explain Planand related diagnostic

info for one SQLstatement

Complete Reference Guide

Note:215187.1

SQLTXPLAIN


67/73

Characteristics:

Designed to help during the diagnostic phase of

SQL performance issue.

Provide a comprehensive report

Facilitates the creation of test cases onseparate environments

SQLTXPLAIN

SQLTXPLAIN.SQL


68/73

Improved Explain Plan

Install

Sqlplus sys as sysdba

SQL> @sqcreate.sql

Execute some modules, Sql

Statements

Create a report with the tool

Check the output via Internet Browser

Using the SQLTXPLAIN:


69/73

3 different ways:

1. Xplain - Standard - Generates Explain Plan,

SQL is not executed

2. Xtract - Advanced - Generates Explain Plan,SQL is in memory already

3. Xecute - Special - SQL is executed, then

Execution Plan is obtained

Using the SQLTXPLAIN:

Improved Explain report


70/73

Improved Explain report

SQLTXPLAIN


71/73

Use

SQLTXPLAIN Benefits:

Improved explain plan

Very useful to diagnose sql performance

problems Solve some known issues with the standard

explain plan.

You can upload the output information toyour SRs.

Performance Tools Quick Reference Guide


72/73

Performance Tools Quick Reference Guide

Now Available Through MOS!

A quick guide to available tools

Can be used for resolving performance issues.

Can be used for follow up Service Requests

Include documentation about different performance

tools

Go to MOS Note:438452.1- Performance Tools Quick

Reference Guide


73/73

RDA and Diags

Documents

Transcript of RDA and Diags