Post on 18-Nov-2014
description
© 2012 IBM Corporation
IMS Tools from IBMLatest NewsJune 2012
Helene Lyon
helene.lyon@fr.ibm.com
DE, European IMS Architecture Team Technical Executive
© 2012 IBM Corporation
DB2 and IMS Data Management Tools
2000: Reduce your TCO
2007+Reduce your TCO & Increase your value
2004 Autonomic Computing and End to End Monitoring
Reducing TCO is our first focus
�Provide autonomic features to add capability
and simplify operations
�Avoid tedious tasks and reduce errors
�Preserve your investment in z/OS applications
and databases
2003: Integration of products, new capabilities, better performance
2001-2002 Product replacements
2003-Day 1 Support
© 2012 IBM Corporation3
IMS Tools Modernization and Autonomics
IMS Fast Path Solution Pack for z/OS
IMS HP Fast Path UtilitiesIMS DB Repair FacilityIMS HP Image CopyIMS Library Integrity Utilities
IMS Recovery Solution Pack for z/OS
IMS HP Image CopyIMS Database Recovery FacilityIMS HP Change AccumulationIMS Index BuilderIMS DRF Extended Functions
IMS Performance Solution Pack for z/OS
IMS Connect ExtensionsIMS Performance AnalyzerIMS Problem Investigator
IMS Database Solution Pack for z/OS
IMS DB Reorganization Expert- Unload, Load, Index Build, Prefix Resolution/UpdateIMS HP Image CopyIMS HP Pointer CheckerIMS Library Integrity Utilities
�IMS HALDB Toolkit�IMS Sequential Randomizer Generator
Data Base Administration
�IMS Online Reorganization Facility�IMS Cloning Tool�IMS Database Control Suite
Utility Management
�IMS HP Image Copy�IMS DEDB Fast Recovery�IMS Recovery Expert V2
Backup and Recovery �Batch Terminal Simulator
�Batch Backout Manager�Program Restart Facility
Application Management
Performance Management
�IBM Transaction Analysis Workbench�IMS Buffer Pool Analyzer�IMS Network Compression Facility
System / TMAdministration
System�IMS Command Control Facility�IMS ETO Support�IMS HP Sysgen Tools�IMS Queue Control Facility�IMS Workload RouterTM�IMS Configuration Manager�IMS Sysplex Manager
RegulatoryCompliance
�Guardium S-TAP for IMS�IBM Infosphere Guardium Data Encryption for DB2 and IMS Databases
IBM Tools Base for z/OS
© 2012 IBM Corporation4
IMS Tools Solution Packs
� High performance IMS Tools help you perform your IMS database management tasks – providing full end-to-end solutions
� A full suite of IMS Tools to help with:– Full-function database maintenance– Fast Path database maintenance– Recovery– Performance and tuning
� Built on our vision, built for you– Easier to install– Easier to maintain– Increased integration– Automated– Modern– Built to fit any size shop
IMS Recovery IMS Recovery
Solution PackSolution Pack
IMS Database IMS Database
Solution PackSolution Pack
IMS Performance IMS Performance
Solution PackSolution Pack
IMS Fast Path IMS Fast Path
Solution PackSolution Pack
IBM Tools Base
© 2012 IBM Corporation5
Agenda
� The Path to Autonomics
� IMS Performance & Debugging Solutions Update
� IMS Database Utilities Update
� IMS Backup & Recovery Update
© 2012 IBM Corporation6
Why Autonomics and Modernization
� Unanticipated problems may result in downtime and loss of revenue
� Increased burden of system management and maintenance
� Problem determination is time and resource intensive
– Expert skills are often spent ascertaining when a problem took place rather than figuring
out how to fix it
� DBA resources are expensive and dwindling – Expert skills are wasted on repetitive tasks
� Time and resources are not available for developing new applications, pursuing new technologies, and growing business
Now more than ever, business challenges demand it!
© 2012 IBM Corporation7
Internet
Extranet
Intranet
Load
Balancer
Internet
ServersE-commerce
Applications
Databases Databases
Mainframe
Enterprise Server
Applications
ERP
Messaging
Middleware
When problems do occur, the impact can be extensive
IT
Operations DB
Specialist
Business
Analyst
Business
Executive
The database server is in trouble. I’ll create an incident as soon as I can
and work on it. I hope no one is affected.
Why am Ihaving these database
events? Everything seems ok.
Why are these applicationtransactions taking
so long?
We are behind inorder processing.
Why?
Help
Desk
So many calls,so many incidents.I don’t know what to tell customers.
Executives are upset with orders not
being processed. I need to tell
them why.
IT
Manager
© 2012 IBM Corporation8
Modern Graphical User Interfaces are critical
� Modern Graphical User Interfaces– Provide a richer user experience, can convey more information
– Reduce the need for IMS or Z specific knowledge
– Shorten the IMS learning curve for new DBAs
– Enable deeper integration between tools and across platforms
– Customers expect it!!
� Leap ahead to Graphical interfaces for IMS
– Focus on Web-based interfaces for administration• Allow access from anywhere
– Focus on Eclipse-based interfaces for development
AdministratorsDevelopers
Eclipse(development)
Web Browser(administration)
© 2012 IBM Corporation9
IBM Tools Base for z/OS
� A pre-requisite for all IMS Tools Solution Packs
� Contains all the necessary common infrastructure components for enabling
autonomics and next generation UIs
� No charge PID
– Program number: 5655-V93
– IBM Tools Base for z/OS 1.3
9
IMS Tools Knowledge Base
Policy Services
Autonomics Director
Administration ConsoleDynamic
Application Infrastructure
Reports
Sensor
Policie
s
Discovery
Autonom
ics
AutoDiscovery
© 2012 IBM Corporation10
IMS Tools Distributed Access Infrastructure
Tool
Tool
Tool
z/OSISPF
IMS
Tool
Tool
Terminal Emulator
DAITCP/IPApplication
ServerHTTP
TCP/IP
…
Browser
Eclipse
BTS
Many IMS Tools
© 2012 IBM Corporation11
IMS Administration Console Goals
� Provide a holistic view of your IMS system from a single, easy-to-use web
interface– Dynamic, interactive graphs and charts provide you with a visual
representation of your sensor data– Integration with the Autonomics Director provides a list of policy exceptions
and recommended resolutions for all of your monitored databases
– All IMS Tools reports stored in the IMS Tools Knowledge Base can be
searched, retrieved, and viewed effortlessly
� Prepare for the next generation of IMS DBAs– Uses the latest web technologies for a rich user experience
– Access from anywhere via the Internet using the most popular web browsers– Includes a robust help system that serves as a learning aid for new IMS DBAs.
© 2012 IBM Corporation12
Overview of IMS Resources with Drill-down
Resource status,
errors, and
recommendations
can be aggregated
with an ability to
drill down
© 2012 IBM Corporation13
Holistic View of IMS Resources
…from Sensors
…from Auto Discovery
…from Autonomics Director
…from Various HP Tools
© 2012 IBM Corporation14
Prepare the next generation of IMS DBAs
Integrated help
educates new and
experienced DBAs
on database
concepts and how
to interpret charts
© 2012 IBM Corporation15
Administration Console Benefits
� Install once, access anywhere via the Internet– Single, server-based installation
– Access through popular web browsers
� Safety and security features are built in
– Uses SSL and RACF authentication
� Works “out of the box”
– Immediately view your databases using your existing DBRC groups or Autonomics
Director monitor list
� Easily customized– Define your own groups of databases to view
� Consolidated information at your fingertips– Summary pages provide total counts of warning, severe, and critical exceptions for a
database group – drill down to the individual database level from there
© 2012 IBM Corporation16
Policy Services - Using Sensor Data to Help Make Decisions
� Policy definitions to evaluate specific database states– E.g. the state of space utilization at a specific instance in time– Threshold values are compared against sensor data for a given database or group of databases– When thresholds are met or exceeded, exceptions occur
� Statistical point-in-time sensor data– Stored in IMS Tools Knowledge Base repository– Historically maintained per user specifications– Over 60 separate data elements related to space usage, optimization, and fragmentation
• E.g. data set extents, DASD volume usage, data set free space, roots distribution, RAP usage, CI/CA splits, and IMS free space
� Two methods to collect sensor data– Standalone database sensor utilities for Full-Function and Fast Path databases– Integrated with existing IMS Tools
• High Performance Image Copy, High Performance Pointer Checker• Fast Path Analyzer, Fast Path Online Pointer Checker
� Works “out of the box”– Ships with predefined policies and threshold values
� Customizable to fit your shop– You can define your own sets of threshold values– Customize the messages sent when exceptions do occur– Specify who receives which messages and how
• WTO, e-mail, or text
© 2012 IBM Corporation17
Autonomics Director Overview
� Automatic collection of Sensor data
� On Demand collection/ evaluation for immediate issues
– “I have a problem and need the information now!”
� Automatic analysis and evaluation of database status
– Based on user-defined policies and thresholds
� Recommendation for reorganization– Easy to understand: simple “yes” or “no”
� E-mail or text notification when a reorganization is recommended
– Alert DBA to consider taking action
� Flexible scheduling around peak workloads– Doesn’t interfere with production throughput
or response
� Works with existing job schedulers
� Exploits the power of IMS sysplex– Redundant servers for highest levels of
availability– Spreads data collection/tools workload based
on system capacity and status
� Easily customized for groups or individual databases
– Auto-discovery of databases and existing database groups
– User-defined groupings: “These are the databases that I’m responsible for”
– Group-assigned defaults propagate to individual databases
� Intuitive user interfaces for all users– Full ISPF interface– Integrates with new IMS Administration
Console for viewing database status on the web
© 2012 IBM Corporation18
Autonomics Director Configuration
AD Master Server
AD Failover Server
AD Active Server
AD Active Server
ITKB
Server
SensorsSensors
SensorsSensors
MVS1MVS1
MVS2MVS2
MVS3MVS3
MVS4MVS4SensorsSensors
SensorsSensors
© 2012 IBM Corporation1919
Autonomics Director Process Flow
Autonomics Director Master Server
ITKB
RepositoryServer
Tools Input Repository
AD Repository
Sensor Data
Repository
Policy Repository
DBDLIBs
DBRCRECONs
Policy/SensorEvaluationServices
SchedulerServices
AutoDiscovery
RouterServices
MonitorServices
DB Sensor
ICPC
DB SensorJCL Lib(s)
Internal Reader
Customization Recommendations
USDB1 HDAM Sensor=8
hrs
Eval
=8 hrs
USDB2 DEDB Sensor=12 hrs
Eval
=12 hrs
User Interface Services
© 2012 IBM Corporation20
Agenda
� The Path to Autonomics
� IMS Performance & Debugging Solutions Update
� IMS Database Utilities Update
� IMS Backup & Recovery Update
© 2012 IBM Corporation21
IMS Performance Analysis & Debugging
ONLINEJJ-1J-n
M o n i t o r i n gM e t r o l o g y / C a p a c i t y P l a n n i n g
A n
a l y
s i s
d e
p t h
Omegamon
IT CAM
LOG
IMS/CICS Performance Analyser
Transaction Analysis Workbench
DB2 Performance Expert
IMS Problem Investigator
Transaction Analysis Workbench
DB2 Log analysis
Tivoli Decision Support
© 2012 IBM Corporation22
z/OS
OPERLOG SMF / RMF 30,64,88 … /7x
IMS
DL/1
DB2
IMS TM
CICS
DDF
DB2 SP
IMS Connect
CTG
OTMA
WAS/z
MQ
IMS Connect
CE
XC
EXCEX
journal
CEX
journal
IMS log
DB/DC Monitor
SMF
114/115
120/111 ATF/TRF
SMF
100/101/102
SMF
110
CQS LGSTRM
CQS
OM
EG
AM
ON
DB2 log
MQ log
IMS Performance Analysis & Debugging …
© 2012 IBM Corporation23
IBM Transaction Analysis Workbench for z/OS
� A transaction analysis framework for System z– Not transaction manager specific
– Leverages current IBM tools for transaction analysis
� Not IMS or CICS specific, but first release provides more synergy with the existing
tools for those transaction managers– Synergy with IMS and CICS Performance Analyzer, with IMS Problem Investigator
– No prereq for CICS PA, IMS PA or IMS PI
� Automates collection of data needed for problem analysis
� Provides a session manager to manage problem analysis through its lifecycle
� Goal
– Enable higher productivity by lower skilled staff, reduce problem analysis time, and serve
as a training tool for new support staff
– Allow the ‘First Responder’ to determine the most likely source of the problem so that the
right subject matter expert can work on the problem
– Allow for ‘Deep dive’ problem determination via synergy with other IBM tools• Subject matter experts may also use tools not supported by the Workbench
© 2012 IBM Corporation24
IBM Transaction Analysis Workbench for z/OS (5697-P37) …
� Integrated CICS and IMS performance management and problem determination
� System and subsystem performance that directly affects CICS and IMS
� Integrated CICS-DBCTL performance reporting using both CICS and IMS performance data
CICS
Performance
Analyzer
CMF
IMS
Performance
Analyzer
IMS log
IMS
Problem
Investigator
DB2/MQ log
TransactionAnalysis
Workbench
SMF, OPERLOG,
other data sources
© 2012 IBM Corporation25
Rules Based Routing
DB Integrity Check
Custom FORMsbased reports
Dashboard
IMS Connect Event Collection
IMS Performance AnalyzerIMS Performance Analyzer
IMS Transaction Index
Log data:IMSDB2
Websphere MQIMS ConnectOMEGAMON
ISPF
dialog
Extracts
Reports
IMS Problem InvestigatorIMS Problem Investigator
IMS Performance Solution Pack Transit Reports
IMS Performance Solution PackIMS Performance Solution Pack
IMS Connect ExtensionsIMS Connect Extensions
IMS Performance Solution Pack for z/OS
© 2012 IBM Corporation26
IMS Connect Extensions
� Enhances IMS Connect performance, availability & security– Streamlines operational management of IMS Connect and its clients
– Flexible access control to Improve system security
� Enhances IMS Connect availability with dynamic workload management
– Management of customer user exits and control of input message traffic
� Event recording & performance monitoring features
– Examine the details and timing of internal IMS Connect events
– Collects performance and accounting information for IMS Connect
– IMS Connect internal and external transit times and latency times
– Exception reporting showing failures and timeouts
� Provides instrumentation and performance reporting for IMS Connect
– Creates detailed IMS Connect reports in conjunction with IMS Performance Analyzer
– Solves IMS Connect problems in conjunction with IMS Problem Investigator
– Displays IMS Connect activity and utilization in real time
– Enables reporting for Omegamon XE, IMS Performance Analyzer,
and IMS Problem Investigator
© 2012 IBM Corporation27
Single consolidated view of sessions running on all systems
(or view activity for individual systems or user-defined groups)
Extensive details on
individual sessions
The
system view
shows the
status of
all
systems
Cancel sessions
© 2012 IBM Corporation28
IMS Performance Analyzer
� The premier IMS tools for…– Maintaining service levels and capacity planning– Response time analysis– Monitoring enterprise-wide indicators that can adversely affect IMS performance
� Analysis of data from the IMS logs, IMS monitor, and IMS Connect– Shared Queue support - merge logs to produce end to end transaction response times– 100’s of fields can be summarized and analysed
� Forms-based reporting to identify specific processing deficiencies– Reporting on IMS through ISPF dialogs or batch commands
� Generation of “Transaction accounting index” to be used to intelligently navigate log files with IMS Problem Investigator based on filters
� Cold start analysis– Analyses what would happen after an emergency cold start of IMS at some point in time
(for example, now or at end of log)• Identifies what messages would be lost• What in flight transactions with external subsystems be lost
� Gap analysis– Identifies periods of time where log records are not being cut– Can highlight an external system event that may have caused IMS to slow down
© 2012 IBM Corporation29
Batch job:
report/extract
request
JCL
Specifiedinput files
Generates& submits
SLDS (or OLDS)
Disk or tape:
IMS Log records
IMS Connect Extensions
journal data sets
IMS Connect records
IMS PA
ISPF dialog
IMS Monitor data sets
OMEGAMON
TRF Extractor data sets
IMS Monitor records
Report/extract
request
with input file
ddnames
Extracts
TransactionIndex
Reports
IMS Performance Analyzer …
© 2012 IBM Corporation30
IMS Performance Analyzer 4.1
Combined IMS and Connect Summary
COMBSUMM Printed at 11:15:00 04May2006 Data from 11.16.33 18Apr2006 to 12.04.17 18Apr2006
Avg Avg Avg Avg Avg Avg Avg
Tran CON Resp Input ReadSock ReadExit SAF Call OTMAproc IMS Resp
Trancode Count Time Time In Time Time Time Time Time . . .
BALANCE 14 57 0 0 0 0 51 28
DEPOSIT 432 540 0 0 0 0 539 522
ORDER 1458 202 5 5 0 0 17 16
WITHDRAW 16 3035 214 214 0 0 605 332
Avg Avg Avg Avg Avg Avg
InputQ Process OutputQ Total CPU DB Call
. . . Time Time Time Time Time Count . . .
5 54 0 60 3 2
6 7 4203 4216 2 1
8 213 17528 17749 1 1
8 291 2251 2549 3 1
Avg Avg Avg
Confirm Output XmitExit
. . . Time Time Time
6 0 0
0 1 0
179 0 0
249 1967 0
IMS Connect
response time
IMS internal response time
IMS transit breakdown and resource usage
Connect Output
Connect InputOTMA response time
• Combined IMS Connect and IMS log metrics
• Design a Form to include required information only
• No restriction on report page width
• Export to CSV or DB2 as an alternative to reporting
IMS Performance Analyzer
Combined Transit analysis report
© 2012 IBM Corporation31
IMS Problem Investigator
� Analysis of IMS event data can help identify problematic applications and identify system performance issues.
� IMS Problem Investigator complements IMS Performance Analyzer for enhanced log analysis and reporting.
� IMS Problem Investigator provides an ISPF interface and batch reporting capabilities that enable the investigator to interactively navigate, investigate, and analyze:
– IMS log, IMS Monitor records, IMS Common Queue Server (CQS) log records,
– IMS Connect event data,
– SMF records
– Omegamon TRF log and extract,
– DB2 log,
– Websphere MQ log extract.
� Key Features include:
– Browse, analyze, and interpret logs
– Gain an end-to-end picture of transactions in the Sysplex.
– Understand IMS log record with detailed field description and global fields.
� The TX line action will connect records associated with the same transaction across
all logs.
© 2012 IBM Corporation32
� Modern IMS transactions affect multiple subsystems
� Information about these transactions is recorded in even more sources
� IMS PI provides a unified logical view of transactions spanning all these systems
IMS log
IMS transaction
IMS Problem Investigator
Data sources
Transaction activity merged into a single view
IMS-related subsystems
Transaction activity logged in multiple locations
IMS monitor
TRF Extractordata set
Extracts
CQS logDB2 log
DB2 CQSIMS DB/TMIMS ConnectWebSphere
MQ
WebSphere MQlog extract
IMS ConnectExtensions
journal
SMF
ISPF
dialogReports
OMEGAMONTRF records
IRLM long-lockrecords
User records
IMS ConnectExtensions
IMS PATransaction
Index
© 2012 IBM Corporation33
© 2012 IBM Corporation34
IMS Problem InvestigatorFormat and navigate log files quickly and easily
� IMS PI allows you to interactively browse and analyze log records
� Instantaneous view of the logs
� Navigate by the time of day
� Select records to drill down right to the values of individual flag bits
© 2012 IBM Corporation35
Tracks DRDAflow
Reports separateresponse timesfor IMS Connect
and IMS
WebSphereApplicationServer (WAS)
IMSConnect
IMSConnectExtensions
IMSPerformance
Analyzer
IMSProblemInvestigator
ODBM IMS
WASsupport staff
The problem is somewhere in here:a reporting "black hole" betweenthe two product support teams IMS
support staff
Response times over 2 seconds!
"WebSphere Application Server waits 2 secondsfor a response from IMS. Contact IMS support."
"IMS respondsin a millisecond."
Event journal
IMS log
© 2012 IBM Corporation36
Agenda
� The Path to Autonomics
� IMS Performance & Debugging Solutions Update
� IMS Database Utilities Update
� IMS Backup & Recovery Update
© 2012 IBM Corporation37
Utilities Management
� IMS Database Solution Pack for z/OS– IMS Database Reorganization Expert– IMS High Performance Unload– IMS High Performance Load– IMS Index Builder– IMS High Performance Prefix Resolution– IMS High Performance Pointer Checker– IMS High Performance Image Copy– IMS Library Integrity Utilities
� IMS Fast Path Solution Pack for z/OS– IMS Fast Path Advanced Tools– IMS Fast Path Basic Tools– IMS Fast Path Online Tools– IMS Database Repair Facility
� IMS Cloning Tool
� IMS Database Control Suite
� IMS Online Reorganization Facility
© 2012 IBM Corporation38
IMS DB Solution Pack
� DB Solution Pack provides a complete set of high performance tools to unload, load, reorganize, build indexes for, backup, verify, and report on full-function databases
UnloadLoad
Reorganization
DB Integrity CheckDB Repair
BackupImage Copy
IndexBuild/Recovery
IMS Definition Libraries Management
DB Space Utilization Analysis
DB Repair FacilityDB Repair Facility
IMS Database Reorganization Expert
IMS Index BuilderIMS Index Builder IMS High Performance Image Copy
IMS High Performance Image Copy
IMS High Performance Prefix Resolution
IMS High Performance Prefix Resolution
IMS Library Integrity Utilities
IMS Library Integrity Utilities
IMS High Performance Load
IMS High Performance Load
IMS High Performance Pointer Checker
IMS High Performance Pointer Checker
IMS High Performance Unload
IMS High Performance Unload
© 2012 IBM Corporation39
IMS Database Reorganization Expert
� Follow-on product of IMS Parallel Reorganization (IPR) V3R2
� IMS Parallel Reorg Driver renamed to “Smart Reorg” features:
– Collecting statistics data for database space management• We will call this data the sensor data!
– Defining and managing the reorganization policy for detecting space management
exceptions
– Utilizing the policy for conditional reorganization
– Utilizing the policy for exception notification and reporting
– Tracking detected exceptions and effectiveness of reorganization
� IPR Unload, IPR Reload, and IPR DB Scan utilities are also included and are fully compatible with those in IPR
© 2012 IBM Corporation40
Sep. 21 AnnouncementSingle Step ExecutionSingle Step Execution
- IMS DB Reorganization Expert
- IMS High Performance Unload
- IMS High Performance Load
- IMS Index Builder
- IMS High Performance Image Copy
- IMS High Performance Pointer Checker
- IMS High Performance Prefix Resolution
- IMS Tools Base Pack
“Smart Reorg”
DB
(Shadow)
Sec. Index(Shadow)
DB
SecondaryIndex
Reports andDB Statistics
DBAdmin
IndexImage Copies
Database Image Copy
OnlineRead Access
Database“Health Check”
ConcurrentDatabaseBackup
Automated DBRC
Processing
IMS Database Reorganization Expert …
© 2012 IBM Corporation41
Smart Reorg utility scans and analyses database, collects sensor data, judges reorganization requirement based on policy, and takes reorganization automatically in one job step!
SmartReorgDriver
IMS Tools Knowledge BaseReport Service
Parallel ReorganizationService
Conditional ReorgSupport Service
IMS ToolsKnowledge
BaseServer
Sensor
Data
Smart Reorg utility job stepRepositories
Reports
Policy
Database
ShadowDatabase
Reload
Unload
Scanning Online DB
IMSOnline Subsystems
IMS Tools Online System Interface
DBAnalyzer
DB Sensor
Policy ServicesPolicy Evaluation
Exception Notification
Sensor Data Store
Sensor Data Read
Smart Reorg utility in Reorg Expert
© 2012 IBM Corporation42
IMS Library Integrity Utilities
� Productivity aid for managing IMS Definition Libraries
Providing High-speed generation process for processing large volumes of IMS ACBs
Consistency Checker ensure all the necessary definitions have been created for a database
MFS Reversal
Advanced ACBGenConsistency Checking Utility
�MFS Reversal - Convert MFS MID/MOD/DIF/DOF control blocks back into IMS MFS utility control statements
�MFS Compare - is designed to compare two sets of MFS source libraries
Integrity Checker help prevent system outages caused by databases corrupted by using wrong DBD
�Mapper
�Reversal
�Compare
Integrity Checking FacilityDBD/PSB/ACB
© 2012 IBM Corporation43
IMS Fast Path Solution Pack
� “An All-In-One Fast Path full maintenance solution”– IMS High Performance Fast Path Utilities (HPFPU)
– IMS High Performance Image Copy for z/OS (HPIC)
– IMS Library Integrity Utilities for z/OS (LIU)
– IMS Database Repair Facility (DB Repair)
– Prereq: IBM Tools Base for z/OS
Unload
ReloadReorganization
DB Integrity Check
BackupImage Copy
IMS Definition Libraries Management
DB Repair
DB Space Utilization Analysis
IMS HP FP UtilitiesIMS HP FP Utilities DB Repair FacilityDB Repair Facility
IMS HP Image CopyIMS HP Image Copy
IMS Library Integrity UtilitiesIMS Library Integrity Utilities
IMS Fast Path Solution Pack
© 2012 IBM Corporation44
20112009 2010 20122008200720062005
History of IMS FP Tools
Day 1 support for each new IMS release
IMS 9
HPFPU V2.2
� FPA ANALYZE
� FPA CHANGE
HPFPU V3
� Online Expert Reorg
� Online DMACPRINT
� FPA EXTRACT
� FPA DMACPRINT
HPFPU V2
� FPA UNLOAD
� FPA RELOAD
� FPB
� FPO
HPFPU V3.2Enhancements
� ITKB support
� DB rec. length report
� Multi areas
� HPIC HASH enh.
IMS 10 QPP GA IMS 11 QPP GA IMS 12 QPP GA
FP Solution Pack V1
� HPFPU
� HPIC
� LIU
� DB Repair
All in a single package
HPFPU V3.2
� FPA REORG
FPSP V1.2� Enhancementsin FPSP V1components
� DB SensorCapability
Ease of Use
Online Tooling
Tools integrated solutions
Common Infrastructure
Simplification &Modernization
Simplification &Modernization
HPIC V4 Enhancements
� ITKB support
� Fast Recovery IC
IMS Tools Base V1.1/V1.2(added Policy Services)IMS Tools Knowledge Base
LIU V2
� MFS Reversal& Compare
� Integrationwith DRF/HPIC
HPIC V4
LIU V1� Consistency Checker, DBD/PSB/ACB Compare/Mapper/Reversal, Adv. ACB Generator
� Integrity Checker
LIU V2Enh.
� FPA support
HPIC V4.2
� Fast Dump
� DB Quiesce
� HPIC Image Copy under FPO
Tools Base V1.3(added AD & AC)
FPSI Support
© 2012 IBM Corporation45
IMS Fast Path Solution Pack V1.2
� Strategic– From individual tools to solution packs
– Product simplification and modernization
� Provides complete tool set
– Reorganization and restructure• Unload/reload with/without structure change• Direct free space reorganization
– Pointer check and space analysis
– High performance/function Image Copy
– Library consistency verification
� Added DB Sensor capability – Supports sensor data collection
• Built on Tools Base V1.3 services
– A core component for Autonomic Director (AD) /
Administration Console (AC) solutions
IBM Tools Base for z/OS V1.3
IMS FP Solution Pack for z/OS V1.2
• Fast Path Advanced Tool• Fast Path Online Tool
• Fast Path Basic Tools
• IMS High Performance Image Copy
• IMS Library Integrity Utilities
• IMS Database Repair Facility
• Fast Path Stand-alone DB Sensor
SensorSensor
SensorSensor
SensorSensor
SensorSensor
• IMS Versions supported:
V10, V11, V12
• Autonomics Director• Administration Console• Policy Services• IMS Tools Knowledge Base
• …
© 2012 IBM Corporation46
Agenda
� The Path to Autonomics
� IMS Performance & Debugging Solutions Update
� IMS Database Utilities Update
� IMS Backup & Recovery Update
© 2012 IBM Corporation47
IMS Backup and Recovery
Index Builder
Tools
Pointer Checker Tool
Database
Recovery Utility or Tools
Database Image Copy
Utility or Tool
IMS Batch Logging
Online Log Archive
DBRC RECONs
Image Copy
Databases
Recovered Databases
CA (+)CA (-)
Batch Backout Utility or Tool
Change
Accumulation Utility or Tool
Incremental Image Copy
Rebuild Index
Database Unload / Reload
Utility or Tool
Unload Dataset
OLDS to SLDS/RLDS
IMS Logging
System Level Backup
© 2012 IBM Corporation48
How to identify available resources ?
� Manually : DBRC commands are great !
� Asking for help ? Use RRR Recovery ReadinessReporter
� What is the image copy frequency in production? Is this automated?
� Are the jobs scheduled on a regular basis?
� How often do image copy jobs fail? Is it lack of space or objects not in correct state?
� What types of backups are being used? – DB2 DSN1COPY, FDR, HSM?– IMS batch image copy (SHRLEVEL reference),
concurrent image copy (SHRLEVEL change),SMS image copies?
� Is storage team already making volume copies of DB2/IMS data?
� Are you image copying the same object/database many times during a night without you knowing it?
� Do you have control over your backups?
� Are incremental copies made?– How many between full copies?– DB2 Merge copy run?– IMS Change Accums?
� Are these copied to disk or tape? Stacked on tape?
� Is everything in sync with the ICF catalog?
� Do you verify recovery on a scheduled basis?
� Are you taking copies of application spaces – test and production?
© 2012 IBM Corporation49
Resource Readiness Reporter
� RRR is an informative tool that will providesites with the help they need in the following:
– Risk• Reduce risk of data loss by reporting missed backups
– Exposure• Reduce exposure for application outage
– Costs• Reveal the price of image copies – by examining their resource usage.
� Analyzes all recovery resources for DB2 and IMS subsystems over a specified period
of time.– Note: Resource usage is valid for only DSNUTILB (DB2 image copies). RRR does not
report on CPU/IO for vendor utilities. Same for IMS IC for now.
� Simple installable “Load and Go” program downloadable from– https://www14.software.ibm.com/webapp/iwm/web/reg/download.do?source=swg-
ibmrrrdi&S_PKG=dl&lang=en_US&cp=UTF-8
0 Rand
© 2012 IBM Corporation50
How does it work ?
� RRR will produce a report on– Which tsnames/dbnames do not have a valid image copies within a given time period.
– Which tsnames/dbnames have valid image copies within the same time period•And whether or not these “registered” image copies datasets still exist on the z/OS system
– The CPU and I/O resources required to create these image copies
– It shows IMS Change Accum consumption
SMF
DB2 CatalogOr IMS RECON
ICF Catalog
RRR
© 2012 IBM Corporation51
51
START-TIMESTAMP/END-TIMESTAMP INFO
Image Copy consumption of resources
Change Accumresource consumption summary
This information is for the LPAR –break down on how often ICs are done and which day
Sample Report- SMF Report for IMS
© 2012 IBM Corporation52
Sample Reports – DB2
Without ICs
Recovery Readiness Image Copy Report
Subsystem EA1A
Start Timestamp 2011-05-04-00.01.00.000000
End Timestamp 2011-05-04-23.59.00.999999
Objects without Image Copies
DBNAME TSNAME Part Type IC Dataset IC Dataset Check
________ ________ ____ ____ __________________________ ________________
PARTDB01 PARTTS01 0001 TS Not Checked
PARTDB01 PARTTS01 0002 TS Not Checked
PARTDB01 PARTTS01 0003 TS Not Checked
With IC data sets checked
….
…
Objects with Image Copies
DBNAME TSNAME Part Type IC Dataset IC Dataset Check
________ ________ ____ ____ __________________________ ________________
PARTDB02 PARTTS02 0001 TS PDBOB.DB02.TS02.P01.COPY Checked
PARTDB02 PARTTS02 0002 TS PDBOB.DB02.TS02.P02.COPY Checked
PARTDB02 PARTTS02 0003 TS PDBOB.DB02.TS02.P03.COPY Checked
© 2012 IBM Corporation53
IMS « Local » Recovery
� Using IMS standard utilities– Use DBRC GENJCL.RECOVER command
to generate the correct JCL
– Utilities for indexes
� Using IMS Tools for increased availability, simplification and productivity
� IMS Recovery Expert (IMS RE)
– To facilitate, automate and create easy recovery procedures, and to « power » the use of
storage-based fast replication solutions.
� IMS Recovery Solution Pack– Including DRF to do PITR, to speed up IC processing and build index
� DB2 Recovery Expert with IMS RE to coordinate recovery between DB2 and IMS
•Prepare and test jobs before
•Take time to educate yourself and test different possibilities
•Organize cross team procedures for DB2 and IMS
© 2012 IBM Corporation54
IMS Recovery Expert for z/OS
� Database and Storage-aware backup and recovery tool
� Backup Functions for IMS databases, IMS systems and application libraries
– IMS System Level Backup• IMS Databases, IMS Systems, Recovery Structures, and Application Libraries in one backup at
same point in time
– Automated offloading and encryption of data
– Meta-data repository to maintain information on system level backups
� Intelligent “local” Recovery Manager
– Performs efficient local recoveries using available recovery resources and tools
– IBM IMS backup and recovery utilities look like a single product from the end-users
perspective
� Intelligent “Disaster” Recovery Manager
– Simplifies and automates traditional disaster recovery process • Restore system level backup and restart DBMS • Restore system level backup, restore RECON, run recovery to point in time, restart DBMS
54
© 2012 IBM Corporation55
IMS Recovery Expert for z/OS - Intelligent Recovery Manager (IRM)
� Single interface for recovery processes, ISPF or GUI
� Recovers application, individual database, or indexes
– Even if the SLB contains other databases than the ones we want to recover
– Using Current, Timestamp, or PITR
� Application profile is created in advance – Single database or group of databases
– Logically related databases and indexes can be included automatically
� Determines best recovery method
– Restores from either IC or SLB
– Indexes that can not be restored are rebuilt
– Recovery using log apply needs one pass of the logs
– Access to DBs is automatically stopped and restarted at end of recovery
– Drives the IMS Recovery Solution Pack if needed• Runtime analysis determines utilities to run (and their order)• Spawns recovery jobs as needed
� Storage-based fast-replication performs restore
– Performs an instantaneous data set restore process
© 2012 IBM Corporation5656
IMS Recovery Expert / DB2 Recovery Expert
� Reduce backup, recovery, and administration costs
� Provide a sophisticated infrastructure and metadata to manage the DBMS and storage processor coordination
– DBMS and storage-based fast-replication integration
� Perform backups instantly
� Fast restore and parallel recovery reduces recovery time
� Used for both DR and Local Application Recovery
� Used for IMS and DB2
DB2 & IMS RE
Source DB Volumes
Storage Processor APIs
TargetVolumes DB System
Backup
DB2 & IMS
© 2012 IBM Corporation57
Incremental
Image Oopy
DB Integrity Check
Backup
Image Copy
Database Recovery
Database Recovery FacilityDatabase Recovery Facility IMS HP Change Accum
IMS HP Change Accum
IMS HP Image CopyIMS HP Image Copy
IMS Recovery Solution Pack IMS Recovery Solution Pack
Recovery Health Check
Recovery ExpertRecovery Expert
IMS Recovery Solution Pack
Recovery Health Check
Change Accumulation
IMS Recovery Solution Pack for z/OS
© 2012 IBM Corporation58
IMS Recovery Solution Pack for z/OS – Recovery engine
� Based on DRF functions
� High Performance IMS Database Recovery Solution
– Parallel Input/Output
– Parallel Processing / Sorting
– Single archived Log and CA Data Set Pass
– Single pass DB write
– DBRC Controlled
� Recovery of Multiple DBDS or Areas in one step– Runs in Parallel with IMS Transaction Processing
� Recovery Time Options– Recover to End of Logs
– Time Stamp Recovery (Recovery Point)
– Point-In-Time Recovery (Arbitrary Point)• "Image Copy Needed" state is set in RECON for recovered databases after PITR• List of Open UOW
© 2012 IBM Corporation59
IBDFSPREC0
DRF Master
Address Space
Subordinate
Address Spaces
DRF
Log and CA
Reader
SORT
DBDS / Area
Restore
Control
Function
Sub A/S
Sub A/S
Sub A/S ...
JCL
Report
RECON
FP Area
DBDS
Logs
CAsICs
DupliDS
HPPC
DEDB PC
Auxiliary
Process
HPIC
ICs
IMS Recovery Solution Pack for z/OS – Recovery engine …
© 2012 IBM Corporation60
� Based on IMS Recovery Expert Version 1
� Aid to ensure that the IMS database environment is recoverable – Does not perform the actual database recovery
– IMS Database Recovery Facility (DRF) is the recommended tool for performing IMS
database recoveries
� Functions– Create clean recovery points
– Locate existing recovery points
– Identify problems which may affect recoveries
– Verify needed recovery assets
– Condition RECON data sets for disaster recovery
– Issue IMS commands via batch
6 separate featuresRecovery Point Creation (RPCR)Recovery Point Identification (RPID)Verify Recovery Assets (VERIFY)RECON Data Set Cleanup (RCU)IMS Command Interface (IMSCMD)Health Checker (HCHECK)
And in additionRECON Copy (RECONCOPY)Database List (DBLIST)
IMS Recovery Solution Pack for z/OS – Recovery Expert functions
© 2012 IBM Corporation61 61
IMS and DB2 Disaster Recovery Tutorials
� IBM developerWorks– www.ibm.com/developerworks
• External IBM website with articles, tutorials and demonstrations
� IMS Disaster Recovery Tutorials– Four parts:
• Part 1: Overview of all solutions• Part 2: IMS Base and IMS Tool solutions• Part 3: IMS Recovery Expert Disaster and Local Recovery• Part 4: Coordinated IMS and DB2 Disaster Recovery
– Downloadable demonstration file• Demos are installed on hard disk and viewed with internet browser
© 2012 IBM Corporation62 62
DeveloperWorks URL for Tutorials
• http://www.ibm.com/developerworks/views/data/libraryview.jsp?search_by=IMS+disaster+recovery+solutions
© 2012 IBM Corporation63
Agenda
Questions
� The Path to Autonomics
� IMS Performance & Debugging Solutions Update
� IMS Database Utilities Update
� IMS Backup & Recovery Update
© 2012 IBM Corporation64
Summary
� IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs
� IBM is dedicated to the continued success and support of IMS and the mainframe.
We’re invested for the long term, right beside you.
� We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers
around autonomic computing
Greater Greater
functionfunction
Even better Even better
value for value for
MoneyMoney
Better Better
performanceperformance
© 2012 IBM Corporation65
IMS Resources On-line
� IMS on the web– http://www.ibm.com/ims/
� IMS Tools on the Web
– http://www.ibm.com/software/data/db2imstools/products/ims-tools.html
� IMS Tools Support for IMS V12– http://www-01.ibm.com/support/docview.wss?uid=swg21419734
� IMS Tools Users Guides and Documentation
– http://www.ibm.com/software/data/db2imstools/imstools-library.html