iCluster UserGuide V71TR2

download iCluster UserGuide V71TR2

of 576

Transcript of iCluster UserGuide V71TR2

  • 8/18/2019 iCluster UserGuide V71TR2

    1/575

    Rocket iCluster

    User's Guide

    Version 7.1 Technical Release 2

    October 2014CLU-07TR1–UG-01

  • 8/18/2019 iCluster UserGuide V71TR2

    2/575

    2

    Notices

    Edition

    Publication date: October 2014Book number: CLU-07TR1–UG-01

    Product version: Version 7.1 Technical Release 2

    Copyright

    © Rocket Software, Inc. or its affiliates 2012–2014. All Rights Reserved.

    Trademarks

    Rocket is a registered trademark of Rocket Software, Inc. For a list of Rocket registered trademarks goto: www.rocketsoftware.com/about/legal. All other products or services mentioned in this documentmay be covered by the trademarks, service marks, or product names of their respective owners.

    Examples

    This information might contain examples of data and reports. The examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity tothe names and addresses used by an actual business enterprise is entirely coincidental.

    License agreement

    This software and the associated documentation are proprietary and confidential to Rocket Software,Inc. or its affiliates, are furnished under license, and may be used and copied only in accordance withthe terms of such license.

    Note: This product may contain encryption technology. Many countries prohibit or restrict the

    use, import, or export of encryption technologies, and current use, import, and export regulationsshould be followed when exporting this product.

    http://www.rocketsoftware.com/about/legal

  • 8/18/2019 iCluster UserGuide V71TR2

    3/575

    3

    Corporate information

    Rocket Software, Inc. develops enterprise infrastructure products in four key areas: storage, networks,and compliance; database servers and tools; business information and analytics; and applicationdevelopment, integration, and modernization.

    Website: www.rocketsoftware.comRocket Global Headquarters77 4

    th Avenue, Suite 100

    Waltham, MA 02451-1468USA

    To contact Rocket Software by telephone for any reason, including obtaining pre-sales informationand technical support, use one of the following telephone numbers.

    Country Toll-free telephone number

    United States 1-855-577-4323

    Australia 1-800-823-405

    Belgium 0800-266-65Canada 1-855-577-4323

    China 800-720-1170

    France 08-05-08-05-62

    Germany 0800-180-0882

    Italy 800-878-295

    Japan 0800-170-5464

    Netherlands 0-800-022-2961

    New Zealand 0800-003210

    South Africa 0-800-980-818

    United Kingdom 0800-520-0439

    Contacting Technical Support

    The Rocket Customer Portal is the primary method of obtaining support. If you have current supportand maintenance agreements with Rocket Software, you can access the Rocket Customer Portal andreport a problem, download an update, or read answers to FAQs. To log in to the Rocket CustomerPortal or to request a Rocket Customer Portal account, go to www.rocketsoftware.com/support.

    In addition to using the Rocket Customer Portal to obtain support, you can use one of the telephonenumbers that are listed above or send an email to [email protected].

    mailto:[email protected]://www.rocketsoftware.com/supporthttp://www.rocketsoftware.com/

  • 8/18/2019 iCluster UserGuide V71TR2

    4/575

    4

    Contents

    Notices...................................................................................................................................................................................2

    Corporate information......................................................................................................................................................... 3

    Chapter 1: iCluster 7.1 TR2 summary of changes............................................................................................................ 15Chapter 2: iCluster resources.............................................................................................................................................25

    Chapter 3: Rocket iCluster................................................................................................................................................. 26Starting iCluster...................................................................................................................................................... 26Accessing the job logs............................................................................................................................................27Starting iCluster after a system IPL.......................................................................................................................27Ending iCluster before a system IPL..................................................................................................................... 28

    Chapter 4: User registration...............................................................................................................................................30Registering users.....................................................................................................................................................30Changing registered users..................................................................................................................................... 31Removing registered users.....................................................................................................................................31

    Viewing the Work with Users screen.....................................................................................................................31Server authentication for secure DDM connections.............................................................................................32Verifying DDM authentication................................................................................................................................32Enabling DDM access..............................................................................................................................................33

    Chapter 5: Node operations...............................................................................................................................................35Adding a node to a cluster.................................................................................................................................... 35Viewing the node settings......................................................................................................................................36Removing a node from a cluster...........................................................................................................................36Changing node attributes...................................................................................................................................... 36Renaming a node....................................................................................................................................................37Assigning a failover message queue to a node.................................................................................................... 38Specifying a f ailover user exit on a node..............................................................................................................38

    Changing the status of a node.............................................................................................................................. 39Viewing nodes in the cluster..................................................................................................................................39Checking for communications failure on a node.................................................................................................39Verifying communications between nodes in a cluster.......................................................................................40Changing the IP address of a node.......................................................................................................................41

    Chapter 6: Group operations............................................................................................................................................. 42Setting up groups................................................................................................................................................... 42Adding a group....................................................................................................................................................... 42Changing group attributes.....................................................................................................................................43Removing a group.................................................................................................................................................. 44Viewing groups in a cluster....................................................................................................................................44Working with recovery domains............................................................................................................................44

    Adding a backup node to the recovery domain of a group.....................................................................45Removing a backup node from the recovery domain............................................................................. 45Changing the primary node to the backup node.................................................................................................45Viewing the current settings for a specified group.............................................................................................. 46

    Chapter 7: Starting replication.......................................................................................................................................... 47Initial synchronization............................................................................................................................................47Start replication using marked journal positions................................................................................................ 47Starting replication groups....................................................................................................................................48

    Chapter 8: Resilient devices...............................................................................................................................................49Understanding resilient devices............................................................................................................................49

    Adding a switchable device entry to a group...........................................................................................49

  • 8/18/2019 iCluster UserGuide V71TR2

    5/575

    Contents

    5

    Viewing the attributes of a switchable device replication group............................................................ 49Changing the attributes of a switchable device entry in a group........................................................... 50Removing a switchable device entry from a group..................................................................................50

    Chapter 9: Object specifiers and path object specifiers.................................................................................................. 51Understanding object specifiers............................................................................................................................51Generic object specifiers........................................................................................................................................ 51Rules of precedence for object specifiers.............................................................................................................52

    Working with object specifiers.............................................................................................................................. 52Selecting an object specifier to a replication group................................................................................ 52Changing object specifier attributes......................................................................................................... 56Deselecting an object specifier from a group...........................................................................................59Reconfiguring object specifiers................................................................................................................. 60Viewing object specifiers............................................................................................................................61

    Path object specifiers.............................................................................................................................................61Naming conventions for path object specifiers........................................................................................61Journaled and non-journaled path object specifiers...............................................................................62

    Working with path object specifiers......................................................................................................................62Adding a path object specifier to a group................................................................................................ 62Removing a path object specifier..............................................................................................................63

    Changing path object specifier attributes................................................................................................ 63Chapter 10: Replication considerations............................................................................................................................65

    Replicating database *FILE objects.......................................................................................................................65Replicating BSF objects..........................................................................................................................................66Replicating configuration objects......................................................................................................................... 68Replicating user profiles........................................................................................................................................ 69Replicating LOBs.....................................................................................................................................................69

    Large object (LOB) constraints..................................................................................................................70Replicating triggers.................................................................................................................................................70Using the SAVFEXIT user exit program when replicating save files....................................................................70

    Replicating objects with save files and the SAVFEXIT program.............................................................. 72Replicating SQL objects......................................................................................................................................... 72

    Replicating QDLS or DLO objects..........................................................................................................................73Including the QDLS folder and QDLS sub-folders in replication............................................................. 73Replicating WebSphere MQ objects...................................................................................................................... 74

    Creating a local relational database directory entry............................................................................... 75Enabling WebSphere MQ replication........................................................................................................ 75

    WebSphere MQ recommendations........................................................................................................................75Supported ob ject types for replication.................................................................................................................75

    Chapter 11: Configuring high availability for external applications................................................................................80Configuring replication for external applications................................................................................................ 80Using iCluster with external applications.............................................................................................................80Re-creating groups after Lifecycle Manager upgrade from Version 7.5.............................................................. 82Configuring replication for Rocket Lifecycle Manager......................................................................................... 83

    Configuring replication of objects stored outside of Lifecycle Manager.............................................................84Chapter 12: iCluster operations.........................................................................................................................................85

    Staging objects....................................................................................................................................................... 85Clearing the staging store......................................................................................................................................86Changing the size of  a staging store.....................................................................................................................86Changing the name of a staging store library......................................................................................................86Starting the replication apply process..................................................................................................................87Starting the replication apply process for groups on the backup node............................................................. 88Ending the replication apply process................................................................................................................... 88Ending the replication apply process on a specific node.................................................................................... 89Locked objects and locked object contention..................................................................................................... 89

  • 8/18/2019 iCluster UserGuide V71TR2

    6/575

    Contents

    6

    Commitment control.............................................................................................................................................. 90Specifying the commitment control level for a group.........................................................................................90

    Chapter 13: Cluster operations..........................................................................................................................................92Starting cluster operations at a node...................................................................................................................92Starting cluster operations for groups..................................................................................................................92Restarting cluster node operations with current machine rejoining the cluster................................................93Ending cluster operations at a node.....................................................................................................................93

    Ending cluster operations for all groups.............................................................................................................. 94Ending cluster operations for groups with a specific primary node................................................................... 94Restarting iCluster after restarting a node........................................................................................................... 94Upgrading the version of a cluster........................................................................................................................95Deleting a cluster....................................................................................................................................................95

    Chapter 14: Suspended objects.........................................................................................................................................96Suspending an object.............................................................................................................................................96Suspending a BSF object....................................................................................................................................... 96Activating ob jects................................................................................................................................................... 97

    Activating a suspended object.................................................................................................................. 97Activating BSF objects................................................................................................................................98

    Automatic ob ject reactivation............................................................................................................................... 98

    Removing user profiles from suspension............................................................................................................100

    Chapter 15: Journaling considerations...........................................................................................................................101Uncommitted transactions.................................................................................................................................. 101Remote journaling................................................................................................................................................ 102Configuring remote journaling............................................................................................................................ 103Role switching with remote journals.................................................................................................................. 104Setting journal positions......................................................................................................................................104

    Setting a journal start position............................................................................................................... 105Marking the current journal positions for replication............................................................................106Changing journal receivers...................................................................................................................... 107Displaying replication status of journal receivers..................................................................................107

    Verifying the audit journal................................................................................................................................... 107

    Synchronization points........................................................................................................................................ 108Setting a synchronization point.......................................................................................................................... 108Passing arguments to sync point user exit programs........................................................................................110Retrieving recovery checkpoints......................................................................................................................... 110

    Retrieving a recovery checkpoint from the command line................................................................... 110Performance of replication groups..................................................................................................................... 111

    Logging a journal entry............................................................................................................................111

    Chapter 16: Sync check operations.................................................................................................................................113Setting attributes for sync checks.......................................................................................................................113Selecting sync check attributes for a group.......................................................................................................113Starting a sync check for a group....................................................................................................................... 114Starting a user-specified sync check...................................................................................................................116

    Starting a continuous sync check for a group....................................................................................................120Ending a sync check............................................................................................................................................. 120Viewing sync check results.................................................................................................................................. 121Generating sync check reports............................................................................................................................121Purging sync check results.................................................................................................................................. 122

    Chapter 17: Event log....................................................................................................................................................... 123Displaying the event log.......................................................................................................................................123Clearing the event log..........................................................................................................................................124

    Chapter 18: Failover and switchover mechanisms........................................................................................................ 126What happens during a switchover or failover.................................................................................................. 126Failover mechanisms............................................................................................................................................127

  • 8/18/2019 iCluster UserGuide V71TR2

    7/575

    Contents

    7

    Key differences in failover mechanisms............................................................................................................. 127

    Chapter 19: SwitchOver System...................................................................................................................................... 129User actions...........................................................................................................................................................129Detecting node failures........................................................................................................................................129Defining user exit programs.................................................................................................................................130

    Detecting problems in processing a role switch.................................................................................... 131Node failure examples..........................................................................................................................................132

    Example of manual failover.....................................................................................................................133Example of automatic failover................................................................................................................ 135

    Performing a manual failover..............................................................................................................................136Performing a manual failover after the primary node fails................................................................... 136

    Recovering from failovers.................................................................................................................................... 136Restoring a group whose primary node has failed................................................................................ 137

    Testing switchover for a single group.................................................................................................................137Convert existing clusters to use SwitchOver System.........................................................................................138

    Changing an existing cluster to use SwitchOver System.......................................................................138Cluster limits for SwitchOver System..................................................................................................................139

    Chapter 20: Cluster Resource Services failover mechanism..........................................................................................140Clustering overview and concepts...................................................................................................................... 140

    iCluster and Cluster Resource Services...............................................................................................................141iCluster groups and role switching......................................................................................................................141

    ROLESWITCH parameter.......................................................................................................................... 142Preparing the cluster to handle switchovers and failovers............................................................................... 143

    Journal entry processing......................................................................................................................... 143Failover message queue...........................................................................................................................143Line controller heartbeat.........................................................................................................................143

    Passing arguments to role switch user exit programs.......................................................................................144FAILED state overview..........................................................................................................................................144

    Node failure detection in iCluster........................................................................................................... 144FAILED state scenarios.............................................................................................................................144Detecting a FAILED state..........................................................................................................................145

    Group failover........................................................................................................................................... 145Recovery paths for a FAILED state...................................................................................................................... 146PARTITION state overview................................................................................................................................... 148False and True PARTITIONS.................................................................................................................................148Recovery paths for a PARTITION state................................................................................................................150Restarting active groups...................................................................................................................................... 151

    Restarting active groups with mirroring in the original direction with ROLESWITCH *NO.................. 151Restarting active groups with mirroring in the original direction with ROLESWITCH *YES..................152Restarting active groups with mirroring in the opposite direction with ROLESWITCH *NO.................153Restarting active groups with mirroring in the opposite direction with ROLESWITCH *YES................153

    Rejoining non-functioning nodes........................................................................................................................ 154To rejoin a non-functioning node with a role switch.............................................................................154To rejoin a non-functioning node without a role switch....................................................................... 155

    Removing a failed node from the cluster........................................................................................................... 156Alertable messages for clustering....................................................................................................................... 156Switching the ownership of the iCluster metadata to another node................................................................157Configuring a new cluster to use Cluster Resource Services.............................................................................157Changing an existing cluster to use Cluster Resource Services........................................................................ 158Cluster limits for Cluster Resource Services....................................................................................................... 158

    Chapter 21: Modifying default cluster system values.................................................................................................... 159

    Chapter 22: Role switch operations................................................................................................................................160Changing a primary node to backup node.........................................................................................................160Starting a role switch........................................................................................................................................... 160

  • 8/18/2019 iCluster UserGuide V71TR2

    8/575

    Contents

    8

    Role switch simulator...........................................................................................................................................161Simulating role switches......................................................................................................................................161Ending role switch simulation.............................................................................................................................163

    Chapter 23: Monitoring.....................................................................................................................................................165Monitoring overview.............................................................................................................................................165Understanding latency......................................................................................................................................... 166Status Monitor views............................................................................................................................................ 166

    Real Time Overall Latency view.............................................................................................................. 167Real Time Ob ject Latency view............................................................................................................... 167Real Time Ob ject Position And Totals view............................................................................................168Real Time Ob ject Throughput view.........................................................................................................168

    Status column information..................................................................................................................................169Monitoring the replication environment.............................................................................................................171

    Performing tasks from the Status Monitors........................................................................................... 173Searching while monitoring.....................................................................................................................174Configuring replication monitoring.........................................................................................................175Configuring email for replication monitoring alerts.............................................................................. 176Configuring replication monitoring alerts.............................................................................................. 176

    Object and group status...................................................................................................................................... 177

    Work with Object Status views................................................................................................................177Work with BSF/SQL Status views............................................................................................................ 178Object status reason codes..................................................................................................................................178Out-of-sync reason codes.................................................................................................................................... 181Viewing and changing object status................................................................................................................... 184Working with BSF and SQL objects.....................................................................................................................185Historical Status Monitor views...........................................................................................................................185

    Historical Latency view............................................................................................................................ 185Historical Object Position and Totals view.............................................................................................186Historical Object Throughput view......................................................................................................... 187

    Viewing the Historical Status Monitor.................................................................................................................187Changing the Historical Latency collection process..........................................................................................188Deleting historical information from the Historical Latency.............................................................................189

    Chapter 24: Reporting...................................................................................................................................................... 190iCluster Configuration Report (DMCFGRPT)........................................................................................................190iCluster System Report (DMSYSINF)....................................................................................................................192iCluster Group Status Report (DMGRPSTS)........................................................................................................ 192iCluster Sync Check Report (DMSCRPT)..............................................................................................................193iCluster Replication Coverage Report (DMRPLCVRPT).......................................................................................194iCluster Event Log Report (DMDSPLOG)............................................................................................................. 195Files with Triggers Report (DMRPTTRG)..............................................................................................................195Files with Constraints Report (DMRPTCST)........................................................................................................ 196Journal Analysis Reports (DMANZJRN)............................................................................................................... 197Cross-Library Logical File Report (DMRPTXLF)................................................................................................... 200Objects Count Report (DMOBJCNT)....................................................................................................................201

    Chapter 25: iCluster commands......................................................................................................................................203Node commands...................................................................................................................................................203

    DMADDNODE—Add Node......................................................................................................................... 204DMCHGNODE—Change Node...................................................................................................................208DMRMVNODE—Remove Node.................................................................................................................. 214DMRNMNODE—Rename Node................................................................................................................. 215DMDSPNODE—Display Node....................................................................................................................216DMWRKNODE—Work with Nodes............................................................................................................ 217DMCHGNODIP—Change Node IP Address...............................................................................................218DMINZNODE—Initialize Node for Recovery.............................................................................................219

    Group commands................................................................................................................................................. 220

  • 8/18/2019 iCluster UserGuide V71TR2

    9/575

    Contents

    9

    DMADDGRP—Add Group...........................................................................................................................220DMCHGGRP—Change Group.................................................................................................................... 235DMRMVGRP—Remove Group................................................................................................................... 248DMADDBACK—Add Backup Node to Recovery Domain......................................................................... 249DMRMVBACK—Remove Backup Node from Recovery Domain..............................................................250DMDSPGRP—Display Group..................................................................................................................... 251DMWRKGRP—Work with Groups..............................................................................................................251

    Native IBM i object commands............................................................................................................................253DMSELOBJ—Select Objects to Group......................................................................................................254DMDSELOBJ—Deselect Objects from Group...........................................................................................260DMCHGOBJSL—Change Object Selection............................................................................................... 261DMWRKOBJ—Work with Object Specifiers..............................................................................................267DMSNDOBJ—Send Object Immediately..................................................................................................268

    Byte Stream File (BSF) commands......................................................................................................................270DMADDBSF—Add Path Specifier to Group..............................................................................................271DMRMVBSF—Remove Path Specifier from Group.................................................................................. 275DMCHGBSF—Change Path Specifier to Group........................................................................................276DMWRKBSF—Work with Path Object Specifiers..................................................................................... 279

    External application commands..........................................................................................................................280CFGHAXAPP—Configure HA for External Application.............................................................................280

    RMVHAXAPP—Remove HA for External Application............................................................................... 283Administration commands...................................................................................................................................284

    DMSETSVAL—Set Cluster System Values................................................................................................ 284DMCHGTIME—Change System Date and Time....................................................................................... 302DMCLRLOG—Clear Cluster Event Log......................................................................................................304HAPNGTCP—Ping Using TCP....................................................................................................................306STRHATCP—Start TCP/IP Listener...........................................................................................................307WRKHAJOB—Work with Active Cluster Jobs.......................................................................................... 308DMDLTCLSTR—Delete Cluster..................................................................................................................309DMSETMSTR—iCluster Set Metadata Owner.......................................................................................... 310

    Report commands................................................................................................................................................ 311DMCFGRPT—iCluster Configuration Report............................................................................................311

    DMSYSINF—System Information..............................................................................................................313DMSYSINF—System Information..............................................................................................................314DMSCRPT—Sync Check Report................................................................................................................315DMRPLCVRPT—iCluster Replication Coverage....................................................................................... 317DMDSPLOG—Display Cluster Event Log..................................................................................................318DMRPTTRG—Report Files With Triggers..................................................................................................322DMRPTCST—Report Files With Constraints............................................................................................ 323DMANZJRN—Analyze Journals................................................................................................................ 325DMRPTXLF—Report Cross-library LFs......................................................................................................328DMOBJCNT—Report Object Counts........................................................................................................ 329

    Cluster operation commands..............................................................................................................................330DMSTRCST—Start iCluster Processes......................................................................................................331DMENDCST—End iCluster Processes.......................................................................................................333DMSTRNODE—iCluster Start Node.......................................................................................................... 335DMENDNODE—iCluster End Node........................................................................................................... 336DMREJOIN—iCluster Rejoin Cluster.........................................................................................................337DMSTRGRP—iCluster Start Group........................................................................................................... 339DMENDGRP—iCluster End Group.............................................................................................................342DMSTRSWO—Switchover Group..............................................................................................................344DMSETPRIM—iCluster Prepare Primary.................................................................................................. 345DMCHGROLE—iCluster Change Primary................................................................................................. 346DMSWTCHRDY—iCluster Switchover Ready............................................................................................347RTVSWCHRDY—Retrieve Switchover Ready Status................................................................................349DMSTRRSS—Start Roleswitch Simulator................................................................................................ 350

  • 8/18/2019 iCluster UserGuide V71TR2

    10/575

    Contents

    10

    DMENDRSS—End Roleswitch Simulator................................................................................................. 352DMINZSWO—Initialize System Switchover..............................................................................................353DMFNZSWO—Finalize System Switchover.............................................................................................. 357DMGENEXC—Generate Command Exceptions........................................................................................361

    Replication operation commands.......................................................................................................................362DMSETPOS—Set Journal Start Position..................................................................................................363DMMRKPOS—Mark Journal Positions..................................................................................................... 366

    DSPHAPOS—Display Journal Information..............................................................................................368RTVHAPOS—Retrieve iCluster Journal Position..................................................................................... 369VFYHAJRN—Verify Audit Journal............................................................................................................. 371DMSTRAPY—Start Replication Apply Process.........................................................................................373DMENDAPY—End Replication Apply Process..........................................................................................375RTVAPYSTS—Retrieve Apply Status.........................................................................................................376DMACTOBJ—Activate Object....................................................................................................................378DMACTBSF—Activate BSF Object.............................................................................................................380DMACTOOS—Activate Out of Sync Objects.............................................................................................381DMSUSOBJ—Suspend Object.................................................................................................................. 383DMSUSBSF—Suspend BSF Object........................................................................................................... 384CRTCFGOBJ—Create Configuration Objects...........................................................................................385INITHAOBJ—Initialize Objects..................................................................................................................387

    DMLOGENT—Log Journal Entry...............................................................................................................388DMACTSPLF—Activate Suspended Spooled Files...................................................................................390DMWRKSSPLF—Work with Suspended Spooled Files............................................................................ 391RTVRCVPT—Retrieve Recovery Checkpoint............................................................................................392RTVRCVPTR—Retrieve Recovery Checkpoint (CL Program)...................................................................393SYNCHATRG—Synchronize Triggers........................................................................................................ 395

    Monitor commands.............................................................................................................................................. 396WRKCSMON—Work with Full Cluster Monitor........................................................................................ 397WRKHASMON—Work with Status Monitor on Primary Node.................................................................398WRKHATMON—Work with Status Monitor on Backup Node..................................................................399DSPHASMON—Display Source Monitor...................................................................................................400CHGHASMON—Change History Monitor on Primary Node.................................................................... 400

    PRGHASMON—Purge History Monitor on Primary Node....................................................................... 403WRKHAOBJST—Work with Object Status............................................................................................... 404WRKHABSFST—Work with BSF Status.................................................................................................... 405DMWRKOBJST—Work with Object Status by Group.............................................................................. 406

    Sync check commands.........................................................................................................................................407SELSCATTR—Select Sync Check Attributes............................................................................................ 408DMSCATTR—Select Sync Check Attributes for a Group......................................................................... 413DMSTRSC—Start group sync check.........................................................................................................417DMSTRSCUSR—Start user-specified sync check.....................................................................................421STRCNSC—Start continuous sync check.................................................................................................426DMSCRPT—Sync Check Report................................................................................................................427DSPHASC—Display Sync Check Results.................................................................................................. 429ENDHASC—End Sync Check.....................................................................................................................430PRGHASC—Purge Sync Check Results.................................................................................................... 430DMSYNCACT—Sync Check and Activate..................................................................................................431STRHASC—Start group sync check..........................................................................................................432STRHASCUSR—Start user-specified sync check..................................................................................... 436

    Registered iCluster user commands................................................................................................................... 441DMWRKUSR—Work with Users................................................................................................................ 441DMADDUSR—Add User............................................................................................................................. 442DMCHGUSR—Change User....................................................................................................................... 444DMRMVUSR—Remove User...................................................................................................................... 445

    Utility commands..................................................................................................................................................446DMAUTOCFG—Auto-configure iCluster....................................................................................................446

  • 8/18/2019 iCluster UserGuide V71TR2

    11/575

    Contents

    11

    DMMONHA—Monitor iCluster Replication...............................................................................................449ENDMONHA—End iCluster Replication Monitoring................................................................................ 451DMWRKALR—iCluster Alert Destinations.................................................................................................452DMADDALR—Add iCluster Alert Destination........................................................................................... 453DMCHGALR—Change iCluster Alert Destination.....................................................................................454DMRMVALR—Remove iCluster Alert Destination....................................................................................455RTVHACFGS—Retrieve HA Configuration Source................................................................................... 456

    Switchable device commands.............................................................................................................................457DMADDSWDEV—Add Switchable Device Entry to Group........................................................................458DMDSPASPGP—Display Switchable Device Group................................................................................. 459DMCHGSWDEV—Change Switchable Device Entry to Group................................................................. 459DMRMVSWDEV—Remove Switchable Device Entry to Group................................................................ 460

    Other commands.................................................................................................................................................. 461SETHAREG—Restore iCluster Communications Registry.......................................................................461DMDSPCRG—Display Cluster Resource Group........................................................................................462DMDSPCNODE—Display Cluster Node.....................................................................................................463DMSETSYNC—Set Sync Point...................................................................................................................463DMSYNCCMD—Run Command At Sync Point......................................................................................... 467

    Journal management commands....................................................................................................................... 470DMWRKJRN—Work with Journals........................................................................................................... 471

    CHGHAJRN—Change Journal Receiver................................................................................................... 473DLTHAJRCV—Delete Journal Receivers.................................................................................................. 474ENDHADJRCV—End Journal Management..............................................................................................477DMDSPJNMNG—Display Journal Management Details..........................................................................479DMRMVJNMNG—Remove Journal Management Record........................................................................479DMSTRJNMNG—Restart journal management jobs...............................................................................480

    Access path maintenance commands................................................................................................................ 481DMWRKAPLST—Work with Access Path Lists......................................................................................... 482DMCRTAPLST—Create Access Path List..................................................................................................482DMDLTAPLST—Delete Access Path List...................................................................................................483DMDSPAPLST—Display Access Path List.................................................................................................484DMADDAPL—Add Access Path To List.....................................................................................................485

    DMRMVAPL—Remove Access Path from List.......................................................................................... 486DMADDPFAPL—Add PF Access Paths To List..........................................................................................487DMRMVPFAPL—Remove PF Access Paths From List.............................................................................. 489DMSTRAPM—Start Access Path Maintenance.........................................................................................490DMENDAPM—End Access Path Maintenance..........................................................................................492DMCHGAPM—Change Access Path Maintenance....................................................................................493DMDSPAPM—Display Access Path Maintenance Details........................................................................494DMREGAPLST—Register access path list................................................................................................ 495

    Tools for replicating job schedule entries.......................................................................................................... 496DMRTVJSE—Retrieve Job Schedule Entries............................................................................................496DMAP YJSE—Apply Job Schedule Entries................................................................................................ 497DMRMVJSE—Remove Job Schedule Entries........................................................................................... 499

    Chapter 26: iCluster Administrator and Event Viewer....................................................................................................500Starting and logging on to iCluster Administrator.............................................................................................500

    Logging on to iCluster Administrator......................................................................................................500Setting system values in iCluster Administrator.................................................................................... 501

    Chapter 27: Monitoring operations with the iCluster Administrator.............................................................................503

    Chapter 28: Node operations with the iCluster Administrator......................................................................................504Setting up nodes...................................................................................................................................................504

    Adding a node to the cluster................................................................................................................... 504Removing a node from the cluster..........................................................................................................505

    Changing node attributes with iCluster Administrator......................................................................................505Associating a job description to a node................................................................................................. 505

  • 8/18/2019 iCluster UserGuide V71TR2

    12/575

    Contents

    12

    Assigning statuses to replicated user profiles........................................................................................506Enabling iCluster to create and hold replication objects...................................................................... 506Configuring a node to use switchable resources................................................................................... 507Checking for communications failure on a node................................................................................... 507Assigning a failover message queue to a node...................................................................................... 508Specifying a failover user exit on a node................................................................................................508Changing the status of a node................................................................................................................ 509

    Chapter 29: Group operations with iCluster Administrator...........................................................................................510Setting up groups................................................................................................................................................. 510

    Adding a replication group...................................................................................................................... 510Adding a refresh-only group....................................................................................................................512Adding a WebSphere MQ group.............................................................................................................. 514Removing a replication group................................................................................................................. 514Removing a refresh-only group............................................................................................................... 515Removing an MQSeries group................................................................................................................. 515

    Changing group attributes...................................................................................................................................515Assigning a target library for replicated objects of a group.................................................................. 515Assigning a failover message queue for a group....................................................................................516Effecting a roleswitch at failover for a group......................................................................................... 516

    Assigning user exit programs for role switches......................................................................................517Specifying the polling interval for a group............................................................................................. 518Saving active objects in a group............................................................................................................. 518Configuring journaling for a replication group.......................................................................................519Specifying a BSF journal for a group...................................................................................................... 520Configuring recovery exposure for a group............................................................................................520Specif ying a description for a group.......................................................................................................521Changing a journal location for a group.................................................................................................521

    Converting groups................................................................................................................................................ 522To convert a replication group to a refresh-only group........................................................................ 522To convert a refresh-only group to a replication group........................................................................ 522

    Working with recovery domains..........................................................................................................................522Adding a backup node to a group’s recovery domain...........................................................................522

    Removing the backup node from the recovery domain of a replication group....................................523

    Chapter 30: Using object specifiers with iCluster Administrator...................................................................................524Working with object specifiers.............................................................................................................................524

    Selecting a native object specifier to a replication group..................................................................... 524Deselecting an object specifier................................................................................................................526Changing a native object specifier.......................................................................................................... 526

    Working with path specifiers............................................................................................................................... 527Selecting a path object specifier to the replication group.................................................................... 528Changing a path object specifier.............................................................................................................529

    Chapter 31: Cluster operations with iCluster Administrator......................................................................................... 530Starting cluster operations at the specified node..............................................................................................530

    Starting cluster operations for a replication group........................................................................................... 530Starting cluster operations for a refresh-only group......................................................................................... 531Starting cluster operations for a WebSphere MQ group....................................................................................531Restarting node operations and rejoining the cluster.......................................................................................531Ending cluster operations.................................................................................................................................... 532Ending cluster operations at the specified node............................................................................................... 532Ending cluster operations for a replication group.............................................................................................532Ending cluster operations for a refresh-only group...........................................................................................533Ending cluster operations for a WebSphere MQ group..................................................................................... 533Ending cluster operations and deleting cluster definitions on all active nodes...............................................533

    Chapter 32: Replication operations with iCluster Administrator.................................................................................. 535

  • 8/18/2019 iCluster UserGuide V71TR2

    13/575

    Contents

    13

    Replicating native objects outside of a group to a target node........................................................................535Replicating path objects outside of a group to a target node.......................................................................... 536Activating objects................................................................................................................................................. 536

    Activating an object..................................................................................................................................536Suspending objects.............................................................................................................................................. 537

    Suspending a native object..................................................................................................................... 537Suspending a path object........................................................................................................................537

    Chapter 33: Role switch operations with iCluster Administrator..................................................................................539Initiating role switches.........................................................................................................................................539

    Initiating a role switch within a replication group.................................................................................539Initiating a role switch within an MQSeries group................................................................................. 539

    Preparing primary nodes for role switches........................................................................................................ 540Setting a primary node for a replication group..................................................................................... 540

    Changing roles...................................................................................................................................................... 540Changing the role of the primary node for a replication group............................................................ 540Changing the role of the primary node for an MQSeries group.............................................................540

    Chapter 34: Journaling considerations with iCluster Administrator.............................................................................542Setting journal positions......................................................................................................................................542

    Marking current journal positions for a replication group.................................................................... 542

    Setting journal positions for replication groups.................................................................................... 543Setting synchronization points............................................................................................................................543

    Setting a synchronization point for a group...........................................................................................544Starting the apply process...................................................................................................................................545

    Starting the apply process for a replication group................................................................................ 546Starting the apply process for an MQSeries group................................................................................ 546

    Ending the apply process.....................................................................................................................................547Ending the apply process for a replication group..................................................................................547Ending the apply process for a WebSphere MQ group.......................................................................... 547

    Chapter 35: Using the Event Viewer................................................................................................................................549Working with the Event Viewer............................................................................................................................549

    Starting the Event Viewer........................................................................................................................ 549

    Applying a filter to all event types.......................................................................................................... 549Applying a filter to replication events.....................................................................................................550Applying a filter to communication events............................................................................................ 551Applying a filter to cluster events........................................................................................................... 552Clearing the Event Viewer log..................................................................................................................552

    Exporting event messages................................................................................................................................... 552Exporting the event log to the clipboard................................................................................................553Exporting the event log to a printer........................................................................................................553Exporting the event log to a file..............................................................................................................553

    Setting the message frame size...........................................................................................................................554Setting the message frame size...............................................................................................................554

    Detailed messages................................................................................................................................................554

    Viewing detailed messages in the Event Viewer.....................................................................................554Chapter 36: Monitoring replication activity and status using iCluster Administrator..................................................555

    Using the Backup Monitor................................................................................................................................... 555Starting the Backup Monitor................................................................................................................... 556Refreshing the Backup Monitor............................................................................................................... 556Changing the refresh rate of the Backup Monitor..................................................................................556Resetting the transaction count for the Backup Monitor......................................................................557

    Using the Object Status Monitor......................................................................................................................... 557Starting the Object Status Monitor......................................................................................................... 557Starting the Object Status Monitor from the Backup Monitor.............................................................. 558Activating an object using the Object Status Monitor........................................................................... 558

  • 8/18/2019 iCluster UserGuide V71TR2

    14/575

    Contents

    14

    Suspending a native object using the Object Status Monitor............................................................... 558Suspending a path object using the Object Status Monitor..................................................................559Manually refreshing the Object Status Monitor......................................................................................559

    Using the Performance Monitor.......................................................................................................................... 559Starting the Performance Monitor for a replication group....................................................................561Starting the Performance Monitor for an MQSeries group....................................................................561Changing the Performance Monitor refresh rate................................................................................... 562

    Manually refreshing the Performance Monitor.......................................................................................562Viewing the progress of an object refresh on the Performance Monitor.............................................. 562Changing the latency time format on the Performance Monitor.......................................................... 562

    Index.................................................................................................................................................................................. 564

  • 8/18/2019 iCluster UserGuide V71TR2

    15/575

    15

    Chapter 1: iCluster 7.1 TR2 summary of changes

    Rocket iCluster 7.1 TR2 introduces the following enhancements and changes.

    October 2014

    Major enhancements

    iCluster Mobile Monitor

    The iCluster Mobile Monitor performs replication monitoring of an iCluster environment froma smart phone, tablet, or computer that has remote access to the servers where iCluster isinstalled. From any device, use a web browser that supports HTML5 to access the Mobile Monitorgraphical interface that provides replication monitoring and supports other configuration andoperational functions that include starting, ending, and switching replication groups. For detailson installing, configuring, and using the iCluster Mobile Monitor, see the Rocket iCluster MobileMonitor Installation Guide in the Rocket Documentation Library at docs.rocketsoftware.com.

    Reports menu

    A full reports menu is available. Use Option 9 on the iCluster main menu to view and produce the

    following reports:

    ▪ iCluster Configuration Report

    ▪ iCluster System Report

    ▪ Group Status Report

    ▪ Sync Check Report

    ▪ iCluster Replication Coverage Report

    ▪ Display Cluster Event Log

    ▪ Report Files With Triggers

    ▪ Report Files With Constraints

    ▪ Journal Analysis reports:

    ▪ DMANZJBAND—Journal bandwidth▪ DMANZJNTVO—Journal analysis for native objects

    ▪ DMANZJBSFO—Journal analysis for IFS objects

    ▪ DMANZJPGM—Journal analysis by program

    ▪ DMANZJJOB—Journal analysis by job

    ▪ DMANZJNENT—Journal analysis by entry type for native objects

    ▪ DMANZJBENT—Journal analysis by entry type for IFS objects

    ▪ DMANZJJRN—Journal totals

    ▪ Report Object Counts

    ▪ Report Cross-library Logical Files

    For more information, see Reporting, on page 190.

    Full Cluster Status Monitor

    The Full Cluster Status Monitor shows the status of all group and journal combinations on allnodes. Use Option 8 on the iCluster main menu to access the Full Cluster Status Monitor fromany active node to view replication status, latency, and replication throughput of all replicationgroups in the cluster. The Full Cluster Status Monitor requires a terminal emulator with a 132-column display.

    For more information, see WRKCSMON—Work with Full Cluster Monitor, on page 397.

    http://docs.rocketsoftware.com/

  • 8/18/2019 iCluster UserGuide V71TR2

    16/575

    Chapter 1: iCluster 7.1 TR2 summary of changes

    16

    Options and functions on the Work with Object Status and Work with BSF/SQL Object Status

    screens

    The following enhancements are available on the Work with Object Status and Work with BSF/SQL Object Status screens:

    ▪ Option 6 to display the journal entry that caused an object suspension

    ▪ F21 for a command line

    Status monitor options and functions

    More information is displayed in the Status Monitors.

    ▪ The RPB status column displays the following additional information:

    ▪ L (latency) in the R (remote journal process) column when the remote journal process haslatency for the local journal.

    ▪ D (applied delay) displays in the B (apply process on the backup node) column when anapplied delay is configured for the group.

    ▪ The switch readiness status displays in the R (Ready for switch) column.

    The Status Monitors have the following new options:

    ▪3—Work with BSF specifiers

    ▪ 41—Display the Work with Journals (DMWRKJRN) panel

    ▪ 93—Display the Work with Nodes (DMWRKNODE) panel

    From the Full Cluster Status Monitor, the Status and History Monitors, and the Work with Objectsscreens, press F21 for a command line.

    Start and end iCluster process commands

    After an initial program load (IPL), use the DMSTRCST—Start iCluster Processes command tostart the iCluster processes. The DMSTRCST command starts the current node and the groupsthat are configured to autostart. You can use this command from a job scheduler or a CL startupprogram.

    Before an initial program load