Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.
-
Upload
berniece-thompson -
Category
Documents
-
view
233 -
download
3
Transcript of Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.
![Page 1: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/1.jpg)
Managing SX.e and TWL with scripts and MARC
02/12/04Jeremiah Curtis
![Page 2: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/2.jpg)
AssumptionsYou should understand:
1. MARC -- What it is and generally what it does
2. Unix -- what it is and basic commands
3. Shell Scripts -- what they are and what they are used for
4. Basic understanding of TWL (for the TWL specific portions – you can nap during these portions if you are not
concerned with TWL)
![Page 3: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/3.jpg)
Once upon a time…• … customers as well as NxTrend
personnel identified the need to have a standard set of scripts
• MARC would generate the standard set
• Everyone would be happy
![Page 4: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/4.jpg)
The Shadow...• NxTrend support identified needs
that the MARC scripts did not address
• The product evolved, but MARC was not well suited to this change
• So, there became two sets of scripts– GFI for Go For It– MARC
![Page 5: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/5.jpg)
Confusion Reigned...
• There was confusion – Which scripts should be used? – Which were getting installed?
![Page 6: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/6.jpg)
An Alliance was Forged...
• The decision came that there should be only one set of scripts
• MARC should generate these scripts
• MARC should be flexible enough to handle future needs
![Page 7: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/7.jpg)
Harmony was Restored...• All scripts will be generated by MARC
and are stored as templates• No longer hand editing scripts• Script issues will begin by regenerating
all scripts• New scripts are easily added
and existing ones easilyupdated
![Page 8: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/8.jpg)
The End
![Page 9: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/9.jpg)
The Changes
• The next section describes the current set of scripts
![Page 10: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/10.jpg)
New Scripts and New Names
• Many new scripts have been added to MARC’s script base
• Many more scripts had a name change to standardize names and functions
![Page 11: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/11.jpg)
The Progress Admin Server
• These scripts help manage the Progress Admin and Name Serversadmin.start
admin.shut
admin.query
nameserver.query
![Page 12: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/12.jpg)
The Database• These scripts help manage the
database brokersdbbroker.startdbbroker.shutdbbroker.query
• These are database utilitiesdbstatstruncate.bi
![Page 13: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/13.jpg)
The Application Broker
• These scripts help manage the Progress Application Brokersappbroker.start
appbroker.shut
appbroker.query
![Page 14: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/14.jpg)
Parameter Files• The following are a new set of
parameter files for client connectionsclient.pfeditor.pfbatch.pfsingleuser.pfconnect.pf
![Page 15: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/15.jpg)
The Environment
• These scripts help manage this particular environmentnxt.env
nxtall.start
nxtall.shut
![Page 16: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/16.jpg)
Enterprise
• To start SX.enterprise, now use sxesxe
sxee
![Page 17: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/17.jpg)
The Report Manager
• These are the Report Manager scriptsrptmgr (or rptmgr.start)
rptmgr.shut
![Page 18: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/18.jpg)
Binary Dump and Load
• These scripts are for Dump and Loadseasybd sareabd
bddriver.p sareabddriver.p
bddumpall.p bddumparea.p
bdloadall.p bdloadarea.p
bdscript.p sareabdscript.p
![Page 19: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/19.jpg)
After Imaging
• These scripts are for AIaimage.start
aimage.shut
aimage.backedup
aimage.list
aimage.archive
aimage.new
aistats
rollforward.ai
truncate.ai
![Page 20: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/20.jpg)
Backups
• These are new standard backup scriptsbackup.data
backup.full
backup.online
backup.files
![Page 21: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/21.jpg)
RxServer
• RxServer scripts are now generated by MARCrxsfax.sh
rxsprint.sh
emailout.sh
![Page 22: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/22.jpg)
Other Scripts
• These don’t fit anywhere elserdclean
sassi.sh
shutuser
showuser
config_rpt
![Page 23: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/23.jpg)
TWL
• TWL scripts have been mostly rewritten
• MARC generates all of the needed TWL scripts
• TWL scripts now follow a standard naming convention
![Page 24: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/24.jpg)
Additional TWL Application Broker• These scripts help manage the Application
Broker that manages TWL connections to the SX.enterprise databasetwlentappbroker.starttwlentappbroker.shuttwlentappbroker.query
• TWL also uses the normal appbroker scripts which are generated from TWLMARC. These appbrokers are for connections to the TWL database
![Page 25: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/25.jpg)
TWL RF Units
• These scripts are used to start the TWL application on RF unitstwlrf
twlentrf
twlentrf.pf
![Page 26: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/26.jpg)
Additional TWL Environment
• Since TWL integrates with SX.enterprise, an additional environment is available using:twlsecondary.env
![Page 27: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/27.jpg)
TWL End of Day• These scripts are used to run TWL End
of Day processing. These are usually called from the backup scripts
• The first script performs processing that requires a single-user connection to the DB while the second performs tasks using a normal multi-user connection to the DBtwleod1
twleod2
![Page 28: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/28.jpg)
TWL Interfaces
• The following scripts are used to manage the TWL interfacestwlsend.start twlrcvpack.sh
twlsend.sh twlrcv.sh
twlsend.shut twlrcv.shut
twlsend.query twlrcv.query
![Page 29: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/29.jpg)
The Templates
• The next section describes the new Script Generator in MARC
![Page 30: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/30.jpg)
MARC Generate Scripts• MARC• Databases -> Configure ->
Generate Scripts• Select the database(s) to generate
scripts for• Select the scripts to generate
![Page 31: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/31.jpg)
Script Template• All scripts generated by MARC
are stored as templates• These templates contain the
form of the final script• Critical portions of a template
contain tags• These tags get substituted with
real values to generate a script
![Page 32: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/32.jpg)
MARC Generate Scripts• All of the templates reside in
subdirectories under /rd/marc/scripts/template
• All templates must end with a .tpl
• These subdirectories are:basedghpibmsco intchantaxwaretwl
![Page 33: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/33.jpg)
• All of the templates in base are added to the list
• One system directory is included based on the selected machine type in Installations -> Configure (e.g. ibm)
• If optional products are setup in MARC, then those templates are also included in the list (e.g. twl)
• The custom directory is always checked first and overrides a standard template of the same name
MARC Generate Scripts
![Page 34: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/34.jpg)
• Script templates may also be in /rd/marc/scripts/cust in the same subdirectories
• Copy the template from the directory under /rd/marc/scripts/template
Custom Scripts
![Page 35: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/35.jpg)
Template Tags
• There are two types of template tags– System tags (defined by MARC)– Custom tags (defined by the user)
• Tags are names enclosed in ‘< >’– Example: <ENVNAME>
• The convention is to use tag names that are all capital letters
![Page 36: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/36.jpg)
System Tags
• System tags are defined during the installation of MARC
• System tags contain values that MARC can get from the information in its own database
• System Tags can not be edited directly with the tag editor
![Page 37: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/37.jpg)
Custom Tags• Users may use the Tag Editor to create
and edit tags.• Custom tags are created by users or
may be in some delivered scripts (e.g. rxsprint.sh)
• Values for the tags can be assigned in two ways:– By answering the prompt when MARC finds
an undefined tag– By using the tag editor in Databases ->
Configure -> Tag Editor
![Page 38: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/38.jpg)
The Tag Editor
• The tag editor allows the user to:– Create new custom tags– Modify existing custom tags– Delete custom tags
![Page 39: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/39.jpg)
Example Template• Here is a simple template
<SCRIPTNAME=ENV”helloworld.sh”>
<DESTDIR=BIN>
echo “Hello, world!”
• Top two lines are reserved for formatting• SCRIPTNAME is what the script will be
called• DESTDIR tells where the script will get
created
![Page 40: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/40.jpg)
Script Naming
<SCRIPTNAME=ENV”helloworld.sh”>
• All scripts should be prefaced with the environment name
• Use ENV before the script name to substitute in the environment name in the MARC that is generating the script
![Page 41: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/41.jpg)
Destinations
<DESTDIR=BIN>
• The destination directory can be a path• The destination can be one of these
predefined directoriesBINOPSYSRDEXEC
![Page 42: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/42.jpg)
Building A Script• Here is a simple template
“helloworld.sh.tpl”
<SCRIPTNAME=ENV”helloworld.sh”>
<DESTDIR=BIN>
echo “Hello, world!”
• Should be created in the ../cust/base directory
• Generating script to /rd/bin/
![Page 43: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/43.jpg)
Script Templates - Summary
• All scripts will be generated by MARC and are stored as templates
• Should no longer hand edit scripts• Script issues will begin by
regenerating all scripts• New scripts are easily added and
existing ones easily updated
![Page 44: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/44.jpg)
MARC Enhancements
The next section describes some changes in Progress 9 and changes in MARC 10.1
![Page 45: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/45.jpg)
First, Some Background
• With the advent of Progress 9, there are some new concepts to understand
• MARC 10.1 also contains many changes to accommodate the new version of Progress as well as a few enhancements
![Page 46: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/46.jpg)
Storage Areas• The Progress database has changed to
incorporate a new concept of storage areas
• Storage areas are a logical grouping of tables
• Storage areas are also in their own files on disk and have extents
• Oh, and by the way, all Progress 9 databases are multi-volume and will have extents
![Page 47: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/47.jpg)
Progress Admin and Name Servers
• MARC can now configure the ports used by the Progress Admin and Name Servers– Admin Server Port– Admin Server Admin Port– Name Server Port
• Allows for multiple installs of Progress– Live: /rd/dlc– Test: /test/rd/dlc
![Page 48: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/48.jpg)
Installation Configure Screen
• New Environment Name• Online Backup Directory• AI Save Directory• Layout Changes
![Page 49: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/49.jpg)
Database Configuration• With storage areas, MARC has the
ability to configure extents for the storage areas
• Each storage area can be configured to have a certain number of fixed extents plus the size for the fixed extents
![Page 50: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/50.jpg)
AppServer Changes• The AppServer source code is not
on the Unix server anymore• Therefore the AppServer is not
compiled from MARC anymore• The AppServer is pushed from the
Staging Client
![Page 51: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/51.jpg)
TWL Related Changes
• There are now two AppServer configurations– twlappsrv– twlsxappsrv
• TWL warehouse locations now only configure the name of the location
![Page 52: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/52.jpg)
Backup Configuration• Backup configuration have been
completely rewritten• Configuring backups have changed
– They work– Tape Device– AI– Online Backup
• Script templates are copied for the type of backup needed
![Page 53: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/53.jpg)
Shutuser
• The Disconnect User function has been completely rewritten
• MARC now calls the shutuser script– The script is generated by MARC– It works– There is a lookup available (F12) to
see users logged in
![Page 54: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/54.jpg)
Dump and Load
• There are two types of dump and load– For an upgrade which included a Progress 9
upgrade, a dump and load is needed to put the data into the correct storage areas
– For maintenance, a dump and load is used to realign data and improves performance
– There are different functions for each type of dump and load
![Page 55: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/55.jpg)
Maintenance Dump and Load
• Reworked in MARC 10.1– A storage area can be dumped and
loaded– The dump and load is based on
scripts proven to work
![Page 56: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/56.jpg)
Script Generation
• The script generation module in MARC has been completely rewritten
• Script generation is now template-based• No hacking required• Script generation is logged
– scriptgen log– systemtag.lst
![Page 57: Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.](https://reader036.fdocuments.net/reader036/viewer/2022062423/5697bf8e1a28abf838c8cf8b/html5/thumbnails/57.jpg)
Questions
?
?
?
?
?
?
?
?
?
?
?
?