IBM Tivoli Workload Scheduler for z/OS Best Practices: End-to-end and mainframe scheduling, 2nd Edition

IBM Tivoli Workload Scheduler for z/OS Best Practices: End-to-end and mainframe scheduling, 2nd Edition

by Vasfi Gucer, Michael A Lowry, Darren Pfister, Cy Atkinson, Anna Dawson, Neil E Ogle, Stephen Viola, Sharon Wheeler
Released May 2006
Publisher(s): IBM Redbooks
ISBN: None

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM Redbooks publication serves as a reference for system programmers and administrators who will be installing IBM Tivoli Workload Scheduler for z/OS in mainframe and end-to-end scheduling environments.

Installing IBM Tivoli Workload Scheduler for z/OS requires an understanding of the started tasks, the communication protocols and how they apply to the installation, how the exits work, how to set up various IBM Tivoli Workload Scheduler for z/OS parameters and their functions, how to customize the audit function and the security, and many other similar topics.

In this book, we have attempted to cover all of these topics with practical examples to help IBM Tivoli Workload Scheduler for z/OS installation run more smoothly. We explain the concepts, then give practical examples and a working set of common parameters that we have tested in our environment.

Table of contents

  1. Notices
    1. Trademarks
  2. Preface
    1. The team that wrote this redbook
    2. Become a published author
    3. Comments welcome
  3. Summary of changes
    1. May 2006, Second Edition
  4. Part 1: Tivoli Workload Scheduler for z/OS mainframe scheduling
    1. Chapter 1: Tivoli Workload Scheduler for z/OS installation
      1. Before beginning the installation
      2. Starting the install
      3. Updating SYS1.PARMLIB
        1. Update the IEFSSNxx member
        2. Updating the IEAAPFxx member
        3. Updating the SMFPRMxx member
        4. Updating the dump definitions
        5. Updating the XCF options (when using XCF)
        6. VTAM parameters
        7. Updating the IKJTSOxx member
        8. Updating SCHEDxx member
      4. SMF and JES exits installation
      5. Running EQQJOBS (1/3)
      6. Running EQQJOBS (2/3)
      7. Running EQQJOBS (3/3)
        1. How to run EQQJOBS
        2. Option 1
        3. Option 2
        4. Option 3
      8. Security
      9. Allocating the data sets (1/2)
      10. Allocating the data sets (2/2)
        1. Sizing the data sets
      11. Creating the started tasks
      12. Defining Tivoli Workload Scheduler for z/OS parameters
      13. Setting up the ISPF environment
      14. Configuring Tivoli Workload Scheduler for z/OS; building a current plan
        1. Setting up the initial Controller configuration
      15. Building a workstation (1/4)
      16. Building a workstation (2/4)
      17. Building a workstation (3/4)
      18. Building a workstation (4/4)
        1. Building a calendar
        2. Building an application/operation
        3. Creating a long-term plan
        4. Creating a current plan
    2. Chapter 2: Tivoli Workload Scheduler for z/OS installation verification
      1. Verifying the Tracker
        1. Verifying the MLOG
        2. Verifying the events in the event data set
        3. Diagnosing missing events
      2. Controller checkout
        1. Reviewing the MLOG
        2. Controller ISPF checkout
      3. DataStore checkout
    3. Chapter 3: The started tasks
      1. Overview
      2. The Controller started task
        1. Controller subtasks
        2. Controller started task procedure
      3. The Tracker started task
        1. The Event data set
        2. The Tracker procedure
        3. Tracker performance
      4. The DataStore started task
        1. DataStore procedure
        2. DataStore subtasks
      5. Connecting the primary started tasks
      6. The APPC Server started task
        1. APPC Server procedure
      7. TCP/IP Server
    4. Chapter 4: Tivoli Workload Scheduler for z/OS communication
      1. Which communication to select
      2. XCF and how to configure it
        1. Initialization statements used for XCF
      3. VTAM: its uses and how to configure it
      4. Shared DASD and how to configure it
      5. TCP/IP and its uses
      6. APPC
    5. Chapter 5: Initialization statements and parameters
      1. Parameter members built by EQQJOBS
      2. EQQCONOP and EQQTRAP (1/8)
      3. EQQCONOP and EQQTRAP (2/8)
      4. EQQCONOP and EQQTRAP (3/8)
      5. EQQCONOP and EQQTRAP (4/8)
      6. EQQCONOP and EQQTRAP (5/8)
      7. EQQCONOP and EQQTRAP (6/8)
      8. EQQCONOP and EQQTRAP (7/8)
      9. EQQCONOP and EQQTRAP (8/8)
        1. OPCOPTS from EQQCONOP
        2. OPCOPTS from EQQTRAP
        3. The other OPCOPTS parameters
        4. CONTROLLERTOKEN(ssn), OPERHISTORY(NO), and DB2SYSTEM(db2)
        5. FLOPTS
        6. RCLOPTS
        7. ALERTS
        8. AUDITS
        9. AUTHDEF
        10. EXITS
        11. INTFOPTS
        12. JTOPTS
        13. NOERROR
        14. RESOPTS
        15. ROUTOPTS
        16. XCFOPTS
      10. EQQCONOP - STDAR
      11. EQQCONOP - CONOB
      12. RESOURCE - EQQCONOP, CONOB
      13. EQQTRAP - TRAP
        1. TRROPTS
        2. XCFOPTS
      14. EQQTRAP - STDEWTR
      15. EQQTRAP - STDJCC
    6. Chapter 6: Tivoli Workload Scheduler for z/OS exits
      1. EQQUX0nn exits
        1. EQQUX000 - the start/stop exit
        2. EQQUX001 - the job submit exit
        3. EQQUX002 - the JCL fetch exit
        4. EQQUX003 - the application description feedback exit
        5. EQQUX004 - the event filter exit
        6. EQQUX005 - the JCC SYSOUT archiving exit
        7. EQQUX006 - the JCC incident-create exit
        8. EQQUX007 - the operation status change exit
        9. EQQUX009 - the operation initiation exit
        10. EQQUX011 - the job tracking log write exit
      2. EQQaaaaa exits
        1. EQQUXCAT - EQQDELDS/EQQCLEAN catalog exit
        2. EQQDPUE1 - daily planning report exit
        3. EQQUXPIF - AD change validation exit
        4. EQQUXGDG - EQQCLEAN GDG resolution exit
      3. User-defined exits
        1. JCL imbed exit
        2. Variable substitution exit
        3. Automatic recovery exit
    7. Chapter 7: Tivoli Workload Scheduler for z/OS security
      1. Authorizing the started tasks
        1. Authorizing Tivoli Workload Scheduler for z/OS to access JES
      2. UserID on job submission
      3. Defining ISPF user access to fixed resources
        1. Group profiles
    8. Chapter 8: Tivoli Workload Scheduler for z/OS Restart and Cleanup
      1. Implementation
        1. Controller Init parameters
      2. Cleanup Check option
        1. Restart and Cleanup options
      3. Ended in Error List criteria (1/2)
      4. Ended in Error List criteria (2/2)
      5. Steps that are not restartable (1/2)
      6. Steps that are not restartable (2/2)
        1. Re-executing steps
        2. EQQDELDS
        3. Deleting data sets
        4. Restart jobs run outside Tivoli Workload Scheduler for z/OS
    9. Chapter 9: Dataset triggering and the Event Trigger Tracking
      1. Dataset triggering (1/5)
      2. Dataset triggering (2/5)
      3. Dataset triggering (3/5)
      4. Dataset triggering (4/5)
      5. Dataset triggering (5/5)
        1. Special Resources
        2. Controlling jobs with Tivoli Workload Scheduler for z/OS Special Resources
        3. Special Resource Monitor
        4. Special Resource Monitor Cleanup
        5. DYNAMICADD and DYNAMICDEL
        6. RESOPTS
        7. Setting up dataset triggering
        8. GDG Dataset Triggering
      6. Event Trigger Tracking (1/2)
      7. Event Trigger Tracking (2/2)
        1. ETT: Job Trigger and Special Resource Trigger
        2. ETT demo applications
        3. Special Resource ETT
    10. Chapter 10: Tivoli Workload Scheduler for z/OS variables
      1. Variable substitution
        1. Tivoli Workload Scheduler for z/OS variables syntax
      2. Tivoli Workload Scheduler for z/OS supplied JCL variables (1/2)
      3. Tivoli Workload Scheduler for z/OS supplied JCL variables (2/2)
        1. Tivoli Workload Scheduler for z/OS JCL variable examples
      4. Tivoli Workload Scheduler for z/OS variable table (1/4)
      5. Tivoli Workload Scheduler for z/OS variable table (2/4)
      6. Tivoli Workload Scheduler for z/OS variable table (3/4)
      7. Tivoli Workload Scheduler for z/OS variable table (4/4)
        1. Setting up a table
        2. Creating a promptable variable
        3. Tivoli Workload Scheduler for z/OS maintenance jobs
      8. Tivoli Workload Scheduler for z/OS variables on the run (1/2)
      9. Tivoli Workload Scheduler for z/OS variables on the run (2/2)
        1. How to update Job Scheduling variables within the work flow
        2. Tivoli Workload Scheduler for z/OS Control Language (OCL)
        3. Tivoli Workload Scheduler for z/OS OCL examples
    11. Chapter 11: Audit Report facility
      1. What is the audit facility?
      2. Invoking the Audit Report interactively
      3. Submitting from the dialog a batch job
      4. Submitting an outside batch job (1/2)
      5. Submitting an outside batch job (2/2)
    12. Chapter 12: Using Tivoli Workload Scheduler for z/OS effectively
      1. Prioritizing the batch flows (1/3)
      2. Prioritizing the batch flows (2/3)
      3. Prioritizing the batch flows (3/3)
        1. Why do you need this?
        2. Latest start time
        3. Latest start time: calculation
        4. Latest start time: maintaining
        5. Latest start time: extra uses
        6. Earliest start time
        7. Balancing system resources
        8. Workload Manager integration
        9. Input arrival time
        10. Exploit restart capabilities
      4. Designing your batch network
      5. Moving JCL into the JS VSAM files
        1. Pre-staging JCL tests: description
        2. Pre-staging JCL tests: results tables
        3. Pre-staging JCL conclusions
      6. Recommendations
        1. Pre-stage JCL
        2. Optimize JCL fetch: LLA
        3. Optimize JCL fetch: exits
        4. Best practices for tuning and use of resources
        5. Implement EQQUX004
        6. Review your tracker and workstation setup
        7. Review initialization parameters
        8. Review your z/OS UNIX System Services and JES tuning
  5. Part 2: Tivoli Workload Scheduler for z/OS end-to-end scheduling
    1. Chapter 13: Introduction to end-to-end scheduling
      1. Introduction to end-to-end scheduling
        1. Overview of Tivoli Workload Scheduler
        2. Tivoli Workload Scheduler network
      2. The terminology used in this book
      3. Tivoli Workload Scheduler architecture (1/2)
      4. Tivoli Workload Scheduler architecture (2/2)
        1. The Tivoli Workload Scheduler network
        2. Tivoli Workload Scheduler workstation types
      5. End-to-end scheduling: how it works
      6. Comparing enterprise-wide scheduling deployment scenarios
        1. Keeping Tivoli Workload Scheduler and Tivoli Workload Scheduler for z/OS separate
        2. Managing both mainframe and distributed environments from Tivoli Workload Scheduler using the z/OS extended agent
        3. Mainframe-centric configuration (or end-to-end scheduling)
    2. Chapter 14: End-to-end scheduling architecture
      1. End-to-end scheduling architecture (1/6)
      2. End-to-end scheduling architecture (2/6)
      3. End-to-end scheduling architecture (3/6)
      4. End-to-end scheduling architecture (4/6)
      5. End-to-end scheduling architecture (5/6)
      6. End-to-end scheduling architecture (6/6)
        1. Components involved in end-to-end scheduling
        2. Tivoli Workload Scheduler for z/OS end-to-end configuration
        3. Tivoli Workload Scheduler for z/OS end-to-end plans
        4. Making the end-to-end scheduling system fault tolerant
        5. Benefits of end-to-end scheduling
      7. Job Scheduling Console and related components (1/2)
      8. Job Scheduling Console and related components (2/2)
        1. A brief introduction to the Tivoli Management Framework
        2. Job Scheduling Services (JSS)
        3. Connectors
      9. Job log retrieval in an end-to-end environment (1/2)
      10. Job log retrieval in an end-to-end environment (2/2)
        1. Job log retrieval via the Tivoli Workload Scheduler Connector
        2. Job log retrieval via the OPC Connector
        3. Job log retrieval when firewalls are involved
      11. Tivoli Workload Scheduler, important files, and directory structure
      12. conman commands in the end-to-end environment
    3. Chapter 15: TWS for z/OS end-to-end scheduling installation and customization
      1. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (1/9)
      2. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (2/9)
      3. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (3/9)
      4. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (4/9)
      5. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (5/9)
      6. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (6/9)
      7. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (7/9)
      8. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (8/9)
      9. Installing Tivoli Workload Scheduler for z/OS end-to-end scheduling (9/9)
        1. Executing EQQJOBS installation aid
        2. Defining Tivoli Workload Scheduler for z/OS subsystems
        3. Allocate end-to-end data sets
        4. Create and customize the work directory
        5. Create started task procedures
        6. Initialization statements for Tivoli Workload Scheduler for z/OS end-to-end scheduling
        7. Initialization statements used to describe the topology
        8. Example of DOMREC and CPUREC definitions
        9. The JTOPTS TWSJOBNAME() parameter
        10. Verify end-to-end installation
      10. Installing FTAs in an end-to-end environment (1/4)
      11. Installing FTAs in an end-to-end environment (2/4)
      12. Installing FTAs in an end-to-end environment (3/4)
      13. Installing FTAs in an end-to-end environment (4/4)
        1. Installation program and CDs
        2. Configuring steps for post-installation
        3. Verify the Tivoli Workload Scheduler installation
      14. Define, activate, verify fault-tolerant workstations
        1. Define fault-tolerant workstation in Tivoli Workload Scheduler controller workstation database
        2. Activate the fault-tolerant workstation definition
        3. Verify that the fault-tolerant workstations are active and linked
      15. Creating fault-tolerant workstation job definitions and job streams (1/4)
      16. Creating fault-tolerant workstation job definitions and job streams (2/4)
      17. Creating fault-tolerant workstation job definitions and job streams (3/4)
      18. Creating fault-tolerant workstation job definitions and job streams (4/4)
        1. Centralized and non-centralized scripts
        2. Definition of centralized scripts
        3. Definition of non-centralized scripts
        4. Combining centralized script and VARSUB and JOBREC
        5. Definition of FTW jobs and job streams in the controller
      19. Verification test of end-to-end scheduling (1/3)
      20. Verification test of end-to-end scheduling (2/3)
      21. Verification test of end-to-end scheduling (3/3)
        1. Verification of job with centralized script definitions
        2. Verification of job with non-centralized scripts
        3. Verification of centralized script with JOBREC parameters
      22. Tivoli Workload Scheduler for z/OS E2E poster
    4. Chapter 16: Using the Job Scheduling Console with Tivoli Workload Scheduler for z/OS
      1. Job Scheduling Console
        1. JSC components
        2. Architecture and design
      2. Activating support for the Job Scheduling Console (1/2)
      3. Activating support for the Job Scheduling Console (2/2)
        1. Install and start JSC Server
        2. Installing and configuring Tivoli Management Framework
        3. Install Job Scheduling Services
      4. Installing the connectors (1/2)
      5. Installing the connectors (2/2)
        1. Creating connector instances
        2. Creating TMF administrators for Tivoli Workload Scheduler
      6. Installing the Job Scheduling Console step by step (1/2)
      7. Installing the Job Scheduling Console step by step (2/2)
      8. ISPF and JSC side by side (1/5)
      9. ISPF and JSC side by side (2/5)
      10. ISPF and JSC side by side (3/5)
      11. ISPF and JSC side by side (4/5)
      12. ISPF and JSC side by side (5/5)
        1. Starting applications management
        2. Managing applications and operations in Tivoli Workload Scheduler for z/OS end-to-end scheduling
        3. Comparison: building applications in ISPF and JSC
        4. Editing JCL with the ISPF Panels and the JSC
        5. Viewing run cycles with the ISPF panels and JSC
    5. Chapter 17: End-to-end scheduling scenarios
      1. Description of our environment and systems (1/2)
      2. Description of our environment and systems (2/2)
      3. Creation of the Symphony file in detail
      4. Migrating Tivoli OPC tracker agents to end-to-end scheduling (1/3)
      5. Migrating Tivoli OPC tracker agents to end-to-end scheduling (2/3)
      6. Migrating Tivoli OPC tracker agents to end-to-end scheduling (3/3)
        1. Migration benefits
        2. Migration planning
        3. Migration checklist
        4. Migration actions
        5. Migrating backward
      7. Conversion from Tivoli Workload Scheduler network to Tivoli Workload Scheduler for z/OS managed network (1/3)
      8. Conversion from Tivoli Workload Scheduler network to Tivoli Workload Scheduler for z/OS managed network (2/3)
      9. Conversion from Tivoli Workload Scheduler network to Tivoli Workload Scheduler for z/OS managed network (3/3)
        1. Illustration of the conversion process
        2. Considerations before doing the conversion
        3. Conversion process from Tivoli Workload Scheduler to Tivoli Workload Scheduler for z/OS
        4. Some guidelines to automate the conversion process
      10. Tivoli Workload Scheduler for z/OS end-to-end fail-over scenarios (1/3)
      11. Tivoli Workload Scheduler for z/OS end-to-end fail-over scenarios (2/3)
      12. Tivoli Workload Scheduler for z/OS end-to-end fail-over scenarios (3/3)
        1. Configure Tivoli Workload Scheduler for z/OS backup engines
        2. Configure DVIPA for Tivoli Workload Scheduler for z/OS end-to-end server
        3. Configuring the backup domain manager for the first-level domain manager
        4. Switch to Tivoli Workload Scheduler backup domain manager
        5. Implementing Tivoli Workload Scheduler high availability on high-availability environments
      13. Backup and maintenance guidelines for FTAs
        1. Backup of the Tivoli Workload Scheduler FTAs
        2. Stdlist files on Tivoli Workload Scheduler FTAs
        3. Auditing log files on Tivoli Workload Scheduler FTAs
        4. Monitoring file systems on Tivoli Workload Scheduler FTAs
        5. Central repositories for important Tivoli Workload Scheduler files
      14. Security on fault-tolerant agents (1/2)
      15. Security on fault-tolerant agents (2/2)
        1. The security file
        2. Sample security file
      16. End-to-end scheduling tips and tricks (1/3)
      17. End-to-end scheduling tips and tricks (2/3)
      18. End-to-end scheduling tips and tricks (3/3)
        1. File dependencies in the end-to-end environment
        2. Handling offline or unlinked workstations
        3. Using dummy jobs
        4. Placing job scripts in the same directories on FTAs
        5. Common errors for jobs on fault-tolerant workstations
        6. Problems with port numbers
        7. Cannot switch to new Symphony file (EQQPT52E) messages
    6. Chapter 18: End-to-end scheduling troubleshooting
      1. End-to-end scheduling installation (1/2)
      2. End-to-end scheduling installation (2/2)
        1. EQQISMKD
        2. EQQDDDEF
        3. EQQPCS05
        4. EQQPH35E message after applying or installing maintenance
      3. Security issues with end-to-end feature (1/2)
      4. Security issues with end-to-end feature (2/2)
        1. Duplicate UID
        2. E2E Server user ID not eqqUID
        3. CP batch user ID not in eqqGID
        4. General RACF check procedure for E2E Server
        5. Security problems with BPX_DEFAULT_USER
      5. End-to-end scheduling PORTNUMBER and CPUTCPIP
        1. CPUTCPIP not same as nm port
        2. PORTNUMBER set to PORT reserved for another task
        3. PORTNUMBER set to PORT already in use
        4. TOPOLOGY and SERVOPTS PORTNUMBER set to same value
      6. End-to-end scheduling Symphony switch and distribution (daily planning jobs) (1/2)
      7. End-to-end scheduling Symphony switch and distribution (daily planning jobs) (2/2)
        1. EQQPT52E cannot switch to new Symphony file
        2. CP batch job for end-to-end scheduling is run on wrong LPAR
        3. No valid Symphony file exists
        4. DM and FTAs alternate between linked and unlinked
        5. S0C4 abend in BATCHMAN at CHECKJOB+84
        6. S0C1 abend in Daily Planning job with message EQQ2011W
        7. EQQPT60E in E2E Server MLOG after a REPLAN
        8. Symphony file not created but CP job ends with RC=04
        9. CPEXTEND gets EQQ3091E and EQQ3088E messages
        10. SEC6 abend in daily planning job
        11. CP batch job starting before file formatting has completed
      8. OMVS limit problems
        1. MAXFILEPROC value set too low
        2. MAXPROCSYS value set too low
        3. MAXUIDS value set too low
      9. Problems with jobs running on FTAs
        1. Jobs on AS/400 LFTA stuck Waiting for Submission
        2. Backslash “\\” may be treated as continuation character
        3. FTA joblogs cannot be retrieved (EQQM931W message)
        4. FTA job run under a non-existent user ID
        5. FTA job runs later than expected
        6. FTA jobs do not run (EQQE053E message in Controller MLOG)
        7. Jobs run at the wrong time
      10. OPC Connector troubleshooting
      11. SMP/E maintenance issues
        1. Message CCGLG01E issued repeatedly; WRKDIR may be full
        2. Messages beginning EQQPH* or EQQPT* missing from MLOG
        3. S0C4 in E2E Server after applying USS fix pack8
        4. Recommended method for applying maintenance
        5. Message AWSBCV001E at E2E Server shutdown
      12. Other end-to-end scheduling problems
        1. Delay in Symphony current plan (SCP) processing
        2. E2E Server started before TCP/IP initialized
        3. CPUTZ defaults to UTC due to invalid setting
        4. Domain manager file system full
        5. EQQW086E in Controller EQQMLOG
        6. S0C4 abend in E2E Server task DO_CATREAD routine
        7. Abend S106-0C, S80A, and S878-10 in E2E or JSC Server
        8. Underscore “_” in DOMREC may cause IKJ56702I error
        9. Message EQQPT60E and AWSEDW026E
        10. Controller displays residual FTA status (E2E disabled)
      13. Other useful end-to-end scheduling information (1/2)
      14. Other useful end-to-end scheduling information (2/2)
        1. End-to-end scheduling serviceability enhancements
        2. Restarting an FTW from the distributed side
        3. Adding or removing an FTW
        4. Changing the OPCMASTER that an FTW should use
        5. Reallocating the EQQTWSIN or EQQTWSOU file
        6. E2E Server SYSMDUMP with Language Environment (LE)
        7. Analyzing file contention within the E2E Server
        8. Determining the fix pack level of an FTA
      15. Where to find messages in UNIX System Services
      16. Where to find messages in an end-to-end environment
    7. Appendix A: Version 8.2 PTFs and a Version 8.3 preview
      1. Tivoli Workload Scheduler for z/OS V8.2 PTFs
      2. Preview of Tivoli Workload Scheduler for z/OS V8.3
    8. Appendix B: EQQAUDNS member example
      1. An example of member that resides in the HLQ.SKELETON DATASET
    9. Appendix C: Additional material
      1. Locating the Web material
      2. Using the Web material
        1. System requirements for downloading the Web material
        2. How to use the Web material
    10. Related publications
      1. IBM Redbooks
      2. Other publications
      3. Online resources
      4. How to get IBM Redbooks
      5. Help from IBM
    11. Index (1/4)
    12. Index (2/4)
    13. Index (3/4)
    14. Index (4/4)
    15. Back cover

Product information

  • Title: IBM Tivoli Workload Scheduler for z/OS Best Practices: End-to-end and mainframe scheduling, 2nd Edition
  • Author(s): Vasfi Gucer, Michael A Lowry, Darren Pfister, Cy Atkinson, Anna Dawson, Neil E Ogle, Stephen Viola, Sharon Wheeler
  • Release date: May 2006
  • Publisher(s): IBM Redbooks
  • ISBN: None