Reduce Storage Occupancy and Increase Operations Efficiency with IBM zEnterprise Data Compression

Reduce Storage Occupancy and Increase Operations Efficiency with IBM zEnterprise Data Compression

Released February 2015
Publisher(s): IBM Redbooks
ISBN: 9780738440453

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

IBM® zEnterprise® Data Compression (zEDC) capability and the Peripheral Component Interconnect Express (PCIe or PCI Express) hardware adapter called zEDC Express were announced in July 2013 as enhancements to the IBM z/OS® V2.1 operating system (OS) and the IBM zEnterprise EC12 (zEC12) and the IBM zEnterprise BC12 (zBC12).

zEDC is optimized for use with large sequential files, and uses an industry-standard compression library. zEDC can help to improve disk usage and optimize cross-platform exchange of data with minimal effect on processor usage.

The first candidate for such compression was the System Management Facility (SMF), and support for basic sequential access method (BSAM) and queued sequential access method (QSAM) followed in first quarter 2014. IBM software development kit (SDK) 7 for z/OS Java, IBM Encryption Facility for z/OS, IBM Sterling Connect:Direct® for z/OS and an IBM z/VM® guest can also use zEDC Express.

zEDC can also be used for Data Facility Storage Management Subsystem data set services (DFSMSdss) dumps and restores, and for DFSMS hierarchical storage manager (DFSMShsm) when using DFSMSdss for data moves.

This IBM Redbooks® publication describes how to set up the zEDC functionality to obtain the benefits of portability, reduced storage space, and reduced processor use for large operational sets of data with the most current IBM System z® environment.

Please note that the additional material referenced in the text is not available from IBM.

Table of contents

  1. Front cover
  2. Figures
  3. Tables
  4. Examples
  5. Notices
    1. Trademarks
  6. IBM Redbooks promotions
  7. Preface
    1. Authors
    2. Now you can become a published author, too
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  8. Chapter 1. zEDC overview and prerequisites
    1. 1.1 Overview of zEDC Express
      1. 1.1.1 DEFLATE format
      2. 1.1.2 Types of compression
    2. 1.2 Use cases
    3. 1.3 Configuration
      1. 1.3.1 Prerequisites
      2. 1.3.2 Coexistence
  9. Chapter 2. Installing IBM zEnterprise Data Compression Express devices
    1. 2.1 Installation planning
      1. 2.1.1 Preconditions
    2. 2.2 z/OS: Verify the prerequisites
    3. 2.3 z/OS: Enabling the Priced Software Feature
    4. 2.4 z/OS: Control the use of Peripheral Component Interconnect Express features
    5. 2.5 HCD: Defining the device
      1. 2.5.1 HCD PCIe function configuration
      2. 2.5.2 HCD PCIe function verification
    6. 2.6 HCD: Activating the new configuration
    7. 2.7 z/OS: Bringing the zEDC Express devices online to z/OS
    8. 2.8 z/OS: Managing the zEDC Express devices
  10. Chapter 3. z/OS zEnterprise Data Compression and System Management Facilities
    1. 3.1 Introduction
      1. 3.1.1 Benefits
    2. 3.2 SMF use
    3. 3.3 Setting up z/OS SMF
    4. 3.4 Dumping compressed records
    5. 3.5 Coexistence
    6. 3.6 Test case
      1. 3.6.1 Environment setup
      2. 3.6.2 SMF logstreams usage
      3. 3.6.3 Comparison about IFASMFDL
      4. 3.6.4 Comparison about IFASMFDP
    7. 3.7 zEDC and PCIe monitoring
      1. 3.7.1 Using RMF Postprocessor batch job
      2. 3.7.2 RMF Spreadsheet Reporter
      3. 3.7.3 Fields in the RMF PCIe report
  11. Chapter 4. z/OS zEnterprise Data Compression Express feature and BSAM/QSAM data sets
    1. 4.1 BSAM and QSAM
      1. 4.1.1 Basic Sequential Access Method
      2. 4.1.2 Queued Sequential Access Method
    2. 4.2 System setup and DFSMS parameters
    3. 4.3 Work with zEDC compressed files
      1. 4.3.1 BSAM files
      2. 4.3.2 QSAM files
      3. 4.3.3 Dumps
    4. 4.4 Identifying candidates
    5. 4.5 DB2 for z/OS data and zEDC
      1. 4.5.1 Virtual Storage Access Method DB2 data sets
      2. 4.5.2 Non-VSAM DB2 data sets
  12. Chapter 5. IBM System z Batch Network Analyzer Tool
    1. 5.1 Introduction to zBNA
      1. 5.1.1 How to obtain zBNA
      2. 5.1.2 Identification of zEDC Express compression candidates
    2. 5.2 Installation of the zBNA tool
      1. 5.2.1 Input data gathering
      2. 5.2.2 Analyzing the output
    3. 5.3 Example of zBNA zEDC Express analysis
  13. Chapter 6. zEDC and DFSMSdss
    1. 6.1 DFSMSdss functions that support zEDC Express
    2. 6.2 DFSMSdss tasks and parameters with zEDC Express
      1. 6.2.1 CONSOLIDATE
      2. 6.2.2 COPY
      3. 6.2.3 DEFRAG
      4. 6.2.4 DUMP and RESTORE
      5. 6.2.5 PRINT
  14. Chapter 7. zEDC and DFSMShsm when using DFSMSdss as the data mover
    1. 7.1 Introduction
      1. 7.1.1 DFSMShsm
    2. 7.2 Compression in DFSMShsm today
      1. 7.2.1 Specifying when compression with zEDC should be done
    3. 7.3 Using zEDC support in DFSMShsm
      1. 7.3.1 Overriding SETSYS for individual data sets
      2. 7.3.2 Controlling ZCOMPRESS for Volume Dumps
      3. 7.3.3 Recovering data using zEDC
      4. 7.3.4 Coexistence of z/OS V1R12 and V1R13
  15. Chapter 8. zEDC advanced topics
    1. 8.1 zEDC compression using Java
    2. 8.2 IBM Encryption Facility
    3. 8.3 WebSphere MQ for z/OS V8
    4. 8.4 IBM Sterling Connect:Direct for z/OS V5.2
    5. 8.5 z/VM and zEDC
    6. 8.6 zlib use by applications
      1. 8.6.1 zlib and z/OS
      2. 8.6.2 Running zlib
    7. 8.7 System z authorized compression services
  16. Appendix A. Additional material
    1. Locating the web material
    2. Using the web material
  17. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  18. Back cover
  19. IBM System x Reference Architecture for Hadoop: IBM InfoSphere BigInsights Reference Architecture
    1. Introduction
    2. Business problem and business value
    3. Reference architecture use
    4. Requirements
    5. InfoSphere BigInsights predefined configuration
    6. InfoSphere BigInsights HBase predefined configuration
    7. Deployment considerations
    8. Customizing the predefined configurations
    9. Predefined configuration bill of materials
    10. References
    11. The team who wrote this paper
    12. Now you can become a published author, too!
    13. Stay connected to IBM Redbooks
  20. Notices
    1. Trademarks

Product information

  • Title: Reduce Storage Occupancy and Increase Operations Efficiency with IBM zEnterprise Data Compression
  • Author(s):
  • Release date: February 2015
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738440453