IBM Spectrum Archive Enterprise Edition V1.3.0: Installation and Configuration Guide

IBM Spectrum Archive Enterprise Edition V1.3.0: Installation and Configuration Guide

by Larry Coyne, Khanh Ngo, Illarion Borisevich
Released April 2019
Publisher(s): IBM Redbooks
ISBN: 9780738457543

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM® Redbooks® publication helps you with the planning, installation, and configuration of the new IBM Spectrum™ Archive Enterprise Edition v1.3.0 for the IBM TS3310, IBM TS3500, IBM TS4300, and IBM TS4500 tape libraries. IBM Spectrum Archive™ EE enables the use of LTFS for the policy management of tape as a storage tier in an IBM Spectrum Scale™ based environment. It helps encourage the use of tape as a critical tier in the storage environment. This is the seventh edition of IBM Spectrum Archive Installation and Configuration Guide.

IBM Spectrum Archive EE can run any application that is designed for disk files on a physical tape media. IBM Spectrum Archive EE supports the IBM Linear Tape-Open (LTO) Ultrium 8, 7, 6, and 5 tape drives in IBM TS3310, TS3500, TS4300, and TS4500 tape libraries. In addition, IBM TS1160, TS1155, TS1150, and TS1140 tape drives are supported in TS3500 and TS4500 tape library configurations.

IBM Spectrum Archive EE can play a major role in reducing the cost of storage for data that does not need the access performance of primary disk. The use of IBM Spectrum Archive EE to replace disks with physical tape in tier 2 and tier 3 storage can improve data access over other storage solutions because it improves efficiency and streamlines management for files on tape. IBM Spectrum Archive EE simplifies the use of tape by making it transparent to the user and manageable by the administrator under a single infrastructure.

This publication is intended for anyone who wants to understand more about IBM Spectrum Archive EE planning and implementation. This book is suitable for IBM clients, IBM Business Partners, IBM specialist sales representatives, and technical specialists.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. April 2019, Seventh Edition Version 1.3.0
    2. June 2018, Sixth Edition Version 1.2.6
    3. January 2018, Fifth Edition Version 1.2.5.1
    4. August 2017, Fourth Edition Version 1.2.4
    5. February 2017, Third Edition Version 1.2.2 minor update
    6. January 2017, Third Edition Version 1.2.2
    7. August 2016, Second Edition Version 1.2.1
    8. June 2016, First Edition, Version 1.2
    9. January 2015, Third Edition Version 1.1.1.2
    10. November 2014, Second Edition Version 1.1.1.1
  5. Chapter 1. IBM Spectrum Archive Enterprise Edition
    1. 1.1 Introduction
      1. 1.1.1 Operational storage
      2. 1.1.2 Active archive
    2. 1.2 IBM Spectrum Archive EE functions
      1. 1.2.1 User Task Reporting
    3. 1.3 IBM Spectrum Archive EE components
      1. 1.3.1 IBM Spectrum Archive EE terms
      2. 1.3.2 Hierarchical Storage Manager
      3. 1.3.3 Multi-Tape Management Module
      4. 1.3.4 IBM Spectrum Archive Library Edition Plus component
    4. 1.4 IBM Spectrum Archive EE cluster configuration introduction
  6. Chapter 2. IBM Spectrum Archive overview
    1. 2.1 Introduction to IBM Spectrum Archive and LTFS
      1. 2.1.1 Tape media capacity with IBM Spectrum Archive
      2. 2.1.2 Comparison of the IBM Spectrum Archive products
      3. 2.1.3 IBM Spectrum Archive Single Drive Edition
      4. 2.1.4 IBM Spectrum Archive Library Edition
      5. 2.1.5 IBM Spectrum Archive Enterprise Edition
    2. 2.2 IBM Spectrum Scale
      1. 2.2.1 Overview
      2. 2.2.2 Storage pools
      3. 2.2.3 Policies and policy rules
      4. 2.2.4 Migration or premigration
      5. 2.2.5 Active File Management
    3. 2.3 OpenStack SwiftHLM
    4. 2.4 IBM Spectrum Archive EE dashboard
    5. 2.5 IBM Spectrum Archive EE REST API
    6. 2.6 Types of archiving
  7. Chapter 3. Planning
    1. 3.1 System requirements
      1. 3.1.1 Limitations
    2. 3.2 Required software
    3. 3.3 Hardware and software setup
    4. 3.4 Sizing and settings
      1. 3.4.1 IBM Spectrum Archive EE metadata file system
      2. 3.4.2 Redundant copies
      3. 3.4.3 Performance
  8. Chapter 4. Installation
    1. 4.1 Installing IBM Spectrum Archive EE on a Linux system
    2. 4.2 Installation prerequisites for IBM Spectrum Archive EE
      1. 4.2.1 Installing the host bus adapter and device driver
    3. 4.3 Installing IBM Spectrum Archive EE
      1. 4.3.1 Extracting binary rpm files from an installation package
      2. 4.3.2 Installing, upgrading, or uninstalling IBM Spectrum Archive EE
    4. 4.4 Installing a RESTful server
    5. 4.5 Quick installation guide for IBM Spectrum Archive EE
    6. 4.6 Library replacement
      1. 4.6.1 Library replacement procedure
      2. 4.6.2 Pool relocation procedure
  9. Chapter 5. Upgrading from version 1.1.x
    1. 5.1 Overview of the IBM Spectrum Archive EE upgrade from version 1.1.x
    2. 5.2 The ltfsee_config_save command
    3. 5.3 The ltfsee_config_upgrade command
    4. 5.4 Upgrading from IBM Spectrum Archive Enterprise Edition version 1.1.x
      1. 5.4.1 Prerequisite tasks for the upgrade
      2. 5.4.2 Upgrading your operating system
      3. 5.4.3 Upgrading IBM Spectrum Archive Enterprise Edition
      4. 5.4.4 Post-upgrade tasks
    5. 5.5 Upgrade processing output examples
      1. 5.5.1 Example output from ltfsee_config_save
      2. 5.5.2 Example of creating and moving the upgrade_offline.lst in the home directory to <metadata_filesystem_name>/.ltfsee/upgrade
      3. 5.5.3 Example output from ltfsee_install --upgrade
      4. 5.5.4 Example output from ltfsee_config_upgrade
  10. Chapter 6. Configuration
    1. 6.1 Configuration prerequisites
      1. 6.1.1 Configuration worksheet tables
      2. 6.1.2 Obtaining configuration information
      3. 6.1.3 Configuring key-based login with OpenSSH
      4. 6.1.4 Preparing the IBM Spectrum Scale file system for IBM Spectrum Archive EE
    2. 6.2 Configuring IBM Spectrum Archive EE
      1. 6.2.1 The ltfsee_config utility
      2. 6.2.2 Configuring a single node cluster
      3. 6.2.3 Configuring a multiple-node cluster
      4. 6.2.4 Configuring a multiple-node cluster with two tape libraries
      5. 6.2.5 Modifying a multiple-node configuration for control node redundancy
    3. 6.3 First-time start of IBM Spectrum Archive EE
      1. 6.3.1 Configuring a Centralized Archive Repository solution
      2. 6.3.2 Configuring an Asynchronous Archive Replication solution
  11. Chapter 7. Operations
    1. 7.1 Overview
      1. 7.1.1 IBM Spectrum Archive EE command summaries
      2. 7.1.2 Using the command-line interface
    2. 7.2 Status information
      1. 7.2.1 IBM Spectrum Scale
      2. 7.2.2 IBM Spectrum Archive Library Edition Plus component
      3. 7.2.3 Hierarchical Space Management
      4. 7.2.4 IBM Spectrum Archive EE
    3. 7.3 Upgrading components
      1. 7.3.1 IBM Spectrum Scale
      2. 7.3.2 IBM Spectrum Archive LE+ component
      3. 7.3.3 Hierarchical Storage Management
      4. 7.3.4 IBM Spectrum Archive EE
    4. 7.4 Starting and stopping IBM Spectrum Archive EE
      1. 7.4.1 Starting IBM Spectrum Archive EE
      2. 7.4.2 Stopping IBM Spectrum Archive EE
    5. 7.5 Task command summaries
      1. 7.5.1 eeadm task list
      2. 7.5.2 eeadm task show
    6. 7.6 IBM Spectrum Archive EE database backup
    7. 7.7 IBM Spectrum Archive EE automatic node failover
      1. 7.7.1 IBM Spectrum Archive EE monitoring daemon
    8. 7.8 Tape library management
      1. 7.8.1 Adding tape cartridges
      2. 7.8.2 Moving tape cartridges
      3. 7.8.3 Formatting tape cartridges
      4. 7.8.4 Removing tape drives
      5. 7.8.5 Adding tape drives
    9. 7.9 Tape storage pool management
      1. 7.9.1 Creating tape cartridge pools
      2. 7.9.2 Deleting tape cartridge pools
    10. 7.10 Pool capacity monitoring
    11. 7.11 Migration
      1. 7.11.1 Managing file migration pools
      2. 7.11.2 Threshold-based migration
      3. 7.11.3 Manual migration
      4. 7.11.4 Replicas and redundant copies
      5. 7.11.5 Data Migration
      6. 7.11.6 Migration hints and tips
    12. 7.12 Premigration
      1. 7.12.1 Premigration with the eeadm premigrate command
      2. 7.12.2 Premigration running the mmapplypolicy command
    13. 7.13 Preserving file system objects on tape
      1. 7.13.1 Saving file system objects with the eeadm save command
      2. 7.13.2 Saving file system objects with policies
    14. 7.14 Recall
      1. 7.14.1 Transparent recall
      2. 7.14.2 Selective recall using the eeadm recall command
      3. 7.14.3 Read Starts Recalls: Early trigger for recalling a migrated file
    15. 7.15 Recalling files to their resident state
    16. 7.16 Reconciliation
    17. 7.17 Reclamation
      1. 7.17.1 Reclamation considerations
    18. 7.18 Checking and repairing tapes
    19. 7.19 Importing and exporting
      1. 7.19.1 Importing
      2. 7.19.2 Exporting tape cartridges
      3. 7.19.3 Offlining tape cartridges
    20. 7.20 Drive Role settings for task assignment control
    21. 7.21 Tape drive intermix support
      1. 7.21.1 Objective for WORM tape support
      2. 7.21.2 Function overview for WORM tape support
      3. 7.21.3 The effects of file operations on immutable and appendOnly files
    22. 7.22 Obtaining the location of files and data
    23. 7.23 Obtaining system resources, and tasks information
    24. 7.24 Monitoring the system with SNMP
    25. 7.25 Configuring Net-SNMP
      1. 7.25.1 Starting and stopping the snmpd daemon
      2. 7.25.2 Example of an SNMP trap
    26. 7.26 IBM Spectrum Archive REST API
      1. 7.26.1 Pools endpoint
      2. 7.26.2 Tapes endpoint
      3. 7.26.3 Libraries endpoint
      4. 7.26.4 Nodegroups endpoint
      5. 7.26.5 Nodes endpoint
      6. 7.26.6 Drives endpoint
      7. 7.26.7 Task endpoint
  12. Chapter 8. Hints, tips, and preferred practices
    1. 8.1 Preventing migration of the .SPACEMAN and metadata directories
    2. 8.2 Maximizing migration performance with redundant copies
    3. 8.3 Changing the SSH daemon settings
    4. 8.4 Setting mmapplypolicy options for increased performance
    5. 8.5 Setting the inode size for the GPFS file system for increased performance
    6. 8.6 Determining the file states for all files within the GPFS file system
    7. 8.7 Memory considerations on the GPFS file system for increased performance
    8. 8.8 Increasing the default maximum number of inodes in IBM Spectrum Scale
    9. 8.9 Configuring IBM Spectrum Scale settings for performance improvement
    10. 8.10 Real world use cases for mmapplypolicy
      1. 8.10.1 Creating a traditional archive system policy
      2. 8.10.2 Creating active archive system policies
      3. 8.10.3 IBM Spectrum Archive EE migration policy with AFM
    11. 8.11 Capturing a core file on RHEL with abrtd
    12. 8.12 Antivirus considerations
    13. 8.13 Automatic email notification with rsyslog
    14. 8.14 Overlapping IBM Spectrum Scale policy rules
    15. 8.15 Storage pool assignment
    16. 8.16 Tape cartridge removal
      1. 8.16.1 Reclaiming tape cartridges before you remove or export them
      2. 8.16.2 Exporting tape cartridges before physically removing them from the library
    17. 8.17 Reusing LTFS formatted tape cartridges
      1. 8.17.1 Reformatting LTFS tape cartridges through eeadm commands
    18. 8.18 Reusing non-LTFS tape cartridges
    19. 8.19 Moving tape cartridges between pools
      1. 8.19.1 Avoiding changing assignments for tape cartridges that contain files
      2. 8.19.2 Reclaiming a tape cartridge and changing its assignment
    20. 8.20 Offline tape cartridges
      1. 8.20.1 Do not modify the files of offline tape cartridges
      2. 8.20.2 Solving problems
    21. 8.21 Scheduling reconciliation and reclamation
    22. 8.22 License Expiration Handling
    23. 8.23 Disaster recovery
      1. 8.23.1 Tiers of disaster recovery
      2. 8.23.2 Preparing IBM Spectrum Archive EE for a tier 1 disaster recovery strategy (offsite vaulting)
      3. 8.23.3 IBM Spectrum Archive EE tier 1 DR procedure
    24. 8.24 IBM Spectrum Archive EE problem determination
    25. 8.25 Collecting IBM Spectrum Archive EE logs for support
    26. 8.26 Backing up files within file systems that are managed by IBM Spectrum Archive EE
      1. 8.26.1 Considerations
      2. 8.26.2 Backing up a GPFS or IBM Spectrum Scale environment
      3. 8.26.3 IBM TS4500 Automated Media Verification with IBM Spectrum Archive EE
  13. Chapter 9. Use cases
    1. 9.1 Use cases overview
      1. 9.1.1 Use case for archive
      2. 9.1.2 Use case for tiered and scalable storage
      3. 9.1.3 Use case data exchange
    2. 9.2 Oil and Gas
    3. 9.3 Media and Entertainment
    4. 9.4 Healthcare and Genomics
    5. 9.5 Archive of Research/Scientific Data for Long Periods of Time
    6. 9.6 University Scientific Data Archive
    7. 9.7 AFM use cases
      1. 9.7.1 Centralized Archive Repository
      2. 9.7.2 Asynchronous Archive Replication
  14. Chapter 10. Troubleshooting
    1. 10.1 Overview
      1. 10.1.1 Quick health check
      2. 10.1.2 Common startup errors
    2. 10.2 Hardware
      1. 10.2.1 Tape library
      2. 10.2.2 Tape drives
      3. 10.2.3 Tape cartridge
    3. 10.3 Recovering data from a write failure tape
    4. 10.4 Recovering data from a read failure tape
    5. 10.5 Software
      1. 10.5.1 Linux
      2. 10.5.2 IBM Spectrum Scale
      3. 10.5.3 IBM Spectrum Archive LE+ component
      4. 10.5.4 Hierarchical storage management
      5. 10.5.5 IBM Spectrum Archive EE logs
    6. 10.6 Recovering from system failures
      1. 10.6.1 Power failure
      2. 10.6.2 Mechanical failure
      3. 10.6.3 Inventory failure
      4. 10.6.4 Abnormal termination
  15. Chapter 11. Reference
    1. 11.1 Command-line reference
      1. 11.1.1 IBM Spectrum Archive EE commands
      2. 11.1.2 IBM Spectrum Scale commands
      3. 11.1.3 Tivoli Storage Manager for Space Management commands
    2. 11.2 Formats for IBM Spectrum Scale to IBM Spectrum Archive EE migration
    3. 11.3 System calls and IBM tools
      1. 11.3.1 Downloading the IBM Tape Diagnostic Tool
      2. 11.3.2 Using the IBM LTFS Format Verifier
    4. 11.4 IBM Spectrum Archive EE interoperability with IBM Spectrum Archive products
  16. Appendix A. Additional material
    1. Locating the web material
    2. Using the web material
  17. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  18. Back cover

Product information

  • Title: IBM Spectrum Archive Enterprise Edition V1.3.0: Installation and Configuration Guide
  • Author(s): Larry Coyne, Khanh Ngo, Illarion Borisevich
  • Release date: April 2019
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738457543