IBM Spectrum Archive Enterprise Edition V1.2.5.1 Installation and Configuration Guide

IBM Spectrum Archive Enterprise Edition V1.2.5.1 Installation and Configuration Guide

by Larry Coyne, Khanh Ngo, Illarion Borisevich
Released January 2018
Publisher(s): IBM Redbooks
ISBN: 9780783442846

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Abstract

This IBM® Redbooks® publication helps you with the planning, installation, and configuration of the new IBM Spectrum™ Archive V1.2.5.1 for the IBM TS3310, IBM TS3500, IBM TS4300, and IBM TS4500 tape libraries. IBM Spectrum Archive™ EE enables the use of the LTFS for the policy management of tape as a storage tier in an IBM Spectrum Scale™ based environment. It helps encourage the use of tape as a critical tier in the storage environment. This is the fifth edition of IBM Spectrum Archive Installation and Configuration Guide.

IBM Spectrum Archive EE can run any application that is designed for disk files on a physical tape media. IBM Spectrum Archive EE supports the IBM Linear Tape-Open (LTO) Ultrium 8, 7, 6, and 5 tape drives in IBM TS3310, TS3500, TS4300, and TS4500 tape libraries. In addition, IBM TS1155, TS1150, and TS1140 tape drives are supported in TS3500 and TS4500 tape library configurations.

IBM Spectrum Archive EE can play a major role in reducing the cost of storage for data that does not need the access performance of primary disk. The use of IBM Spectrum Archive EE to replace disks with physical tape in tier 2 and tier 3 storage can improve data access over other storage solutions because it improves efficiency and streamlines management for files on tape. IBM Spectrum Archive EE simplifies the use of tape by making it transparent to the user and manageable by the administrator under a single infrastructure.

This publication is intended for anyone who wants to understand more about IBM Spectrum Archive EE planning and implementation. This book is suitable for IBM clients, IBM Business Partners, IBM specialist sales representatives, and technical specialists.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. January 2018, Fifth Edition Version 1.2.5.1
    2. August 2017, Fourth Edition Version 1.2.4
    3. February 2017, Third Edition Version 1.2.2 minor update
    4. January 2017, Third Edition Version 1.2.2
    5. August 2016, Second Edition Version 1.2.1
    6. June 2016, First Edition, Version 1.2
    7. January 2015, Third Edition Version 1.1.1.2
    8. November 2014, Second Edition Version 1.1.1.1
  5. Chapter 1. IBM Spectrum Archive Enterprise Edition
    1. 1.1 Introduction
      1. 1.1.1 Operational storage
      2. 1.1.2 Active archive
    2. 1.2 IBM Spectrum Archive EE functions
    3. 1.3 IBM Spectrum Archive EE components
      1. 1.3.1 IBM Spectrum Archive EE terms
      2. 1.3.2 Hierarchical Storage Manager
      3. 1.3.3 Multi-Tape Management Module
      4. 1.3.4 IBM Spectrum Archive Library Edition Plus component
    4. 1.4 IBM Spectrum Archive EE cluster configuration introduction
  6. Chapter 2. IBM Spectrum Archive overview
    1. 2.1 Introduction to IBM Spectrum Archive and LTFS
      1. 2.1.1 Tape media capacity with IBM Spectrum Archive
    2. 2.2 Comparison of the IBM Spectrum Archive products
      1. 2.2.1 IBM Spectrum Archive Single Drive Edition
      2. 2.2.2 IBM Spectrum Archive Library Edition
      3. 2.2.3 IBM Spectrum Archive Enterprise Edition
    3. 2.3 IBM Spectrum Scale
      1. 2.3.1 Overview
      2. 2.3.2 Storage pools
      3. 2.3.3 Policies and policy rules
      4. 2.3.4 Migration or premigration
      5. 2.3.5 Active File Management
    4. 2.4 OpenStack SwiftHLM
    5. 2.5 IBM Spectrum Archive EE dashboard
    6. 2.6 IBM Spectrum Archive EE REST API
    7. 2.7 Types of archiving
  7. Chapter 3. Planning
    1. 3.1 System requirements
    2. 3.2 Required software
    3. 3.3 Hardware and software setup
    4. 3.4 Sizing and settings
      1. 3.4.1 IBM Spectrum Scale block size
      2. 3.4.2 IBM Spectrum Archive EE metadata file system
      3. 3.4.3 Redundant copies
      4. 3.4.4 Performance
  8. Chapter 4. Installation
    1. 4.1 Installing IBM Spectrum Archive EE on a Linux system
    2. 4.2 Installation prerequisites for IBM Spectrum Archive EE
      1. 4.2.1 Installing the host bus adapter and device driver
      2. 4.2.2 Installing the IBM tape device driver
    3. 4.3 Installing IBM Spectrum Archive EE
      1. 4.3.1 Extracting binary rpm files from an installation package
      2. 4.3.2 Installing, upgrading, or uninstalling IBM Spectrum Archive EE
    4. 4.4 Installing a RESTful server
    5. 4.5 Quick installation guide for IBM Spectrum Archive EE
    6. 4.6 Library replacement procedure
  9. Chapter 5. Upgrading from version 1.1.x
    1. 5.1 Overview of the IBM Spectrum Archive EE upgrade from version 1.1.x
    2. 5.2 The ltfsee_config_save command
    3. 5.3 The ltfsee_config_upgrade command
    4. 5.4 Upgrading from IBM Spectrum Archive Enterprise Edition version 1.1.x
      1. 5.4.1 Prerequisite tasks for the upgrade
      2. 5.4.2 Upgrading your operating system
      3. 5.4.3 Upgrading IBM Spectrum Archive Enterprise Edition
      4. 5.4.4 Post-upgrade tasks
    5. 5.5 Upgrade processing output examples
      1. 5.5.1 Example output from ltfsee_config_save
      2. 5.5.2 Example of creating and moving the upgrade_offline.lst in the home directory to <metadata_filesystem_name>/.ltfsee/upgrade
      3. 5.5.3 Example output from ltfsee_install --upgrade
      4. 5.5.4 Example output from ltfsee_config_upgrade
  10. Chapter 6. Configuration
    1. 6.1 Configuration prerequisites
      1. 6.1.1 Configuration worksheet tables
      2. 6.1.2 Obtaining configuration information
      3. 6.1.3 Configuring key-based login with OpenSSH
      4. 6.1.4 Preparing the IBM Spectrum Scale file system for IBM Spectrum Archive EE
      5. 6.1.5 Enabling control paths in the logical library
    2. 6.2 Configuring IBM Spectrum Archive EE
      1. 6.2.1 The ltfsee_config utility
      2. 6.2.2 Configuring a single node cluster
      3. 6.2.3 Configuring a multiple-node cluster
      4. 6.2.4 Configuring a multiple-node cluster with two tape libraries
      5. 6.2.5 Modifying a multiple-node configuration for control node redundancy
    3. 6.3 First-time start of IBM Spectrum Archive EE
    4. 6.4 Configuring IBM Spectrum Archive EE with IBM Spectrum Scale AFM
      1. 6.4.1 Configuring a Centralized Archive Repository solution
      2. 6.4.2 Configuring an Asynchronous Archive Replication solution
  11. Chapter 7. Operations
    1. 7.1 Overview
      1. 7.1.1 IBM Spectrum Archive EE command summaries
      2. 7.1.2 Using the command-line interface
    2. 7.2 Status information
      1. 7.2.1 IBM Spectrum Scale
      2. 7.2.2 IBM Spectrum Archive Library Edition Plus component
      3. 7.2.3 Hierarchical Space Management
      4. 7.2.4 IBM Spectrum Archive EE
    3. 7.3 Upgrading components
      1. 7.3.1 IBM Spectrum Scale
      2. 7.3.2 IBM Spectrum Archive LE+ component
      3. 7.3.3 Hierarchical Storage Management
      4. 7.3.4 IBM Spectrum Archive EE
    4. 7.4 Starting and stopping IBM Spectrum Archive EE
      1. 7.4.1 Starting IBM Spectrum Archive EE
      2. 7.4.2 Stopping IBM Spectrum Archive EE
    5. 7.5 IBM Spectrum Archive EE database backup
    6. 7.6 IBM Spectrum Archive EE automatic node failover
      1. 7.6.1 IBM Spectrum Archive EE monitoring daemon
    7. 7.7 Tape library management
      1. 7.7.1 Adding tape cartridges
      2. 7.7.2 Moving tape cartridges
      3. 7.7.3 Formatting tape cartridges
      4. 7.7.4 Removing tape drives
      5. 7.7.5 Adding tape drives
    8. 7.8 Tape storage pool management
      1. 7.8.1 Creating tape cartridge pools
      2. 7.8.2 Deleting tape cartridge pools
    9. 7.9 Pool capacity monitoring
    10. 7.10 Migration
      1. 7.10.1 Managing file migration pools
      2. 7.10.2 Threshold-based migration
      3. 7.10.3 Manual migration
      4. 7.10.4 Replicas and redundant copies
      5. 7.10.5 Migration hints and tips
    11. 7.11 Premigration
      1. 7.11.1 Premigration with the ltfsee premigrate command
      2. 7.11.2 Premigration running the mmapplypolicy command
    12. 7.12 Preserving file system objects on tape
      1. 7.12.1 Saving file system objects with the ltfsee save command
      2. 7.12.2 Saving file system objects with policies
    13. 7.13 Restoring non-empty regular files and file system objects from tape
    14. 7.14 Recall
      1. 7.14.1 Transparent recall
      2. 7.14.2 Selective recall
      3. 7.14.3 Recalling files with the ltfsee recall command
      4. 7.14.4 Read Starts Recalls: Early trigger for recalling a migrated file
    15. 7.15 Repairing files to their resident state
    16. 7.16 Handling of write-failure tapes
    17. 7.17 Handling of read-failure tapes
    18. 7.18 Reconciliation
    19. 7.19 Reclamation
      1. 7.19.1 Reclamation considerations
      2. 7.19.2 Reclamation performance
    20. 7.20 Checking and repairing
    21. 7.21 Importing and exporting
      1. 7.21.1 Importing
      2. 7.21.2 Exporting
      3. 7.21.3 Import/Export enhancements
    22. 7.22 Drive Role settings for job assignment control
    23. 7.23 Tape drive intermix support
    24. 7.24 WORM support for the IBM TS1155, TS1150, and TS1140 tape drives
      1. 7.24.1 Objective for WORM tape support
      2. 7.24.2 Function overview for WORM tape support
      3. 7.24.3 The effects of file operations on immutable and appendOnly files
    25. 7.25 Obtaining the location of files and data
    26. 7.26 Obtaining inventory, job, and scan status
    27. 7.27 Cleaning up a scan or session
    28. 7.28 Monitoring the system with SNMP
    29. 7.29 Configuring Net-SNMP
      1. 7.29.1 Starting and stopping the snmpd daemon
      2. 7.29.2 Example of an SNMP trap
    30. 7.30 IBM Spectrum Archive REST API
      1. 7.30.1 Pools endpoint
      2. 7.30.2 Tapes endpoint
      3. 7.30.3 Libraries endpoint
      4. 7.30.4 Nodegroups endpoint
      5. 7.30.5 Nodes endpoint
      6. 7.30.6 Drives endpoint
  12. Chapter 8. Hints, tips, and preferred practices
    1. 8.1 Preventing migration of the .SPACEMAN and metadata directories
    2. 8.2 Maximizing migration performance with redundant copies
    3. 8.3 Changing the SSH daemon settings
    4. 8.4 Setting mmapplypolicy options for increased performance
    5. 8.5 Setting the inode size for the GPFS file system for increased performance
    6. 8.6 Determining the file states for all files within the GPFS file system
    7. 8.7 Memory considerations on the GPFS file system for increased performance
    8. 8.8 Increasing the default maximum number of inodes in IBM Spectrum Scale
    9. 8.9 Configuring IBM Spectrum Scale settings for performance improvement
    10. 8.10 Real world use cases for mmapplypolicy
      1. 8.10.1 Creating a traditional archive system policy
      2. 8.10.2 Creating active archive system policies
      3. 8.10.3 IBM Spectrum Archive EE migration policy with AFM
    11. 8.11 Capturing a core file on RHEL with abrtd
    12. 8.12 Antivirus considerations
    13. 8.13 Automatic email notification with rsyslog
    14. 8.14 Overlapping IBM Spectrum Scale policy rules
    15. 8.15 Storage pool assignment
    16. 8.16 Tape cartridge removal
      1. 8.16.1 Reclaiming tape cartridges before you remove or export them
      2. 8.16.2 Exporting tape cartridges before physically removing them from the library
    17. 8.17 Reusing LTFS formatted tape cartridges
      1. 8.17.1 Reformatting LTFS tape cartridges through ltfsee commands
    18. 8.18 Reusing non-LTFS tape cartridges
    19. 8.19 Moving tape cartridges between pools
      1. 8.19.1 Avoiding changing assignments for tape cartridges that contain files
      2. 8.19.2 Reclaiming a tape cartridge and changing its assignment
    20. 8.20 Offline tape cartridges
      1. 8.20.1 Do not modify the files of offline tape cartridges
      2. 8.20.2 Solving problems
    21. 8.21 Scheduling reconciliation and reclamation
    22. 8.22 License Expiration Handling
    23. 8.23 Disaster recovery
      1. 8.23.1 Tiers of disaster recovery
      2. 8.23.2 Preparing IBM Spectrum Archive EE for a tier 1 disaster recovery strategy (offsite vaulting)
      3. 8.23.3 IBM Spectrum Archive EE tier 1 DR procedure
    24. 8.24 IBM Spectrum Archive EE problem determination
    25. 8.25 Collecting IBM Spectrum Archive EE logs for support
    26. 8.26 Backing up file systems that are not managed by IBM Spectrum Archive EE
      1. 8.26.1 Considerations
      2. 8.26.2 Backing up a GPFS or IBM Spectrum Scale environment
      3. 8.26.3 Backing up non-IBM Spectrum Scale file systems
      4. 8.26.4 IBM TS4500 Automated Media Verification with IBM Spectrum Archive EE
  13. Chapter 9. Use cases
    1. 9.1 Use cases overview
      1. 9.1.1 Use case for archiving
      2. 9.1.2 Use case for backup
      3. 9.1.3 Use case for tiered and scalable storage
      4. 9.1.4 Use case data exchange
    2. 9.2 University of Basel and Swiss Institute of Bioinformatics (SIB)
      1. 9.2.1 Business needs
    3. 9.3 AFM use cases
      1. 9.3.1 Centralized Archive Repository
      2. 9.3.2 Asynchronous Archive Replication
  14. Chapter 10. Troubleshooting
    1. 10.1 Overview
      1. 10.1.1 Quick health check
    2. 10.2 Hardware
      1. 10.2.1 Tape library
      2. 10.2.2 Tape drives
      3. 10.2.3 Tape cartridge
    3. 10.3 Recovering data from a write failure tape
    4. 10.4 Recovering data from a read failure tape
    5. 10.5 Handling export errors
    6. 10.6 Software
      1. 10.6.1 Linux
      2. 10.6.2 IBM Spectrum Scale
      3. 10.6.3 IBM Spectrum Archive LE+ component
      4. 10.6.4 Hierarchical storage management
      5. 10.6.5 IBM Spectrum Archive EE logs
    7. 10.7 Recovering from system failures
      1. 10.7.1 Power failure
      2. 10.7.2 Mechanical failure
      3. 10.7.3 Inventory failure
      4. 10.7.4 Abnormal termination
  15. Chapter 11. Reference
    1. 11.1 Command-line reference
      1. 11.1.1 IBM Spectrum Archive EE commands
      2. 11.1.2 IBM Spectrum Scale commands
      3. 11.1.3 Tivoli Storage Manager for Space Management commands
    2. 11.2 Formats for IBM Spectrum Scale to IBM Spectrum Archive EE migration
    3. 11.3 System calls and IBM tools
      1. 11.3.1 Downloading the IBM Tape Diagnostic Tool
      2. 11.3.2 Using the IBM LTFS Format Verifier
    4. 11.4 IBM Spectrum Archive EE interoperability with IBM Spectrum Archive products
  16. Appendix A. Additional material
    1. Locating the web material
    2. Using the web material
  17. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  18. Back cover

Product information

  • Title: IBM Spectrum Archive Enterprise Edition V1.2.5.1 Installation and Configuration Guide
  • Author(s): Larry Coyne, Khanh Ngo, Illarion Borisevich
  • Release date: January 2018
  • Publisher(s): IBM Redbooks
  • ISBN: 9780783442846