IBM Spectrum Archive Enterprise Edition V1.3.2.2: Installation and Configuration Guide

IBM Spectrum Archive Enterprise Edition V1.3.2.2: Installation and Configuration Guide

by Hiroyuki Miyoshi, Yuka Sasaki, Arnold Byron Lua, Yasuhiro Yoshihara, Khanh Ngo, Larry Coyne
Released March 2022
Publisher(s): IBM Redbooks
ISBN: 9780738460420

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM® Redbooks® publication helps you with the planning, installation, and configuration of the new IBM Spectrum® Archive Enterprise Edition (EE) Version 1.3.2.2 for the IBM TS4500, IBM TS3500, IBM TS4300, and IBM TS3310 tape libraries.

IBM Spectrum Archive Enterprise Edition enables the use of the LTFS for the policy management of tape as a storage tier in an IBM Spectrum Scale based environment. It also helps encourage the use of tape as a critical tier in the storage environment.

This edition of this publication is the tenth edition of IBM Spectrum Archive Installation and Configuration Guide.

IBM Spectrum Archive EE can run any application that is designed for disk files on a physical tape media. IBM Spectrum Archive EE supports the IBM Linear Tape-Open (LTO) Ultrium 9, 8, 7, 6, and 5 tape drives. and the IBM TS1160, TS1155, TS1150, and TS1140 tape drives.

IBM Spectrum Archive EE can play a major role in reducing the cost of storage for data that does not need the access performance of primary disk. The use of IBM Spectrum Archive EE to replace disks with physical tape in tier 2 and tier 3 storage can improve data access over other storage solutions because it improves efficiency and streamlines management for files on tape. IBM Spectrum Archive EE simplifies the use of tape by making it transparent to the user and manageable by the administrator under a single infrastructure.

This publication is intended for anyone who wants to understand more about IBM Spectrum Archive EE planning and implementation. This book is suitable for IBM customers, IBM Business Partners, IBM specialist sales representatives, and technical specialists.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. December 2021, Tenth Edition Version 1.3.2.2
    2. June 2021, Ninth Edition Version 1.3.1.2
    3. February 2020, Eighth Edition Version 1.3.0.6
    4. April 2019, Seventh Edition Version 1.3.0
    5. June 2018, Sixth Edition Version 1.2.6
    6. January 2018, Fifth Edition Version 1.2.5.1
    7. August 2017, Fourth Edition Version 1.2.4
    8. February 2017, Third Edition Version 1.2.2 minor update
    9. January 2017, Third Edition Version 1.2.2
    10. August 2016, Second Edition Version 1.2.1
    11. June 2016, First Edition, Version 1.2
    12. January 2015, Third Edition Version 1.1.1.2
    13. November 2014, Second Edition Version 1.1.1.1
  5. Chapter 1. IBM Spectrum Archive Enterprise Edition
    1. 1.1 Introduction
      1. 1.1.1 Operational storage
      2. 1.1.2 Active archive
    2. 1.2 IBM Spectrum Archive EE functions
      1. 1.2.1 User Task Reporting
    3. 1.3 IBM Spectrum Archive EE components
      1. 1.3.1 IBM Spectrum Archive EE terms
      2. 1.3.2 Hierarchical Storage Manager
      3. 1.3.3 Multi-Tape Management Module
      4. 1.3.4 IBM Spectrum Archive Library Edition component
    4. 1.4 IBM Spectrum Archive EE cluster configuration introduction
  6. Chapter 2. IBM Spectrum Archive overview
    1. 2.1 Introduction to IBM Spectrum Archive and LTFS
      1. 2.1.1 Tape media capacity with IBM Spectrum Archive
      2. 2.1.2 Comparison of the IBM Spectrum Archive products
      3. 2.1.3 IBM Spectrum Archive Single Drive Edition
      4. 2.1.4 IBM Spectrum Archive Library Edition
      5. 2.1.5 IBM Spectrum Archive Enterprise Edition
    2. 2.2 IBM Spectrum Scale
      1. 2.2.1 Overview
      2. 2.2.2 Storage pools
      3. 2.2.3 Policies and policy rules
      4. 2.2.4 Migration or premigration
      5. 2.2.5 Active File Management
      6. 2.2.6 Scale Out Backup and Restore
    3. 2.3 OpenStack SwiftHLM
    4. 2.4 IBM Spectrum Archive EE dashboard
    5. 2.5 IBM Spectrum Archive EE REST API
    6. 2.6 Types of archiving
  7. Chapter 3. Planning for IBM Spectrum Archive Enterprise Edition
    1. 3.1 IBM Spectrum Archive EE deployment options
      1. 3.1.1 On IBM Spectrum Scale Servers
      2. 3.1.2 As an IBM Spectrum Scale Client
      3. 3.1.3 As an IBM Elastic Storage Systems IBM Spectrum Scale Client
      4. 3.1.4 As an IBM Spectrum Scale stretched cluster
    2. 3.2 Data-access methods
      1. 3.2.1 Data access using application or users on IBM Spectrum Scale Clients
      2. 3.2.2 Data access using Protocol Nodes on IBM Spectrum Scale Server Nodes with IBM Spectrum Archive EE
      3. 3.2.3 Data access using Protocol Nodes integrated with the IBM ESS
    3. 3.3 System requirements
      1. 3.3.1 Limitations
    4. 3.4 Required software for Linux systems
      1. 3.4.1 Required software packages for Red Hat Enterprise Linux systems
      2. 3.4.2 Required software to support REST API service on RHEL systems
      3. 3.4.3 Required software to support a dashboard for IBM Spectrum Archive Enterprise Edition
      4. 3.4.4 Required software for SwiftHLM
    5. 3.5 Hardware and software setup
    6. 3.6 IBM Spectrum Archive deployment examples
      1. 3.6.1 Deploying on Lenovo servers
      2. 3.6.2 Deploying on Versastack converged infrastructure
    7. 3.7 Sizing and settings
      1. 3.7.1 Redundant copies
      2. 3.7.2 Planning for LTO-9 Media Initialization/Optimization
      3. 3.7.3 IBM Spectrum Archive EE Sizing Tool
      4. 3.7.4 Performance
      5. 3.7.5 Ports that are used by IBM Spectrum Archive EE
    8. 3.8 High-level component upgrade steps
  8. Chapter 4. Installing IBM Spectrum Archive Enterprise Edition
    1. 4.1 Installing IBM Spectrum Archive EE on a Linux system
    2. 4.2 Installation prerequisites for IBM Spectrum Archive EE
      1. 4.2.1 Installing the host bus adapter and device driver
    3. 4.3 Installing IBM Spectrum Archive EE
      1. 4.3.1 Extracting binary rpm files from an installation package
      2. 4.3.2 Installing, upgrading, or uninstalling IBM Spectrum Archive EE
    4. 4.4 Installing a RESTful server
    5. 4.5 Quick installation guide for IBM Spectrum Archive EE
    6. 4.6 Library replacement
      1. 4.6.1 Library replacement procedure
      2. 4.6.2 Pool relocation procedure
    7. 4.7 Tips when upgrading host operating system
  9. Chapter 5. Configuring IBM Spectrum Archive Enterprise Edition
    1. 5.1 Configuration prerequisites
      1. 5.1.1 Configuration worksheet tables
      2. 5.1.2 Obtaining configuration information
      3. 5.1.3 Configuring key-based login with OpenSSH
      4. 5.1.4 Preparing the IBM Spectrum Scale file system for IBM Spectrum Archive EE
    2. 5.2 Configuring IBM Spectrum Archive EE
      1. 5.2.1 The ltfsee_config utility
      2. 5.2.2 Configuring a single node cluster
      3. 5.2.3 Configuring a multiple-node cluster
      4. 5.2.4 Configuring a multiple-node cluster with two tape libraries
      5. 5.2.5 Modifying a multiple-node configuration for control node redundancy
    3. 5.3 First-time start of IBM Spectrum Archive EE
      1. 5.3.1 Configuring IBM Spectrum Archive EE with IBM Spectrum Scale AFM
      2. 5.3.2 Configuring a Centralized Archive Repository solution
      3. 5.3.3 Configuring an Asynchronous Archive Replication solution
  10. Chapter 6. Managing daily operations of IBM Spectrum Archive Enterprise Edition
    1. 6.1 Overview
      1. 6.1.1 IBM Spectrum Archive EE command summaries
      2. 6.1.2 Using the command-line interface
    2. 6.2 Status information
      1. 6.2.1 IBM Spectrum Scale
      2. 6.2.2 IBM Spectrum Archive Library Edition component
      3. 6.2.3 Hierarchical Space Management
      4. 6.2.4 IBM Spectrum Archive EE
    3. 6.3 Upgrading components
      1. 6.3.1 IBM Spectrum Scale
      2. 6.3.2 IBM Spectrum Archive LE component
      3. 6.3.3 Hierarchical Storage Management
      4. 6.3.4 IBM Spectrum Archive EE
    4. 6.4 Starting and stopping IBM Spectrum Archive EE
      1. 6.4.1 Starting IBM Spectrum Archive EE
      2. 6.4.2 Stopping IBM Spectrum Archive EE
    5. 6.5 Task command summaries
      1. 6.5.1 eeadm task list
      2. 6.5.2 eeadm task show
    6. 6.6 IBM Spectrum Archive EE database backup
    7. 6.7 IBM Spectrum Archive EE automatic node failover
      1. 6.7.1 IBM Spectrum Archive EE monitoring daemon
    8. 6.8 Tape library management
      1. 6.8.1 Adding tape cartridges
      2. 6.8.2 Moving tape cartridges
      3. 6.8.3 Formatting tape cartridges
      4. 6.8.4 Removing tape drives
      5. 6.8.5 Adding tape drives
    9. 6.9 Tape storage pool management
      1. 6.9.1 Creating tape cartridge pools
      2. 6.9.2 Deleting tape cartridge pools
    10. 6.10 Pool capacity monitoring
    11. 6.11 Migration
      1. 6.11.1 Managing file migration pools
      2. 6.11.2 Threshold-based migration
      3. 6.11.3 Manual migration
      4. 6.11.4 Replicas and redundant copies
      5. 6.11.5 Data Migration
      6. 6.11.6 Migration hints and tips
    12. 6.12 Premigration
      1. 6.12.1 Premigration with the eeadm premigrate command
      2. 6.12.2 Premigration running the mmapplypolicy command
    13. 6.13 Preserving file system objects on tape
      1. 6.13.1 Saving file system objects with the eeadm save command
      2. 6.13.2 Saving file system objects with policies
    14. 6.14 Recall
      1. 6.14.1 Transparent recall
      2. 6.14.2 Selective recall using the eeadm recall command
      3. 6.14.3 Read Starts Recalls: Early trigger for recalling a migrated file
      4. 6.14.4 Recommend Access Order
    15. 6.15 Recalling files to their resident state
    16. 6.16 Reconciliation
    17. 6.17 Reclamation
      1. 6.17.1 Reclamation considerations
    18. 6.18 Checking and repairing tapes
    19. 6.19 Importing and exporting
      1. 6.19.1 Importing
      2. 6.19.2 Exporting tape cartridges
      3. 6.19.3 Offlining tape cartridges
    20. 6.20 Drive Role settings for task assignment control
    21. 6.21 Tape drive intermix support
      1. 6.21.1 Objective for WORM tape support
      2. 6.21.2 Function overview for WORM tape support
      3. 6.21.3 The effects of file operations on immutable and appendOnly files
    22. 6.22 Obtaining the location of files and data
    23. 6.23 Obtaining system resources, and tasks information
    24. 6.24 Monitoring the system with SNMP
    25. 6.25 Configuring Net-SNMP
      1. 6.25.1 Starting and stopping the snmpd daemon
      2. 6.25.2 Example of an SNMP trap
    26. 6.26 IBM Spectrum Archive REST API
      1. 6.26.1 Pools endpoint
      2. 6.26.2 Tapes endpoint
      3. 6.26.3 Libraries endpoint
      4. 6.26.4 Nodegroups endpoint
      5. 6.26.5 Nodes endpoint
      6. 6.26.6 Drives endpoint
      7. 6.26.7 Task endpoint
    27. 6.27 File system migration
  11. Chapter 7. Hints, tips, and preferred practices
    1. 7.1 Preventing migration of the .SPACEMAN and metadata directories
    2. 7.2 Maximizing migration performance with redundant copies
    3. 7.3 Changing the SSH daemon settings
    4. 7.4 Setting mmapplypolicy options for increased performance
    5. 7.5 Preferred inode size for IBM Spectrum Scale file systems
    6. 7.6 Determining the file states for all files within the GPFS file system
    7. 7.7 Memory considerations on the GPFS file system for increased performance
    8. 7.8 Increasing the default maximum number of inodes in IBM Spectrum Scale
    9. 7.9 Configuring IBM Spectrum Scale settings for performance improvement
    10. 7.10 Use cases for mmapplypolicy
      1. 7.10.1 Creating a traditional archive system policy
      2. 7.10.2 Creating active archive system policies
      3. 7.10.3 IBM Spectrum Archive EE migration policy with AFM
    11. 7.11 Capturing a core file on Red Hat Enterprise Linux with the Automatic Bug Reporting Tool
    12. 7.12 Anti-virus considerations
    13. 7.13 Automatic email notification with rsyslog
    14. 7.14 Overlapping IBM Spectrum Scale policy rules
    15. 7.15 Storage pool assignment
    16. 7.16 Tape cartridge removal
      1. 7.16.1 Reclaiming tape cartridges before you remove or export them
      2. 7.16.2 Exporting tape cartridges before physically removing them from the library
    17. 7.17 Reusing LTFS formatted tape cartridges
      1. 7.17.1 Reformatting LTFS tape cartridges through eeadm commands
    18. 7.18 Reusing non-LTFS tape cartridges
    19. 7.19 Moving tape cartridges between pools
      1. 7.19.1 Avoiding changing assignments for tape cartridges that contain files
      2. 7.19.2 Reclaiming a tape cartridge and changing its assignment
    20. 7.20 Offline tape cartridges
      1. 7.20.1 Do not modify the files of offline tape cartridges
      2. 7.20.2 Solving problems
    21. 7.21 Scheduling reconciliation and reclamation
    22. 7.22 License Expiration Handling
    23. 7.23 Disaster recovery
      1. 7.23.1 Tiers of disaster recovery
      2. 7.23.2 Preparing IBM Spectrum Archive EE for a tier 1 disaster recovery strategy (offsite vaulting)
      3. 7.23.3 IBM Spectrum Archive EE tier 1 DR procedure
    24. 7.24 IBM Spectrum Archive EE problem determination
      1. 7.24.1 Rsyslog log suppression by rate-limiting
    25. 7.25 Collecting IBM Spectrum Archive EE logs for support
    26. 7.26 Backing up files within file systems that are managed by IBM Spectrum Archive EE
      1. 7.26.1 Considerations
      2. 7.26.2 Backing up a GPFS or IBM Spectrum Scale environment
    27. 7.27 IBM TS4500 Automated Media Verification with IBM Spectrum Archive EE
    28. 7.28 How to disable commands on IBM Spectrum Archive EE
    29. 7.29 LTO 9 Media Optimization
  12. Chapter 8. IBM Spectrum Archive Enterprise Edition use cases
    1. 8.1 Overview of use cases
      1. 8.1.1 Use case for archive
      2. 8.1.2 Use case for tiered and scalable storage
      3. 8.1.3 Use case data exchange
    2. 8.2 Media and Entertainment
    3. 8.3 Media and Entertainment
    4. 8.4 High-Performance Computing
    5. 8.5 Healthcare
    6. 8.6 Genomics
    7. 8.7 Archive of research and scientific data for extended periods
    8. 8.8 University Scientific Data Archive
    9. 8.9 Oil and gas
    10. 8.10 S3 Object Interface
    11. 8.11 AFM use cases
      1. 8.11.1 Centralized archive repository
      2. 8.11.2 Asynchronous archive replication
  13. Chapter 9. Troubleshooting IBM Spectrum Archive Enterprise Edition
    1. 9.1 Overview
      1. 9.1.1 Quick health check
      2. 9.1.2 Common startup errors
    2. 9.2 Hardware
      1. 9.2.1 Tape library
      2. 9.2.2 Tape drives
    3. 9.3 Recovering data from a write failure tape
    4. 9.4 Recovering data from a read failure tape
    5. 9.5 Software
      1. 9.5.1 Linux
      2. 9.5.2 IBM Spectrum Scale
      3. 9.5.3 IBM Spectrum Archive LE component
      4. 9.5.4 Hierarchical storage management
      5. 9.5.5 IBM Spectrum Archive EE logs
    6. 9.6 Recovering from system failures
      1. 9.6.1 Power failure
      2. 9.6.2 Mechanical failure
      3. 9.6.3 Inventory failure
      4. 9.6.4 Abnormal termination
  14. Chapter 10. Reference
    1. 10.1 Command-line reference
      1. 10.1.1 IBM Spectrum Archive EE help guide for commands
      2. 10.1.2 Drive status and state codes
      3. 10.1.3 Node status codes
      4. 10.1.4 Tape status codes
      5. 10.1.5 IBM Spectrum Scale commands
      6. 10.1.6 IBM Spectrum Protect for Space Management commands
    2. 10.2 Formats for IBM Spectrum Scale to IBM Spectrum Archive EE migration
    3. 10.3 System calls and IBM tools
      1. 10.3.1 Downloading the IBM Tape Diagnostic Tool
      2. 10.3.2 Using the IBM LTFS Format Verifier
    4. 10.4 IBM Spectrum Archive EE interoperability with IBM Spectrum Archive products
  15. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  16. Back cover

Product information

  • Title: IBM Spectrum Archive Enterprise Edition V1.3.2.2: Installation and Configuration Guide
  • Author(s): Hiroyuki Miyoshi, Yuka Sasaki, Arnold Byron Lua, Yasuhiro Yoshihara, Khanh Ngo, Larry Coyne
  • Release date: March 2022
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738460420