Integration of IBM Aspera Sync with IBM Spectrum Scale: Protecting and Sharing Files Globally

Integration of IBM Aspera Sync with IBM Spectrum Scale: Protecting and Sharing Files Globally

by Nils Haustein, Jose M Gomez, Benjamin C Forsyth
Released March 2019
Publisher(s): IBM Redbooks
ISBN: 9780738457499

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Economic globalization requires data to be available globally. With most data stored in file systems, solutions to make this data globally available become more important.

Files that are in file systems can be protected or shared by replicating these files to another file system that is in a remote location. The remote location might be just around the corner or in a different country. Therefore, the techniques that are used to protect and share files must account for long distances and slow and unreliable wide area network (WAN) connections.

IBM® Spectrum Scale is a scalable clustered file system that can be used to store all kinds of unstructured data. It provides open data access by way of Network File System (NFS); Server Message Block (SMB); POSIX Object Storage APIs, such as S3 and OpenStack Swift; and the Hadoop Distributed File System (HDFS) for accessing and sharing data.

The IBM Aspera® file transfer solution (IBM Aspera Sync) provides predictable and reliable data transfer across large distance for small and large files. The combination of both can be used for global sharing and protection of data.

This IBM Redpaper™ publication describes how IBM Aspera Sync can be used to protect and share data that is stored in IBM Spectrum™ Scale file systems across large distances of several hundred to thousands of miles. We also explain the integration of IBM Aspera Sync with IBM Spectrum Scale™ and differentiate it from solutions that are built into IBM Spectrum Scale for protection and sharing. We also describe different use cases for IBM Aspera Sync with IBM Spectrum Scale.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Chapter 1. IBM Aspera Sync and IBM Spectrum Scale overview
    1. 1.1 IBM Aspera Sync
    2. 1.2 IBM Spectrum Scale
      1. 1.2.1 Extended attributes
    3. 1.3 Differentiation with IBM Spectrum Scale Active File Management
    4. 1.4 Performance measurements
  5. Chapter 2. Setting up IBM Aspera Sync with IBM Spectrum Scale
    1. 2.1 Overview
    2. 2.2 Preparation
    3. 2.3 How async works
      1. 2.3.1 Async example
      2. 2.3.2 Sync Database
      3. 2.3.3 Sessions
      4. 2.3.4 Replication modes
      5. 2.3.5 Control overwrites
      6. 2.3.6 Control deletion on target
      7. 2.3.7 Using file lists
      8. 2.3.8 Cluster awareness
    4. 2.4 How ascp works
      1. 2.4.1 Ascp example
      2. 2.4.2 Transfer modes
      3. 2.4.3 Control overwrites
      4. 2.4.4 Control deletes on target
      5. 2.4.5 Different path names on source and target
      6. 2.4.6 Using file lists and file pair lists
      7. 2.4.7 Cluster awareness
    5. 2.5 IBM Spectrum Scale configuration
  6. Chapter 3. Using IBM Aspera Sync with IBM Spectrum Scale
    1. 3.1 IBM Spectrum Scale policy engine considerations with IBM Aspera
    2. 3.2 Async without policy engine
    3. 3.3 Ascp without policy engine
    4. 3.4 Integration with the IBM Spectrum Scale policy engine
      1. 3.4.1 IBM Spectrum Scale policy engine
      2. 3.4.2 Integration with async
      3. 3.4.3 Integration with ascp
    5. 3.5 Integration with Hierarchical Storage Management
      1. 3.5.1 Async with HSM on source
      2. 3.5.2 Async with HSM on target
    6. 3.6 Integration with immutable files
    7. 3.7 Integration with IBM Spectrum Scale Snapshots
      1. 3.7.1 Considerations with ascp and snapshots
      2. 3.7.2 Using the policy engine with snapshots
  7. Chapter 4. Summary
    1. 4.1 Async or ascp standalone
    2. 4.2 Async or ascp integrated with the policy engine
    3. 4.3 Stand-alone LIST policies or external policy script
    4. 4.4 Use of snapshots
    5. 4.5 Use cases
      1. 4.5.1 File sharing
      2. 4.5.2 File migration
      3. 4.5.3 Disaster recovery
  8. Related publications
    1. IBM Redbooks
    2. Online resources
    3. Help from IBM
  9. Back cover

Product information

  • Title: Integration of IBM Aspera Sync with IBM Spectrum Scale: Protecting and Sharing Files Globally
  • Author(s): Nils Haustein, Jose M Gomez, Benjamin C Forsyth
  • Release date: March 2019
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738457499