IBM System Storage SAN Volume Controller and Storwize V7000 Replication Family Services

IBM System Storage SAN Volume Controller and Storwize V7000 Replication Family Services

by Jon Tate, Rafael Vilela Dias, Ivaylo Dikanarov, Jim Kelly, Peter Mescher
Released March 2013
Publisher(s): IBM Redbooks
ISBN: 9780738437781

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM® Redbooks® publication describes the new features that have been added with the release of the IBM System Storage® SAN Volume Controller (SVC) and IBM System Storage Storwize® V7000 6.4.0 code, including Replication Family Services.

Replication Family Services refers to the various copy services available on the SVC and Storwize V7000 including IBM FlashCopy®, Metro Mirror and Global Mirror, Global Mirror with Change Volumes, Volume Mirroring, and Stretched Cluster Volume Mirroring. The details behind the theory and practice of these services are examined, and SAN design suggestions and troubleshooting tips are provided. Planning requirements, automating copy services processed, and fabric design are explained. Multiple examples including implementation and server integration are included, along with a discussion of software solutions and services that are based on Replication Family Services.

This book is intended for use by pre-sales and post-sales support, and storage administrators. Readers are expected to have an advanced knowledge of the SVC, Storwize V7000, and the SAN environment.

The following publications are useful resources that provide background information:

  • Implementing the IBM System Storage SAN Volume Controller V6.3, SG24-7933

  • Implementing the IBM Storwize V7000 V6.3, SG24-7938

  • IBM SAN Volume Controller and Brocade Disaster Recovery Solutions for VMware, REDP-4626[

  • IBM System Storage SAN Volume Controller Upgrade Path from Version 4.3.1 to 6.1, REDP-4716[

  • Real-time Compression in SAN Volume Controller and Storwize V7000, REDP-4859

  • SAN Volume Controller: Best Practices and Performance Guidelines, SG24-7521

  • Implementing the Storwize V7000 and the IBM System Storage SAN32B-E4 Encryption Switch, SG24-7977

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Summary of changes
    1. March 2013, Third Edition
  4. Preface
    1. The team who wrote this book
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  5. Chapter 1. Introduction to Replication Family Services
    1. 1.1 FlashCopy
    2. 1.2 Metro Mirror and Global Mirror
      1. 1.2.1 Global Mirror with Change Volumes
    3. 1.3 Volume Mirroring function
      1. 1.3.1 Stretched Cluster Volume Mirroring
  6. Chapter 2. Planning for Replication Family Services
    1. 2.1 High-level design
      1. 2.1.1 Defining your project
      2. 2.1.2 Functional requirements
      3. 2.1.3 Non-functional requirements
      4. 2.1.4 Prior to implementation
    2. 2.2 Business continuity and productivity goals
      1. 2.2.1 Data protection
      2. 2.2.2 Storage efficiency
    3. 2.3 High availability
      1. 2.3.1 Volume Mirroring for high availability
      2. 2.3.2 SVC Stretched Cluster for high availability
    4. 2.4 Backup and restore
      1. 2.4.1 FlashCopy for backup and restore
      2. 2.4.2 Using Reverse FlashCopy to restore a volume
      3. 2.4.3 Backup and restore references
    5. 2.5 Disaster recovery
      1. 2.5.1 Disaster recovery site location
      2. 2.5.2 Metro Mirror for disaster recovery
      3. 2.5.3 Global Mirror for disaster recovery
      4. 2.5.4 FlashCopy in a Metro or Global Mirror recovery
      5. 2.5.5 Global Mirror with Change Volumes for disaster recovery
      6. 2.5.6 SVC Stretched Cluster for disaster recovery
      7. 2.5.7 Three-site replication for disaster recovery
      8. 2.5.8 Further reading for disaster recovery
    6. 2.6 Creating volume copies
      1. 2.6.1 Single Volume Mirroring
      2. 2.6.2 FlashCopy (volumes and Consistency Groups)
      3. 2.6.3 Metro or Global Mirror
    7. 2.7 Moving volumes
      1. 2.7.1 migratevdisk
      2. 2.7.2 Volume Mirroring usage
      3. 2.7.3 movevdisk
      4. 2.7.4 Metro or Global Mirror
    8. 2.8 Capacity planning
      1. 2.8.1 Performance monitoring on SVC and Storwize V7000
      2. 2.8.2 Using Disk Magic to predict the impact of Metro and Global Mirror
      3. 2.8.3 FlashCopy considerations for disk performance
      4. 2.8.4 Grain size
    9. 2.9 Planning for supportability
      1. 2.9.1 Understanding consistency
      2. 2.9.2 Planning for host attachments
      3. 2.9.3 Extended Quorum Support for SVC Stretched Cluster
      4. 2.9.4 Support Notifications
  7. Chapter 3. Metro Mirror and Global Mirror
    1. 3.1 Terminology
    2. 3.2 Metro and Global Mirror overview
    3. 3.3 Partnerships between systems
      1. 3.3.1 Layer concept
      2. 3.3.2 Partnership topologies
      3. 3.3.3 Partnership heartbeat
    4. 3.4 Network connectivity for Metro and Global Mirror
      1. 3.4.1 Fibre Channel over Ethernet (FCoE)
      2. 3.4.2 Planning your network for Metro or Global Mirror
    5. 3.5 Relationships between volumes or Consistency Groups
      1. 3.5.1 Consistency Groups
    6. 3.6 Initial synchronization
      1. 3.6.1 Default synchronization across the network
      2. 3.6.2 Tape-based synchronization
    7. 3.7 Relationship states
      1. 3.7.1 State definitions
      2. 3.7.2 State descriptions
      3. 3.7.3 Stop, Start, and Switch commands
    8. 3.8 Tunable parameters and limits
      1. 3.8.1 I/O Group memory allocation for Metro and Global Mirror
      2. 3.8.2 Partnership bandwidth (total background copy limit)
      3. 3.8.3 relationshipbandwidthlimit
      4. 3.8.4 rcbuffersize
      5. 3.8.5 gmlinktolerance and gmmaxhostdelay
      6. 3.8.6 Configuration limits
    9. 3.9 Metro Mirror
    10. 3.10 Global Mirror
      1. 3.10.1 gmlinktolerance and gmmaxhostdelay
      2. 3.10.2 rcbuffersize
      3. 3.10.3 Link delay simulation
    11. 3.11 Global Mirror with Change Volumes
      1. 3.11.1 Recovery point objective using Change Volumes
      2. 3.11.2 Bandwidth sizing example for Change Volumes
      3. 3.11.3 Disk sizing for Change Volumes
      4. 3.11.4 Migrating from Global Mirror to Global Mirror with Change Volumes
    12. 3.12 Intra-cluster replication
    13. 3.13 Three-site replication with SVC Stretched Cluster and Metro Mirror or Global Mirror
  8. Chapter 4. Implementing Metro Mirror and Global Mirror
    1. 4.1 Metro Mirror using the CLI
      1. 4.1.1 Setting up Metro Mirror
      2. 4.1.2 Creating a partnership - Metro Mirror
      3. 4.1.3 Creating Metro Mirror relationships
      4. 4.1.4 Starting Metro Mirror
      5. 4.1.5 Monitoring the background copy progress
      6. 4.1.6 Stopping and restarting Metro Mirror
      7. 4.1.7 Changing the copy direction on Metro Mirror
      8. 4.1.8 Creating multiple partnerships
    2. 4.2 Global Mirror using the CLI
      1. 4.2.1 Setting up Global Mirror
      2. 4.2.2 Creating a partnership - Global Mirror
      3. 4.2.3 Changing link tolerance and system delay simulation
      4. 4.2.4 Creating Global Mirror relationships
      5. 4.2.5 Starting Global Mirror
      6. 4.2.6 Monitoring the background copy progress
      7. 4.2.7 Stopping and restarting Global Mirror
      8. 4.2.8 Switching the direction on Global Mirror
    3. 4.3 Global Mirror with Change Volumes using the CLI
      1. 4.3.1 Change Volume requirements
      2. 4.3.2 Changing Global Mirror to Global Mirror with Change Volumes
      3. 4.3.3 Creating the thin-provisioned Change Volumes
      4. 4.3.4 Stopping the stand-alone remote copy relationship
      5. 4.3.5 Setting cyclingmode on the stand-alone remote copy relationship
      6. 4.3.6 Setting the Change Volume on the master volume
      7. 4.3.7 Setting the Change Volume on the auxiliary volume
      8. 4.3.8 Starting the stand-alone relationship with cyclingmode
      9. 4.3.9 Stopping the Consistency Group to allow setting cyclingmode
      10. 4.3.10 Setting cyclingmode on the Consistency Group
      11. 4.3.11 Setting the Primary Change Volumes for the Consistency Group
      12. 4.3.12 Setting the secondary Change Volumes for the Consistency Group
      13. 4.3.13 Starting the Consistency Group with Change Volumes
    4. 4.4 Implementation using the GUI
      1. 4.4.1 Creating a partnership between two systems (clusters)
      2. 4.4.2 Creating stand-alone relationships between volumes
      3. 4.4.3 Creating a Consistency Group
      4. 4.4.4 Renaming a Consistency Group
      5. 4.4.5 Renaming a relationship
      6. 4.4.6 Moving a stand-alone remote copy relationship to a Consistency Group
      7. 4.4.7 Removing a remote copy relationship from a Consistency Group
      8. 4.4.8 Starting a relationship
      9. 4.4.9 Starting a Consistency Group
      10. 4.4.10 Switching the copy direction on a relationship
      11. 4.4.11 Switching the copy direction on a Consistency Group
      12. 4.4.12 Stopping a Metro Mirror or Global Mirror relationship
      13. 4.4.13 Stopping a Consistency Group
      14. 4.4.14 Deleting stand-alone relationships
      15. 4.4.15 Deleting a Consistency Group
  9. Chapter 5. FlashCopy
    1. 5.1 Introduction to FlashCopy
      1. 5.1.1 Life without the FlashCopy function
      2. 5.1.2 Life with the FlashCopy function
      3. 5.1.3 FlashCopy function use and example cases
    2. 5.2 FlashCopy characteristics
      1. 5.2.1 FlashCopy mapping
      2. 5.2.2 Number of FlashCopy mappings in a cluster
      3. 5.2.3 FlashCopy Consistency Groups
      4. 5.2.4 Multiple Target FlashCopy
      5. 5.2.5 Cascaded FlashCopy
      6. 5.2.6 Combined Multiple Target FlashCopy and Cascaded FlashCopy
      7. 5.2.7 Incremental FlashCopy
      8. 5.2.8 Thin-provisioned FlashCopy
      9. 5.2.9 Background copy
    3. 5.3 FlashCopy internals
      1. 5.3.1 Indirection layer
      2. 5.3.2 Summary of FlashCopy indirection layer algorithm
      3. 5.3.3 Discussion of grains
      4. 5.3.4 FlashCopy indirection layer algorithm
      5. 5.3.5 Interaction and dependency between Multiple Target FlashCopy mappings
      6. 5.3.6 bitmaps
      7. 5.3.7 Usable bitmap space
      8. 5.3.8 FlashCopy maximum configurations
      9. 5.3.9 Summary of FlashCopy function rules and characteristics
    4. 5.4 FlashCopy events and states
      1. 5.4.1 FlashCopy mapping states
    5. 5.5 Dependencies between FlashCopy mappings
      1. 5.5.1 Linked lists of mappings and resulting dependencies
      2. 5.5.2 Stopping FlashCopy mappings within a tree
    6. 5.6 Practical example of a mapping tree
      1. 5.6.1 FlashCopy mapping setup
      2. 5.6.2 Workflow to set up and run FlashCopy mappings
      3. 5.6.3 Characteristics of this setup and notes about the steps
      4. 5.6.4 Workflow to set up and run FlashCopy mappings
      5. 5.6.5 Characteristics of this setup and notes about the steps
  10. Chapter 6. Implementing FlashCopy
    1. 6.1 Copy considerations
      1. 6.1.1 Command syntax and online help
      2. 6.1.2 Interoperation with Metro Mirror and Global Mirror
      3. 6.1.3 FlashCopy: simulated scenario
    2. 6.2 FlashCopy - CLI operation
      1. 6.2.1 Setting up FlashCopy
      2. 6.2.2 Creating a FlashCopy Consistency Group
      3. 6.2.3 Creating a FlashCopy mapping
      4. 6.2.4 Preparing (pre-triggering) the FlashCopy mapping
      5. 6.2.5 Preparing (pre-triggering) the FlashCopy Consistency Group
      6. 6.2.6 Starting (triggering) FlashCopy mappings
      7. 6.2.7 Starting (triggering) FlashCopy Consistency Group
      8. 6.2.8 Monitoring the FlashCopy progress
      9. 6.2.9 Stopping the FlashCopy mapping
      10. 6.2.10 Stopping the FlashCopy Consistency Group
      11. 6.2.11 Deleting the FlashCopy mapping
      12. 6.2.12 Deleting the FlashCopy Consistency Group
      13. 6.2.13 Migrating a volume to a thin-provisioned volume
      14. 6.2.14 Reverse FlashCopy
      15. 6.2.15 Split-stopping FlashCopy maps
    3. 6.3 Example: FlashCopy using the CLI
      1. 6.3.1 Checking Volumes and the Metro Mirror relationship
      2. 6.3.2 Creating FlashCopy mappings
      3. 6.3.3 Creating a Consistency Group
      4. 6.3.4 Adding FlashCopy mappings to a Consistency Group
      5. 6.3.5 Preparing a FlashCopy mapping
      6. 6.3.6 Starting a Consistency Group
      7. 6.3.7 Modifying a FlashCopy mapping
      8. 6.3.8 Stopping a FlashCopy mapping and a Consistency Group
      9. 6.3.9 Deleting a FlashCopy mapping and a Consistency Group
    4. 6.4 FlashCopy - GUI operation
      1. 6.4.1 Introduction to the GUI
      2. 6.4.2 Creating a FlashCopy mapping
      3. 6.4.3 Creating and starting a snapshot preset with a single click
      4. 6.4.4 Creating and starting a clone preset with a single click
      5. 6.4.5 Creating and starting a backup preset with a single click
      6. 6.4.6 Creating a FlashCopy Consistency Group
      7. 6.4.7 Creating FlashCopy mappings in a Consistency Group
      8. 6.4.8 Showing dependent mappings
      9. 6.4.9 Moving a FlashCopy mapping to a Consistency Group
      10. 6.4.10 Removing a FlashCopy mapping from a Consistency Group
      11. 6.4.11 Modifying a FlashCopy mapping
      12. 6.4.12 Renaming a FlashCopy mapping
      13. 6.4.13 Renaming a Consistency Group
      14. 6.4.14 Deleting a FlashCopy mapping
      15. 6.4.15 Deleting a FlashCopy Consistency Group
      16. 6.4.16 Starting FlashCopy mappings
      17. 6.4.17 Starting a FlashCopy Consistency Group
      18. 6.4.18 Stopping the FlashCopy Consistency Group
      19. 6.4.19 Stopping the FlashCopy mapping
      20. 6.4.20 Migrating between a fully allocated volume and a thin-provisioned volume
      21. 6.4.21 Reversing and splitting a FlashCopy mapping
  11. Chapter 7. Volume Mirroring
    1. 7.1 Volume Mirroring overview
      1. 7.1.1 Mirrored volume components
      2. 7.1.2 Volume Mirroring usage cases and characteristics
      3. 7.1.3 Performance considerations of Volume Mirroring
      4. 7.1.4 Bitmap space for out-of-sync volume copies
      5. 7.1.5 Synchronization status of volume copies
    2. 7.2 Volume Mirroring infrastructure design examples
      1. 7.2.1 HA design using a single SVC or Storwize V7000 cluster
      2. 7.2.2 HA and disaster-tolerant design using SVC or Storwize V7000 cluster
      3. 7.2.3 Quorum disks
      4. 7.2.4 Quorum disk considerations
      5. 7.2.5 High availability design using an SVC Stretched Cluster configuration
      6. 7.2.6 Non-ISL configuration
      7. 7.2.7 ISL configuration
  12. Chapter 8. Implementing Volume Mirroring
    1. 8.1 Managing bitmap space for Volume Mirroring using the GUI
    2. 8.2 Managing bitmap space for Volume Mirroring using the CLI
    3. 8.3 Configuring Volume Mirroring using the GUI
      1. 8.3.1 Creating a new volume
      2. 8.3.2 Adding a mirrored copy to an existing volume
      3. 8.3.3 Deleting a mirrored copy from a volume mirror
      4. 8.3.4 Splitting a volume copy
      5. 8.3.5 Validating volume copies
      6. 8.3.6 Migrating to a thin-provisioned volume using Volume Mirroring
    4. 8.4 Configuring Volume Mirroring using the CLI
      1. 8.4.1 Creating a new volume
      2. 8.4.2 Adding a mirrored copy to an existing volume
      3. 8.4.3 Deleting a mirrored volume
      4. 8.4.4 Splitting a mirrored volume
      5. 8.4.5 Validating a mirrored volume
      6. 8.4.6 Configuring I/O Time-out for Mirrored Volumes
  13. Chapter 9. Server integration
    1. 9.1 Copied data
    2. 9.2 Data on copied volumes
    3. 9.3 AIX specifics
      1. 9.3.1 JFS, JFS2, and Copy Services
      2. 9.3.2 Example of copy creation
      3. 9.3.3 Accessing useful copies in AIX
    4. 9.4 Windows specifics
      1. 9.4.1 Windows 2000 Server, Windows Server 2003, SVC Advanced Copy Services
      2. 9.4.2 Microsoft Windows Server 2008 and IBM SVC Advanced Copy Services
    5. 9.5 Linux specifics
      1. 9.5.1 Creating useful copies
      2. 9.5.2 Accessing useful copies
      3. 9.5.3 Accessing target or secondary volumes from the same Linux host
      4. 9.5.4 Accessing target or secondary volumes from a different Linux host
    6. 9.6 Other operating systems
  14. Chapter 10. Automating copy services processes
    1. 10.1 Running commands on the cluster
      1. 10.1.1 Connection
      2. 10.1.2 Authentication
      3. 10.1.3 Submission
      4. 10.1.4 Authorization
      5. 10.1.5 Execution
    2. 10.2 Creating connections
      1. 10.2.1 Transient connections
      2. 10.2.2 Persistent connections
    3. 10.3 SVC command-line scripting
      1. 10.3.1 Submitting command-line scripts
      2. 10.3.2 Example SVC command-line script
    4. 10.4 Server-side scripting
      1. 10.4.1 Creating persistent SVC connections
      2. 10.4.2 Handling the SVC response
    5. 10.5 SVC CIMOM programming
      1. 10.5.1 CIM concepts
      2. 10.5.2 SVC concepts mapping to CIM concepts
      3. 10.5.3 Creating and starting a FlashCopy mapping
    6. 10.6 Logging
    7. 10.7 Auditing
  15. Chapter 11. Software solutions and services based on IBM SVC Replication Family Services
    1. 11.1 IBM Tivoli Storage Productivity Center for Replication with IBM SVC Replication Family Services
      1. 11.1.1 TPC-R compared to SVC/SSPC console
      2. 11.1.2 Setting up TPC-R for use with the SVC
      3. 11.1.3 Configuring Copy Services relationships
      4. 11.1.4 Failover/Failback Metro and Global Mirror sessions
      5. 11.1.5 Metro and Global Mirror with practice sessions
      6. 11.1.6 Using CSV files during Copy Set creation
      7. 11.1.7 TPC for Replication CLI
      8. 11.1.8 TPC-R Live demo
      9. 11.1.9 IBM Tivoli Storage Productivity Center V5.1
    2. 11.2 IBM Tivoli Storage FlashCopy Manager
      1. 11.2.1 IBM Tivoli Storage FlashCopy Manager for Windows
      2. 11.2.2 Microsoft Exchange Server backup and restore with IBM Tivoli Storage FlashCopy Manager for Windows
      3. 11.2.3 Microsoft File System backup and restore with IBM Tivoli Storage FlashCopy Manager for Windows
      4. 11.2.4 IBM Tivoli Storage FlashCopy Manager for Oracle
      5. 11.2.5 IBM Tivoli Storage FlashCopy Manager for VMware
      6. 11.2.6 IBM Tivoli Storage FlashCopy Manager live demonstration
    3. 11.3 IBM SVC plug-ins
      1. 11.3.1 IBM Storage Management Console for VMware vCenter
      2. 11.3.2 Storage Management Pack for Microsoft System Center Operations Manager
      3. 11.3.3 IBM Storage Device Driver for VMware
    4. 11.4 IBM SVC/Storwize V7000 disaster recovery solution for VMware environment
    5. 11.5 IBM SVC/Storwize V7000 FlashCopy and Symantec NetBackup
    6. 11.6 SVC/Storwize V7000 Remote Copy and Veritas Storage Foundation Enterprise HA
  16. Chapter 12. Fabric design considerations for Replication Family
    1. 12.1 Topology and zoning for Metro and Global Mirror
      1. 12.1.1 Dual WAN zoning
      2. 12.1.2 Single WAN zoning
      3. 12.1.3 Mirror-only ports
      4. 12.1.4 Alternate Global Mirror topology - “forwarding” I/O group
    2. 12.2 FCoE and remote replication
    3. 12.3 Topology and zoning for Stretched Cluster
      1. 12.3.1 Stretched Cluster and the third-site quorum requirement
      2. 12.3.2 “Classic” Stretched Cluster topology - no inter-node ISLs
      3. 12.3.3 Stretched Cluster with inter-node ISLs
    4. 12.4 WAN connectivity for replication
      1. 12.4.1 WAN connectivity types
      2. 12.4.2 WAN redundancy
      3. 12.4.3 Link quality
      4. 12.4.4 Bandwidth planning
    5. 12.5 SAN routing with mirroring
      1. 12.5.1 SAN routing with Brocade products
      2. 12.5.2 SAN routing with Cisco Inter-VSAN Routes
  17. Chapter 13. Troubleshooting Replication Family Services
    1. 13.1 Basic replication diagnostics
      1. 13.1.1 Common replication error codes
      2. 13.1.2 Collecting SVC performance data
    2. 13.2 Basic replication performance troubleshooting tips
      1. 13.2.1 First steps
      2. 13.2.2 Workload analysis
      3. 13.2.3 Source and destination storage controllers
      4. 13.2.4 SVC/Storwize V7000 CPU utilization
      5. 13.2.5 WAN performance (Metro and Non-Cycling Mode Global Mirror)
    3. 13.3 SAN diagnostics for replication
      1. 13.3.1 Fibre Channel flow control overview
    4. 13.4 FCIP congestion troubleshooting
      1. 13.4.1 Background
      2. 13.4.2 Checking WAN bandwidth configuration
      3. 13.4.3 FCIP tunnel quality check
  18. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Referenced websites
    4. Help from IBM
  19. Back cover

Product information

  • Title: IBM System Storage SAN Volume Controller and Storwize V7000 Replication Family Services
  • Author(s): Jon Tate, Rafael Vilela Dias, Ivaylo Dikanarov, Jim Kelly, Peter Mescher
  • Release date: March 2013
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738437781