Full shutdown backup using distcp
distcp (distributed copy) is a tool provided by Hadoop for copying a large dataset on the same, or different HDFS cluster. It uses MapReduce to copy files in parallel, handle error and recovery, and report the job status.
As HBase stores all its files, including system files on HDFS, we can simply use distcp to copy the HBase directory to either another directory on the same HDFS, or to a different HDFS, for backing up the source HBase cluster.
Note that this is a full shutdown backup solution. The distcp tool works because the HBase cluster is shut down (or all tables are disabled) and there are no edits to files during the process. Do not use distcp on a live HBase cluster. Therefore, this solution is for the ...
Get HBase Administration Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
