Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 21 additions & 1 deletion src/main/asciidoc/_chapters/ops_mgt.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -475,8 +475,11 @@ Options:
endtime end of the time range. Ignored if no starttime specified.
versions number of cell versions to copy
new.name new table's name
peer.uri The URI of the peer cluster
peer.adr Address of the peer cluster given in the format
hbase.zookeeer.quorum:hbase.zookeeper.client.port:zookeeper.znode.parent
Do not take effect if peer.uri is specified
Deprecated, please use peer.uri instead
families comma-separated list of families to copy
To copy from cf1 to cf2, give sourceCfName:destCfName.
To keep the same name, just give "cfName"
Expand All @@ -498,10 +501,14 @@ For performance consider the following general options:
-Dmapred.map.tasks.speculative.execution=false
----

Starting from 3.0.0, we introduce a `peer.uri` option so the `peer.adr` option is deprecated. Please
use connection URI for specifying HBase clusters. For all previous versions, you should still use
the `peer.adr` option.

.Scanner Caching
[NOTE]
====
Caching for the input Scan is configured via `hbase.client.scanner.caching` in the job configuration.
Caching for the input Scan is configured via `hbase.client.scanner.caching` in the job configuration.
====

.Versions
Expand Down Expand Up @@ -586,10 +593,18 @@ $ ./bin/hbase org.apache.hadoop.hbase.mapreduce.SyncTable --help
Usage: SyncTable [options] <sourcehashdir> <sourcetable> <targettable>

Options:
sourceuri Cluster connection uri of the source table
(defaults to cluster in classpath's config)
sourcezkcluster ZK cluster key of the source table
(defaults to cluster in classpath's config)
Do not take effect if sourceuri is specifie
Deprecated, please use sourceuri instead
targeturi Cluster connection uri of the target table
(defaults to cluster in classpath's config)
targetzkcluster ZK cluster key of the target table
(defaults to cluster in classpath's config)
Do not take effect if targeturi is specified
Deprecated, please use targeturi instead
dryrun if true, output counters but no writes
(defaults to false)
doDeletes if false, does not perform deletes
Expand All @@ -613,6 +628,10 @@ Examples:
$ bin/hbase org.apache.hadoop.hbase.mapreduce.SyncTable --dryrun=true --sourcezkcluster=zk1.example.com,zk2.example.com,zk3.example.com:2181:/hbase hdfs://nn:9000/hashes/tableA tableA tableA
----

Starting from 3.0.0, we introduce `sourceuri` and `targeturi` options so `sourcezkcluster` and
`targetzkcluster` are deprecated. Please use connection URI for specifying HBase clusters. For all
previous versions, you should still use `sourcezkcluster` and `targetzkcluster`.

Cell comparison takes ROW/FAMILY/QUALIFIER/TIMESTAMP/VALUE into account for equality. When syncing at the target, missing cells will be
added with original timestamp value from source. That may cause unexpected results after SyncTable completes, for example, if missing
cells on target have a delete marker with a timestamp T2 (say, a bulk delete performed by mistake), but source cells timestamps have an
Expand Down Expand Up @@ -2449,6 +2468,7 @@ The `Peers` Znode::
It consists of a list of all peer replication clusters, along with the status of each of them.
The value of each peer is its cluster key, which is provided in the HBase Shell.
The cluster key contains a list of ZooKeeper nodes in the cluster's quorum, the client port for the ZooKeeper quorum, and the base znode for HBase in HDFS on that cluster.
Starting from 3.0.0, you can also specify connection URI as a cluster key. See <<client.connectionuri>> for more details about connection URI.

The `RS` Znode::
The `rs` znode contains a list of WAL logs which need to be replicated.
Expand Down