TiKV-CDC v1.3.0 Beta

New Features

• Support Kafka sink

What's Changed

• [close #350] Fix flaky it http_api by @pingyu in #351
• [close #355] chore: use latest gotestsum by @pingyu in #354
• Bump golang.org/x/net from 0.1.0 to 0.17.0 in /cdc by @dependabot in #352
• Bump google.golang.org/grpc from 1.43.0 to 1.56.3 in /br/tests/rawkv by @dependabot in #356
• Bump github.com/gin-gonic/gin from 1.7.7 to 1.9.1 in /cdc by @dependabot in #357
• Bump golang.org/x/net from 0.9.0 to 0.17.0 in /br/tests/rawkv by @dependabot in #358
• Bump github.com/prometheus/client_golang from 1.11.0 to 1.11.1 in /br/tests/rawkv by @dependabot in #359
• [close #362] Allow Bump in PR title by @pingyu in #363
• Bump golang.org/x/net from 0.1.0 to 0.17.0 in /br by @dependabot in #361
• Bump google.golang.org/grpc from 1.43.0 to 1.56.3 in /br by @dependabot in #360
• Bump github.com/prometheus/client_golang from 1.11.0 to 1.11.1 in /br by @dependabot in #364
• [to #323] *: Remove tidb dependency by @pingyu in #367
• [close #324] Switch to official client-go 44449c0 by @pingyu in #368
• [close #369] *: Upgrade to go1.21 by @pingyu in #370
• [to #371] chore: Upgrade golangci-lint to v1.55.2 by @pingyu in #373
• [close #371] Upgrade client-go/tidb to release 7.5 by @pingyu in #372
• [close #378] *: add go:generate to building and testing process by @pingyu in #379
• [close #381] Support Kafka sink by @pingyu in #380
• [close #381] Add integration tests for Kafka sink by @pingyu in #382
• [to #381] Add more integration tests for Kafka sink by @pingyu in #387
• [close #383] fix integration test case flow_control & stop_downstream by @pingyu in #392
• [close #395] Batch writes in Kafka consumer by @pingyu in #396
• [close #394] Fix disorder of messages to Kafka by @pingyu in #397
• [close #405] cd: Fix failure of CD and support to build arm64 artifact by @pingyu in #406
• [close #407] Fix arm64 build by @pingyu in #408

New Contributors

• @dependabot made their first contribution in #352

Full Changelog: cdc-v1.2.0-beta...cdc-v1.3.0-beta

TiKV-CDC v1.2.0 Beta

What's Changed

• [close #338] *: upgrade to Go 1.19 by @pingyu in #337
• [to #340] upgrade version of s3 & yaml by @pingyu in #339
• [close #345] build: fix client-java dependency by @pingyu in #344
• [close #343]fix cdc residue metrics by @zeminzhou in #342
• [to #346] Improve fault tolerance for TSO by @pingyu in #347
• [close #348] support filter for key & value by @pingyu in #349

Full Changelog: cdc-v1.1.1...cdc-v1.2.0-beta

TiKV-CDC v1.1.1

Improvements

1. Fix memory leak.
2. Improve integration test rubustness.

What's Changed

• [close #328] cdc: simplify readme by @pingyu in #327
• [close #333] update client-go version to fix context leak by @pingyu in #332
• [close #334] tests: fix timeout of integration test sigstop by @pingyu in #335
• [close #333] Fix context leak in BatchDelete by @pingyu in #336

TiKV-CDC v1.1.0

Key features & improvements

1. Support replicating data with TLS enabled TiKV clusters of both upstream and downstream. See User Guide.
2. Support replication for existing TiKV clusters with data more than 900GB.
3. Support deploying more than 20 changefeeds at the same time.
4. Support specifying key range when deploying changefeed.
5. Polish flow control to avoid Out-Of-Memory.
6. Improve code coverage of unit tests and integration tests.

What's Changed

• [close #211] Add TiKV-CDC config templates by @pingyu in #212
• [close #213] Add TiKV-CDC Chinese manual by @pingyu in #214
• [close #215] Add integration test for TiKV-CDC by @zeminzhou in #216
• [close #232] Add HTTPs as sink URI by @zeminzhou in #233
• [close #241] Fix flow control @zeminzhou in #242
• [close #246] Fix unified sorter @zeminzhou in #247
• [close #248] Fix keyspan sink metrics by @pingyu in #249
• [close #253] Add input event metric for puller @zeminzhou in #254
• [close #250] Remove empty value check in client-go @pingyu in #277
• [close #280] Fix TiKV-CDC stuck when sent SIGSTOP to PD leader @zeminzhou in #286
• [close #287] Fix alertmanager for TiKV-CDC @zeminzhou in #288
• [close #295] Split integrated tests to groups @pingyu in #314

TiKV-BR v1.1.0

Key features & improvements

1. Support Amazon S3 as storage when backup and restoration. See User Guide.
2. Support backup and restoration with key range. See User Guide.
3. Support backup and restoration for TLS enabled TiKV cluster. See User Guide.
4. Support backup and restoration for v5.x.x TiKV cluster. See User Guide.
5. Support rate limit during backup and restoration. See User Guide.
6. Improve code coverage of unit tests and integration tests.

What's Changed

• [close #217] Add BR unit test coverage statistics by @haojinming in #218
• [close #220] TiKV-BR support key range by @haojinming in #221
• [close #229] Add integration test coverage report for TiKV-BR by @haojinming in #230
• [close #227] Update BR readme by @haojinming in #228
• [close #235] Support TLS connection for TiKV-BR by @haojinming in #236
• [close #239] Add gcttl and range in readme by @haojinming in #240
• [close #263] Fix br docker build by @haojinming in #264
• [close #267] Fix restore ratelimit by @haojinming in #268
• [close #231] TiKV-BR support v5.x.x by @haojinming in #282
• [close #305] Fix supported version in tikv br README by @haojinming in #306

TiKV-CDC v1.0.0

Release TiKV-CDC v1.0.0
Please see https://github.com/tikv/migration/blob/main/cdc/README.md.

TiKV-BR v1.0.1

TiKV-BR v1.0.1 release:

1. Fix bugs
2. Support return backup-ts after backup for apiv2 cluster.

TiKV-CDC v1.0.0 alpha

Release TiKV-CDC v1.0.0 alpha
Please see https://github.com/tikv/migration/blob/main/cdc/README.md.

TiKV-BR v1.0.0

Release TiKV-BR v1.0.0
Please see: https://github.com/tikv/migration/blob/main/br/README-cn.md