pingcap/tiflow

[TiCDC] support data compression when syncing to MySQL/TiDB

オープン

#9,733 opened on 2023/09/13

 (3 件のコメント) (1 件のリアクション) (0 人の担当者)Go (310 件のフォーク)auto 404
help wantedtype/feature

Repository metrics

Stars
 (461 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Is your feature request related to a problem?

When deploy multiple TiDB Clusters across multiple regions, TiCDC will be used to replicate data changes between these TiDB Clusters. There are some points need to be considered when doing cross region replication:

  • The network bandwidth of cross regions is limited.
  • The cost of data transfer across regions is higher than data transfer inside a region.

Describe the feature you'd like

Support compression when replicate data changes across regions. MySQL protocol support compression: https://dev.mysql.com/doc/refman/8.0/en/connection-compression-control.html TiDB also support connection compression: https://github.com/pingcap/tidb/issues/22605

Describe alternatives you've considered

  1. Don't support compression, pay more cost for cross region replication; but it is easier to hit cross region network bandwidth limitation when the data replication throughput is large enough.

Teachability, Documentation, Adoption, Migration Strategy

No response

コントリビューターガイド