pingcap/tiflow

Support global index in TiCDC

Aberta

#943 aberto em 9 de set. de 2020

 (3 comentários) (0 reação) (0 responsável)Go (310 forks)auto 404
help wanted

Métricas do repositório

Stars
 (461 estrelas)
Métricas de merge de PR
 (Métricas PR pendentes)

Description

Feature Request

Is your feature request related to a problem? Please describe:

TiDB implements global index for partition in 5.0, ref: proposal, TiCDC is not compatible with global index now

In older partition table implementations, row data and indexes are independent of each other between different partitions of the same table. So, different partitions of the same table can be distributed to different nodes in the TiCDC, and write downstream concurrently, without concurrent conflict detection.

After the global index is implemented, the indexes of different partitions are no longer completely independent, and a modification in one partition may affect row data in another partition under more than one uniqueness constraints. Therefore TiCDC cannot simply concurrently write to different partitions of the same table. Different partitions of the same table can not be distributed to different nodes anymore.

Describe the feature you'd like:

Support global index in TiCDC

Time

GanttStart: 2020-09-15 GanttDue: 2020-10-30 GanttProgress: 0%

Workload estimation(person-day)

  • Develop & QA: 10
  • Document: 1

Guia do colaborador