apache/pulsar

Make the autoSkipNonRecoverableData can work for compacted topic

オープン

#17,222 opened on 2022/08/23

 (2 件のコメント) (0 件のリアクション) (1 人の担当者)Java (3,485 件のフォーク)batch import
Stalehelp wanted

Repository metrics

Stars
 (13,697 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

After we enabled autoSkipNonRecoverableData, the topic will skip the non-recoverable ledger which will lose some data, but the topic is able to load and continues to provide messaging service. This usually happens when multiple bookie replicas are corrupted, or the Ledger has been deleted This usually happens when multiple bookie copies are corrupted

But the Ledger used by the compacted topic is not able to be skipped even if autoSkipNonRecoverableData=true

Solution

Make the compacted Ledger can skip the non-recoverable Ledger if autoSkipNonRecoverableData=true

Alternatives

No

Anything else?

No

Are you willing to submit a PR?

  • I'm willing to submit a PR!

コントリビューターガイド