apache/pulsar

Make the autoSkipNonRecoverableData can work for schema Ledger

オープン

#17,221 opened on 2022/08/23

 (2 件のコメント) (0 件のリアクション) (1 人の担当者)Java (3,485 件のフォーク)batch import
Stalehelp wanted

Repository metrics

Stars
 (13,697 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

After we enabled autoSkipNonRecoverableData, the topic will skip the non-recoverable ledger which will lose some data, but the topic is able to load and continues to provide messaging service. This usually happens when multiple bookie replicas are corrupted, or the Ledger has been deleted This usually happens when multiple bookie copies are corrupted

But the Ledger used by the schema is not able to be skipped even if autoSkipNonRecoverableData=true

Solution

Make the schema can skip the non-recoverable Ledger if autoSkipNonRecoverableData=true And looks like we need to provide a new option to skip the data that the schema is lost.

Alternatives

No

Anything else?

No

Are you willing to submit a PR?

  • I'm willing to submit a PR!

コントリビューターガイド