apache/pulsar

Make the autoSkipNonRecoverableData can work for schema Ledger

Open

#17,221 创建于 2022年8月23日

在 GitHub 查看
 (2 评论) (0 反应) (1 负责人)Java (13,697 star) (3,485 fork)batch import
Stalehelp wanted

描述

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

After we enabled autoSkipNonRecoverableData, the topic will skip the non-recoverable ledger which will lose some data, but the topic is able to load and continues to provide messaging service. This usually happens when multiple bookie replicas are corrupted, or the Ledger has been deleted This usually happens when multiple bookie copies are corrupted

But the Ledger used by the schema is not able to be skipped even if autoSkipNonRecoverableData=true

Solution

Make the schema can skip the non-recoverable Ledger if autoSkipNonRecoverableData=true And looks like we need to provide a new option to skip the data that the schema is lost.

Alternatives

No

Anything else?

No

Are you willing to submit a PR?

  • I'm willing to submit a PR!

贡献者指南