apache/pulsar

Make the autoSkipNonRecoverableData can work for cursor ledger

Open

#17,220 创建于 2022年8月23日

在 GitHub 查看
 (4 评论) (0 反应) (1 负责人)Java (13,697 star) (3,485 fork)batch import
Stalehelp wanted

描述

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

After we enabled autoSkipNonRecoverableData, the topic will skip the non-recoverable ledger which will lose some data, but the topic is able to load and continues to provide messaging service. This usually happens when multiple bookie replicas are corrupted, or the Ledger has been deleted This usually happens when multiple bookie copies are corrupted

But the Ledger used by the cursor is not able to be skipped even if autoSkipNonRecoverableData=true

Solution

Make the cursor can skip the non-recoverable Ledger if autoSkipNonRecoverableData=true

Alternatives

No

Anything else?

No

Are you willing to submit a PR?

  • I'm willing to submit a PR!

贡献者指南

技术栈
java
领域
backenddatabase
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-2 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
mostly clear
前置要求
Understanding of Apache Pulsar cursor managementKnowledge of ledger recovery in Pulsar
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
20
研究方向
The issue requires extending the existing autoSkipNonRecoverableData functionality, currently applied to topic ledgers, to cursor ledgers. The implementation likely resides in the managed ledger or cursor components of Apache Pulsar. Developers should examine the code path where autoSkipNonRecoverableData is checked for topic ledgers and replicate similar logic for cursor ledgers. The assignee (if any) or comments may provide additional context. Look for files such as ManagedLedgerImpl.java or similar classes handling cursor recovery.