apache/pulsar

Make the autoSkipNonRecoverableData can work for compacted topic

Open

#17,222 opened on 2022年8月23日

GitHub で見る
 (2 comments) (0 reactions) (1 assignee)Java (13,697 stars) (3,485 forks)batch import
Stalehelp wanted

説明

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

After we enabled autoSkipNonRecoverableData, the topic will skip the non-recoverable ledger which will lose some data, but the topic is able to load and continues to provide messaging service. This usually happens when multiple bookie replicas are corrupted, or the Ledger has been deleted This usually happens when multiple bookie copies are corrupted

But the Ledger used by the compacted topic is not able to be skipped even if autoSkipNonRecoverableData=true

Solution

Make the compacted Ledger can skip the non-recoverable Ledger if autoSkipNonRecoverableData=true

Alternatives

No

Anything else?

No

Are you willing to submit a PR?

  • I'm willing to submit a PR!

コントリビューターガイド

技術スタック
java
領域
backend
Issue 種別
feature
難度新しい貢献者にとっての実装難度です。1 は非常に小さな変更、5 は専門的な作業です。
3
推定時間経験ある貢献者が調査、実装、テスト、pull request 準備にかけるおおよその時間範囲です。
half day
活動状況Issue が今どれだけ取り組みやすいかを示します。新しい、活発、古い、ブロック中、またはメンテナー入力待ちなどです。
stale
明確さ期待される変更、受け入れ条件、次の手順がどれだけ明確かを示します。
clear
前提条件
JavaApache Pulsar internalsBookKeeper concepts
初心者向け度初回貢献者にどれだけ取り組みやすいかを 1-100 で推定したスコアです。
20
調査方針
Investigate the current implementation of autoSkipNonRecoverableData for non compacted topics, likely in ManagedLedgerImpl or related classes. Then determine the changes needed to support compacted topics, focusing on the ledger handling for compacted topics. Review any existing PRs or comments for guidance. The issue has an assignee, so coordinating with them may be beneficial.
Make the autoSkipNonRecoverableData can work for compacted topic · apache/pulsar#17222 | Good First Issue