provectus/kafka-ui

Number of messages on Overview page isn't synced properly after topic compaction and doesn't match to number on Messages page

Open

#3275 opened on Jan 27, 2023

View on GitHub
 (4 comments) (0 reactions) (0 assignees)Java (7,799 stars) (977 forks)batch import
good first issuescope/backendstatus/acceptedtype/bug

Description

Describe the bug (Actual behavior) There are 2 pages Overview and Messages where the number of a topic messages is shown. After the topic's compaction, the number of messages isn't updated/synced on Overview page. Please have a look at the screenshots below:

Expected behavior Those metrics should be synced as soon as possible and show an up-to-date value. Otherwise, it's confusing 🤔

Set up

Steps to Reproduce

  1. Create a topic with compact cleanup policy
  2. Produce some messages
  3. Have a look at the number of messages there
  4. Wait for topic compaction or trigger it manually
  5. Have a look at the number of messages on Overview and Messages pages. The numbers are not equal.

Screenshots

Additional context

Contributor guide

Tech stack
java
Domain
full stack
Issue type
bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
basic knowledge of Kafka compactionfamiliarity with Kafka UI project structure
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50
Research direction
Investigate how the message count is computed on the Overview and Messages pages. Check the backend API endpoints (likely in the topic controller) to see if they return the same value. Review whether the Overview page uses a cached or aggregated metric that is not updated after compaction. Look at recent commits or PRs related to topic metrics. Examine the frontend data fetching logic for the Overview page to see if it re fetches after compaction events.