provectus/kafka-ui

[Bug] Support older kafka versions (v0.11.0)

Open

#1550 opened on Feb 4, 2022

View on GitHub
 (18 comments) (0 reactions) (0 assignees)Java (7,799 stars) (977 forks)batch import
good first issuescope/backendstatus/acceptedtype/bug

Description

Describe the bug There is no topic list displayed. But when I display the consumers list I am able to navigate to topic for this consumer group.

http://localhost:8080/ui/clusters/QA3/topics

There is a warning in logs

WARN  [parallel-2] o.h.v.i.p.j.JavaBeanExecutable: HV000254: Missing parameter metadata for TopicColumnsToSortDTO(String, int, String), which declares implicit or synthetic parameters. Automatic resolution of generic type information for method parameters may yield incorrect results if multiple parameters have the same erasure. To solve this, compile your code with the '-parameters' flag

Set up Version:0.3.3 Run through docker compose

 version: '3'
 services:
   magic:
     container_name: kafka-ui
     image: provectuslabs/kafka-ui
     ports:
       - "8080:8080"
     environment:
       - KAFKA_CLUSTERS_0_NAME=QA3
       - KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS=..
       - KAFKA_CLUSTERS_0_READONLY=true

Steps to Reproduce

docker-compose up

Expected behavior See list of topics.

Logs

kafka-ui  | 2022-02-04 12:43:05,887 INFO  [parallel-1] o.a.k.c.u.AppInfoParser: Kafka version: 2.8.0
kafka-ui  | 2022-02-04 12:43:05,887 INFO  [parallel-1] o.a.k.c.u.AppInfoParser: Kafka commitId: ebb1d6e21cc92130
kafka-ui  | 2022-02-04 12:43:05,888 INFO  [parallel-1] o.a.k.c.u.AppInfoParser: Kafka startTimeMs: 1643978585885
kafka-ui  | 2022-02-04 12:43:09,796 ERROR [kafka-admin-client-thread | adminclient-1] c.p.k.u.s.MetricsService: Failed to collect cluster QA3 info
kafka-ui  | org.apache.kafka.common.errors.UnsupportedVersionException: Attempted to write a non-default includeSynonyms at version 0
kafka-ui  | 2022-02-04 12:43:09,800 DEBUG [kafka-admin-client-thread | adminclient-1] c.p.k.u.s.ClustersMetricsScheduler: Metrics updated for cluster: QA3
kafka-ui  | 2022-02-04 12:43:35,671 DEBUG [parallel-1] c.p.k.u.s.ClustersMetricsScheduler: Start getting metrics for kafkaCluster: QA3
kafka-ui  | 2022-02-04 12:43:36,253 ERROR [kafka-admin-client-thread | adminclient-1] c.p.k.u.s.MetricsService: Failed to collect cluster QA3 info
kafka-ui  | org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support DESCRIBE_LOG_DIRS
kafka-ui  | 2022-02-04 12:43:36,253 DEBUG [kafka-admin-client-thread | adminclient-1] c.p.k.u.s.ClustersMetricsScheduler: Metrics updated for cluster: QA3
kafka-ui  | 2022-02-04 12:43:42,902 WARN  [parallel-2] o.h.v.i.p.j.JavaBeanExecutable: HV000254: Missing parameter metadata for TopicColumnsToSortDTO(String, int, String), which declares implicit or synthetic parameters. Automatic resolution of generic type information for method parameters may yield incorrect results if multiple parameters have the same erasure. To solve this, compile your code with the '-parameters' flag.

Additional context

Contributor guide

Tech stack
javaspring
Domain
backendapi
Issue type
bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
JavaApache Kafka basicsSpring Boot
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60
Research direction
Investigate the Kafka admin client usage in the MetricsService and related classes. The errors suggest that the client is using API features (includeSynonyms in describeConfigs, DESCRIBE LOG DIRS) not supported by Kafka 0.11.0. Look for where the admin client is configured and see if there is a version check or fallback. Consider using the AdminClient API methods that work with older versions, or conditionally skip features based on broker version. Additionally, address the HV000254 warning by compiling with parameters flag or fixing the DTO.