KRaft: a new controller can bootstrap against itself and never join the quorum

Aperta
#1,062 0 commenti 0 reazioni 1 assegnatario Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

@razvan ci sta già lavorando.

Dal 13/11/2026.

  • #1063 di @razvan — aperta

Valutazione

Questa issue non è ancora stata valutata.

Descrizione

type/bug
Description

A controller that starts without metadata (a new pod, e.g. after scaling up a controller role group) finds the quorum leader through controller.quorum.bootstrap.servers. Outside Kerberos, that list has one entry per controller role group: the role group's headless Service. That Service sets publishNotReadyAddresses: true, so the name also resolves to the starting pod's own IP.

Kafka treats each entry in controller.quorum.bootstrap.servers as one bootstrap node and resolves its name when it connects. If the starting pod's lookup returns its own IP, the connection succeeds, so Kafka never tries another address. The pod asks itself for the leader, gets no answer, and repeats this forever.

This is a race in the quorum management added in #1010.

Symptoms
  • The new controller stays in Raft state unattached (epoch 0) and never becomes an observer. The quorum's replication status doesn't list it at all.
  • Its quorum-manager sidecar logs Local Raft state is 'unattached', nothing to do indefinitely, so it never calls add-controller.
  • The kafka container never becomes ready, and the StatefulSet rollout stalls. Because the StatefulSet uses OrderedReady, later replicas are not created either.
  • The pod's only connections on the controller port go to its own IP.
  • Deleting the pod usually clears it: the replacement resolves another IP and joins normally.
Lingua principale
Rust
Stelle
31
Fork
9
Merge medio
4g 5h
PR unite (30g)
14

Preparare l'ambiente

  • Nessun Dockerfile né file Docker Compose
  • Ha un modello di pull request
  • Nessuna guida per i contributori

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di stackabletech/kafka-operator

Tutte le issue di stackabletech/kafka-operator

Issue simili

Altre issue su Rust

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.