Hacktoberfest 2026: le issue che i maintainer hanno segnato per ottobre, aperte e adatte ai principianti. Sfoglia le issue Hacktoberfest

Retention run never completes against a POSIX-backend S3 gateway (VersityGW) and stalls the sidecar metrics endpoint

Aperta
  • Qualcosa non va?
#1,044 1 commento 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
48/100
Tipo di issue
Bug
Chiarezza
Abbastanza chiara
Stato di attività
Tranquilla
Stack tecnologico
go, postgresql
Ambito
backend, cloud, observability-sre

Direzione di ricerca

Inizia tracciando il runnable di retention attivato dalla cadenza di ObjectStore e l’handler /metrics del sidecar dell’istanza, riproducendo il blocco contro un gateway S3 con backend POSIX. Confronta l’orchestrazione del plugin con il comando funzionante barman-cloud-backup-delete. Il lavoro è completo quando un’esecuzione bloccata va in timeout e rende visibile una condizione ObjectStore senza portare /metrics offline.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

bug

Environment

  • CloudNativePG 1.30.0, plugin-barman-cloud v0.14.0 (sidecar image plugin-barman-cloud-sidecar:v0.14.0)
  • PostgreSQL 18.4 and 17.10 clusters (3 instances each)
  • Object store: VersityGW S3 gateway with the posix backend, plain HTTP endpoint inside the cluster
  • Base backups and WAL archiving against this endpoint work fine (nightly base from standby, continuous WAL, PITR restore drills pass)

What happens

With any retentionPolicy set on the ObjectStore (I used "30d"), the catalog-maintenance/retention run starts on its ~30 minute cadence and never completes. There is no error surfaced anywhere — no failed condition on the ObjectStore, nothing actionable in the sidecar logs — the run just stays stuck, and a new one piles up on the next cadence.

The visible damage is on the metrics side: while a retention run is stuck, the instance sidecar's /metrics endpoint stops responding (scrapes time out; see companion issue about the missing deadline on the metrics path). In practice the exporter for the affected instance goes dark for hours — in my case the primary was unscrapeable for 6.7 hours while PostgreSQL itself was perfectly healthy. That silently blinds exactly the alerts that matter most (WAL-archiver failures, backup staleness), because they key off primary metrics.

Removing retentionPolicy from the ObjectStore stops the recurring wedge immediately.

Why I don't think it's barman itself

Running the equivalent delete manually with the very same endpoint and credentials completes in seconds:

barman-cloud-backup-delete --cloud-provider aws-s3 \
  --endpoint-url http://<versitygw>:7070 \
  --retention-policy "RECOVERY WINDOW OF 30 DAYS" \
  s3://pg-backups/ <cluster-name>

So the hang appears to be in the plugin's runnable orchestration around it, not in the underlying barman operation. Possibly related to #770 (retention not pruning base backups), but the symptom here is a hang + metrics outage rather than a silent no-op.

Expected

  • The retention runnable should have a timeout, and a stuck/failed run should surface as a condition on the ObjectStore instead of hanging silently.
  • A stuck retention run should never be able to take the metrics endpoint down with it.

Current workaround

retentionPolicy removed; retention is done by a monthly manual CronJob running barman-cloud-backup-delete with the same credentials (works reliably). Happy to provide sidecar logs/goroutine dumps from a reproduction if that helps.

Lingua principale
Go
Stelle
200
Fork
82
Merge medio
2g 6h
PR unite (30g)
19

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di cloudnative-pg/plugin-barman-cloud

Tutte le issue di cloudnative-pg/plugin-barman-cloud

Issue simili

Altre issue su Go

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.