Hacktoberfest 2026: los issues que los mantenedores marcaron para octubre, abiertos y aptos para principiantes. Explorar issues de Hacktoberfest

[Bug] PL/Python statement_timeout can leave a zombie subprocess despite finally: wait()

Abierto
  • ¿Algo no está bien?
#2,181 2 comentarios 0 reacciones 1 asignado Ver en GitHub

Los mantenedores suelen responder en 2 días

@krylosov-aa ya está trabajando en esto.

Desde el 24/10/2026.

  • #2185 de @krylosov-aa — abierto

Evaluación

Este issue todavía no se ha evaluado.

Descripción

type: Bug
Apache Cloudberry version

main, probably REL_2_STABLE

What happened

When statement_timeout cancels a PL/Python function waiting in subprocess.Popen.communicate(), the SQL statement can return a cancellation error while its timeout child remains a zombie, despite an explicit process.wait() in a finally block.

The zombie remains a child of the backend after subsequent SQL statements and disappears when the backend session closes. The monitored command itself has already finished.

This was discovered while reviewing #2117, but also reproduces with a harmless sleep command and does not require diskquota or segment recovery.

What you think should happen instead

The exited subprocess should be reaped before the cancellation error is returned to the client.

How to reproduce

The measured runs used coordinator connections with options='-c gp_role=utility' and autocommit enabled.

To reproduce under the same conditions, start an interactive psql session connected to the coordinator. Replace the placeholders with your connection details:

PGOPTIONS='-c gp_role=utility' psql -h <coordinator_host> -p <coordinator_port> -d <database>

Run the following statements with autocommit enabled and without an explicit transaction. Record the value returned by SELECT pg_backend_pid();.

CREATE EXTENSION IF NOT EXISTS plpython3u;

CREATE OR REPLACE FUNCTION public.zombie_repro()
RETURNS void LANGUAGE plpython3u AS $$
import subprocess

p = subprocess.Popen(
    ['timeout', '-k', '1', '5', 'sleep', '0.3'],
    stdout=subprocess.PIPE,
    stderr=subprocess.STDOUT
)
try:
    p.communicate()
finally:
    p.wait()
$$;

SELECT pg_backend_pid();

SET statement_timeout = '100ms';
SELECT public.zombie_repro();

RESET statement_timeout;
SELECT 1;

Keep the psql session open after the timeout error. From another terminal on the coordinator host, inspect the backend’s child processes, replacing <backend_pid> with the recorded PID:

ps -o pid,ppid,stat,comm --ppid <backend_pid>

When the issue reproduces, a timeout process appears with STAT containing Z and PPID matching the backend PID. It persists after subsequent SQL statements and disappears when the session closes.

The result is timing-dependent and does not occur on every invocation. If necessary, repeat the procedure using a fresh connection for each attempt.

Observed reproduction rates:

  • Minimal example above: 16 out of 20 independent backend sessions.
  • Exact pg_recoverseg helper from #2117, invoking real gprecoverseg: 12 out of 20 independent backend sessions.

Every attempt returned SQLSTATE 57014 from the function call. Zombie detection was performed after RESET statement_timeout, a 200 ms delay, and SELECT 1. A separate check confirmed persistence after two seconds and another SELECT 1.

Each attempt closed its connection afterwards, so the counts do not include children left by previous attempts.

Operating System

Any

Anything else

The results above were verified in this environment:

  • Ubuntu 22.04, Linux x86_64.
  • Python 3.10.12.
  • Cloudberry 3.0.0-devel / PostgreSQL 16.9, with assertions enabled.
  • Server source commit: 070d9d33b3bacea45d991f54c100b4bc077c8d58.

Possible cause to investigate: StatementTimeoutHandler signals both the backend process group and the backend PID, while PLy_handle_cancel_interrupt queues KeyboardInterrupt through Py_AddPendingCall. Repeated cancellation may interrupt cleanup. This is a hypothesis, not a confirmed root cause.

Are you willing to submit PR?
  • Yes, I am willing to submit a PR!
Code of Conduct
Lenguaje dominante
C
Estrellas
1.4k
Forks
265
Merge medio
3 d 17 h
PR fusionados (30 d)
68

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de apache/cloudberry

Todos los issues de apache/cloudberry

Issues similares

Más issues de C

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.