HTTP/2 to origin: GOAWAY closes the session at once and aborts streams at or below last_stream_id
Los mantenedores suelen responder en 2 días
@bneradt ya está trabajando en esto.
Desde el 1/10/2026.
Evaluación
Este issue todavía no se ha evaluado.
Descripción
Summary
When an HTTP/2 origin sends GOAWAY, ATS closes the session immediately. That aborts every stream at or below last_stream_id, even though RFC 9113 §6.8 says the peer may still finish them. Graceful drains (GOAWAY NO_ERROR with last_stream_id 2^31-1, or a real last id) therefore fail every request in flight on the connection. Requests with non-idempotent methods aren't retried, so each one goes to the client as 502 with ERR_CONNECT_FAIL.
Cause
Http2ConnectionState::rcv_goaway_frame on master:
this->rx_error_code = {ProxyErrorClass::SSN, static_cast<uint32_t>(goaway.error_code)};
this->session->get_proxy_session()->do_io_close();
- Every stream gets EOS from
Http2Stream::initiating_close. - For a stream still waiting for its response header,
HttpSM::state_read_server_response_headerhandles VC_EVENT_EOS by going tohandle_server_setup_error, thenhandle_post_failurewhen a request body is in flight. - The state ends up
CONNECTION_CLOSED.HttpTransact::is_request_retryablerefuses to retry a non-idempotent method onceserver_request_hdr_bytes > 0, so the client gets a 502.
HTTP/1.1 has no equivalent drain signal, so an HTTP/1.1 POST hit by an abrupt close fails the same way. What's specific to HTTP/2 is that the origin announces it will finish these streams, and ATS throws them away.
Observed
On a 10.0.x build with HTTP/2 to origin enabled. rcv_goaway_frame closes the same way on master.
502 ERR_CONNECT_FAILwith origin status000and zero retries, almost only on POST, PROPFIND, PUT, REPORT and DELETE.- It comes in bursts: 183 requests across several origin sessions ended within the same 100 ms, while other sessions to the same origin kept returning 200.
proxy.process.http2.session_die_defaulttracksproxy.process.http2.goaway_frames_inalmost one-for-one (1,469 / 1,468 on one host). Both counters include client sessions as well as origin sessions.- Over HTTP/2 the sessions are long-lived and heavily multiplexed (thousands of transactions per session), so one drain fails dozens of requests at once.
- A build without HTTP/2 session reuse in the same site and window, where each connection carried only a few requests, had 0 failures where about 5 were expected.
We haven't yet confirmed from a packet capture that every burst was a GOAWAY rather than a TCP close, but the handler behaves as described whichever it was.
Suggested fix
On GOAWAY from an origin:
- Mark the session as draining and take it out of the session pool, so no new streams go on it.
- Reset streams with id >
last_stream_idand make them retryable (they were never processed). - Let streams at or below
last_stream_idrun to completion, and close the session once the active stream count reaches 0 or a drain timeout passes.
The inbound (client) GOAWAY path could follow the same approach.
Related, and may be worth its own issue: ATS keeps opening new streams on an origin session that has answered nothing for many seconds. In the bursts above, sessions silent for about 16 s were still taking new streams until about 300 ms before they closed. A PING-based liveness check would limit how many requests one stalled session can take down.
- Lenguaje dominante
- C++
- Estrellas
- 2k
- Forks
- 878
- Merge medio
- 3 d 15 h
- PR fusionados (30 d)
- 94
Preparar el entorno
- Sin Dockerfile ni archivo de Docker Compose
- Sin plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de apache/trafficserver
-
Bug HTTP Support
Dificultad 2/5 1-3 horas Aptitud para principiantes 74/100
apache/trafficserver#13118 ·
Los mantenedores suelen responder en 2 días
-
traffic_ctl: apply --error-level to config reload resultsPosiblemente ocupada @brbzull0 la tomó hoy. Abierto
apache/trafficserver#13832 · 1 asignado ·
Los mantenedores suelen responder en 2 días
-
header_rewrite: rm-destination after set-destination URL crashes traffic_serverPosiblemente ocupada @moonchen la tomó hace 8 días. AbiertoBug Crash header_rewrite Plugins
apache/trafficserver#13800 · 1 asignado ·
Los mantenedores suelen responder en 2 días
-
Dificultad 4/5 3-5 días Aptitud para principiantes 48/100
apache/trafficserver#13798 ·
Los mantenedores suelen responder en 2 días
-
Dificultad 4/5 3-5 días Aptitud para principiantes 48/100
apache/trafficserver#13784 ·
Los mantenedores suelen responder en 2 días
Todos los issues de apache/trafficserver
Issues similares
-
nth_root does not restore the rounding mode and can return an upper bound below the true rootAbierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
-
1 type: problem 2 scope: firmware 3 good first issue
Dificultad 2/5 1-3 horas Aptitud para principiantes 65/100
SpaceTeam/STS1_COBC_SW#511 ·
-
documentation good first issue
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
imaaiagent/fumi#3 ·
-
[Performance]: Beam search re-materializes Result.output_token_ids from pybind once per beamAbiertoGeneral perf
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
NVIDIA/TensorRT-LLM#20236 ·
Los mantenedores suelen responder en 1 día
-
bug
Dificultad 1/5 Menos de una hora Aptitud para principiantes 88/100
E3SM-Project/mam4xx#603 ·
Los mantenedores suelen responder en 1 día