Uniform decompression-budget and corrupt-input handling across all permessage-* extensions
Los mantenedores suelen responder en 1 día
Ya se ha fusionado un pull request relacionado.
- #1987 de @oberstet — fusionado
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 30/100
- Tipo de issue
- Error
- Claridad
- Bien especificado
- Estado de actividad
- Estancado
- Stack tecnológico
- python
- Área
- backend, networking
Línea de trabajo
Start with websocket/protocol.py and onFrameData(), then inspect the four decompress_message_data() implementations and their compression dependency versions. Add unit coverage for the listed budget and corrupt-input cases, plus protocol tests on Twisted and asyncio; run them on CPython and PyPy. Done means all backends enforce the output budget and map decode errors to PayloadCorruptError, with clean connection failures.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Summary
Autobahn supports four WebSocket per-message compression extensions: permessage-deflate (RFC 7692), and the non-standard permessage-bzip2, permessage-brotli and permessage-snappy. All four implement the same internal method:
def decompress_message_data(self, data, max_output_len=None): ...
The receive path (websocket/protocol.py, onFrameData()) passes in the remaining maxMessagePayloadSize budget as max_output_len. The four backends do not handle that budget, or a decode error, the same way. This issue makes their behaviour uniform.
Current behaviour
| Extension | Budget passed to the library? | Over budget | Budget already 0 | Corrupt input |
|---|---|---|---|---|
| deflate | yes (max_length) |
PayloadExceededError |
returns 1 octet, no exception (the protocol's post-inflation check then rejects it) | zlib.error |
| bzip2 | yes (max_length) |
PayloadExceededError |
PayloadExceededError |
OSError |
| brotli | no: decompresses the whole frame, then checks | PayloadExceededError, after decompression |
PayloadExceededError |
brotli.error / brotlicffi.error |
| snappy | no: decompresses the whole frame, then checks | PayloadExceededError, after decompression |
PayloadExceededError |
no exception: the input is buffered and an empty message is returned |
Decode errors are not caught in onFrameData(), so how a connection fails on a corrupt compressed frame depends on the backend and on the networking framework (Twisted or asyncio).
Target behaviour
For every extension, on CPython and PyPy, and on Twisted and asyncio:
- Budget: no backend produces more than
max_output_len + 1octets in one call. "Over budget" and "budget already 0" both raisePayloadExceededError, which is raised before the backend decompresses past the budget, not after.- brotli: use
Decompressor.process(data, output_buffer_limit=...), and raise the floor of thecompressextra tobrotli>=1.2.0(CPython) /brotlicffi>=1.2.0(PyPy), the first versions that have this argument. - snappy: python-snappy's
StreamDecompressor.decompress()has no output limit, so feed the input one framing chunk at a time (at most 64 KiB of output each) and stop at the budget. - deflate: raise
PayloadExceededErroronce the budget is used up, instead of capping the call at 1 octet.
- brotli: use
- Corrupt input: each library's decode error becomes a new
autobahn.exception.PayloadCorruptError. The protocol fails the connection the same way for every backend, on Twisted and asyncio. The snappy backend rejects malformed input instead of buffering it. - Remove or correct the code comments claiming that per-frame decompression is "bounded on the wire by
maxFramePayloadSize".
Tests
- Unit tests for every cell of the table above, on all four backends: over budget in one frame, over budget across two frames, exactly at budget, one octet over, budget already 0, and corrupt input. They must check both the exception type and that the output never exceeds the budget plus one octet.
- Protocol-level tests on Twisted and asyncio: a corrupt compressed frame, and an over-budget compressed message, each fail the connection cleanly with the expected close code.
- Run on CPython and PyPy.
Target
autobahn-python 26.10.1
- Lenguaje dominante
- Python
- Estrellas
- 2.5k
- Forks
- 767
- Merge medio
- 1 d 1 h
- PR fusionados (30 d)
- 23
Preparar el entorno
- Sin Dockerfile ni archivo de Docker Compose
- Tiene una plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de crossbario/autobahn-python
-
CI-CD enhancement
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
crossbario/autobahn-python#1945 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
bug CI-CD
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
crossbario/autobahn-python#1932 ·
Los mantenedores suelen responder en 1 día
-
CI-CD enhancement
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
crossbario/autobahn-python#1829 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
[BUG] extract_peer_certificate() raises AttributeError with pyOpenSSL >= 26.2.0 when the peer certificate has extensionsPosiblemente ocupada @oberstet la tomó hoy. Abiertobug wamp websocket
Dificultad 4/5 3-5 días Aptitud para principiantes 35/100
crossbario/autobahn-python#2014 ·
Los mantenedores suelen responder en 1 día
-
bug CI-CD
Dificultad 4/5 3-5 días Aptitud para principiantes 52/100
crossbario/autobahn-python#2013 ·
Los mantenedores suelen responder en 1 día
Todos los issues de crossbario/autobahn-python
Issues similares
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
-
[Device Support Request] HOBEIAN ZG-204ZL (Tuya PIR motion sensor with illuminance)Posiblemente ocupada @lenucksi la tomó hoy. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
zigpy/zha-device-handlers#5493 ·
Los mantenedores suelen responder en 3 días
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
drevendev/BeautifulRepo#42 ·
Los mantenedores suelen responder en 1 día
-
enhancement good first issue
Dificultad 2/5 1-3 horas Aptitud para principiantes 84/100
writerslogic/holographic-memory#93 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 66/100
antoine-tena/kiln#47 ·
Los mantenedores suelen responder en 1 día