asyncio: DPY-4011 on connect_async() when the listener closes the original socket after a redirect
Valutazione
- Difficoltà
- 3/5
- Tempo stimato
- 1-2 giorni
- Idoneità per principianti
- 35/100
Direzione di ricerca
Start with BaseAsyncProtocol._connect_tcp() and BaseAsyncProtocol.connection_lost() in the asyncio protocol implementation; the report identifies the unguarded waiter handling when the old redirected transport closes. Run the supplied fake-listener reproducer, which needs no database, and verify that the redirected connection waits until the 3-second timeout rather than failing early with DPY-4011. Pull request #617 is already open with a proposed fix.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
- What versions are you using?
- Oracle Database 19.28.0.0.0 (RAC, the listener redirects every connection to another address)
- python-oracledb 26.0.1 (Thin mode). Also reproduced with a build of
main. platform.platform: Linux-6.18.40.1-microsoft-standard-WSL2-x86_64-with-glibc2.39sys.maxsize > 2**32: Trueplatform.python_version: 3.14.3(same result with 3.13.2)
- Is it an error or a hang or a crash?
An error.
- What error(s) or behavior you are seeing?
oracledb.connect_async() and oracledb.create_pool_async() always fail with
oracledb.exceptions.DatabaseError: DPY-4011: the database or network closed the connection
about 0.3 seconds after the connect starts. oracledb.connect() with the same parameters works, with or without disable_oob=True and with either server_type.
With PYO_DEBUG_PACKETS the sync and async traces are the same up to the second authorization request. The async trace ends there:
Sending request authorization [op 17] on socket 7
Disconnecting transport [op 18] on socket 7
Wrapping the protocol passed to loop.create_connection() shows that the socket that gets closed is not the one in use (addresses replaced):
[0.050s] fd 6 connected to LISTENER:1521
[0.092s] fd 6 received 378 bytes <- redirect
[0.134s] fd 7 connected to NODE:1521
[0.176s] fd 7 received 8 bytes
[0.217s] fd 7 received 45 bytes <- accept
[0.259s] fd 7 received 191 bytes
[0.302s] fd 7 received 2717 bytes
[0.344s] fd 7 received 371 bytes <- auth phase one response
[0.376s] fd 6 EOF received from LISTENER:1521
[0.376s] fd 6 connection_lost exc=None
[0.376s] DPY-4011: the database or network closed the connection
[0.376s] fd 7 connection_lost exc=None <- closed by the driver after the error
Cause
After a redirect the driver opens a second transport using the same protocol object (lambda: self in BaseAsyncProtocol._connect_tcp()), and the transport to the listener is left open. In this environment the listener closes its side roughly 0.3 seconds later, while the driver is waiting for a packet on the new transport. BaseAsyncProtocol.connection_lost() is then called for the old transport:
def connection_lost(self, exc):
if not self._in_connect:
...
if self._read_buf._waiter is not None \
and not self._read_buf._waiter.done():
error = errors._create_err(errors.ERR_CONNECTION_CLOSED)
self._read_buf._waiter.set_exception(error.exc_type(error))
The first block is skipped because _in_connect is set, as the docstring intends ("losing the connection is ignored since this can happen normally when a listener redirect is encountered"). The second block is not guarded, so the pending wait on the healthy transport is failed with DPY-4011. When the listener closes its socket before the driver starts waiting on the new transport there is no pending waiter, which is presumably why this is not seen everywhere.
The unguarded block is already present in 3.4.2 and 4.0.0, so this is not new in 26.x.
- Does your application call init_oracle_client()?
No. Thin mode.
- Include a runnable Python script that shows the problem.
No database is needed. A fake listener answers the CONNECT packet with a REDIRECT and closes its socket 0.3 seconds later; the redirected server accepts the TCP connection and stays silent. The driver should keep waiting on the redirected connection until the 3 second timeout.
"""
Reproduces DPY-4011 with asyncio and a listener redirect, without a database.
A fake listener answers the CONNECT packet with a REDIRECT to a second server
and closes its own socket only 0.3 seconds later. The second server accepts the
TCP connection and stays silent, so the driver should keep waiting on it until
the 3 second timeout below expires.
"""
import asyncio
import struct
import time
import oracledb
LISTENER_CLOSE_DELAY = 0.3
async def main():
async def redirected_server(reader, writer):
await reader.read() # never answers; waits for the client to give up
writer.close()
target = await asyncio.start_server(redirected_server, "127.0.0.1", 0)
target_port = target.sockets[0].getsockname()[1]
async def listener(reader, writer):
await reader.read(8192) # CONNECT packet
data = (
f"(ADDRESS=(PROTOCOL=TCP)(HOST=127.0.0.1)(PORT={target_port}))"
"\x00(DESCRIPTION=(CONNECT_DATA=(SERVICE_NAME=svc)))"
).encode()
# REDIRECT packet (type 5) followed by a DATA packet (type 6) with
# the redirect data, as sent by an Oracle Database 19c listener
writer.write(struct.pack(">HHBBHH", 10, 0, 5, 0, 0, len(data)))
writer.write(
struct.pack(">HHBBHH", 10 + len(data), 0, 6, 0, 0, 0) + data
)
await writer.drain()
await asyncio.sleep(LISTENER_CLOSE_DELAY)
writer.close() # the listener closes its side late
server = await asyncio.start_server(listener, "127.0.0.1", 0)
listener_port = server.sockets[0].getsockname()[1]
start = time.monotonic()
try:
await asyncio.wait_for(
oracledb.connect_async(
user="u",
password="p",
dsn=f"127.0.0.1:{listener_port}/svc",
retry_count=0,
),
3,
)
except asyncio.TimeoutError:
print(
f"{oracledb.__version__}: OK - still waiting on the redirected "
f"connection after {time.monotonic() - start:.1f}s"
)
except oracledb.Error as e:
print(
f"{oracledb.__version__}: BUG - failed after "
f"{time.monotonic() - start:.1f}s: {e.__cause__ or e}"
)
server.close()
target.close()
asyncio.run(main())
Output with 26.0.1:
26.0.1: BUG - failed after 0.3s: DPY-4011: the database or network closed the connection
Output with the fix proposed in the linked pull request:
26.1.0b1: OK - still waiting on the redirected connection after 3.0s
- Lingua principale
- Python
- Stelle
- 455
- Fork
- 119
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Preparare l'ambiente
- Nessun Dockerfile né file Docker Compose
- Ha un modello di pull request
- Leggi la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di oracle/python-oracledb
-
Client Library or Database
Difficoltà 4/5 3-5 giorni Idoneità per principianti 25/100
oracle/python-oracledb#620 · 2 commenti ·
-
Difficoltà 4/5 3-5 giorni Idoneità per principianti 42/100
oracle/python-oracledb#619 ·
-
bug
Difficoltà 4/5 3-5 giorni Idoneità per principianti 48/100
oracle/python-oracledb#615 ·
-
Fetch character columns as raw bytes in the database character set into data frames (Thick mode)Apertaenhancement
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
oracle/python-oracledb#614 · 1 commento ·
-
Client Library or Database
Difficoltà 4/5 3-5 giorni Idoneità per principianti 35/100
oracle/python-oracledb#613 · 3 commenti ·
Tutte le issue di oracle/python-oracledb
Issue simili
-
`burr` fails to start when the Python path has a space in itForse già presa @enekoreto l’ha presa oggi. Apertastatus/needs-triage
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
I maintainer di solito rispondono entro 5 giorni
-
gemini 出现了新的域名需要加入Aperta
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 72/100
-
Difficoltà 2/5 Mezza giornata Idoneità per principianti 72/100
debpalash/VoiceStudio#2903 ·
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
dagster-io/community-integrations#367 ·
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 74/100
aws-samples/sample-per-model-bedrock#243 ·
I maintainer di solito rispondono entro 1 giorno