asyncio: DPY-4011 on connect_async() when the listener closes the original socket after a redirect
Évaluation
- Difficulté
- 3/5
- Temps estimé
- 1-2 jours
- Accessibilité débutants
- 35/100
Piste de recherche
Start with BaseAsyncProtocol._connect_tcp() and BaseAsyncProtocol.connection_lost() in the asyncio protocol implementation; the report identifies the unguarded waiter handling when the old redirected transport closes. Run the supplied fake-listener reproducer, which needs no database, and verify that the redirected connection waits until the 3-second timeout rather than failing early with DPY-4011. Pull request #617 is already open with a proposed fix.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Description
- What versions are you using?
- Oracle Database 19.28.0.0.0 (RAC, the listener redirects every connection to another address)
- python-oracledb 26.0.1 (Thin mode). Also reproduced with a build of
main. platform.platform: Linux-6.18.40.1-microsoft-standard-WSL2-x86_64-with-glibc2.39sys.maxsize > 2**32: Trueplatform.python_version: 3.14.3(same result with 3.13.2)
- Is it an error or a hang or a crash?
An error.
- What error(s) or behavior you are seeing?
oracledb.connect_async() and oracledb.create_pool_async() always fail with
oracledb.exceptions.DatabaseError: DPY-4011: the database or network closed the connection
about 0.3 seconds after the connect starts. oracledb.connect() with the same parameters works, with or without disable_oob=True and with either server_type.
With PYO_DEBUG_PACKETS the sync and async traces are the same up to the second authorization request. The async trace ends there:
Sending request authorization [op 17] on socket 7
Disconnecting transport [op 18] on socket 7
Wrapping the protocol passed to loop.create_connection() shows that the socket that gets closed is not the one in use (addresses replaced):
[0.050s] fd 6 connected to LISTENER:1521
[0.092s] fd 6 received 378 bytes <- redirect
[0.134s] fd 7 connected to NODE:1521
[0.176s] fd 7 received 8 bytes
[0.217s] fd 7 received 45 bytes <- accept
[0.259s] fd 7 received 191 bytes
[0.302s] fd 7 received 2717 bytes
[0.344s] fd 7 received 371 bytes <- auth phase one response
[0.376s] fd 6 EOF received from LISTENER:1521
[0.376s] fd 6 connection_lost exc=None
[0.376s] DPY-4011: the database or network closed the connection
[0.376s] fd 7 connection_lost exc=None <- closed by the driver after the error
Cause
After a redirect the driver opens a second transport using the same protocol object (lambda: self in BaseAsyncProtocol._connect_tcp()), and the transport to the listener is left open. In this environment the listener closes its side roughly 0.3 seconds later, while the driver is waiting for a packet on the new transport. BaseAsyncProtocol.connection_lost() is then called for the old transport:
def connection_lost(self, exc):
if not self._in_connect:
...
if self._read_buf._waiter is not None \
and not self._read_buf._waiter.done():
error = errors._create_err(errors.ERR_CONNECTION_CLOSED)
self._read_buf._waiter.set_exception(error.exc_type(error))
The first block is skipped because _in_connect is set, as the docstring intends ("losing the connection is ignored since this can happen normally when a listener redirect is encountered"). The second block is not guarded, so the pending wait on the healthy transport is failed with DPY-4011. When the listener closes its socket before the driver starts waiting on the new transport there is no pending waiter, which is presumably why this is not seen everywhere.
The unguarded block is already present in 3.4.2 and 4.0.0, so this is not new in 26.x.
- Does your application call init_oracle_client()?
No. Thin mode.
- Include a runnable Python script that shows the problem.
No database is needed. A fake listener answers the CONNECT packet with a REDIRECT and closes its socket 0.3 seconds later; the redirected server accepts the TCP connection and stays silent. The driver should keep waiting on the redirected connection until the 3 second timeout.
"""
Reproduces DPY-4011 with asyncio and a listener redirect, without a database.
A fake listener answers the CONNECT packet with a REDIRECT to a second server
and closes its own socket only 0.3 seconds later. The second server accepts the
TCP connection and stays silent, so the driver should keep waiting on it until
the 3 second timeout below expires.
"""
import asyncio
import struct
import time
import oracledb
LISTENER_CLOSE_DELAY = 0.3
async def main():
async def redirected_server(reader, writer):
await reader.read() # never answers; waits for the client to give up
writer.close()
target = await asyncio.start_server(redirected_server, "127.0.0.1", 0)
target_port = target.sockets[0].getsockname()[1]
async def listener(reader, writer):
await reader.read(8192) # CONNECT packet
data = (
f"(ADDRESS=(PROTOCOL=TCP)(HOST=127.0.0.1)(PORT={target_port}))"
"\x00(DESCRIPTION=(CONNECT_DATA=(SERVICE_NAME=svc)))"
).encode()
# REDIRECT packet (type 5) followed by a DATA packet (type 6) with
# the redirect data, as sent by an Oracle Database 19c listener
writer.write(struct.pack(">HHBBHH", 10, 0, 5, 0, 0, len(data)))
writer.write(
struct.pack(">HHBBHH", 10 + len(data), 0, 6, 0, 0, 0) + data
)
await writer.drain()
await asyncio.sleep(LISTENER_CLOSE_DELAY)
writer.close() # the listener closes its side late
server = await asyncio.start_server(listener, "127.0.0.1", 0)
listener_port = server.sockets[0].getsockname()[1]
start = time.monotonic()
try:
await asyncio.wait_for(
oracledb.connect_async(
user="u",
password="p",
dsn=f"127.0.0.1:{listener_port}/svc",
retry_count=0,
),
3,
)
except asyncio.TimeoutError:
print(
f"{oracledb.__version__}: OK - still waiting on the redirected "
f"connection after {time.monotonic() - start:.1f}s"
)
except oracledb.Error as e:
print(
f"{oracledb.__version__}: BUG - failed after "
f"{time.monotonic() - start:.1f}s: {e.__cause__ or e}"
)
server.close()
target.close()
asyncio.run(main())
Output with 26.0.1:
26.0.1: BUG - failed after 0.3s: DPY-4011: the database or network closed the connection
Output with the fix proposed in the linked pull request:
26.1.0b1: OK - still waiting on the redirected connection after 3.0s
- Langage dominant
- Python
- Étoiles
- 456
- Forks
- 119
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Préparer son environnement
- Aucun Dockerfile ni fichier Docker Compose
- Propose un modèle de pull request
- Lire le guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de oracle/python-oracledb
-
Thin mode: ORA-01483 for string binds of 2731-8191 bytes on a database with the UTF8 character setOuverte
Difficulté 4/5 3-5 jours Accessibilité débutants 45/100
oracle/python-oracledb#627 · 1 commentaire ·
-
Difficulté 3/5 1-2 jours Accessibilité débutants 75/100
oracle/python-oracledb#626 ·
-
bug
Difficulté 4/5 3-5 jours Accessibilité débutants 48/100
oracle/python-oracledb#625 ·
-
bug
Difficulté 4/5 1-2 jours Accessibilité débutants 45/100
oracle/python-oracledb#624 ·
-
Difficulté 4/5 3-5 jours Accessibilité débutants 48/100
oracle/python-oracledb#623 ·
Toutes les issues de oracle/python-oracledb
Issues similaires
-
area:scripts area:tests bug priority:later
Difficulté 2/5 1-3 heures Accessibilité débutants 72/100
Ikalus1988/MisakaNet#4358 ·
Les mainteneurs répondent en général sous 1 jour
-
Discovered ports from service discovery are never propagated to modules in Module.load()Peut-être pris @vishalmore90 l’a pris aujourd’hui. Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 70/100
OWASP/Nettacker#1828 · 1 commentaire ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 1/5 Moins d'une heure Accessibilité débutants 88/100
aws-samples/sample-per-model-bedrock#708 ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
-
[Performance] Bound resolve_api_hashes raw fallback reads to the 1 MiB region actually scannedOuverte
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
sjkim1127/Reversecore_MCP#365 ·
Les mainteneurs répondent en général sous 1 jour