Potential bug: SIGSEGV in Thin-mode AsyncConnection.fetch_df_batches() for VARCHAR2 + TIMESTAMP result; synchronous dataframe fetch succeeds
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Idoneità per principianti
- 20/100
Direzione di ricerca
The crash occurs in the thin-mode async dataframe fetch path, specifically in AsyncConnection.fetch_df_batches() when a VARCHAR2 column is followed by a TIMESTAMP column. Start by examining the async dataframe fetching implementation in the oracledb source, focusing on type conversion and memory management. Reproduce the crash using the provided script to understand the exact point of failure, then compare with the synchronous fetch path to identify differences.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
1. Versions
-
python-oracledb: 26.0.1
-
Mode: Thin
-
Python: 3.14.7
-
PyArrow: 25.0.1
-
Platform: Linux 7.0.0-29-generic x86_64, glibc 2.41
-
64-bit Python: yes
-
OS family used by the application: Debian 13 or newer
-
init_oracle_client()is not called
2. Is this an error, hang, or crash?
Crash: the Python interpreter terminates with SIGSEGV, normally with exit
status 139.
No Python exception is raised.
3. Behavior
Thin-mode AsyncConnection.fetch_df_batches() segfaults while fetching a
result containing a VARCHAR2 column followed by a TIMESTAMP(6) column.
The crash occurs while advancing the async dataframe iterator, before the
returned object is converted with pyarrow.table().
The equivalent synchronous Connection.fetch_df_batches() call succeeds and
returns all rows.
Ordinary row fetching with AsyncCursor.fetchmany() also succeeds.
The two source columns are described as:
STATEMENTKEY:
type_code=DB_TYPE_VARCHAR
display_size=30
internal_size=30
precision=None
scale=None
null_ok=False
WRITETIME:
type_code=DB_TYPE_TIMESTAMP
display_size=23
internal_size=None
precision=0
scale=6
null_ok=True
For a representative 1,000-row result:
all 1,000 VARCHAR2 values are non-null;
all 1,000 TIMESTAMP values are non-null;
the VARCHAR2 column contains one distinct/repeated value;
the TIMESTAMP column contains 1,000 distinct values.
Isolation results:
Query shape
Async dataframe fetch
VARCHAR2 only
succeeds
NUMBER only
succeeds
TIMESTAMP only
succeeds
VARCHAR2 + NUMBER
succeeds
NUMBER + TIMESTAMP
succeeds
VARCHAR2 + TIMESTAMP
SIGSEGV
VARCHAR2 + CAST(TIMESTAMP AS TIMESTAMP(6))
succeeds in the reduced test
Same VARCHAR2 + TIMESTAMP query using synchronous Connection.fetch_df_batches()
succeeds
A synthetic DUAL CONNECT BY query with a repeated VARCHAR2 value and generated
TIMESTAMP values did not reproduce the crash. It may therefore depend on
additional result metadata or the exact encoded values.
This appears related to, but different from, issue #597:
the VARCHAR2 column has a defined internal_size of 30;
the failure was isolated to AsyncConnection.fetch_df_batches();
synchronous Connection.fetch_df_batches() succeeds.
4. Reproducer using an existing table
The following reproduces consistently against the affected view. The object and
column names below are anonymized, but the reported Oracle data types and
metadata are unchanged.
import asyncio
import faulthandler
import oracledb
import pyarrow as pa
faulthandler.enable()
USER = "..."
PASSWORD = "..."
DSN = "host:1521/service"
SQL = """
select varchar_key, timestamp_value
from affected_view
where rownum <= 1000
"""
async def reproduce_async():
async with oracledb.connect_async(
user=USER,
password=PASSWORD,
dsn=DSN,
) as connection:
batches = connection.fetch_df_batches(
statement=SQL,
size=1000,
fetch_decimals=True,
)
iterator = aiter(batches)
print("before async fetch", flush=True)
# The interpreter segfaults during this await. The next print is not
# reached, and pyarrow.table() is not involved in the crash.
oracle_dataframe = await anext(iterator)
print("after async fetch", flush=True)
table = pa.table(oracle_dataframe)
print(table.schema)
asyncio.run(reproduce_async())
Equivalent synchronous control:
import oracledb
import pyarrow as pa
with oracledb.connect(
user=USER,
password=PASSWORD,
dsn=DSN,
) as connection:
for oracle_dataframe in connection.fetch_df_batches(
statement=SQL,
size=1000,
fetch_decimals=True,
):
table = pa.table(oracle_dataframe)
print(table.schema, table.num_rows)
The synchronous control completes successfully.
Ordinary async row-fetch control:
import asyncio
import oracledb
async def row_fetch_control():
async with oracledb.connect_async(
user=USER,
password=PASSWORD,
dsn=DSN,
) as connection:
async with connection.cursor() as cursor:
cursor.arraysize = 1000
cursor.prefetchrows = 1000
await cursor.execute(SQL)
rows = await cursor.fetchmany(1000)
print(len(rows))
asyncio.run(row_fetch_control())
This also completes successfully.
5. Requested-schema behavior
The async crash was also observed in the application when passing a PyArrow
requested_schema, for example:
schema = pa.schema([
("VARCHAR_KEY", pa.string()),
("TIMESTAMP_VALUE", pa.timestamp("us")),
])
async for oracle_dataframe in connection.fetch_df_batches(
statement=SQL,
size=1000,
fetch_decimals=True,
requested_schema=schema,
):
table = pa.table(oracle_dataframe)
The crash still occurs while fetching, before the pa.table() call.
6. Expected behavior
AsyncConnection.fetch_df_batches() should return the same dataframe values as
the successful synchronous dataframe fetch, or raise a Python exception if the
result cannot be represented.
It should not terminate the interpreter.
- Lingua principale
- Python
- Stelle
- 451
- Fork
- 118
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Guida per i contributori
Apri la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di oracle/python-oracledb
-
fetch_df_batches() segfaults with fetch_decimals=True and repeated NUMBER values across batches Apertabug
Difficoltà 4/5 3-5 giorni Idoneità per principianti 45/100
oracle/python-oracledb#608 · 1 commento ·
-
bug
Difficoltà 4/5 3-5 giorni Idoneità per principianti 48/100
oracle/python-oracledb#592 · 6 commenti · 1 reazione ·
-
enhancement
Difficoltà 4/5 3-5 giorni Idoneità per principianti 35/100
oracle/python-oracledb#564 ·
-
bug
Difficoltà 4/5 3-5 giorni Idoneità per principianti 45/100
oracle/python-oracledb#502 · 5 commenti ·
-
bug Client Library or Database
Difficoltà 4/5 3-5 giorni Idoneità per principianti 45/100
oracle/python-oracledb#422 · 1 commento ·
Tutte le issue di oracle/python-oracledb
Issue simili
-
bug
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
stephrobert/dsoxlab#238 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
sublimehq/package_control#1780 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 65/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
nwg-piotr/nwg-displays#145 ·