Issues when using databricks-sql-connector==4.6.0
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 64/100
Research direction
Reproduce the failure with databricks-sqlalchemy 2.0.10, alembic 1.8.4, and databricks-sql-connector 4.6.0, then compare it with connector 4.2.6. Start by reading databricks/sqlalchemy/base.py and databricks/sqlalchemy/_parse.py, especially the result handling shown in the traceback. Done means schema migrations complete successfully with connector 4.6.0.
Written by the indexing model from the issue text.
Description
Hello there,
I am using databricks-sqlalchemy (2.0.10) in combination with alembic (1.8.4) in a CI/CD pipeline to automate schema migrations.
When our pipeline suddenly stopped working, i found out after some debugging, that alembic fails with an error message (see below) when using databricks-sql-connector==4.6.0. After pinning the sql connector to databricks-sql-connector==4.2.6 (the version it works with from my local machine), the migrations ran through again.
The corresponding part of my CI/CD pipeline log:
File "/agent/_work/1/s/.venv/lib/python3.14/site-packages/databricks/sqlalchemy/base.py", line 382, in has_table
self._describe_table_extended(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
connection=connection,
^^^^^^^^^^^^^^^^^^^^^^
...<2 lines>...
schema_name=schema,
^^^^^^^^^^^^^^^^^^^
)
^
File "/agent/_work/1/s/.venv/lib/python3.14/site-packages/databricks/sqlalchemy/base.py", line 208, in _describe_table_extended
fmt_result = _describe_table_extended_result_to_dict_list(result)
File "/agent/_work/1/s/.venv/lib/python3.14/site-packages/databricks/sqlalchemy/_parse.py", line 40, in _describe_table_extended_result_to_dict_list
for row in result.all():
~~~~~~~~~~^^
File "/agent/_work/1/s/.venv/lib/python3.14/site-packages/sqlalchemy/engine/result.py", line 987, in all
return self._allrows()
~~~~~~~~~~~~~^^
File "lib/sqlalchemy/engine/_result_cy.py", line 366, in sqlalchemy.engine._result_cy.BaseResultInternal._allrows
File "lib/sqlalchemy/engine/_result_cy.py", line 201, in sqlalchemy.engine._result_cy.BaseResultInternal._row_getter.many_rows_simple
File "lib/sqlalchemy/engine/_row_cy.py", line 72, in sqlalchemy.engine._row_cy.BaseRow.__init__
TypeError: Expected tuple, got Row
Cheers,
Thomas
- Dominant language
- Python
- Stars
- 24
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from databricks/databricks-sqlalchemy
-
`TIMESTAMP`, `TIMESTAMP_NTZ`, `TINYINT` and the other `TypeDecorator`s don't declare `python_type`Open
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
get_columns() missing @reflection.cache causes a warehouse round-trip on every reflection callPossibly taken @TangoEnSkai claimed this 55 days ago. Open
Difficulty 1/5 Under an hour Newbie friendliness 92/100
-
get_foreign_keys() missing @reflection.cache causes excessive DESCRIBE TABLE EXTENDED queriesPossibly taken @TangoEnSkai claimed this 55 days ago. Open
Difficulty 1/5 Under an hour Newbie friendliness 90/100
-
TypeError when using Enum columns with the Databricks dialect (all 2.0.x releases)Possibly taken @TangoEnSkai claimed this 55 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
-
Unable to insert Python lists into ARRAY<STRING> columns using pandas to_sqlPossibly taken @aminghadersohi claimed this 21 days ago. Open
Difficulty 4/5 3-5 days Newbie friendliness 48/100
databricks/databricks-sqlalchemy#73 · 1 comment ·
All issues in databricks/databricks-sqlalchemy
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
lidofinance/diffyscan#239 ·
Maintainers usually reply within 1 day
-
docs: the dev-setup table and AGENTS.md name the reviewed_by guard that CI's Changelog job runsOpenarea: tools documentation good first issue ready for a contributor
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
eyalgolan/statecraft-israel#873 · 1 comment ·
Maintainers usually reply within 1 day
-
GET rooms API returns 500 due to nonexistent Room.is_active attributePossibly taken @Mars-60 claimed this today. Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 5 days
-
Harmony OPeNDAP SubSetter (HOSS) Geographic production rssmif16d 7 XYZ_PROV
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
nasa/harmony-autotester#341 ·