bulkcopy_arrow() / bulkcopy()` broken in 1.16.0
Mantenedores costumam responder em até 1 dia
Avaliação
- Dificuldade
- 3/5
- Tempo estimado
- Meio dia
- Facilidade para iniciantes
- 72/100
Direção de pesquisa
Start by reading mssql_python/cursor.py at the bulkcopy_arrow() implementation and trace how it imports and uses mssql_py_core; inspect the corresponding bulkcopy() path too. Reproduce the reported import behavior with the 1.16.0 Windows package and check where the connection classes are exposed. Done when both bulk copy methods can access the connection class after a clean 1.16.0 install.
Escrita pelo modelo de indexação a partir do texto da issue.
Descrição
Title
bulkcopy_arrow() / bulkcopy() broken in 1.16.0: AttributeError: module 'mssql_py_core' has no attribute 'PyCoreConnection'
Description
After upgrading from 1.15.0 to 1.16.0, any call to cursor.bulkcopy_arrow(...) (and presumably cursor.bulkcopy(...), which shares the same pycore connection path) fails immediately with:
AttributeError: module 'mssql_py_core' has no attribute 'PyCoreConnection'
Full traceback:
File ".../site-packages/mssql_python/cursor.py", line 3764, in bulkcopy_arrow
pycore_connection = mssql_py_core.PyCoreConnection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'mssql_py_core' has no attribute 'PyCoreConnection'
This reproduces on a clean pip install mssql-python==1.16.0 with no other code changes — the exact same script works correctly against 1.15.0.
Root cause
This looks like a packaging regression from the 1.16.0 change that split the Rust runtime out into a separate version-matched mssql-python-rs package (per the 1.16.0 release notes).
On Windows, after pip install mssql-python==1.16.0, the compiled extension lands at:
site-packages/mssql_py_core/mssql_py_core.pyd
There is no __init__.py inside site-packages/mssql_py_core/. As a result, import mssql_py_core resolves to an empty implicit namespace package (PEP 420) rather than loading the compiled extension — so mssql_py_core.PyCoreConnection doesn't exist at that path.
The compiled extension itself is fine and fully functional — it just needs to be imported one level deeper:
import mssql_py_core.mssql_py_core as core
print([a for a in dir(core) if "Connection" in a])
# -> ['PyAsyncConnection', 'PyCoreConnection']
But mssql_python/cursor.py's bulkcopy_arrow (and likely bulkcopy) does a plain top-level import mssql_py_core and then calls mssql_py_core.PyCoreConnection(...) directly, which hits the empty namespace package instead of the real module.
Likely fix: either (a) add an __init__.py to the mssql_py_core package in the mssql-python-rs wheel that re-exports from the nested mssql_py_core.mssql_py_core extension module, or (b) update mssql-python's internal imports to reference mssql_py_core.mssql_py_core explicitly.
Environment
mssql-python: 1.16.0 (regression; works correctly on 1.15.0)mssql-python-rs: 0.3.0mssql-python-odbc: 18.6.2.2- Python: 3.11.0
- OS: Windows 10/11 (
Windows-10-10.0.26200-SP0), x86_64 - Install method:
pip install mssql-python==1.16.0(clean upgrade from 1.15.0 in an existing venv)
Reproduction steps
pip install mssql-python==1.16.0
python -c "
import mssql_python
cn = mssql_python.connect('SERVER=...;DATABASE=...;Trusted_Connection=yes;')
cur = cn.cursor()
cur.bulkcopy_arrow('some_table', some_pyarrow_record_batch_reader)
"
Minimal repro of the underlying import issue (no SQL Server connection needed):
import mssql_py_core
print(mssql_py_core.__file__) # None -- confirms empty namespace package
print(hasattr(mssql_py_core, "PyCoreConnection")) # False
import mssql_py_core.mssql_py_core as core
print(core.__file__) # points to the real .pyd
print(hasattr(core, "PyCoreConnection")) # True
Expected behavior
import mssql_py_core should expose PyCoreConnection (and PyAsyncConnection) at the top level, as it presumably did before the 1.16.0 packaging split, so bulkcopy_arrow()/bulkcopy() work without modification.
Actual behavior
bulkcopy_arrow() / bulkcopy() are completely broken on 1.16.0 for Windows installs via pip, with no workaround short of pinning back to 1.15.0.
Impact
This blocks all bulk-copy / Arrow bulk-load workflows on 1.16.0. We've rolled back to 1.15.0 in the meantime.
- Linguagem predominante
- Python
- Estrelas
- 479
- Forks
- 62
- Merge médio
- 2d 16h
- PRs com merge (30d)
- 15
Preparar o ambiente
Inicia o contêiner de desenvolvimento do projeto no navegador, com a sua própria conta do GitHub.
- Sem Dockerfile nem arquivo Docker Compose
- Tem um modelo de pull request
- Ler o guia de contribuição
Primeiros passos
- Leia a issue inteira e depois o guia de contribuição do projeto.
- Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
- Faça um fork do repositório e trabalhe em uma branch.
- Abra um pull request que referencie o número da issue.
Mais de microsoft/mssql-python
-
triage needed
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 82/100
microsoft/mssql-python#863 · 1 comentário ·
Mantenedores costumam responder em até 1 dia
-
triage needed
Dificuldade 4/5 3-5 dias Facilidade para iniciantes 48/100
microsoft/mssql-python#862 · 2 comentários ·
Mantenedores costumam responder em até 1 dia
-
Pooled connection checkout has no timeout: connect() hangs ~16 min on a dead socketTalvez já em andamento @jahnvi480 assumiu há 3 dias. Abertaarea: connectivity-auth bug inADO triage done under development
Dificuldade 4/5 3-5 dias Facilidade para iniciantes 48/100
microsoft/mssql-python#854 · 3 comentários · 1 responsável ·
Mantenedores costumam responder em até 1 dia
-
triage needed
Dificuldade 5/5 Mais de uma semana Facilidade para iniciantes 38/100
microsoft/mssql-python#850 · 2 comentários · 1 reação ·
Mantenedores costumam responder em até 1 dia
-
bulkcopy() & bulkcopy_arrow() fail with Schannel AcquireCredentialsHandleW error 0x8009030D (SEC_E_UNKNOWN_CREDENTIALS)Talvez já em andamento @jahnvi480 assumiu há 5 dias. Abertaarea: bulk-copy bug inADO triage done
Dificuldade 4/5 3-5 dias Facilidade para iniciantes 20/100
microsoft/mssql-python#848 · 5 comentários · 1 responsável ·
Mantenedores costumam responder em até 1 dia
Todas as issues de microsoft/mssql-python
Issues semelhantes
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 68/100
Arekkazu/sgpmp-backend#744 ·
Mantenedores costumam responder em até 1 dia
-
Review backlog (security): master-branch remote guard trusts unbound provenance package fieldAbertaagent/reviewer
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 78/100
projectbluefin/utah-packages#634 ·
Mantenedores costumam responder em até 1 dia
-
enhancement good first issue help wanted
Dificuldade 2/5 1-2 dias Facilidade para iniciantes 78/100
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 68/100
home-assistant/core#188613 ·
Mantenedores costumam responder em até 1 dia
-
WebsiteAbertagood first issue
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 91/100
TanbirRamim/open-source-radar#314 ·
Mantenedores costumam responder em até 1 dia