nteract/papermill

FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.

Open

Aperta il 31 gen 2025

Vedi su GitHub
 (0 commenti) (0 reazioni) (0 assegnatari)Python (5381 star) (402 fork)batch import
bughelp wanted

Descrizione

🐛 Bug

[2025-01-31, 11:17:58 UTC] {{pod_manager.py:395}} INFO - [base] /usr/local/lib/python3.8/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead. [2025-01-31, 11:17:58 UTC] {{pod_manager.py:395}} INFO - [base] from pyarrow import HadoopFileSystem

Hello community,

I'm running papermill in version 2.6.0 in python3.8 and I'm seeing this error, it should be already solved as I read here but I'm still able to see it, can you help me with that?

thank you so much.

Guida contributor

Tech stack
python
Dominio
backend
Tipo issue
bug
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
1
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
under 1 hour
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
fresh
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
Nessuno
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
90
Direzione di ricerca
The issue reports a deprecation warning from pyarrow. The fix is to replace `from pyarrow import HadoopFileSystem` with `from pyarrow.fs import HadoopFileSystem` in the file `papermill/iorw.py`. However, to maintain compatibility with older versions of pyarrow, a try except block may be needed. Check if the fix was already applied in a later version of papermill. If not, submit a PR with the change and ensure tests pass.