nteract/papermill

FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.

Open

#816 建立於 2025年1月31日

在 GitHub 查看
 (0 留言) (0 反應) (0 負責人)Python (5,381 star) (402 fork)batch import
bughelp wanted

描述

🐛 Bug

[2025-01-31, 11:17:58 UTC] {{pod_manager.py:395}} INFO - [base] /usr/local/lib/python3.8/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead. [2025-01-31, 11:17:58 UTC] {{pod_manager.py:395}} INFO - [base] from pyarrow import HadoopFileSystem

Hello community,

I'm running papermill in version 2.6.0 in python3.8 and I'm seeing this error, it should be already solved as I read here but I'm still able to see it, can you help me with that?

thank you so much.

貢獻者指南

技術棧
python
領域
backend
議題類型
bug
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
1
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
under 1 hour
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
fresh
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
無
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
90
研究方向
The issue reports a deprecation warning from pyarrow. The fix is to replace `from pyarrow import HadoopFileSystem` with `from pyarrow.fs import HadoopFileSystem` in the file `papermill/iorw.py`. However, to maintain compatibility with older versions of pyarrow, a try except block may be needed. Check if the fix was already applied in a later version of papermill. If not, submit a PR with the change and ensure tests pass.