apache/datafusion-python

View on GitHub

Apache DataFusion Python Bindings

Stars: 605
Forks: 176
Open beginner issues: 3
Indexed issues: 72
Avg merge: 1d 23h
Merged PRs (30d): 8

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 17, 2026
Latest indexed: Sep 14, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

Allow "str" for function arguments that accept "col" expressions Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 70/100

apache/datafusion-python#1757 · Opened Sep 22, 2026
Allow extension libraries to contribute object stores over FFI Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion-python#1737 · Opened Sep 15, 2026
CsvReadOptions.null_regex has no effect: matching values are read as literal strings, and fail the read in a numeric column Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

apache/datafusion-python#1735 · 1 comment · Opened Sep 12, 2026
Nothing in CI runs examples/*.py, and one of them is broken Open

bug good first issue

Difficulty 4/5 3-5 days Newbie friendliness 48/100

apache/datafusion-python#1728 · Opened Sep 11, 2026
Give the two FFI example crates a runnable entry point Open

enhancement python

Difficulty 4/5 3-5 days Newbie friendliness 68/100

apache/datafusion-python#1727 · Opened Sep 11, 2026
Rewrite the "Encode metadata, not a handle to a live object" section Open

documentation

Difficulty 2/5 1-3 hours Newbie friendliness 72/100

apache/datafusion-python#1726 · Opened Sep 11, 2026
Quarantine the greedy ForeignExecutionPlan claim so it cannot be copied by accident Open

documentation rust

Difficulty 3/5 1-2 days Newbie friendliness 72/100

apache/datafusion-python#1725 · Opened Sep 11, 2026
Replace the logical codec's object registry with durable metadata Open

enhancement rust

Difficulty 4/5 3-5 days Newbie friendliness 74/100

apache/datafusion-python#1724 · 1 comment · 1 assignee · Opened Sep 11, 2026
Make examples/ behave like examples: runnable, and consistent with the extension guide Open

documentation enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

apache/datafusion-python#1723 · Opened Sep 11, 2026
Add a first-class example of multiple extension libraries in one distributed query Open

apache/datafusion-python#1719 · 1 assignee · Opened Sep 9, 2026
enable_url_table returns a handle on a different session, unlike every other with_* derivation Open

api change bug

Difficulty 4/5 3-5 days Newbie friendliness 55/100

apache/datafusion-python#1708 · Opened Sep 4, 2026
Add an agent skill for datafusion-python extension authors Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1707 · Opened Sep 4, 2026
Report which extension codec handled each node of a serialized plan Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1706 · Opened Sep 4, 2026
Decode Python UDFs opaquely so a scheduler needs no Python interpreter Open

enhancement rust

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1705 · Opened Sep 4, 2026
Expose Python UDF inlining as a public, reusable extension codec Open

enhancement rust

Difficulty 5/5 Over a week Newbie friendliness 48/100

apache/datafusion-python#1704 · Opened Sep 4, 2026
Gate pyo3/extension-module so the crate can be linked as a Rust dependency and tested Open

development-process enhancement rust

apache/datafusion-python#1703 · 1 comment · 1 assignee · Opened Sep 4, 2026
[Discussion] Define python UDF using `CREATE FUNCTION` SQL statement Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1701 · Opened Aug 30, 2026
Release datafusion-python 55.0.0 Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion-python#1696 · 3 comments · Opened Aug 26, 2026
Missing docstring examples in the `unparser` module Open

Difficulty 2/5 Half a day Newbie friendliness 88/100

apache/datafusion-python#1691 · Opened Aug 16, 2026
Add wrapper classes for Expression types Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 45/100

apache/datafusion-python#1681 · Opened Aug 9, 2026
Extend SessionContext.with_extensions to cover additional extension points (functions, catalogs, object stores) Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 52/100

apache/datafusion-python#1676 · 1 comment · Opened Aug 7, 2026
WindowEvaluator already provides the pure-Python window UDF base class #1577 (item 6) asks for Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion-python#1670 · Opened Aug 7, 2026
from_pycapsule! / try_from_pycapsule! macros don't support dunder methods that take arguments Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1669 · Opened Aug 7, 2026
Wire FFI_TableProvider / TableProvider(ABC) through to the Rust TableProvider trait Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1668 · Opened Aug 7, 2026
Build fails against DataFusion 54.1.0 due to new `schema` field on `RecursiveQuery` Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

apache/datafusion-python#1644 · Opened Jul 24, 2026
Expose per-file write metadata from DataFrame.write_parquet() Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

apache/datafusion-python#1637 · Opened Jul 17, 2026
Integrate `datafusion-distributed` with `datafusion-python` Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1612 · 16 comments · 1 reaction · Opened Jun 26, 2026
Segfault with PyArrow 24 on macOS when using mimalloc v3 Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

apache/datafusion-python#1607 · 2 comments · Opened Jun 25, 2026
Pipeline FFI types: missing Protocols, ABCs, and capsule helpers Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

apache/datafusion-python#1577 · 1 comment · Opened Jun 4, 2026
Surface foreign ExecutionPlan metrics via FFI (FFI_MetricsSet) Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion-python#1576 · Opened Jun 4, 2026
Expose SessionContext.add_analyzer_rule for Python-defined analyzer rules Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1575 · Opened Jun 4, 2026
Expose SessionContext.add_optimizer_rule for Python-defined logical optimizer rules Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion-python#1574 · Opened Jun 4, 2026
Expose SessionContext.create_physical_expr for logical-to-physical Expr conversion Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

apache/datafusion-python#1573 · Opened Jun 4, 2026
Expose SessionContext.register_higher_order_function / deregister_higher_order_function (v54) Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion-python#1572 · Opened Jun 4, 2026
Expose SessionContext.register_variable / deregister_variable for SQL @var support Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion-python#1571 · Opened Jun 4, 2026
Simplified filter expression has a Null type instead of Int64 type across the FFI layer Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 55/100

apache/datafusion-python#1551 · 11 comments · Opened May 18, 2026
Release DataFusion-Python 54.0.0 Open

Difficulty 4/5 3-5 days Newbie friendliness 18/100

apache/datafusion-python#1533 · 2 reactions · Opened May 12, 2026
Deprecate Expr for functions that take only specific literals Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

apache/datafusion-python#1496 · 1 comment · Opened Apr 14, 2026
Doc improvements Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 72/100

apache/datafusion-python#1463 · 1 comment · Opened Mar 29, 2026
Improve online documentation page for DataFrame Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1397 · 1 comment · Opened Feb 25, 2026
Add support for scalar values with extension types Open

enhancement

apache/datafusion-python#1301 · 3 comments · 1 assignee · Opened Nov 6, 2025
Inadvertently merged commits to main without a PR Open

Difficulty 1/5 Under an hour Newbie friendliness 10/100

apache/datafusion-python#1258 · 3 comments · Opened Oct 2, 2025
Investigate creating progress indicator Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion-python#1257 · 2 comments · 1 reaction · Opened Oct 1, 2025
Remove pyarrow as required dependency, relying on Arrow PyCapsule Interface Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion-python#1227 · 14 comments · 2 reactions · Opened Sep 3, 2025
Some group by query is 6~7x slower than DuckDB Open

apache/datafusion-python#1186 · 15 comments · 1 assignee · Opened Jul 7, 2025
Attach runtime before calling scan for foreign table provider Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

apache/datafusion-python#1146 · Opened Jun 10, 2025
Iceberg writes Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion-python#1097 · 5 comments · Opened Apr 7, 2025
Allow setting `ClientOptions` for `datafusion.object_store` contexts Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion-python#1082 · Opened Mar 23, 2025
Add most functions to the Expr class so that they're chainable. Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

apache/datafusion-python#1064 · 5 comments · Opened Mar 14, 2025
Expose object_store for direct use Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion-python#1008 · 6 comments · Opened Jan 29, 2025

apache/datafusion-python

Get new issues in your inbox