pymc-devs/pymc

Add PyArrow backend

Open

#7,300 opened on May 6, 2024

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (7,926 stars) (1,902 forks)batch import
enhancementshelp wanted

Description

Description

This is the default backend in nutpie and could possibly also be the one in PyMC.

@aseyboldt suggests it may be much more performant than our numpy default backend atm.

Contributor guide

Tech stack
python
Domain
backend
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
needs investigation
Prerequisites
PythonPyMC internalsPyArrow
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20
Research direction
This feature request proposes adding a PyArrow backend for PyMC, referencing nutpie's existing implementation. To proceed, a contributor should study PyMC's current numpy backend (e.g., pymc/sampling/backends/) and understand the interface. Reviewing nutpie's PyArrow backend code would provide a reference implementation. Engaging with the issue author or maintainers (e.g., @aseyboldt) for more detailed requirements is recommended. The scope of work includes performance benchmarking and ensuring compatibility with PyMC's sampling methods.