More `jit` options, specifically `nogil=True` on the serial kernels
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 65/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- python
- Domain
- performance
Research direction
Start by locating the serial fallback kernels and the current jit configuration in the repository. Check how their compilation options are set and whether nogil=True can be applied consistently. Done means the serial kernels support the requested option without breaking their existing behavior, with the claimed parallelization speedup demonstrated as described in the issue.
Written by the indexing model from the issue text.
Description
Hi @flying-sheep I was wondering why the serial (fallback) kernels aren't compiled with nogil=True. This would enable parallelization via joblib and dask schedulers. Is there a reason for it? If not I can open a PR showing the speedup also.
I also want to point to something I learned. Tbb doesn't oversubscribe because it uses a process-wide arena. So, we can suggest tbb in certain OS'es instead of falling back. But setting nogil=True will be enough to be fast enough in itself.
- Dominant language
- Python
- Stars
- 15
- Forks
- 5
- Avg merge
- 10h 33m
- Merged PRs (30d)
- 9
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from scverse/fast-array-utils
-
Difficulty 1/5 1-3 hours Newbie friendliness 74/100
scverse/fast-array-utils#165 ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
scverse/fast-array-utils#215 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
scverse/fast-array-utils#179 · 23 comments ·
-
type: numpy/scipy
Difficulty 5/5 Over a week Newbie friendliness 25/100
scverse/fast-array-utils#128 ·
-
good first issue
Difficulty 3/5 Half a day Newbie friendliness 38/100
scverse/fast-array-utils#100 · 4 comments ·
All issues in scverse/fast-array-utils
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
anthropics/skills#1811 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
speaches-ai/speaches#678 ·
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
datalayer/mcp-compose#42 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
conda-forge/spacy-feedstock#177 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
UKGovernmentBEIS/inspect_evals#2523 ·