data-apis/array-api-tests

View on GitHub

Test suite for Python array API standard compliance

Stars: 74
Forks: 54
Open beginner issues: 1
Indexed issues: 50
Avg merge: 4d 15h
Merged PRs (30d): 6

Dominant language: Python
License: MIT
Last GitHub push: Sep 15, 2026
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

No coverage for `__imatmul__` (`@=`) Open

Difficulty 2/5 1-3 hours Newbie friendliness 87/100

data-apis/array-api-tests#465 · 1 comment · Opened Sep 11, 2026
Test reflected operators? Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

data-apis/array-api-tests#460 · 1 comment · Opened Aug 29, 2026
test_trace sporadically fails under numpy Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

data-apis/array-api-tests#455 · 2 comments · Opened Aug 17, 2026
Pain points in using the test suite Open

tracking

Difficulty 5/5 Over a week Newbie friendliness 25/100

data-apis/array-api-tests#381 · 9 comments · Opened Jun 1, 2025
Providing reproduction code for failed test cases Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

data-apis/array-api-tests#379 · 10 comments · Opened May 21, 2025
Jax float64 precision issues do not play ball with hypothesis Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

data-apis/array-api-tests#368 · 3 comments · Opened May 5, 2025
Missing use cases for binops on array vs. scalar Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

data-apis/array-api-tests#364 · 3 comments · Opened Apr 11, 2025
missing extensions are not ignored by default Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

data-apis/array-api-tests#329 · 3 comments · Opened Dec 27, 2024
test_finfo fails on numpy Open

wontfix

Difficulty 3/5 1-2 days Newbie friendliness 35/100

data-apis/array-api-tests#317 · 12 comments · 1 reaction · Opened Nov 20, 2024
Split tests into smaller sub-tests Open

low priority

Difficulty 5/5 Over a week Newbie friendliness 25/100

data-apis/array-api-tests#316 · Opened Nov 20, 2024
Rename master to main Open

low priority

Difficulty 4/5 3-5 days Newbie friendliness 25/100

data-apis/array-api-tests#315 · 1 comment · Opened Nov 20, 2024
Test device support Open

high priority

Difficulty 4/5 3-5 days Newbie friendliness 48/100

data-apis/array-api-tests#302 · 4 comments · 1 reaction · Opened Nov 14, 2024
Incomplete tests Open

high priority

Difficulty 5/5 Over a week Newbie friendliness 25/100

data-apis/array-api-tests#301 · 5 comments · Opened Nov 14, 2024
Skipped flaky tests Open

high priority

Difficulty 4/5 3-5 days Newbie friendliness 45/100

data-apis/array-api-tests#300 · 10 comments · Opened Nov 14, 2024
Avoid inplace operators in general tests Open

low priority

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

data-apis/array-api-tests#287 · 2 comments · Opened Sep 1, 2024
Special case tests need to be updated Open

high priority

Difficulty 4/5 3-5 days Newbie friendliness 32/100

data-apis/array-api-tests#284 · 3 comments · Opened Aug 1, 2024
`test_has_names` fails on missing `fft` extension Open

medium priority

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

data-apis/array-api-tests#282 · 3 comments · Opened Jul 29, 2024
Better signature tests for required arguments Open

medium priority

Difficulty 3/5 1-2 days Newbie friendliness 45/100

data-apis/array-api-tests#281 · Opened Jul 9, 2024
test_eigh filters too much (FailedHealthCheck) Open

low priority

Difficulty 3/5 1-2 days Newbie friendliness 28/100

data-apis/array-api-tests#280 · 2 comments · Opened Jul 1, 2024
Tests failing with data_too_large health check Open

low priority

Difficulty 3/5 1-2 days Newbie friendliness 35/100

data-apis/array-api-tests#277 · 1 comment · Opened Jun 26, 2024
test_has_names fails on info category checked main namespace, instead of class attributes Open

Difficulty 1/5 1-3 hours Newbie friendliness 45/100

data-apis/array-api-tests#261 · 1 comment · Opened May 11, 2024
Allow different arg names for positional-only arguments in signature tests Open

bug medium priority

Difficulty 3/5 1-2 days Newbie friendliness 45/100

data-apis/array-api-tests#256 · 1 reaction · Opened May 1, 2024
Test __array_namespace__ Open

api coverage high priority

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

data-apis/array-api-tests#248 · Opened Mar 27, 2024
asarray() copy flag and buffer protocol inputs are not sufficiently tested Open

api coverage

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

data-apis/array-api-tests#241 · 1 reaction · Opened Mar 8, 2024
Update libraries we test on CI Open

tracking

Difficulty 4/5 3-5 days Newbie friendliness 28/100

data-apis/array-api-tests#235 · 1 comment · Opened Feb 20, 2024
Update dtype assertions in sum-like tests for `>2023.12` versions Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

data-apis/array-api-tests#234 · Opened Feb 20, 2024
has_names check missing some things Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

data-apis/array-api-tests#224 · Opened Dec 6, 2023
has_names test can't run if certain names are missing Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

data-apis/array-api-tests#223 · 1 comment · Opened Dec 6, 2023
DeadlineExceeded failures in test_eye/test_linspace Open

bug performance

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

data-apis/array-api-tests#214 · 3 comments · 1 reaction · Opened Nov 19, 2023
Tests are too slow for libraries with eager-mode dispatch overhead Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

data-apis/array-api-tests#197 · 16 comments · Opened Nov 9, 2023
test_linspace error with numpy Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

data-apis/array-api-tests#195 · 1 comment · Opened Sep 12, 2023
Support libraries that don't allow mutation Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

data-apis/array-api-tests#188 · Opened Jun 2, 2023
Incorrect getitem test? Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 42/100

data-apis/array-api-tests#172 · 1 reaction · Opened Feb 25, 2023
signature tests being misled by **kwargs Open

medium priority

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

data-apis/array-api-tests#171 · 1 comment · Opened Feb 24, 2023
signature tests for floor_divide and remainder divide by 0 Open

medium priority

Difficulty 3/5 1-2 days Newbie friendliness 35/100

data-apis/array-api-tests#170 · 1 comment · Opened Feb 21, 2023
--disable-extension doesn't work with test_has_names.py Open

medium priority

Difficulty 3/5 1-2 days Newbie friendliness 25/100

data-apis/array-api-tests#169 · Opened Feb 18, 2023
Smoke tests for statistical function output Open

medium priority

Difficulty 3/5 1-2 days Newbie friendliness 35/100

data-apis/array-api-tests#167 · 1 reaction · Opened Feb 2, 2023
Loosely assert for functions that produce ints but internally might use floats Open

data-apis/array-api-tests#154 · 8 comments · 1 assignee · Opened Nov 1, 2022
Generate value filters for element-wise tests Open

low priority

data-apis/array-api-tests#147 · 1 assignee · Opened Oct 4, 2022
Easier way to pin to "latest" release Open

low priority

Difficulty 5/5 Over a week Newbie friendliness 35/100

data-apis/array-api-tests#145 · 3 comments · Opened Sep 30, 2022
Feature request: safety factor parameter Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

data-apis/array-api-tests#135 · 3 comments · Opened Aug 8, 2022
Failed hypothesis health check Open

hard to reproduce

Difficulty 3/5 1-2 days Newbie friendliness 35/100

data-apis/array-api-tests#132 · 11 comments · Opened Jun 26, 2022
Improve docs for elwise/op test utilities Open

low priority

data-apis/array-api-tests#126 · 1 assignee · Opened Jun 1, 2022
Test new `copy` arg in `test_reshape` Open

low priority

data-apis/array-api-tests#108 · 1 comment · 1 assignee · Opened Mar 23, 2022
Support vendoring this test suite by removing need for `array-api` submodule Open

medium priority

Difficulty 5/5 Over a week Newbie friendliness 35/100

data-apis/array-api-tests#107 · 1 comment · Opened Mar 22, 2022
Add simple example of running with different frameworks in the README Open

low priority

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

data-apis/array-api-tests#88 · 3 comments · Opened Jan 25, 2022
Specify dependency of each test case Open

low priority

Difficulty 5/5 Over a week Newbie friendliness 25/100

data-apis/array-api-tests#51 · 2 comments · Opened Dec 16, 2021
Compare numerical functions against an arbitrary precision library Open

low priority

Difficulty 5/5 Over a week Newbie friendliness 25/100

data-apis/array-api-tests#7 · 2 comments · Opened Oct 8, 2020

data-apis/array-api-tests

Get new issues in your inbox