`acceptance-test` inconsistent with `test-local`
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 70/100
Research direction
Start by comparing the acceptance-test and test-local entry points, then inspect how AcceptanceTestRunner resolves test_formulas/ against examples/formulas/smtlib. Done means acceptance-test discovers the existing prefixed formulas and runs successfully with the parallel SMT solver.
Written by the indexing model from the issue text.
Description
On the mainline-2026 branch, I succeeded in locally testing a parallel SMT solver with the test-local command, but it fails with acceptance-test, printing:
...
2026-08-10 17:12:34 - AcceptanceTestRunner - WARNING - Missing required benchmark categories: malformed_, oom_, sat_, timeout_, unsat_. Ensure test_formulas/ contains files with these prefixes.
2026-08-10 17:12:34 - AcceptanceTestRunner - ERROR - No test cases found in /home/tomaqa/Data/Prog/C++/smt-comp/aws-batch-comp-infrastructure-sample/test_formulas
But SMT formulas are located at examples/formulas/smtlib, not test_formulas. Is this part outdated?
- Dominant language
- Python
- Stars
- 12
- Forks
- 14
- Avg merge
- 5m
- Merged PRs (30d)
- 1
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from aws-samples/aws-batch-comp-infrastructure-sample
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 4/5 3-5 days Newbie friendliness 55/100
aws-samples/aws-batch-comp-infrastructure-sample#54 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
aws-samples/aws-batch-comp-infrastructure-sample#53 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
aws-samples/aws-batch-comp-infrastructure-sample#22 · 2 comments ·
All issues in aws-samples/aws-batch-comp-infrastructure-sample
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100