Add a SecretBench evaluation adapter
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 38/100
Research direction
No files or tests are named. Start by reading the existing reproducible benchmark against detect-secrets and locating how it runs evaluations; compare that structure with the proposed SecretBench adapter. Done means the benchmark evaluates real labelled leaks, rather than relying only on synthetic secrets.
Written by the indexing model from the issue text.
Description
Evaluate on real labelled leaks so results do not depend only on synthetic secrets.
- Dominant language
- Python
- Stars
- 0
- Forks
- 1
- Avg merge
- 4d 3h
- Merged PRs (30d)
- 1
Getting set up
- Ships a Dockerfile or Docker Compose file
- No pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from eyadstein/secretsift
-
good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
eyadstein/secretsift#1 ·
All issues in eyadstein/secretsift
Similar issues
-
release
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
MichaelYcJo/SpecSeal#1535 ·
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
valentinfrlch/ha-llmvision#769 ·
Maintainers usually reply within 1 day
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 75/100
daniel-ospina/tortoise#11937 · 1 comment ·
Maintainers usually reply within 1 day
-
good first issue help wanted python up-for-grabs
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
andrewsiah/agentswarm-data-tasks#238 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
cadence-workflow/cadence-ai-samples#175 ·
Maintainers usually reply within 1 day