FEAT GUI: Accept exact seed selections in scenario requests
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Idoneità per principianti
- 35/100
Direzione di ricerca
Start with pyrit\models\catalog\scenario.py, pyrit\backend\services\scenario_configuration_resolver.py, the scenario estimate/run services, and pyrit\scenario\core\dataset_configuration.py. Trace how shared estimate and run inputs are resolved, then use the existing framework/model/scenario/database tests to cover exact selections, stale or conflicting references, provenance, read-only estimates, and SQLite/Azure SQL-compatible access.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Is your feature request related to a problem? Please describe.
A user selecting a few examples in the explorer must run exactly those examples. Current scenario requests expose dataset names, caps, and a small filter set, not an explicit selected-example contract. Reconstructing a selection from broad filters could run different data.
Work item 13 of 17 in #2744. Technical prerequisites: item 2's stable seed/group IDs and the scorer-preset contract from item 12. Keep not ready yet until promoted.
Describe the solution you'd like
Extend the shared estimate/run models and configuration resolver with a bounded, typed explicit-selection input resolved from existing memory.
- Select complete logical examples by stable references. Resolve canonical content on the backend; do not trust arbitrary browser-supplied file paths or rebuild membership from a dataset name alone.
- Preserve group membership, roles, order, source seed IDs, and existing provenance. Reuse DatasetAttackConfiguration's explicit seed/seed-group input where appropriate.
- Make explicit selection mutually exclusive with conflicting dataset-name/filter/sampling overrides. Do not silently apply a scenario's default cap or random sample to an explicit selection.
- Include the selected configured scorer reference and explicit objective inputs needed by the later scenario adapter, without serializing arbitrary component instances in the request.
- Use the same effective selection/configuration for preview, estimate, and launch. Detect missing, changed, or invalid examples and ask the user to refresh rather than silently dropping rows or expanding to a whole dataset.
- Preserve selected-input provenance using existing scenario/result mechanisms; do not create a new persistent dataset per selection.
Acceptance criteria:
- Selecting N examples yields those same N logical examples in resolution, with linked media intact.
- Invalid/duplicate/missing references and conflicting selection modes have defined, tested behavior.
- Default dataset caps and filters cannot silently change an explicit selection.
- Estimate resolution is read-only and does not fetch providers, persist seeds, or invoke models.
- Existing named-dataset request behavior remains compatible.
- Contract/resolver tests cover mixed examples, stale selection, provenance, and SQLite/Azure SQL-compatible memory access.
Describe alternatives you've considered, if relevant
Do not send an entire dataset to the browser, encode selections as arbitrary Python/opaque dataset_config objects, duplicate selected seeds into a new dataset, or add memory migrations. This item defines/resolves inputs; the scenario implementation is item 14.
Additional context
Start with pyrit\models\catalog\scenario.py, pyrit\backend\services\scenario_configuration_resolver.py, scenario estimate/run services, and pyrit\scenario\core\dataset_configuration.py. DATASET_FILTERS currently exposes harm_categories and data_types; exact selection needs an intentional shared contract. Follow framework/model/scenario/database/test instructions.
- Lingua principale
- Python
- Stelle
- 4.5k
- Fork
- 896
- Merge medio
- 3g 8h
- PR unite (30g)
- 191
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di microsoft/PyRIT
-
BUG HarmBench loader drops ContextString, so contextual behaviors are sent without their context Aperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 74/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
Tutte le issue di microsoft/PyRIT
Issue simili
-
agent-ready documentation needs-triage
Difficoltà 1/5 1-3 ore Idoneità per principianti 88/100
-
documentation
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 91/100
-
workflow-status page template still says reusable workflows are "triggered only by workflow_call:" Aperta
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 92/100
-
instance instance add
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 72/100
searxng/searx-instances#939 · 1 commento ·
-
area-deployment area-integrations triage:bot-seen
Difficoltà 2/5 Mezza giornata Idoneità per principianti 86/100