FEAT GUI: Accept exact seed selections in scenario requests
まだ誰も着手していません。
評価
- 難易度
- 5/5
- 見積もり時間
- 1週間以上
- 初心者へのやさしさ
- 35/100
調査の方向性
Start with pyrit\models\catalog\scenario.py, pyrit\backend\services\scenario_configuration_resolver.py, the scenario estimate/run services, and pyrit\scenario\core\dataset_configuration.py. Trace how shared estimate and run inputs are resolved, then use the existing framework/model/scenario/database tests to cover exact selections, stale or conflicting references, provenance, read-only estimates, and SQLite/Azure SQL-compatible access.
索引モデルが issue の本文から書いたものです。
説明
Is your feature request related to a problem? Please describe.
A user selecting a few examples in the explorer must run exactly those examples. Current scenario requests expose dataset names, caps, and a small filter set, not an explicit selected-example contract. Reconstructing a selection from broad filters could run different data.
Work item 13 of 17 in #2744. Technical prerequisites: item 2's stable seed/group IDs and the scorer-preset contract from item 12. Keep not ready yet until promoted.
Describe the solution you'd like
Extend the shared estimate/run models and configuration resolver with a bounded, typed explicit-selection input resolved from existing memory.
- Select complete logical examples by stable references. Resolve canonical content on the backend; do not trust arbitrary browser-supplied file paths or rebuild membership from a dataset name alone.
- Preserve group membership, roles, order, source seed IDs, and existing provenance. Reuse DatasetAttackConfiguration's explicit seed/seed-group input where appropriate.
- Make explicit selection mutually exclusive with conflicting dataset-name/filter/sampling overrides. Do not silently apply a scenario's default cap or random sample to an explicit selection.
- Include the selected configured scorer reference and explicit objective inputs needed by the later scenario adapter, without serializing arbitrary component instances in the request.
- Use the same effective selection/configuration for preview, estimate, and launch. Detect missing, changed, or invalid examples and ask the user to refresh rather than silently dropping rows or expanding to a whole dataset.
- Preserve selected-input provenance using existing scenario/result mechanisms; do not create a new persistent dataset per selection.
Acceptance criteria:
- Selecting N examples yields those same N logical examples in resolution, with linked media intact.
- Invalid/duplicate/missing references and conflicting selection modes have defined, tested behavior.
- Default dataset caps and filters cannot silently change an explicit selection.
- Estimate resolution is read-only and does not fetch providers, persist seeds, or invoke models.
- Existing named-dataset request behavior remains compatible.
- Contract/resolver tests cover mixed examples, stale selection, provenance, and SQLite/Azure SQL-compatible memory access.
Describe alternatives you've considered, if relevant
Do not send an entire dataset to the browser, encode selections as arbitrary Python/opaque dataset_config objects, duplicate selected seeds into a new dataset, or add memory migrations. This item defines/resolves inputs; the scenario implementation is item 14.
Additional context
Start with pyrit\models\catalog\scenario.py, pyrit\backend\services\scenario_configuration_resolver.py, scenario estimate/run services, and pyrit\scenario\core\dataset_configuration.py. DATASET_FILTERS currently exposes harm_categories and data_types; exact selection needs an intentional shared contract. Follow framework/model/scenario/database/test instructions.
- 主要言語
- Python
- スター
- 4.5k
- フォーク
- 896
- 平均マージ
- 3日 8時間
- マージ済み PR(30日)
- 191
コントリビューションガイド
このリポジトリのコントリビューションガイドは索引されていません
はじめの一歩
- issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
- 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
- リポジトリをフォークし、ブランチを切って変更します。
- issue 番号を参照したプルリクエストを送ります。
microsoft/PyRIT のほかの issue
-
BUG HarmBench loader drops ContextString, so contextual behaviors are sent without their context オープン
難易度 2/5 1〜3時間 初心者へのやさしさ 74/100
-
難易度 2/5 1〜3時間 初心者へのやさしさ 78/100
-
難易度 2/5 1〜3時間 初心者へのやさしさ 82/100
-
難易度 2/5 1〜3時間 初心者へのやさしさ 78/100
-
難易度 5/5 1週間以上 初心者へのやさしさ 35/100
microsoft/PyRIT の issue をすべて見る
似ている issue
-
agent-ready documentation needs-triage
難易度 1/5 1〜3時間 初心者へのやさしさ 88/100
-
documentation
難易度 1/5 1時間未満 初心者へのやさしさ 91/100
-
workflow-status page template still says reusable workflows are "triggered only by workflow_call:" オープン
難易度 1/5 1時間未満 初心者へのやさしさ 92/100
-
instance instance add
難易度 1/5 1時間未満 初心者へのやさしさ 72/100
searxng/searx-instances#939 · コメント 1 件 ·
-
area-deployment area-integrations triage:bot-seen
難易度 2/5 半日 初心者へのやさしさ 86/100