Serialize prompts that cycle through choices
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 42/100
- Issue type
- Refactor
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- python
- Domain
- machine-learning
Research direction
The issue does not name files or tests. Start by searching the prompt templates for uses of the choice filter, then inventory the templates that contain cycling alternatives. Done means each alternative is represented by a separate template rather than multiple prompts selected at runtime.
Written by the indexing model from the issue text.
Description
In some prompt templates, there is logic like this:
{% set seq = [
''Answer the question depending on the context.'',
''What is the answer?'',
] %}
{{ seq | choice }}
Context: {{context}};
Question: {{question}};
...
This makes it so that one prompt is effectively multiple prompts. We should "serialize" them into separate templates.
- Dominant language
- Python
- Stars
- 3k
- Forks
- 375
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from bigscience-workshop/promptsource
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
bigscience-workshop/promptsource#838 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
bigscience-workshop/promptsource#813 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 30/100
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
All issues in bigscience-workshop/promptsource
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100