打分模型不准确
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 30/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Quiet
- Tech stack
- python
- Domain
- machine-learning
Research direction
Start by reproducing the reported behavior with FIRM-Edit-8B on the mentioned left/right, earring, and brooch editing cases. Compare the model's scores and explanations with the intended edits; the issue does not name any files, tests, or a concrete completion criterion, so further project context is needed before implementation.
Written by the indexing model from the issue text.
Description
hi，你好，我使用FIRM-Edit-8B测试了一些编辑case，发现模型很容易左右不分，明明编辑的是对的，但是却说左右错了，以及明明编辑了的case（比如加耳环或者胸针之类的），给低分，给的原因是图像一样，没有编辑，是因为训练该模型的时候，这种数据很少造成的吗？
- Dominant language
- Python
- Stars
- 49
- Forks
- 2
- PR merge metrics
- No merged PRs in 30d
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from VisionXLab/FIRM-Reward
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
All issues in VisionXLab/FIRM-Reward
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 83/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
FuRongJun-1999/dsh-memory#65 ·
Maintainers usually reply within 1 day
-
ci needs-ac
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Ikalus1988/MisakaNet#2930 ·
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Qiskit/qiskit-aer#2466 ·
-
area/cli
Difficulty 2/5 1-3 hours Newbie friendliness 82/100