decode & decode_iter 多线程会不会有问题
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 20/100
Research direction
Start by tracing the model's decode and decode_iter entry points and checking how they share state when called from multiple threads. Look for existing concurrency tests or documentation in the repository; done would require a clear, evidence-based thread-safety conclusion and any necessary test or documentation update.
Written by the indexing model from the issue text.
Description
如果多个线程同时使用model的 decode 和 decode_iter方法，会不会有问题？
- Dominant language
- C++
- Stars
- 752
- Forks
- 94
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from MegEngine/InferLLM
-
SG2042 服务器 make 出错 Open
Difficulty 4/5 3-5 days Newbie friendliness 30/100
-
无法加载模型bin或者guff模型 Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
-
有打算支持qwen吗 Open
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Difficulty 4/5 3-5 days Newbie friendliness 20/100
-
这个有windows的部署教程吗 Open
Difficulty 3/5 1-2 days Newbie friendliness 35/100
All issues in MegEngine/InferLLM
Similar issues
-
ai_reviewed
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
ydb-platform/ydb#53869 · 3 comments ·
-
bug cert blocker needs triage
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
project-chip/connectedhomeip#74373 ·
-
upstream update
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
conan-io/conan-center-index#31035 ·
-
Bug
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
documentation
Difficulty 1/5 Under an hour Newbie friendliness 85/100
vllm-project/vllm-ascend#17329 ·