Clarification needed for dataset usage in example / llm_simple_qa .
#233 opened on 2025/08/06
Repository metrics
- Stars
- (178 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
Introduction or background of this discussion: Ianvs includes a wide range of examples showcasing its benchmarking capabilities. As far as I see , Issue #194 keeps a track of all the issues which are yet to be verified and well documented.
This issue is about the example
llm_simple_qa
Contents of this discussion:
I've been trying to run the llm_simple_qa example and encountered some confusion regarding the dataset. The README.md for this example embeds the dataset content directly and asks users to manually copy it. This differs significantly from the cloud-edge-collaborative-inference-for-llm example, which provides a clear kaggle download command for its dataset.
Screenshot of README.md of llm_simple_qa
Problem:
Lack of clear documentation and clarify in llm_simple_qa example .In addition , a verification is needed where the example runs or not .