Incorrect Validation Warning When Using Multimodal Context With No Other Prompt References
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 45/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- jupyter-notebook
- Domain
- ai
Research direction
Start with nemo/NeMo-Data-Designer/advanced/multimodal/visual-question-answering-using-vlm.ipynb and run the visual-question-answering example to reproduce the PROMPT_WITHOUT_REFERENCES warning. Trace the validator path used by multi_modal_context; done means an image-only context no longer produces this warning while genuine prompts without references still do.
Written by the indexing model from the issue text.
Description
When an image is passed as context using the multi_modal_context parameter and no other column is referenced in the prompt, the validator throws an incorrect warning, PROMPT_WITHOUT_REFERENCES.
See visual-question-answering.ipynb to reproduce the error.
- Dominant language
- Jupyter Notebook
- Stars
- 4.2k
- Forks
- 1.1k
- Avg merge
- 10h 15m
- Merged PRs (30d)
- 1
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from NVIDIA/GenerativeAIExamples
-
Difficulty 1/5 Under an hour Newbie friendliness 70/100
NVIDIA/GenerativeAIExamples#361 · 2 comments ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
NVIDIA/GenerativeAIExamples#299 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
NVIDIA/GenerativeAIExamples#437 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 45/100
NVIDIA/GenerativeAIExamples#400 ·
-
Difficulty 5/5 Over a week Newbie friendliness 10/100
NVIDIA/GenerativeAIExamples#399 ·
All issues in NVIDIA/GenerativeAIExamples
Similar issues
-
area/config comp/cli comp/plugins P3 Plugin Catalog sweeper:risk-compatibility tool/memory type/bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
NousResearch/hermes-agent#119909 · 1 comment ·
-
bug configuration documentation examples policies processor tests training
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
huggingface/lerobot#4727 ·
-
📱 AI 日报 · 2026-09-23 Openai-content daily-post
Difficulty 1/5 Under an hour Newbie friendliness 85/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
run-llama/llama_index#23199 ·
-
p:2-high pydanty:bug
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
pydantic/pydantic-ai#8642 · 2 comments ·