RAGdiscussionhelp wanted
Description
Issue Checklist
- I understand that issues are meant for feedback and problem-solving, not for venting, and I will provide as much detail as possible to help resolve the issue.
- I have checked the pinned issues and searched through the existing open issues, closed issues, and discussions and did not find a similar suggestion.
- I confirm that I am here to ask questions and discuss issues, not to report bugs or request features.
Platform
Windows
Version
1.9.4
Your Question
I have built a knowledge base that works normally in conversation mode, but I want to use Python to call it through API. However, only the basic dialogue function of the LLM is available, and the knowledge base cannot be used. The prompt word examples given in api-doc do not have the relevant usage of knowledge_base, so I am seeking help from everyone.
Here is my Payload example:
BASE_URL = "http://127.0.0.1:9000/v1/chat/completions"
HEADERS = {
"accept": "application/json",
"Authorization": f"Bearer {API_KEY}",
"Content-Type": "application/json"
}
PAYLOAD=
{
"model": "dashscope:qwen3.5-plus",
"messages": [
{"role": "system", "content": "【 System Instructions 】 Answer strictly according to the content of the knowledge base and prohibit free expression. If there is no relevant answer in the knowledge base, a response must be given stating 'unable to answer based on existing information''"},
{"role": "user", "content": "What are the functions of the big data analysis module for social governance in the government industry?"}
],
"temperature": 1,
"knowledgebase": "KB-Test",
"max_tokens": 1,
"stream": false
}
I have tried "knowledgebase","knowledgeBase","knowledge-base","KB" and "knowledge_base" in payload, but none of them work. :<
Thank you!
Context
No response
Additional Information
Priority
Medium (Would like a response soon)