opensearch-project/demos

[FEATURE][DocBot] Generate responses with our RAG pipeline

开放

#83 创建于 2023年11月1日

 (2 条评论) (0 个反应) (0 位负责人) (18 个派生)auto 404
OSCIenhancementgood first issuehelp wanted

仓库指标

星标
 (4 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Is your feature request related to a problem?

At the moment we have several of the pieces of the RAG pipeline built but now we need to pull it all together. We need to pull this all together now.

What solution would you like?

Our DocBot class will call docbot.language_model:generate_response see #80. Generate response will need to query our cohere-index and collect the response to return to the user.

https://opensearch.org/docs/latest/ml-commons-plugin/conversational-search/#using-the-pipeline

Note* here the interaction_size is the number of previous chats to send as context. The context_size is the number of results from our search that we will send through.

The most challenging thing with this PR is we will need to use a neural search in our query section in order to find the most relevant documents. https://opensearch.org/docs/latest/search-plugins/neural-text-search/#step-4-search-the-index-using-neural-search. The model_id that we will need to reference here is the MODEL_ID that is being used by our ingestion pipeline.

贡献者指南