opensearch-project/demos

[FEATURE][DocBot] Generate responses with our RAG pipeline

開放

#83 建立於 2023年11月1日

 (2 則留言) (0 個反應) (0 位負責人) (18 個分叉)auto 404
OSCIenhancementgood first issuehelp wanted

倉庫指標

星標
 (4 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Is your feature request related to a problem?

At the moment we have several of the pieces of the RAG pipeline built but now we need to pull it all together. We need to pull this all together now.

What solution would you like?

Our DocBot class will call docbot.language_model:generate_response see #80. Generate response will need to query our cohere-index and collect the response to return to the user.

https://opensearch.org/docs/latest/ml-commons-plugin/conversational-search/#using-the-pipeline

Note* here the interaction_size is the number of previous chats to send as context. The context_size is the number of results from our search that we will send through.

The most challenging thing with this PR is we will need to use a neural search in our query section in order to find the most relevant documents. https://opensearch.org/docs/latest/search-plugins/neural-text-search/#step-4-search-the-index-using-neural-search. The model_id that we will need to reference here is the MODEL_ID that is being used by our ingestion pipeline.

貢獻者指南