Chain server fail to pull the result

未關閉
#269 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視

還沒有人認領這個 Issue。

評估

難度
4/5
預估耗時
3-5 天
新手友好度
25/100
Issue 類型
缺陷
描述清晰度
需要釐清
活躍度
停滯
技術堆疊
go
領域
backend

研究方向

先從 internal/proxy/task_search.go:581 開始,沿著 internal/proxy/lb_policy.go 和 pkg/util/retry/retry.go 追蹤回報的失敗,然後檢查 VectorMemIndex.cpp:411 中顯示 ef(10) 低於 k(40) 的錯誤。在 chain-server 工作流程中重現該搜尋並確定預期結果;當查詢在沒有發生回報的 retry 失敗的情況下傳回結果時,即表示完成。

由索引模型根據 Issue 內容生成。

描述

2025/01/29 12:35:47.094 +00:00] [WARN] [retry/retry.go:104] ["retry func failed, reach max retry"] [traceID=5ce0d7f04403e4b765eefacedfbf5a5b] [attempt=2]
[2025/01/29 12:35:47.094 +00:00] [WARN] [proxy/task_search.go:581] ["search execute failed"] [traceID=5ce0d7f04403e4b765eefacedfbf5a5b] [nq=1] [error="failed to search/query delegator 2 for channel by-dev-rootcoord-dml_1_454401150931015494v0: fail to search on QueryNode 2: worker(2) query failed: Operator::GetOutput failed for [Operator:, plan node id: 11562] : => failed to search: config={{"ef":10,"k":40,"metric_type":"L2","span_id":"11dd9c06b163fd13","trace_flags":0,"trace_id":"5ce0d7f04403e4b765eefacedfbf5a5b"}} out of range in json: ef(10) should be larger than k(40) at /workspace/source/internal/core/src/index/VectorMemIndex.cpp:411"] [errorVerbose="failed to search/query delegator 2 for channel by-dev-rootcoord-dml_1_454401150931015494v0: fail to search on QueryNode 2: worker(2) query failed: Operator::GetOutput failed for [Operator:, plan node id: 11562] : => failed to search: config={{"ef":10,"k":40,"metric_type":"L2","span_id":"11dd9c06b163fd13","trace_flags":0,"trace_id":"5ce0d7f04403e4b765eefacedfbf5a5b"}} out of range in json: ef(10) should be larger than k(40) at /workspace/source/internal/core/src/index/VectorMemIndex.cpp:411\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus/internal/proxy.(*LBPolicyImpl).ExecuteWithRetry.func1\n | \t/workspace/source/internal/proxy/lb_policy.go:218\n | [...repeated from below...]\nWraps: (2) failed to search/query delegator 2 for channel by-dev-rootcoord-dml_1_454401150931015494v0\nWraps: (3) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus/internal/proxy.(*searchTask).searchShard\n | \t/workspace/source/internal/proxy/task_search.go:791\n | github.com/milvus-io/milvus/internal/proxy.(*LBPolicyImpl).ExecuteWithRetry.func1\n | \t/workspace/source/internal/proxy/lb_policy.go:210\n | github.com/milvus-io/milvus/pkg/util/retry.Do\n | \t/workspace/source/pkg/util/retry/retry.go:44\n | github.com/milvus-io/milvus/internal/proxy.(*LBPolicyImpl).ExecuteWithRetry\n | \t/workspace/source/internal/proxy/lb_policy.go:179\n | github.com/milvus-io/milvus/internal/proxy.(*LBPolicyImpl).Execute.func1\n | \t/workspace/source/internal/proxy/lb_policy.go:246\n | golang.org/x/sync/errgroup.(*Group).Go.func1\n | \t/go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:78\n | runtime.goexit\n | \t/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.0.linux-amd64/src/runtime/asm_amd64.s:1695\nWraps: (4) fail to search on QueryNode 2\nWraps: (5) worker(2) query failed: Operator::GetOutput failed for [Operator:, plan node id: 11562] : => failed to search: config={{"ef":10,"k":40,"metric_type":"L2","span_id":"11dd9c06b163fd13","trace_flags":0,"trace_id":"5ce0d7f04403e4b765eefacedfbf5a5b"}} out of range in json: ef(10) should be larger than k(40) at /workspace/source/internal/core/src/index/VectorMemIndex.cpp:411\nError types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) merr.milvusError"]

主要語言
Jupyter Notebook
星號
4.2k
分支
1.1k
平均合併
10 小時 15 分鐘
30 天內合併 PR
1

貢獻指南

開啟貢獻指南

從這裡開始

  1. 先讀完整個 Issue,再讀專案的貢獻指南。
  2. 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
  3. Fork 儲存庫,在一個分支上完成修改。
  4. 送出 Pull Request,並在描述裡引用這個 Issue 編號。

NVIDIA/GenerativeAIExamples 的其他 Issue

查看 NVIDIA/GenerativeAIExamples 的全部 Issue

相似的 Issue

更多 Backend & API Design Issue

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。