vespa-engine/vespa

Support a properties-file (available during runtime) for ml-models (Stateless evaluation in container)

Open

#9,552 opened on 2019年5月24日

GitHub で見る
 (0 comments) (0 reactions) (0 assignees)Java (4,948 stars) (561 forks)batch import
enhancementgood first issue

説明

Hello Vespa Team, Can you please consider support a properties-file which is available during run-time along with the model ? So some meta-data e.g. threshold/label, etc can be associated with the model. This is for the stateless evaluation of the models like (XGBoost, TensorFlow, Onnx, etc) which is supported in vespa.

Thank you, Pinank

コントリビューターガイド

技術スタック
javatensorflow
領域
machine learningbackend
Issue 種別
feature
難度新しい貢献者にとっての実装難度です。1 は非常に小さな変更、5 は専門的な作業です。
4
推定時間経験ある貢献者が調査、実装、テスト、pull request 準備にかけるおおよその時間範囲です。
over 1 week
活動状況Issue が今どれだけ取り組みやすいかを示します。新しい、活発、古い、ブロック中、またはメンテナー入力待ちなどです。
stale
明確さ期待される変更、受け入れ条件、次の手順がどれだけ明確かを示します。
unclear
前提条件
Understanding of Vespa architectureFamiliarity with ML model evaluation in Vespa
初心者向け度初回貢献者にどれだけ取り組みやすいかを 1-100 で推定したスコアです。
10
調査方針
The issue requests adding a properties file for ML models (XGBoost, TensorFlow, ONNX) during stateless evaluation. Since the issue is from 2019 and has no comments, the requester's intent is to associate metadata like thresholds/labels with models. To implement, one should investigate Vespa's model serving infrastructure, specifically how models are packaged and evaluated in containers (e.g., using the model evaluation API). The key challenge is to define a format for the properties file and integrate it into the model loading process. The solution would likely involve modifications to the model configuration and evaluation pipeline.