Latest Only option for Historical Retrieval · feast-dev/feast#1687

(12 留言) (1 反應) (0 負責人)Python (5,029 star) (896 fork)batch import

Community Contribution Neededgood first issuekeep-openkind/featurepriority/p1

描述

Is your feature request related to a problem? Please describe.

In many batch workflows, it is worthwhile to retrieve the latest features by entity only. This is useful from the purposes of both production and backtesting purposes.

E.g. if I have an hourly/daily batch which goes through our whole customer base to find fraudulent customers, we wouldn't really use the online store for this.

Describe the solution you'd like

Allow users to specify an entity set extracted from a feature view should have an option to be deduplicated by latest. Depends on #1611

my_daily_batch_scoring_df = store.get_latest_features(
    entity_df = "my_df", 
    feature_refs = [...],
)

Additional context Linked issue #1611

貢獻者指南

技術棧: python
領域: datamachine learning
議題類型: feature
難度: 3
預計時間: 1-2 days
活動狀態: stale
清晰度: mostly clear
前置要求: Familiarity with Feast feature storeUnderstanding of historical retrieval APIKnowledge of entity sets and deduplication
新手友善度: 30
研究方向: The feature request proposes a new method `get latest features` to deduplicate historical features by entity. Implementation depends on resolving issue #1611 first. The existing `get historical features` method in the Python SDK (likely in `sdk/python/feast/inference.py` or similar) should be studied. Comments on the issue may contain discussion on API design. Focus on understanding how entity sets and feature views are currently retrieved and how deduplication by latest timestamp would fit.