Messures and Doc for index freshness/update · apache/pinot#14371

(2 留言) (0 反應) (1 負責人)Java (4,937 star) (1,234 fork)batch import

documentationgood first issue

描述

A part of Pinots secret sauce for speed are indexes. Is there any info available what index freshness/delay is achievable for newly ingested data / just changed data (upsert) for the different kinds of indexes? on how this could be improved/reduced? On how index updating works for each type?

of course I found

some info snippets in some issues in this field:
- https://github.com/apache/pinot/issues/6431
- https://github.com/apache/pinot/issues/13504
some sentence on it in the doc for native text index https://docs.pinot.apache.org/basics/indexing/native-text-index
etc

but no overview / table summing this topic up.

貢獻者指南

技術棧: java
領域: documentationdatabaseperformance
議題類型: documentation
難度: 2
預計時間: 1-3 hours
活動狀態: active
清晰度: clear
前置要求: basic understanding of Pinot indexingaccess to documentation and issues
新手友善度: 65
研究方向: Review the existing documentation links and related issues (e.g., #6431, #13504) to understand current index freshness information. Then, study the code for each index type (e.g., text, inverted, star tree) to describe update mechanisms. Compile findings into a table or overview section in the documentation.