Messures and Doc for index freshness/update · apache/pinot#14371

(2 comments) (0 reactions) (1 assignee)Java (4,937 stars) (1,234 forks)batch import

documentationgood first issue

説明

A part of Pinots secret sauce for speed are indexes. Is there any info available what index freshness/delay is achievable for newly ingested data / just changed data (upsert) for the different kinds of indexes? on how this could be improved/reduced? On how index updating works for each type?

of course I found

some info snippets in some issues in this field:
- https://github.com/apache/pinot/issues/6431
- https://github.com/apache/pinot/issues/13504
some sentence on it in the doc for native text index https://docs.pinot.apache.org/basics/indexing/native-text-index
etc

but no overview / table summing this topic up.

コントリビューターガイド

技術スタック: java
領域: documentationdatabaseperformance
Issue 種別: documentation
難度: 2
推定時間: 1-3 hours
活動状況: active
明確さ: clear
前提条件: basic understanding of Pinot indexingaccess to documentation and issues
初心者向け度: 65
調査方針: Review the existing documentation links and related issues (e.g., #6431, #13504) to understand current index freshness information. Then, study the code for each index type (e.g., text, inverted, star tree) to describe update mechanisms. Compile findings into a table or overview section in the documentation.