apache/pinot

Increase the latency of a query which has TIME as sorted column when ORDER BY TIME DESC is applied

Open

#6,970 opened on 2021年5月25日

GitHub で見る
 (4 comments) (0 reactions) (0 assignees)Java (1,234 forks)batch import
help wanted

Repository metrics

Stars
 (4,937 stars)
PR merge metrics
 (平均マージ 6d 7h) (30d で 186 merged PRs)

説明

Hi, There is usecase, where need to Increase the latency of a query which has ATIME as sorted column in a pinot table when ORDER BY ATIME DESC limit 100 is applied.

I've a select query which has ORDER BY ATIME ASC limit 100 is applied , then the the time taken for query is barely 15ms, (total rows - 450M, segments- 290, numOfDocsScanned - 318), where as for ORDER BY ATIME DESC limit 100 is taking around (timetaken -200ms, numDocsScanned - 5744955), which is very high, as it is reading whole segment.

Please provide a support reading the segment from bottom in this case, which can reduce the timetaken and numOfDocsScanned...

Thanks Akram Syed

コントリビューターガイド