opensearch-project/OpenSearch

Skip metadata upload if no new segment files to upload during refresh for remote store clusters

Open

#17,530 建立於 2025年3月6日

在 GitHub 查看
 (10 留言) (0 反應) (1 負責人)Java (1,505 fork)batch import
Storage:Remoteenhancementgood first issue

倉庫指標

Star
 (8,123 star)
PR 合併指標
 (平均合併 5天 9小時) (30 天內合併 266 個 PR)

描述

Is your feature request related to a problem? Please describe

In the refresh flow of remote store indexes, we determine the files to be uploaded, upload them and then upload the associated metadata. This, however, uploads the metadata even when there is no new files to upload. This can be optimised and metadata upload can be skipped for such cases.

https://github.com/opensearch-project/OpenSearch/blob/3966ed93beb2ff13854d2a6e1ff51dfa32295830/server/src/main/java/org/opensearch/index/shard/RemoteStoreRefreshListener.java#L266C21-L292

Describe the solution you'd like

Optimise the segments upload flow to skip metadata upload when there are no newer segment files.

Related component

No response

Describe alternatives you've considered

No response

Additional context

No response

貢獻者指南