opensearch-project/OpenSearch
Auf GitHub ansehen[Feature Request] [Remote Store] Make metadata store independent of data store
Open
#12.919 geöffnet am 26. März 2024
Storage:Remoteenhancementgood first issue
Repository-Metriken
- Stars
- (8.123 Stars)
- PR-Merge-Metriken
- (Durchschn. Merge 5T 9h) (266 gemergte PRs in 30 T)
Beschreibung
Is your feature request related to a problem? Please describe
- Currently, when we configure remote store for a cluster, both data and metadata (of segment, translog and cluster state) is stored in the same store.
- But the access pattern and consistency requirements for data and metadata are different.
- For example, data files are uploaded and downloaded by providing a filename whereas metadata is fetched based on certain characteristics such as recency.
- Due to these differences, it is possible that metadata can be stored in a different data store (for example, a key-value store) as we store the data files in a blob store.
Describe the solution you'd like
The ideal solution should allow configuring a different remote store for metadata.
Related component
Storage:Remote
Describe alternatives you've considered
No response
Additional context
No response