opensearch-project/OpenSearch

Rollover - min_docs condition

Open

#6,780 opened on Mar 21, 2023

View on GitHub
 (2 comments) (0 reactions) (1 assignee)Java (1,505 forks)batch import
CCIdistributed frameworkenhancementgood first issue

Repository metrics

Stars
 (8,123 stars)
PR merge metrics
 (Avg merge 5d 9h) (266 merged PRs in 30d)

Description

Is your feature request related to a problem? Please describe. Currently Rollover API supports maxAge, maxSize and maxDocs conditions. When maxAge condition is used we could easily get in situation where index is rolled over, even tho it had 0 or very few documents.

Describe the solution you'd like Add minDocs condition, which would prevent rollover until specified number of documents is present in index.

Describe alternatives you've considered call Search API to count documents in index, before calling Rollover API.

Additional context Alerting, SA and ISM plugins are using rollover API in its "index management job" logic for some plugin indices.

Contributor guide

Research direction
Examine the Rollover API implementation in OpenSearch to locate where maxAge, maxSize, and maxDocs conditions are evaluated. Add a new minDocs condition following the same pattern.
Tech stack
java
Domain
apibackend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
JavaOpenSearch
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70