elastic/elasticsearch

ETA for Reindex API

Open

#76.904 aberto em 25 de ago. de 2021

Ver no GitHub
 (2 comments) (0 reactions) (0 assignees)Java (76.700 stars) (25.882 forks)batch import
:Distributed/Reindex>enhancementTeam:Distributedhelp wanted

Description

The get task API (e.g. GET _tasks/lOHn4ATPST6LfKCW6m539w:517820) should include an estimated time of completion where applicable.

Specifically when using the reindex API, I had to write myself a basic tool some time ago to estimate when the task would be completed using the total, created, updated, start_time_in_millis, and running_time_in_nanos properties. (Although I believe in cases where the reindex operation omits some documents, this may not even be sufficient!)

It would be great if this functionality was built into this API.

Guia do colaborador

Pilha de tecnologia
javarest api
Domain
apisearchobservability
Tipo Issue
feature
DifficultyDificuldade de implementação estimada para um novo contribuidor, de 1 para alterações muito pequenas a 5 para trabalho de nível especializado.
4
Tempo estimadoUm intervalo de tempo aproximado para um colaborador experiente investigar, implementar, testar e preparar um pull request.
over 1 week
Status da atividadeQuão disponível o issue aparece agora: novo, ativo, obsoleto, bloqueado ou aguardando entrada do mantenedor.
stale
ClarityCom que clareza o issue explica a mudança esperada, os critérios de aceitação e a próxima etapa.
mostly clear
Prerequisites
Elasticsearch task frameworkREST API endpointsJava concurrencyTime estimation logic
Simpatia para novatosUma pontuação de 1 a 100 que estima o quão acessível este issue é para colaboradores iniciantes.
20
Direção de pesquisa
Investigate the Elasticsearch task management system, specifically the get task API implementation at `GET tasks/{taskId}`. Understand how the reindex operation tracks progress using fields like `total`, `created`, `updated`, `start time in millis`, and `running time in nanos`. Research potential algorithms like exponential moving average to estimate ETA, considering that documents may be omitted. Review existing discussions in the issue and any linked resources. Look at the `TasksClient.java` and `TransportTasksAction.java` source files for implementation details. Proposing adding an `estimated completion time` field to the task response is a starting point.