elastic/elasticsearch

Reindex from remote support multiple nodes and failover

Open

#19 395 ouverte le 12 juil. 2016

Voir sur GitHub
 (14 commentaires) (0 réactions) (0 assignés)Java (25 882 forks)batch import
:Distributed/Reindex>enhancementTeam:Distributedgood first issuehelp wanted

Métriques du dépôt

Stars
 (76 700 stars)
Métriques de merge PR
 (Merge moyen 2j) (1 000 PRs mergées en 30 j)

Description

Currently, reindex from remote allows to configure one single host to send http requests to. In case of failure, there are cases (e.g. 429 response code for search) where we schedule a retry for the same request against the same node. We also have a backoff policy so that bulk failures get retried too.

I wonder if it makes sense to allow reindex from remote to either use the Sniffer and send requests to multiple nodes, or allow to configure multiple nodes, or both. In case multiple nodes are available, it makes much more sense to let the RestClient do the retries on a different node, then the current custom retry code would be less needed I think.

This issue is to discuss what makes sense to do in reindex from remote and whether we need to change anything there.

Guide contributeur