trinodb/trino

DFs received by coordinator are unacked

Open

#5.429 geöffnet am 6. Okt. 2020

Auf GitHub ansehen
 (2 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Java (2.678 Forks)batch import
good first issue

Repository-Metriken

Stars
 (9.113 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 5T 9h) (306 gemergte PRs in 30 T)

Beschreibung

Currently, coordinator fetches DF delta between local version and worker version. Coordinator sends it's local version as part of DF request. Worker is free to remove stored DFs based on coordinator local version. However, coordinator does not acknowledge received DFs until next DF is available. Therefore workers can keep DFs locally longer then needed.

This can be resolved by worker artificially bumping DFs version until there are still unacknowledged DFs

Contributor Guide