envoyproxy/envoy

Make grpc client cache eviction period configurable

Open

#29.982 geöffnet am 5. Okt. 2023

Auf GitHub ansehen
 (1 Kommentar) (0 Reaktionen) (0 zugewiesene Personen)C++ (5.373 Forks)batch import
area/ext_authzarea/grpcenhancementhelp wanted

Repository-Metriken

Stars
 (27.997 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 8T) (378 gemergte PRs in 30 T)

Beschreibung

Envoy is currently hardcoded to evict thread-local GRPC clients from its cache if there is no activity for 50s. Due to the low QPS and high number of Envoy worker threads, it is very easy to cross this interval between consecutive requests on the same worker thread. Hence, many authorization requests from worker threads will incur a connection restablishment latency, resulting in high client-side authorization delays.

To avoid this issue, we would like to be able to use a longer cache eviction timeout. It would be preferable if this timeout is configurable per proxy.

Contributor Guide