envoyproxy/envoy

Bypass Ratelimit service , if Ratelimit svc healthcheck fails

Open

#22,398 opened on Jul 26, 2022

View on GitHub
 (2 comments) (0 reactions) (0 assignees)C++ (5,373 forks)batch import
area/ratelimithelp wantedquestion

Repository metrics

Stars
 (27,997 stars)
PR merge metrics
 (Avg merge 8d) (378 merged PRs in 30d)

Description

NOTE : This is not an issue . I am asking for a solution if anyone has implemented. I did not find any community group where I will ask for the solution. So posting here.

Hi All, My applications are running in Kubernets with ISTIO . I working on implementing ratelimiting using Envoy Filters.

I have deployed the Ratelimit service and Redis . http_health_check is configured for Ratelimit service and Redis healthcheck is implemented using REDIS_HEALTH_CHECK_ACTIVE_CONNECTION=true

We are facing an issue where , if Ratelimit service or Redis is down then latency is increased by the timeout configured for Ratelimit or Redis.

we are looking for a solution where : If the Ratelimit service is DOWN , then Envoy will not reach ratelimit service. It will bypass it and directly call the upstream.

Looking for suggestions and guidance .

Contributor guide

Research direction
Investigate Envoy's health check filter and rate limit filter configuration to allow fallback when upstream is unhealthy. Look into Envoy's circuit breaker and outlier detection settings that can bypass the rate limit service if it fails health checks.
Tech stack
None
Domain
infrastructure
Issue type
Research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
EnvoyKubernetesHealth check basics
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40