Rate-limit handling to count requests
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Aptitud para principiantes
- 35/100
Línea de trabajo
Start by reading BaseDAVClient._rate_limit_sleep_seconds() and the rate-limit decorator setup in tests/test_caldav.py around line 1412. Compare the existing reactive client behavior with the test framework’s fixed-delay behavior, then decide where request counting belongs. Done means the chosen approach respects the declared interval and count without delaying requests while budget remains.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Currently the rate-limit throttling is done very simple - if it's allowed, say, to send 30000 requests within a 30000 second window, it will sleep 1s between each request.
Two alternative methods should be considered:
- Send 30000 requests without any throttling, then sleep out the window.
- Send the first request without any throttling, then add a progressingly growing delay so that there will never be a long complete halt when the quota has been reached.
The description below was AI-generated and seems to follow the first
method suggested above.
There are two separate pieces of rate-limit machinery today, and neither counts
requests.
The client is purely reactive. BaseDAVClient._rate_limit_sleep_seconds()
only ever runs after the server has answered 429 (or 503 with Retry-After).
It sleeps Retry-After, or default_sleep, capped by max_sleep, and retries.
Nothing tracks how many requests have been sent, so the client walks into the
throttle every time and then waits it out.
The test framework throttles pre-emptively, with a fixed delay per request.
tests/test_caldav.py around line 1412:
foo = self.is_supported("rate-limit", dict)
if foo.get("enable"):
rate_delay = foo.get("interval", 0) / foo.get("count", 1)
self.caldav.request = _delay_decorator(self.caldav.request, t=rate_delay)
So a server declaring interval: 300, count: 1500 gets 300 / 1500 = 0.2
seconds of sleep before every request, including the first, when the whole
budget is still unspent. A run that makes a few thousand requests pays minutes
for it. For ecloud, which declares interval: 2, count: 1, it is 2 seconds per
request.
What it should do instead
Count. A token bucket, or simply a deque of the timestamps of requests inside
the window:
- under budget → send immediately, no sleep at all;
- budget spent → sleep exactly long enough for the oldest request in the window
to age out, not a fixed slice.
With 1500 per 300s that means the first 1500 requests go through at full speed
and only a run that genuinely exceeds the server's budget ever waits.
Where it belongs
Arguably in the client rather than the test framework, so that real users get it
too: a client that knows a server's published limits can stay under them instead
of discovering them through 429s. The test framework's decorator could then go
away. Deciding that is part of the issue - the rate-limit feature already
carries interval and count, and nothing outside the test suite reads them.
Noticed while adding a rate-limit declaration for OX (interval 300, count
1500), which switched that 0.2-second-per-request delay on for the whole OX test
run.
- Lenguaje dominante
- Python
- Estrellas
- 412
- Forks
- 113
- Merge medio
- 2 d 18 h
- PR fusionados (30 d)
- 15
Preparar el entorno
- Sin Dockerfile ni archivo de Docker Compose
- Sin plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de python-caldav/caldav
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 66/100
python-caldav/caldav#735 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 62/100
python-caldav/caldav#687 ·
Los mantenedores suelen responder en 1 día
-
iCloud: URL.join raises "can't be joined" when REPORT hrefs use caldav.icloud.com after client.url was rewritten to the pNN partition hostPosiblemente ocupada @tobixen la tomó hoy. Abierto
Dificultad 4/5 3-5 días Aptitud para principiantes 52/100
python-caldav/caldav#730 · 2 comentarios ·
Los mantenedores suelen responder en 1 día
-
Dificultad 4/5 3-5 días Aptitud para principiantes 48/100
python-caldav/caldav#725 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 3/5 1-2 días Aptitud para principiantes 48/100
python-caldav/caldav#720 ·
Los mantenedores suelen responder en 1 día
Todos los issues de python-caldav/caldav
Issues similares
-
Performance: deprecated DeviceEntry.config_entries access blocks the event loop for tens of secondsAbierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
tuya/tuya_cloud_ha_bridge#14 ·
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
semantica-agi/semantica#1968 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 62/100
Los mantenedores suelen responder en 1 día
-
agent: ready area: submission priority: high type: docs
Dificultad 2/5 1-3 horas Aptitud para principiantes 62/100
dkritarth/scopewatch#213 ·
Los mantenedores suelen responder en 1 día
-
Broken link in RELEASE.mdPosiblemente ocupada @Jah-yee la tomó hoy. Abierto
Dificultad 1/5 Menos de una hora Aptitud para principiantes 88/100
sphinx-contrib/httpdomain#143 ·
Los mantenedores suelen responder en 1 día