Bug: Redis connection pool exhaustion on /downloads/ endpoint under high concurrency
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 38/100
- Issue 类型
- 缺陷
- 描述清晰度
- 需要澄清
- 活跃度
- 冷清
- 技术栈
- python, redis
- 领域
- backend, performance
调研方向
首先检查 gunicorn.conf、apps/downloads/views.py 和 config/settings/cache.py，然后使用应用程序的 Redis 连接指标和日志检查并发行为。确认 downloads 端点是否耗尽其连接池，并在 Redis 或 Celery 工作上发生阻塞。完成的标准是：突发流量不再导致报告中的资源耗尽、延迟或连接错误，并且在 Redis 承受压力时仍可获取缓存的统计信息。
由索引模型根据 Issue 内容生成。
描述
Describe the bug
Under high concurrency conditions, particularly during new Python release events, the /downloads/ endpoint may experience Redis connection pool exhaustion. The application is configured with gunicorn.conf setting workers = 2, which creates a bottleneck when combined with synchronous Redis operations in the downloads view.
This manifests as increased tail latency and potential redis.exceptions.ConnectionError entries in application logs during traffic spikes.
To Reproduce
- Access https://www.python.org/downloads/ during a high-traffic event (e.g., new Python release announcement)
- Monitor response times and Redis connection metrics via application monitoring
- Observe elevated error rates and latency under sustained concurrent requests
Expected behavior
- Connection pooling should gracefully handle burst traffic without exhaustion
- Stale-while-revalidate caching pattern should serve cached download statistics when Redis is under pressure
- Celery tasks triggered from download views should be truly asynchronous, not blocking Redis operations on the main request thread
URL to the issue
https://www.python.org/downloads/
Screenshots
N/A (requires production monitoring access: Datadog dashboards, Sentry error logs, or Redis connection pool metrics)
Browsers
Microsoft Edge
Operating System
Windows
Browser Version
N/A
Relevant log output
# Example of expected log entry during pool exhaustion (needs verification in production):
redis.exceptions.ConnectionError: Connection pool exhausted. Unable to acquire connection within timeout.
# Relevant files for investigation:
# - gunicorn.conf (workers = 2)
# - apps/downloads/views.py
# - config/settings/cache.py
Additional context
Recent PR #2764 added a sitetree cache purge command to the Makefile, indicating the team's awareness of caching best practices. Similar patterns should be applied to high-traffic endpoints like /downloads/. Django cache framework documentation recommends connection pooling for production deployments. The project's dependency modernization efforts (e.g., pygments bump in PR #2977) suggest the team is actively maintaining performance-critical components.
- 主要语言
- Python
- 星标
- 1.7k
- 派生
- 705
- 平均合并
- 1 天 2 小时
- 30 天内合并 PR
- 38
环境准备
- 提供 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 没有贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
python/pythondotorg 的其他 Issue
-
bug
难度 1/5 1 小时以内 新手友好度 88/100
python/pythondotorg#3149 · 2 条评论 ·
维护者通常 1 天内回复
-
app/pages bug
难度 2/5 1-3 小时 新手友好度 68/100
python/pythondotorg#2677 · 3 条评论 ·
维护者通常 1 天内回复
-
Provide email address for reaching PSF Board members可能重新可做 @Gezahegne 于 125 天前认领，目前没有进行中的 PR。 未关闭backend easy
难度 2/5 1-3 小时 新手友好度 74/100
python/pythondotorg#2453 · 8 条评论 ·
维护者通常 1 天内回复
-
bug
难度 4/5 1-2 天 新手友好度 12/100
python/pythondotorg#3185 · 2 条评论 ·
维护者通常 1 天内回复
-
Migrate away from EthicalAds可能已有人在做 @JacobCoffee 于 3 天前认领。 未关闭
难度 4/5 3-5 天 新手友好度 25/100
python/pythondotorg#3176 · 1 条评论 ·
维护者通常 1 天内回复
查看 python/pythondotorg 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 72/100
NousResearch/hermes-agent#136483 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 88/100
维护者通常 1 天内回复
-
[BUG] LazyStackedTensorDictStore zeroes the last byte of a new key set on the last element可能已有人在做 @peterdsharpe 今天认领。 未关闭bug
难度 2/5 1-3 小时 新手友好度 78/100
pytorch/tensordict#2307 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 78/100
维护者通常 1 天内回复
-
GrokModel.generate/a_generate pass an OpenAI-style list-of-dicts to xai_sdk.chat.user(), so every call crashes with a protobuf TypeError before any network I/O可能已有人在做 @Christian-Sidak 今天认领。 未关闭
难度 2/5 1-3 小时 新手友好度 70/100
confident-ai/deepeval#3436 · 1 条评论 ·
维护者通常 1 天内回复