Research: demonstrate if parallel SQL queries are worthwhile · simonw/datasette#1727 | Good First Issue

(32 评论) (0 反应) (0 负责人)Python (625 fork)batch import

help wantedresearch

仓库指标

Star: (8,637 star)
PR 合并指标: (平均合并 67天 23小时) (30 天内合并 19 个 PR)

描述

I added parallel SQL query execution here:

https://github.com/simonw/datasette/issues/1723

My hunch is that this will take advantage of multiple cores, since Python's sqlite3 module releases the GIL once a query is passed to SQLite.

I'd really like to prove this is the case though. Just not sure how to do it!

Larger question: is this performance optimization actually improving performance at all? Under what circumstances is it worthwhile?

贡献者指南

研究方向: 设计一个基准测试，比较并行和非并行情况下的查询执行时间。利用SQLite的线程模型并测量CPU利用率来确认GIL是否释放。测试不同类型的查询（例如简单SELECT、复杂JOIN）和数据库大小。记录结果以指导优化决策。
技术栈: python
领域: backend
议题类型: 调研
难度: 3
预计时间: 半天
活动状态: 活跃
清晰度: 基本清晰
前置要求: PythonSQLPerformance testing
新手友好度: 60