Research: demonstrate if parallel SQL queries are worthwhile · simonw/datasette#1727 | Good First Issue

(32 留言) (0 反應) (0 負責人)Python (625 fork)batch import

help wantedresearch

倉庫指標

Star: (8,637 star)
PR 合併指標: (平均合併 67天 23小時) (30 天內合併 19 個 PR)

描述

I added parallel SQL query execution here:

https://github.com/simonw/datasette/issues/1723

My hunch is that this will take advantage of multiple cores, since Python's sqlite3 module releases the GIL once a query is passed to SQLite.

I'd really like to prove this is the case though. Just not sure how to do it!

Larger question: is this performance optimization actually improving performance at all? Under what circumstances is it worthwhile?

貢獻者指南

研究方向: 設計一個基準測試，比較並行和非並行情況下的查詢執行時間。利用SQLite的線程模型並測量CPU利用率來確認GIL是否釋放。測試不同類型的查詢（例如簡單SELECT、複雜JOIN）和數據庫大小。記錄結果以指導優化決策。
技術棧: python
領域: backend
議題類型: 調研
難度: 3
預計時間: 半天
活動狀態: 活躍
清晰度: 大致清晰
前置要求: PythonSQLPerformance testing
新手友善度: 60