yugabyte/yugabyte-db

[YSQL] Parallelize postgres build make invocations

Open

#27,196 opened on May 15, 2025

View on GitHub
 (7 comments) (0 reactions) (0 assignees)C (8,229 stars) (1,003 forks)batch import
area/ysqlgood first issuehelp wantedkind/enhancementpriority/mediumstatus/awaiting-triage

Description

Jira Link: DB-16682

Description

python/yugabyte/build_postgres.py make_postgres calls make in various subdirectories. After self.pg_build_root, the remaining items can be parallelized (or could everything be parallelized?). Perhaps all that's needed is some python multithreading.

Issue Type

kind/enhancement

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.

Contributor guide

Tech stack
pythonshell
Domain
build systemperformance
Issue type
performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Basic PythonUnderstanding of make
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60
Research direction
Examine python/yugabyte/build postgres.py, specifically the make postgres function, to identify which make invocations can be parallelized. Consider using Python's concurrent.futures or threading module. Ensure that parallelization does not cause race conditions or dependency issues. Review existing comments in the issue for any additional constraints.