Build process takes over all resources
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 45/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- cmake, python
- Domain
- build-system
Research direction
Look at the pyproject.toml and CMakeLists.txt to understand the build process. The issue mentions CMake and ninja; check if there are flags to limit parallelism or memory usage. The logs show a Python version mismatch for numpy; verify the environment and dependencies. Test building the ggml-python wheel locally with resource constraints.
Written by the indexing model from the issue text.
Description
I was trying to install the dependencies for tinygrad, but when the instalation process reaches the step of building the ggml wheel it takes over all of my resources and freezes my computer.
Here are the logs:
pip install ggml-python --verbose --no-cache-dir --force-reinstall --upgrade
Using pip 24.3.1 from /home/andre/miniconda3/envs/tiny/lib/python3.12/site-packages/pip (python 3.12)
Collecting ggml-python
Downloading ggml_python-0.0.37.tar.gz (1.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 7.7 MB/s eta 0:00:00
Running command pip subprocess to install build dependencies
Using pip 24.3.1 from /home/andre/miniconda3/envs/tiny/lib/python3.12/site-packages/pip (python 3.12)
Collecting scikit-build-core>=0.5.1 (from scikit-build-core[pyproject]>=0.5.1)
Obtaining dependency information for scikit-build-core>=0.5.1 from https://files.pythonhosted.org/packages/88/fe/90476c4f6a1b2f922efa00d26e876dd40c7279e28ec18f08f0851ad21ba6/scikit_build_core-0.10.7-py3-none-any.whl.metadata
Using cached scikit_build_core-0.10.7-py3-none-any.whl.metadata (21 kB)
Collecting packaging>=21.3 (from scikit-build-core>=0.5.1->scikit-build-core[pyproject]>=0.5.1)
Obtaining dependency information for packaging>=21.3 from https://files.pythonhosted.org/packages/88/ef/eb23f262cca3c0c4eb7ab1933c3b1f03d021f2c48f54763065b6f0e321be/packaging-24.2-py3-none-any.whl.metadata
Using cached packaging-24.2-py3-none-any.whl.metadata (3.2 kB)
Collecting pathspec>=0.10.1 (from scikit-build-core>=0.5.1->scikit-build-core[pyproject]>=0.5.1)
Obtaining dependency information for pathspec>=0.10.1 from https://files.pythonhosted.org/packages/cc/20/ff623b09d963f88bfde16306a54e12ee5ea43e9b597108672ff3a408aad6/pathspec-0.12.1-py3-none-any.whl.metadata
Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB)
Using cached scikit_build_core-0.10.7-py3-none-any.whl (165 kB)
Using cached packaging-24.2-py3-none-any.whl (65 kB)
Using cached pathspec-0.12.1-py3-none-any.whl (31 kB)
Installing collected packages: pathspec, packaging, scikit-build-core
Successfully installed packaging-24.2 pathspec-0.12.1 scikit-build-core-0.10.7
Installing build dependencies ... done
Running command Getting requirements to build wheel
Could not determine CMake version via --version, got '' 'Traceback (most recent call last):\n File "/home/andre/.local/bin/cmake", line 5, in <module>\n from cmake import cmake\nModuleNotFoundError: No module named \'cmake\'\n'
Getting requirements to build wheel ... done
Running command pip subprocess to install backend dependencies
Using pip 24.3.1 from /home/andre/miniconda3/envs/tiny/lib/python3.12/site-packages/pip (python 3.12)
Collecting cmake>=3.21
Obtaining dependency information for cmake>=3.21 from https://files.pythonhosted.org/packages/b8/8d/a7cf7573df4c67de7cb4b2e36cfc790462b90813baa14604c3693a23d89b/cmake-3.31.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached cmake-3.31.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB)
Collecting ninja>=1.5
Obtaining dependency information for ninja>=1.5 from https://files.pythonhosted.org/packages/62/54/787bb70e6af2f1b1853af9bab62a5e7cb35b957d72daf253b7f3c653c005/ninja-1.11.1.2-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata
Using cached ninja-1.11.1.2-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB)
Using cached cmake-3.31.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (27.8 MB)
Using cached ninja-1.11.1.2-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB)
Installing collected packages: ninja, cmake
changing mode of /tmp/pip-build-env-_2alanid/normal/bin/ccmake to 775
changing mode of /tmp/pip-build-env-_2alanid/normal/bin/cmake to 775
changing mode of /tmp/pip-build-env-_2alanid/normal/bin/cpack to 775
changing mode of /tmp/pip-build-env-_2alanid/normal/bin/ctest to 775
Successfully installed cmake-3.31.1 ninja-1.11.1.2
Installing backend dependencies ... done
Running command Preparing metadata (pyproject.toml)
*** scikit-build-core 0.10.7 using CMake 3.31.1 (metadata_wheel)
Preparing metadata (pyproject.toml) ... done
Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/3a/be/650f9c091ef71cb01d735775d554e068752d3ff63d7943b26316dc401749/numpy-1.21.2.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/5f/d6/ad58ded26556eaeaa8c971e08b6466f17c4ac4d786cd3d800e26ce59cc01/numpy-1.21.3.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/fb/48/b0708ebd7718a8933f0d3937513ef8ef2f4f04529f1f66ca86d873043921/numpy-1.21.4.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/c2/a8/a924a09492bdfee8c2ec3094d0a13f2799800b4fdc9c890738aeeb12c72e/numpy-1.21.5.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/45/b7/de7b8e67f2232c26af57c205aaad29fe17754f793404f59c8a730c7a191a/numpy-1.21.6.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
Collecting numpy>=1.20.0 (from ggml-python)
Obtaining dependency information for numpy>=1.20.0 from https://files.pythonhosted.org/packages/9e/3e/3757f304c704f2f0294a6b8340fcf2be244038be07da4cccf390fa678a9f/numpy-2.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading numpy-2.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Collecting typing_extensions>=4.6.3 (from ggml-python)
Obtaining dependency information for typing_extensions>=4.6.3 from https://files.pythonhosted.org/packages/26/9f/ad63fc0248c5379346306f8668cda6e2e2e9c95e01216d2b8ffd9ff037d0/typing_extensions-4.12.2-py3-none-any.whl.metadata
Downloading typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Downloading numpy-2.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.0/16.0 MB 4.4 MB/s eta 0:00:00
Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Building wheels for collected packages: ggml-python
Running command Building wheel for ggml-python (pyproject.toml)
*** scikit-build-core 0.10.7 using CMake 3.31.1 (wheel)
*** Configuring CMake...
Any help would be greatly appreciated.
- Dominant language
- Python
- Stars
- 152
- Forks
- 16
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from abetlen/ggml-python
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
abetlen/ggml-python#91 ·
-
Import error Open
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
abetlen/ggml-python#90 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
abetlen/ggml-python#93 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 30/100
abetlen/ggml-python#21 ·
-
Difficulty 5/5 Over a week Newbie friendliness 10/100
abetlen/ggml-python#20 ·
All issues in abetlen/ggml-python
Similar issues
-
triage/confirmed
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
agentscope-ai/agentscope#2775 ·
-
comp/desktop P3 type/bug
Difficulty 1/5 Under an hour Newbie friendliness 92/100
NousResearch/hermes-agent#118866 ·
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 90/100
apache/cloudstack#14222 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100