Build process takes over all resources

Open
#92 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
45/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
cmake, python
Domain
build-system

Research direction

Look at the pyproject.toml and CMakeLists.txt to understand the build process. The issue mentions CMake and ninja; check if there are flags to limit parallelism or memory usage. The logs show a Python version mismatch for numpy; verify the environment and dependencies. Test building the ggml-python wheel locally with resource constraints.

Written by the indexing model from the issue text.

Description

I was trying to install the dependencies for tinygrad, but when the instalation process reaches the step of building the ggml wheel it takes over all of my resources and freezes my computer.

Here are the logs:

pip install ggml-python --verbose --no-cache-dir --force-reinstall --upgrade Using pip 24.3.1 from /home/andre/miniconda3/envs/tiny/lib/python3.12/site-packages/pip (python 3.12) Collecting ggml-python Downloading ggml_python-0.0.37.tar.gz (1.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 7.7 MB/s eta 0:00:00 Running command pip subprocess to install build dependencies Using pip 24.3.1 from /home/andre/miniconda3/envs/tiny/lib/python3.12/site-packages/pip (python 3.12) Collecting scikit-build-core>=0.5.1 (from scikit-build-core[pyproject]>=0.5.1) Obtaining dependency information for scikit-build-core>=0.5.1 from https://files.pythonhosted.org/packages/88/fe/90476c4f6a1b2f922efa00d26e876dd40c7279e28ec18f08f0851ad21ba6/scikit_build_core-0.10.7-py3-none-any.whl.metadata Using cached scikit_build_core-0.10.7-py3-none-any.whl.metadata (21 kB) Collecting packaging>=21.3 (from scikit-build-core>=0.5.1->scikit-build-core[pyproject]>=0.5.1) Obtaining dependency information for packaging>=21.3 from https://files.pythonhosted.org/packages/88/ef/eb23f262cca3c0c4eb7ab1933c3b1f03d021f2c48f54763065b6f0e321be/packaging-24.2-py3-none-any.whl.metadata Using cached packaging-24.2-py3-none-any.whl.metadata (3.2 kB) Collecting pathspec>=0.10.1 (from scikit-build-core>=0.5.1->scikit-build-core[pyproject]>=0.5.1) Obtaining dependency information for pathspec>=0.10.1 from https://files.pythonhosted.org/packages/cc/20/ff623b09d963f88bfde16306a54e12ee5ea43e9b597108672ff3a408aad6/pathspec-0.12.1-py3-none-any.whl.metadata Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) Using cached scikit_build_core-0.10.7-py3-none-any.whl (165 kB) Using cached packaging-24.2-py3-none-any.whl (65 kB) Using cached pathspec-0.12.1-py3-none-any.whl (31 kB) Installing collected packages: pathspec, packaging, scikit-build-core Successfully installed packaging-24.2 pathspec-0.12.1 scikit-build-core-0.10.7 Installing build dependencies ... done Running command Getting requirements to build wheel Could not determine CMake version via --version, got '' 'Traceback (most recent call last):\n File "/home/andre/.local/bin/cmake", line 5, in <module>\n from cmake import cmake\nModuleNotFoundError: No module named \'cmake\'\n' Getting requirements to build wheel ... done Running command pip subprocess to install backend dependencies Using pip 24.3.1 from /home/andre/miniconda3/envs/tiny/lib/python3.12/site-packages/pip (python 3.12) Collecting cmake>=3.21 Obtaining dependency information for cmake>=3.21 from https://files.pythonhosted.org/packages/b8/8d/a7cf7573df4c67de7cb4b2e36cfc790462b90813baa14604c3693a23d89b/cmake-3.31.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Using cached cmake-3.31.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB) Collecting ninja>=1.5 Obtaining dependency information for ninja>=1.5 from https://files.pythonhosted.org/packages/62/54/787bb70e6af2f1b1853af9bab62a5e7cb35b957d72daf253b7f3c653c005/ninja-1.11.1.2-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata Using cached ninja-1.11.1.2-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB) Using cached cmake-3.31.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (27.8 MB) Using cached ninja-1.11.1.2-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB) Installing collected packages: ninja, cmake changing mode of /tmp/pip-build-env-_2alanid/normal/bin/ccmake to 775 changing mode of /tmp/pip-build-env-_2alanid/normal/bin/cmake to 775 changing mode of /tmp/pip-build-env-_2alanid/normal/bin/cpack to 775 changing mode of /tmp/pip-build-env-_2alanid/normal/bin/ctest to 775 Successfully installed cmake-3.31.1 ninja-1.11.1.2 Installing backend dependencies ... done Running command Preparing metadata (pyproject.toml) *** scikit-build-core 0.10.7 using CMake 3.31.1 (metadata_wheel) Preparing metadata (pyproject.toml) ... done Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/3a/be/650f9c091ef71cb01d735775d554e068752d3ff63d7943b26316dc401749/numpy-1.21.2.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11) Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/5f/d6/ad58ded26556eaeaa8c971e08b6466f17c4ac4d786cd3d800e26ce59cc01/numpy-1.21.3.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11) Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/fb/48/b0708ebd7718a8933f0d3937513ef8ef2f4f04529f1f66ca86d873043921/numpy-1.21.4.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11) Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/c2/a8/a924a09492bdfee8c2ec3094d0a13f2799800b4fdc9c890738aeeb12c72e/numpy-1.21.5.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11) Link requires a different Python (3.12.3 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/45/b7/de7b8e67f2232c26af57c205aaad29fe17754f793404f59c8a730c7a191a/numpy-1.21.6.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11) Collecting numpy>=1.20.0 (from ggml-python) Obtaining dependency information for numpy>=1.20.0 from https://files.pythonhosted.org/packages/9e/3e/3757f304c704f2f0294a6b8340fcf2be244038be07da4cccf390fa678a9f/numpy-2.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Downloading numpy-2.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB) Collecting typing_extensions>=4.6.3 (from ggml-python) Obtaining dependency information for typing_extensions>=4.6.3 from https://files.pythonhosted.org/packages/26/9f/ad63fc0248c5379346306f8668cda6e2e2e9c95e01216d2b8ffd9ff037d0/typing_extensions-4.12.2-py3-none-any.whl.metadata Downloading typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB) Downloading numpy-2.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.0/16.0 MB 4.4 MB/s eta 0:00:00 Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB) Building wheels for collected packages: ggml-python Running command Building wheel for ggml-python (pyproject.toml) *** scikit-build-core 0.10.7 using CMake 3.31.1 (wheel) *** Configuring CMake...

Any help would be greatly appreciated.

Dominant language
Python
Stars
152
Forks
16
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from abetlen/ggml-python

All issues in abetlen/ggml-python

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.