--source: the tmpbin python -> python2 link breaks in several setups
维护者通常 1 天内回复
评估
- 难度
- 3/5
- 预计耗时
- 1-2 天
- 新手友好度
- 42/100
- Issue 类型
- 缺陷
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 领域
- build-system
调研方向
The bug is in build_node_from_src in nodeenv.py, which looks up python2 and links it as tmpbin/python. Start by running the issue's reproduction script against that function, once per case, to see each failure. Done means the five cases (python2.7 only, dangling link, stale link, pyenv-style shim, relative PATH entry) either build or fail with a clear message, and the fix settles whether the link approach should change.
由索引模型根据 Issue 内容生成。
描述
On Python 3, build_node_from_src looks up python2 and points python at it through a link in tmpbin (master, ecb4b74):
python2_path = shutil.which('python2')
if not python2_path:
raise OSError(
'Python >=3.0 virtualenv detected, but no python2 '
'command (required for building node.js) was found'
)
logger.debug(' * Temporarily pointing python to %s', python2_path)
node_tmpbin_dir = join(src_dir, 'tmpbin')
node_tmpbin_link = join(node_tmpbin_dir, 'python')
mkdir(node_tmpbin_dir)
if not os.path.exists(node_tmpbin_link):
callit(['ln', '-s', python2_path, node_tmpbin_link])
env['PATH'] = '{}:{}'.format(node_tmpbin_dir,
os.environ.get('PATH', ''))
PR #429 keeps this code for node.js before 13 (the lookup) and before 8.8 (the link). It breaks in these cases:
- Only
python2.7is on PATH. A Python 2.7 installed withmake altinstallhaspython2.7but nopython2. nodeenv raises the "no python2 command" error, although node's own./configurewrapper (6.12+ / 8.5+) triespython2.7first. - A dangling
tmpbin/pythonfrom an earlier run.srcis kept after a failed build or with--no-clean-src, and--forcereuses it.os.path.existsfollows the link, so once the old python2 is gone,ln -sfails withFile exists. - A stale
tmpbin/pythonfrom an earlier run. If the old target still exists, the build uses it instead of the python2 found now. - python2 is a pyenv shim. pyenv shims pick the program by their own name (
program="${0##*/}", thenpyenv exec "$program"), so a link namedpythonto~/.pyenv/shims/python2runspyenv exec python. With e.g.pyenv global 3.12.0 2.7.18that is Python 3.12. - A relative PATH entry.
shutil.whichreturns a relative path (bin/python2), andln -sstores it relative totmpbin/, so the link dangles and./configurecan't findpython.
The link is also made by running ln -s through callit, while the rest of the module uses os.symlink.
Reproduce
On master (ecb4b74) on macOS, where /usr/bin has no python2, with fake scripts in place of node's configure, make and python2. Run from a nodeenv checkout:
T=/tmp/y; mkdir -p $T
git show ecb4b74:nodeenv.py > $T/nodeenv.py
PY=$(command -v python3)
mkscript() { mkdir -p "$(dirname "$1")"; printf '#!/bin/sh\n%s\n' "$2" > "$1"; chmod +x "$1"; }
mkscript $T/tools/make 'exit 0'
mkscript $T/py27/python2.7 'echo "python2.7 runs"'
mkscript $T/py2old/python2 'echo "OLD python2 runs"'
mkscript $T/py2new/python2 'echo "NEW python2 runs"'
mkscript $T/shims/python2 'echo "shim dispatches to: ${0##*/}"'
# every case gets a node source dir whose configure runs `python`
newcase() { mkscript $T/$1/src/node-src/configure 'exec python'; }
cat > $T/run.py <<'EOF'
import sys, types
sys.path.insert(0, '/tmp/y')
import nodeenv
work = sys.argv[1]
args = types.SimpleNamespace(load_average=None, jobs='2', without_ssl=False,
debug=False, profile=False, make_path='/tmp/y/tools/make', verbose=True)
try:
nodeenv.build_node_from_src(work + '/env', work + '/src', work + '/src/node-src', args)
except OSError as e:
print('OSError:', e)
EOF
- Only
python2.7:
newcase c1
env PATH="$T/py27:/usr/bin:/bin" $PY $T/run.py $T/c1
OSError: Python >=3.0 virtualenv detected, but no python2 command (required for building node.js) was found
- Dangling link:
newcase c2; mkdir -p $T/c2/src/tmpbin; ln -s $T/gone/python2 $T/c2/src/tmpbin/python
env PATH="$T/py2new:/usr/bin:/bin" $PY $T/run.py $T/c2
ln: /tmp/y/c2/src/tmpbin/python: File exists
OSError: Command ln -s /tmp/y/py2new/python2 /tmp/y/c2/src/tmpbin/python failed with error code 1
- Stale link:
newcase c3; mkdir -p $T/c3/src/tmpbin; ln -s $T/py2old/python2 $T/c3/src/tmpbin/python
env PATH="$T/py2new:/usr/bin:/bin" $PY $T/run.py $T/c3
OLD python2 runs
- A shim that dispatches on its name like pyenv's:
newcase c4
env PATH="$T/shims:/usr/bin:/bin" $PY $T/run.py $T/c4
shim dispatches to: python
- Relative PATH entry:
newcase c5; mkscript $T/c5/bin/python2 'echo "python2 runs"'
(cd $T/c5 && env PATH="bin:/usr/bin:/bin" $PY $T/run.py $T/c5)
readlink $T/c5/src/tmpbin/python
./configure: line 2: exec: python: not found
OSError: Command ./configure --prefix=/tmp/y/c5/env failed with error code 127
bin/python2
- 主要语言
- Python
- 星标
- 1.8k
- 派生
- 225
- 平均合并
- 17 小时 18 分钟
- 30 天内合并 PR
- 26
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南,环境需要你自己搭建:先看它的 README,通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
ekalinin/nodeenv 的其他 Issue
-
README config example breaks when copied into ~/.nodeenvrc可能已有人在做 @jihtsan 于 9 天前认领。 未关闭docs
难度 1/5 1 小时以内 新手友好度 90/100
维护者通常 1 天内回复
-
activate.fish erases a pre-existing NODE_PATH and never restores it可能已有人在做 @jihtsan 于 9 天前认领。 未关闭bug
难度 2/5 1-3 小时 新手友好度 86/100
维护者通常 1 天内回复
-
难度 3/5 1-2 天 新手友好度 50/100
维护者通常 1 天内回复
-
--source passes --make, --jobs and --load-average to the shell unquoted可能已有人在做 @jihtsan 于 9 天前认领。 未关闭
难度 2/5 1-3 小时 新手友好度 35/100
维护者通常 1 天内回复
-
难度 5/5 一周以上 新手友好度 25/100
ekalinin/nodeenv#416 · 3 条评论 ·
维护者通常 1 天内回复
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 78/100
维护者通常 6 天内回复
-
github_actions
难度 2/5 1-3 小时 新手友好度 65/100
collective/icalendar#2003 · 1 条评论 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 79/100
-
难度 2/5 1-3 小时 新手友好度 68/100
openzim/python-scraperlib#360 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 82/100
volcengine/OpenViking#6445 ·
维护者通常 1 天内回复