`parse python` panics in `LSPClient.Locate` (`slice bounds out of range`) when following imports into `.venv`
评估
调研方向
从 lang/lsp/lsp_methods.go:316 和 lang/collect/collect.go:2114 开始,然后在包含已填充 .venv 的 Python 3.12 项目中使用 abcoder parse python . -o /tmp/ast.json 重现。确认格式错误的范围不再导致 panic,并且受影响的 token 会被跳过或作为错误报告;比较使用 --exclude .venv 时的行为。
由索引模型根据 Issue 内容生成。
描述
parse python panics in LSPClient.Locate (slice bounds out of range [13:6]) when following imports into .venv
Repo: cloudwego/abcoder
Labels: bug, language/python, crash
Summary
When parsing a Python project whose source imports modules from a .venv/ containing Python 3.12 syntax that the bundled jedi 0.19.1 / parso 0.8.4 cannot fully parse, abcoder hard-crashes:
panic: runtime error: slice bounds out of range [13:6]
goroutine 1 [running]:
github.com/cloudwego/abcoder/lang/lsp.(*LSPClient).Locate(...)
/tmp/abcoder-build/lang/lsp/lsp_methods.go:316 +0x430
github.com/cloudwego/abcoder/lang/collect.(*Collector).getSymbolByLocation(...)
/tmp/abcoder-build/lang/collect/collect.go:2114 +0xe58
github.com/cloudwego/abcoder/lang/collect.(*Collector).getSymbolByTokenWithLimit(...)
github.com/cloudwego/abcoder/lang/collect.(*Collector).getDepsWithLimit(...)
github.com/cloudwego/abcoder/lang/collect.(*Collector).processSymbol(...)
/tmp/abcoder-build/lang/collect/collect.go:2245 +0x328
github.com/cloudwego/abcoder/lang/collect.(*Collector).Collect(...)
/tmp/abcoder-build/lang/collect/collect.go:206 +0x3c0
The panic is preceded by hundreds of warnings like:
[ERROR] collect.go:2306: get type symbol for token {file:///.../.venv/lib/python3.12/site-packages/redis/_parsers/socket.py:115:24-115:32 function [] readline} failed: definition of token ... not found
…and pylsp stderr noise from the pylsp_semantic_tokens hook:
WARNING - pylsp.config.config - Failed to load hook pylsp_semantic_tokens:
'Newline' object has no attribute 'children'
AttributeError in jedi/inference/syntax_tree.py:460 (infer_or_test)
jedi/parso returns a malformed range (start 13 > end 6), and lang/lsp/lsp_methods.go:316 slices a string with that range without bounds-checking → panic.
Reproduction
# Project: any Python 3.12 project with a populated .venv that contains
# files using PEP 701 f-strings or other 3.12-only syntax (e.g. attrs, redis).
abcoder parse python . -o /tmp/ast.json
# …jedi follows imports into .venv/...redis/_parsers/socket.py
# panic: runtime error: slice bounds out of range [13:6]
Expected
LSPClient.Locateshould validate theRangeit receives (Start <= End, both within document bounds) and return an error instead of panicking.- Higher up,
Collector.getSymbolByLocationshould swallow such errors as a "skip this token" rather than propagating a panic. - Optionally:
parse pythonshould default to excluding common virtualenv directories (.venv,venv,env) since they're never the parse target — they're only ever followed transitively, which is what triggers the bad ranges.
Workaround
Pass --exclude .venv (and any other vendored Python trees):
abcoder parse python . -o /tmp/ast.json --exclude .venv
Root cause notes (for triage)
The malformed range originates from jedi's syntax-tree inference on certain 3.12 constructs that parso 0.8.4 represents incorrectly (e.g. Newline nodes appearing where parso normally yields simple_stmt children). Bumping parso to ≥0.8.5 in the bundled pylsp fork's deps may eliminate the source — but the Go side should still bounds-check defensively.
Environment
- abcoder
v0.0.0-20260427034146-9d8ecc5873be+dirty - macOS 25.3.0 (arm64)
- jedi 0.19.1, parso 0.8.4 (in miniconda Python 3.10)
- Project: Python 3.12 with
.venvcontainingattrs,redis,pydantic, etc.
- 主要语言
- Go
- 星标
- 389
- 派生
- 58
- PR 合并指标
- 30 天内没有已合并 PR
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
cloudwego/abcoder 的其他 Issue
-
难度 4/5 3-5 天 新手友好度 42/100
-
难度 4/5 3-5 天 新手友好度 35/100
-
难度 3/5 1-2 天 新手友好度 55/100
-
难度 4/5 3-5 天 新手友好度 35/100
-
难度 2/5 1-3 小时 新手友好度 35/100
查看 cloudwego/abcoder 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 66/100
-
bug
难度 2/5 1-3 小时 新手友好度 78/100
signal18/replication-manager#1981 ·
维护者通常 1 天内回复
-
Battery UI: German word "Speicher"可能已有人在做 @github-actions 今天认领。 未关闭ux
难度 2/5 1-3 小时 新手友好度 68/100
维护者通常 1 天内回复
-
ready-for-agent
难度 2/5 1-3 小时 新手友好度 83/100
jasonfen/terminal-space-program#611 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 76/100
prime-radiant-inc/evener#4329 ·
维护者通常 1 天内回复