compact: build the successor in a private directory and publish it atomically
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 35/100
- Issue 类型
- 缺陷
- 描述清晰度
- 描述清楚
- 活跃度
- 活跃
- 技术栈
- javascript, node.js
调研方向
Start with okf/faces/lib/compact.js and read guardCompactPaths(), claimDir(), and the staging and cleanup flow. The issue also identifies Bundle.init and the sign callback as key points to trace. Add the three listed race tests, then verify that compaction refuses a changed destination and cleanup preserves replacement directories and files.
由索引模型根据 Issue 内容生成。
描述
Summary
compact() in okf/faces/lib/compact.js (branch feat/okf-autobee-v2) checks its paths once, then writes into them in place. Another process that writes into the out-dir or the staging path while a compaction runs can lose its files. The review of the compaction hardening (T13 to T18) found two such races. The owner accepted both for the first release, as a fast follow after the branch lands.
The two races
- The out-dir check expires before the store opens.
guardCompactPaths()refuses a non-empty out-dir before the face step. Compaction then materializes, stages and awaits thesigncallback. If another process creates the out-dir and writes a file into it during that window,claimDir()accepts the directory, andBundle.init(Corestore) clears it. The foreign file is gone, and compaction reports success. - Cleanup equates a path name with ownership. On a failure, compaction removes the stage when
ownStageis true, andclaimDir().release()removes the out-dir or the entries that it did not see at claim time. If another process replaced the stage directory, or added a file to the out-dir after the claim, cleanup deletes that directory or file.
Both races need a concurrent writer on the same paths. A single user on one machine who runs one compaction at a time does not meet them.
The full fix
- Build the successor in a private directory that compaction creates exclusively, for example
mkdtemp(<out-dir>.compact-build-), beside the out-dir. - Stage, ingest and verify there. Close the successor vault.
- Publish with an atomic rename onto the out-dir. On POSIX,
rename(2)of a directory fails withENOTEMPTYorEEXISTwhen the destination is not empty, so a changed destination is refused, never cleared. - Reopen the published vault at the out-dir and return it.
compact()then returns a vault that it reopened, not the one that it built. That is an API change for callers that hold the build path. - Cleanup removes only the private build directory and the stage that this run created. Record the device and inode of each created directory, and refuse to remove a path whose identity changed.
Tests to add
- A
signcallback that creates the out-dir and writes a file into it: compaction refuses, and the file stays. - A stage replaced between staging and a failure: the replacement stays.
- A file added to the out-dir after the claim, then an init failure: the file stays.
- 主要语言
- JavaScript
- 星标
- 0
- 派生
- 0
- PR 合并指标
- 30 天内没有已合并 PR
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南,环境需要你自己搭建:先看它的 README,通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
indexzero/hyperdown 的其他 Issue
-
难度 5/5 一周以上 新手友好度 25/100
-
okf: align with upstream OKF v0.2 — vault→bundle vocabulary migration + conformance audit (ADR-009)未关闭
难度 5/5 一周以上 新手友好度 25/100
查看 indexzero/hyperdown 的全部 Issue
相似的 Issue
-
bug documentation
难度 1/5 1 小时以内 新手友好度 88/100
awslabs/visual-asset-management-system#880 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 74/100
维护者通常 1 天内回复
-
possible bug
难度 2/5 1-3 小时 新手友好度 85/100
Mintplex-Labs/anything-llm#6889 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 78/100
swc-project/swc-next#1165 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 78/100
nhsuk/nhsuk-prototype-kit-package#439 ·
维护者通常 1 天内回复