Cache refresh policies based on scancode CLI options/scancode output version updates

未关闭
#5,472 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 2 天内回复

还没有人认领这个 Issue。

评估

难度
5/5
预计耗时
一周以上
新手友好度
15/100
Issue 类型
功能
描述清晰度
需要澄清
活跃度
活跃
技术栈
python
领域
tooling

调研方向

The payload names no file or test, so start from the two linked threads: discussion r3948561703 on PR 5289 and issue 3941, which cover cache versioning. The open question is whether to hash the data fields and CLI options into the cache index path, and how stale-cache errors are handled. Maintainers need to settle that design before a patch is meaningful, so done means an agreed policy in the thread, not a code change yet.

由索引模型根据 Issue 内容生成。

描述

maintainers-only

From https://github.com/aboutcode-org/scancode-toolkit/pull/5289#discussion_r3948561703, as a follow up:

Should we include some functionality to re-compute the cache for a file based on data structure changes caused by different versions of scancode, or different CLI options used with different output data formats? There is some discussion on this at https://github.com/aboutcode-org/scancode-toolkit/issues/3941

We need to check that we atleast handle the errors resulting out of this. Additionally it would be nice to somehow include the data format versions in the index cache too, smartly avoiding cache recompute whenever possible.

Output data formats are not always changes based on scancode versions, and an update in the output data format version also doesn't correspond to updates in all the scanner output data. So we need to probably compute a hash based on all the data fields present for a particular scanner data based on the keys present in the mapping and include this in the index file path? This would cover both variations caused by scancode version changes and CLI options used.

主要语言
Python
星标
2.7k
派生
871
平均合并
1 天 10 小时
30 天内合并 PR
3

环境准备

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

aboutcode-org/scancode-toolkit 的其他 Issue

查看 aboutcode-org/scancode-toolkit 的全部 Issue

相似的 Issue

更多 Python Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。