Enhancement request: Trigger `populate_purldb` pipeline in ScanCode.io on SBOM import
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
调研方向
首先跟踪 SBOM 导入入口以及名为 load_sbom 和 populate_purldb 的 pipeline;先验证 ScanCode.io 依赖问题 #1644。然后梳理 web/API 选项、PurlDB 完成、Improve Packages from PurlDB 以及后续扫描流程。配置的导入能够在无需手动操作 ScanCode.io 的情况下完成这些步骤,即视为完成。
由索引模型根据 Issue 内容生成。
描述
Is your enhancement request related to a problem? Please describe.
Currently DejaCode has trouble getting all necessary information for scanning package that have been imported from SBOMs. Most often not enough information are present to deduce the download URL. For references, see issues such as:
- https://github.com/aboutcode-org/dejacode/issues/121
- https://github.com/aboutcode-org/dejacode/issues/258
- https://github.com/aboutcode-org/dejacode/issues/256
The issue stems from the fact the translation from PURL to URL is not always directly possible and may thus not be supported by purl2url and/or DejaCode is not using purl2url in all situations (it is used when manually adding a package but seemingly not when importing through SBOM). For example more elaborate logic is needed for Maven to determine what file needs to be downloaded, which may not be immediately clear from the PURL as the file could have a variety of potential file extensions. This issue can be addressed by using DejaCode, ScanCode.io, and PurlDB, where PurlDB is pulling the metadata of the package, which can then be used to enhance the package information in DejaCode.
Currently the step of gathering metadata for an SBOM requires manually creating an additional pipeline in ScanCode.io to run populate_purldb for the imported SBOM. My suggestion would be to offer an additional option for the SBOM import so that DejaCode triggers this pipeline automatically after running load_sbom. In a completely perfect solution, DejaCode would also allow to run "Improve Package from PurlDB" automatically, once PurlDB has concluded the gathering of metadata. This is needed to assign the download URLs to the package, otherwise the scanning of packages cannot be started
Note: For this to work, ScanCode.io first has to fix the bug in https://github.com/aboutcode-org/scancode.io/issues/1644 where populate_purldb fails if any dependencies are listed in the SBOM. This currently requires to manually edit the SBOM file and remove the dependencies array in the JSON file.
What are the benefits of the requested enhancement?
- Users can import SBOM and have packages analyzed straight from DejaCode, without requiring additional manual steps or access to ScanCode.io
- Allows fully automated CI/CD integration, where a product is created, SBOM uploads, metadata gathered and then all packages get scanned
Describe the solution you would like
- Extend the project that is being created in ScanCode.io by a
populate_purldbpipeline after theload_sbompipeline - Run "Improve Packages from PurlDB" once the PurlDB has gather the metadata (unclear if this is technically possible)
- Once the metadata has been added to the packages continue with scanning the packages
- Provide options in the web view and API to configure if these two options should be enabled for an SBOM import
Additional notes
This feature together with the fix for ScanCode.io would greatly help to integrate this an automated CI workflow.
- 主要语言
- Python
- 星标
- 52
- 派生
- 30
- 平均合并
- 4 小时 57 分钟
- 30 天内合并 PR
- 21
环境准备
- 提供 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
aboutcode-org/dejacode 的其他 Issue
-
DOC: Document workflow between ScanCode.io and DejaCode可能已有人在做 @tdruez 于 1 天前认领。 未关闭documentation
难度 3/5 1-2 天 新手友好度 55/100
aboutcode-org/dejacode#606 · 2 条评论 ·
维护者通常 1 天内回复
-
难度 4/5 3-5 天 新手友好度 45/100
aboutcode-org/dejacode#603 ·
维护者通常 1 天内回复
-
design needed enhancement
难度 3/5 1-2 天 新手友好度 62/100
aboutcode-org/dejacode#561 · 3 条评论 ·
维护者通常 1 天内回复
-
Enhancement request: Refine License Category - Copyleft Limited可能重新可做 @hesa 于 119 天前认领,目前没有进行中的 PR。 未关闭design needed enhancement
aboutcode-org/dejacode#499 · 13 条评论 · 已指派 3 人 ·
维护者通常 1 天内回复
-
BUG: Product overview page splits product with many versions across pages可能重新可做 关联的 PR 已关闭且未合并。 未关闭bug design needed enhancement
难度 3/5 1-2 天 新手友好度 45/100
aboutcode-org/dejacode#460 ·
维护者通常 1 天内回复
查看 aboutcode-org/dejacode 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 70/100
pydantic/pydantic-ai#12091 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 88/100
维护者通常 1 天内回复
-
CSS enhancement good first issue
难度 2/5 1-3 小时 新手友好度 70/100
pychess/pychess-variants#2448 ·
维护者通常 1 天内回复
-
Bump locked PyTensor so Apple clang 21 does not pass -ld64可能已有人在做 @drbenvincent 今天认领。 未关闭bug dev ops
难度 2/5 1-3 小时 新手友好度 70/100
维护者通常 2 天内回复
-
ai_p2 bug comp-datalake
难度 2/5 1-3 小时 新手友好度 85/100
ClickHouse/ClickHouse#128306 · 1 条评论 ·
维护者通常 1 天内回复