Enhancement request: Trigger `populate_purldb` pipeline in ScanCode.io on SBOM import
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Aptitud para principiantes
- 25/100
Línea de trabajo
Comienza rastreando el punto de entrada de importación de SBOM y las canalizaciones denominadas load_sbom y populate_purldb; primero verifica el problema de dependencia de ScanCode.io #1644. Después, identifica las opciones web/API, la finalización de PurlDB, Improve Packages from PurlDB y el flujo de escaneo posterior. Se considera completado cuando la importación configurada completa estos pasos sin trabajo manual en ScanCode.io.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Is your enhancement request related to a problem? Please describe.
Currently DejaCode has trouble getting all necessary information for scanning package that have been imported from SBOMs. Most often not enough information are present to deduce the download URL. For references, see issues such as:
- https://github.com/aboutcode-org/dejacode/issues/121
- https://github.com/aboutcode-org/dejacode/issues/258
- https://github.com/aboutcode-org/dejacode/issues/256
The issue stems from the fact the translation from PURL to URL is not always directly possible and may thus not be supported by purl2url and/or DejaCode is not using purl2url in all situations (it is used when manually adding a package but seemingly not when importing through SBOM). For example more elaborate logic is needed for Maven to determine what file needs to be downloaded, which may not be immediately clear from the PURL as the file could have a variety of potential file extensions. This issue can be addressed by using DejaCode, ScanCode.io, and PurlDB, where PurlDB is pulling the metadata of the package, which can then be used to enhance the package information in DejaCode.
Currently the step of gathering metadata for an SBOM requires manually creating an additional pipeline in ScanCode.io to run populate_purldb for the imported SBOM. My suggestion would be to offer an additional option for the SBOM import so that DejaCode triggers this pipeline automatically after running load_sbom. In a completely perfect solution, DejaCode would also allow to run "Improve Package from PurlDB" automatically, once PurlDB has concluded the gathering of metadata. This is needed to assign the download URLs to the package, otherwise the scanning of packages cannot be started
Note: For this to work, ScanCode.io first has to fix the bug in https://github.com/aboutcode-org/scancode.io/issues/1644 where populate_purldb fails if any dependencies are listed in the SBOM. This currently requires to manually edit the SBOM file and remove the dependencies array in the JSON file.
What are the benefits of the requested enhancement?
- Users can import SBOM and have packages analyzed straight from DejaCode, without requiring additional manual steps or access to ScanCode.io
- Allows fully automated CI/CD integration, where a product is created, SBOM uploads, metadata gathered and then all packages get scanned
Describe the solution you would like
- Extend the project that is being created in ScanCode.io by a
populate_purldbpipeline after theload_sbompipeline - Run "Improve Packages from PurlDB" once the PurlDB has gather the metadata (unclear if this is technically possible)
- Once the metadata has been added to the packages continue with scanning the packages
- Provide options in the web view and API to configure if these two options should be enabled for an SBOM import
Additional notes
This feature together with the fix for ScanCode.io would greatly help to integrate this an automated CI workflow.
- Lenguaje dominante
- Python
- Estrellas
- 52
- Forks
- 30
- Merge medio
- 4 h 57 min
- PR fusionados (30 d)
- 21
Preparar el entorno
- Incluye un Dockerfile o un archivo de Docker Compose
- Tiene una plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de aboutcode-org/dejacode
-
DOC: Document workflow between ScanCode.io and DejaCodePosiblemente ocupada @tdruez la tomó hace 1 día. Abiertodocumentation
Dificultad 3/5 1-2 días Aptitud para principiantes 55/100
aboutcode-org/dejacode#606 · 3 comentarios ·
Los mantenedores suelen responder en 1 día
-
Dificultad 4/5 3-5 días Aptitud para principiantes 45/100
aboutcode-org/dejacode#603 ·
Los mantenedores suelen responder en 1 día
-
design needed enhancement
Dificultad 3/5 1-2 días Aptitud para principiantes 62/100
aboutcode-org/dejacode#561 · 3 comentarios ·
Los mantenedores suelen responder en 1 día
-
Enhancement request: Refine License Category - Copyleft LimitedQuizá libre de nuevo @hesa la tomó hace 119 días y no hay ningún pull request abierto. Abiertodesign needed enhancement
aboutcode-org/dejacode#499 · 13 comentarios · 3 asignados ·
Los mantenedores suelen responder en 1 día
-
BUG: Product overview page splits product with many versions across pagesQuizá libre de nuevo Un pull request para esta issue se cerró sin fusionarse. Abiertobug design needed enhancement
Dificultad 3/5 1-2 días Aptitud para principiantes 45/100
aboutcode-org/dejacode#460 ·
Los mantenedores suelen responder en 1 día
Todos los issues de aboutcode-org/dejacode
Issues similares
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 86/100
NousResearch/hermes-agent#147104 ·
Los mantenedores suelen responder en 1 día
-
[oblt-aw][autodoc] Document new required `shared-org-key` input for `obs-aw-dependency-review`Posiblemente ocupada @github-actions la tomó hoy. Abierto
Dificultad 1/5 Menos de una hora Aptitud para principiantes 90/100
Los mantenedores suelen responder en 1 día
-
bot-triaged module: inductor oncall: pt2 topic: fuzzer triaged
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
Los mantenedores suelen responder en 1 día
-
getchaintips leaves out the active tip once a header is staged on it, where Core always lists itAbierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 88/100
btclib-org/btclib-node#2158 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
patrick-hudson/put.gd-desktop#979 · 1 comentario ·
Los mantenedores suelen responder en 1 día