BiocParallel does not keep logs during job failure
@nturaga ya está trabajando en esto.
Desde el 6/9/2019.
Evaluación
Este issue todavía no se ha evaluado.
Descripción
Hello,
I am currently running a parallel jobs (with bplapply) on an LSF cluster using BatchToolsParam and I found an issue where there are no logs produced in runs that have a few jobs failing.
Here is the error log from the failed run:
Quitting from lines 86-88 (demultiplex.Rmd)
Error in .reduceResultsList(ids, fun, ..., missing.val = missing.val, :
All jobs must be have been successfully computed
Calls: <Anonymous> ... bplapply -> bplapply -> <Anonymous> -> .reduceResultsList
Execution halted
When I tried to check the logs from the batchtools jobs, I noticed that there was no logs being produced at all which made figuring out the reason for the job failures difficult. I eventually managed to capture the logs manually by copying the temporary registry directory before the bplapply job finishes, where I found that the cause of the job failure is due to a missing executable in a few of the cluster nodes, resulting in the job exiting before R was even executed.
It would be really useful to actually be able to get the logs from the batchtools jobs even if some of the jobs failed to execute R, especially in LSF cluster as the logs contain the job execution information.
- Lenguaje dominante
- R
- Estrellas
- 69
- Forks
- 32
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de Bioconductor/BiocParallel
-
Dificultad 3/5 1-2 días Aptitud para principiantes 65/100
Bioconductor/BiocParallel#286 · 1 comentario ·
-
Dificultad 3/5 1-2 días Aptitud para principiantes 50/100
Bioconductor/BiocParallel#285 ·
-
Bioconductor/BiocParallel#284 · 2 comentarios · 1 asignado ·
-
Dificultad 4/5 3-5 días Aptitud para principiantes 25/100
Bioconductor/BiocParallel#283 · 2 comentarios ·
-
DoparParam: Captured stdout is relayed to stdout for some foreach adapters and stderr for others Abierto
Dificultad 4/5 3-5 días Aptitud para principiantes 35/100
Bioconductor/BiocParallel#277 ·
Todos los issues de Bioconductor/BiocParallel
Issues similares
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
easystats/performance#950 ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
briandconnelly/airnow#9 ·
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
-
Copy cohorts to keep old cohorts Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
OHDSI/CohortConstructor#774 ·