BiocParallel does not keep logs during job failure
@nturaga 已经在做这个了。
开始于 2019年9月6日。
评估
这个 Issue 还没有评估数据。
描述
Hello,
I am currently running a parallel jobs (with bplapply) on an LSF cluster using BatchToolsParam and I found an issue where there are no logs produced in runs that have a few jobs failing.
Here is the error log from the failed run:
Quitting from lines 86-88 (demultiplex.Rmd)
Error in .reduceResultsList(ids, fun, ..., missing.val = missing.val, :
All jobs must be have been successfully computed
Calls: <Anonymous> ... bplapply -> bplapply -> <Anonymous> -> .reduceResultsList
Execution halted
When I tried to check the logs from the batchtools jobs, I noticed that there was no logs being produced at all which made figuring out the reason for the job failures difficult. I eventually managed to capture the logs manually by copying the temporary registry directory before the bplapply job finishes, where I found that the cause of the job failure is due to a missing executable in a few of the cluster nodes, resulting in the job exiting before R was even executed.
It would be really useful to actually be able to get the logs from the batchtools jobs even if some of the jobs failed to execute R, especially in LSF cluster as the logs contain the job execution information.
- 主要语言
- R
- 星标
- 69
- 派生
- 32
- PR 合并指标
- 30 天内没有已合并 PR
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南，环境需要你自己搭建：先看它的 README，通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
Bioconductor/BiocParallel 的其他 Issue
-
BatchtoolsParam handles reduce.in.order differently from others可能已有人在做 @LeonidasZhak 于 44 天前认领。 未关闭
难度 3/5 1-2 天 新手友好度 65/100
Bioconductor/BiocParallel#286 · 1 条评论 ·
-
难度 3/5 1-2 天 新手友好度 50/100
Bioconductor/BiocParallel#285 ·
-
futile.logger may be archived from CRAN可能重新可做 @Jiefei-Wang 于 281 天前认领，目前没有进行中的 PR。 未关闭
Bioconductor/BiocParallel#284 · 2 条评论 · 已指派 1 人 ·
-
难度 4/5 3-5 天 新手友好度 25/100
Bioconductor/BiocParallel#283 · 2 条评论 ·
-
DoparParam: Captured stdout is relayed to stdout for some foreach adapters and stderr for others未关闭
难度 4/5 3-5 天 新手友好度 35/100
Bioconductor/BiocParallel#277 ·
查看 Bioconductor/BiocParallel 的全部 Issue
相似的 Issue
-
Component: R
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 2 天内回复
-
bug pixi-build-r
难度 2/5 1-3 小时 新手友好度 70/100
prefix-dev/pixi#7229 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 78/100
-
难度 2/5 1-3 小时 新手友好度 72/100
rstudio/reticulate#1933 ·
-
难度 1/5 1 小时以内 新手友好度 62/100