Very slow scheduling
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 25/100
- Issue 类型
- 缺陷
- 描述清晰度
- 需要澄清
- 活跃度
- 停滞
- 技术栈
- r
调研方向
首先查看 scheduling 选项以及任何 verbose 或 trace 标志的文档。在 Slurm 上使用小型作业重现该报告，并比较 scheduling 值和启动延迟。当隔离出 scheduling 缓慢的原因，并明确相应的行为或文档时，即视为完成。
由索引模型根据 Issue 内容生成。
描述
I am sorry to not have a reproducible example yet. My code base is very large and was running just fine until the job size became small. So I'll make a reproducible example after hearing some suggestions on what to test. In my case, the jobs are rather small - 10s each. The problem I'm seeing is they don't get scheduled very quickly. In fact, at any given time only one slurm job, or at most two, are running (the machine they are running on can run ~15 jobs by ram and cpu requirements). I'm trying to run 60 chunks, and to resolve this problem I set scheduling to 5, which did bump up the number of running jobs to 2-3. However, the main problem is that the chunks seem to take 10-15 seconds to launch, and I don't know what I changed - a few days ago, with larger jobs - this was not the case. So to my specific questions, before I try to generate a small reproducible example:
- Is there a verbose/trace flag? I can't see it in the documentation
- Is there anything to pay attention to beyond the "scheduling" option? Any hunch for what may be causing this issue for me to start looking at in generating an example?
- 主要语言
- R
- 星标
- 87
- 派生
- 10
- PR 合并指标
- 30 天内没有已合并 PR
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
futureverse/future.batchtools 的其他 Issue
-
feature/resources scheduler/lsf
难度 2/5 1-3 小时 新手友好度 68/100
futureverse/future.batchtools#105 ·
-
feature/resources scheduler/sge
难度 4/5 3-5 天 新手友好度 50/100
futureverse/future.batchtools#104 · 1 条评论 ·
-
feature/resources scheduler/slurm
难度 3/5 1-2 天 新手友好度 66/100
futureverse/future.batchtools#103 ·
-
难度 2/5 1-3 小时 新手友好度 55/100
futureverse/future.batchtools#102 ·
-
难度 4/5 3-5 天 新手友好度 15/100
查看 futureverse/future.batchtools 的全部 Issue
相似的 Issue
-
Component: R
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
bug pixi-build-r
难度 2/5 1-3 小时 新手友好度 70/100
prefix-dev/pixi#7229 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 78/100
-
难度 2/5 1-3 小时 新手友好度 72/100
rstudio/reticulate#1933 ·
-
难度 1/5 1 小时以内 新手友好度 62/100