feat: allow specifying multiple values for properties in an instance
维护者通常 1 天内回复
@christian-pinto 已经在做这个了。
开始于 2026年9月28日。
评估
这个 Issue 还没有评估数据。
描述
Description
I would like a way for a problem instance to a sweep of one or more variables.
An example is given in https://zib-aopt.github.io/QOBLIB/instance.html?problem=06&name=a050_t10_s00_b020 where the parameter lambda has multiple values
This would allow us to add this QOBLIB problem instance, a050_t10_s00_b020 (and the others), as defined there which we can't currently do.
Proposed Solution
Proposed solution is to define the properties of the instance in the same way as an entity space. This naturally allows defining a sweep.
The previous solution will not work in this case because
- each lambda value is a separate input file.
- which lambda value is which is only stored in the file name
That is, as is reading only the files you have to know how the lambda value was stored. The qoblib results display works because the submitter of a result can make this mapping in the submission. The website does not have to understand the mapping.
The problem remains in how to handle the difference between parameters which can have exactly one of a set of values (the artefact files) and the others. Right now I propose keeping them separate as they are - later we might find a way to define everything as an entity space (e.g. using constraints).
Alternate Solutions
Define in one instance folder multiple sub-instances which are then rendered as being one instance in the dashboard.
For example in this case one folder for lamdba=0, lambda=1e-6 etc.
Additional Context
If showing on a leadeboard the varying parameters would have to be added to instance name in same was a parameterized experiment. This doesn't happen on QOBLIB and leads to a bug where the best value for 050_t10_s00_b020 is actually the best value for one of the lambdas.
- 主要语言
- Python
- 星标
- 3
- 派生
- 7
- 平均合并
- 15 小时 34 分钟
- 30 天内合并 PR
- 18
环境准备
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
IBM/algorithm-nexus 的其他 Issue
-
难度 2/5 1-3 小时 新手友好度 68/100
IBM/algorithm-nexus#159 ·
维护者通常 1 天内回复
-
feat: enabling associating experiment results to a benchmark instance when number of instance properties exceeds experiment properties可能已有人在做 @christian-pinto 今天认领。 未关闭enhancement
IBM/algorithm-nexus#282 · 1 条评论 · 已指派 1 人 ·
维护者通常 1 天内回复
-
难度 3/5 1-2 天 新手友好度 68/100
IBM/algorithm-nexus#276 ·
维护者通常 1 天内回复
-
难度 3/5 1-2 天 新手友好度 45/100
IBM/algorithm-nexus#254 ·
维护者通常 1 天内回复
-
Test bmfm-targets with vllm >= 0.29.0可能已有人在做 @sivanravidos 于 18 天前认领。 未关闭
IBM/algorithm-nexus#240 · 已指派 1 人 ·
维护者通常 1 天内回复
查看 IBM/algorithm-nexus 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 84/100
PedestrianDynamics/pyFDS-Evac#343 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 88/100
theskumar/python-dotenv#708 ·
-
难度 1/5 1 小时以内 新手友好度 88/100
维护者通常 2 天内回复
-
Docs Timedelta
难度 2/5 1-3 小时 新手友好度 72/100
pandas-dev/pandas#69919 ·
维护者通常 1 天内回复
-
API documentation
难度 2/5 1-3 小时 新手友好度 72/100
zephyrproject-rtos/west#1009 · 2 条评论 ·
维护者通常 3 天内回复