Rotate FK-tables instead of EKOs
评估
调研方向
Read src/pineko/evolve.py around the linked lines 282–286 and 313–320, then inspect the PineAPPL grid rotation change linked in the issue. The issue proposes evolving unrotated EKOs and rotating the resulting FK-tables; check the existing evolution tests and add coverage for that flow. The linked pull request #227 is open, so review its status before starting.
由索引模型根据 Issue 内容生成。
描述
There's another big optimization potential to speed up the generation of FK-tables. Currently, I believe, pineko works the following way (correct me if I'm wrong):
- we store flavour-basis to flavour-basis EKOs for all Q2 slices, but always for the standard 50 x-node points. The biggest EKO that we have,
ATLAS_1JET_8TEV_R06, is 2.4 GB. - Next, we reinterpolate the EKO to match the x-grid points actually used in the grid. For
ATLAS_1JET_8TEV_R06this blows up the size of the EKO to 22 GB. - Finally, we rotate the EKO, such that the resulting FK-tables are in the evolution basis. This further increases the size, resulting in whopping 45 GB.
But thanks to some developments on PineAPPL's side, we can now perform a rotation at the level of grids (and therefore also FK-tables). So I suggest that
- we perform the evolution using the unrotated EKOs, which has the advantage that the EKOs are much smaller, and finally
- rotate the evolved FK-tables from the flavour-basis to the evolution basis.
The evolution in the flavour basis is much faster, it's roughly the quotient of the size of the EKOs. For ATLAS_1JET_8TEV_R06 it's roughly twice as fast (45 GB / 22 GB). With the added benefit that we need less disk space, of course.
Practically speaking, the changes on pineko's side should be minimal. We probably have to delete the following lines:
https://github.com/NNPDF/pineko/blob/9f8b03ce9132c91866a160e4396998abaca843c2/src/pineko/evolve.py#L282-L286
and instead add the rotation after the evolution:
https://github.com/NNPDF/pineko/blob/9f8b03ce9132c91866a160e4396998abaca843c2/src/pineko/evolve.py#L313-L320
- 主要语言
- Python
- 星标
- 2
- 派生
- 0
- 平均合并
- 10 天 34 分钟
- 30 天内合并 PR
- 3
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
NNPDF/pineko 的其他 Issue
-
难度 2/5 1-3 小时 新手友好度 66/100
-
Overwrite if encounters stale symlinks to ekos可能已有人在做 @ashishsoni-ai 于 5 天前认领。 未关闭bug
难度 2/5 1-3 小时 新手友好度 84/100
-
benchmarks/unit tests
难度 1/5 1 小时以内 新手友好度 78/100
-
难度 4/5 3-5 天 新手友好度 20/100
-
Check whether IC from theory card is used可能重新可做 @kamillaurent 于 58 天前认领,目前没有进行中的 PR。 未关闭
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 76/100
GoogleCloudPlatform/professional-services-data-validator#1899 ·
维护者通常 4 天内回复
-
难度 2/5 1-3 小时 新手友好度 72/100
mohanraj00/entelos#200 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 68/100
-
sweep
难度 2/5 1-3 小时 新手友好度 85/100
bketelsen/truenas-mcp#77 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 86/100
sandbox-quantum/switch#2163 ·
维护者通常 1 天内回复