NPY file format for regular matrix data
还没有人认领这个 Issue。
评估
调研方向
未指定实现文件或测试。首先查看 #15 和链接的 NPY 格式规范中讨论的矩阵维度和数据类型处理。完成的标准是确定是否应在更高层的 TRX 格式中使用 NPY，并明确其对兼容性和内存映射的影响。
由索引模型根据 Issue 内容生成。
描述
This idea was going to result in #15 getting peppered with repetitive comments, so I'm going to write it here separately instead.
TRX currently has novel handling of matrix dimensions & datatype for various data files, achieved via file names. When looking through the code in #15 I also see what looks like novel enumeration / single-character encoding of data type. This may be creating a novel solution for a problem for which many solutions already exist.
The NPY format provides an established solution for these issues. Matrix dimensions and data type (including endianness) are encoded in the file header as part of a dictionary literal. I've myself recently implemented C++ support for that format in https://github.com/MRtrix3/mrtrix3/pull/2437. Using this file format as part of the higher-order TRX format would be fairly trivial for Python, in particular facilitating reading / writing of data with no dependence on TRX libraries, and for other languages the overhead would be no greater than that demanded by the current specification. Potential downsides are that features such as matrix dimensionality / size and data type would no longer be visible from a filesystem view (though they could be pretty easily seen just using head), and memory-mapping implementations would need to support loading from a non-zero offset into a file (which shouldn't be difficult, it's a common operation). But the upsides in terms of not reinventing the wheel may more than offset that.
- 主要语言
- Python
- 星标
- 27
- 派生
- 20
- 平均合并
- 2 天 25 分钟
- 30 天内合并 PR
- 1
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南，环境需要你自己搭建：先看它的 README，通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
tee-ar-ex/trx-python 的其他 Issue
-
难度 3/5 1-2 天 新手友好度 45/100
tee-ar-ex/trx-python#85 · 1 个 reaction ·
-
难度 4/5 3-5 天 新手友好度 25/100
tee-ar-ex/trx-python#77 · 1 条评论 ·
-
难度 5/5 一周以上 新手友好度 25/100
tee-ar-ex/trx-python#72 · 3 条评论 ·
-
难度 5/5 一周以上 新手友好度 25/100
tee-ar-ex/trx-python#51 · 23 条评论 ·
-
good first issue
难度 4/5 3-5 天 新手友好度 35/100
tee-ar-ex/trx-python#39 · 1 条评论 ·
查看 tee-ar-ex/trx-python 的全部 Issue
相似的 Issue
-
bug
难度 2/5 1-3 小时 新手友好度 68/100
Deltares/imod-python#1940 ·
维护者通常 1 天内回复
-
effort: low prio: low ready
难度 1/5 1 小时以内 新手友好度 82/100
digitalfabrik/integreat-cms#4621 ·
维护者通常 5 天内回复
-
难度 1/5 1 小时以内 新手友好度 88/100
ioos/compliance-checker#1375 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 82/100
维护者通常 1 天内回复
-
netbox status: backlog topic: testing type: housekeeping
难度 2/5 1-3 小时 新手友好度 70/100
netbox-community/netbox#23395 ·
维护者通常 1 天内回复