[refactor]: merge multiple models into singular file for standard output
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
调研方向
Start by reading the standard-output code that creates the tables and figures, and trace where it currently passes a list of data frames; the issue does not name specific files or tests. Check whether those data frames share a schema and how the outputs consume them. Done means the outputs use a single data frame and the package's relevant tests pass.
由索引模型根据 Issue 内容生成。
描述
We should feed in a single df to all tables and figures rather than a list. Especially to aid in memory issues. See rationale below:
Memory wise, it is more efficient to have a dataframe rather than a list. I am thinking that if we actually move to parquet files/databases that the list of dataframes would be the least efficient way to store this information in R. And, according to Gemini
A single consolidated data frame is significantly more memory-efficient and performant than a list of many small data frames, assuming the data frames share the same schema. Every R object carries structural overhead (class definitions, attributes, dimensions, and names). If you store thousands of small data frames in a list, R maintains thousands of separate attribute vectors and column names. Consolidating into one table collapses that metadata into a single set. R's vector engine operates on contiguous blocks of memory. Iterating over elements in a list (e.g., via lapply() or purrr::map()) incurs call-stack overhead and traverses fragmented pointers across the heap, whereas column operations on a single data frame utilize SIMD vectorization and cache locality. The R garbage collector tracks every allocated node (Vcells and Ncells). Having a large list of separate data frames balloons the total count of distinct objects, forcing the garbage collector to run frequently and cause execution pauses.
A list of data frames is only preferable if:
- The structures differ: The tables do not share common columns or types, making a combined table sparse or full of NA padding.
- Independent lifecycle: You frequently delete, update, or process chunks independently and want to let R selectively garbage-collect individual pieces without rewriting a massive master table.
Originally posted by @kellijohnson-NOAA in #455
- 主要语言
- R
- 星标
- 20
- 派生
- 10
- 平均合并
- 3 天 15 小时
- 30 天内合并 PR
- 28
环境准备
在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。
- 没有 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
nmfs-ost/stockplotr 的其他 Issue
-
Address R cmd check warnings可能已有人在做 @sbreitbart-NOAA 于 2 天前认领。 未关闭
nmfs-ost/stockplotr#459 · 已指派 1 人 ·
维护者通常 1 天内回复
-
Check for obs and exp. for each example data in the package可能已有人在做 @Schiano-NOAA 于 3 天前认领。 未关闭question
nmfs-ost/stockplotr#452 · 已指派 1 人 ·
维护者通常 1 天内回复
-
Add make_rda and rda bundle to composition plots可能已有人在做 @Schiano-NOAA 于 3 天前认领。 未关闭development enhancement
nmfs-ost/stockplotr#451 · 已指派 1 人 ·
维护者通常 1 天内回复
-
Release Checklist - Monthly Update可能已有人在做 @Schiano-NOAA 于 8 天前认领。 未关闭
nmfs-ost/stockplotr#442 · 已指派 2 人 ·
维护者通常 1 天内回复
-
Brainstorm ways to automatically update `save_all_plots()`可能已有人在做 @sbreitbart-NOAA 于 16 天前认领。 未关闭
nmfs-ost/stockplotr#432 · 4 条评论 · 已指派 2 人 ·
维护者通常 1 天内回复
查看 nmfs-ost/stockplotr 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 62/100
BGI-shenzhen/PopLDdecay#25 ·
-
难度 2/5 1-3 小时 新手友好度 88/100
Public-Environmental-Data-Partners/EJAM#699 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 65/100
waldronlab/bugphyzz#281 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 88/100
-
难度 2/5 1-3 小时 新手友好度 76/100
维护者通常 1 天内回复