cmu-delphi/forecast-eval

Save output as CSV, and read and write using `data.table`

開放

#262 建立於 2023年4月17日

 (5 則留言) (0 個反應) (1 位負責人)R (3 個分叉)auto 404
enhancementgood first issue

倉庫指標

星標
 (6 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Using RDS to read/write/store data is slow and not portable. We may want to switch the data pipeline or dashboard to being written in Python in the future, so using a format that Python can easily read would be preferable.

Looking at a comparison of different formats and packages, storing as a CSV and reading/writing using data.table via fread and fwrite seems pretty good. feather could also be an option (is supported in both R and Python) but it's not clear if standard dataframe and dplyr procedures work with it. data.table data can be seamlessly processed either with dplyr or with faster data.table syntax.

貢獻者指南