Filewriter: implement structure
評估
這個 Issue 還沒有評估資料。
描述
Implement the initial top-level structure of the filewriter process, to prove that we have a design that will work in practice. This should follow DS ADR 10.
Should include:
- Trait definitions for writer modules
- Kafka-listening infrastructure (including pooled architecture)
- HDF5-writing infrastructure
- Including writing fully-static datasets/groups
- Infrastructure for parsing dynamically-provided
nexus_structure(part of run start)- Including configuration parameters for each writer module
- Logging
- Metrics
- Testing
- Including unit tests for individual writer modules
- Benchmarking
- Include a bench for each writer module
- Include one overall top-level bench for writing a small but representative file in-memory
- Docs
- Error propagation with appropriate context for debugging (likely miette + thiserror)
- Two different writer modules, which may write simple/incomplete data at this stage.
- E.g. simplified IXseblock and simplified NXevent_data
Functionally, the end point of this ticket is that we have a filewriter process that can listen to streams of data from Kafka and write some data from those streams, in a simplified/incomplete way, to a HDF5/NeXus file.
- 主要語言
- 沒有語言資料
- 星號
- 0
- 分支
- 0
- PR 合併指標
- 30 天內沒有已合併 PR
環境準備
這個專案沒有提供開發容器、Dockerfile 或貢獻指南，環境需要你自己搭建：先看它的 README，通用步驟見我們的新手貢獻指南。
從這裡開始
- 先讀完整個 Issue，再讀專案的貢獻指南。
- 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
- Fork 儲存庫，在一個分支上完成修改。
- 送出 Pull Request，並在描述裡引用這個 Issue 編號。
ISISComputingGroup/DataStreaming 的其他 Issue
-
難度 2/5 1 小時以內 新手友好度 85/100
-
filewriter
難度 5/5 一週以上 新手友好度 25/100
-
filewriter
難度 5/5 一週以上 新手友好度 20/100
-
`file_writer`: improve run_stop logic可能已有人在做 @Tom-Willemsen 於 1 天前認領。 未關閉filewriter
難度 5/5 一週以上 新手友好度 35/100
ISISComputingGroup/DataStreaming#119 · 1 則留言 · 已指派 1 人 ·
-
難度 5/5 一週以上 新手友好度 35/100