`filewriter`: deployment topology

未关闭

#98 创建于 2026年7月27日 5 条评论 0 个 reaction 已指派 0 人在 GitHub 查看

还没有人认领这个 Issue。

评估

先阅读此 issue 中的部署拓扑备选方案，然后查看关联的 issue #96 和 #85，了解相关约束。确定所选架构必须如何支持 HRPD-X、SANDALS2、WISH 和 VESUVIO，同时保持向 MNeuData 扩展的能力；当架构达成一致并完成文档记录时，即视为完成。

由索引模型根据 Issue 内容生成。

filewriter

We need to define how the filewriter and other cooperating processes will run.

One-per-instrument: each FW process incrementally writing out the events from a single instrument
Pooled: some number, perhaps dynamic, of filewriters which may pick up a writing job from any instrument. This is the architecture that ESS use.

Things to consider:

Pooled architecture is a requirement if we might ever collect data faster than it can be written to disk. This seems unlikely at present.
Consider interaction with https://github.com/ISISComputingGroup/DataStreaming/issues/96 ; this likely makes a pooled architecture more desirable
Needs to work for HRPD-X/SANDALS2/WISH/VESUVIO etc before MNeuData is available. We do not need to solve the MNeuData case in this issue, but we should pick an architecture which makes it possible to extend in likely MNeuData directions later.
Consider interaction with https://github.com/ISISComputingGroup/DataStreaming/issues/85

这个仓库没有索引到贡献指南

Investigate refactoring vs replacing forwarder 未关闭

ISISComputingGroup/DataStreaming#115 · 已指派 1 人 · 2026年9月21日创建
Filewriter: implement structure 未关闭

ISISComputingGroup/DataStreaming#114 · 已指派 1 人 · 2026年9月18日创建
Implement process talking to low-level detector modules 未关闭

难度 4/5 3-5 天新手友好度 35/100

ISISComputingGroup/DataStreaming#113 · 2026年9月15日创建
`kafka_event_aggregator`: backpressure 未关闭

难度 5/5 一周以上新手友好度 45/100

ISISComputingGroup/DataStreaming#111 · 2026年9月10日创建
`kafka_event_aggregator`: improve metrics 未关闭

难度 3/5 1-2 天新手友好度 48/100

ISISComputingGroup/DataStreaming#112 · 2026年9月9日创建