Tracking: the components and interfaces of essapps, and how far each has got

未关闭 适合新手
  • 哪里不对？
#155 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
2/5
预计耗时
1-3 小时
新手友好度
62/100
Issue 类型
文档
描述清晰度
描述清楚
活跃度
活跃
技术栈
python

调研方向

从 issue 的架构表开始，这些表列出了组件和接口、它们的使用者、状态以及相关 issue。将表中的条目与引用的 issue 和项目当前状态进行比较，尤其留意表中提到 data.md 或 form.py 之类文件的情况。跟踪文档准确反映每个条目的状态，并提供链接或位置后，即表示完成。

由索引模型根据 Issue 内容生成。

描述

Every box and arrow one would draw in an architecture diagram of essapps, with how far each has got. Items without an issue say "no issue".

Kind. C is a component. I is an interface. An interface gets a row only if it has a design of its own: it crosses a process or deployment boundary, or several implementations sit behind it. Other arrows are part of their component.

For. What needs the item: N notebook, G interactive GUI, B batch reduction, A automatic reduction, H hosted service. "all" means N G B A.

Status. mentioned, then idea (a concrete proposal exists), then prototype (runs, with known gaps, or a test fake only), then implemented (works in-process, with tests). † means only on the unmerged LoKI stack. ‡ means parked on 24-sans-batch.

Workflows

Item Kind What For Status Where
WorkflowSpec C Names a workflow's params and outputs all implemented #80, #118
Params language I What a request may give at each field all implemented #88, #140
Binding I Params in, outputs out; stage and driver variants all implemented #81
Pipeline and function bindings C Bind sciline pipelines and plain functions all implemented
Driver binding C Bind an accumulating workflow N G implemented #40
Binding checks C Test an author's promises all implemented #81
Serialized spec I A spec as data, for clients that do not import it H prototype #88; no reader yet
Spec identity I Which version of a spec a record ran all idea #80
LoKI package C Specs, bindings, and plots of LoKI all prototype† #24
Several detector banks C One workflow that takes a list of banks, plain or accumulating, combined before normalization; esssans does not do this yet all mentioned #24
Other instrument packages C The same for other instruments all mentioned no issue
Instrument defaults C Usual values for fields such as bins G B A mentioned no issue

Client and backend core

Item Kind What For Status Where
Client API I One proposal's calls to one backend all implemented #81, #95
Request checks C Refuse a request, naming the field all implemented
History log and views C Append-only events, and state built from them all implemented
Durable history and restart C Log on disk; restart without rerunning G A H prototype #81, #151
Kept values C A value lives while something keeps it all implemented #123
Scheduler and workers C Run a request once its references are ready all implemented #61
Stages C Compute a template's fixed part once N B implemented #24: a failed stage cannot retry
Accumulators C Rows pushed, with a state that can be read N G implemented #40, #123
Provenance C The records and files behind a record all implemented
Software versions C Installed versions in provenance all mentioned #152
Change feed I Which records changed since a position G A H implemented† #148; no files or releases
Output description and cuts I describe and select= G H implemented† #149
Computed looks C A projection next to a value, with no record G H mentioned #149
Labels and members C Name sequences of records B A implemented #81
Templates and apply C Fill a template per file; a rule's function finds related files N B A implemented #33, #160

Files

Item Kind What For Status Where
File source I Resolve, list, watch, and describe files all implemented #57, #131
File metadata vocabulary I Kind and role of a file; a raw file's role narrows a picker and refuses nothing all prototype #153, #159
Run number in a workflow I A workflow cannot learn a file's run number all mentioned #124
How a file gets its role C NICOS, SciCat, or file contents A mentioned #153, data.md
Folder source C One folder and a hand-filled table N G B prototype† #131
Folder scan C Metadata from the files, not from a table; scan_directory of ess-sans-widgets is a starting point, with a replaceable reader while file fields are not settled N G B mentioned no issue
Working folder C Choose or change the input folder in an app G B mentioned no issue
SciCat and /ess source C Files and metadata at ESS all idea #57, #131
Metadata caching C Do not re-read every file on each refresh G B idea no issue
New-file signal I Tell an app that a new run exists G A mentioned no issue
Store I Persist an output by record and name B A H implemented #152; thin
Real store C A store that is not the test fake B A H mentioned #152
Codec per output type I How an output type becomes a file G B A H mentioned #152
File writer C Write an output where a person chooses N G B mentioned #152
Layout on disk C Where results go, and how they are found B A H mentioned #152
Written file to source I A saved file appears in the pickers G B A idea story C2
Retention C Drop files by proposal, label, or age A H mentioned #152
Publisher I Output to a SciCat derived dataset G B A idea #152
SciCat widget C The person's publish dialog G B mentioned #152
SciCat credentials C Whose token, and how it arrives G B A mentioned #152

Shared UI core (no widget library)

Item Kind What For Status Where
Listing C Snapshot of records, labels, and what fits G B A implemented #95, #150
Component contract I refresh(listing) and show G B A prototype #150
Form state and rules C Field tree, unset values, missing fields G B idea #150; now in form.py
Form to frontend I Build a widget per field, and sync it G B idea #150
Field type reading C What a field's type allows G B implemented
Output rows and details C The list of outputs and their text G B A prototype #150; now in Panel
Record details C The text about a record G B A prototype #150; now in Panel
Provenance graph model C Nodes, edges, and layout G B A prototype #150; now in Panel
Submission outcome C Refusal and completion messages G B prototype #150; now in Panel
Record names C Labels that say which sample G B A idea #95, #24
Plot function I Outputs in, plopp figure out N G B A prototype† #149
Plot choice by shape C Which plot suits an array; sliders G B prototype† #149
General plots C Several chosen outputs on one plot G B prototype‡ #149
Fill form from a record C Show a record's params to edit G B implemented Form.set
Autofill C Offer the newest masks and centre G B mentioned no issue; against a rule in form.py
Saved configurations C Reopen or name earlier settings G B A mentioned no issue

Widget frontends

Item Kind What For Status Where
Panel frontend C Widgets, table, timer, and graph in Panel G B A prototype #150
ipywidgets frontend C The same in ipywidgets G B idea no issue
PyQt frontend C The same in PyQt G B mentioned no issue

Applications

Item Kind What For Status Where
Generic app C Forms, outputs, and records for any spec G prototype #24
Technique app C An app that knows SANS G B prototype‡ #24
Configured plots C Plots scientists make all the time G B A prototype† #149
Mask creation C Draw or edit masks on an image G mentioned no issue
Mask files C Save masks so MASKS can load them G B A mentioned no issue
Batch table and pairing C Rows of runs, paired by metadata B prototype‡ #33
Per-run tweak C Edit and resubmit one row B prototype‡ #24

Automatic reduction service

Item Kind What For Status Where
Trigger loop C New file to the application's function, which submits any number of requests A implemented #33, #68, #160
Service process C Runs the loop 24/7 with local() A idea #151
Technique package loading I Specs and rules per technique A idea #151
Several proposals C One loop per proposal, or one for all A mentioned #151, #27
Configuration of a running service C Change the can without a restart A mentioned #151, #33
Rule status C What the rules did and why A mentioned #27, #151
Publishing with no frontend C Results reach SciCat unattended A idea #152

Hosted service

Item Kind What For Status Where
Transport and wire format I connect(), calls and values over HTTP H mentioned #27
Auth and proposal access C Who submits, and what they may read H mentioned #27
Client per user I Which client a user or session gets H idea no issue
Lease and memory cap C End vanished clients, bound their memory H idea #27
Cluster executor C Run on workers and Slurm; stop started work H idea #27
Environments C Which packages and versions are installed H mentioned no issue
Operations C Metrics, logs, and disk per proposal H mentioned no issue

ESS systems (not ours to build)

Item Kind What For Status Where
SciCat C Dataset catalogue all external #57, #152
/ess/raw and /ess/data C Files at ESS all external #131
NICOS C Writes runs, and may record their role A external #153
Slurm C The cluster H external #27
主要语言
Python
星标
0
派生
1
平均合并
9 小时 40 分钟
30 天内合并 PR
60

环境准备

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 阅读贡献指南

从这里开始

  1. 先读完整个 Issue，再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库，在一个分支上完成修改。
  4. 提交 Pull Request，并在描述里引用这个 Issue 编号。

scipp/essapps 的其他 Issue

查看 scipp/essapps 的全部 Issue

相似的 Issue

更多 Python Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。