Use `frictionless` to validate schemas and CSV files
@alexdewar is already working on this.
Since Aug 27, 2025.
Assessment
This issue has not been assessed yet.
Description
We have schema files in the table schema format in schemas/input which are used primarily to generate documentation for the input format. We will also use a similar mechanism for the output format (#529).
We could use the Python-based frictionless framework to validate all the CSV files for the example models. We're already checking that the files are well-formed with our Rust tests, so this would be primarily to check that the schemas themselves are well-formed (which is kind of the opposite to how they're normally used). It seems you can either do this from the command-line or from a Python script. We should run it on the CI to enforce this.
There seems to be a concept in frictionless called "packages" which I don't entirely understand, but it may be a way we can group all these schemas together somehow (the only way I could get it to work was by running individual schemas against individual files, but that's a bit gross and doesn't enforce file names).
- Dominant language
- Rust
- Stars
- 8
- Forks
- 5
- Avg merge
- 11h 31m
- Merged PRs (30d)
- 33
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from EnergySystemsModellingLab/MUSE2
-
bug documentation
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
EnergySystemsModellingLab/MUSE2#1367 · 1 comment ·
-
Remove the `ironing out iteration 0` prefix from debug files when the ironing out loop is turned off Openmuse xiii question
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
EnergySystemsModellingLab/MUSE2#1221 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
EnergySystemsModellingLab/MUSE2#1554 ·
-
bug
EnergySystemsModellingLab/MUSE2#1541 · 2 comments · 1 assignee ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
EnergySystemsModellingLab/MUSE2#1526 ·
All issues in EnergySystemsModellingLab/MUSE2
Similar issues
-
bug CLI custom-model
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
rust-bitcoin/rust-bitcoin#6930 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
fulcrumgenomics/ferro-hgvs#2251 ·
-
A-allocators A-docs C-enhancement T-libs
Difficulty 2/5 1-3 hours Newbie friendliness 75/100