Repository Issues
Medical-Event-Data-Standard/MEDS-DEV
The MEDS Decentralized Extensible Validation (MEDS-DEV) Benchmark: Establishing Reproducibility and Comparability in ML for Health
Issues
Open
Add FEMR tasks/labelers
enhancementhelp wanted
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
MEDS-DEV Results should track dataset metadata (e.g., versions)
Results storage and trackingenhancementgood first issuepriority:high
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
[Model] Add the model CORE-BEHRT
BLOCKEDModelsenhancementhelp wantedpriority:medium
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
We should support evaluation-only mode for pre-trained models distributed with weights
Experimental APIModelsUsability/Interfaceenhancementhelp wantedpriority:medium
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments1 reaction0 assignees
Open
[Dataset] Adds dataset EHR-Shot
Datasetshelp wantedpriority:medium
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments1 reaction2 assignees
Open
Further improvements to `abnormal_lab` tasks.
Tasksenhancementhelp wantedpriority:critical
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
7 comments0 reactions5 assignees
Open
MEDS-DEV needs a website for leaderboards and updated documentation.
Results InterpretationUsability/InterfaceWebsite / Brandingdocumentationenhancementhelp wantedpriority:critical
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
We need to add a more robust collection of public and private datasets and better curate included datasets.
DatasetsUsability/Interfaceenhancementhelp wantedpriority:critical
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
Test code should only test datasets and/or tasks and/or models that have been changed since the last successful CI test run on GitHub.
Testinghelp wantedpriority:critical
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
2 comments0 reactions0 assignees