dssg/tyra

View on GitHub

Prediction model evaluation

Stars: 4
Forks: 1
Open beginner issues: 0
Indexed issues: 46

Dominant language: JavaScript
License: No license data
Last GitHub push: Sep 22, 2017
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

46 open issues indexed

update README for configuration Open

dssg/tyra#117 · 2 comments · 1 assignee · Opened Apr 23, 2018
Dockerfile fails Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

dssg/tyra#116 · Opened Jan 31, 2018
Upgrade jquery Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

dssg/tyra#115 · Opened Jan 22, 2018
Show KNN graph Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dssg/tyra#114 · Opened Jan 21, 2018
Plot jaccard similarities using thresholds from 0% to 100% Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dssg/tyra#113 · Opened Jan 21, 2018
Make not-yet-trustable evaluation dates dashed Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

dssg/tyra#112 · Opened Jan 21, 2018
Add reasonable default metrics or block user from hitting 'go' button before adding one Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

dssg/tyra#111 · Opened Jan 21, 2018
Tyra compatibility check Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dssg/tyra#110 · Opened Jan 21, 2018
Implement front-end testing Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dssg/tyra#109 · Opened Jan 21, 2018
View for within model: crosstabs Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

dssg/tyra#108 · Opened Jan 21, 2018
Plot predicted vs true probabilities Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

dssg/tyra#107 · Opened Jan 21, 2018
Between model: jaccard similarity Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dssg/tyra#106 · Opened Jan 21, 2018
Between model: Jaccard similarity over time Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dssg/tyra#105 · Opened Jan 21, 2018
Between model: rank-order correlation over time Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

dssg/tyra#104 · Opened Jan 20, 2018
View for Between model: plot counts and sums per year Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

dssg/tyra#103 · Opened Jan 20, 2018
Use lift := precision / baseline for inter-year averages and comparisons to compensate for changing baseline Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dssg/tyra#102 · Opened Jan 20, 2018
Make changes at the model input to be compatible with Audition Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dssg/tyra#101 · Opened Dec 18, 2017
Modify README with Docker instructions Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dssg/tyra#99 · Opened Nov 3, 2017
Score distribution seems weird Open

bug

dssg/tyra#97 · 1 comment · 1 assignee · Opened Sep 14, 2017
No Feature Distribution Plot Open

bug

dssg/tyra#96 · 1 assignee · Opened Sep 13, 2017
No Individual Feature Importance Plot Open

bug

dssg/tyra#95 · 1 assignee · Opened Sep 13, 2017
It seems that Tyra always rank by avg, it doesn't care about the metric Open

bug

dssg/tyra#94 · 2 comments · 1 assignee · Opened Sep 13, 2017
Fix first graph to show accuracy at time x rather than average accuracy over time x+t Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dssg/tyra#92 · Opened Sep 7, 2017
Add nginx support Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dssg/tyra#90 · Opened Aug 31, 2017
Better handling for the materialized view Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

dssg/tyra#88 · Opened Aug 25, 2017
Increase granularity of "precision and recall by threshold" plot Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

dssg/tyra#87 · Opened Aug 23, 2017
After running cache_table.sql... Open

bug

dssg/tyra#82 · 2 comments · 1 assignee · Opened Aug 21, 2017
Instructions in README are misleading Open

enhancement

dssg/tyra#81 · 1 assignee · Opened Aug 21, 2017
Link is broken in README Open

enhancement

dssg/tyra#80 · 1 assignee · Opened Aug 21, 2017
Are the name of the configuration files hardcoded? Open

enhancement

dssg/tyra#78 · 1 comment · 1 assignee · Opened Aug 21, 2017
Problem with capital feature names in the feature distribution graph Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dssg/tyra#74 · 1 comment · Opened Aug 16, 2017
Tyra crashed suddenly and a restart causes this error Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

dssg/tyra#73 · 1 comment · Opened Aug 16, 2017
Drawing full rectangle for zoom-in Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dssg/tyra#65 · Opened Jul 26, 2017
Remove duplication from get_model_groups Open

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

dssg/tyra#55 · 1 comment · Opened Jun 1, 2017
Switch default metric ranking to avg Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dssg/tyra#49 · Opened Apr 5, 2017
Convert metrics over time to use model group and only use one as_of_date Open

dssg/tyra#48 · 2 assignees · Opened Apr 5, 2017
Add linting npm script Open

Difficulty 1/5 Under an hour Newbie friendliness 35/100

dssg/tyra#46 · Opened Mar 14, 2017
Be able to choose outcome label for model selection for newer db schema. Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

dssg/tyra#44 · Opened Mar 13, 2017
Graph showing effect of different training windows (same test) Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dssg/tyra#42 · Opened Feb 17, 2017
Implement more model ranking functions and make them customizable Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dssg/tyra#41 · Opened Feb 17, 2017
Allow installations of Tyra to configure the graphs shown Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dssg/tyra#40 · Opened Feb 17, 2017
Model selection: grid of small per-model graphs Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

dssg/tyra#39 · Opened Feb 17, 2017
Create model comparison graph Open

dssg/tyra#38 · 1 assignee · Opened Feb 16, 2017
Fix install steps Open

Difficulty 1/5 Under an hour Newbie friendliness 45/100

dssg/tyra#36 · 1 comment · Opened Feb 16, 2017
Remove evaluation codes from tyra when we have the repo for evaluation Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

dssg/tyra#28 · Opened Jan 20, 2017
Remaining test graphs need to link to real data Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dssg/tyra#18 · Opened Jan 10, 2017

dssg/tyra

Get new issues in your inbox