dice-group/gerbil

View on GitHub

GERBIL - General Entity annotatoR Benchmark

Stars: 231
Forks: 55
Open beginner issues: 0
Indexed issues: 132

Dominant language: Java
License: AGPL-3.0
Last GitHub push: Jun 23, 2026
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

132 open issues indexed

Web pages should have `<title>` Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

dice-group/gerbil#474 · Opened Jun 25, 2026
Report internal statistics Open

priority:medium SHK type:enhancement

dice-group/gerbil#473 · 1 assignee · Opened Jun 23, 2026
Gerbil QA swaps annotator and dataset in JSON LD output Open

priority:medium type:bug

dice-group/gerbil#470 · 1 assignee · Opened Apr 13, 2026
[QA] Implement unit test for experiment with uploaded files for QA system and dataset Open

priority:high type:enhancement

dice-group/gerbil#469 · 1 assignee · Opened Apr 8, 2026
Update UI libraries Open

dice-group/gerbil#468 · 1 assignee · Opened Jan 29, 2026
[QA] Dataset label is missing for uploaded datasets Open

priority:medium type:bug

Difficulty 3/5 1-2 days Newbie friendliness 38/100

dice-group/gerbil#464 · 1 reaction · Opened Sep 10, 2025
Reproducibility of WAT results Open

priority:high type:bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/gerbil#458 · 5 comments · Opened Sep 17, 2024
Add per instance results for additional evaluators Open

priority:low type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

dice-group/gerbil#457 · Opened Aug 19, 2024
Replace a time-consuming lookup for the ERD dataset Open

priority:medium SHK type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#456 · 8 comments · Opened Aug 16, 2024
[QA] C2KB sub experiment takes all Meaning instances into account, including properties Open

priority:medium type:bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

dice-group/gerbil#455 · Opened Aug 16, 2024
User defined description of experiments Open

priority:low type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

dice-group/gerbil#447 · Opened Mar 26, 2024
The link to gerbil_data.zip has to be manually updated in Github actions Open

priority:medium type:enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

dice-group/gerbil#445 · Opened Jan 25, 2024
[QA] Leaderboard for challenges is too slow Open

priority:medium type:bug type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

dice-group/gerbil#442 · Opened Oct 13, 2023
Integrate NameTag and other EOSC tools Open

priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#441 · Opened Sep 29, 2023
LP: Implement GERBIL instance for the evaluation of Link Prediction Open

type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#440 · Opened Aug 1, 2023
Sometimes in experiment results statusCode is 0 but there are no results yet Open

priority:high type:bug

dice-group/gerbil#435 · 1 comment · 1 assignee · Opened Jun 15, 2023
SameAs retrieval causes problems in a JUnit test Open

priority:high type:bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/gerbil#433 · Opened Jun 5, 2023
Integrate MasakhaNER datasets Open

priority:low SHK type:enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dice-group/gerbil#427 · Opened Mar 28, 2023
QAnswer not displayed in the systems list Open

priority:high type:enhancement

dice-group/gerbil#423 · 5 comments · 1 assignee · Opened Nov 16, 2022
File-based cache can slow down experiments Open

priority:low

dice-group/gerbil#422 · 3 comments · 1 assignee · Opened Oct 26, 2022
Setup Error on Amazon EC2 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/gerbil#417 · 1 comment · Opened Jun 11, 2022
[QA] Language tags should be chosen from a list Open

priority:medium type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

dice-group/gerbil#414 · Opened May 13, 2022
Check uploaded files Open

priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#400 · Opened Nov 4, 2021
Datasets with more than 1 question don't work Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

dice-group/gerbil#399 · 4 comments · Opened Sep 30, 2021
[QA] Add MQALD dataset Open

type:enhancement

dice-group/gerbil#381 · 1 comment · 1 assignee · Opened Mar 9, 2021
about question set Open

type:question

dice-group/gerbil#378 · 1 comment · 2 assignees · Opened Dec 30, 2020
How to terminate the experiment Open

type:question

Difficulty 3/5 1-2 days Newbie friendliness 30/100

dice-group/gerbil#373 · 9 comments · Opened Nov 30, 2020
Docker image Open

priority:medium type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#371 · 2 comments · 4 reactions · Opened Nov 13, 2020
FRED needs authentication Open

priority:high type:bug

dice-group/gerbil#370 · 1 comment · 2 assignees · Opened Nov 13, 2020
xLisa Annotator not available Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

dice-group/gerbil#369 · Opened Nov 10, 2020
Add datasets from paper Open

priority:medium type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/gerbil#361 · 1 comment · 1 reaction · Opened Jul 31, 2020
Run time warning appears although GERBIL has only one job Open

priority:low type:bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dice-group/gerbil#360 · Opened Jul 15, 2020
[QA] Add dataset LC-QuAD 2 Open

SHK type:enhancement

dice-group/gerbil#355 · 1 assignee · Opened May 25, 2020
[QA] Add Message Passing System Open

priority:high SHK type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#354 · 2 comments · Opened May 25, 2020
[QA] Add Wikidata based datasets Open

SHK type:enhancement

dice-group/gerbil#347 · 2 assignees · Opened Apr 16, 2020
Configuring GERBIL Experiment Open

duplicate

Difficulty 4/5 3-5 days Newbie friendliness 30/100

dice-group/gerbil#344 · 6 comments · Opened Mar 19, 2020
Load Annotator URLs otf Open

type:enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

dice-group/gerbil#343 · Opened Mar 17, 2020
Tasks seem to get lost while they are still listed as active Open

type:bug

Difficulty 4/5 3-5 days Newbie friendliness 32/100

dice-group/gerbil#342 · Opened Mar 10, 2020
Change FOX Demo URL Open

Difficulty 2/5 Under an hour Newbie friendliness 30/100

dice-group/gerbil#340 · Opened Feb 21, 2020
GsinKB A2KB Open

type:question

Difficulty 4/5 3-5 days Newbie friendliness 30/100

dice-group/gerbil#335 · 4 comments · Opened Nov 23, 2019
Fine grained (per annotation) experiment results Open

type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/gerbil#331 · Opened Sep 12, 2019
Add available API methods for experiment types to DBpedia Sportlight Open

type:enhancement type:question

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dice-group/gerbil#330 · Opened Sep 10, 2019
Mark "higher order" annotators Open

priority:low type:enhancement type:question

dice-group/gerbil#329 · 1 assignee · Opened Sep 9, 2019
[QA] Recode the Annotation and URL Validation part Open

type:bug

dice-group/gerbil#324 · 1 assignee · Opened Jun 21, 2019
Improve documentation of KPIs Open

priority:low type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dice-group/gerbil#321 · Opened May 23, 2019
[QA] Add http://frankenstein.qanary-qa.com/query Open

SHK type:enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

dice-group/gerbil#319 · Opened May 19, 2019
[QA] use QUINT as a new system Open

SHK type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/gerbil#318 · Opened May 19, 2019
[QA] WDAqua-core1 renaming and new endpoint Open

priority:high SHK type:bug

Difficulty 3/5 1-2 days Newbie friendliness 25/100

dice-group/gerbil#317 · Opened May 11, 2019
[QA] Request to include datasets in gerbil Open

SHK type:enhancement

dice-group/gerbil#314 · 3 assignees · Opened Apr 2, 2019
How to know with which dataset an annotator is queried? Open

type:question

dice-group/gerbil#313 · 5 comments · 3 assignees · Opened Mar 15, 2019

dice-group/gerbil

Get new issues in your inbox