dice-group/Squirrel

View on GitHub

Squirrel searches and collects Linked Data

Stars: 25
Forks: 19
Open beginner issues: 0
Indexed issues: 35

Dominant language: Java
License: No license data
Last GitHub push: Sep 25, 2020
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

35 open issues indexed

Seed URLs are rejected Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

dice-group/Squirrel#157 · Opened Jun 29, 2023
Seed file in README Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

dice-group/Squirrel#156 · Opened Jun 29, 2023
Normalizer should transform certain parts of IRIs to their lower-cased form Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dice-group/Squirrel#148 · Opened Nov 23, 2021
Worker should follow instructions in HTTP 429 responses Open

component:worker priority:low type:enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dice-group/Squirrel#121 · 1 comment · Opened Sep 20, 2019
Use information from the SPARQL service description vocabulary Open

component:worker priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#120 · Opened Sep 20, 2019
Implement usage of .well-known URIs Open

component:frontier priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

dice-group/Squirrel#119 · 1 comment · Opened Sep 12, 2019
Improve usage of the VoID vocabulary Open

component:worker priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#118 · Opened Sep 12, 2019
Replace old UriType usages in queue classes Open

component:frontier priority:low type:discussion type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dice-group/Squirrel#117 · Opened Sep 7, 2019
Detect URI Type Open

component:frontier priority:critical type:enhancement

dice-group/Squirrel#111 · 1 assignee · Opened May 21, 2019
WorkerGuard not fully thread-safe Open

component:frontier priority:low type:bug

dice-group/Squirrel#102 · 1 assignee · Opened Mar 6, 2019
Error in FrontierImpl: Could not recognise IP address even when the link can be opened in browser Open

component:frontier priority:low type:question

Difficulty 4/5 3-5 days Newbie friendliness 30/100

dice-group/Squirrel#88 · Opened Dec 11, 2018
Improvement of the HTTP Fetcher and Queue when status 500/503 is returned Open

component:worker priority:low type:enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dice-group/Squirrel#81 · Opened Oct 30, 2018
KML Analyzer Open

component:worker priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#79 · Opened Oct 25, 2018
Improve parsing robustness Open

component:worker priority:high type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#64 · 3 comments · Opened Jun 5, 2018
LDN inbox as crawler frontier Open

component:frontier priority:low type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

dice-group/Squirrel#59 · 1 reaction · Opened May 8, 2018
Provide VOID data for crawled datasets Open

priority:high type:enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#58 · Opened Apr 27, 2018
Use Mock FTP server for FTPFetcherTest Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dice-group/Squirrel#55 · 1 comment · Opened Mar 1, 2018
Possible Source of Seed permid.org Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

dice-group/Squirrel#45 · Opened Jan 5, 2018
GRDDL files Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/Squirrel#44 · Opened Dec 15, 2017
Enable usage of CKAN API Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#37 · 6 comments · Opened Nov 22, 2017
Better serialization detection Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#32 · Opened Oct 11, 2017
Configurable queue names Open

component:frontier priority:low type:enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dice-group/Squirrel#31 · Opened Oct 6, 2017
Recrawling Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dice-group/Squirrel#28 · 1 comment · Opened Oct 6, 2017
Frontier should store timestamp of crawling Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

dice-group/Squirrel#27 · 1 comment · Opened Oct 6, 2017
Workers don't get new IP package from frontier Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dice-group/Squirrel#26 · Opened Oct 6, 2017
The frontier generates too many messages if an IP address couldn't be determined Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

dice-group/Squirrel#25 · Opened Oct 6, 2017
Domain logging crashes with NullPointerException Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

dice-group/Squirrel#23 · Opened Oct 6, 2017
Crawler should tolerate restarts Open

dice-group/Squirrel#20 · 2 comments · 1 assignee · Opened Jul 21, 2017
Write integration tests for "rabbit" branch Open

dice-group/Squirrel#16 · 1 assignee · Opened Jun 22, 2017
Make a CI/CD pipeline for "rabbit" branch Open

dice-group/Squirrel#15 · 1 assignee · Opened Jun 22, 2017
Test Seed Generators Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/Squirrel#14 · Opened Sep 2, 2016
0009: URIProcessing: Deduplicate SPARQL endpoints Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dice-group/Squirrel#7 · Opened Feb 11, 2016
0010: URIProcessing: Deduplicate dereferenceable URIs Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dice-group/Squirrel#6 · Opened Feb 11, 2016
0012: URIProcessing: deduplicate JSON-LD API Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#4 · Opened Feb 11, 2016
0017: URIProcessor: ML UriType Identification Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dice-group/Squirrel#2 · Opened Feb 11, 2016

dice-group/Squirrel

Get new issues in your inbox