Delete redirected pages
Maintainers usually reply within 1 day
@tomatotomata is already working on this.
Since Aug 2, 2026.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 48/100
Research direction
Start by locating the code that changes a link from FETCHED to REDIRECT and the corresponding index update path. Trace how redirected URLs are handled, then add coverage for removing the old URL from the index and run the relevant crawler tests.
Written by the indexing model from the issue text.
Description
From a user
Links that were once pages and then turn to redirects are our issue. Our content management system auto creates clean URLs. If the title of the page is changed the clean URL is changed and the old URL is redirected to the new URL. The old URL stays in our index unless manually removed. When a link is changed from FETCHED to REDIRECT it would be ideal if the index is removed.
- Dominant language
- Java
- Stars
- 1k
- Forks
- 295
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 62
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from apache/stormcrawler
-
Remove dependency on httpcomponents.core5Possibly taken @rzo1 claimed this 1 day ago. OpenBREAKING CHANGE core
Difficulty 5/5 Over a week Newbie friendliness 15/100
apache/stormcrawler#2266 ·
Maintainers usually reply within 1 day
-
URLNormalizer The query is split on `;` as well as `&`, which rewrites URLsPossibly taken @jnioche claimed this 27 days ago. Openbug
apache/stormcrawler#2199 · 1 assignee ·
Maintainers usually reply within 1 day
-
[Bug report] BasicURLNormalizer unmangleQueryString inserts a second `?` when a query value contains a `/`Possibly taken @jnioche claimed this 27 days ago. Openbug core
apache/stormcrawler#2198 · 1 assignee ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 70/100
apache/stormcrawler#2131 ·
Maintainers usually reply within 1 day
-
[Improvement] Work towards Maven 4 CompatibilityPossibly taken @mvolikas claimed this 352 days ago. Opengood first issue help wanted
apache/stormcrawler#1662 · 2 comments · 1 assignee ·
Maintainers usually reply within 1 day
All issues in apache/stormcrawler
Similar issues
-
[BUG] jackson3 JacksonJsonpMapper(ObjectMapper) fails to deserialize `_source` with "Trailing token" errorPossibly taken @junyeokk claimed this today. Openbug untriaged
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
opensearch-project/opensearch-java#2236 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 83/100
cloudfoundry/cf-java-client#1392 ·
Maintainers usually reply within 2 days
-
Posting fails with "Context too long"Possibly taken @jimklimov claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
open-learning-exchange/myplanet#18392 ·
Maintainers usually reply within 2 days