FreshRSS/FreshRSS

Clear duplicates

Open

#948 创建于 2015年8月18日

在 GitHub 查看
 (55 评论) (15 反应) (0 负责人)PHP (15,022 star) (1,171 fork)batch import
Feature Requesthelp wanted

描述

Here's the situation:

  • I subscribed to a few planets (like planet-libre.org)
  • I subscribed to a few blogs that put some of its articles (but not all of them) on some of those planets

Once in a while, I have duplicates : the article of the planet subscription and the one of the blog subscription.

I'm wondering if it's possible to think about a way to "clear" the displayed articles in those cases and to display only one of them (like the original one, not the copies on the planets).

贡献者指南

技术栈
php
领域
backend
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
half day
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
PHPRSS feed parsingDatabase schema understanding
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
40
研究方向
To implement deduplication, first understand the data model of articles and feeds in FreshRSS (likely in app/Models/). Review the issue comments for proposed solutions, such as comparing article hashes or URLs. Then design a solution that detects duplicates from planet subscriptions and original blog feeds, and either filters or marks them. Implementation should be purely backend without UI changes unless needed.
Clear duplicates · FreshRSS/FreshRSS#948 | Good First Issue