karakeep-app/karakeep

Deduplication doesn't take into account the trailing "/"

開放

#864 建立於 2025年1月12日

 (1 則留言) (3 個反應) (0 位負責人)TypeScript (1,356 個分叉)auto 404
feature requestgood first issuepri/mediumstatus/approved

倉庫指標

星標
 (27,587 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Describe the Bug

I am not a programmer so I may be well off base here but this is what i've found.

I have imported all my bookmarks from the various services i've used over the years totalling 12844 bookmarks. While scanning the list in Hoarder I came across some duplicates, the only difference between urls being a trailing "/". I've seen that you do deduplication on import but treat duplicate URLs with different protocols (http and https) as unique.

Long story short, I knocked up a python script with chatgpt to take my exported bookmarks and ignore the protocol and normalise the urls (ignoring the trailing "/") and the output was 2257!

Steps to Reproduce

Import bookmarks with duplicate urls but with one having trailing slashes added.

Expected Behaviour

One copy of a particular url.

Screenshots or Additional Context

No response

Device Details

No response

Exact Hoarder Version

v0.21.0

Have you checked the troubleshooting guide?

  • I have checked the troubleshooting guide and I haven't found a solution to my problem

貢獻者指南