lance-format/lance
Allow users to set a distance threshold to consider two vectors a "very similiar"
已关闭
#875 创建于 2023年5月17日
A-indexA-pythonenhancementgood first issuehelp wanted
仓库指标
- 星标
- (6,582 个星标)
- PR 合并指标
- (平均合并 6天 1小时) (30 天内合并 219 个 PR)
描述
Problem Statement
For example, I have lots of images that are resized jpgs and gifs -- the hashes are technically different, but the vector l2 distance is tiny then there's deduplicating things like images and watermarked images -- i also want this to be grouped together and to pick just one which basically uses the vector distance again, but with a looser threshold