reworkd/AgentGPT

✨ Investigate the best similarity score threshold to remove duplicate tasks

开放

#729 创建于 2023年6月6日

 (0 条评论) (0 个反应) (0 位负责人)TypeScript (9,446 个派生)batch import
enhancementhelp wanted

仓库指标

星标
 (34,594 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

When we generate tasks, we filter tasks that have a similarity score that is too close to existing tasks in the vector database

similar_tasks = memory.get_similar_tasks(
    task, score_threshold=0.95  # TODO: Once we use ReAct, revisit
)

This is done with the help of the code above. Arbitrarily, we use 0.95. Even with this, the task may not be related.

On the other hand, there may be very related / duplicated tasks that have a score that is less than this.

This ticket is tasked with investigating what the best value for this threshold is, or to use some other means of calculating similarity for this given case.

贡献者指南