zilliztech/GPTCache

[Feature]: Cache answer diversity

Open

#551 aperta il 9 ott 2023

Vedi su GitHub
 (3 commenti) (0 reazioni) (0 assegnatari)Python (407 fork)batch import
good first issuehacktoberfest

Metriche repository

Star
 (5857 star)
Metriche merge PR
 (Nessuna PR mergiata in 30 g)

Descrizione

Is your feature request related to a problem? Please describe.

Currently, when GPTCache evaluates similarity, it retrieves cached answers that meet the similarity threshold. However, in many generation scenarios, users may desire a range of answers that exhibit similar meaning but offer more content diversity.

Are you looking for a lightweight model that can easily rewrite text?

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

Guida contributor