online-ml/river

Online GapEncoder

已关闭

#1,439 创建于 2023年11月3日

 (4 条评论) (0 个反应) (0 位负责人)Python (553 个派生)batch import
Good first issueNew feature

仓库指标

星标
 (4,574 个星标)
PR 合并指标
 (平均合并 47天 6小时) (30 天内合并 46 个 PR)

描述

skrub is a wonderful new project related to scikit-learn. You can see Gaël Varoquaux present it here. They have a transformer called GapEncoder: it's a way to embed fuzzy strings. This could be really powerful online, say for classifying Tweets or Twitch messages, where typos are aplenty.

We already have a way to do online TD-IDF/count vectorization. But we don't have Gamma-Poisson matrix factorization. It is doable online though. Once we have it, we could assemble the two into a nice GapEncoder class. See paper here.

This is related to #1412. Indeed, maybe this works well without Gamma-Poisson matrix factorization. For instance, we could use decomposition.LDA, which we already have.

贡献者指南