online-ml/river

Online GapEncoder

已關閉

#1,439 建立於 2023年11月3日

 (4 則留言) (0 個反應) (0 位負責人)Python (553 個分叉)batch import
Good first issueNew feature

倉庫指標

星標
 (4,574 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

skrub is a wonderful new project related to scikit-learn. You can see Gaël Varoquaux present it here. They have a transformer called GapEncoder: it's a way to embed fuzzy strings. This could be really powerful online, say for classifying Tweets or Twitch messages, where typos are aplenty.

We already have a way to do online TD-IDF/count vectorization. But we don't have Gamma-Poisson matrix factorization. It is doable online though. Once we have it, we could assemble the two into a nice GapEncoder class. See paper here.

This is related to #1412. Indeed, maybe this works well without Gamma-Poisson matrix factorization. For instance, we could use decomposition.LDA, which we already have.

貢獻者指南