online-ml/river

Online GapEncoder

Geschlossen

#1.439 geöffnet am 03.11.2023

 (4 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Python (553 Forks)batch import
Good first issueNew feature

Repository-Metriken

Stars
 (4.574 Sterne)
PR-Merge-Metriken
 (Durchschn. Merge 47T 6h) (46 gemergte PRs in 30 T)

Beschreibung

skrub is a wonderful new project related to scikit-learn. You can see Gaël Varoquaux present it here. They have a transformer called GapEncoder: it's a way to embed fuzzy strings. This could be really powerful online, say for classifying Tweets or Twitch messages, where typos are aplenty.

We already have a way to do online TD-IDF/count vectorization. But we don't have Gamma-Poisson matrix factorization. It is doable online though. Once we have it, we could assemble the two into a nice GapEncoder class. See paper here.

This is related to #1412. Indeed, maybe this works well without Gamma-Poisson matrix factorization. For instance, we could use decomposition.LDA, which we already have.

Contributor Guide