combust/mleap

Case Insensitivity on MLeap Models

Open

#713 geöffnet am 8. Sept. 2020

Auf GitHub ansehen
 (3 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Scala (312 Forks)batch import
enhancementhelp wanted

Repository-Metriken

Stars
 (1.461 Stars)
PR-Merge-Metriken
 (Keine gemergten PRs in 30 T)

Beschreibung

By default, if you train a PySparkML model with a dataframe that has uppercase column names, and then try to run an inference with the same column names but in lowercase, the prediction will fail. Is there a parameter or way to set case insensitivity on inference?

I see this checking for a strict vs relaxed select of the leapframe which I assume is what I'm looking for. How can I set that when serializing a PySpark Model to an MLeap Bundle?

Thanks!

Edit: I see that my second question was wrong - It comes from the transform function, not embedded into the Bundle itself. So when I call model.transform(frame) is there documentation on how to pass in the relaxedSelect option?

Edit: It seems like I'm incorrect on what relaxedSelect does. It seems to just "not throw an error on columns that don't exist" instead of being case insensitive. Is there a case insensitivity option?

Contributor Guide