spark-nlp

Is a library that was developed by john snow labs to offer common transformers for NLP to Spark. It would be incredibly useful to be able to train these models and then deploy them with MLeap.

https://github.com/JohnSnowLabs/spark-nlp

We still need to outline the work in terms of which transformers and models we need to offer support for and if we will include them in core modules or create separate modules for NLP.