Real-World Natural Language Processing

11 Deploying and serving NLP applications

This chapter covers

• Choosing the right architecture for your NLP application
• Version-controlling your code, data, and model
• Deploying and serving your NLP model
• Interpreting and analyzing model predictions with LIT (Language Interpretability Tool)

Where chapters 1 through 10 of this book are about building NLP models, this chapter covers everything that happens outside NLP models. Why is this important? Isn’t NLP all about building high-quality ML models? It may come as a surprise if you don’t have much experience with production NLP systems, but a large portion of an NLP system has very little to do with NLP at all. As shown in figure 11.1, only a tiny fraction of a typical real-world ML system is ...