Deploy ML Apps

Deploy ML Apps#

Batch vs Online Prediction#

../_images/batch_deployment.png

Fig. 6 Batch prediction. Source: CS 329S: Machine Learning Systems Design (Stanford, 2022)#

../_images/real_time_deployment.png

Fig. 7 Online prediction. Source: CS 329S: Machine Learning Systems Design (Stanford, 2022)#

Deployment Types#

Batch Prediction#

Batch Prediction

Model-In-Service#

Model In Service

Model-As-Service#

Model As Service

Examples#

Refer to code example in code/deployment directory.

Contents