Course Wiki
Creating a pre-processing service — Machine Learning Zoomcamp Module 10
Add notes from the video (PRs are welcome)
Related Pages
Machine Learning Zoomcamp › Module 10: Kubernetes and TensorFlow Serving › Creating a pre-processing service
Notes
Add notes from the video (PRs are welcome)
- turn jupyter notebook into flask app
- the notebook communicates with the model deployed with tensorflow
- the notebook fetches an image, pre-processes it, turns it into protobuf, sends it to tensorflow-serving, does post-processing and finally gives a human-readable answer
- convert notebook into python script and call the script gateway
- prepare request, send request, prepare response
- you can reuse the flask app code from session 5
- two components: docker container with tensorflow serving and flask application with the gateway
- be aware of the library sizes: tensorflow 1.7 GB, tensorflow CPU ~400 MB, tensorflow serving
- turn numpy array into protobuf format
- tensorflow protobuf
| ⚠️ |
The notes are written by the community. If you see an error here, please create a PR with a fix. |
Key concepts
Related notes
- mlz-m01-introduction-to-numpy
- mlz-m01-introduction-to-pandas
- mlz-m01-linear-algebra-refresher
- mlz-m01-setting-up-the-environment
- mlz-m02-baseline-model-for-car-price-prediction-project
- mlz-m02-categorical-variables
- mlz-m02-computing-rmse-on-validation-data
- mlz-m02-data-preparation
- mlz-m02-exploratory-data-analysis
- mlz-m02-feature-engineering
- mlz-m02-linear-regression
- mlz-m02-linear-regression-vector-form
- mlz-m02-regularization
- mlz-m02-root-mean-squared-error-rmse
- mlz-m02-setting-up-the-validation-framework
- mlz-m02-training-linear-regression-normal-equation
- mlz-m02-tuning-the-model
- mlz-m02-using-the-model
- mlz-m03-data-preparation
- mlz-m03-eda
- mlz-m03-feature-importance-churn-rate-and-risk-ratio
- mlz-m03-feature-importance-correlation
- mlz-m03-feature-importance-mutual-information
- mlz-m03-logistic-regression
- mlz-m03-model-interpretation
- mlz-m03-one-hot-encoding
- mlz-m03-setting-up-the-validation-framework
- mlz-m03-training-logistic-regression-with-scikit-learn
- mlz-m04-accuracy-and-dummy-model
- mlz-m04-confusion-table
- mlz-m04-cross-validation
- mlz-m04-roc-auc
- mlz-m04-roc-curves
- mlz-m04-summary
- mlz-m05-deployment-to-the-cloud-aws-elastic-beanstalk-op
- mlz-m05-environment-management-docker
- mlz-m05-explore-more
- mlz-m05-intro-session-overview
- mlz-m05-python-virtual-environment-pipenv
- mlz-m05-serving-the-churn-model-with-flask
- mlz-m05-web-services-introduction-to-flask
- mlz-m06-gradient-boosting-and-xgboost
- mlz-m06-xgboost-parameter-tuning
- mlz-m08-checkpointing
- mlz-m08-explore-more
- mlz-m08-fashion-classification
- mlz-m08-installation-of-tensorflow
- mlz-m08-tensorflow-and-keras
- mlz-m08-transfer-learning
- mlz-m09-explore-more
- mlz-m09-introduction-to-serverless
- mlz-m09-preparing-a-docker-image
- mlz-m09-python-3-12-vs-tf-lite-2-17
- mlz-m09-tensorflow-lite
- mlz-m10-deploying-a-simple-service-to-kubernetes
- mlz-m10-deploying-tensorflow-models-to-kubernetes
- mlz-m10-deploying-to-eks
- mlz-m10-explore-more
- mlz-m10-introduction-to-kubernetes
- mlz-m10-overview
- mlz-m10-running-everything-locally-with-docker-compose
- mlz-m10-summary
- mlz-m10-tensorflow-serving