Course Wiki
Confusion table — Machine Learning Zoomcamp Module 4
Confusion table is a way of measuring different types of errors and correct decisions that binary classifiers can make. Considering this information, it is possible to evaluate the quality of the model by different strategies.
Related Pages
Machine Learning Zoomcamp › Module 4: Evaluation Metrics for Classification › Confusion table
Notes
Confusion table is a way of measuring different types of errors and correct decisions that binary classifiers can make. Considering this information, it is possible to evaluate the quality of the model by different strategies.
When comes to a prediction of an LR model, each falls into one of four different categories:
- Prediction is that the customer WILL churn. This is known as the Positive class
- And Customer actually churned - Known as a True Positive (TP)
- But Customer actually did not churn - Known as a False Positive (FP)
- Prediction is that the customer WILL NOT churn’ - This is known as the Negative class
- Customer did not churn - True Negative (TN)
- Customer churned - False Negative (FN)
Confusion Table is a way to summarize the above results in a tabular format, as shown below:
| Predictions | |||
|---|---|---|---|
| Negative | Positive | ||
| Actual | Negative | TN | FP |
| Positive | FN | TP | |
!confusion_matrix.png
The accuracy corresponds to the sum of TN and TP divided by the total of observations.
The code of this project is available in this jupyter notebook.
Add notes from the video (PRs are welcome)
| ⚠️ |
The notes are written by the community. If you see an error here, please create a PR with a fix. |
Key concepts
Related notes
- mlz-m01-introduction-to-numpy
- mlz-m01-introduction-to-pandas
- mlz-m01-linear-algebra-refresher
- mlz-m01-setting-up-the-environment
- mlz-m02-baseline-model-for-car-price-prediction-project
- mlz-m02-categorical-variables
- mlz-m02-computing-rmse-on-validation-data
- mlz-m02-data-preparation
- mlz-m02-exploratory-data-analysis
- mlz-m02-feature-engineering
- mlz-m02-linear-regression
- mlz-m02-linear-regression-vector-form
- mlz-m02-regularization
- mlz-m02-root-mean-squared-error-rmse
- mlz-m02-setting-up-the-validation-framework
- mlz-m02-training-linear-regression-normal-equation
- mlz-m02-tuning-the-model
- mlz-m02-using-the-model
- mlz-m03-data-preparation
- mlz-m03-eda
- mlz-m03-feature-importance-churn-rate-and-risk-ratio
- mlz-m03-feature-importance-correlation
- mlz-m03-feature-importance-mutual-information
- mlz-m03-logistic-regression
- mlz-m03-model-interpretation
- mlz-m03-one-hot-encoding
- mlz-m03-setting-up-the-validation-framework
- mlz-m03-training-logistic-regression-with-scikit-learn
- mlz-m04-accuracy-and-dummy-model
- mlz-m04-cross-validation
- mlz-m04-evaluation-metrics-session-overview
- mlz-m04-explore-more
- mlz-m04-precision-and-recall
- mlz-m04-roc-auc
- mlz-m04-roc-curves
- mlz-m04-summary
- mlz-m06-gradient-boosting-and-xgboost
- mlz-m06-xgboost-parameter-tuning
- mlz-m08-installation-of-tensorflow
- mlz-m10-creating-a-pre-processing-service