Course Wiki
Summary — Machine Learning Zoomcamp Module 6
- Decision trees learn if-then-else rules from data. - Finding the best split: select the least impure split. This algorithm can overfit, that's why we control it by limiting the max depth and the size of the group. - Random forest is a...
Related Pages
Machine Learning Zoomcamp › Module 6: Decision Trees and Ensemble Learning › Summary
Notes
- Decision trees learn if-then-else rules from data.
- Finding the best split: select the least impure split. This algorithm can overfit, that’s why we control it by limiting the max depth and the size of the group.
- Random forest is a way of combining multiple decision trees. It should have a diverse set of models to make good predictions.
- Gradient boosting trains model sequentially: each model tries to fix errors of the previous model. XGBoost is an implementation of gradient boosting.
Add notes from the video (PRs are welcome)
| ⚠️ |
The notes are written by the community. If you see an error here, please create a PR with a fix. |
Key concepts
Related notes
- mlz-m01-model-selection-process
- mlz-m01-setting-up-the-environment
- mlz-m05-summary
- mlz-m06-credit-risk-scoring-project
- mlz-m06-data-cleaning-and-preparation
- mlz-m06-decision-tree-learning-algorithm
- mlz-m06-decision-trees
- mlz-m06-decision-trees-parameter-tuning
- mlz-m06-ensemble-learning-and-random-forest
- mlz-m06-explore-more
- mlz-m06-gradient-boosting-and-xgboost
- mlz-m06-selecting-the-best-model
- mlz-m06-xgboost-parameter-tuning
- mlz-m08-transfer-learning
- mlz-m09-explore-more