Course Wiki
Data preparation — Machine Learning Zoomcamp Module 3
This session covered data obtention and some procedures of data preparation.
Related Pages
Machine Learning Zoomcamp › Module 3: Machine Learning for Classification › Data preparation
Notes
This session covered data obtention and some procedures of data preparation.
Commands, functions, and methods:
!wget- Linux shell command for downloading datapd.read.csv()- read csv filesdf.head()- take a look of the dataframedf.head().T- take a look of the transposed dataframedf.columns- retrieve column names of a dataframedf.columns.str.lower()- lowercase all the letters in the columns names of a dataframedf.columns.str.replace(' ', '_')- replace the space separator in the columns names of a dataframedf.dtypes- retrieve data types of all seriesdf.index- retrieve indices of a dataframepd.to_numeric()- convert a series values to numerical values. Theerrors='coerce'argument allows making the transformation despite some encountered errors.df.fillna()- replace NAs with some value(df.x == "yes").astype(int)- convert x series of yes-no values to numerical values.
The entire code of this project is available in this jupyter notebook.
| ⚠️ |
The notes are written by the community. If you see an error here, please create a PR with a fix. |
Key concepts
Related notes
- mlz-m01-introduction-to-numpy
- mlz-m01-introduction-to-pandas
- mlz-m01-linear-algebra-refresher
- mlz-m01-setting-up-the-environment
- mlz-m01-summary
- mlz-m02-baseline-model-for-car-price-prediction-project
- mlz-m02-categorical-variables
- mlz-m02-computing-rmse-on-validation-data
- mlz-m02-data-preparation
- mlz-m02-exploratory-data-analysis
- mlz-m02-feature-engineering
- mlz-m02-linear-regression
- mlz-m02-linear-regression-vector-form
- mlz-m02-regularization
- mlz-m02-root-mean-squared-error-rmse
- mlz-m02-setting-up-the-validation-framework
- mlz-m02-training-linear-regression-normal-equation
- mlz-m02-tuning-the-model
- mlz-m02-using-the-model
- mlz-m03-churn-prediction-project
- mlz-m03-eda
- mlz-m03-explore-more
- mlz-m03-feature-importance-churn-rate-and-risk-ratio
- mlz-m03-feature-importance-correlation
- mlz-m03-feature-importance-mutual-information
- mlz-m03-logistic-regression
- mlz-m03-model-interpretation
- mlz-m03-one-hot-encoding
- mlz-m03-setting-up-the-validation-framework
- mlz-m03-summary
- mlz-m03-training-logistic-regression-with-scikit-learn
- mlz-m03-using-the-model
- mlz-m04-accuracy-and-dummy-model
- mlz-m04-confusion-table
- mlz-m04-cross-validation
- mlz-m04-roc-auc
- mlz-m04-roc-curves
- mlz-m04-summary
- mlz-m06-data-cleaning-and-preparation
- mlz-m06-decision-trees-parameter-tuning
- mlz-m06-gradient-boosting-and-xgboost
- mlz-m06-xgboost-parameter-tuning
- mlz-m08-installation-of-tensorflow
- mlz-m10-creating-a-pre-processing-service