A Machine Learning foundation project focused on preparing real-world data before building ML models.
This project demonstrates the complete data preprocessing workflow using an insurance dataset, including data exploration, cleaning, feature engineering, encoding, feature scaling, and train-test splitting.
Raw datasets usually cannot be used directly for Machine Learning.
Before training any model, data must be cleaned, transformed, and prepared.
This project walks through the complete preprocessing pipeline that is typically performed before model development.
- Python
- Pandas
- NumPy
- Matplotlib
- Seaborn
- Scikit-learn
- Jupyter Notebook
insurance.csv
The dataset contains insurance-related information such as:
- Age
- Sex
- BMI
- Children
- Smoker
- Region
- Charges
- Load dataset
- Inspect data
- Check shape
- Check data types
- Summary statistics
- Missing value analysis
- Duplicate value analysis
- Univariate analysis
- Bivariate analysis
- Correlation analysis
- Distribution analysis
- Outlier detection
- Data visualization
- Handle missing values
- Remove duplicates
- Fix data types
- Prepare clean dataset
- Encode categorical features
- Label Encoding
- One-Hot Encoding
- Create ML-ready features
- Feature Scaling
- Standardization
- Normalization
- Train-Test Split
- Data Exploration
- Exploratory Data Analysis (EDA)
- Data Cleaning
- Feature Engineering
- Feature Encoding
- Feature Scaling
- Data Preprocessing
- Train-Test Split
- Preparing data for Machine Learning
Through this project I practiced:
- Understanding raw datasets
- Cleaning real-world data
- Preparing datasets for ML models
- Applying feature engineering techniques
- Performing feature scaling
- Building a complete ML preprocessing pipeline
machine-learning-data-preprocessing/
│
├── insurance.csv
├── machine_learning_data_preprocessing.ipynb
├── README.md
- Train Machine Learning models
- Model evaluation
- Hyperparameter tuning
- Cross Validation
- Feature Selection
- Model Deployment
MD ANIK
Machine Learning • Python • Pandas • Statistics • Data Science