Random Forest

-

The core idea behind Random Forest is to create a "forest" of decision trees, each built on different subsets of the data and using a random subset of features. It's used for both classification (like spam detection) and regression (like predicting house prices). A type of bagging that uses decision trees to improve prediction accuracy and robustness.

How Does It Work?

  1. Data Sampling: Randomly pick samples from your data.
  2. Tree Building: Build decision trees on these samples.
  3. Voting/Averaging: For classification, trees vote for the most common class. For regression, the average of predictions is taken.


Example: Predicting House Prices

Imagine we want to predict house prices based on features like size, location, and age of the house.

Step-by-Step

  1. Collect Data: Gather data on house prices along with features like size, location, and age.

  2. Create Subsets: Randomly create multiple subsets of this data.

  3. Build Trees: For each subset, build a decision tree. Each tree might split on different features. For example:

    • Tree 1: Splits on size first, then location.
    • Tree 2: Splits on age first, then size.

  4. Predict: For a new house, each tree makes a price prediction. These predictions are then averaged.

Example in Numbers

  • House 1: 2000 sq ft, Downtown, 10 years old
  • House 2: 1500 sq ft, Suburbs, 5 years old

Data:

  • House 1: $500,000
  • House 2: $300,000
  • And so on...

Random Forest:

  • Tree 1 predicts $450,000
  • Tree 2 predicts $470,000
  • Tree 3 predicts $440,000
  • Average prediction: $(450,000 + 470,000 + 440,000) / 3 = $453,333

Advantages

  • Accurate: Combines multiple trees for better predictions.
  • Robust: Handles large datasets and avoids overfitting.
  • Random Forest deals with overfitting and outliers by averaging the predictions of multiple decision trees trained on random subsets of the data and features, which reduces variance and smooths out anomalies.

Disadvantages

  • Complex: Harder to interpret than single trees.
  • Computationally Intensive: Requires more resources.

Applications

  • Finance: Fraud detection, stock price prediction.
  • Healthcare: Disease risk prediction, patient diagnosis.

Conclusion

Random Forest is a powerful tool for making accurate predictions by combining multiple decision trees. It's versatile and robust, making it suitable for a wide range of applications.

Comments

Post a Comment

Popular posts from this blog

Extracting Tables and Text from Images Using Python

-
Image
In this blog, we'll explore a complete Python solution that detects and extracts tables and text from images using libraries like Transformers, OpenCV, PaddleOCR, and easyOCR. This step-by-step breakdown includes code to detect tables, extract content from individual table cells, and retrieve any remaining text in the image. Overview When working with scanned documents, such as invoices or forms, it is essential to accurately extract both structured information (like tables) and unstructured text. The approach we’ll explore uses Microsoft's pretrained object detection model to locate tables and OCR techniques to extract the text from both table cells and the rest of the image. Steps: 1. This code first detects table using microsoft's model. and save that image which contains detected table only  2. After that, from the detected table , we make a seperate image for each cell.  3. Then we read text from the image of each cell  4. Now, to read the extra texts except for the ...
Read more

Getting Started with ML

-
Image
 Types of ML :- 1) Supervised ML :- Before going for supervised learning, you need to be aware of two terminologies: Suppose, you have the data of student's age and weight. Now, for new student, just by knowing age, you want to predict his weight. So, in this case i. Dependent Variable : Age ii. Independent Variable : Weight Regression : It is applied on Numeric Data such as temperature, weight etc. Classification : It is applied on Categorial Data. There are 2 types of classification: 1.Binary Classification - Yes/No, Spam/Not Spam, etc. 2. Multiclass Classification - Small/Medium/Large, Bad/Average/Good/Excellent etc. 2) Unsupervised ML :- i. Clustering : If we have some data where there is no dependent/independent variable, then we can use clustering. suppose, we have data for salary and age. There is no relation between salary and age. So, clustering groups the data and keep the data with same characteristics together. ii. Dimensionality Reduction : Suppose, we have 100...
Read more

Linear Regression

-
Image
 Linear Regression shows the Linear Relationship between dependent features(Y-axis) and independent features(X-axis).  There are 2 types of Linear Regression: 1. Simple Linear Regression -  It has only one independent variable. Hypothesis Function for Simple Linear Regression : where: Y is the dependent variable X is the independent variable  β0 is the intercept ( the value where the regression line crosses the y-axis) β1 is the slope/weight ex : calculate weight based on age. In above figure Red dots represent Actual Data Points and black dots represent predicted values. error is calculated by (Actual Value - Predicted Value) 2. Multiple Linear Regression -  It has more than one independent features.  Hypothesis Function for Simple Linear Regression : y= a0 + a1x1 + a2x2 + a3x3 + ..  Let's understand this by example, we all know that if the size of the house is bigger, then the price also increases. But along with this, there are many other factors ...
Read more