Ensemble Methods: Bagging and Boosting
                                             Piyush Rai
                                   Machine Learning (CS771A)
                                            Oct 26, 2016
       Machine Learning (CS771A)          Ensemble Methods: Bagging and Boosting                  1
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        Voting or Averaging of predictions of multiple pre-trained models
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        “Stacking”: Use predictions of multiple models as “features” to train a new model and use the new
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        model to make predictions on test data
   Some Simple Ensembles
       Machine Learning (CS771A)             Ensemble Methods: Bagging and Boosting                        2
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        “Stacking”: Use predictions of multiple models as “features” to train a new model and use the new
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        model to make predictions on test data
   Some Simple Ensembles
        Voting or Averaging of predictions of multiple pre-trained models
       Machine Learning (CS771A)             Ensemble Methods: Bagging and Boosting                        2
   Some Simple Ensembles
        Voting or Averaging of predictions of multiple pre-trained models
        “Stacking”: Use predictions of multiple models as “features” to train a new model and use the new
        model to make predictions on test data
       Machine Learning (CS771A)             Ensemble Methods: Bagging and Boosting                        2