Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Adaboost and its application using classification trees
Dissertation (MSc)--University of Pretoria, 2013.
Saved in:
| Other Authors: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
University of Pretoria
2021
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613667157082112 |
|---|---|
| access_status_str | Open Access |
| author2 | Kanfer, F.H.J. (Frans) |
| author_browse | Kanfer, F.H.J. (Frans) |
| author_facet | Kanfer, F.H.J. (Frans) |
| collection | Thesis |
| dc_rights_str_mv | © 2020 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria. |
| description | Dissertation (MSc)--University of Pretoria, 2013. |
| format | Thesis |
| id | oai:repository.up.ac.za:2263/79206 |
| institution | University of Pretoria (South Africa) |
| language | English |
| last_indexed | 2026-06-10T12:39:47.098Z |
| license_str | Other — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UPSpace — University of Pretoria Institutional Repository |
| publishDate | 2021 |
| publishDateRange | 2021 |
| publishDateSort | 2021 |
| publisher | University of Pretoria |
| publisherStr | University of Pretoria |
| record_format | dspace |
| source_str | UPSpace — University of Pretoria Institutional Repository |
| spelling | oai:repository.up.ac.za:2263/79206 Adaboost and its application using classification trees Kanfer, F.H.J. (Frans) nvithal@iburst.co.za Millard, Sollie M. Vithal, Nishay UCTD Dissertation (MSc)--University of Pretoria, 2013. This mini-dissertation seeks to provide the reader with an understanding of one of the most popular boosting methods in use today called Adaboost and its first extension Adaboost.M1. Boosting, as the name suggests, is an ensemble and machine learningmethod created to improve or "boost" prediction accuracy via repeatedMonte- Carlo type simulations. Due to the methods flexibility to be applied over any learning algorithm, in this dissertation we have chosen to make use of decision trees, or more specifically classification trees constructed by the CART method, as a base predictor. The reason for boosting classification trees include the learning algorithms lack of accuracy when applied on a stand-alone basis in many settings, its practical real world application and the ability for classification trees to perform natural internal feature selection. The core topics covered include where the Adaboost method arose from, how and why it works, possible issues with the method and examples using classification trees as the base predictor to demonstrate and assess the methods performance. Although no formal mathematical derivation of the method was provided at the time the method was created, a statistical justification was put forward several years later which explained Adaboost in terms of well known additive modelling when minimizing a specific exponential loss function or criterion. This justification is provided along with real and simulated examples demonstrating Adaboost’s performance using two types of classification trees i.e. stumps (classification trees with two terminal nodes) and optimized or pruned full trees. What is shown empirically is that when boosting tree stumps the performance enhancements achieved by Adaboost in many cases meets or exceeds the single or boosted larger tree structures. This finding has benefits such as simplified model structures and lower computational time. Lastly we provide a cursory review of new developments within the field of boosting such as margin theory which seeks to provide an explanation as to the methods seemingly mysterious test and training error performance; optimized tree boosting procedures such as gradient boosted methods and combinatorial ensemble methods using bagging and boosting. Statistics MSc Unrestricted 2021-04-06T07:22:10Z 2021-04-06T07:22:10Z 2017/02/10 2013 Dissertation Vithal, N 2013, Adaboost and its application using classification trees, MSc Dissertation, University of Pretoria, Pretoria, viewed yymmdd <http://hdl.handle.net/2263/79206> E14/4/555 http://hdl.handle.net/2263/79206 en © 2020 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria. application/pdf University of Pretoria |
| spellingShingle | UCTD Adaboost and its application using classification trees |
| title | Adaboost and its application using classification trees |
| title_full | Adaboost and its application using classification trees |
| title_fullStr | Adaboost and its application using classification trees |
| title_full_unstemmed | Adaboost and its application using classification trees |
| title_short | Adaboost and its application using classification trees |
| title_sort | adaboost and its application using classification trees |
| topic | UCTD |
| url | http://hdl.handle.net/2263/79206 |