Bayesian random forests for high-dimensional classification and regression with complete and incomplete microarray data

Oyebayo, Olaniran Ridwan (2018) Bayesian random forests for high-dimensional classification and regression with complete and incomplete microarray data. Doctoral thesis, Universiti Tun Hussein Onn Malaysia.

Preview	Text 24p OLANIRAN RIDWAN OYEBAYO.pdf Download (850kB) | Preview
	Text (Copyright Declaration) OLANIRAN RIDWAN OYEBAYO COPYRIGHT DECLARATION.pdf Restricted to Repository staff only Download (793kB) | Request a copy
	Text (Full Text) OLANIRAN RIDWAN OYEBAYO WATERMARK.pdf Restricted to Registered users only Download (2MB) | Request a copy

Abstract

Random Forests (RF) are ensemble of trees methods widely used for data prediction, interpretation and variable selection purposes. The wide acceptance can be attributed to its robustness to high dimensionality problem. However, when the high-dimensional data is a sparse one, RF procedures are inefficient. Thus, this thesis aims at improving the efficiency of RF by providing a probabilistic framework using Bayesian reasoning. The modification comprises of two main modelling problems: high-dimensionality and missing data. These problems were extensively studied within the scope of classification (binary and multi-class) and regression (linear and survival). The new procedure called Bayesian Random Forest (BRF) focuses on modification of terminal node parameter estimation and selection of random subsets for splitting. BRF algorithm combines the strengths of random subset and greedy selection procedures in creating new maximal ordered variable relevance weights. These weights are in turn used to develop new impurity functions for selecting optimal splits for each tree in a forest. BRF works mainly because the maximal weights are computed using a data-driven procedure called bootstrap prior which was shown to satisfy the uniformly minimum variance property under mild regularity conditions. In addition, BRF ensures that important variables are selected at each subset selection step, thus reducing false signals and eventually improving accuracy of models. As a further extension, missing covariates problem was also handled by pre-imputing the variables using Multivariate Imputation by Chain Equation (MICE) before building forests. Performance analysis was achieved using simulated and eighteen real-life classification and regression microarray cancer datasets. Empirical results from the data analysis established appreciable supremacy over RF and several other competing methods. Keyword: Random Forest, Bayesian Inference, Classification, Regression, Missing Data.

Item Type:	Thesis (Doctoral)
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA76.75-76.765 Computer software
Divisions:	Faculty of Applied Science and Technology > Department of Mathematics and Statistics
Depositing User:	Miss Afiqah Faiqah Mohd Hafiz
Date Deposited:	21 Jul 2021 04:51
Last Modified:	21 Jul 2021 04:51
URI:	http://eprints.uthm.edu.my/id/eprint/326

Actions (login required)

View Item