Framework of Meta-Heuristic Variable Length Searching for Feature Selection in High-Dimensional Data

Qadir Saraf, Tara Othman and Fuad, Norfaiza and Md Taujuddin, Nik Shahidah Afifi (2023) Framework of Meta-Heuristic Variable Length Searching for Feature Selection in High-Dimensional Data. Computers, 12 (7). pp. 1-15.

[img] Text
J16188_001cf5dff0bc3a42365b2bcdb33bad98.pdf
Restricted to Registered users only

Download (1MB) | Request a copy

Abstract

Feature Selection in High Dimensional Space is a combinatory optimization problem with an NP-hard nature. Meta-heuristic searching with embedding information theory-based criteria in the fitness function for selecting the relevant features is used widely in current feature selection algorithms. However, the increase in the dimension of the solution space leads to a high computational cost and risk of convergence. In addition, sub-optimality might occur due to the assumption of a certain length of the optimal number of features. Alternatively, variable length searching enables searching within the variable length of the solution space, which leads to more optimality and less computational load. The literature contains various meta-heuristic algorithms with variable length searching. All of them enable searching in high dimensional problems. However, an uncertainty in their performance exists. In order to fill this gap, this article proposes a novel framework for comparing various variants of variable length-searching meta-heuristic algorithms in the application of feature selection. For this purpose, we implemented four types of variable length meta-heuristic searching algorithms, namely VLBHO-Fitness, VLBHO-Position, variable length particle swarm optimization (VLPSO) and genetic variable length (GAVL), and we compared them in terms of classification metrics. The evaluation showed the overall superiority of VLBHO over the other algorithms in terms of accomplishing lower fitness values when optimizing mathematical functions of the variable length type.

Item Type: Article
Uncontrolled Keywords: feature selection; high dimensional space; meta-heuristic; solution space; variable length
Subjects: Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75-76.95 Calculating machines
Divisions: Faculty of Computer Science and Information Technology > FSKTM
Depositing User: Mr. Mohamad Zulkhibri Rahmad
Date Deposited: 28 Oct 2024 08:12
Last Modified: 28 Oct 2024 08:16
URI: http://eprints.uthm.edu.my/id/eprint/11661

Actions (login required)

View Item View Item