Unselected Features Help the Selection of Features

PROJECT TITLE :

Feature Selection Boosted by Unselected Features

ABSTRACT:

The goal of feature selection is to identify those characteristics that are most strongly relevant and to eliminate the others. In recent times, there has been a lot of interest in embedded feature selection methods. These methods incorporate learning of feature weights into the process of training a classifier, which has garnered a lot of attention. Traditional embedded methods, on the other hand, only concentrate on the combinatorial optimality of all of the features that are chosen. They will often choose the features that are only marginally relevant because their combination abilities are satisfactory, but they will omit some features that are extremely relevant, which will bring the generalization performance down. In order to solve this problem, we have developed a brand new embedded framework for feature selection that we call feature selection boosted by unselected features (FSBUF). To be more specific, we modify the conventional embedded model by adding an additional classifier for features that have not been chosen, and we jointly learn the feature weights in order to maximize the classification loss caused by features that have not been chosen. As a consequence of this, the additional classifier reuses the strongly relevant features that were not selected to replace the features in the selected feature subset that were only moderately relevant. Our ultimate goal can be expressed as an optimization problem called a minimax optimization problem, and we devise an efficient gradient-based algorithm to solve it. In addition, we provide a theoretical demonstration that the proposed FSBUF is capable of enhancing the generalization ability of conventional embedded feature selection methods. Extensive testing on both artificial and actual-world data sets demonstrates that FSBUF provides superior performance while also being easily understandable.

Did you like this research project?

To get this research project Guidelines, Training and Code... Click Here