A Binary Superior Tracking Artificial Bee Colony with Dynamic Cauchy Mutation for Feature Selection

Chu, Xianghua; Li, Shuxiang; Gao, Da; Zhao, Wei; Cui, Jianshuang; Huang, Linya

doi:https://doi.org/10.1155/2020/8864315

Complexity

On this page

Abstract Introduction Background Discussion Conclusion Data Availability Disclosure Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Solving Engineering and Science Problems Using Complex Bio-inspired Computation Approaches

View this Special Issue

Research Article | Open Access

Volume 2020 | Article ID 8864315 | https://doi.org/10.1155/2020/8864315

A Binary Superior Tracking Artificial Bee Colony with Dynamic Cauchy Mutation for Feature Selection

Xianghua Chu,^1,2Shuxiang Li,¹Da Gao,¹Wei Zhao,¹Jianshuang Cui,³and Linya Huang¹

Academic Editor: Zhile Yang

Received07 Aug 2020

Revised24 Sept 2020

Accepted20 Oct 2020

Published09 Nov 2020

Abstract

This paper aims to propose an improved learning algorithm for feature selection, termed as binary superior tracking artificial bee colony with dynamic Cauchy mutation (BSTABC-DCM). To enhance exploitation capacity, a binary learning strategy is proposed to enable each bee to learn from the superior individuals in each dimension. A dynamic Cauchy mutation is introduced to diversify the population distribution. Ten datasets from UCI repository are adopted as test problems, and the average results of cross-validation of BSTABC-DCM are compared with other seven popular swarm intelligence metaheuristics. Experimental results demonstrate that BSTABC-DCM could obtain the optimal classification accuracy and select the best representative features for the UCI problems.

1. Introduction

Feature selection is one of the cornerstones in machine learning [1] to select the proper combination of features to best describe the target problem. The useful features are retained while the redundant features and irrelevant features are removed by feature selection. As a result, an appropriate set of selected features can reduce computational complexity, improve knowledge discovery, and achieve satisfactory learning performance [2]. However, the number of possible combinations increases exponentially with the number of candidate features, which make efficient methods always in need for feature selection.

Existing feature selection methods can be classified as filter method, embedded method, and wrapper method [3]. The filter method is to evaluate the correlation between variables to reduce feature size of dataset, and the evaluation process does not involve specific learning algorithms [4]. The embedded method embeds feature selection with classiﬁers, where the commonly embedded methods include support vector machine (SVM), ID3, C4.5, and Lasso, a least-squares regression method based on L1 regular terms [5]. The wrapper method uses a feature search component to produce feature subset and utilizes the specific classifier to evaluate the performance of different feature subsets until achieving termination conditions. In the wrapper method, swarm intelligence algorithms [6], such as particle swarm optimization [7], bacterial foraging optimization [8], grey wolf optimization [9], and brain storm optimization [10], have attracted great interests across various areas [5, 11].

Artificial bee colony (ABC) [12], as a recently proposed swarm intelligence metaheuristic [13], has been employed to address feature selection problems due to its promising efficiency and simple implementation. Keles and Kılıç [14] applied ABC to feature selection on SCADI dataset with 70 samples and 206 attributes. Seven features were finally selected from 206 features to classify the dataset with various classification methods. The classification accuracy was significantly improved. Kiliç and Keleş [15] proposed ABC to select features on z-Alizadeh Sani dataset with 303 samples and 56 attributes, and the classification accuracy is enhanced on the original data.

The promising applications encourage researchers to continuously improve the optimization performance of original ABC in feature selection. Shunmugapriya et al. [16] enhanced ABC by mining the global optimal solutions and previously abandoned solutions. Experimental results showed that the feature selection performance was improved without significant increase in computational cost. Özger et al.[17] implemented 8 variants of the binary ABC algorithm to solve feature selection problems, and the proposed algorithm using the bit-by-bit operator has a better global search capability. Wang et al. [18] diversified the initial food sources to make the initialization evenly distributed. Numerical results displayed that the method could get high classification accuracy and smaller feature subset. Liu [19] proposed an ABC variant based on knee points to accelerate the convergence speed on feature selection problems. Though the proposed strategies improve original ABC performance, however, in each iteration of the ABC variants, each food source is only updated in one dimension, and the searching strategy enables the bees to randomly learn from other bees. This results in slow convergence speed and inferior exploitation capability of ABC in the process of optimization.

In this work, a binary superior tracking artificial bee colony with dynamic Cauchy mutation (BSTABC-DCM) is proposed to further improve convergence speed and exploitation capability of ABC for feature selection. Two efficient search strategies, namely, superior tracking strategy [20] and dynamic Cauchy mutation, are integrated into the proposed algorithm. Compared with original ABC, superior tracking strategy enhances ABC’ learning behaviors in two aspects: (1) instead of only updating one dimension in each iteration, bees learn from others in each dimension in each iteration; (2) instead of learning randomly, bees select individuals with better fitness to follow. A dynamic Cauchy mutation is integrated to diversify the population and improve global search ability. Ten datasets of different types of UCI are adopted to test BSTABC-DCM on feature selection problems. Seven popular swarm intelligence algorithms are included for comparison. Comprehensive experiments are conducted to evaluate the effectiveness of the proposed method for feature selection.

This paper is organized as follows: Section 2 introduces the background includes the principle of the original ABC algorithm and related work on feature selection. Section 3 presents the proposed BSTABC-DCM. Section 4 shows the process and results of the experiment. Section 5 makes conclusions.

2. Background

2.1. Artificial Bee Colony

The ABC framework is divided into employed bee stage, onlooker bee stage, and scout bee stage [21]. The employed bee first mines food source and shares the information of food source with the onlooker bee. The onlooker bee selects food source to be mined according to the information. If the better food source not be mined, the onlooker bee transforms into the scout bee and searches for the new food source [22, 23]. Firstly, initialize the food source. The initialization method is as follows:in which , where refers to the number of food source, , refers to problem dimension, and refer to the maximum and minimum values of the dimension of source, respectively.(1)Employed bee stage: The amount of the employed bee is half of the initial food source, and it is attached to half of the better source. A new food source is mined near the attached food source. The mining method is shown in the following equation: where refers to the newly mined food source, is a random number between [−1, 1], and refer to the dimension of food source , respectively. Calculating and updating the objective function value of the new food source, and after the employed bee found a better food source, calculating the new fitness according to the following equation: where refers to objective function value of food source .(2)Onlooker bee stage: Calculating the probability by (4) and then selecting food source, the better food sources are retained by the roulette method. Further exploring food source by the following equation: where refers to the dimension of food source selected by roulette and is the food source different from .(3)Scout bee stage: If the food source is not replaced by a better one, then the scout bees start to generate new food sources randomly according to equation (1).

2.2. Related Work on Feature Selection

It is a great challenge to train the high-dimensional dataset. With the increase in dimensions, the demand of training samples increases exponentially causing “curse of dimensionality”. In addition, many models are inapplicable to high-dimensional data [24]. Therefore, feature selection is an important way to improve learning performance and a key role in the data preprocessing step of machine learning.

Existing feature selection methods can be divided into three categories: filter method, embedded method, and wrapper method [25]. The principles of each type of method and the corresponding algorithm are reviewed in this section.(1)Filter method: The filter method is to evaluate the correlation between variables according to statistical, information theory, and distance measurement [4]. Filter methods find out K variables with strong correlation based on the correlation parameters including correlation coefficient, chi-square test, Fisher score, and information gain [5]. It does not involve any specific learning algorithm in the evaluation process. Peng et al. [26] derived the minimal-redundancy-maximal-relevance criterion (mRMR) based on the principle of statistics and improved a two-stage feature selection algorithm, and experimental results show that mRNR performs well in classification accuracy. Meyer and Bontempi [27] proposed a filter method of feature selection based on the double input symmetrical relevance (DISR), a new information theoretic selection criterion. The proposed method is competitive with other filter method of feature selection. Almuallim and Dietterich [28] presented a filter method FOCUS, a quasipolynomial time algorithm, and FOCUS can achieve good performance on coverage, sample complexity, and generalization. ABB and relief are also belonging to the filter method [25].(2)Embedded method: The embedded method integrates the process of feature selection with the process of classifier learning, which is mainly to solve the problem of high computational costs caused by the reconstruction of the classification model when processing different datasets. The commonly embedded methods can be divided three types [5]. The first is the pruning method, which is eliminating features from all features, and support vector machine (SVM) eliminates features recursively. The second is the feature selection algorithms with a build-in mechanism such as ID3 and C4.5. The third is regularization models. This method minimizes fitting errors by objective functions and the features with low coefficients are eliminated, such as lasso regularization and bridge regularization [5]. Mohsenzadeh et al. [29] proposed relevance sample feature machine (RSFM), which is an embedded feature selection method based on sparse Bayesian approach and Gaussian priors. The results show that RSFM performs well in both eliminating redundant features and classification accuracy. Mirzaei et al. [30] proposed an embedded feature selection method based on a fully Bayesian framework and introduced a multistep algorithm with variational approximation to maximum the posteriori probability. The proposed method is successful in both regression and classification.(3)Wrapper method: Wrapper methods put the datasets into the algorithm for training until obtaining the best combination of features within the number of iterations. The commonly used algorithms include greedy search and stochastic search [31]. Greedy search has two methods: forward selection and backward elimination; forward selection expands the subset of features from empty, and backward elimination gradually eliminates features from the complete feature set [25]. The swarm intelligence algorithm belongs to stochastic search, like genetic algorithm (GA), ant colony optimization (ACO), and particle swarm optimization (PSO). Yang et al. [32] proposed chaotic binary particle swarm optimization (CBPSO) for feature selection and used two classifiers to test the algorithm, and the classification accuracy obtained by CBPSO is higher than that of other methods from the literature. Jingwei Too et al. [4] put multiple inertia weight strategy into binary particle swarm optimization and proposed CBPSO-MIWS for feature selection. The results show that CBPSO-MIWS can achieve competitive performance in all five swarm intelligence algorithms. Xue et al. [33] studied two multiobjective feature selection algorithms based on PSO; the first algorithm applied the idea of nondominated sorting into PSO while the second algorithm put mutation and crowding strategy into PSO to search for the Pareto solutions. These two algorithms can evolve a set of nondominated solutions automatically. Compared with the three famous multiobjective algorithms, the second algorithm obtains the better results. Cheng and Lu [34] integrated the sampling survey method into the heuristic intelligent optimization algorithm and proposed a new feature selection method. The sampling survey method is used to build the feature-scoring system and reduced dimension length-scoring system. Results showed that the proposed algorithm can select features quickly and effectively.

We have studied the wrapper feature selection method in this paper. The flowchart of the wrapper feature selection method is given in Figure 1.

3. Proposed Method

3.1. Binary Superior Tracking Strategy

In BSTABC-DCM, a binary superior tracking strategy is proposed for feature selection. Specifically, compared with ABC’s search strategy, the integrated superior tracking strategy has two main differences: (1) bees learn from others in each dimension instead of only learning one dimension in each iteration and (2) bees choose the better individuals to learn instead of random moving. The food sources are updated as the following equation:where denotes the superior neighbor for guidance; it is a D-dimensional vector of which elements are constructed by itself (position of the food source) for food source and other superior food sources with two probabilistic selection methods (roulette selection and tournament selection). The pseudocode for generating is presented in Algorithm 1.

	Input parameters
For = 1 :
If


If

Else
End
Else
End
End
Return

Pr is the initialized probability threshold, which determines whether the current individual learns from his superior neighbor or itself. is a function used to produce an integer from a uniform discrete distribution, FS refers to the position of food source, and FV is the function value.

As feature selection is a binary optimization problem, the continuous food source is converted to a binary one after updating the food source using equation (6). Two-step binarization technique [35] is used to make the binarization of the continuous solution. The first step corresponds to the transfer function; sigmoid function [4] is adopted to transform the position of food source into probability value according to equation (7). The second step is binarization technique; the probability value of food source is converted to the binary one by applying the following equation:where refers to the continuous food source, refers to the binary food source, and is a random number uniformly distributed between 0 and 1.

3.2. Dynamic Cauchy Mutation Method

To enhance the global exploration of the proposed method, a dynamic Cauchy mutation is implemented to refine the global best solution in each iteration. The dynamic Cauchy mutation method in this study is defined [36] as the following equation:where is a random number between [1, D], denotes the Cauchy distribution scale, is the global best solution in each iteration, and refers to a random number generated by Cauchy() distribution. The value of is set to 1 to balance the exploitation ability of the proposed algorithm, and is a dynamic weight defined as follows:where is a random number between [0, 1], and means the current number of iteration.

3.3. Procedure of the Proposed Method

BSTABC-DCM includes two main searching components: binary superior tracking strategy (BST) and dynamic Cauchy mutation method (DCM). In BSTABC-DCM, the food sources are explored using equation (6) in the employed bee stage and onlooker bee stage, where each dimension of food source is updated by learning from the better food sources. This ensures the timely information exchange between food sources. After the onlooker bee stage, a dynamic Cauchy mutation method is implemented to increase population diversity, and the most fertile food sources are explored. The flowchart of BSTABC-DCM is given in Figure 2.

4. Experimental Study

In this section, a set of feature selection problems is employed to comprehensively verify the performance of BSTABC-DCM.

4.1. Experiment Settings

Three metrics including classification accuracy, average classification accuracy, and the number of selected features are adopted for performance assessment. Seven state-of-the-art swarm intelligence algorithms, i.e., artificial bee colony (ABC) algorithm [12], gbest-guided ABC (GABC) [37], quick ABC (qABC) [38], comprehensive learning particle swarm optimizer (CLPSO) [39], PSO [7], GWO [9], and BSO [10], are included for comparison.

Regarding the parameter setting of BSTABC-DCM, KNN has been widely used in various fields with relatively large sample size, such as pattern recognition, text categorization, and moving object recognition [40, 41]. As more than half of the test datasets are relatively large in size, KNN (k = 5) is selected as the classification algorithm in our study. In each experiment, we conduct 5-fold experiment by dividing 80% of the dataset as training set and the remaining 20% as testing set. Each algorithm runs 20 times independently in each dataset. Evaluation indicators include best accuracy, worst accuracy, mean accuracy, standard deviation (STD), and the number of redundant features removed. The final accuracy is the average accuracy of 5-fold cross-validation [42].

4.1.1. Benchmark Datasets

Considering the number of instances and dimensions of different datasets, ten datasets from the UCI are adopted as test problems [4]. The number of instances and dimensions of the datasets are shown in Table 1.

4.1.2. Parameter Settings

For fair comparison, the number of population and the number of iterations of each algorithm are set to 10 and 100, and each algorithm runs 20 times independently. All the analyses are implemented in MATLAB 2017b with Intel Core i7 2.6 GHz and 16.0 GB RAM. The specific parameter settings of compared algorithms are shown in Table 2.

4.2. Experimental Results

For each experiment, we randomly divide the datasets into five parts, with 80% as training set and 20% as testing set. The average results obtained by 20 times 5-fold cross-validation are obtained as the final results. Without feature selection, the classification accuracy of the KNN (K = 5) algorithm is shown in Table 3.

We implement the comparison algorithms on the ten datasets for feature selection. The average results obtained by cross-validation are regarded as the final experiment results. The experimental results of the proposed algorithm and other seven compared algorithms are shown in Tables 4 and 5. The best experimental results among the eight algorithms are shown in bold.

From the results, it can be observed that the optimal classification accuracy obtained by BSTABC-DCM is higher than that of the other seven algorithms on 8 out of 10 datasets. The average classification accuracy obtained by BSTABC-DCM is higher on 9 out of 10 datasets. The classification accuracy of BSTABC-DCM increases by 16.67% on average, while the classification accuracy increases by 15.27% on average by other seven algorithms. Specifically, for classification accuracy, BSTABC-DCM increases more than 10% on 4 datasets, the next is GWO, which increases more than 10% on 3 datasets, and other six algorithms increase only on 2 datasets. The highest increased classification accuracy obtained by BSTABC-DCM is in BreastCancerCombiadataR2 dataset, which is 68.19%.

Figure 3 demonstrates the convergence process of the comparison algorithms, where the proposed BSTABC-DCM is shown in green. It is observed that BSTABC-DCM converges faster than other algorithms on 8 out of 10 datasets. The classification results and the convergence curves indicate BSTABC-DCM enhances ABC’s exploitation capability.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

(j)

In addition to classification accuracy, another indicator to measure the performance of algorithms is the number of redundant features removed. The number of redundant features removed is the average number obtained by 20 runs. Table 6 shows the number of redundant features removed by the eight algorithms. The best value of the eight methods is shown in bold.

The result in the optimal number row represents the number of data sets that each algorithm performs best/the total number of features removed. As can be seen from the above table, the proposed algorithm BSTABC-DCM removed the most redundant features in three datasets, which are diabetic retinopathy dataset, ionosphere dataset, and Pdspeechfeatures dataset. Although BSO and qABC also performed well in removing redundant features, judging from the percentage of redundant functions removed in the original dataset, BSTABC-DCM is undoubtedly the most promising, reaching 43.37%. In other words, compared with the original dataset, BSTABC-DCM can greatly reduce the number of features and ensure higher classification accuracy after feature selection. In conclusion, BSTABC-DCM has promising performance on the test problems.

5. Discussion

In summary, the above experimental results show that the proposed method has improved the best classification accuracy on 8 out of 10 datasets. For the number of removed redundant features, BSTABC-DCM is outperforming with the highest percentage of redundant features removed. This reveals that our proposed strategies have significantly enhanced the original ABC algorithm in terms of global exploration and exploitation capabilities. In addition, it can be seen from Figure 2 that the convergence speed of BSTABC-DCM is comparable to the other comparison algorithms. Though convergence speed is comparable to the other algorithms, it is promising to combine the advantages of different methods, e.g., random forest and Naive Bayes, with the proposed algorithm to further refine the optimization process.

6. Conclusion

In this study, a binary superior tracking artificial bee colony with dynamic Cauchy mutation (BSTABC-DCM) is proposed for feature selection. Specifically, a binary superior tracking strategy is integrated to improve the learning behavior of bees by boosting the efficiency of information sharing in population. In each iteration, the bees can learn from the superior bees in each dimension. A dynamic Cauchy mutation is introduced to diversify population and enhance global search ability. We select ten datasets from UCI to verify the performance of BSTABC-DCM, and seven state-of-the-art swarm intelligence algorithms are included for comparison. Experimental results indicate that BSTABC-DCM achieves the best results on classification accuracy while removing nearly half of the redundant features. The convergence speed of BSTABC-DCM is comparable to the comparison algorithms.

While promising, there are still margins for further investigation. Firstly, different binary conversion methods could be considered to improve optimization efficiency. Secondly, both the classification accuracy and feature size will be combined with fitness function to build a multiobjective model. Thirdly, adaptive search strategies can be considered to enhance the adaptability of the proposed method. Applying BSTABC-DCM to more practical problems such as capacitated location problem of distribution center, vehicle routing problems, and scheduling problems is also one of our research directions.

Data Availability

The data used to support the findings are available from UCI Machine Learning Repository.

Disclosure

An earlier version of this work was previously presented in the International Conference on Neural Computing for Advanced Application.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was partially supported by the National Natural Science Foundation of China (grant nos. 71971142, 71501132, and 71701079).

References

Y. Cui, S. Xu, L. Zhang, R. E. Welsh, and B. K. P. Horn, “The key techniques and future vision of feature selection in machine learning,” Journal of Beijing University of Posts and Telecommunications, vol. 41, no. 1, pp. 1–12, 2018.
View at: Google Scholar
D. Manoranjan and H. Liu, “Feature selection for classification,” Intelligent Data Analysis, vol. 1, no. 1–4, pp. 131–156, 1997.
View at: Publisher Site | Google Scholar
C. Girish and F. Sahin, “A survey on feature selection methods,” Computers & Electrical Engineering, vol. 40, no. 1, pp. 16–28, 2014.
View at: Publisher Site | Google Scholar
J. Too, A. R. Abdullah, N. Mohd Saad, and N. M. Saad, “A new co-evolution binary particle swarm optimization with multiple inertia weight strategy for feature selection,” Informatics, vol. 6, no. 2, p. 21, 2019.
View at: Publisher Site | Google Scholar
J. L. Tang, S. Alelyani, and S. H. Liu, “Feature selection for classification: A review,” Data Classification, vol. 37, pp. 29–60, 2014.
View at: Publisher Site | Google Scholar
X. Chu, F. Cai, C. Cui, M. Hu, L. Li, and Q. Qin, “Adaptive recommendation model using meta-learning for population-based algorithms,” Information Sciences, vol. 476, pp. 192–210, 2019.
View at: Publisher Site | Google Scholar
J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948, Perth, Western Australia, November 1995.
View at: Publisher Site | Google Scholar
K. M. Passino, “Biomimicry of bacterial foraging for distributed optimization and control,” IEEE Control Systems Magazine, vol. 22, no. 3, pp. 52–67, 2002.
View at: Google Scholar
E. Emary, H. M. Zawbaa, and A. E. Hassanien, “Binary grey wolf optimization approaches for feature selection,” Neurocomputing, vol. 172, pp. 371–381, 2016.
View at: Publisher Site | Google Scholar
Y. Shi, “An optimization algorithm based on brainstorming process,” International Journal of Swarm Intelligence Research, vol. 2, no. 4, pp. 35–62, 2011.
View at: Google Scholar
Y. Wang, “Research on Feature Selection Methods Based on Swarm Intelligent Algorithm, Jilin University, Changchun, China, 2019.
D. Karaboga and B. Basturk, “A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm,” Journal of Global Optimization, vol. 39, no. 3, pp. 459–471, 2007.
View at: Publisher Site | Google Scholar
X. Chu, T. Wu, J. D. Weir, Y. Shi, B. Niu, and L. Li, “Learning–interaction–diversification framework for swarm intelligence optimizers: a unified perspective,” Neural Computing and Applications, vol. 32, no. 6, pp. 1–21, 2018.
View at: Publisher Site | Google Scholar
M. K. Keleş and Ü. Kılıç, “Artificial bee colony algorithm for feature selection on scadi dataset,” in Proceedings of the 2018 3rd International Conference On Computer Science and Engineering (UBMK), pp. 463–466, Bosnia and Herzegovina, Sarajevo, September 2018.
View at: Google Scholar
Ü. Kiliç and M. K. Keleş, “Feature selection with artificial bee colony algorithm on Z-Alizadeh Sani dataset,” in Proceedings of the 2018 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 1–3, Adana, Turkey, October 2018.
View at: Google Scholar
P. Shunmugapriya, S. Kanmani, R. Supraja, and K. Saranya, “Feature selection optimization through enhanced artificial bee colony algorithm,” in Proceedings of the International Conference on Recent Trends in Information Technology (ICRTIT), pp. 56–61, Piscataway, NJ, USA, July 2013.
View at: Google Scholar
Z. B. Özger, B. Bolat, and B. Dırı, “A comparative study on binary artificial bee colony optimization methods for feature selection,” in Proceedings of the International Symposium on INnovations in Intelligent SysTems and Applications (INISTA), pp. 1–4, Sinaia, Romania, August 2016.
View at: Google Scholar
H. Wang, H. Yu, Q. Zhang et al., “Parameters optimization of classifier and feature selection based on improved artificial bee colony algorithm,” in Proceedings of the International Conference On Advanced Mechatronic Systems (ICAMechS), pp. 242–247, Melbourne, Australia, November 2016.
View at: Publisher Site | Google Scholar
M. Liu, “Improved Multi-Objective Artificial Bee Colony Algorithm and its Application in Feature Selection, Anhui University, Hefei, China, 2018.
X. Chu, G. Hu, B. Niu, L. Li, and Z. Chu, “An superior tracking artificial bee colony for global optimization problems,” in Proceedings of the 2016 IEEE Congress on Evolutionary Computation (CEC), pp. 2712–2717, Vancouver, BC, Canada, July 2016.
View at: Google Scholar
X. Chao and W. Li, “Feature selection method optimized by artificial bee colony algorithm,” Journal of Frontiers of Computer Science and Technology, vol. 13, no. 2, pp. 300–309, 2019.
View at: Google Scholar
Y. Li, “Research and Application of Multi-Objective Artificial Bee Colony algorithm”[D], Northeastern University, Boston, MA, USA, 2012.
Q. Qin, S. Cheng, L. Li, and Y. Shi, “A review of artificial bee colony algorithm,” CAAI Transactions on Intelligent Systems, vol. 9, no. 2, pp. 127–135, 2014.
View at: Google Scholar
Z. Li, J. Du, B. Nie et al., “Summary of feature selection methods,” Computer Engineering and Applications, vol. 55, no. 24, pp. 10–19, 2019.
View at: Google Scholar
V. Kumar and S. Minz, “Feature selection: a literature review,” The Smart Computing Review, vol. 4, no. 3, pp. 211–229, 2014.
View at: Publisher Site | Google Scholar
H. Peng, F. Long, and C. Ding, “Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1226–1238, 2005.
View at: Publisher Site | Google Scholar
P. E. Meyer and G. Bontempi, “On the use of variable complementarity for feature selection in cancer classification,” in Proceedings of the Workshops On Applications of Evolutionary Computation, pp. 91–102, Budapest, Hungary, April 2006.
View at: Google Scholar
H. Almuallim and T. G. Dietterich, “Learning with many irrelevant features,” Artificial Intelligence, vol. 91, pp. 547–552, 1991.
View at: Google Scholar
Y. Mohsenzadeh, H. Sheikhzadeh, A. M. Reza, N. Bathaee, and M. M. Kalayeh, “The relevance sample-feature machine: a sparse Bayesian learning approach to joint feature-sample selection,” IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 2241–2254, 2013.
View at: Publisher Site | Google Scholar
A. Mirzaei, Y. Mohsenzadeh, and H. Sheikhzadeh, “Variational relevant sample-feature machine: a fully Bayesian approach for embedded feature selection,” Neurocomputing, vol. 241, pp. 181–190, 2017.
View at: Publisher Site | Google Scholar
B. Venkatesh and J. Anuradha, “A review of feature selection and its methods,” Cybernetics and Information Technologies, vol. 19, no. 1, pp. 3–26, 2019.
View at: Publisher Site | Google Scholar
C.-S. Yang, L.-Y. Chuang, J.-C. Li, and C.-H. Yang, “Chaotic maps in binary particle swarm optimization for feature selection,” in Proceedings of the 2008 IEEE Conference On Soft Computing in Industrial Applications, pp. 107–112, 2008.
View at: Publisher Site | Google Scholar
B. Xue, M. Zhang, and W. N. Browne, “Particle swarm optimization for feature selection in classification: a multi-objective approach,” IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 1656–1671, 2012.
View at: Publisher Site | Google Scholar
Z. Cheng and Z. Lu, “A novel efficient feature dimensionality reduction method and its application in engineering,” Complexity, vol. 2018, Article ID 2879640, 14 pages, 2018.
View at: Publisher Site | Google Scholar
B. Crawford, R. Soto, G. Astorga, J. García, C. Castro, and F. Paredes, “Putting continuous metaheuristics to work in binary search spaces,” Complexity, vol. 2017, Article ID 8404231, 19 pages, 2017.
View at: Publisher Site | Google Scholar
X. Chu, D. Gao, S. Cheng et al., “Worker assignment with learning-forgetting effect in cellular manufacturing system using adaptive memetic differential search algorithm,” Computers & Industrial Engineering, vol. 136, pp. 381–396, 2019.
View at: Publisher Site | Google Scholar
G. Zhu and S. Kwong, “Gbest-guided artificial bee colony algorithm for numerical function optimization,” Applied Mathematics and Computation, vol. 217, no. 7, pp. 3166–3173, 2010.
View at: Publisher Site | Google Scholar
D. Karaboga and B. Gorkemli, “A quick artificial bee colony (qABC) algorithm and its performance on optimization problems,” Applied Soft Computing, vol. 23, pp. 227–238, 2014.
View at: Publisher Site | Google Scholar
J. J. Liang, A. K. Qin, P. N. Suganthan, and S. Baskar, “Comprehensive learning particle swarm optimizer for global optimization of multimodal functions,” IEEE Transactions on Evolutionary Computation, vol. 10, no. 3, pp. 281–295, 2006.
View at: Publisher Site | Google Scholar
Z. Deng, X. Zhu, D. Cheng, M. Zong, and S. Zhang, “Efficient k NN classification algorithm for big data,” Neurocomputing, vol. 195, pp. 143–148, 2016.
View at: Publisher Site | Google Scholar
S. Dhanabal and S. Chandramath, “A review of various k-nearest neighbor query processing techniques,” International Journal of Computer Applications, vol. 31, no. 7, pp. 14–22, 2011.
View at: Google Scholar
C. Alippi and M. Roveri, “Virtual k-fold cross validation: An effective method for accuracy assessment,” in Proceedings of the International Joint Conference On Neural Networks (IJCNN), pp. 1–6, Barcelona, Spain, July 2010.
View at: Google Scholar

Copyright

Copyright © 2020 Xianghua Chu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

350

Downloads

888

Citations