An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set

QIAN Wenbin; SHU Wenhao; YANG Bingru; ZHANG Changsheng

Article Contents

Article Navigation > Chinese Journal of Electronics > 2015 > 24(1): 128-133

QIAN Wenbin, SHU Wenhao, YANG Bingru, et al., “An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set,” Chinese Journal of Electronics, vol. 24, no. 1, pp. 128-133, 2015,

Citation:

QIAN Wenbin, SHU Wenhao, YANG Bingru, et al., “An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set,” Chinese Journal of Electronics, vol. 24, no. 1, pp. 128-133, 2015,

Citation:

PDF( 219 KB)

An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set

1.
School of Software, Jiangxi Agriculture University, Nanchang 330045, China;
2.
Beijing Key Laboratory of Knowledge Engineering of Material Science, Beijing 100083, China;
3.
School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, China

Funds: This work is supported in part by the National Natural Science Foundation of China (No.61175048, No.71461013), the Key Project of Ministry of Science and Technology of China (No.2010IM020900), the 2012 Ladder Plan Project of Beijing Key Laboratory of Knowledge Engineering for Materials Science (No.Z121101002812005), and Zhejiang Provincial Natural Science Foundation of China (No.LY13F020024).

Received Date: 2013-05-01
Rev Recd Date: 2013-07-01
Publish Date: 2015-01-10

Abstract

Abstract

Feature selection is a challenging problem in pattern recognition and machine learning. In real-life applications, feature set in the decision systems may vary over time. There are few studies on feature selection with the variation of feature set. This paper focuses on this issue, an incremental feature selection algorithm in dynamic decision systems is developed based on dependency function. The incremental algorithm avoids some recomputations, rather than retrain the dynamic decision system as new one to compute the feature subset from scratch. We firstly employ an incremental manner to update the new dependency function, then we incorporate the calculated dependency function into the incremental feature selection algorithm. Compared with the direct (non-incremental) algorithm, the computational efficiency of the proposed algorithm is improved. The experimental results on different data sets from UCI show that the proposed algorithm is effective and efficient.
- Rough sets,
- Feature selection,
- Attribute reduction,
- Incremental algorithm,
- Dynamic data set

FullText(HTML)

References(21)

References

Z. Pawlak and A. Skowron, "Rough sets and boolean reasoning", Information Sciences, Vol.177, pp.41-73, 2007.

Y.H. Qian, J.Y. Liang, W. Pedrycz, et al., "Positive approximation: An accelerator for attribute reduction in rough set theory", Artificial Intelligence, Vol.174, pp.597-618, 2010.

R.W. Swiniarski and A. Skowron, "Rough set methods in feature selection and recognition", Pattern Recognition Letters, Vol.24, pp.833-849, 2003.

D. Yamaguchi, "Attribute dependency functions considering data efficiency", International Journal of Approximate Reasoning, Vol.51, No.1, pp.89-98, 2009.

S. Nakariyakul and D.P. Casasent, "An improvement on floating search algorithms for feature subset selection", Pattern Recognition, Vol.42, pp.9, pp.1932-1940, 2009.

M. Kryszkiewicz and P. Lasek, "FUN: Fast discovery of minimal sets of attributes functionally determining a decision attribute", Transaction on Rough Sets, Vol.9, pp.76-95, 2008.

J. Qian, D.Q. Miao, Z.H. Zhang, et al., "Hybrid approaches to attribute reduction based on indiscernibility and discernibility relation", International Journal of Approximating Reasoning, Vol.50, No.1, pp.174-188, 2009.

A. Radaideh, Q. Sulaiman and M. Selamat, "Feature selection by ordered rough set based feature weighting", Database and Expert Systems Applications, Springer, Berlin, Germany, pp.105-112, 2005.

D.Q. Miao, Y. Zhao, Y.Y. Yao, et al., "Relative reducts in consistent and inconsistent decision tables of the Pawlak rough set model", Information Sciences, Vol.179, pp.4140-4150, 2009.

J. Zhong, Q.G. Sun and X. Li, "A novel feature selection method based on probability latent semantic analysis for chinese text classification", Chinese Journal of Electronics, Vol.20, No.2, pp. 228-232, 2011.

J.B. Li, L.J. Yu and S.H. Sun, "Refined kernel principal component analysis based feature extraction", Chinese Journal of Electronics, Vol.20, No.3, pp.467-470, 2011.

A.S. kowron and C. Rauszer, "The Discernibility matrics and functions in information systems", Intelligent Decision Support, Springer, Netherlands, pp.331-360, 1992.

Z.Y. Xu, B.R. Yang and W. Song, "Comparative study of different attribute reduction based on decision table", Chinese Journal of Electronics, Vol.15, No.4, pp.953-956, 2006.

R.L. Lang, Z.P. Xu and F. Gao, "A knowledge acquisition method for fault diagnosis of airborne equipments based on support vector regression machine", Chinese Journal of Electronics, Vol.22, No.2, pp.277-281, 2013.

J.Y. Liang, F. Wang, C.Y. Dang, et al., "A group incremental approach to feature selection applying rough set technique", IEEE Transactions on Knowledge and Data Engineering, Vol.26, No.2, pp.294-308, 2014.

F. Wang, J.Y. Liang and Y.H. Qian, "Attribute reduction: A dimension incremental strategy", Knowledge-Based Systems, Vol.39, pp.95-108, 2013.

F. Hu, G.Y. Wang, H. Huang, et al., "Incremental attribute reduction based on elementary sets", Proc. of the 10th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing, Regina, Canada, pp.185-193, 2005.

Y.Y. Yao and Y. Zhao, "Discernibility matrix simplification for constructing attribute reducts", Information Sciences, Vol. 179, No.5, pp.867-882, 2009.

M. Yang, "An incremental updating algorithm for attribute reduction based on improved discernibility matrix", Chinese Journal of Computers, Vol.30, No.5, pp.815-822, 2007. (in Chinese)

Y.T. Xu, L.S. Wang and R.Y. Zhang, "A dynamic attribute reduction algorithm based on 0-1 integer programming", Knowledge-Based Systems, Vol.24, pp.1341-1347, 2011.

A. Asuncion and D.J. Newman, "UCI machine learning repository", available at http://archive.ics.uci.edu /ml/datasets.html, 2012.

Relative Articles

Supplements(0)

Cited By

Proportional views