QIAN Wenbin, SHU Wenhao, YANG Bingru, ZHANG Changsheng. An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set[J]. Chinese Journal of Electronics, 2015, 24(1): 128-133.
Citation: QIAN Wenbin, SHU Wenhao, YANG Bingru, ZHANG Changsheng. An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set[J]. Chinese Journal of Electronics, 2015, 24(1): 128-133.

An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature Set

Funds:  This work is supported in part by the National Natural Science Foundation of China (No.61175048, No.71461013), the Key Project of Ministry of Science and Technology of China (No.2010IM020900), the 2012 Ladder Plan Project of Beijing Key Laboratory of Knowledge Engineering for Materials Science (No.Z121101002812005), and Zhejiang Provincial Natural Science Foundation of China (No.LY13F020024).
  • Received Date: 2013-05-01
  • Rev Recd Date: 2013-07-01
  • Publish Date: 2015-01-10
  • Feature selection is a challenging problem in pattern recognition and machine learning. In real-life applications, feature set in the decision systems may vary over time. There are few studies on feature selection with the variation of feature set. This paper focuses on this issue, an incremental feature selection algorithm in dynamic decision systems is developed based on dependency function. The incremental algorithm avoids some recomputations, rather than retrain the dynamic decision system as new one to compute the feature subset from scratch. We firstly employ an incremental manner to update the new dependency function, then we incorporate the calculated dependency function into the incremental feature selection algorithm. Compared with the direct (non-incremental) algorithm, the computational efficiency of the proposed algorithm is improved. The experimental results on different data sets from UCI show that the proposed algorithm is effective and efficient.
  • loading
  • Z. Pawlak and A. Skowron, "Rough sets and boolean reasoning", Information Sciences, Vol.177, pp.41-73, 2007.
    Y.H. Qian, J.Y. Liang, W. Pedrycz, et al., "Positive approximation: An accelerator for attribute reduction in rough set theory", Artificial Intelligence, Vol.174, pp.597-618, 2010.
    R.W. Swiniarski and A. Skowron, "Rough set methods in feature selection and recognition", Pattern Recognition Letters, Vol.24, pp.833-849, 2003.
    D. Yamaguchi, "Attribute dependency functions considering data efficiency", International Journal of Approximate Reasoning, Vol.51, No.1, pp.89-98, 2009.
    S. Nakariyakul and D.P. Casasent, "An improvement on floating search algorithms for feature subset selection", Pattern Recognition, Vol.42, pp.9, pp.1932-1940, 2009.
    M. Kryszkiewicz and P. Lasek, "FUN: Fast discovery of minimal sets of attributes functionally determining a decision attribute", Transaction on Rough Sets, Vol.9, pp.76-95, 2008.
    J. Qian, D.Q. Miao, Z.H. Zhang, et al., "Hybrid approaches to attribute reduction based on indiscernibility and discernibility relation", International Journal of Approximating Reasoning, Vol.50, No.1, pp.174-188, 2009.
    A. Radaideh, Q. Sulaiman and M. Selamat, "Feature selection by ordered rough set based feature weighting", Database and Expert Systems Applications, Springer, Berlin, Germany, pp.105-112, 2005.
    D.Q. Miao, Y. Zhao, Y.Y. Yao, et al., "Relative reducts in consistent and inconsistent decision tables of the Pawlak rough set model", Information Sciences, Vol.179, pp.4140-4150, 2009.
    J. Zhong, Q.G. Sun and X. Li, "A novel feature selection method based on probability latent semantic analysis for chinese text classification", Chinese Journal of Electronics, Vol.20, No.2, pp. 228-232, 2011.
    J.B. Li, L.J. Yu and S.H. Sun, "Refined kernel principal component analysis based feature extraction", Chinese Journal of Electronics, Vol.20, No.3, pp.467-470, 2011.
    A.S. kowron and C. Rauszer, "The Discernibility matrics and functions in information systems", Intelligent Decision Support, Springer, Netherlands, pp.331-360, 1992.
    Z.Y. Xu, B.R. Yang and W. Song, "Comparative study of different attribute reduction based on decision table", Chinese Journal of Electronics, Vol.15, No.4, pp.953-956, 2006.
    R.L. Lang, Z.P. Xu and F. Gao, "A knowledge acquisition method for fault diagnosis of airborne equipments based on support vector regression machine", Chinese Journal of Electronics, Vol.22, No.2, pp.277-281, 2013.
    J.Y. Liang, F. Wang, C.Y. Dang, et al., "A group incremental approach to feature selection applying rough set technique", IEEE Transactions on Knowledge and Data Engineering, Vol.26, No.2, pp.294-308, 2014.
    F. Wang, J.Y. Liang and Y.H. Qian, "Attribute reduction: A dimension incremental strategy", Knowledge-Based Systems, Vol.39, pp.95-108, 2013.
    F. Hu, G.Y. Wang, H. Huang, et al., "Incremental attribute reduction based on elementary sets", Proc. of the 10th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing, Regina, Canada, pp.185-193, 2005.
    Y.Y. Yao and Y. Zhao, "Discernibility matrix simplification for constructing attribute reducts", Information Sciences, Vol. 179, No.5, pp.867-882, 2009.
    M. Yang, "An incremental updating algorithm for attribute reduction based on improved discernibility matrix", Chinese Journal of Computers, Vol.30, No.5, pp.815-822, 2007. (in Chinese)
    Y.T. Xu, L.S. Wang and R.Y. Zhang, "A dynamic attribute reduction algorithm based on 0-1 integer programming", Knowledge-Based Systems, Vol.24, pp.1341-1347, 2011.
    A. Asuncion and D.J. Newman, "UCI machine learning repository", available at http://archive.ics.uci.edu /ml/datasets.html, 2012.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (202) PDF downloads(896) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return