全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

Component Thermodynamical Selection Based Gene Expression Programming for Function Finding

DOI: 10.1155/2014/915058

Full-Text   Cite this paper   Add to My Lib

Abstract:

Gene expression programming (GEP), improved genetic programming (GP), has become a popular tool for data mining. However, like other evolutionary algorithms, it tends to suffer from premature convergence and slow convergence rate when solving complex problems. In this paper, we propose an enhanced GEP algorithm, called CTSGEP, which is inspired by the principle of minimal free energy in thermodynamics. In CTSGEP, it employs a component thermodynamical selection (CTS) operator to quantitatively keep a balance between the selective pressure and the population diversity during the evolution process. Experiments are conducted on several benchmark datasets from the UCI machine learning repository. The results show that the performance of CTSGEP is better than the conventional GEP and some GEP variations. 1. Introduction Gene expression programming (GEP) [1, 2], improved genetic programming (GP) with linear representation [3, 4], is an artificial problem solver inspired in natural genotype/phenotype system. GEP combines both the simple, linear string of chromosomes with fixed length to represent the solutions similar to the ones utilized in genetic algorithm (GA) and the ramified structures with different sizes and shapes similar to the parse trees of GP [3, 5, 6]. Thus, GEP has the advantages of both GA and GP, while overcoming some of their individual limitations [3, 4]. Because of its high performance, GEP has attracted increasing attention recently as an efficient and effective data mining approach. Moreover, it has been successfully applied to many fields, such as function finding [7–9], symbolic regression [10–13], parameter optimization [14], rule mining [15], classification [3, 16], time series forecasting [2], prediction of flow number of asphalt mixes [17], prediction of material load [18, 19], prediction of the strength of concrete [20], engineering design [21], and machine scheduling [22, 23]. Although GEP has been successfully employed in a variety of areas, in practical applications, it is found that the conventional GEP usually suffers from premature convergence and slow convergence rate resulting in poor solution quality and/or large computational cost [2–4]. The main reason is that the conventional GEP cannot quantitatively keep a balance between the selective pressure and the population diversity during the evolution process. Therefore, this may lead to trapping in the local optimum and/or slowing down the search speed. In general, increasing selective pressure and promoting population diversity in GEP are often in conflict with each other

References

[1]  C. Ferreira, “Gene expression programming: a new adaptive algorithm for solving problems,” Complex Systems, vol. 13, no. 2, pp. 87–129, 2001.
[2]  C. Ferreira, Gene Expression Programming, Mathematical Modeling by an Artificial Intelligence, Springer, Berlin, Germany, 2nd edition, 2006.
[3]  V. K. Karakasis and A. Stafylopatis, “Efficient evolution of accurate classification rules using a combination of gene expression programming and clonal selection,” IEEE Transactions on Evolutionary Computation, vol. 12, no. 6, pp. 662–678, 2008.
[4]  C. Zhou, W. Xiao, T. M. Tirpak, and P. C. Nelson, “Evolving accurate and compact classification rules with gene expression programming,” IEEE Transactions on Evolutionary Computation, vol. 7, no. 6, pp. 519–531, 2003.
[5]  A. H. Gandomi and A. H. Alavi, “A new multi-gene genetic programming approach to nonlinear system modeling. Part I: materials and structural engineering problems,” Neural Computing and Applications, vol. 21, no. 1, pp. 171–187, 2012.
[6]  A. H. Gandomi and A. H. Alavi, “Multi-stage genetic programming: a new strategy to nonlinear system modeling,” Information Sciences, vol. 181, no. 23, pp. 5227–5239, 2011.
[7]  Y. Chen, C. J. Tang, R. Li, M. F. Zhu, C. Li, and J. Zuo, “Reduced-GEP: improving gene expression programming by gene reduction,” in Proceedings of the 2nd International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC '10), pp. 176–179, Jiangsu, China, August 2010.
[8]  J.-L. Zheng, C.-J. Tang, K.-K. Xu, N. Yang, L. Duan, and H.-J. Li, “Gene expression programming evolution difficulty prediction based on posture model,” Journal of Software, vol. 22, no. 5, pp. 899–913, 2011.
[9]  M. Zhu, C. Tang, S. Dai, Y. Chen, S. Qiao, and Y. Xiang, “Na?ve gene expression programming based on genetic neutrality,” Computer Research and Development, vol. 47, no. 2, pp. 292–299, 2010.
[10]  E. A. Colbourn, S. J. Roskilly, R. C. Rowe, and P. York, “Modelling formulations using gene expression programming—a comparative analysis with artificial neural networks,” European Journal of Pharmaceutical Sciences, vol. 44, no. 3, pp. 366–374, 2011.
[11]  A. Mollahasani, A. H. Alavi, and A. H. Gandomi, “Empirical modeling of plate load test moduli of soil via gene expression programming,” Computers and Geotechnics, vol. 38, no. 2, pp. 281–286, 2011.
[12]  S. S. S. Hosseini and A. H. Gandomi, “Short-term load forecasting of power systems by gene expression programming,” Neural Computing and Applications, vol. 21, no. 2, pp. 377–389, 2012.
[13]  J.-J. Hu, C.-J. Tang, L. Duan, J. Zuo, J. Peng, and C.-A. Yuan, “Strategy for diversifying initial population of gene expression programming,” Chinese Journal of Computers, vol. 30, no. 2, pp. 305–310, 2007.
[14]  K. Xu, Y. Liu, R. Tang, J. Zuo, J. Zhu, and C. Tang, “A novel method for real parameter optimization based on gene expression programming,” Applied Soft Computing Journal, vol. 9, no. 2, pp. 725–737, 2009.
[15]  T. Zeng, C. Tang, Y. Xiang, P. Chen, and Y. Liu, “A model of immune gene expression programming for rule mining,” Journal of Universal Computer Science, vol. 13, no. 10, pp. 1484–1497, 2007.
[16]  J. L. ávila, E. L. Gibaja, A. Zafra, and S. Ventura, “A gene expression programming algorithm for multi-label classification,” Journal of Multiple-Valued Logic and Soft Computing, vol. 17, no. 2-3, pp. 183–206, 2011.
[17]  A. H. Gandomi, A. H. Alavi, M. R. Mirzahosseini, and F. M. Nejad, “Nonlinear genetic-based Models for prediction of flow number of asphalt mixtures,” Journal of Materials in Civil Engineering, vol. 23, no. 3, pp. 248–263, 2010.
[18]  F. ?zcan, “Gene expression programming based formulations for splitting tensile strength of concrete,” Construction and Building Materials, vol. 26, no. 1, pp. 404–410, 2012.
[19]  S. M. Mousavi, P. Aminian, A. H. Gandomi, A. H. Alavi, and H. Bolandi, “A new predictive model for compressive strength of HPC using gene expression programming,” Advances in Engineering Software, vol. 45, no. 1, pp. 105–114, 2012.
[20]  A. H. Gandomi, S. K. Babanajad, A. H. Alavi, and Y. Farnam, “Novel approach to strength modeling of concrete under triaxial compression,” Journal of Materials in Civil Engineering, vol. 24, no. 9, pp. 1132–1143, 2012.
[21]  L. Gao, M. Xiao, X. Shao, P. Jiang, L. Nie, and H. Qiu, “Analysis of gene expression programming for approximation in engineering design,” Structural and Multidisciplinary Optimization, vol. 46, no. 3, pp. 399–413, 2012.
[22]  A. Baykaso?lu and M. G??ken, “Gene expression programming based due date assignment in a simulated job shop,” Expert Systems with Applications, vol. 36, no. 10, pp. 12143–12150, 2009.
[23]  L. Nie, X. Shao, L. Gao, and W. Li, “Evolving scheduling rules with gene expression programming for dynamic single-machine scheduling problems,” International Journal of Advanced Manufacturing Technology, vol. 50, no. 5–8, pp. 729–747, 2010.
[24]  Y. Xu and Z. Wang, “Genetic algorithm optimized CCEM for complex topology,” Mathematical Problems in Engineering, vol. 2012, Article ID 383248, 14 pages, 2012.
[25]  L. W. Qu, K. Chen, B. H. Li, J. S. Ma, and W. Tao, “The optimized transport scheme of empty and heavy containers with novel genetic algorithm,” Mathematical Problems in Engineering, vol. 2013, Article ID 434125, 5 pages, 2013.
[26]  Z. Miao, K. Fu, and F. Yang, “A hybrid genetic algorithm for the multiple crossdocks problem,” Mathematical Problems in Engineering, vol. 2012, Article ID 316908, 18 pages, 2012.
[27]  K. Zhang, S. Sun, and H. Si, “Prediction of retention times for a large set of pesticides based on improved gene expression programming,” in Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation (GECCO '08), pp. 1725–1726, ACM, Atlanta, Ga, USA, July 2008.
[28]  Y. Rao, R.-C. Wang, and C.-A. Yuan, “Improving gene expression programming using parallel taboo search,” in Proceedings of the IEEE 5th International Conference on Natural Computation (ICNC '09), pp. 144–148, Tianjin, China, August 2009.
[29]  J. Wu, T. Li, B. Fang, Y. Jiang, Z. Li, and Y. Liu, “Parallel niche gene expression programming based on general multi-core processor,” in Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence (AICI '10), vol. 3, pp. 75–79, Sanya, China, October 2010.
[30]  Y. Jiang, C.-J. Tang, H.-C. Zheng et al., “Adaptive gene expression programming algorithm based on cloud model,” in Proceedings of the IEEE 1st International Conference on BioMedical Engineering and Informatics (BMEI '08), vol. 1, pp. 226–230, Sanya, China, May 2008.
[31]  K. Li, W. Pan, W. Zhang, and Z. Chen, “Automatic modeling of a novel gene expression programming based on statistical analysis and critical velocity,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '08), pp. 641–647, Hong Kong, June 2008.
[32]  R. C. Liu, Q. F. Lei, J. Liu, and L. C. Jiao, “A population diversity-oriented gene expression programming for function finding,” in Simulated Evolution and Learning, vol. 6457 of Lecture Notes in Computer Science, pp. 215–219, Springer, Berlin, Germany, 2010.
[33]  Y. Q. Zhang and J. Xiao, “Population diversity strategy in gene expression programming,” Advanced Materials Research, vol. 204–210, pp. 288–292, 2011.
[34]  Y. Zhang, J. Xiao, and S. Sun, “BS-GEP algorithm for prediction of software failure series,” Journal of Software, vol. 7, no. 1, pp. 243–248, 2012.
[35]  N. Mori, J. Yoshida, H. Tamaki, H. Kita, and Y. Nishikawa, “Thermodynamical selection rule for the genetic algorithm,” in Proceedings of the IEEE International Conference on Evolutionary Computation (CEC '95), vol. 1, pp. 188–192, Perth, Australia, December 1995.
[36]  W. Q. Ying, Y. X. Li, S. J. Peng, and W. W. Wang, “A steep thermodynamical selection rule for evolutionary algorithms,” in Computational Science, vol. 4490 of Lecture Notes in Computer Science, pp. 997–1004, Springer, Berlin, Germany, 2007.
[37]  W.-Q. Ying, Y.-X. Li, and P. C.-Y. Sheu, “Improving the computational efficiency of thermodynamical genetic algorithms,” Journal of Software, vol. 19, no. 7, pp. 1613–1622, 2008.
[38]  C. Blake, E. Keogh, and C. J. Merz, “Repository of machine learning databases,” 2012, http://mlearn.ics.uci.edu/databases/function-finding/function-finding.data.
[39]  S. García, A. Fernández, J. Luengo, and F. Herrera, “Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power,” Information Sciences, vol. 180, no. 10, pp. 2044–2064, 2010.
[40]  S. García and F. Herrera, “An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons,” Journal of Machine Learning Research, vol. 9, pp. 2677–2694, 2008.
[41]  J. Dem?ar, “Statistical comparisons of classifiers over multiple data sets,” Journal of Machine Learning Research, vol. 7, pp. 1–30, 2006.
[42]  S. García, D. Molina, M. Lozano, and F. Herrera, “A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization,” Journal of Heuristics, vol. 15, no. 6, pp. 617–644, 2009.

Full-Text

comments powered by Disqus

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133

WeChat 1538708413