Transactions of Nanjing University of Aeronautics & Astronautics
+Advanced Search
Archive > Volume 37 Issue S > 2020,37(S):76-87. DOI:10.16356/j.1005-1120.2020.S.010 Prev Next

Evolutionary Algorithm with Ensemble Classifier Surrogate Model for Expensive Multiobjective Optimization

  • Article
  • Figures
  • Metrics
  • Preview PDF
  • Reference
  • Related
  • Cited by
    Abstract:
    For many real-world multiobjective optimization problems， the evaluations of the objective functions are computationally expensive. Such problems are usually called expensive multiobjective optimization problems （EMOPs）. One type of feasible approaches for EMOPs is to introduce the computationally efficient surrogates for reducing the number of function evaluations. Inspired from ensemble learning， this paper proposes a multiobjective evolutionary algorithm with an ensemble classifier （MOEA-EC） for EMOPs. More specifically， multiple decision tree models are used as an ensemble classifier for the pre-selection， which is be more helpful for further reducing the function evaluations of the solutions than using single inaccurate model. The extensive experimental studies have been conducted to verify the efficiency of MOEA-EC by comparing it with several advanced multiobjective expensive optimization algorithms. The experimental results show that MOEA-EC outperforms the compared algorithms.

    Keywords:
    multiobjective evolutionary algorithm ; expensive multiobjective optimization ; ensemble classifier ; surrogate model

    Clc Number:
    TP18

    表 4 Table 4 Comparison of band fusion result evaluation
    表 2 Table 2 Comparison of UNcamp fusion result evaluation
    表 1 Table 1 NSCT-GoogLeNet image fusion algorithm steps
    图1 Decomposed structure of NSCTFig.1
    图2 Framework of the proposed methodFig.2
    图3 Result on “UNcamp” imageFig.3
    图4 Result on “Sandpath” imageFig.4
    图5 Result on “Band” imageFig.5
    表 3 Table 3 Comparison of sandpath fusion result evaluation
    [1] KALYANMOY D. Multi objective optimization using evolutionary algorithms[M]. [S.l.]： John Wiley and Sons， 2001?.
    [2] MIETTINEN K. Nonlinear multiobjective optimization[J]. International Series in Operations Research and Management Science， 1999?， 51（2）： 246.
    [3] KALYANMOY D， PRATAP A， AGARWAL S， et al. A fast and elitist multiobjective genetic algorithm： Nsga-ii[J]. IEEE Transactions on Evolutionary Computation， 2002， 6（2）： 182-197.
    [4] ZITZLER E， LAUMANNS M， THIELE L. Spea2： Improving the strength pareto evolutionary algorithm for multiobjective optimization[C]//Proceedings of Evolutionary Methods for Design， Optimization and Control with Applications to Industrial Problem. Athens， Grecle： [s.n.]， 2001.
    [5] ZHANG Q， HUI L. Moea/d： A multiobjective evolutionary algorithm based on decomposition[J]. IEEE Transactions on Evolutionary Computation， 2007， 11（6）： 712-731.
    [6] CAI X， MEI Z， FAN Z， et al. A constrained decomposition approach with grids for evolutionary multiobjective optimization?[J]. IEEE Transactions on Evolutionary Computation， 2018， 22（4）： 564-577.
    [7] ZITZLER Z， KüNZLI S?. Indicator-based selection in multiobjective search?[C]//Proceedings of International Conference on Parallel Problem Solving from Nature. [S.l.]： Springer， 2004： 832-842.
    [8] SUN Y， YEN G G， ZHANG Y. IGD indicator-based evolutionary algorithm for many-objective optimization problems[J]. IEEE Transactions on Evolutionary Computation， 2018， 99： 1.
    [9] KUYA Y， TAKEDA K， ZHANG X， et al. Multifidelity surrogate modeling of experimental and computational aerodynamic data sets?[J]. AIAA Journal， 2011， 49（2）： 289-298.
    [10] DOUGUET D. E-lea3D： A computational-aided drug design web server[J]. Nucleic Acids Research， 2010， 38（S2）： 615-621.
    [11] WANG H， JIN Y， JANSEN J O. Data-driven surrogate-assisted multiobjective evolutionary optimization of a trauma system?[J]. IEEE Trans? Evolutionary Computation， 2016， 20（6）： 939-952.
    [12] BROOMHEAD D S， LOWE D. Radial basis functions， multi-variable functional interpolation and adaptive networks[R]. United Kingdom： Royal Signals and Radar Establishment Malvern， 1988.
    [13] ZURADA J M. Introduction to artificial neural systems[M]. Avonmore： West Publishing Company， 1992.
    [14] KRIGE D G. A statistical approach to some basic mine valuation problems on the witwatersrand[J]. Journal of the Southern African Institute of Mining and Metallurgy， 1951， 52（6）： 119-139.
    [15] ALLMENDINGER R， EMMERICH M T， HAKANEN J， et al. Surrogate-assisted multicriteria optimization： Complexities， prospective solutions， and business case[J]. Journal of Multi-criteria Decision Analysis， 2017， 24（1/2）： 5-24.
    [16] HABIB A， SINGH H， CHUGH T， et al. A multiple surrogate-assisted decomposition-based evolutionary algorithm for expensive multi/many-objective optimization[J]. IEEE Transactions on Evolutionary Computation， 2019， 23（6）： 1000-1014.
    [17] WANG H， JIN Y. A random forest-assisted evolutionary algorithm for data-driven constrained multiobjective combinatorial optimization of trauma systems[J]. IEEE Transactions on Cybernetics， 2018， 50（2）： 536-549.
    [18] CHUGH T， JIN Y， MIETTINEN K， et al. A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization?[J]. IEEE Transactions on Evolutionary Computation， 2018，22（1）： 129-142.
    [19] PAN L， HE C， TIAN Y， et al. A classification-based surrogate-assisted evolutionary algorithm for expensive many-objective optimization[J]. IEEE Transactions on Evolutionary Computation， 2018， 23（1）： 74-88.
    [20] BHATTACHARJEE K S， SINGH H K， RAY T. Multiple surrogate-assisted many-objective optimization for computationally expensive engineering design?[J]. Journal of Mechanical Design， 2018， 140（5）： 051403.
    [21] HE C， CHENG R， ZHANG C， et al. Evolutionary large-scale multiobjective optimization for ratio error estimation of voltage transformers?[J]. IEEE Transactions on Evolutionary Computation， 2020， 24（5）： 868-881.
    [22] TIAN Y， YANG S， ZHANG L， et al. A surrogate-assisted multiobjective evolutionary algorithm for large-scale task-oriented pattern mining?[J]. IEEE Transactions on Emerging Topics in Computational Intelligence， 2018， 3（2）： 106-116.
    [23] MIN A T W， ONG Y S， GUPTA A， et al. Multiproblem surrogates：? Transfer evolutionary multiobjective optimization of computationally expensive problems[J]. IEEE Transactions on Evolutionary Computation， 2019， 23（1）： 15-28.
    [24] LYU Z， WANG L， HAN Z， et al. Surrogate-assisted particle swarm optimization algorithm with pareto active learning for expensive multi-objective optimization?[J]. IEEE/CAA Journal of Automatica Sinica， 2019， 6（3）： 838-849.
    [25] EVERITT B S. Classification and regression trees[M]. Hoboken： John Wiley & Sons， Ltd， 2005.
    [26] FARNSWORTH D， ORR R. Gini means?[J]. The American Mathematical Monthly， 1986， 93（8）： 603-607.
    [27] DIETTERICH T G. Ensemble methods in machine learning[C]//Proceedings of International Workshop on Multiple Classifier Systems. [S.l.]： Springer， 2000： 1-15.
    [28] DEB K，THIELE L，LAUMANNS M，et al. Scalable multi-objective optimization test problems[C]//Proceedings of the 2002 Congress on Evolutionary Computation. Honolulu：IEEE， 2002：825-830.
    [29] YE T， RAN C， ZHANG X， et al. Platemo：? A matlab platform for evolutionary multi-objective optimization[J]. IEEE Computational Intelligence Magazine， 2017， 12（4）： 73-87.
    [30] ZHANG Q， LIU W， TSANG E， et al. Expensive multiobjective optimization by moea/d with gaussian process model[J]. IEEE Transactions on Evolutionary Computation， 2010， 14（3）： 456-474.
    [31] PEDREGOSA F， VAROQUAUX G， GRAMFORT A， et al. Scikit-learn： Machine learning in python[J]. Journal of Machine Learning Research， 2013， 12（10）： 2825-2830.
    [32] ZHOU A， ZHANG Q， JIN Y， et al. A model-based evolutionary algorithm for bi-objective optimization[C]/

Articles

WeChat

Mobile website

Website Copyright © Transactions of Nanjing University of Aeronautics & Astronautics
Supported by:Beijing E-Tiller Technology Development Co., Ltd.