Evolutionary Сomputation for Solving the Terminal Optimal Control Problem

Abstract

The present article considers the problem of numerical solution of the terminal optimal control problem. The general statement of the terminal optimal control problem and a brief overview of its solving methods are presented. With a direct approach and reduction of the optimal control problem to the finite-dimensional optimization problem, the target functional on the space of desired parameters, regardless of the type of approximation of the control function, may not have the unimodal property. Therefore, it is advisable to use evolutionary algorithms to solve the problem. A general approach to solving the terminal optimal control problem of evolutionary computational algorithms is presented. The paper presents a description of some evolutionary algorithms that were selected as the most effective for solving the optimal control problem. A hybrid evolutionary algorithm based on a combination of several evolutionary algorithms is considered. The computational experiment considers the terminal optimal control problems, for which optimal solutions were found by known classical numerical methods that use the gradient of the target functionality when searching. Comparison of the results obtained by classical and evolutionary methods by functional values and computational costs allows us to conclude that evolutionary algorithms are able to effectively solve the terminal optimal control problems

Please cite this article in English as:

Diveev A.I. Evolutionary computation for solving the terminal optimal control problem. Herald of the Bauman Moscow State Technical University, Series Instrument Engineering, 2023, no. 1 (142), pp. 44--59 (in Russ.). DOI: https://doi.org/10.18698/0236-3933-2023-1-44-59

References

[1] Karpenko A.P. Sovremennye algoritmy poiskovoy optimizatsii [Modern algorithms of search engine optimization]. Moscow, BMSTU Publ., 2014.

[2] Duriez T., Brunton S.L., Noack B.R. Machine learning control --- taming nonlinear dynamics and turbulence. Vol. 116. Cham, Springer, 2017. DOI: https://doi.org/10.1007/978-3-319-40624-4

[3] Diveev A., Shmalko E. Machine learning control by symbolic regression. Cham, Springer, 2021. DOI: https://doi.org/10.1007/978-3-030-83213-1

[4] Pontryagin L.S., Boltyanskiy V.G., Gamkrelidze R.V., et al. Matematicheskaya teoriya optimalnykh protsessov [Mathematical theory of optimal processes]. Moscow, Nauka Publ., 1983.

[5] Fedorenko R.P. Priblizhennoe reshenie zadachi optimalnogo upravleniya [Approximate solution of an optimal control problem]. Moscow, Nauka Publ., 1978.

[6] Gornov A.Yu., Tyatyushkin A.I., Finkelshteyn E.A. Numerical methods for solving applied optimal control problems. Comput. Math. and Math. Phys., 2013, vol. 53, no. 12, pp. 1825--1838. DOI: https://doi.org/10.1134/S0965542513120063

[7] Gornov A.Yu., Tyatyushkin A.I., Finkelshteyn E.A. Numerical methods for solving terminal optimal control problems. Comput. Math. and Math. Phys., 2016, vol. 56, no. 2, pp. 221--234. DOI: https://doi.org/10.1134/S0965542516020093

[8] Andrianov A.N., Anikin A.S., Gornov A.Yu. Numerical study of high-dimensional optimization problems using a modification of Polyak’s method. J. Comput. Syst. Sci. Int., 2018, vol. 57, no. 4, pp. 561--580. DOI: https://doi.org/10.1134/S106423071804007X

[9] Diveev A.I., Konstantinov S.V. Study of the practical convergence of evolutionary algorithms for the optimal program control of a wheeled robot. J. Comput. Syst. Sci. Int., 2018, vol. 57, no. 4, pp. 561--580. DOI: https://doi.org/10.1134/S106423071804007X

[10] Diveev A.I., Sofronova E.A., Konstantinov S.V. Approaches to numerical solution of optimal control problem using evolutionary computations. Appl. Sci., 2021, vol. 11,iss. 15, art. 7096. DOI: https://doi.org/10.3390/app11157096

[11] Diveev A.I., Konstantinov S.V. Evolutionary algorithms for the problem of optimal control. Vestnik RUDN. Ser. Inzhenernye issledovaniya [RUDN Journal of Engineering Research], 2017, vol. 18, no. 2, pp. 254--265 (in Russ.). DOI: https://doi.org/10.22363/2312-8143-2017-18-2-254-265

[12] Diveev A., Shmalko E. Comparison of direct and indirect approaches for numerical solution of the optimal control problem by evolutionary methods. In: Jacimovic M., Khachay M., Malkova V., Posypkin M. (eds). Optimization and Applications. OPTIMA 2019. Cham, Springer, 2020, pp. 180--193. DOI: https://doi.org/10.1007/978-3-030-38603-0_14

[13] Diveev A., Konstantinov S.V., Balandina G.I., et al. Comparative research of random search algorithms and evolutionary algorithms for the optimal control problem of the mobile robot. Procedia Comput. Sci., 2019, vol. 150, pp. 462--470. DOI: https://doi.org/10.1016/j.procs.2019.02.080

[14] Konstantinov S.V., Diveev A.I. Solving the problem of the optimal control system general synthesis based on approximation of a set of extremals using the symbol regression method. Herald of the Bauman Moscow State Technical University, Series Instrument Engineering, 2020, no. 2 (131), pp. 59--74. DOI: http://dx.doi.org/10.18698/0236-3933-2020-2-59-74

[15] Diveev A.I. Hybrid evolutionary algorithm for optimal control. Voprosy teorii bezopasnosti i ustoychivosti sistem, 2021, no. 23, pp. 3--12.

[16] Diveev A. Hybrid evolutionary algorithm for optimal control problem. In: Arai K. (eds). Intelligent Systems and Applications. IntelliSys 2022. Lecture Notes in Networks and Systems, vol. 543. Cham, Springer, 2023, pp. 726--738. DOI: https://doi.org/10.1007/978-3-031-16078-3_50

[17] Davis L. Handbook of genetic algorithms. New York, Van Nostrand Reinhold, 1991.

[18] Eberhart R.K.E. Particle swarm optimization. Proc. ICNN’95, 1995, pp. 1942--1948. DOI: https://doi.org/10.1109/ICNN.1995.488968

[19] Mirjalili S., Mirjalili S.M., Lewis A. Grey Wolf Optimizer. Adv. Eng. Softw., 2014, vol. 69, pp. 46--61. DOI: https://doi.org/10.1016/j.advengsoft.2013.12.007