Dynamic Processes Identification in the Form of Differential Equations and their Systems with Introducing the Evolutionary Approaches

Abstract

The paper considers approaches based on the evolutionary algorithms to identify the dynamic processes. The first approach lies in obtaining a model in the form of a differential equation from the numerical data that describe the system behavior. The second approach makes it possible to describe processes with several output actions in the form of a differential equations system. The proposed approaches are searching for a model in the symbolic form, which is convenient in the further system analysis. A modified genetic programming algorithm was introduced in search for the structure, and the equations numerical parameters were selected using the differential evolution algorithm. Evolutionary algorithm self-tuning procedures were applied. The proposed approaches were tested on the problems described by differential equations of various orders and types. Testing included a study of the approaches effectiveness in the presence of noise in the initial data and of the model accuracy dependence on the sample size. Practical identification problems were solved. The first practical task was connected to monitoring the state of hydraulic systems and contained 14 input and 1 output variables. The second practical task was connected to the air composition monitoring and contained 8 input and 2 output variables. For the first task, the obtained results were compared with the model obtained by the nonparametric identification method

The work was performed with support by the Ministry of Education and Science of the Russian Federation within the framework of the State Task in the Field of Science (project no. FEFE-2023-0004)

Please cite this article in English as:

Karaseva T.S., Semenkin E.S. Dynamic processes identification in the form of differential equations and their systems with introducing the evolutionary approaches. Herald of the Bauman Moscow State Technical University, Series Instrument Engineering, 2023, no. 3 (144), pp. 84--98 (in Russ.). DOI: https://doi.org/10.18698/0236-3933-2023-3-84-98

References

[1] Magallon-Garcia D.A., Ontanon-Garcia L.J., Garcia-Lopez J.H., et al. Identification of chaotic dynamics in jerky-based systems by recurrent wavelet first-order neural networks with a Morlet wavelet activation function. Axioms, 2023, vol. 12, no. 2, art. 200. DOI: https://doi.org/10.3390/axioms12020200

[2] Alessandrini M., Falaschetti L., Biagetti G., et al. Nonlinear dynamic system identification in the spectral domain using particle-bernstein polynomials. Electronics, 2022, vol. 11, no. 19, art. 3100. DOI: https://doi.org/10.3390/electronics11193100

[3] Lavrentyev M.M., Vasilyev V.G., Romanov V.G. Mnogomernye obratnye zadachi dlya differentsialnykh uravneniy [Multidimensional inverse problems for differential equations]. Novosibirsk, Nauka Publ., 1969.

[4] Boykov I.V., Krivulin N.P. The methods for identification of dynamical systems. Programmnye sistemy: teoriya i prilozheniya [Program Systems: Theory and Applications], 2014, vol. 5, no. 5, pp. 79--96 (in Russ.).

[5] Reimer M., Rudzicz F. Identifying articulatory goals from kinematic data using principal differential analysis. Proc. Interspeech, 2010, pp. 1608--1611. DOI: https://doi.org/10.21437/Interspeech.2010-466

[6] Semenkin E.S., Semenkina M.E. Samokonfiguriruemye evolyutsionnye algoritmy modelirovaniya i optimizatsii [Self-configuring evolutionary modeling and optimization algorithms]. Magnitogorsk, SibSU Publ., 2014.

[7] Ryzhikov I., Semenkin E. Modified evolutionary strategies algorithm in linear dynamic system identification. Proc. 9th ICINCO, 2012, vol. 1, pp. 618--621. DOI: https://doi.org/10.5220/0004044706180621

[8] Brester C., Ryzhikov I., Stanovov V., et al. Nonlinear dynamic system identification with a cooperative population-based algorithm featuring a restart metaheuristic.IOP Conf. Ser.: Mater. Sc. Eng., 2020, vol. 734, art. 012100. DOI: https://doi.org/10.1088/1757-899X/734/1/012100

[9] Cao H., Kang L., Chen Y., et al. Evolutionary modeling of systems of ordinary differential equations with genetic programming. Genet. Program. Evolvable Mach., 2000, vol. 1, no. 4, pp. 309--337. DOI: https://doi.org/10.1023/A:1010013106294

[10] Koza J.R. Genetic programming. Cambridge, MIT Press, 1992.

[11] Karaseva T.S., Mitrofanov S.A. Self-configuring genetic programming algorithm for solving symbolic regression problems. IOP Conf. Ser.: Mater. Sc. Eng., 2020, vol. 862, art. 052069. DOI: https://doi.org/10.1088/1757-899X/862/5/052069

[12] Bakhvalov N.S. Chislennye metody [Numerical methods]. Moscow, Nauka Publ., 1975.

[13] Storn R., Price K. Differential evolution --- a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim., 1997, vol. 11, no. 4, pp. 341--359. DOI: https://doi.org/10.1023/A:1008202821328

[14] Karaseva T.S. Automatic differential equations identification by self-configuring genetic programming algorithm. IOP Conf. Ser.: Mater. Sc. Eng., 2020, vol. 734, art. 012093. DOI: https://doi.org/10.1088/1757-899X/734/1/012093

[15] Das S.S., Mullick S.S., Suganthan P.N. Recent advances in differential evolution --- an updated survey. Swarm Evol. Comput., 2016, vol. 27, pp. 1--30. DOI: https://doi.org/10.1016/j.swevo.2016.01.004

[16] Stanovov V., Akhmedova S., Semenkin E. Biased parameter adaptation in differential evolution. Inf. Sc., 2021, vol. 566, pp. 215--238. DOI: https://doi.org/10.1016/j.ins.2021.03.016

[17] Niehaus J., Banzhaf W. Adaption of operator probabilities in genetic programming. In: Genetic programming. Berlin, Springer Verlag, 2001, pp. 325--336.

[18] UCI Machine Learning Repository. archive.ics.uci.edu: website. Available at: http://www.ics.uci.edu (accessed 06.02.2023).

[19] Medvedev A.V. Osnovy teorii adaptivnykh system [Fundamentals of adaptive systems theory]. Krasnoyarsk, SibSAU Publ., 2015.

[20] Korneeva A.A., Sergeeva N.A., Chzhan E.A. Nonparametric data analysis in identification problem. Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaya tekhnika i informatika [Tomsk State University Journal of Control and Computer Science], 2013, no. 1, pp. 86--95 (in Russ.).