Virtual Reality Mobile Platform for Restoring Upper Limbs Functions using Electromiography Data

The article describes a mobile virtual reality platform based on the biological feedback of electromyography for restoring the functions of the upper limbs of people affected by accidents, stroke, Parkinson's disease or who suffered as a result of military operations. The definition of the electromyography (EMG) signal is given. The effectiveness of the biological feedback method in the rehabilitation process is indicated. The problem of initial data preprocessing is considered in order to identify the informative features of the EMG signal in the time domain. The general scheme of a mobile virtual reality platform based on biological feedback is described and preliminary evidence of the platform capability in its current state is presented. The block diagram of the EMG data acquisition module is developed. Developing a training program within the framework of computer games in two-dimensional or three-dimensional space is proposed. The algorithm of the mobile virtual reality platform based on the biological feedback of electromyography is illustrated. The results of the implementation of the proposed biofeedback electromyography system are presented. The advantages of the developed system in comparison with other systems currently available are emphasized; the disadvantages of this method are identified and ways to eliminate them are proposed

Some results were obtained with the financial supported by the Ministry of Education and Science of the Russian Federation (project no. 0705-2020-0041 "Fundamental research of methods for digital transformation of the component base of micro- and nanosystems")

References

[1] Budko R.Yu., Chernov N.N., Budko A.Yu. Recognition of facial movements by facial electromyogram signals in real time. Nauchnyy vestnik NGTU [Scientific Bulletin of NSTU], 2018, vol. 71, no. 2, pp. 59--74 (in Russ.).

[2] Chernikova L.A., Ustinova K.I., Ioffe M.E., et al. The postural sway biofeedback in neurology. Byul. SO RAMN [The Bulletin of Siberian Branch of Russian Academy of Medical Sciences], 2004, no. 3, pp. 85--91 (in Russ.).

[3] Chernikova L.A., Ioffe M.E., Busheneva S.N., et al. EMG biofeedback and functional magnetic resonance imaging in the post-stroke rehabilitation (precise grip training). Byulleten’ sibirskoy meditsiny [Bulletin of Siberian Medicine], 2010, no. 2, pp. 12--17 (in Russ.).

[4] Samman A., Terekhov V.V. [Analysis of control methods for electronic arm using myography]. Bogatstvo Rossii: Vseros. forum nauch. molodezhy [Wealth of Russia: All-Russian Sc. Young Forum]. Moscow, Bauman MSTU Publ., 2018, pp. 32--33 (in Russ.).

[5] Samman A. [Making a model in MATLAB Simulink for real-time reading and processing of signal]. Bogatstvo Rossii: II Vseros. forum nauch. molodezhy [Wealth of Russia: II All-Russian Sc. Young Forum]. Moscow, Bauman MSTU Publ., 2019, pp. 91--94 (in Russ.).

[6] Sethana S., Sri Kumari V., Madhavi K. The effectiveness of EMG biofeedback on hand function in subjects with stroke. Int. J. Physiother, 2014, vol. 1, no. 4, pp. 178--186. DOI: https://doi.org/10.15621/ijphy/2014/v1i4/54557

[7] Qidwai U., Ajimsha M.S., Shakir M. The role of EEG and EMG combined virtual reality gaming system in facial palsy rehabilitation --- a case report. J. Bodyw. Mov. Ther., 2019, vol. 23, no. 2, pp. 425--431. DOI: https://doi.org/10.1016/j.jbmt.2019.02.012

[8] Di Girolamo M. Post-stroke rehabilitation of hand function based on electromyography biofeedback. PhD Thes. Politecnico di Torino, 2018. DOI: https://doi.org/10.6092/polito/porto/2729320

[9] Levin M.F., Magdalon E.K., Michelsen S.M., et al. Quality of grasping and the role of haptics in a 3D immersive virtual reality environment in individuals with stroke. IEEE Trans. Neural Syst. Rehabilitation Eng., 2015, vol. 23, no. 6, pp. 1047--1055. DOI: https://doi.org/10.1109/TNSRE.2014.2387412

[10] Dash A., Lahiri U. Design of virtual reality-enabled surface electromyogram-triggered grip exercise platform. IEEE Trans. Neural Syst. Rehabilitation Eng., 2020, vol. 28, no. 2, pp. ‏444--452. DOI: https://doi.org/10.1109/TNSRE.2019.2959449

[11] Lin P.D., Chen H.U., Hung S., et al. An upper extremity rehabilitation system using virtual reality technology. Proc. 15th I-SPAN, 2018. DOI: https://doi.org/10.1109/I-SPAN.2018.00048

[12] Kabanov A.A. Development of analog filtering circuit for electromyography signal. Omskiy nauchnyy vestnik [Omsk Scientific Bulletin], 2018, no. 5, pp. 135--138 (in Russ.). DOI: https://doi.org/10.25206/1813-8225-2018-161-135-138

[13] Nikolay S.W., Walker A.L. Grip strength and endurance: Influences of anthropometric variation, hand dominance, and gender. Int. J. Ind. Ergon., 2005, vol. 35, no. 7, pp. 605--618. DOI: https://doi.org/10.1016/j.ergon.2005.01.007

[14] Liu L., Chen X., Lu Z., et al. Development of an EMG-ACC-based upper limb rehabilitation training system. IEEE Trans. Neural Syst. Rehabilitation Eng., 2017, vol. 25, no. 3, pp. 244--253. DOI: https://doi.org/10.1109/TNSRE.2016.2560906

[15] Wojtara T., Alnajjar F., Shimoda S., et al. Muscle synergy stability and human balance maintenance. J. Neuroeng. Rehabil., 2014, vol. 11, no. 1, art. 129. DOI: https://doi.org/10.1186/1743-0003-11-129