Izvestiya of Saratov University.

Mathematics. Mechanics. Informatics

ISSN 1816-9791 (Print)
ISSN 2541-9005 (Online)


For citation:

Dorofeev N. V., Grecheneva A. V. Algorithm for motion detection and gait classification based on mobile phone accelerometer data. Izvestiya of Saratov University. Mathematics. Mechanics. Informatics, 2023, vol. 23, iss. 4, pp. 531-543. DOI: 10.18500/1816-9791-2023-23-4-531-543, EDN: WNESNS

This is an open access article distributed under the terms of Creative Commons Attribution 4.0 International License (CC-BY 4.0).
Published online: 
30.11.2023
Full text:
(downloads: 421)
Language: 
Russian
Heading: 
Article type: 
Article
UDC: 
004.048
EDN: 
WNESNS

Algorithm for motion detection and gait classification based on mobile phone accelerometer data

Autors: 
Dorofeev Nikolay Viktorovich, Vladimir State University
Grecheneva Anastasya V., Vladimir State University
Abstract: 

This paper briefly describes the development of information technology tools using biometric data, in particular, human gait parameters. The problems of assessing gait parameters using a mobile phone accelerometer in real conditions are briefly described. The relevance of this research is substantiated in the field of developing algorithms for assessing biometric gait indicators based on data from wearable devices. The main approaches to the processing of wearable device accelerometer data are considered, the main shortcomings and problems in improving the quality of gait parameter estimation are indicated. The algorithm for processing data from a mobile phone accelerometer is described. In the proposed algorithm, the selection of movement patterns during gait  in the recorded data is carried out on the basis of statistical information within the “floating” time window (frequency component with the maximum contribution to the spectrum of the accelerometer signal, the duration of the selected time segments), as well as on the basis of the value of the correlation coefficient, selected time segments. At the stage of data segmentation, the time window of searching of movement segments, as well as the allowable thresholds of selecting movements by their duration, change depending on the individual characteristics of the gait and human activity. The classification of the selected segments according to the nature of gait movements is carried out on the basis of a feed-forward neural network. The sigmoid was used as the activation function for the hidden layers, and the normalized exponential function was used for the output layer. The neural network was trained using the gradient backdescent method with cross entropy as an optimization criterion. Due to the selection of segments with a high correlation coefficient, the classification of data shows the quality of distinguishing movements above 95%.

Acknowledgments: 
The work was carried out with the financial support of a grant from the President of the Russian Federation (project No. MK-1558.2021.1.6).
References: 
  1. Sprager S., Juric M. B. Inertial Sensor-Based Gait Recognition: A Review. Sensors, 2015, vol. 15, pp. 22089–22127. https://doi.org/10.3390/s150922089
  2. Connor P., Ross A. Biometric recognition by gait: A survey of modalities and features. Computer Vision and Image Understanding, 2018, vol. 167, pp. 1–27. https://doi.org/10.1016/j.cviu.2018.01.007
  3. Guelta B., Tlemsani R., Chouraqui S., Benouis M. An improved behavioral biometric system based on gait and ECG signals. International Journal of Intelligent Engineering & Systems, 2019, vol. 12, iss. 6, pp. 147–156. https://doi.org/10.22266/ijies2019/1231.14
  4. Ren Y., Chuah M. C. User verification leveraging gait recognition for smartphone enabled mobile healthcare systems. IEEE Transactions on Mobile Computing, 2015, vol. 14, iss. 9, pp. 1961–1974. https://doi.org/10.1109/TMC.2014.2365185
  5. Khabir K. M., Siraj Md. S., Ahmed M., Ahmed M. U. Prediction of gender and age from inertial sensor-based gait dataset. Joint 2019 8th International Conference on Informatics, Electronics & Vision (ICIEV) & 3rd International Conference on Imaging, Vision & Pattern Recognition (IVPR), Eastern Washington University, May 30 – June 4, 2019, pp. 371–376. https://doi.org/10.1109/ICIEV.2019.8858521
  6. Shema-Shiratzaky S., Beer Y., Mor A., Elbaz A. Smartphone-based inertial sensors technology – Validation of a new application to measure spatiotemporal gait metrics. Gait & Posture, 2022, vol. 93, pp. 102–106. https://doi.org/10.1016/j.gaitpost.2022.01.024
  7. Garufov D., Bours P. User authentication based on foot motion. SIViP, 2011, vol. 5, pp. 457–467. https://doi.org/10.1007/s11760-011-0249-1
  8. Reyes O. C., Vera-Rodriguez R., Scully P. J., Ozanyan K. B. Analysis of spatio-temporal representations for robust footstep recognition with deep residual neural networks. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2018, vol. 4, pp. 1–13. https://doi.org/10.1109/TPAMI.2018.2799847
  9. Sokolova A. I., Konushin A. S. Methods of gait recognition in video. Proceedings of the Institute for System Programming of the RAS, 2019, vol. 31, iss. 1, pp. 69–82 (in Russian). https://doi.org/10.15514/ISPRAS-2019-31(1)-5, EDN: PGFXZW
  10. Helvas A. V., Belyaikina N. G., Gilya-Zetinov A. A., Chernikova D. D., Shabunin V. M., Yapryntsev E. O. Gesture recognition using a neural network and the application of this approach to create a new generation of gaming gadgets. Proceedings of Moscow Institute of Physics and Technology, 2017, iss. 2 (34). pp. 1–7 (in Russian). EDN: ZBMXML
  11. Teh P. S., Zhang N., Tan S.-Y., Shi Q., Khoh W. H., Nawaz R. Strengthen user authentication on mobile devices by using user’s touch dynamics pattern. Journal of Ambient Intelligence and Humanized Computing, 2020, vol. 11, iss. 10, pp. 4019–4039. https://doi.org/10.1007/s12652-019-01654-y
  12. Zhang X., Yao L., Huang C., Gu T., Yang Z., Liu Y. DeepKey: A multimodal biometric authentication system via deep decoding gaits and brainwaves. ACM Transactions on Intelligent Systems and Technology, 2020, vol. 11, iss. 4, art. 49. https://doi.org/10.1145/3393619
  13. Grecheneva A. V., Dorofeev N. V., Goryachev M. S. Estimation of human biomechanics during registration with a wearable device. Journal of Physics Conference Series, 2021, vol. 2096, iss. 1, art. 012117. https://doi.org/10.1088/1742-6596/2096/1/012117
  14. Lu H., Huang J., Saha T., Nachman L. Unobtrusive gait verification for mobile phones. Proceedings of the 2014 ACM International Symposium on Wearable Computers. Seattle, WA, USA, Sept. 13–17, 2014, pp. 91–98. https://doi.org/10.1145/2634317.2642868
  15. Oguz A., Ertugrul O. F. Human identification based on accelerometer sensors obtained by mobile phone data. Biomedical Signal Processing and Control, 2022, vol. 77, art. 103847. https://doi.org/10.1016/j.bspc.2022.103847
  16. Tandon R., Javid P., Giulio I. D. Mobile phone use is detrimental for gait stability in young adults. Gait & Posture, 2021, vol. 88, pp. 37–41. https://doi.org/10.1016/j.gaitpost.2021.05.001
  17. Pierce A., Ignasiak N. K., Eiteman-Pang W. K., Rakovsky C. Mobile phone sensors can discern medication-related gait quality changes in Parkinson’s patients in the home environment. Computer Methods and Programs in Biomedicine Update, 2021, vol. 1, art. 100028. https://doi.org/10.1016/j.cmpbup.2021.100028
  18. Lunardini F., Malavolti M., Pedrocchi A. L. G., Borghese N. A., Ferrante S. A mobile app to transparently distinguish single-from dual-task walking for the ecological monitoring of age-related changes in daily-life gait. Gait & Posture, 2021, vol. 86, pp. 27–32. https://doi.org/10.1016/j.gaitpost.2021.02.028 
Received: 
05.10.2022
Accepted: 
07.04.2023
Published: 
30.11.2023