Wearable sensor-based pattern mining for human activity recognition: deep learning approach

Abstract

Purpose

This paper aims to deal with the human activity recognition using human gait pattern. The paper has considered the experiment results of seven different activities: normal walk, jogging, walking on toe, walking on heel, upstairs, downstairs and sit-ups.

Design/methodology/approach

In this current research, the data is collected for different activities using tri-axial inertial measurement unit (IMU) sensor enabled with three-axis accelerometer to capture the spatial data, three-axis gyroscopes to capture the orientation around axis and 3° magnetometer. It was wirelessly connected to the receiver. The IMU sensor is placed at the centre of mass position of each subject. The data is collected for 30 subjects including 11 females and 19 males of different age groups between 10 and 45 years. The captured data is pre-processed using different filters and cubic spline techniques. After processing, the data are labelled into seven activities. For data acquisition, a Python-based GUI has been designed to analyse and display the processed data. The data is further classified using four different deep learning model: deep neural network, bidirectional-long short-term memory (BLSTM), convolution neural network (CNN) and CNN-LSTM. The model classification accuracy of different classifiers is reported to be 58%, 84%, 86% and 90%.

Findings

The activities recognition using gait was obtained in an open environment. All data is collected using an IMU sensor enabled with gyroscope, accelerometer and magnetometer in both offline and real-time activity recognition using gait. Both sensors showed their usefulness in empirical capability to capture a precised data during all seven activities. The inverse kinematics algorithm is solved to calculate the joint angle from spatial data for all six joints hip, knee, ankle of left and right leg.

Practical implications

This work helps to recognize the walking activity using gait pattern analysis. Further, it helps to understand the different joint angle patterns during different activities. A system is designed for real-time analysis of human walking activity using gait. A standalone real-time system has been designed and realized for analysis of these seven different activities.

Originality/value

The data is collected through IMU sensors for seven activities with equal timestamp without noise and data loss using wirelessly. The setup is useful for the data collection in an open environment outside the laboratory environment for activity recognition. The paper also presents the analysis of all seven different activity trajectories patterns.

Citation

Bijalwan, V., Semwal, V.B. and Gupta, V. (2022), "Wearable sensor-based pattern mining for human activity recognition: deep learning approach", Industrial Robot, Vol. 49 No. 1, pp. 21-33. https://doi.org/10.1108/IR-09-2020-0187