Skip to main content

A Recurrent Neural Network for Hand Gesture Recognition based on Accelerometer Data

Phan, Huy (2019) A Recurrent Neural Network for Hand Gesture Recognition based on Accelerometer Data. In: 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2019). . IEEE (In press)

PDF - Author's Accepted Manuscript
Download (149kB) Preview
Official URL


For many applications, hand gesture recognition systems that rely on biosignal data exclusively are mandatory. Usually, theses systems have to be affordable, reliable as well as mobile. The hand is moved due to muscle contractions that cause motions of the forearm skin. Theses motions can be captured with cheap and reliable accelerometers placed around the forearm. Since accelerometers can also be integrated into mobile systems easily, the possibility of a robust hand gesture recognition based on accelerometer signals is evaluated in this work. For this, a neural network architecture consisting of two different kinds of recurrent neural network (RNN) cells is proposed. Experiments on three databases reveal that this relatively small network outperforms by far state-of-the-art hand gesture recognition approaches that rely on multi-modal data. The combination of accelerometer data and an RNN forms a robust hand gesture classification system, i.e., the performance of the network does not vary a lot between subjects and it is outstanding for amputees. Furthermore, the proposed network uses only 5 ms short windows to classify the hand gestures. Consequently, this approach allows for a quick, and potentially delay-free hand gesture detection.

Item Type: Conference or workshop item (Paper)
Uncontrolled keywords: Hand gesture recognition, recurrent neural network, accelerometer data
Divisions: Faculties > Sciences > School of Computing > Data Science
Depositing User: Huy Phan
Date Deposited: 07 May 2019 12:51 UTC
Last Modified: 27 Jul 2019 23:00 UTC
Resource URI: (The current URI for this page, for reference purposes)
Phan, Huy:
  • Depositors only (login required):


Downloads per month over past year