Data-Glove-Based Hand Gesture Recognition System Using Flex Sensors And An Imu Sensor

Ong, Jing Hao (2017) Data-Glove-Based Hand Gesture Recognition System Using Flex Sensors And An Imu Sensor. Project Report. Universiti Sains Malaysia, Pusat Pengajian Kejuruteraan Elektrik & Elektronik. (Submitted)

[img]
Preview
PDF
Download (866kB) | Preview

Abstract

With the great expansion of computer technology, Human-Computer Interaction (HCI) is required to be more effective. Hand gestures are more natural compared with actions associated with the traditional devices such as the keyboard, mouse, etc. This thesis proposes a wearable data gloved-based hand gesture recognition system that is able to recognize static hand and dynamic gestures to allow human interacts with the computer in more natural manner. This system recognizes the hand gestures based on the information captured by the flex sensors and an IMU sensor. The fingers’ bending angles are measured by using the flex sensors while the pitch and roll of the hand are detected by using the IMU sensors. The acquired data is then processed in Raspberry Pi board. The Complementary filter is used to fuse the data from the accelerometer data and gyroscope packed in IMU sensor to obtain an accurate measurement. This system is based on k-Nearest Neighbors (k-NN) classifier algorithm, Dynamic Time Warping (DTW) and Euclidean distance metric algorithms. The proposed system was tested in recognizing 38 static and 12 dynamic hand gestures. The meaning of the hand gesture is displayed on GUI created in Raspberry Pi by using Python’s Tkinter programming. An accuracy of 98.97 % is achieved by this system in recognizing 12 dynamic and 38 static hand gestures without the user’s noise.

Item Type: Monograph (Project Report)
Subjects: T Technology
T Technology > TK Electrical Engineering. Electronics. Nuclear Engineering
Divisions: Kampus Kejuruteraan (Engineering Campus) > Pusat Pengajian Kejuruteraaan Elektrik & Elektronik (School of Electrical & Electronic Engineering) > Monograph
Depositing User: Mr Mohamed Yunus Mat Yusof
Date Deposited: 17 Jun 2022 03:43
Last Modified: 17 Jun 2022 03:43
URI: http://eprints.usm.my/id/eprint/52929

Actions (login required)

View Item View Item
Share