Full Text Available

Note: Clicking the button above will open the full text document at the original institutional repository in a new window.

Ultrasound 3D gesture recognition

Thesis (MEng)--Stellenbosch University, 2018.

Saved in:
Bibliographic Details
Main Author: Kim, Hankyu
Other Authors: Niesler, T. R.
Format: Thesis
Language:en_ZA
Published: Stellenbosch : Stellenbosch University 2018
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867613786025754624
access_status_str Open Access
author Kim, Hankyu
author2 Niesler, T. R.
author_browse Kim, Hankyu
Niesler, T. R.
author_facet Niesler, T. R.
Kim, Hankyu
author_sort Kim, Hankyu
collection Thesis
dc_rights_str_mv Stellenbosch University
description Thesis (MEng)--Stellenbosch University, 2018.
format Thesis
id oai:scholar.sun.ac.za:10019.1/103697
institution Stellenbosch University (South Africa)
language en_ZA
last_indexed 2026-06-10T12:41:40.401Z
license_str Other — see source repository
provenance_str_mv Harvested via OAI-PMH from SUNScholar — Stellenbosch University Repository
publishDate 2018
publishDateRange 2018
publishDateSort 2018
publisher Stellenbosch : Stellenbosch University
publisherStr Stellenbosch : Stellenbosch University
record_format dspace
source_str SUNScholar — Stellenbosch University Repository
spelling oai:scholar.sun.ac.za:10019.1/103697 Ultrasound 3D gesture recognition Kim, Hankyu Niesler, T. R. Stellenbosch University. Faculty of Engineering. Dept. of Electrical and Electronic Engineering. Gesture Recognition UCTD Ultrasonic imaging Three-dimensional imaging Microphone arrays Thesis (MEng)--Stellenbosch University, 2018. ENGLISH ABSTRACT: Interest in gesture recognition systems have grown with the recent advancements in the field of virtual and augmented reality. Gesture recognition provides a flexible interface that is not bound by the hardware as traditional mouse and keyboard combination do. This flexibility is important in virtual environments where the user has to interact with 3 dimensional objects. Having a reliable gesture recognition system will allow development of an intuitive user interface where the user can work with virtual objects as they would do in the real life. This research presents the development of a 2D beamforming microphone array for capturing 3D images, and the processing of the captured images for gesture recognition. The developed hardware consists of an 8x8 square array of MEMS microphones that capture pulsed sinusoids emitted by an ultrasonic transducer. The data from the microphone array is demodulated, filtered, and beamformed using appropriate methods to produce 3D images of the scene. The captured data is then processed, extracting only the relevant features, to a set of time-series vectors that represents the movement of a hand - i.e. a gesture. Using dynamic time warping (DTW) and k-nearest neighbours, the presented gestures are matched with previously captured templates, thereby recognising the type of gesture that was presented. The result showed very promising outcome with 97.5% accuracy in identifying correct gestures when the gestures are presented using a reflector, and 88.2% when the gestures are presented with a bare hand. AFRIKAANSE OPSOMMING: Geen opsomming beskikbaar 2018-02-28T08:47:52Z 2018-04-09T07:06:32Z 2018-02-28T08:47:52Z 2018-04-09T07:06:32Z 2018-03 Thesis http://hdl.handle.net/10019.1/103697 en_ZA Stellenbosch University 116 pages : illustrations application/pdf Stellenbosch : Stellenbosch University
spellingShingle Gesture Recognition
UCTD
Ultrasonic imaging
Three-dimensional imaging
Microphone arrays
Kim, Hankyu
Ultrasound 3D gesture recognition
title Ultrasound 3D gesture recognition
title_full Ultrasound 3D gesture recognition
title_fullStr Ultrasound 3D gesture recognition
title_full_unstemmed Ultrasound 3D gesture recognition
title_short Ultrasound 3D gesture recognition
title_sort ultrasound 3d gesture recognition
topic Gesture Recognition
UCTD
Ultrasonic imaging
Three-dimensional imaging
Microphone arrays
url http://hdl.handle.net/10019.1/103697
work_keys_str_mv AT kimhankyu ultrasound3dgesturerecognition