Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Enhancing cross-dataset performance in distracted driver detection using body part activity recognition.
Detecting distracted drivers is a crucial task, and the literature proposes various deep learning-based methods. Among these methods, convolutional neural networks dominate because they can extract and learn image features automatically. However, even though existing methods have reported remarkable...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English Eng |
| Published: |
Department of Electrical Engineering
2025
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613184871890944 |
|---|---|
| access_status_str | Open Access |
| author | Zandamela, Frank |
| author2 | Nicolls, Frederick |
| author_browse | Nicolls, Frederick Zandamela, Frank |
| author_facet | Nicolls, Frederick Zandamela, Frank |
| author_sort | Zandamela, Frank |
| collection | Thesis |
| description | Detecting distracted drivers is a crucial task, and the literature proposes various deep learning-based methods. Among these methods, convolutional neural networks dominate because they can extract and learn image features automatically. However, even though existing methods have reported remarkable results, the cross-dataset performance of these methods remains unknown. A problem arises because cross-dataset performance often indicates a model's generalisation ability. Without knowing the model's cross-dataset performance, deployment in the real world could result in catastrophic events. This thesis investigates the generalisation ability of deep learning-based distracted driver detection methods. In addition, a robust distracted driver detection approach is proposed. The proposed approach is based on recognising distinctive activities of human body parts involved when a driver is operating a vehicle. Representative state-of-the-art deep learning-based methods have been trained exclusively on three widely used image datasets and evaluated across the test sets of these datasets. Experimental results reveal that current deep learning-based methods for detecting distracted drivers do not generalise well on unknown datasets, particularly for convolutional neural network (CNN) models that use the entire image for prediction. In addition, the experiments indicated that although current distracted driver detection datasets are relatively large, they lack diversity. The proposed approach was implemented using a state-of-the-art object detection algorithm called Yolov7. The cross-dataset performance of the implemented approach was evaluated on three benchmark datasets and a custom dataset. Experimental results demonstrate that the proposed approach improves cross-dataset performance. A cross-dataset accuracy improvement of 7.8% was observed. Most importantly, the overall balanced (F1-score) performance was improved by a factor of 2.68. The experimental results also revealed that although the proposed approach demonstrates commendable performance on a custom test set, all algorithms encountered challenges when dealing with the custom test set, mainly due to lower image quality and difficult lighting conditions. The thesis presents two main contributions. Firstly, it evaluates the performance of current deep learning-based distracted driver detection algorithms across different datasets. Secondly, it proposes a robust algorithm for detecting distracted drivers by identifying key human body parts involved in operating a vehicle. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/41155 |
| institution | University of Cape Town (South Africa) |
| language | English Eng |
| last_indexed | 2026-06-10T12:32:07.214Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2025 |
| publishDateRange | 2025 |
| publishDateSort | 2025 |
| publisher | Department of Electrical Engineering |
| publisherStr | Department of Electrical Engineering |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/41155 Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. Zandamela, Frank Nicolls, Frederick Stoltz, Gene Engineering Detecting distracted drivers is a crucial task, and the literature proposes various deep learning-based methods. Among these methods, convolutional neural networks dominate because they can extract and learn image features automatically. However, even though existing methods have reported remarkable results, the cross-dataset performance of these methods remains unknown. A problem arises because cross-dataset performance often indicates a model's generalisation ability. Without knowing the model's cross-dataset performance, deployment in the real world could result in catastrophic events. This thesis investigates the generalisation ability of deep learning-based distracted driver detection methods. In addition, a robust distracted driver detection approach is proposed. The proposed approach is based on recognising distinctive activities of human body parts involved when a driver is operating a vehicle. Representative state-of-the-art deep learning-based methods have been trained exclusively on three widely used image datasets and evaluated across the test sets of these datasets. Experimental results reveal that current deep learning-based methods for detecting distracted drivers do not generalise well on unknown datasets, particularly for convolutional neural network (CNN) models that use the entire image for prediction. In addition, the experiments indicated that although current distracted driver detection datasets are relatively large, they lack diversity. The proposed approach was implemented using a state-of-the-art object detection algorithm called Yolov7. The cross-dataset performance of the implemented approach was evaluated on three benchmark datasets and a custom dataset. Experimental results demonstrate that the proposed approach improves cross-dataset performance. A cross-dataset accuracy improvement of 7.8% was observed. Most importantly, the overall balanced (F1-score) performance was improved by a factor of 2.68. The experimental results also revealed that although the proposed approach demonstrates commendable performance on a custom test set, all algorithms encountered challenges when dealing with the custom test set, mainly due to lower image quality and difficult lighting conditions. The thesis presents two main contributions. Firstly, it evaluates the performance of current deep learning-based distracted driver detection algorithms across different datasets. Secondly, it proposes a robust algorithm for detecting distracted drivers by identifying key human body parts involved in operating a vehicle. 2025-03-12T09:05:39Z 2025-03-12T09:05:39Z 2024-05 2025-03-12T08:55:32Z Thesis / Dissertation Masters MSc http://hdl.handle.net/11427/41155 en Eng application/pdf Department of Electrical Engineering Faculty of Engineering and the Built Environment University of Cape Town |
| spellingShingle | Engineering Zandamela, Frank Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. |
| thesis_degree_str | Master's |
| title | Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. |
| title_full | Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. |
| title_fullStr | Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. |
| title_full_unstemmed | Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. |
| title_short | Enhancing cross-dataset performance in distracted driver detection using body part activity recognition. |
| title_sort | enhancing cross dataset performance in distracted driver detection using body part activity recognition |
| topic | Engineering |
| url | http://hdl.handle.net/11427/41155 |
| work_keys_str_mv | AT zandamelafrank enhancingcrossdatasetperformanceindistracteddriverdetectionusingbodypartactivityrecognition |