Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Real-time video sentiment analysis through the use of snapshots
There are many types of emotions that one can experience and they usually have a direct impact on a person's behaviour. Emotions can be conveyed in several ways such as gestures/body movement, words or facial expressions and this dissertation we aim to distinguish the emotional state of a person bas...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English English |
| Published: |
Department of Statistical Sciences
2025
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613165720698880 |
|---|---|
| access_status_str | Open Access |
| author | Ramma, Sudiptee |
| author2 | Nyirenda, Juwa |
| author_browse | Nyirenda, Juwa Ramma, Sudiptee |
| author_facet | Nyirenda, Juwa Ramma, Sudiptee |
| author_sort | Ramma, Sudiptee |
| collection | Thesis |
| description | There are many types of emotions that one can experience and they usually have a direct impact on a person's behaviour. Emotions can be conveyed in several ways such as gestures/body movement, words or facial expressions and this dissertation we aim to distinguish the emotional state of a person based on their facial expressions. Several approaches have been devised in this regard by various past researchers within the computer vision field but unfortunately, despite the similarities in the adopted techniques for the facial and emotion detection processes, there still exist some discrepancies regarding their performances when applied to different images or video streams. As such, the goal of this dissertation is to develop a program that can analyse a real-time video stream and take in each of the frames as an image snapshot which can be in turn processed to efficiently identify faces and recognise a person's emotion based on their facial expressions. Two scenarios, namely Frontal only, and Profile and Frontal, each with their datasets were accounted for in this research. The first dataset (Frontal) consists only of users who are facing forward and the second one (Profile and Frontal) consists of users who are facing forward as well as sideways. Convolutional Neural Network (CNN) models were constructed for each of the given datasets on both the augmented and non-augmented versions of these datasets to obtain the best possible model for each scenario before applying such model to a real-time video stream. In both scenarios, the augmented models outperformed the non-augmented models when tested on unseen static image data and when such a model was applied to a real-time video stream with the help of the OpenCV library and the relevant Haar Cascade classifiers, required for the face detection process (depending on which scenario), fairly accurate results were obtained when each frame within the video stream were converted into an image snapshot before classification. The code for this dissertation can be found here: https://github.com/Drish19/Facial-Emotion-Recognition. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/41869 |
| institution | University of Cape Town (South Africa) |
| language | English eng |
| last_indexed | 2026-06-10T12:31:48.735Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2025 |
| publishDateRange | 2025 |
| publishDateSort | 2025 |
| publisher | Department of Statistical Sciences |
| publisherStr | Department of Statistical Sciences |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/41869 Real-time video sentiment analysis through the use of snapshots Ramma, Sudiptee Nyirenda, Juwa Emotion recognition Facial emotion recognition Face detection Emotion classification Convolutional Neural Network (CNN) OpenCV There are many types of emotions that one can experience and they usually have a direct impact on a person's behaviour. Emotions can be conveyed in several ways such as gestures/body movement, words or facial expressions and this dissertation we aim to distinguish the emotional state of a person based on their facial expressions. Several approaches have been devised in this regard by various past researchers within the computer vision field but unfortunately, despite the similarities in the adopted techniques for the facial and emotion detection processes, there still exist some discrepancies regarding their performances when applied to different images or video streams. As such, the goal of this dissertation is to develop a program that can analyse a real-time video stream and take in each of the frames as an image snapshot which can be in turn processed to efficiently identify faces and recognise a person's emotion based on their facial expressions. Two scenarios, namely Frontal only, and Profile and Frontal, each with their datasets were accounted for in this research. The first dataset (Frontal) consists only of users who are facing forward and the second one (Profile and Frontal) consists of users who are facing forward as well as sideways. Convolutional Neural Network (CNN) models were constructed for each of the given datasets on both the augmented and non-augmented versions of these datasets to obtain the best possible model for each scenario before applying such model to a real-time video stream. In both scenarios, the augmented models outperformed the non-augmented models when tested on unseen static image data and when such a model was applied to a real-time video stream with the help of the OpenCV library and the relevant Haar Cascade classifiers, required for the face detection process (depending on which scenario), fairly accurate results were obtained when each frame within the video stream were converted into an image snapshot before classification. The code for this dissertation can be found here: https://github.com/Drish19/Facial-Emotion-Recognition. 2025-09-19T09:54:23Z 2025-09-19T09:54:23Z 2025 2025-09-19T09:51:43Z Thesis / Dissertation Masters MSc http://hdl.handle.net/11427/41869 en eng application/pdf Department of Statistical Sciences Faculty of Science University of Cape Town |
| spellingShingle | Emotion recognition Facial emotion recognition Face detection Emotion classification Convolutional Neural Network (CNN) OpenCV Ramma, Sudiptee Real-time video sentiment analysis through the use of snapshots |
| thesis_degree_str | Master's |
| title | Real-time video sentiment analysis through the use of snapshots |
| title_full | Real-time video sentiment analysis through the use of snapshots |
| title_fullStr | Real-time video sentiment analysis through the use of snapshots |
| title_full_unstemmed | Real-time video sentiment analysis through the use of snapshots |
| title_short | Real-time video sentiment analysis through the use of snapshots |
| title_sort | real time video sentiment analysis through the use of snapshots |
| topic | Emotion recognition Facial emotion recognition Face detection Emotion classification Convolutional Neural Network (CNN) OpenCV |
| url | http://hdl.handle.net/11427/41869 |
| work_keys_str_mv | AT rammasudiptee realtimevideosentimentanalysisthroughtheuseofsnapshots |