Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Machine Learning for Radio Frequency Interference Flagging
The field of radio frequency interference (RFI) flagging involves the identification of corrupted data within radio astronomy measurements. This work explores the application of supervised machine learning algorithms for RFI flagging, trained on real measurement data and simulated data with simulate...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
Department of Electrical Engineering
2021
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867614210647654400 |
|---|---|
| access_status_str | Open Access |
| author | Harrison, Kyle |
| author2 | Mishra, Amit |
| author_browse | Harrison, Kyle Mishra, Amit |
| author_facet | Mishra, Amit Harrison, Kyle |
| author_sort | Harrison, Kyle |
| collection | Thesis |
| description | The field of radio frequency interference (RFI) flagging involves the identification of corrupted data within radio astronomy measurements. This work explores the application of supervised machine learning algorithms for RFI flagging, trained on real measurement data and simulated data with simulated RFI. The goal of this work is to investigate the prediction of RFI using specific machine learning algorithms; Naive Bayes Classifier, K-Nearest Neighbours Classifier, Random Forest Classifier, the U-Net convolution neural network and the Multilayer Perceptron. These algorithms are trained on real data, in which the ground truth includes inherent false positives, and simulated data where the ground truth positions of RFI are absolute. This is done through the use of time/frequency spectrogram data, relating to radio astronomy measurements, using the magnitudes and phases of each available polarization. Predictions for unseen test data are compared between algorithms, different implementations of those algorithms and each dataset. A specific implementation for data pre-processing is designed and implemented, utilizing a two dimensional filtering technique for feature construction. The goal of this method is intended to implement a means of injecting a form of spatial information of nearby time/frequency samples for each sample in a spectrogram. The inclusion of this spacial information, which is relevant to broadband bursts and narrowband persistent RFI, is hypothesised to increase the level of information present in the processed dataset. The use of feature construction using filtering techniques, demonstrates a noticeable improvement in the machine learning methods where each sample is treated individually during training and inference. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/33777 |
| institution | University of Cape Town (South Africa) |
| language | eng |
| last_indexed | 2026-06-10T12:48:25.650Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2021 |
| publishDateRange | 2021 |
| publishDateSort | 2021 |
| publisher | Department of Electrical Engineering |
| publisherStr | Department of Electrical Engineering |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/33777 Machine Learning for Radio Frequency Interference Flagging Harrison, Kyle Mishra, Amit Taylor, Russ Electrical Engineering The field of radio frequency interference (RFI) flagging involves the identification of corrupted data within radio astronomy measurements. This work explores the application of supervised machine learning algorithms for RFI flagging, trained on real measurement data and simulated data with simulated RFI. The goal of this work is to investigate the prediction of RFI using specific machine learning algorithms; Naive Bayes Classifier, K-Nearest Neighbours Classifier, Random Forest Classifier, the U-Net convolution neural network and the Multilayer Perceptron. These algorithms are trained on real data, in which the ground truth includes inherent false positives, and simulated data where the ground truth positions of RFI are absolute. This is done through the use of time/frequency spectrogram data, relating to radio astronomy measurements, using the magnitudes and phases of each available polarization. Predictions for unseen test data are compared between algorithms, different implementations of those algorithms and each dataset. A specific implementation for data pre-processing is designed and implemented, utilizing a two dimensional filtering technique for feature construction. The goal of this method is intended to implement a means of injecting a form of spatial information of nearby time/frequency samples for each sample in a spectrogram. The inclusion of this spacial information, which is relevant to broadband bursts and narrowband persistent RFI, is hypothesised to increase the level of information present in the processed dataset. The use of feature construction using filtering techniques, demonstrates a noticeable improvement in the machine learning methods where each sample is treated individually during training and inference. 2021-08-17T09:23:43Z 2021-08-17T09:23:43Z 2021 2021-08-17T09:18:48Z Master Thesis Masters MSc http://hdl.handle.net/11427/33777 eng application/pdf Department of Electrical Engineering Faculty of Engineering and the Built Environment |
| spellingShingle | Electrical Engineering Harrison, Kyle Machine Learning for Radio Frequency Interference Flagging |
| thesis_degree_str | Master's |
| title | Machine Learning for Radio Frequency Interference Flagging |
| title_full | Machine Learning for Radio Frequency Interference Flagging |
| title_fullStr | Machine Learning for Radio Frequency Interference Flagging |
| title_full_unstemmed | Machine Learning for Radio Frequency Interference Flagging |
| title_short | Machine Learning for Radio Frequency Interference Flagging |
| title_sort | machine learning for radio frequency interference flagging |
| topic | Electrical Engineering |
| url | http://hdl.handle.net/11427/33777 |
| work_keys_str_mv | AT harrisonkyle machinelearningforradiofrequencyinterferenceflagging |