Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra
Fusion of images captured from different viewpoints is a well-known challenge in computer vision with many established approaches and applications; however, if the observations are captured by sensors also separated by wavelength, this challenge is compounded significantly. This dissertation present...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
Department of Electrical Engineering
2016
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613287107002368 |
|---|---|
| access_status_str | Open Access |
| author | Retief, Francois Jacques |
| author2 | Nicolls, Frederick |
| author_browse | Nicolls, Frederick Retief, Francois Jacques |
| author_facet | Nicolls, Frederick Retief, Francois Jacques |
| author_sort | Retief, Francois Jacques |
| collection | Thesis |
| description | Fusion of images captured from different viewpoints is a well-known challenge in computer vision with many established approaches and applications; however, if the observations are captured by sensors also separated by wavelength, this challenge is compounded significantly. This dissertation presents an investigation into the fusion of visible and thermal image information from two front-facing sensors mounted side-by-side. The primary focus of this work is the development of methods that enable us to map and overlay multi-spectral information; the goal is to establish a combined image in which each pixel contains both colour and thermal information. Pixel-level fusion of these distinct modalities is approached using computational stereo methods; the focus is on the viewpoint alignment and correspondence search/matching stages of processing. Frequency domain analysis is performed using a method called phase congruency. An extensive investigation of this method is carried out with two major objectives: to identify predictable relationships between the elements extracted from each modality, and to establish a stable representation of the common information captured by both sensors. Phase congruency is shown to be a stable edge detector and repeatable spatial similarity measure for multi-spectral information; this result forms the basis for the methods developed in the subsequent chapters of this work. The feasibility of automatic alignment with sparse feature-correspondence methods is investigated. It is found that conventional methods fail to match inter-spectrum correspondences, motivating the development of an edge orientation histogram (EOH) descriptor which incorporates elements of the phase congruency process. A cost function, which incorporates the outputs of the phase congruency process and the mutual information similarity measure, is developed for computational stereo correspondence matching. An evaluation of the proposed cost function shows it to be an effective similarity measure for multi-spectral information. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/20636 |
| institution | University of Cape Town (South Africa) |
| language | eng |
| last_indexed | 2026-06-10T12:33:43.673Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2016 |
| publishDateRange | 2016 |
| publishDateSort | 2016 |
| publisher | Department of Electrical Engineering |
| publisherStr | Department of Electrical Engineering |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/20636 Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra Retief, Francois Jacques Nicolls, Frederick Electrical Engineering Fusion of images captured from different viewpoints is a well-known challenge in computer vision with many established approaches and applications; however, if the observations are captured by sensors also separated by wavelength, this challenge is compounded significantly. This dissertation presents an investigation into the fusion of visible and thermal image information from two front-facing sensors mounted side-by-side. The primary focus of this work is the development of methods that enable us to map and overlay multi-spectral information; the goal is to establish a combined image in which each pixel contains both colour and thermal information. Pixel-level fusion of these distinct modalities is approached using computational stereo methods; the focus is on the viewpoint alignment and correspondence search/matching stages of processing. Frequency domain analysis is performed using a method called phase congruency. An extensive investigation of this method is carried out with two major objectives: to identify predictable relationships between the elements extracted from each modality, and to establish a stable representation of the common information captured by both sensors. Phase congruency is shown to be a stable edge detector and repeatable spatial similarity measure for multi-spectral information; this result forms the basis for the methods developed in the subsequent chapters of this work. The feasibility of automatic alignment with sparse feature-correspondence methods is investigated. It is found that conventional methods fail to match inter-spectrum correspondences, motivating the development of an edge orientation histogram (EOH) descriptor which incorporates elements of the phase congruency process. A cost function, which incorporates the outputs of the phase congruency process and the mutual information similarity measure, is developed for computational stereo correspondence matching. An evaluation of the proposed cost function shows it to be an effective similarity measure for multi-spectral information. 2016-07-25T07:07:58Z 2016-07-25T07:07:58Z 2016 Master Thesis Masters MSc (Eng) http://hdl.handle.net/11427/20636 eng application/pdf Department of Electrical Engineering Faculty of Engineering and the Built Environment University of Cape Town |
| spellingShingle | Electrical Engineering Retief, Francois Jacques Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra |
| thesis_degree_str | Master's |
| title | Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra |
| title_full | Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra |
| title_fullStr | Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra |
| title_full_unstemmed | Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra |
| title_short | Methods for multi-spectral image fusion: identifying stable and repeatable information across the visible and infrared spectra |
| title_sort | methods for multi spectral image fusion identifying stable and repeatable information across the visible and infrared spectra |
| topic | Electrical Engineering |
| url | http://hdl.handle.net/11427/20636 |
| work_keys_str_mv | AT retieffrancoisjacques methodsformultispectralimagefusionidentifyingstableandrepeatableinformationacrossthevisibleandinfraredspectra |