Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Merging deep neural networks and probabilistic models using Sum product networks
Thesis (MEng)--Stellenbosch University, 2020.
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
Stellenbosch : Stellenbosch University
2020
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867614094946729984 |
|---|---|
| access_status_str | Open Access |
| author | Smit, Andries Petrus |
| author2 | Du Preez, J. A. |
| author_browse | Du Preez, J. A. Smit, Andries Petrus |
| author_facet | Du Preez, J. A. Smit, Andries Petrus |
| author_sort | Smit, Andries Petrus |
| collection | Thesis |
| dc_rights_str_mv | Stellenbosch University |
| description | Thesis (MEng)--Stellenbosch University, 2020. |
| format | Thesis |
| id | oai:scholar.sun.ac.za:10019.1/107883 |
| institution | Stellenbosch University (South Africa) |
| language | English |
| last_indexed | 2026-06-10T12:46:35.101Z |
| license_str | Other — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from SUNScholar — Stellenbosch University Repository |
| publishDate | 2020 |
| publishDateRange | 2020 |
| publishDateSort | 2020 |
| publisher | Stellenbosch : Stellenbosch University |
| publisherStr | Stellenbosch : Stellenbosch University |
| record_format | dspace |
| source_str | SUNScholar — Stellenbosch University Repository |
| spelling | oai:scholar.sun.ac.za:10019.1/107883 Merging deep neural networks and probabilistic models using Sum product networks Smit, Andries Petrus Du Preez, J. A. Stellenbosch University. Faculty of Engineering. Dept. of Electrical and Electronic Engineering. Machine learning Neural networks (Computer science) Sum Product Networks UCTD Probabilities Thesis (MEng)--Stellenbosch University, 2020. ENGLISH ABSTRACT: In recent years there has been renewed interest in machine learning algorithms that can explicitly model uncertainty. Machine learning has great potential to revolutionise almost every sector of our world. To apply these algorithms in areas such as healthcare, insurance, and other high-risk sectors, it is necessary to know both when they are uncertain and, at least partially, be able to explain their predictions. A doctor, for example, can only accept or reject a potential treatment if they can understand why the machine learning system has made the recommendation. Probabilistic models have attractive properties in this regard, as they provide a wide range of probabilistic queries, which help to better understand the model's predictions. However, these probabilistic models are normally either limited in their predictive accuracies or have slow inference times. Sum Product Networks (SPNs) have been proposed as a promising type of deep probabilistic network, as they enable probabilistic queries to be answered in tractable time while also being expressive with high modelling accuracies. In this work, we investigate how SPNs can help bridge the gap between black-box deep learning models and interpretable but limited probabilistic graphical models. We also investigate learning algorithms for SPNs, and derive a new structure learning algorithm for constructing a complete SPN directly from data in both the generative and discriminative settings. AFRIKAANSE OPSOMMING: In die afgelope paar jaar is daar ’n hernieude belangstelling in masjienleer-algoritmes wat uitdruklik onsekerheid in hul voorspellings kan modelleer. Masjienleer het groot potensiaal om byna elke sektor van ons wêreld te verbeter. Om hierdie algoritmes in gebiede soos gesondheidsorg, versekering en ander hoë-risiko sektore toe te pas, moet hulle kan weet wanneer hulle onseker is, sowel as ten minste gedeeltelik hul voorspellings kan verduidelik. ’n Dokter kan byvoorbeeld slegs ’n moontlike behandeling aanvaar of verwerp as hy/sy kan verstaan waarom die masjien-leer stelsel hierdie aanbevelings maak. Probabilistiese modelle het aantreklike eienskappe in hierdie opsig, aangesien hulle ’n wye reeks probabilistiese vrae kan antwoord, wat help om die model se voorspellings beter te verstaan. Hierdie probabilistiese modelle is egter normaalweg ´óf beperk in hul voorspellings se akkuraatheid, óf hulle het baie stadige inferensietye. Die Som Produk Netwerk (SPN) is onlangs as ’n belowende soort diep probabilistiese model voorgestel, waar probabilistiese vrae in ’n redelike tyd beantwoord kan word, terwyl dit ook ekspressief is met ’n hoë modellering akkuraatheid. In hierdie werk ondersoek ons hoe ’n SPN gebruik kan word om te help om die gaping tussen die swartkassie-diepleermodelle en verduidelikbare, maar beperkte, probabilistiese grafiese modelle te oorbrug. Ons ondersoek ook leeralgoritmes vir ’n SPN, en verkry ’n nuwe struktuur-leeralgoritme vir die konstruksie van ’n volledige SPN direk uit data in die generatiewe asook diskriminerende mode. Masters 2020-02-24T06:33:12Z 2020-04-28T12:07:46Z 2020-02-24T06:33:12Z 2020-04-28T12:07:46Z 2020-03 Thesis http://hdl.handle.net/10019.1/107883 en Stellenbosch University xiii, 130 leaves : illustrations (some color) application/pdf Stellenbosch : Stellenbosch University |
| spellingShingle | Machine learning Neural networks (Computer science) Sum Product Networks UCTD Probabilities Smit, Andries Petrus Merging deep neural networks and probabilistic models using Sum product networks |
| title | Merging deep neural networks and probabilistic models using Sum product networks |
| title_full | Merging deep neural networks and probabilistic models using Sum product networks |
| title_fullStr | Merging deep neural networks and probabilistic models using Sum product networks |
| title_full_unstemmed | Merging deep neural networks and probabilistic models using Sum product networks |
| title_short | Merging deep neural networks and probabilistic models using Sum product networks |
| title_sort | merging deep neural networks and probabilistic models using sum product networks |
| topic | Machine learning Neural networks (Computer science) Sum Product Networks UCTD Probabilities |
| url | http://hdl.handle.net/10019.1/107883 |
| work_keys_str_mv | AT smitandriespetrus mergingdeepneuralnetworksandprobabilisticmodelsusingsumproductnetworks |