Full Text Available

Note: Clicking the button above will open the full text document at the original institutional repository in a new window.

Variance estimation for Markov processes

Thesis (MSc)--Stellenbosch University, 2021.

Saved in:
Bibliographic Details
Main Author: Blomerus, Wessel
Other Authors: Touchette, Hugo
Format: Thesis
Language:en_ZA
Published: Stellenbosch : Stellenbosch University 2021
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867614097321754624
access_status_str Open Access
author Blomerus, Wessel
author2 Touchette, Hugo
author_browse Blomerus, Wessel
Touchette, Hugo
author_facet Touchette, Hugo
Blomerus, Wessel
author_sort Blomerus, Wessel
collection Thesis
dc_rights_str_mv Stellenbosch University
description Thesis (MSc)--Stellenbosch University, 2021.
format Thesis
id oai:scholar.sun.ac.za:10019.1/110482
institution Stellenbosch University (South Africa)
language en_ZA
last_indexed 2026-06-10T12:46:37.536Z
license_str Other — see source repository
provenance_str_mv Harvested via OAI-PMH from SUNScholar — Stellenbosch University Repository
publishDate 2021
publishDateRange 2021
publishDateSort 2021
publisher Stellenbosch : Stellenbosch University
publisherStr Stellenbosch : Stellenbosch University
record_format dspace
source_str SUNScholar — Stellenbosch University Repository
spelling oai:scholar.sun.ac.za:10019.1/110482 Variance estimation for Markov processes Blomerus, Wessel Touchette, Hugo Stellenbosch University. Faculty of Science. Dept. of Mathematical Sciences. Division Applied Mathematics. Markov processes Estimation theory Asymptotic distribution (Probability theory) Stochastic models Poisson's equation UCTD Thesis (MSc)--Stellenbosch University, 2021. ENGLISH ABSTRACT: We study the asymptotic variance of additive functionals of Markov processes, used in statistics and stochastic modelling as estimators of model parameters. The observations generated by these processes are correlated, which complicates the estimation of the asymptotic variance. In practice, methods for estimating the asymptotic variance are based on either estimating the correlation function or the segmentation of the additive observable (batch mean method). In this thesis, we propose and study three new estimators, based on a link between the asymptotic variance, large deviation theory, and an equation of probability theory called the Poisson equation. The first two estimators rely on the fact that the solution of the Poisson equation can be represented as a conditional expectation. The third estimator is based on a stochastic approximation of the solution of the Poisson equation, suggested by recent works in large deviation theory, which describe the solution as an eigenfunction that can be iteratively estimated in an ‘online’ way as a simulation unfolds. We illustrate these three estimators for simple Markov processes, including Markov chains and diffusion processes, for which the asymptotic variance is exactly known. AFRIKAANSE OPSOMMING: Ons bestudeer die asimptotiese variansie van additiewe funksionale vir Markov-prosesse wat gebruik word in statistiek en stogastiese modellering as beramers van model parameters. Dié prosesse genereer gekorreleerde waarnemings wat die beraming van die asimptotiese variansie kompliseer. In die praktyk word metodes om die asimptotiese variansie te beraam gebaseer op óf die beraming van die korrelasiefunksie óf die segmentasie van die additiewe waarneming (lot gemiddeldes metode). In hierdie tesis stel ons drie nuwe beramers voor wat gebaseer is op die verwantskap tussen die asimptotiese variansie, teorie van groot afwykings en ’n vergelyking van waarskynlikheidsteorie, genaamd die Poisson-vergelyking. Die eerste twee beramers is gebaseer op die feit dat the oplossing van die Poisson-vergelyking in terme van ’n voorwaardelike verwagting uitgebeeld kan word. Die derde beramer is gebaseer op ’n stogastiese benadering van die Poisson-vergelyking se oplossing. Hierdie benadering word voorgestel in onlangse werk in die teorie van groot afwykings, waarin die oplossing beskryf word as ’n eiefunksie wat iteratief benader kan word in ’n “aanlyn”-manier soos die simulasie ontvou. Ons gebruik hierdie drie beramers op eenvoudige Markov-prosesse, naamlik Markov-kettings en diffusieprosesse, waar die asimptotiese varianse bekend is. iii Masters 2021-05-24T07:47:58Z 2021-05-24T07:47:58Z 2021-03 Thesis http://hdl.handle.net/10019.1/110482 en_ZA Stellenbosch University ix, 67 pages application/pdf Stellenbosch : Stellenbosch University
spellingShingle Markov processes
Estimation theory
Asymptotic distribution (Probability theory)
Stochastic models
Poisson's equation
UCTD
Blomerus, Wessel
Variance estimation for Markov processes
title Variance estimation for Markov processes
title_full Variance estimation for Markov processes
title_fullStr Variance estimation for Markov processes
title_full_unstemmed Variance estimation for Markov processes
title_short Variance estimation for Markov processes
title_sort variance estimation for markov processes
topic Markov processes
Estimation theory
Asymptotic distribution (Probability theory)
Stochastic models
Poisson's equation
UCTD
url http://hdl.handle.net/10019.1/110482
work_keys_str_mv AT blomeruswessel varianceestimationformarkovprocesses