Full Text Available

Note: Clicking the button above will open the full text document at the original institutional repository in a new window.

Reinforcement learning for the control of traffic flow on highways

Thesis (PhD)--Stellenbosch University, 2018.

Saved in:
Bibliographic Details
Main Author: Schmidt-Dumont, Thorsten
Other Authors: Van Vuuren, J. H.
Format: Thesis
Language:en_ZA
Published: Stellenbosch : Stellenbosch University 2018
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867613874390302720
access_status_str Open Access
author Schmidt-Dumont, Thorsten
author2 Van Vuuren, J. H.
author_browse Schmidt-Dumont, Thorsten
Van Vuuren, J. H.
author_facet Van Vuuren, J. H.
Schmidt-Dumont, Thorsten
author_sort Schmidt-Dumont, Thorsten
collection Thesis
dc_rights_str_mv Stellenbosch University
description Thesis (PhD)--Stellenbosch University, 2018.
format Thesis
id oai:scholar.sun.ac.za:10019.1/104851
institution Stellenbosch University (South Africa)
language en_ZA
last_indexed 2026-06-10T12:43:03.527Z
license_str Other — see source repository
provenance_str_mv Harvested via OAI-PMH from SUNScholar — Stellenbosch University Repository
publishDate 2018
publishDateRange 2018
publishDateSort 2018
publisher Stellenbosch : Stellenbosch University
publisherStr Stellenbosch : Stellenbosch University
record_format dspace
source_str SUNScholar — Stellenbosch University Repository
spelling oai:scholar.sun.ac.za:10019.1/104851 Reinforcement learning for the control of traffic flow on highways Schmidt-Dumont, Thorsten Van Vuuren, J. H. Bruwer, Megan Stellenbosch University. Faculty of Engineering. Dept. of Industrial Engineering. Reinforcement learning Highway -- Traffic control Ramp metering (Traffic engineering) Variable speed limits Autonomous vehicles UCTD Thesis (PhD)--Stellenbosch University, 2018. ENGLISH ABSTRACT: Traffc congestion has become a significant problem around the world, not only in first-world countries, but also in third-world countries such as South Africa. Due to spatial limitations, especially in well-developed metropolitan areas, which typically experience the worst congestion problems, capacity expansion is not always feasible for relieving the pressure on the transportation network. Furthermore, the theory of induced traffic demand suggests that increasing highway capacity is not a long-term solution to traffic congestion due to additional traffic demand on new or updated routes, induced by commuters' perception that new or upgraded routes should be congestion free. As a result, various approaches toward improving highway traffic flow without increasing infrastructure capacity have been proposed in the literature. Ramp metering and variable speed limits are the best-known control measures for effective traffic flow on highways. In most approaches towards solving the control problems presented by these control measures, optimal control techniques or online feedback control have been employed. Feedback control does not, however, guarantee optimality with respect to the on-ramp metering rate or the speed limit chosen, while optimal control techniques are limited to small networks due to their large computational burden. Reinforcement learning is a promising alternative, providing the means and framework required to achieve near-optimal control policies at a fraction of the computational burden associated with optimal control algorithms. In this dissertation, a decentralised reinforcement learning approach is adopted towards simultaneously solving both the ramp metering and variable speed limit control problems. The dawn of the autononomous vehicle promises further improvements in traffic flow which may be achieved over and above those of the aforementioned established highway traffic control measures, if their capabilities are harnessed effectively. A novel method of ramp metering by autonomous vehicles is introduced in this dissertation, based on the premise that specific instructions may be provided to autonomus vehicles travelling along an on-ramp. The control problem presented by this method of ramp metering via autonomous vehicles is also solved using a reinforcement learning approach. The above solution approaches are implemented as a concept demonstrator within a simple, benchmark microscopic highway traffic simulation model. The effectiveness of the decentralised reinforcement learning approach is evaluated by means of statistical comparisons within the context of this simple benchmark simulation model. These approaches are finally applied within the context of a real-world case study simulation model of a section of the N1 highway outbound out of Cape Town, South Africa in order to demonstrate the effectiveness of the approaches within the context of a realistic scenario based on a real highway network and real traffic flow data. AFRIKAANSE OPSOMMING: Raadpleeg teks vir opsomming Doctoral 2018-10-10T09:49:15Z 2018-12-07T06:47:48Z 2018-10-10T09:49:15Z 2018-12-07T06:47:48Z 2018-12 Thesis http://hdl.handle.net/10019.1/104851 en_ZA Stellenbosch University 460 pages : illustrations application/pdf Stellenbosch : Stellenbosch University
spellingShingle Reinforcement learning
Highway -- Traffic control
Ramp metering (Traffic engineering)
Variable speed limits
Autonomous vehicles
UCTD
Schmidt-Dumont, Thorsten
Reinforcement learning for the control of traffic flow on highways
title Reinforcement learning for the control of traffic flow on highways
title_full Reinforcement learning for the control of traffic flow on highways
title_fullStr Reinforcement learning for the control of traffic flow on highways
title_full_unstemmed Reinforcement learning for the control of traffic flow on highways
title_short Reinforcement learning for the control of traffic flow on highways
title_sort reinforcement learning for the control of traffic flow on highways
topic Reinforcement learning
Highway -- Traffic control
Ramp metering (Traffic engineering)
Variable speed limits
Autonomous vehicles
UCTD
url http://hdl.handle.net/10019.1/104851
work_keys_str_mv AT schmidtdumontthorsten reinforcementlearningforthecontroloftrafficflowonhighways