Full Text Available

Note: Clicking the button above will open the full text document at the original institutional repository in a new window.

Reinforcement learning microservices scheduler in intelligent edge computing

Dissertation (MEng)--University of Pretoria, 2024

Saved in:
Bibliographic Details
Other Authors: Abu-Mahfouz, Adnan Mohammed
Format: Thesis
Language:English
Published: University of Pretoria 2025
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867613513762996224
access_status_str Open Access
author2 Abu-Mahfouz, Adnan Mohammed
author_browse Abu-Mahfouz, Adnan Mohammed
author_facet Abu-Mahfouz, Adnan Mohammed
collection Thesis
dc_rights_str_mv © 2023 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria.
description Dissertation (MEng)--University of Pretoria, 2024
format Thesis
id oai:repository.up.ac.za:2263/100060
institution University of Pretoria (South Africa)
language English
last_indexed 2026-06-10T12:37:20.986Z
license_str Other — see source repository
provenance_str_mv Harvested via OAI-PMH from UPSpace — University of Pretoria Institutional Repository
publishDate 2025
publishDateRange 2025
publishDateSort 2025
publisher University of Pretoria
publisherStr University of Pretoria
record_format dspace
source_str UPSpace — University of Pretoria Institutional Repository
spelling oai:repository.up.ac.za:2263/100060 Reinforcement learning microservices scheduler in intelligent edge computing Abu-Mahfouz, Adnan Mohammed u22851217@tuks.co.za Hancke, Gerhard P. Afachao, Kevin E. UCTD Artificial intelligence (AI) Cloud computing Edge computing Internet of Things (IoT) Microservices Reinforcement learning Resource management Scheduling algorithms Dissertation (MEng)--University of Pretoria, 2024 The proliferation of internet of things (IoT) devices and resource-intensive applications has necessitated the development of intelligent edge computing frameworks. These frameworks aim to address challenges in the resource management, service latency, and data privacy of IoT devices. This research investigates the complex problem of microservice scheduling within intelligent edge computing environments. The focus is on optimising quality of service (QoS) metrics such as the latency, network bandwidth utilisation, and energy consumption during execution of resource-intensive applications. To address this challenge, a novel approach called the Bi-generic A2C Microservice Proxy Policy (BAMPP) is proposed. It leverages reinforcement learning (RL) principles to optimize microservice deployment in dynamic Edge-Cloud ecosystems. BAMPP uniquely considers the intricate inter-dependencies among microservices and adapts to user mobility in real-world scenarios. This research utilises a simulation platform to reproduce the intelligent edge computing environment, integrating real-world datasets to evaluate the performance of BAMPP against comparative algorithms. The research focuses on three key research points: identifying crucial factors influencing microservice scheduler performance, leveraging RL for optimised scheduling, and assessing the impact of random user mobility on service deployment. The results demonstrate BAMPP's superior performance in reducing energy consumption, minimizing network usage, decreasing execution and migration latency, and enhancing reliability in microservice scheduling compared to current systems. This research contributes to the field of intelligent edge computing by introducing a novel modeling approach, developing an advanced algorithm for joint optimization of scheduling and resource management, and providing comprehensive performance evaluations using realistic simulations. The results of this study have important ramifications for raising the effectiveness and performance of microservice applications in intelligent edge environments, potentially leading to cost savings, enhanced sustainability, and widespread implementation across diverse edge computing scenarios. Electrical, Electronic and Computer Engineering MEng (Computer Engineering) Unrestricted Faculty of Engineering, Built Environment and Information Technology SDG-09: Industry, innovation and infrastructure 2025-01-15T07:07:29Z 2025-01-15T07:07:29Z 2025-05-20 2024-07-01 Dissertation * A2025 http://hdl.handle.net/2263/100060 10.25403/UPresearchdata.28016285 10.25403/UPresearchdata.28016285 en © 2023 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria. application/pdf University of Pretoria
spellingShingle UCTD
Artificial intelligence (AI)
Cloud computing
Edge computing
Internet of Things (IoT)
Microservices
Reinforcement learning
Resource management
Scheduling algorithms
Reinforcement learning microservices scheduler in intelligent edge computing
title Reinforcement learning microservices scheduler in intelligent edge computing
title_full Reinforcement learning microservices scheduler in intelligent edge computing
title_fullStr Reinforcement learning microservices scheduler in intelligent edge computing
title_full_unstemmed Reinforcement learning microservices scheduler in intelligent edge computing
title_short Reinforcement learning microservices scheduler in intelligent edge computing
title_sort reinforcement learning microservices scheduler in intelligent edge computing
topic UCTD
Artificial intelligence (AI)
Cloud computing
Edge computing
Internet of Things (IoT)
Microservices
Reinforcement learning
Resource management
Scheduling algorithms
url http://hdl.handle.net/2263/100060