Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning.
Thesis (PhD)--Stellenbosch University, 2024.
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | en_ZA en_ZA |
| Published: |
Stellenbosch : Stellenbosch University
2024
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867614115173761024 |
|---|---|
| access_status_str | Open Access |
| author | Grobler, Abraham |
| author2 | Engelbrecht, Herman |
| author_browse | Engelbrecht, Herman Grobler, Abraham |
| author_facet | Engelbrecht, Herman Grobler, Abraham |
| author_sort | Grobler, Abraham |
| collection | Thesis |
| dc_rights_str_mv | Stellenbosch University |
| description | Thesis (PhD)--Stellenbosch University, 2024. |
| format | Thesis |
| id | oai:scholar.sun.ac.za:10019.1/130458 |
| institution | Stellenbosch University (South Africa) |
| language | en_ZA en_ZA |
| last_indexed | 2026-06-10T12:46:54.487Z |
| license_str | Other — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from SUNScholar — Stellenbosch University Repository |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| publisher | Stellenbosch : Stellenbosch University |
| publisherStr | Stellenbosch : Stellenbosch University |
| record_format | dspace |
| source_str | SUNScholar — Stellenbosch University Repository |
| spelling | oai:scholar.sun.ac.za:10019.1/130458 Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. Grobler, Abraham Engelbrecht, Herman Stellenbosch University. Faculty of Engineering. Dept. of Electrical and Electronic Engineering. Reinforcement learning Electronic commerce Customer relations Gaussian Mixture Model, Machine learning Neural networks (Computer science) UCTD Thesis (PhD)--Stellenbosch University, 2024. ENGLISH ABSTRACT: This thesis aims to optimise the delivery time of e-marketing methods such as emails and push notifications, with the intention of increasing customer engagement with an e-commerce platform. This optimisation can be performed using model-free reinforcement learning (RL) methods. First, we aim to develop a statistical, non-stationary model of a customer’s probability to interact with e-marketing at different hours of the day. The model is built using a small sample of anonymous, real customer data. From this sample, we train a Gaussian Mixture Model, which allows us to generate a large synthetic customer base. This customer model acts as the environment of the RL experiments. We then develop several different RL agents, employing algorithms such as Q-learning and DQN, to try and find the best time to deliver e-marketing messages to each customer. We then compare the different agents in terms of learning rate, adaptability and stability. A novel method for epsilon-greedy exploration, tailored to each customer through a parameter-specific approach, is also proposed and tested. Our experiments demonstrate that this method outperforms traditional exploration techniques in the context of our experiments. Our findings demonstrate that RL-based optimisation of delivery time provides a promising method of potentially increasing the open rate and customer engagement, providing valuable insights for e-commerce platforms. AFRIKAANSE OPSOMMING: Hierdie tesis het ten doel om die aflewertempo van e-bemarkingsmetodes soos e-posse en stootkennisgewings te optimaliseer, met die voorneme om klieëntebetrokkenheid met ’n e-handelsplatform te verhoog. Hierdie optimalisering kan uitgevoer word deur model-vrye versterkingsleermetodes (RL). Eerstens streef ons daarna om ’n statistiese, nie-stasioneêre model van ’n klieënt se waarskynlikheid te ontwikkel om op verskillende tye van die dag met e-bemarking te kommunikeer. Die model is gebou met behulp van ’n klein steekproef van anonieme, werklike klieëntdata. Uit hierdie steekproef lei ons ’n Gaussiese Mengsel Model af, wat ons in staat stel om ’n groot sintetiese klieëntbasis te genereer. Hierdie klieëntmodel dien as die omgewing van die RL-eksperimente. Ons ontwikkel dan verskeie verskillende RL-agente, wat algoritmes soos Q-leer en DQN gebruik, om te probeer en die beste tyd te vind om e-bemarkingsboodskappe aan elke klieënt af te lewer. Ons vergelyk dan die verskillende agente in terme van leertempo, aanpasbaarheid ii https://scholar.sun.ac.za ABSTRACT iii en stabiliteit. ’n Nuwe metode vir epsilon-gulsige verkenning, wat spesifiek vir elke klieënt aangepas is deur ’n parameter-spesifieke benadering, word ook voorgestel en getoets. Ons eksperimente toon dat hierdie metode beter presteer as tradisionele verkenningstegnieke in die konteks van ons eksperimente. Ons bevindings toon dat RL-gebaseerde optimalisering van aflewertempo die oopmaak tempo en klieëntebetrokkenheid doeltreffend verhoog, wat waardevolle insig bied vir e-handelsplatforms. Doctoral 2024-03-04T12:38:37Z 2024-04-26T18:20:39Z 2024-03-04T12:38:37Z 2024-04-26T18:20:39Z 2024-03 Thesis https://scholar.sun.ac.za/handle/10019.1/130458 en_ZA en_ZA Stellenbosch University xi, 91 pages : illustrations. application/pdf Stellenbosch : Stellenbosch University |
| spellingShingle | Reinforcement learning Electronic commerce Customer relations Gaussian Mixture Model, Machine learning Neural networks (Computer science) UCTD Grobler, Abraham Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. |
| title | Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. |
| title_full | Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. |
| title_fullStr | Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. |
| title_full_unstemmed | Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. |
| title_short | Enhancing customer engagement in e-commerce: improving e-marketing open rates through model-free reinforcement learning. |
| title_sort | enhancing customer engagement in e commerce improving e marketing open rates through model free reinforcement learning |
| topic | Reinforcement learning Electronic commerce Customer relations Gaussian Mixture Model, Machine learning Neural networks (Computer science) UCTD |
| url | https://scholar.sun.ac.za/handle/10019.1/130458 |
| work_keys_str_mv | AT groblerabraham enhancingcustomerengagementinecommerceimprovingemarketingopenratesthroughmodelfreereinforcementlearning |