Intelligent handover decision scheme using double deep reinforcement learning

dc.creatorMollel, Michael
dc.creatorAbubakar, Attai Ibrahim
dc.creatorOzturk, Metin
dc.creatorKaijage, Shubi
dc.creatorMichael, Kisangiri,
dc.creatorZoha, Ahmed
dc.creatorImran, Muhammad Ali
dc.creatorAbbasi, Qammer
dc.date2020-06-10T10:29:15Z
dc.date2020-06-10T10:29:15Z
dc.date2020-10
dc.date.accessioned2022-10-25T09:15:55Z
dc.date.available2022-10-25T09:15:55Z
dc.descriptionThis research article published by Elsevier B.V., Volume 42, October 2020
dc.descriptionHandovers (HOs) have been envisioned to be more challenging in 5G networks due to the inclusion of millimetre wave (mm-wave) frequencies, resulting in more intense base station (BS) deployments. This, by its turn, increases the number of HOs taken due to smaller footprints of mm-wave BSs thereby making HO management a more crucial task as reduced quality of service (QoS) and quality of experience (QoE) along with higher signalling overhead are more likely with the growing number of HOs. In this paper, we propose an offline scheme based on double deep reinforcement learning (DDRL) to minimize the frequency of HOs in mm-wave networks, which subsequently mitigates the adverse QoS. Due to continuous and substantial state spaces arising from the inherent characteristics of the considered 5G environment, DDRL is preferred over conventional -learning algorithm. Furthermore, in order to alleviate the negative impacts of online learning policies in terms of computational costs, an offline learning framework is adopted in this study, a known trajectory is considered in a simulation environment while ray-tracing is used to estimate channel characteristics. The number of HO occurrence during the trajectory and the system throughput are taken as performance metrics. The results obtained reveal that the proposed method largely outperform conventional and other artificial intelligence (AI)-based models.
dc.formatapplication/pdf
dc.identifierhttps://doi.org/10.1016/j.phycom.2020.101133
dc.identifierhttps://dspace.nm-aist.ac.tz/handle/20.500.12479/778
dc.identifier.urihttp://hdl.handle.net/123456789/94691
dc.languageen
dc.publisherElsevier B.V.
dc.subjectDouble deep reinforcement learning
dc.subjectHandover management
dc.subjectMillimetre-wave communication
dc.titleIntelligent handover decision scheme using double deep reinforcement learning
dc.typeArticle

Files