Green deep reinforcement learning for radio resource management: architecture, algorithm compression, and challenges

Simple item page
dc.contributor.authorDu, Zhiyong
dc.contributor.authorDeng, Yansha
dc.contributor.authorGuo, Weisi
dc.contributor.authorNallanathan, Arumugam
dc.contributor.authorWu, Qihui
dc.date.accessioned2021-02-19T12:02:17Z
dc.date.available2021-02-19T12:02:17Z
dc.date.issued2020-09-24
dc.description.abstractArtificial intelligence (AI) heralds a step-change in wireless networks but may also cause irreversible environmental damage due to its high energy consumption. Here, we address this challenge in the context of 5G and beyond, where there is a complexity explosion in radio resource management (RRM). For high-dimensional RRM problems in a dynamic environment, deep reinforcement learning (DRL) provides a powerful tool for scalable optimization, but it consumes a large amount of energy over time and risks compromising progress made in green radio research. This article reviews and analyzes how to achieve green DRL for RRM via both architecture and algorithm innovations. Architecturally, a cloudbased training and distributed decision-making DRL scheme is proposed, where RRM entities can make lightweight, deep, local decisions while being assisted by on-cloud training and updating. At the algorithm level, compression approaches are introduced for both deep neural networks (DNNs) and the underlying Markov decision processes (MDPs), enabling accurate lowdimensional representations of challenges. To scale learning across geographic areas, a spatial transfer learning scheme is proposed to further promote the learning efficiency of distributed DRL entities by exploiting the traffic demand correlations. Together, our proposed architecture and algorithms provide a vision for green and on-demand DRL capabilityen_UK
dc.identifier.citationDu Z, Deng Y, Guo W, et al., (2020) Green deep reinforcement learning for radio resource management: architecture, algorithm compression, and challenges. IEEE Vehicular Technology Magazine, Volume 16, Issue 1, March 2021, pp. 29-39en_UK
dc.identifier.issn1556-6072
dc.identifier.urihttps://doi.org/10.1109/MVT.2020.3015184
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/16378
dc.language.isoenen_UK
dc.publisherIEEEen_UK
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.subjectOptimizationen_UK
dc.subjectGreen productsen_UK
dc.subjectEnergy consumptionen_UK
dc.subjectVehicle dynamicsen_UK
dc.subjectMachine learningen_UK
dc.subjectWireless networksen_UK
dc.titleGreen deep reinforcement learning for radio resource management: architecture, algorithm compression, and challengesen_UK
dc.typeArticleen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Green_deep_reinforcement_learning_for_radio_resource_management-2021.pdf
Size:
421.63 KB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Staff publications (SATM)