Multi-agent DRL for resource allocation and cache design in terrestrial-satellite networks

dc.contributor.authorLi, Xiaonan
dc.contributor.authorZhang, Haijun
dc.contributor.authorZhou, Huan
dc.contributor.authorWang, Ning
dc.contributor.authorLong, Keping
dc.contributor.authorAl-Rubaye, Saba
dc.contributor.authorKaragiannidis, George K.
dc.date.accessioned2023-02-14T16:46:15Z
dc.date.available2023-02-14T16:46:15Z
dc.date.issued2022-12-29
dc.description.abstractIn the past few years, satellite communications have greatly affected our daily lives, and the integrated terrestrial-satellite network can combine the advantages of satellite and base stations (BSs) to provide wider coverage and lower cost. Because the resources of terrestrial-satellite network are limited, how to allocate resources of terrestrial-satellite network through effective methods has become a major challenge. This paper proposes a framework for resource allocation of terrestrial-satellite network based on non-orthogonal multiple access (NOMA). Then, a deployment method of local cache pools is given to achieve lower time delay and maximize energy efficiency in terrestrial-satellite network. In the proposed framework, we adopt a multi-agent deep deterministic policy gradient (MADDPG) method to obtain the maximum energy efficiency by user association, power control, and cache design. The MADDPG algorithm is divided into two stages, users and BSs are set as agents to complete the optimization problem in the framework. Finally, the simulation results show that the proposed method has better optimized performance compared with the traditional single-agent deep reinforcement learning algorithm and can efficiently solve the problems of resource allocation and cache design in the integrated terrestrial-satellite network.en_UK
dc.identifier.citationLi X, Zhang H, Zhou H, et al., (2023) Multi-agent DRL for resource allocation and cache design in terrestrial-satellite networks. IEEE Transactions on Wireless Communications, Volume 22, Issue 8, August 2023, pp. 5031-5042en_UK
dc.identifier.eissn1558-2248
dc.identifier.issn1536-1276
dc.identifier.urihttps://doi.org/10.1109/TWC.2022.3231379
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/19180
dc.language.isoenen_UK
dc.publisherIEEEen_UK
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.subjectMADDPGen_UK
dc.subjectenergy efficiencyen_UK
dc.subjectresource allocationen_UK
dc.subjectterrestrial-satellite networken_UK
dc.subjectNOMAen_UK
dc.titleMulti-agent DRL for resource allocation and cache design in terrestrial-satellite networksen_UK
dc.typeArticleen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Multi-Agent_DRL_for_Resource_Allocation-2022.pdf
Size:
1.34 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description: