Fairness-Oriented User Scheduling for Bursty Downlink Transmission Using Multi-Agent Reinforcement Learning
Mingqi Yuan, Qi Cao, Man-On Pun, Yi Chen · APSIPA Transactions on Signal and Information Processing · 2022
Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.
APSIPA Transactions on Signal and Information Processing · Cambridge University Press · article · 2022
Abstract
In this work, we develop practical user scheduling algorithms for downlink bursty traffic with emphasis on user fairness. In contrast to the conventional scheduling algorithms that either equally divide the transmission time slots among users or maximize some ratios without practical physical interpretations, we propose to use the 5%- tile user data rate (5TUDR) as the metric to evaluate user fairness.
Since it is difficult to directly optimize 5TUDR, we first cast the problem into the stochastic game framework and subsequently propose a Multi-Agent Reinforcement Learning (MARL)-based algorithm to perform optimization on the resource block group (RBG) allocation in a highly computationally efficient manner. Furthermore, each MARL agent is designed to take information measured by network counters from multiple network layers (e.g. Channel Quality Indicator, Buffer size) as the input states while the RBG allocation as action with a carefully designed reward function developed to maximize 5TUDR.
Extensive simulation is performed to show that the proposed MARL-based scheduler can achieve fair scheduling while maintaining good average network throughput as compared to conventional schedulers.
Open the resolved locator · 10.1561/116.00000028
Metadata licence: OpenAlex metadata (CC0)