A Q-Learning Based Slice Admission Algorithm for Multi-Tier 5G Cellular Wireless Networks

  • Elizabeth M. Okumu Kabarak University, School of Science Engineering and Technology, P. O. Box Private Bag 20157, Nakuru 20100, Kenya
Keywords: Network slice, 5G, Reinforcement learning, Slice admission, Resource allocation

Abstract

Network slicing enables a 5G infrastructure provider (network infrastructure owner) to create multiple separate virtual networks, each tailored at a specific performance requirement, on a common physical network.  In this context, slice admission algorithms are required to process slice requests received by the infrastructure provider.  These algorithms are tailored to admit and allocate resources to network slices in a manner that results in the optimization of a given objective.  In this paper, a Q-learning slice admission algorithm, which maximizes the infrastructure provider’s revenue, is designed.  Results show that the designed algorithm learns from its environment, which enables it to acquire knowledge about the multi-tiered cellular network, thus allowing it make optimal slice admission decisions.  The results further show that the designed algorithm has superior performance in terms of revenue achieved when compared to algorithms that admit, a) to maximize immediate rewards and b) slices in a random manner. 

References

. ONF TR-526, “Applying SDN Architecture to 5G Slicing,” Apr. 2016.

. ETSI GS NFV 002, “Network Functions Virtualization (NFV); Architectural Framework,” v. 1.1.1, Dec. 2014.

. N. M. M. K. Chowdhury and R. Boutaba, “A Survey of Network Virtualization,” Computer Networks, vol. 54, no. 5, Apr. 2010, pp. 862–76

. NGMN Alliance, “Description of Network Slicing Concept,” Public Deliverable, 2016

. M. O. Ojijo and O. E. Falowo, "A survey on slice admission control strategies and optimization schemes in 5g network", IEEE Access, vol. 8, pp. 14977-14990, 2020.

. D. Bega, M. Gramaglia, A. Banchs, V. Sciancalepore, K. Samdanis, and X. Costa-Perez, ‘‘Optimising 5G infrastructure markets: The business ofnetwork slicing,’’ inProc. IEEE INFOCOM, Atlanta, GA, USA, May 2017,pp. 1–9.

. R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction. MIT press Cambridge, 1998.

. R. Bellman, “A markovian decision process,” DTIC, Tech. Rep., 1957.

. T. Mitchell. Machine Learning, McGraw-Hill, 1997.

. E. Even-Dar and Y. Mansour, “Learning rates for Q-learning,” Journal of Machine Learning Research, vol. 5, pp. 1–25, Dec. 2003.

Published
2021-09-24
Section
Articles