A Q-Learning Based Slice Admission Algorithm for Multi-Tier 5G Cellular Wireless Networks

Authors

  • Elizabeth M. Okumu Kabarak University, School of Science Engineering and Technology, P. O. Box Private Bag 20157, Nakuru 20100, Kenya

Keywords:

Network slice, 5G, Reinforcement learning, Slice admission, Resource allocation

Abstract

Network slicing enables a 5G infrastructure provider (network infrastructure owner) to create multiple separate virtual networks, each tailored at a specific performance requirement, on a common physical network.  In this context, slice admission algorithms are required to process slice requests received by the infrastructure provider.  These algorithms are tailored to admit and allocate resources to network slices in a manner that results in the optimization of a given objective.  In this paper, a Q-learning slice admission algorithm, which maximizes the infrastructure provider’s revenue, is designed.  Results show that the designed algorithm learns from its environment, which enables it to acquire knowledge about the multi-tiered cellular network, thus allowing it make optimal slice admission decisions.  The results further show that the designed algorithm has superior performance in terms of revenue achieved when compared to algorithms that admit, a) to maximize immediate rewards and b) slices in a random manner. 

References

. ONF TR-526, “Applying SDN Architecture to 5G Slicing,” Apr. 2016.

. ETSI GS NFV 002, “Network Functions Virtualization (NFV); Architectural Framework,” v. 1.1.1, Dec. 2014.

. N. M. M. K. Chowdhury and R. Boutaba, “A Survey of Network Virtualization,” Computer Networks, vol. 54, no. 5, Apr. 2010, pp. 862–76

. NGMN Alliance, “Description of Network Slicing Concept,” Public Deliverable, 2016

. M. O. Ojijo and O. E. Falowo, "A survey on slice admission control strategies and optimization schemes in 5g network", IEEE Access, vol. 8, pp. 14977-14990, 2020.

. D. Bega, M. Gramaglia, A. Banchs, V. Sciancalepore, K. Samdanis, and X. Costa-Perez, ‘‘Optimising 5G infrastructure markets: The business ofnetwork slicing,’’ inProc. IEEE INFOCOM, Atlanta, GA, USA, May 2017,pp. 1–9.

. R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction. MIT press Cambridge, 1998.

. R. Bellman, “A markovian decision process,” DTIC, Tech. Rep., 1957.

. T. Mitchell. Machine Learning, McGraw-Hill, 1997.

. E. Even-Dar and Y. Mansour, “Learning rates for Q-learning,” Journal of Machine Learning Research, vol. 5, pp. 1–25, Dec. 2003.

Downloads

Published

2021-09-24

How to Cite

M. Okumu , E. . (2021). A Q-Learning Based Slice Admission Algorithm for Multi-Tier 5G Cellular Wireless Networks. American Scientific Research Journal for Engineering, Technology, and Sciences, 82(1), 11–18. Retrieved from https://asrjetsjournal.org/index.php/American_Scientific_Journal/article/view/6910

Issue

Section

Articles