University of Oulu

M. Naderi Soorki, W. Saad, M. Bennis and C. S. Hong, "Ultra-Reliable Indoor Millimeter Wave Communications Using Multiple Artificial Intelligence-Powered Intelligent Surfaces," in IEEE Transactions on Communications, vol. 69, no. 11, pp. 7444-7457, Nov. 2021, doi: 10.1109/TCOMM.2021.3106686

Ultra-reliable indoor millimeter wave communications using multiple artificial intelligence-powered intelligent surfaces

Saved in:
Author: Naderi Soorki, Mehdi1; Saad, Walid2,3; Bennis, Mehdi4;
Organizations: 1Faculty of Engineering, Shahid Chamran University of Ahvaz, Ahvaz, Iran
2Wireless@VT, Virginia Tech, Blacksburg, VA, USA
3Kyung Hee University, Yongin, South Korea
4Centre for Wireless Communications, University of Oulu, Oulu, Finland
Format: article
Version: accepted version
Access: open
Online Access: PDF Full Text (PDF, 6.4 MB)
Persistent link:
Language: English
Published: Institute of Electrical and Electronics Engineers, 2021
Publish Date: 2021-12-21


In this paper, a novel framework for guaranteeing ultra-reliable millimeter wave (mmW) communications using multiple artificial intelligence (AI)-enabled reconfigurable intelligent surfaces (RISs) is proposed. The use of multiple AI-powered RISs allows changing the propagation direction of the signals transmitted from a mmW access point (AP) thereby improving coverage particularly for non-line-of-sight (NLoS) areas. However, due to the possibility of highly stochastic blockage over mmW links, designing an intelligent controller to jointly optimize the mmW AP beam and RIS phase shifts is a daunting task. In this regard, first, a parametric risk-sensitive episodic return is proposed to maximize the expected bitrate and mitigate the risk of mmW link blockage. Then, a closed-form approximation of the policy gradient of the risk-sensitive episodic return is analytically derived. Next, the problem of joint beamforming for mmW AP and phase shift control for mmW RISs is modeled as an identical payoff stochastic game within a cooperative multi-agent environment, in which the agents are the mmW AP and the RISs. Two centralized and distributed controllers are proposed to control the policies of the mmW AP and RISs. To directly find a near optimal solution, the parametric functional-form policies for the controllers are modeled using deep recurrent neural networks (RNNs). The deep RNN-based controllers are then trained based on the derived closed-form gradient of the risk-sensitive episodic return. It is proved that the gradient update algorithm converges to the same locally optimal parameters as the deep RNN-based centralized and distributed controllers. Simulation results show that the error between the policies of the optimal and the RNN-based controllers is less than 1.5%. Moreover, the variance of the achievable rates resulting from the deep RNN-based controllers is 60% less than the variance of the risk-averse baseline.

see all

Series: IEEE transactions on communications
ISSN: 0090-6778
ISSN-E: 1558-0857
ISSN-L: 0090-6778
Volume: 69
Issue: 11
Pages: 7444 - 7457
DOI: 10.1109/TCOMM.2021.3106686
Type of Publication: A1 Journal article – refereed
Field of Science: 213 Electronic, automation and communications engineering, electronics
Funding: This research was supported by the U.S. National Science Foundation under Grants CNS-1836802 and CNS-2030215.
Copyright information: © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.