Intelligent Interactive Beam Training for Millimeter Wave Communications

Millimeter wave communications, equipped with large-scale antenna arrays, are able to provide Gbps data by exploring abundant spectrum resources. However, the use of a large number of antennas along with narrow beams causes a large overhead in obtaining channel state information (CSI) via beam training, especially for fast-changing channels. To reduce beam training overhead, in this paper we develop an interactive learning design paradigm (ILDP) that makes full use of domain knowledge of wireless communications (WCs) and adaptive learning ability of machine learning (ML). Specifically, the ILDP is fulfilled via deep reinforcement learning (DRL), which yields DRL-ILDP, and consists of communication model (CM) module and adaptive learning (AL) module, which work in an interactive manner. Then, we exploit the DRL-ILDP to design efficient beam training algorithms for both multi-user and user-centric cooperative communications. The proposed DRL-ILDP based algorithms enjoy three folds of advantages. Firstly, ILDP takes full advantages of the existing WC models and methods. Secondly, ILDP integrates powerful ML elements, which facilitates extracting interested statistical and probabilistic information from environments. Thirdly, via the interaction between the CM and AL modules, the algorithms are able to collect samples and extract information in real-time and sufficiently adapt to the ever-changing environments. Simulation results demonstrate the effectiveness and superiority of the designed algorithms.