Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

Intelligent reflecting surface (IRS) is a revolutionary and transformative technology for achieving spectrum and energy efficient wireless communication cost-effectively in the future. Specifically, an IRS consists of a large number of low-cost passive elements each being able to reflect the incident signal independently with an adjustable phase shift so as to collaboratively achieve three-dimensional (3D) passive beamforming without the need of any transmit radio-frequency (RF) chains. In this paper, we study an IRS-aided single-cell wireless system where one IRS is deployed to assist in the communications between a multi-antenna access point (AP) and multiple single-antenna users. We formulate and solve new problems to minimize the total transmit power at the AP by jointly optimizing the transmit beamforming by active antenna array at the AP and reflect beamforming by passive phase shifters at the IRS, subject to users’ individual signal-to-interference-plus-noise ratio (SINR) constraints. Moreover, we analyze the asymptotic performance of IRS’s passive beamforming with infinitely large number of reflecting elements and compare it to that of the traditional active beamforming/relaying. Simulation results demonstrate that an IRS-aided MIMO system can achieve the same rate performance as a benchmark massive MIMO system without using IRS, but with significantly reduced active antennas/RF chains. We also draw useful insights into optimally deploying IRS in future wireless systems.

Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming

It is shown that, particularly for terrestrial cellular telephony, the interference-suppression feature of CDMA (code division multiple access) can result in a many-fold increase in capacity over analog and even over competing digital techniques. A single-cell system, such as a hubbed satellite network, is addressed, and the basic expression for capacity is developed. The corresponding expressions for a multiple-cell system are derived. and the distribution on the number of users supportable per cell is determined. It is concluded that properly augmented and power-controlled multiple-cell CDMA promises a quantum increase in current cellular capacity. >

On the capacity of a cellular CDMA system

The adoption of a reconfigurable intelligent surface (RIS) for downlink multi-user communication from a multi-antenna base station is investigated in this paper. We develop energy-efficient designs for both the transmit power allocation and the phase shifts of the surface reflecting elements subject to individual link budget guarantees for the mobile users. This leads to non-convex design optimization problems for which to tackle we propose two computationally affordable approaches, capitalizing on alternating maximization, gradient descent search, and sequential fractional programming. Specifically, one algorithm employs gradient descent for obtaining the RIS phase coefficients, and fractional programming for optimal transmit power allocation. Instead, the second algorithm employs sequential fractional programming for the optimization of the RIS phase shifts. In addition, a realistic power consumption model for RIS-based systems is presented, and the performance of the proposed methods is analyzed in a realistic outdoor environment. In particular, our results show that the proposed RIS-based resource allocation methods are able to provide up to 300% higher energy efficiency in comparison with the use of regular multi-antenna amplify-and-forward relaying.

Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication

Matrix Differential Calculus with Applications in Statistics and Econometrics

Statistical conditional optimization criteria lead to the development of an iterative algorithm that starts from the matched filter (or constraint vector) and generates a sequence of filters that converges to the minimum-variance-distortionless-response (MVDR) solution for any positive definite input autocorrelation matrix. Computationally, the algorithm is a simple, noninvasive, recursive procedure that avoids any form of explicit autocorrelation matrix inversion, decomposition, or diagonalization. Theoretical analysis reveals basic properties of the algorithm and establishes formal convergence. When the input autocorrelation matrix is replaced by a conventional sample-average (positive definite) estimate, the algorithm effectively generates a sequence of MVDR filter estimators; the bias converges rapidly to zero and the covariance trace rises slowly and asymptotically to the covariance trace of the familiar sample-matrix-inversion (SMI) estimator. In fact, formal convergence of the estimator sequence to the SMI estimate is established. However, for short data records, it is the early, nonasymptotic elements of the generated sequence of estimators that offer favorable bias covariance balance and are seen to outperform in mean-square estimation error, constraint-LMS, RLS-type, orthogonal multistage decomposition, as well as plain and diagonally loaded SMI estimates. An illustrative interference suppression example is followed throughout this presentation.

An iterative algorithm for the computation of the MVDR filter

The radio frequency (RF) spectrum becomes overly crowded in some indoor environments due to the high density of users and bandwidth demands. To accommodate the tremendous wireless data demands, efficient spectrum-sharing approaches are highly desired. To this end, this paper introduces a new spectrum sharing solution for indoor environments based on the usage of a reconfigurable reflect-array in the middle of the wireless channel. By optimally controlling the phase shift of each element on the reflect-array, the useful signals for each transmission pair can be enhanced while the interferences can be canceled. As a result, multiple wireless users in the same room can access the same spectrum band at the same time without interfering each other. Hence, the network capacity can be dramatically increased. To prove the feasibility of the proposed solution, an experimental testbed is first developed and evaluated. Then, the effects of the reflect-array on transport capacity of the indoor wireless networks are investigated. Through experiments, theoretical deduction, and simulations, this paper demonstrates that significantly higher spectrum-spatial efficiency can be achieved by using the smart reflect-array without any modification of the hardware and software in the users' devices.

Increasing indoor spectrum sharing capacity using smart reflect-array

The Welch lower bound (see Welch, R.L., IEEE Trans. Inform. Theory, vol.IT-20, p.397-9, 1974) on the total squared correlation (TSC) of signature sets is known to be tight for real-valued signatures and loose for binary signatures whose number is not a multiple of four. We derive new bounds on the TSC of binary signature sets for any number of signatures K and any signature length L. Then, for almost all K, L in {1,2,...,256}, we design optimum binary signature sets that achieve the new bounds. The design procedure is based on simple transformations of Hadamard matrices.

New bounds on the total squared correlation and optimum design of DS-CDMA binary signature sets

Direct-sequence/code-division multiple-access (DS/CDMA) communication systems equipped with adaptive antenna arrays offer the opportunity for jointly effective spatial and temporal (code) multiple-access interference (MAI) and channel noise suppression. This work focuses on the development of fast joint space-time (S-T) adaptive optimization procedures that may keep up with the fluctuation rates of multipath fading channels. Along these lines, the familiar S-T RAKE processor is equipped with a single orthogonal S-T auxiliary vector (AV) selected under a maximum magnitude cross-correlation criterion. Then, blind joint spatial/temporal MAI and noise suppression with one complex S-T degree of freedom can be performed. This approach is readily extended to cover blind processing with multiple AVs and any desired number of complex degrees of freedom below the S-T product. A sequential procedure for conditional AV weight optimization is shown to lead to superior bit-error-rate (BER) performance when rapid system adaptation with limited input data is sought. Numerical studies for adaptive antenna array reception of multiuser multipath Rayleigh-faded DS/CDMA signals illustrate these theoretical developments. The studies show that the induced BER can be improved by orders of magnitude, while at the same time significantly lower computational optimization complexity is required in comparison with joint S-T minimum-variance distortionless response or equivalent minimum mean-square-error conventional filtering means.

http://www.ece.ualberta.ca/~hcdc/Library/StCommClass/PadBat99.pdf

Joint space-time auxiliary-vector filtering for DS/CDMA systems with antenna arrays

An algorithmic procedure is developed for the random expansion of a given training set to combat overfitting and improve the generalization ability of backpropagation trained multilayer perceptrons (MLPs). The training set is K-means clustered and locally most entropic colored Gaussian joint input-output probability density function estimates are formed per cluster. The number of clusters is chosen such that the resulting overall colored Gaussian mixture exhibits minimum differential entropy upon global cross-validated shaping. Numerical studies on real data and synthetic data examples drawn from the literature illustrate and support these theoretical developments.

Dimitris A. Pados

Papers

An iterative algorithm for the computation of the MVDR filter

Increasing indoor spectrum sharing capacity using smart reflect-array

New bounds on the total squared correlation and optimum design of DS-CDMA binary signature sets

Joint space-time auxiliary-vector filtering for DS/CDMA systems with antenna arrays

On overfitting, generalization, and randomly expanded training sets