Fixed broadband beamformers using small-size microphone arrays are known to be highly sensitive to errors in the microphone array characteristics. The paper describes two design procedures for designing broadband beamformers with an arbitrary spatial directivity pattern, which are robust against gain and phase errors in the microphone array characteristics. The first design procedure optimizes the mean performance of the broadband beamformer and requires knowledge of the gain and the phase probability density functions, whereas the second design procedure optimizes the worst-case performance by using a minimax criterion. Simulations with a small-size microphone array show the performance improvement that can be obtained by using a robust broadband beamformer design procedure.

/pdf/design-of-broadband-beamformers-robust-against-gain-and-fyls8fzgt0.pdf

Design of broadband beamformers robust against gain and phase errors in the microphone array characteristics

A directional acoustic receiving system is constructed in the form of a necklace including an array of two or more microphones mounted on a housing supported on the chest of a user by a conducting loop encircling the user's neck. Signal processing electronics contained in the same housing receives and combines the microphone signals in such a manner as to provide an amplified output signal which emphasizes sounds of interest arriving in a direction forward of the user. The amplified output signal drives the supporting conducting loop to produce a representative magnetic field. An electroacoustic transducer including a magnetic field pick-up coil for receiving the magnetic field is mounted in or on the user's ear and generates an acoustic signal representative of the sounds of interest. The microphone output signals are weighted (scaled) and combined to achieve desired spatial directivity responses. The weighting coefficients are determined by an optimization process. By bandpass filtering the weighted microphone signals with a set of filters covering the audio frequency range and summing the filtered signals, a receiving microphone array with a small aperture size is caused to have a directivity pattern that is essentially uniform over frequency in two or three dimensions. This method enables the design of highly-directive hearing instruments which are comfortable, inconspicuous, and convenient to use. The invention provides the user with a dramatic improvement in speech perception over existing hearing aid designs, particularly in the presence of background noise and reverberation.

A directional hearing system

Frequency-invariant beam patterns are often required by systems using an array of sensors to process broadband signals. If the spatial aperture is shorter than the involved wavelengths, using a superdirective beamforming is essential to get an efficient system. In this context, robustness of array imperfections is a crucial feature. In the literature, only a few approaches have been proposed to design a robust, superdirective, frequency-invariant beamformer based on filter-and-sum architecture; all of them achieve frequency-invariance by imposing a desired beam pattern. However, the choice of a suitable desired beam pattern is critical; an improper choice results in unsatisfactory performance. This paper proposes a new method of array synthesis that allows the design of a robust broadband beamformer with tunable tradeoff between frequency-invariance and directivity, without the need for imposing a desired beam pattern. The latter is defined as a set of variables that do not depend on frequency and are included in the vector of variables to be optimized. To this end, a suitable cost function has been devised whose minimum can be found in closed form. Therefore, the method is analytical and computationally inexpensive. In addition, a technique that allows obtaining a beam pattern with a linear phase over frequency is described. The results show the effectiveness of the proposed method in designing robust superdirective beam patterns for linear arrays receiving far-field signals, with special attention to microphone arrays of limited aperture.

Design of Robust Superdirective Arrays With a Tunable Tradeoff Between Directivity and Frequency-Invariance

Beamforming microphone arrays for speech acquisition in noisy environments

The cocktail party problem, i.e., tracing and recognizing the speech of a specific speaker when multiple speakers talk simultaneously, is one of the critical problems yet to be solved to enable the wide application of automatic speech recognition (ASR) systems. In this overview paper, we review the techniques proposed in the last two decades in attacking this problem. We focus our discussions on the speech separation problem given its central role in the cocktail party environment, and describe the conventional single-channel techniques such as computational auditory scene analysis (CASA), non-negative matrix factorization (NMF) and generative models, the conventional multi-channel techniques such as beamforming and multi-channel blind source separation, and the newly developed deep learning-based techniques, such as deep clustering (DPCL), the deep attractor network (DANet), and permutation invariant training (PIT). We also present techniques developed to improve ASR accuracy and speaker identification in the cocktail party environment. We argue effectively exploiting information in the microphone array, the acoustic training set, and the language itself using a more powerful model. Better optimization objective and techniques will be the approach to solving the cocktail party problem.

Past review, current progress, and challenges ahead on the cocktail party problem

An array of sensors can be used in conjunction with a beamformer, which processes the sensor signals, to achieve a directional response. The beamformer has to be designed such that a beam pattern with certain desired characteristics like specific main beam direction, defined main beam shape, and desired sidelobe level is formed. Conventional methods for the design of beamformers assume sensors with ideal features and do not take the disturbance of the sound field, caused by the mounting of the array, into account. Therefore the predicted theoretical polar response and the measured response often differ significantly. This paper presents a method for optimizing a beamformer for a one‐dimensional microphone array, taking into consideration nonideal features of the sensors and the mounting. Thus the actual polar response can be improved. By evaluating cross‐correlation functions of the sensor signals during a calibration procedure in an anechoic chamber and minimizing the mean squared error between the beamformer output and a prescribed response, optimum parameters for the beamformer are assigned.

Carsten Sydow

Papers

Broadband beamforming for a microphone array