We consider a sensor array located in an enclosure, where arbitrary transfer functions (TFs) relate the source signal and the sensors. The array is used for enhancing a signal contaminated by interference. Constrained minimum power adaptive beamforming, which has been suggested by Frost (1972) and, in particular, the generalized sidelobe canceler (GSC) version, which has been developed by Griffiths and Jim (1982), are the most widely used beamforming techniques. These methods rely on the assumption that the received signals are simple delayed versions of the source signal. The good interference suppression attained under this assumption is severely impaired in complicated acoustic environments, where arbitrary TFs may be encountered. In this paper, we consider the arbitrary TF case. We propose a GSC solution, which is adapted to the general TF case. We derive a suboptimal algorithm that can be implemented by estimating the TFs ratios, instead of estimating the TFs. The TF ratios are estimated by exploiting the nonstationarity characteristics of the desired signal. The algorithm is applied to the problem of speech enhancement in a reverberating room. The discussion is supported by an experimental study using speech and noise signals recorded in an actual room acoustics environment.

Signal enhancement using beamforming and nonstationarity with applications to speech

Speech enhancement and separation are core problems in audio signal processing, with commercial applications in devices as diverse as mobile phones, conference call systems, hands-free systems, or hearing aids. In addition, they are crucial preprocessing steps for noise-robust automatic speech and speaker recognition. Many devices now have two to eight microphones. The enhancement and separation capabilities offered by these multichannel interfaces are usually greater than those of single-channel interfaces. Research in speech enhancement and separation has followed two convergent paths, starting with microphone array processing and blind source separation, respectively. These communities are now strongly interrelated and routinely borrow ideas from each other. Yet, a comprehensive overview of the common foundations and the differences between these approaches is lacking at present. In this paper, we propose to fill this gap by analyzing a large number of established and recent techniques according to four transverse axes: 1 the acoustic impulse response model, 2 the spatial filter design criterion, 3 the parameter estimation algorithm, and 4 optional postfiltering. We conclude this overview paper by providing a list of software and data resources and by discussing perspectives and future trends in the field.

/pdf/a-consolidated-perspective-on-multimicrophone-speech-qnbaqxmtvq.pdf

A Consolidated Perspective on Multimicrophone Speech Enhancement and Source Separation

Summary A new monaural method for the suppression of late room reverberation from speech signals, based on spectral subtraction, is presented. The problem of reverberation suppression differs from classical speech de-noising in that the “reverberation noise” is non stationary. In this paper, the use of a novel estimator of the non-stationary reverberationnoise power spectrum, based on a statistical model of late reverberation, is presented. The algorithm is tested on real reverberated signals. The performances for different RIRs with ranging from 0.34 s to 1.7 s consistently show significant noise reduction with little signal distortion. Moreover, when used as a front end to an automatic speech recognition system, the algorithm brings about dramatic improvements in terms of automatic speech recognition scores in various reverberant environments.

/pdf/a-new-method-based-on-spectral-subtraction-for-speech-4g7r5a110d.pdf

A New Method Based on Spectral Subtraction for Speech Dereverberation

This paper introduces a novel technique for estimating the signal power spectral density to be used in the transfer function of a microphone array post-filter. The technique is a generalization of the existing Zelinski post-filter, which uses the auto- and cross-spectral densities of the array inputs to estimate the signal and noise spectral densities. The Zelinski technique, however, assumes zero cross-correlation between the noise on different sensors. This assumption is inaccurate, particularly at low frequencies and for arrays with closely spaced sensors, and thus the corresponding post-filter is suboptimal in realistic noise conditions. In this paper, a more general expression of the post-filter estimation is developed based on an assumed knowledge of the complex coherence of the noise field. This general expression can be used to construct a more appropriate post-filter in a variety of different noise fields. In experiments using real noise recordings from a computer office, the modified post-filter results in significant improvement in terms of objective speech quality measures and speech recognition performance using a diffuse noise model.

/pdf/microphone-array-post-filter-based-on-noise-field-coherence-8ygqcg54f0.pdf

Microphone array post-filter based on noise field coherence

In speech communication systems, such as voice-controlled systems, hands-free mobile telephones, and hearing aids, the received microphone signals are degraded by room reverberation, background noise, and other interferences This signal degradation may lead to total unintelligibility of the speech and decreases the performance of automatic speech recognition systems In the context of this work reverberation is the process of multi-path propagation of an acoustic sound from its source to one or more microphones The received microphone signal generally consists of a direct sound, reflections that arrive shortly after the direct sound (commonly called early reverberation), and reflections that arrive after the early reverberation (commonly called late reverberation) Reverberant speech can be described as sounding distant with noticeable echo and colouration These detrimental perceptual effects are primarily caused by late reverberation, and generally increase with increasing distance between the source and microphone Conversely, early reverberations tend to improve the intelligibility of speech In combination with the direct sound it is sometimes referred to as the early speech component Reduction of the detrimental effects of reflections is evidently of considerable practical importance, and is the focus of this dissertation More specifically the dissertation deals with dereverberation techniques, ie, signal processing techniques to reduce the detrimental effects of reflections In the dissertation, novel single- and multimicrophone speech dereverberation algorithms are developed that aim at the suppression of late reverberation, ie, at estimation of the early speech component This is done via so-called spectral enhancement techniques that require a specific measure of the late reverberant signal This measure, called spectral variance, can be estimated directly from the received (possibly noisy) reverberant signal(s) using a statistical reverberation model and a limited amount of a priori knowledge about the acoustic channel(s) between the source and the microphone(s) In our work an existing single-channel statistical reverberation model serves as a starting point The model is characterized by one parameter that depends on the acoustic characteristics of the environment We show that the spectral variance estimator that is based on this model, can only be used when the source-microphone distance is larger than the so-called critical distance This is, crudely speaking, the distance where the direct sound power is equal to the total reflective power A generalization of the statistical reverberation model in which the direct sound is incorporated is developed This model requires one additional parameter that is related to the ratio between the direct sound energy and the sound energy of all reflections The generalized model is used to derive a novel spectral variance estimator When the novel estimator is used for dereverberation rather than the existing estimator, and the source-microphone distance is smaller than the critical distance, the dereverberation performance is significantly increased Single-microphone systems only exploit the temporal and spectral diversity of the received signal Reverberation, of course, also induces spatial diversity To additionally exploit this diversity, multiple microphones must be used, and their outputs must be combined by a suitable spatial processor such as the so-called delay and sum beamformer It is not a priori evident whether spectral enhancement is best done before or after the spatial processor For this reason we investigate both possibilities, as well as a merge of the spatial processor and the spectral enhancement technique An advantage of the latter option is that the spectral variance estimator can be further improved Our experiments show that the use of multiple microphones affords a significant improvement of the perceptual speech quality The applicability of the theory developed in this dissertation is demonstrated using a hands-free communication system Since hands-free systems are often used in a noisy and reverberant environment, the received microphone signal does not only contain the desired signal but also interferences such as room reverberation that is caused by the desired source, background noise, and a far-end echo signal that results from a sound that is produced by the loudspeaker Usually an acoustic echo canceller is used to cancel the far-end echo Additionally a post-processor is used to suppress background noise and residual echo, ie, echo which could not be cancelled by the echo canceller In this work a novel structure and post-processor for an acoustic echo canceller are developed The post-processor suppresses late reverberation caused by the desired source, residual echo, and background noise The late reverberation and late residual echo are estimated using the generalized statistical reverberation model Experimental results convincingly demonstrate the benefits of the proposed system for suppressing late reverberation, residual echo and background noise The proposed structure and post-processor have a low computational complexity, a highly modular structure, can be seamlessly integrated into existing hands-free communication systems, and affords a significant increase of the listening comfort and speech intelligibility

/pdf/single-and-multi-microphone-speech-dereverberation-using-81pl8h93qv.pdf

Single- and multi-microphone speech dereverberation using spectral enhancement

In teleconferencing systems, the use of hands-free sound pick-up reduces speech quality. This is due to ambient noise, acoustic echo, and the reverberation produced by the acoustical environment. This paper sets out to present a theoretical analysis of noise reduction and dereverberation algorithms based on a microphone array combined with a Wiener postfilter. It is shown that the transfer function of the postfilter depends on the input signal-to-noise ratio (SNR) and on the noise reduction yielded by the array. The use of a directivity-controlled array instead of a conventional beam-former is proposed to improve the performance of the whole system. Examples in real room environments are provided, which confirm the theoretical results, It is observed that the postfilter gives a limited reduction of the reverberation. On the contrary, an appreciable reduction of acoustic echo and localized noise is obtained and makes the whole system highly attractive for hands-free communication systems.

Analysis of noise reduction and dereverberation techniques based on microphone arrays with postfiltering

The use of optimal postfiltering has been previously proposed to increase the performance of microphone arrays. In this paper, an analysis of the postfilter shows that its behaviour is closely related to the one of the array. This is illustrated by considering a typical videoconferencing context. The results we provide demonstrate that the use of a directivity controlled array is a requirement to ensure a sufficient robustness of the whole system. It is also shown that the dereverberation performed by the postfilter is limited and that its main interest lies in a significant reduction of the acoustic echo even in the double talk case. This attractive property depends on the whole design of the array including its placement versus the acoustic echo sources.

K. U. Simmer

Papers

Analysis of noise reduction and dereverberation techniques based on microphone arrays with postfiltering

Performance of adaptive dereverberation techniques using directivity controlled arrays