Nico De Clercq Pieter Gijsenbergh. Problem Solutions Single-channel approach Multichannel...

20
Nico De Clercq Pieter Gijsenbergh

Transcript of Nico De Clercq Pieter Gijsenbergh. Problem Solutions Single-channel approach Multichannel...

Page 1: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Nico De Clercq Pieter Gijsenbergh

Page 2: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

ProblemSolutions

Single-channel approach Multichannel approach

Our assignment

Overview

Page 3: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Speech is a highly redundant signal: Normal people: noise not a big problem Hearing impaired: noise reduces

intelligibility

Noise = any unwanted signal that interferes with the desired signal

Assumption: additive, locally stationary noise

Problem

Page 4: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

ProblemSolutions

Single-channel approach Multichannel approach

Our assignment

Overview

Page 5: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Noise-cancelling microphonesVoice processor modifications

Preprocessor noise reduction Single-channel Multichannel

Solutions

Page 6: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Single-channel noise reductionOnly one device captures the

signal: Only spectral and temporal characteristics

Techniques: Wiener-filtering Spectral-subtracting Sine-wave modelling Directional microphones

Page 7: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Optimal adaptive filter to maximize SNR

Problem: noise and signal have to be known Solution: use short-term spectra

speech more or less constant

Difficult approach & internal noise issues

Single-channel: Wiener-filter

Page 8: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Principle Measure noise spectrum in non-speech

activity Take mean of measured amplitudes Subtract mean from input signal

Spectral error

Single-channel: spectral subtraction (1)

( ) ( ) ( )j j jX e S e N e jxj ej j jS e X e e e

xjj j je N e e e

Page 9: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Single-channel: spectral subtraction (2)

Modifications: magnitude averaging, half-wave rectification, residual noise reduction, …

Expected results: noise reduced, equal intelligibility

Explanation: non-stationary noise!

Page 10: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

ProblemSolutions

Single-channel approach Multichannel approach

Our assignment

Overview

Page 11: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Multiple sensors capture signal: Exploits spatial diversity of the noise

Noise and signal almost always differ in location

In hearing aids Noise microphone Speech + noise microphone Adaptive filtering

Multi-channel noise reduction

Page 12: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Constructive and deconstructive interference Controls phase (delay) & relative

amplitude (constraint)Fixed or adaptive

Multi-channel: Beamforming

Page 13: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Delay-sum beamformers Inputs are weighed (phase shift)

Filter-sum beamformers Amplitude & phase weights frequency

dependant

Multi-channel: Beamforming (1)

1

( ) ( ) ( )N

n nn

y f w f x f

1

1( ) ( )

N

n nn

y t x tN

Page 14: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Superdirective beamformers Maximize array gain, suppress noise

from other directions Near field superdirectivity for good low

frequency performance Amplitude + phase

Multi-channel: Beamforming (2)

Page 15: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Fixed beam former: Points to desired signal Mostly filter-sum beam formers used

Blocking Matrix (B): Separates desired signal from noise: rows add

up to 0 Maximum N-1 rows

Adaptive part: Minimizes the noise power in the output LMS, with frequency domain processing:

Multi-channel: Beamforming (3) Generalized Sidelobe Canceller

k kf fx ''( ) = B x '( ) ( )kf f f y f k+1 k ka ( ) a ( ) x ''( )

Page 16: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Multi-channel: Beamforming (4) Generalized Sidelobe Canceller

x´´

Page 17: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

ProblemSolutions

Single-channel approach Multichannel approach

Our assignment

Overview

Page 18: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Implement & test algorithmOur choice:

Generalized Sidelobe Canceller with LMS update

Frequency domain implementation of LMS

DSP II: overlap-add, adaptive filtering, time and frequency domain, multirate, …

Our assignment

Page 19: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Suppression of acoustic noise in speech using spectral subtraction, S. Boll, IEEE ASSP, vol 27, no 2, 1979

H. Levitt, "Noise reduction in hearing aids: An overview", Journal of Rehabilitation Research and Development, vol. 38, no. 1, Jan./Feb. 2001, pp. 111-121.

J.J Shynk, "Frequency-domain and multirate adaptive filtering " Signal Processing Magazine, IEEE, Volume 9, Issue 1, Jan 1992 Page(s):14 - 37.

I. A. McCowan, “Robust Speech Recognition using Microphone Arrays”, PhD Thesis, Queensland University of Technology, Australia, 2001.

G. O. Glentis, “Implementation of Adaptive Generalized Sidelobe Cancellers using efficient complex valuedarithmetic”, International Journal of Applied Mathemethics and Computer Science, vol. 13, no. 4, 2003, p. 549-566

https://gilbert.med.kuleuven.be/~koen/demo_beam/demo_beam.html http://www.rp-photonics.com/interference.html

Reference

Page 20: Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.

Questions

?