US20080015845A1 - Audio signal component compensation system - Google Patents

Audio signal component compensation system Download PDF

Info

Publication number
US20080015845A1
US20080015845A1 US11/776,432 US77643207A US2008015845A1 US 20080015845 A1 US20080015845 A1 US 20080015845A1 US 77643207 A US77643207 A US 77643207A US 2008015845 A1 US2008015845 A1 US 2008015845A1
Authority
US
United States
Prior art keywords
signal
audio signal
filter
whitened
sound signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/776,432
Inventor
Gerhard Schmidt
Tim Haulick
Harald Lenhardt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harman Becker Automotive Systems GmbH
Original Assignee
Harman Becker Automotive Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harman Becker Automotive Systems GmbH filed Critical Harman Becker Automotive Systems GmbH
Publication of US20080015845A1 publication Critical patent/US20080015845A1/en
Assigned to NUANCE COMMUNICATIONS, INC. reassignment NUANCE COMMUNICATIONS, INC. ASSET PURCHASE AGREEMENT Assignors: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
Priority to US13/368,092 priority Critical patent/US9111544B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L2021/02082Noise filtering the noise being echo, reverberation of the speech
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/13Acoustic transducers and sound field adaptation in vehicles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/02Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback

Definitions

  • This invention relates to a communication system. More particularly, the invention relates to a method and a system for compensation of audio signal components in a communication system, such as in a vehicle communication system.
  • communication systems are often incorporated in vehicles for different purposes.
  • speech recognition and voice commands of the driver for controlling predetermined electronic devices inside the vehicle.
  • telephone calls such as in a conference call, are possible with two or more passengers within the vehicle.
  • a person sitting on a front seat and a person sitting on one of the back seats may talk to a third person on the other end of the line using a hands-free communication system inside the vehicle.
  • the communication system inside the vehicle for the communication of the different vehicle passengers to each other,
  • the voice of one of the passengers may be detected using one or more microphones positioned in different locations in the vehicle.
  • the signal detected by the microphone can be processed and then output using the loudspeakers of an audio module that is normally located in the vehicle.
  • the signal emitted from the loudspeaker is normally also detected by the microphone.
  • the signals detected by the microphone have to be processed and such signal components have to be filtered out. Otherwise, undesirable feedback can occur in the system.
  • an echo compensation unit for compensating acoustic echoes by simulating the signal path from the loudspeaker to the microphone, should be able to simulate this signal path with a variable time delay.
  • a method with high computing power may be necessary for the echo compensation of audio signal components from a signal detected by a microphone.
  • the required computer power mainly depends on the length of the filter of the echo compensation units. Thus generally, the greater the length of the filter, the more computer power needed.
  • audio modules In addition to the communication signals output via the loudspeakers of the vehicle, audio modules reproducing audio signals, such as radio signals or signals from a music storage device such as a compact disc, are provided in the vehicles. These audio signals are output via the same loudspeakers, and they are also recorded by the microphones and again output via the loudspeaker. If these audio signal components are not attenuated before being output as part of the signal detected by the microphone, the driver has the impression of an audio sound signal having reverberation.
  • the above-described vehicle communication systems are often incorporated into expensive and highly sophisticated vehicles having highly sophisticated audio components.
  • the audio module When the audio module is used in connection with a vehicle communication system, the sound quality is deteriorated by the feedback of the audio signal components picked up by the microphone and again fed to the loudspeakers.
  • the audio signal may be disabled during the in-vehicle communication, or the audio signal components detected by the microphone may be filtered out in an effective way.
  • a filter may be used to simulate the audio signal components of a sound signal that has been emitted from the loudspeaker and then detected by the microphone.
  • the audio signal component may be, for example, an audio signal of a classical piece of music, a pop piece of music, or perhaps an interview without music.
  • the echo compensation may have to be carried out in a different way to be effective.
  • the audio signal components of the audio signal can have, in the case of a stereo signal for example, completely independent audio channels. In other situations, such as, for example, in the case of speaking interviews or one speaking person, the two audio signal parts of the stereo signal may be completely linear, depending on the signals.
  • the echo compensation for linearly dependent signals is a difficult task, as the adaptation algorithms for calculating filter coefficients generally do not have a well-defined solution.
  • the filters When the audio signal changes from a piece of music to a person speaking, it is desirable for the filters to be adapted to the new signal characteristics. This adaptation of the filter tales a certain amount of time and during this time unwanted echoes can occur.
  • echo compensation filters seek to simulate the path of the sound wave in the vehicle by calculating the pulse response.
  • the approximation step may not result in a non-ambiguous and definite answer.
  • the audio signal may be either a mono signal or a multi-channel signal, the different channels being completely linearly dependent from each other, a multi-channel stereo echo compensation filter may have the problem of finding the correct result.
  • the stereo echo compensation filter may not be able to accurately simulate the interior of the vehicle through which the sound passed before it is detected by the microphone in a correct way.
  • a need exists to effectively cope with the different situations that can occur in the compensation of audio signal components in an echo compensation unit, and generally for an improved system and method for compensation of audio signal components in a vehicle communication system.
  • a need further exists to reduce the length of filters while maintaining a length sufficient to allow the echo compensation unit to be able to simulate the signal path of a stereo signal or of a signal in a surround sound mode.
  • Yet a further need exists to effectively cope with the different situations that can occur in the compensation of audio signal components in an echo compensation unit.
  • the communication system may include (i) an audio unit for generating an audio signal, (ii) a microphone for receiving a sound signal, (iii) a loudspeaker for outputting the sound signal detected by the microphone and outputting the audio signal itself, (iv) an echo compensation unit for compensating the audio signal components of the sound signal, and (v) a filter for whitening the sound signal, the audio signal, or both signals.
  • sound signals which may also be referred to as “detected sound signals” refers to the signals detected by a microphone, including both audio signal components and speech signal components.
  • the system may further include at least two filters used in an alternating way for whitening the sound signal, the audio signal, or both signals.
  • the system may further include a sound signal having different audio channels, the time delay of the different audio channels relative to each other being adjustable.
  • a calculating unit may also be provided for calculating time-dependent filter coefficients. Additionally, a switch may be provided for switching the supply of the time-dependent filter coefficients to various audio signal filters. Furthermore, a second switch may also be provided to supply the simulated audio signal components to a subtracting unit, where the signal output from the echo compensation unit may be subtracted from the detected signal output. In addition, an inverse filter may be provided for removing the whitening of the whitened error signal resulting in the echo compensated sound signal, where this inverse filter may also be connected to the calculating unit.
  • a method for compensating audio signal components in a communication system is also provided.
  • a sound signal comprising audio signal components and speech signal components, is detected by a microphone.
  • the detected sound signal is then filtered in order to whiten the sound signal. After whitening the detected sound signal, the audio signal components in the sound signal are compensated. After compensation, the whitening of the compensated sound signal may be removed.
  • filter coefficients may be calculated and supplied to two audio filters in an alternating way, to be used for whitening of signals.
  • the calculated filter coefficients may be supplied to a first filter for a first set of N cycles, and the calculated filter coefficients may be supplied to the other filter for a next set of N cycles resulting in a renewal of the filter coefficients of each filter every 2N cycles (i.e., new filter coefficients for a given filter calculated every 2N cycles).
  • a system and method for compensating audio signal components in a communication system is provided using a mono echo compensation unit and a multi-channel (or stereo) echo compensation unit in combination.
  • the provided echo compensation system may comprise a mono echo compensation unit for receiving one channel of an audio signal, and a multi-channel compensation unit for receiving at least two channels of the audio signal.
  • the audio signal changes its characteristic (for example, from music to a person speaking)
  • either the mono echo compensation unit or the multi-channel echo compensation unit achieves the best echo compensation result. Accordingly, effective echo compensation can be achieved for any kind of audio signal.
  • an echo compensation system is provided that is able to suppress audio signal components of an audio source having a variable time delay.
  • the adaptation of the length of the variable time delay may be used alone, or in connection with other aspects or implementations of the invention. It is also possible that the variation of the length of the delay element may be used in combination with the time-dependent filter coefficients and/or in combination with the dual echo compensation structure of a mono echo compensation unit in combination with a multi-channel echo compensation unit, as described above.
  • FIG. 1 shows one example of an implementation of an in-vehicle communication system in which an echo compensation system may be used.
  • FIG. 2 shows one example of an implementation of a system used for compensating audio signal components in a communication system.
  • FIG. 3 shows a one example of an implementation of an echo compensation system in greater detail.
  • FIG. 4 is a flowchart illustrating a first example of an implementation of a method for compensating audio signal components in a communication system.
  • FIG. 5 shows in further detail a flowchart comprising the steps for using time-dependent filter coefficients for decorrelation.
  • FIG. 6 shows an example of an implementation of a dual echo compensation system in greater detail.
  • FIG. 7 is a flowchart illustrating another example of an implementation of a method for compensating audio signal components in a communication system.
  • FIG. 8 shows pulse responses of an audio signal in a stereo amplification mode and in a surround sound mode.
  • FIG. 9 shows an echo compensation system introducing a variable time delay during an echo compensation.
  • FIG. 10 shows the echo compensation system of FIG. 9 after changing the variable time delay of the echo compensation.
  • FIG. 1 shows one example of an implementation of an in-vehicle communication system in which an echo compensation system may be used.
  • Such an in-vehicle communication system may comprise a plurality of loudspeakers 11 via which audio signals from an audio source unit 15 are omitted.
  • the positions may include, without limitation, the position of the driver 12 a, the position of the front seat passenger 12 b, and two positions in the back 12 c and 12 d.
  • one or more microphones 13 a - d may be provided.
  • the microphones may include, without limitation, the following: a microphone 13 a for detecting the speech signal of a passenger in the driver position 12 a, a microphone 13 b for detecting the speech signal of the front passenger 12 b, a microphone 13 c for detecting the speech signal of the rear passenger behind the driver 12 c, and a microphone 13 d for detecting the speech signal of the rear passenger behind the front seat passenger 12 d, may be provided.
  • a microphone 13 a for detecting the speech signal of a passenger in the driver position 12 a a microphone 13 b for detecting the speech signal of the front passenger 12 b
  • a microphone 13 c for detecting the speech signal of the rear passenger behind the driver 12 c
  • a microphone 13 d for detecting the speech signal of the rear passenger behind the front seat passenger 12 d
  • these microphones 13 a - d may be positioned in other locations, or that more or fewer microphones may be used.
  • more than one microphone may be provided corresponding to a single passenger position.
  • signals received from the rear microphones 13 c - 13 d may be supplied to a first signal processing unit 16 used for controlling the signal processing of speech signals from the back seats 12 c - 12 d to the front seats 12 a - 12 b, and a signal processing unit 17 may receive signals from the front microphones 13 a - 13 b, and control the signal processing of speech signals from the front seats 12 a - 12 b to the back seats 12 c - 12 d.
  • the signal processing units 16 and 17 may determine through which loudspeakers 11 of the vehicle the signals detected by the microphones 13 a - 13 d will be output.
  • FIG. 2 shows one example of an implementation of a system used for compensating audio signal components in a communication system.
  • an audio source unit 15 represents the audio signal source of FIG. 1 having two different audio channels, a first channel x L (n) and a second channel x R (n). While in this example a dual-channel audio signal is shown, the system also applies to multiple channel audio signals having more than two channels.
  • the two audio signal channels (also referred to simply as audio signals) may then be transmitted to a filter unit 21 where they are either filtered in a time-variant manner or processed by a nonlinear characteristic to reduce the mutual correlation.
  • This filtering is done to whiten or decorrelate the audio signal components, as the echo compensation system may be more effective when it is carried out on a whitened audio signal.
  • a whitened signal generally indicates that the spectrum contains equal power per cycle, i.e., the signal has a flat spectrum that contains all different frequencies in equal amount.
  • the filtering for whitening the audio signal furthermore decorrelates the different channels of the audio signal.
  • the filter unit 21 is optional.
  • the filtered audio signal channels x L (n) and x R (n) are then transmitted to an audio amplifier 22 for amplifying the audio signals before they are emitted via the loudspeakers 11 .
  • the filtered audio signal channels are also supplied to an echo compensation unit 23 where the audio signal components of a detected sound signal (not shown) may be removed.
  • the audio signals emitted from the loudspeakers 11 propagate in the environment and may be diffracted different times before they are detected by one or more the microphones 13 .
  • the detected sound signal comprising audio signal components as emitted by the loudspeaker 11 and also comprising speech signal components (such as from one or more of the passengers) are then fed to a processing unit 24 where linear processing (beam forming etc.) of the detected sound signal can be done.
  • the output signals of the two units 23 and 24 are then fed to a subtracting unit 25 where the signal output from the echo compensation unit 23 , ⁇ circumflex over (d) ⁇ (n), is subtracted from the detected signal output from the processing unit 24 , d(n).
  • the subtraction results in an error signal as discussed further below.
  • the radio signal of the left audio channel x L (n) and of the right audio channel x R (n) of the example stereo signal are output via one or more loudspeakers 11 and reach the microphone(s) 13 after having passed the interior of the vehicle.
  • the audio signal component detected by the microphone(s) 13 comprises the direct audio signal as well as signal components diffracted, for example, by obstacles in the path of the sound signals. This signal transmission from the loudspeaker 11 output to the microphone 13 as illustrated in FIG.
  • h L ( n ) [ h L,0 ( n ), h L,1 ( n ), . . . , h L,L-1 ( n )] T (1)
  • h R ( n ) [ h R,0 ( n ), h R,1 ( n ), . . . , h R,L-1 ( n )] T (2)
  • the index n in equations (1) and (2) indicate the time dependence of the pulse responses.
  • the signal path from the loudspeaker 11 to the microphone 13 is simulated by filtering the audio signal in such a way that after filtering, the filtered audio signal corresponds substantially to the audio signal as it was detected by the microphone 13 .
  • the unwanted audio signal component can be removed from the sound signal by subtracting the simulated audio signal component from the detected sound signal.
  • the signal d(n) is either the signal from the microphone 13 or the signal of a linear time invariant processing.
  • a good compensation of the audio signal component can be achieved when the estimated pulse response corresponds to the actual pulse responses and when a sufficient number of coefficients are used.
  • the left and the right audio signal channels can have very different cross correlation characteristics.
  • C( ⁇ ) normally has values of C( ⁇ ) ⁇ 1.
  • the left and the right audio signals may be linearly dependent signals, meaning that the coherence is approximately 1.
  • the values S xLxR ( ⁇ ),S xLxL ( ⁇ ) and S xRxR ( ⁇ ) are called the cross power spectral density or auto power spectral density of the left and right audio signal channels x L (n) and x R (n).
  • the adaptation algorithm compensating the acoustic echoes may not have a non-ambiguous single solution.
  • FIG. 3 shows one implementation of an echo compensation system in greater detail.
  • the sound signal as detected by the microphone 13 comprising the audio signal component and the speech signal component is shown by y(n), and the audio signal itself (in this case, one channel of the audio signal) is represented by the signal x(n).
  • time-dependent decorrelation filter coefficients are used.
  • a calculation unit 31 is provided where the time-dependent filter decorrelation coefficients are calculated.
  • the system of FIG. 3 may also include one or more decorrelation filters 32 , 33 a, 33 b for whitening the different signal components.
  • a first decorrelation filter 32 may be provided for whitening the sound signal as detected by the microphone 13 .
  • decorrelation filters 33 a and 33 b may be provided for filtering the audio signal itself. With decorrelated signals, it is possible that the echo compensation can be carried out faster and in a more effective way.
  • the audio signal x(n) may be processed in predetermined time intervals, and for each time interval the filter coefficients may be calculated.
  • the filter coefficient of the first interval e.g., an audio signal of 100 ms, once calculated by the calculation unit 31 , may be supplied to the first filter 33 a through a switch 34 .
  • the switch 34 switches to the second filter 33 b, and the calculated filter coefficients calculated by calculation unit 31 are then transmitted to the other decorrelation filter 33 b.
  • the switch 34 switches every N cycles, N being the length of the echo compensation filters 35 a and 35 b.
  • the echo compensation filter 35 b may be used for the actual echo compensation.
  • the switch 34 changes its position and transmits the calculated filter coefficients to the filter 33 b.
  • the audio signals are filtered by the echo compensation filters 35 a, 35 b in such a way that the signal path in the vehicle is simulated.
  • the echo compensation filters 35 a, 35 b determine the pulse response between the loudspeaker and the microphone. This can be done by using gradient methods and using least mean square (LMS) algorithms or normalized least mean square algorithms (NLMS). These methods and algorithms are known in the art and will not be discussed in detail.
  • LMS least mean square
  • NLMS normalized least mean square algorithms
  • the output signal is then fed to another switch 36 , the switch 36 switching every N cycles, so that the filtered signals from echo compensation filter 35 a are transmitted to the subtracting unit 37 for N cycles, before the switch 36 is switched and the signal from the echo compensation filter 35 b is fed to the subtracting unit 37 for the next N cycles.
  • the two switches 34 and 36 change their respective states every N cycles, while at the same time each respectively maintaining a different actual state.
  • the switch 34 supplies data to the upper branch 33 a and 35 a
  • the switch 36 receives signal data from the lower branch 33 b and 35 b.
  • the signal parameters in the filters 33 a and 33 b are renewed every 2N cycles, where the signal parameters in the filter 32 are renewed every N cycle.
  • the output signal of filter 32 and the output signal of the echo compensation filters 35 a or 35 b are then used in the subtracting unit where the simulated signal from the respective echo compensation filter 35 a, 35 b is subtracted from the filtered sound signal as detected by the microphone 13 .
  • this whitened error signal ⁇ tilde over (e) ⁇ (n) is then used as a feedback control signal to adapt the audio signal echo compensation filters.
  • the whitened error signal ⁇ tilde over (e) ⁇ (n) is then transmitted to an inverse filter 38 for removing the decorrelation.
  • This inverse filter 38 also receives the calculated filter parameters every N cycles.
  • the resulting error signal e(n) output from the inverse filter 38 then corresponds to the signal that will be output through the loudspeakers of the communication system.
  • the audio signal component is removed or suppressed.
  • a changing audio signal source such as a change from a piece of music to a person speaking, can be detected within N cycles, and the decorrelation filters can follow this change in music also in N cycles.
  • the signal processing is shown for one channel of the audio signal x(n).
  • the echo compensation system may comprise a plurality of decorrelation filters for whitening the audio signal and the sound signal before the echo compensation, where one decorrelation filter is provided for each channel of the audio signal.
  • the channel shown in FIG. 3 may be the left channel of a stereo signal, and the right channel (x R (n)) of the stereo audio signal may utilize a second filter coefficient calculating unit having another two branches of filters.
  • the filtered audio signal for the right channel may then be combined with the filtered audio signal for the left channel before the combined signal is transmitted to the subtracting unit 37 .
  • the detected sound signal comprises all of the individual audio channels, each channel having been processed as shown in FIG. 3 , the different channels being combined before they are transmitted to the subtracting unit 37 .
  • FIG. 4 is a flowchart illustrating an example of an implementation of a method for compensating audio signal components in a communication system.
  • the method of FIG. 4 uses time-dependent filter coefficients.
  • the method starts at step 41 .
  • an audio signal from an audio source is output via the loudspeakers (step 42 ).
  • a microphone may be provided for detecting a sound signal in the vehicle (step 43 ).
  • the detected sound signal may comprise components of the audio signal output via the loudspeakers, as well as speech signal components corresponding to speech signals from one or more passengers.
  • the detected sound signal detected in step 43 generally comprises two different components—the audio signal component and a speech signal component.
  • the detected sound signal and the audio signal are whitened (step 44 ).
  • the acoustic echoes are compensated by compensating the audio signal components in the sound signal (step 45 ). This compensation may be carried out as explained in connection with FIG. 3 using time-dependent decorrelation filter coefficients and using alternating compensation units.
  • the whitening of the different signals is removed in step 46 resulting in an improved error signal and the method ends at step 47 .
  • FIG. 5 shows in further detail a flowchart comprising the steps for using time-dependent filter coefficients for decorrelation.
  • the alternating transmission of the filter coefficients for the decorrelation filter is described in greater detail with respect to FIG. 5 .
  • the whitening of the audio signal may be performed using at least two filters in all alternating way, each filter having time-dependent filter coefficients.
  • the actual characteristic of the audio signal may be taken into account. Accordingly, it is not necessary to use an average signal characteristic, as the filtering may be adapted to the actual audio signal.
  • the other filter when one filter is being used for filtering, the other filter may continue to receive the audio signal so that filter coefficients for this new part of the audio signal can be calculated.
  • the actual speed of the echo compensation filter compensating the audio signal components can be improved.
  • the use of two different filters in an alternating way may help to keep signal processing power low.
  • the audio signal from the audio signal source is first supplied to a calculation unit 31 where the time-dependent filter coefficients are calculated for the decorrelation filters every N cycles (step 51 ).
  • the filter coefficients are typically calculated based on the audio signal itself (step 51 ), the filter coefficients being renewed every N cycles, N being the length of the compensation filter.
  • the calculated filter parameters are calculated by calculation unit 31 (see FIG. 3 ) every 500 (“N”) cycles.
  • the filter coefficients calculated by the calculation unit 31 based, in this example, on the last 500 (N) cycles or input samples are transmitted to the first decorrelation filter 33 a (step 52 ), which will use and/or store this set of filter coefficients for 2N cycles.
  • the other echo compensation filter 35 b is being used (step 52 a ).
  • the calculated filter coefficients calculated for the next N cycles are calculated in step 53 and are then transmitted to the other decorrelation filter 33 b (step 54 ).
  • the first echo compensation filter 35 a is used (step 54 a ). In the method described with respect to FIG.
  • the audio signal for a given decorrelation filter may then be supplied to a switch 37 , the switch changing every N cycles from one echo compensation filter to the other from where the signal is transmitted to the subtracting unit where it is subtracted from the whitened sound signal.
  • the filter coefficients are supplied to the first decorrelation filter 33 a as shown in FIG. 3 (step 52 ), the filter coefficients calculated the N cycles before are used for decorrelation and for compensating the audio signal component in filter 33 b and 35 b.
  • the echo compensation filters 35 a and 35 b may each include a memory storage unit in which the signals which were decorrelated with old filter parameters may be stored.
  • the filter parameters of the decorrelation filters are changed, the decorrelation of the signal in the echo compensation filters may be removed, and then the signal may be decorrelated with the new filter parameters.
  • high computer power may be used to do the calculations. With the use of two different decorrelation filters and two different echo compensation filters which are used in an alternating way the amount of computer power required may be reduced.
  • FIG. 6 shows an example of an implementation of a dual echo compensation system in greater detail.
  • the dual echo compensation system of FIG. 6 uses two echo compensation units in combination—a mono echo compensation unit 62 and a multi-channel echo compensation unit 63 .
  • mono echo compensation and multi-channel or “stereo” echo compensation are carried out at the same time, and the compensation achieving the more desirable results is used.
  • the signal y(n) in this example represents the sound signal detected by the microphones 13 comprising the audio signal component and the speech signal component.
  • the detected sound signal is supplied to a decorrelation filter 61 for whitening the detected sound signal.
  • echo compensation of a stereo signal is shown.
  • the stereo signal has a first audio channel x L (n) and the second audio channel x R (n). These two signals are supplied to decorrelation filters 61 for whitening the audio signal as was discussed in connection with FIG. 3 .
  • the whitened left audio signal is then input into a mono echo compensation unit 62 and to a stereo echo compensation unit 63 .
  • the mono echo compensation unit 62 comprises an echo compensation unit 621 where the audio signal component of the sound signal as detected by the microphone is simulated.
  • the simulated audio signal is then input into a subtracting unit 622 where it is subtracted from the whitened sound signal resulting in a whitened mono error signal ⁇ tilde over (e) ⁇ M (n).
  • the left audio channel is, after passing the decorrelation filter 61 , also input into the stereo echo compensation unit 63 where it is fed to an echo compensation unit 631 where the signal path is simulated as in the other echo compensation unit 621 and as described in connection with FIGS. 1-5 .
  • the whitened audio channel is, after passing the decorrelation filter 61 , fed to a second signal compensation unit 632 .
  • the output signals of the two echo compensation units 631 and 632 are combined in the adder 635 before this combined signal is subtracted from the whitened sound signal in subtracting unit 634 .
  • the output signal of the subtracting unit 634 is a whitened stereo error signal ⁇ tilde over (e) ⁇ s (n).
  • the system of FIG. 6 now has two output error signals, a mono error signal ⁇ tilde over (e) ⁇ M (n) and a stereo error signal ⁇ tilde over (e) ⁇ s (n).
  • the mono echo compensation unit or the stereo echo compensation unit achieves a more desirable result in removing the audio signal component in the detected sound signal.
  • the mono echo compensation unit will generally achieve the more desirable compensation results.
  • the mono echo compensation is generally faster.
  • the stereo echo compensation unit will be able to compensate acoustic echoes.
  • a comparison unit 65 is provided having two inputs, one input being the output of the mono echo compensation unit ⁇ tilde over (e) ⁇ M (n), one input being the output of the stereo echo compensation unit ⁇ tilde over (e) ⁇ s (n).
  • Comparison unit 65 compares the signal power of the two error signals and selects the signal having the lower signal power as an output signal ⁇ tilde over (e) ⁇ (n).
  • This output signal ⁇ tilde over (e) ⁇ (n) of the comparison 65 unit is then transmitted to an inverse decorrelation filter unit 66 removing the whitening of the echo compensated signal.
  • the output error signal e(n) is then the signal that might be output by the loudspeakers in which the audio signal components were effectively removed.
  • the echo compensation unit shown in FIG. 6 can be single filters compensating the echo. However, it is also possible to combine the mono and the multi-channel echo compensation with the time-dependent filter coefficients described in connection with FIGS. 1-5 .
  • a filter coefficient calculating unit such as calculation unit 31 would be provided, and each of the echo compensation units 621 , 631 and 632 may be an echo compensation unit as shown in FIG. 3 comprising a switch for supplying the calculated decorrelation filter coefficients to one of the two branches of each echo compensation unit, another switch being provided for supplying the echo compensated signal to the subtracting unit.
  • the time-dependent filter coefficients would be combined with the mono and multi-channel echo compensation units.
  • FIG. 7 is a flowchart illustrating another example of an implementation of a method for compensating audio signal components in a communication system.
  • a mono echo compensation unit and a multiple channel echo compensation unit are used in combination.
  • the method of FIG. 7 starts at step 71 .
  • the audio signal is output via the loudspeaker in step 72 .
  • a sound signal is detected by the microphone, the sound signal having a speech signal component and an audio signal component.
  • the audio signal components may be removed in the detected sound signal, thus compensating any acoustic echoes.
  • the compensation may comprise two different components.
  • One channel of the audio signal may be supplied to a mono echo compensation unit in step 74 , and in step 75 two or more channels of the multi-channel audio signal are supplied to a multi-channel echo compensation unit.
  • the echo compensation is carried out, be it with time invariant decorrelation filter coefficients or be it in connection with time-dependent decorrelation filter coefficients as described in connection with FIGS. 1-5 .
  • the output of the mono echo compensation unit is compared to the output of the multi-channel echo compensation unit.
  • the signal output having the lower signal power is selected and used as an echo compensated output signal of the sound signal detected by the microphones 13 .
  • the method ends in step 78 .
  • a mono echo compensation unit may achieve more desirable results than a multi-channel stereo echo compensation unit.
  • the stereo echo compensation unit can compensate the audio signal components in the sound signal and therefore the acoustic echoes more effectively. As both filters in the example described with respect to FIGS. 6 and 7 are used in parallel, the compensation unit having the more desirable result is selected.
  • the use of two different compensation units may increase the speed of echo compensation, as the mono echo compensation unit finds a solution in the approximation method much faster than the multi-channel echo compensation unit.
  • the echo compensation may be adapted more quickly with a mono and multi-channel echo compensation unit operating in parallel, than it would be if only a multi-channel echo compensation unit were used.
  • the output from the echo compensation unit that would achieve the best echo compensation result may be selected.
  • echo compensation may be carried out for each channel of an audio signal in the multi-channel echo compensation unit, the echo compensated signals of each channel being added before the resulting signal is compared to the signal output of the mono echo compensation unit. Furthermore, before carrying out the echo compensation, a linear decorrelation can be carried out for whitening the audio signal as discussed above.
  • the audio signal is a stereo signal
  • two channels of the audio signal may be supplied to a multi-channel echo compensation unit, and one channel of the audio signal may be supplied to the mono echo compensation unit.
  • the echo compensation may be carried out by simulating the audio signal components of the sound signal as they are detected by the microphone 13 in the mono echo compensation unit and the multi echo compensation unit and by subtracting the mono and the multi-channel simulated audio signal components from the detected sound signal comprising both components. This subtraction results in a mono and a multi-channel error signal, the power of the mono error signal and the power of the multi-channel error signal being compared in order to select the signal having the lower signal power.
  • time-dependent filter coefficients can be used for whitening the sound signal and for whitening the audio signal as was discussed in connection with the first aspect of the invention.
  • the echoes may be compensated as discussed above in connection with the time-dependent filter coefficients, with two different filters being used in an alternating way as discussed above.
  • FIG. 8-10 illustrate a further aspect of one implementation of the invention.
  • FIG. 8 shows pulse responses of an audio signal in a stereo amplification mode and in a surround sound mode.
  • the upper graph 81 of FIG. 8 illustrates a pulse response of a stereo amplification mode
  • the lower part of FIG. 8 shows a graph 82 of a pulse response of an audio signal in a surround sound mode.
  • an additional time delay was introduced in the audio signal in the surround sound mode.
  • FIG. 9 shows part of an echo compensation system introducing a variable time delay during an echo compensation.
  • a loudspeaker of the system may output the audio signal and the sound signal received by the microphone or microphones.
  • an echo compensation unit may compensate acoustic echoes by simulating the audio signal components in the sound signal as they were detected by the microphone and by subtracting the simulated audio signal components from the detected sound signal.
  • the echo compensation unit may comprise a filter for filtering the audio signal to obtain the pulse response of the audio signal.
  • a delay element introducing a variable time delay into the audio signal before filtering may be provided, a delay control unit being provided controlling the delay element in such a way that the maximum of the pulse response is located within a predetermined range of filter coefficients of the filter.
  • the delay element introducing a variable time delay into the audio signal before filtering allows keeping the length of the filter simulating the audio signal component as received by the microphone 13 , at a constant length.
  • the variable time delay introduced by the amplifier in the different reproduction modes is introduced by the delay element. Thus, it is not necessary to provide a length of the filter that would be able to simulate a maximum time delay introduced by the amplifier. This helps to keep the computation time comparatively low.
  • the delay element comprises a delay element 92 of variable length, the delay element of variable length being connected to a signal memory 93 of the filter filtering the audio signal, the signal memory 93 of the filter having a constant length.
  • the delay element 92 of variable length it is possible to simulate the different time delays introduced by the amplifier of the audio signal.
  • the signal memory 93 of the filter compensating the acoustic echoes can be of a relatively short length.
  • the length of the delay element 92 is selected in such a way that the maximum of the pulse response calculated by the filter is located within a predetermined range of filter coefficients.
  • graph 91 shows an example view of an audio signal.
  • the echo compensation filter comprises a delay element 92 receiving an audio signal or excitation signal 91 .
  • the delay element 92 is of variable length.
  • the delay element 92 introduces a variable delay before the audio signal is transmitted to a signal memory 93 of the echo compensation filter.
  • a memory 94 for storing the filter coefficients of the adaptive filter is provided.
  • different entries of the signal memory 93 are multiplied with the filter coefficients and the different terms are added in an adder 96 , resulting in an output signal of the adapted filter.
  • Graph 95 shows the pulse response calculated by the filter. As can be seen by the indicated pulse response in graph 95 , the maximum of the pulse response is located at a filter coefficient having a relatively large number.
  • This pulse response was calculated based on the predetermined length of the delay memory.
  • the part 91 a of the audio signal 91 is shown, which is comprised in the delay element 92 .
  • the other part 91 b of the audio signal 91 is comprised in the signal memory 93 of the filter.
  • a pulse response is calculated as shown by graph 95 having a maximum 95 a, which is located at a filter coefficient having a relatively large number.
  • the pulse response When it is detected that the maximum 95 a of the pulse response is not located at a predetermined filter coefficient, the pulse response is shifted as shown in FIG. 10 .
  • the pulse response By shifting the pulse response as shown by graph 105 , so that the maximum 105 a is located at a predetermined position of the filter coefficients, the non-existing parts of the pulse response can be filled with zeroes as shown by the part 105 b of the graph 105 .
  • the length of the delay element 92 is also adjusted.
  • the length of the delay element 92 is increased, so that a larger part 91 c of the audio signal is now comprised in the delay element 92 , where only a smaller part of the audio signal 91 d is now comprised in the signal memory 93 of the filter.
  • the new parts of the audio signal generated by the increasing length of the delay element 92 can be filled with zeros as represented by part 91 e of the graph shown in FIG. 10 .
  • the length of the delay element 92 can be controlled in such a way that the maximum of the pulse response is located at a filter coefficient which has a number around 30. It should be understood that any other number can be selected. However, the number of the filter coefficient at which the maximum of the pulse response is to be located may be selected in such a way that this filter coefficient is positioned at the beginning of the filter length. If the number is selected to be too small, the system may not be able to precisely detect whether the determined maximum of the pulse response is actually the maximum or whether the maximum is not represented in the filter coefficients. By way of example, if it is detected that the maximum of the pulse response is located within the first ten filter coefficients, it can be followed that the time delay introduced by the delay element is larger than desired. Accordingly, the length of the delay element 92 may be shortened and the impulse response may be shifted, i.e. the filter coefficients in the coefficient memory 94 may be shifted. Again, the added parts generated by the shifting are filled with zeroes.
  • the direct sound as it is simulated by the echo compensation filter is situated at a predetermined filter coefficient of the filter.
  • the maximum of the pulse response can be arranged at a filter coefficient which is between one tenth and one twentieth of the maximum filter coefficient.
  • the filter compensating the acoustic echoes has a length of 500 coefficients.
  • the delay element may be controlled in such a way that the maximum of the pulse response in the calculated pulse response is positioned between the 20th and the 40th filter coefficient, preferably between the 25th and 35th filter coefficient, even preferably between the 28th and the 32nd filter coefficient.
  • the coefficient representing the direct sound can be found by searching for the maximum of a weighted modulus of the pulse response.
  • the parameter ⁇ is chosen to be between 0 and 1.
  • reflections of the sound signal may be attenuated relative to the direct sound.
  • the maximum of the pulse response in the simulated signal path in the echo compensation filter is found to be at a much larger filter coefficient, this means that the simulated time delay may be smaller than desired. In this case, a further time delay may be introduced. If, however, it is determined that the maximum of the pulse response is located at a filter coefficient having a number which is smaller than the number of the predetermined range, it can be followed that the simulated time delay may be larger than desired. In this case, the delay introduced by the delay element may be made shorter.
  • the calculating power can be used to adapt the length of the delay element by calculating the position of the maximum of the pulse response, by verifying whether this position is within a predetermined range and if not, by shifting the pulse response and by adapting the length of the delay element accordingly.

Abstract

A system compensating audio signal components in a communication system is disclosed, the method comprising the steps of detecting, by a microphone, a sound signal, the sound signal comprising audio signal components resulting from reproducing an audio signal of an audio source, the sound signal further comprising speech signal components corresponding to a speech signal from a person, filtering the sound signal to whiten the sound signal, compensating the audio signal components in the whitened sound signal, and removing the whitening of the compensated sound signal, where the filtering of the audio signal is performed using at least two filters in an alternating way, each filter using time-dependent filter coefficients.

Description

    RELATED APPLICATIONS
  • This application claims priority to European Patent Application Serial No. 06 014 366.6, filed on Jul. 11, 2006, titled METHOD FOR COMPENSATION OF AUDIO SIGNAL COMPONENTS IN A VEHICLE COMMUNICATION SYSTEM AND SYSTEM THEREFOR, the application of which is incorporated by reference in its entirety in this application.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • This invention relates to a communication system. More particularly, the invention relates to a method and a system for compensation of audio signal components in a communication system, such as in a vehicle communication system.
  • 2. Related Art
  • The use of various types of communication systems has been proliferating over the last few years. For example, communication systems are often incorporated in vehicles for different purposes. For example, it is possible to use speech recognition and voice commands of the driver for controlling predetermined electronic devices inside the vehicle. Additionally, telephone calls, such as in a conference call, are possible with two or more passengers within the vehicle. For example, a person sitting on a front seat and a person sitting on one of the back seats may talk to a third person on the other end of the line using a hands-free communication system inside the vehicle. Moreover, it is possible to use the communication system inside the vehicle for the communication of the different vehicle passengers to each other,
  • In vehicle communication systems, it may be difficult to hear speech audibly and clearly due to noise, other sounds in the vehicle or attenuation of the speech sound waves. Accordingly, the voice of one of the passengers may be detected using one or more microphones positioned in different locations in the vehicle. The signal detected by the microphone can be processed and then output using the loudspeakers of an audio module that is normally located in the vehicle. The signal emitted from the loudspeaker, however, is normally also detected by the microphone. To avoid acoustic feedback or other undesirable effects, the signals detected by the microphone have to be processed and such signal components have to be filtered out. Otherwise, undesirable feedback can occur in the system.
  • In vehicle audio systems, it has become possible to select different modes for reproducing an audio signal. By way of example, state of the art audio systems provide the possibility to either reproduce the sound in a stereo mode or in a surround sound mode. In the surround sound mode, additional time delays may be introduced in the different audio channels of the audio signal, so that the person sitting inside the vehicle has the impression of a surround sound audio system. When this audio system having a variable time delay in the different audio channels is used in connection with a vehicle communication system, the audio signal component emitted from the loudspeakers and then detected by the microphone should be removed to avoid unwanted echoes. In a surround sound mode, the signal amplifier introduces an additional time delay into the audio channel and the audio signal component detected by the microphone is delayed by the time delay introduced by the amplifier. Accordingly, an echo compensation unit for compensating acoustic echoes, by simulating the signal path from the loudspeaker to the microphone, should be able to simulate this signal path with a variable time delay. For the echo compensation of audio signal components from a signal detected by a microphone, a method with high computing power may be necessary. The required computer power mainly depends on the length of the filter of the echo compensation units. Thus generally, the greater the length of the filter, the more computer power needed.
  • Furthermore, it is possible that several microphones may be used for one seat to detect the speech signal of a passenger. Negative feedback can be avoided when adaptive filters are used for filtering out echoes and feedback signal components of the signals.
  • In addition to the communication signals output via the loudspeakers of the vehicle, audio modules reproducing audio signals, such as radio signals or signals from a music storage device such as a compact disc, are provided in the vehicles. These audio signals are output via the same loudspeakers, and they are also recorded by the microphones and again output via the loudspeaker. If these audio signal components are not attenuated before being output as part of the signal detected by the microphone, the driver has the impression of an audio sound signal having reverberation.
  • The above-described vehicle communication systems are often incorporated into expensive and highly sophisticated vehicles having highly sophisticated audio components. When the audio module is used in connection with a vehicle communication system, the sound quality is deteriorated by the feedback of the audio signal components picked up by the microphone and again fed to the loudspeakers. To avoid this signal quality degradation, the audio signal may be disabled during the in-vehicle communication, or the audio signal components detected by the microphone may be filtered out in an effective way.
  • For compensation of audio signal components in a sound signal (also referred to as “echo compensation”), a filter may be used to simulate the audio signal components of a sound signal that has been emitted from the loudspeaker and then detected by the microphone. However, the audio signal component may be, for example, an audio signal of a classical piece of music, a pop piece of music, or perhaps an interview without music. For all these different kinds of music, the echo compensation may have to be carried out in a different way to be effective. The audio signal components of the audio signal can have, in the case of a stereo signal for example, completely independent audio channels. In other situations, such as, for example, in the case of speaking interviews or one speaking person, the two audio signal parts of the stereo signal may be completely linear, depending on the signals. The echo compensation for linearly dependent signals is a difficult task, as the adaptation algorithms for calculating filter coefficients generally do not have a well-defined solution. When the audio signal changes from a piece of music to a person speaking, it is desirable for the filters to be adapted to the new signal characteristics. This adaptation of the filter tales a certain amount of time and during this time unwanted echoes can occur.
  • Moreover, echo compensation filters seek to simulate the path of the sound wave in the vehicle by calculating the pulse response. The approximation step may not result in a non-ambiguous and definite answer. Particularly in cases where the audio signal may be either a mono signal or a multi-channel signal, the different channels being completely linearly dependent from each other, a multi-channel stereo echo compensation filter may have the problem of finding the correct result. In other words, the stereo echo compensation filter may not be able to accurately simulate the interior of the vehicle through which the sound passed before it is detected by the microphone in a correct way.
  • Accordingly, a need exists to effectively cope with the different situations that can occur in the compensation of audio signal components in an echo compensation unit, and generally for an improved system and method for compensation of audio signal components in a vehicle communication system. A need further exists to reduce the length of filters while maintaining a length sufficient to allow the echo compensation unit to be able to simulate the signal path of a stereo signal or of a signal in a surround sound mode. Yet a further need exists to effectively cope with the different situations that can occur in the compensation of audio signal components in an echo compensation unit.
  • SUMMARY
  • An echo compensation system for compensating audio signal components in a communication system is provided. The communication system may include (i) an audio unit for generating an audio signal, (ii) a microphone for receiving a sound signal, (iii) a loudspeaker for outputting the sound signal detected by the microphone and outputting the audio signal itself, (iv) an echo compensation unit for compensating the audio signal components of the sound signal, and (v) a filter for whitening the sound signal, the audio signal, or both signals. Applicants note that the term “sound signals” (which may also be referred to as “detected sound signals”) refers to the signals detected by a microphone, including both audio signal components and speech signal components. The system may further include at least two filters used in an alternating way for whitening the sound signal, the audio signal, or both signals. The system may further include a sound signal having different audio channels, the time delay of the different audio channels relative to each other being adjustable.
  • A calculating unit may also be provided for calculating time-dependent filter coefficients. Additionally, a switch may be provided for switching the supply of the time-dependent filter coefficients to various audio signal filters. Furthermore, a second switch may also be provided to supply the simulated audio signal components to a subtracting unit, where the signal output from the echo compensation unit may be subtracted from the detected signal output. In addition, an inverse filter may be provided for removing the whitening of the whitened error signal resulting in the echo compensated sound signal, where this inverse filter may also be connected to the calculating unit.
  • A method for compensating audio signal components in a communication system is also provided. According to one implementation, a sound signal, comprising audio signal components and speech signal components, is detected by a microphone. The detected sound signal is then filtered in order to whiten the sound signal. After whitening the detected sound signal, the audio signal components in the sound signal are compensated. After compensation, the whitening of the compensated sound signal may be removed.
  • According to another implementation, filter coefficients may be calculated and supplied to two audio filters in an alternating way, to be used for whitening of signals. In such an implementation, the calculated filter coefficients may be supplied to a first filter for a first set of N cycles, and the calculated filter coefficients may be supplied to the other filter for a next set of N cycles resulting in a renewal of the filter coefficients of each filter every 2N cycles (i.e., new filter coefficients for a given filter calculated every 2N cycles).
  • According to another implementation of the invention, a system and method for compensating audio signal components in a communication system is provided using a mono echo compensation unit and a multi-channel (or stereo) echo compensation unit in combination. The provided echo compensation system may comprise a mono echo compensation unit for receiving one channel of an audio signal, and a multi-channel compensation unit for receiving at least two channels of the audio signal. When the audio signal changes its characteristic (for example, from music to a person speaking), either the mono echo compensation unit or the multi-channel echo compensation unit achieves the best echo compensation result. Accordingly, effective echo compensation can be achieved for any kind of audio signal.
  • According to yet another implementation, an echo compensation system is provided that is able to suppress audio signal components of an audio source having a variable time delay. In one implementation, the adaptation of the length of the variable time delay may be used alone, or in connection with other aspects or implementations of the invention. It is also possible that the variation of the length of the delay element may be used in combination with the time-dependent filter coefficients and/or in combination with the dual echo compensation structure of a mono echo compensation unit in combination with a multi-channel echo compensation unit, as described above.
  • These and other objects, features and advantages of the present invention, as well as other devices, apparatuses, systems, methods, features and advantages of the invention, will be or will become apparent to one with skill in the art upon examination of the following figures and detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the accompanying claims.
  • BRIEF DESCRIPTION OF THE FIGURES
  • The invention may be better understood by referring to the figures described below. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. In the figures, like reference numerals designate corresponding parts throughout the different views.
  • FIG. 1 shows one example of an implementation of an in-vehicle communication system in which an echo compensation system may be used.
  • FIG. 2 shows one example of an implementation of a system used for compensating audio signal components in a communication system.
  • FIG. 3 shows a one example of an implementation of an echo compensation system in greater detail.
  • FIG. 4 is a flowchart illustrating a first example of an implementation of a method for compensating audio signal components in a communication system.
  • FIG. 5 shows in further detail a flowchart comprising the steps for using time-dependent filter coefficients for decorrelation.
  • FIG. 6 shows an example of an implementation of a dual echo compensation system in greater detail.
  • FIG. 7 is a flowchart illustrating another example of an implementation of a method for compensating audio signal components in a communication system.
  • FIG. 8 shows pulse responses of an audio signal in a stereo amplification mode and in a surround sound mode.
  • FIG. 9 shows an echo compensation system introducing a variable time delay during an echo compensation.
  • FIG. 10 shows the echo compensation system of FIG. 9 after changing the variable time delay of the echo compensation.
  • DETAILED DESCRIPTION
  • While the present invention may be used in various types of communication systems, the invention will be described below with specific reference to an in-vehicle communication system as an example application of the invention.
  • FIG. 1 shows one example of an implementation of an in-vehicle communication system in which an echo compensation system may be used. Such an in-vehicle communication system may comprise a plurality of loudspeakers 11 via which audio signals from an audio source unit 15 are omitted. In the vehicle, different passenger positions are possible. For example, the positions may include, without limitation, the position of the driver 12 a, the position of the front seat passenger 12 b, and two positions in the back 12 c and 12 d. When one of the passengers in the front 12 a, 12 b wants to communicate with one of the passengers sitting in the back 12 c, 12 d, or if two passengers, one in the front and one in the back, are communicating with a third person in a telecommunication system, one or more microphones 13 a-d may be provided. For example, the microphones (or a ray or set of microphones) may include, without limitation, the following: a microphone 13 a for detecting the speech signal of a passenger in the driver position 12 a, a microphone 13 b for detecting the speech signal of the front passenger 12 b, a microphone 13 c for detecting the speech signal of the rear passenger behind the driver 12 c, and a microphone 13 d for detecting the speech signal of the rear passenger behind the front seat passenger 12 d, may be provided. One of skill in the art would understand that these microphones 13 a-d may be positioned in other locations, or that more or fewer microphones may be used. For example, more than one microphone may be provided corresponding to a single passenger position.
  • When more than two microphones are used for one vehicle seat, a beam forming for the different vehicle seat positions can be done. In the example implementation illustrated in FIG. 1, signals received from the rear microphones 13 c-13 d may be supplied to a first signal processing unit 16 used for controlling the signal processing of speech signals from the back seats 12 c-12 d to the front seats 12 a-12 b, and a signal processing unit 17 may receive signals from the front microphones 13 a-13 b, and control the signal processing of speech signals from the front seats 12 a-12 b to the back seats 12 c-12 d. In one implementation, the signal processing units 16 and 17 may determine through which loudspeakers 11 of the vehicle the signals detected by the microphones 13 a-13 d will be output.
  • FIG. 2 shows one example of an implementation of a system used for compensating audio signal components in a communication system. In FIG. 2, an audio source unit 15 represents the audio signal source of FIG. 1 having two different audio channels, a first channel x L(n) and a second channel x R(n). While in this example a dual-channel audio signal is shown, the system also applies to multiple channel audio signals having more than two channels. The two audio signal channels (also referred to simply as audio signals) may then be transmitted to a filter unit 21 where they are either filtered in a time-variant manner or processed by a nonlinear characteristic to reduce the mutual correlation. This filtering is done to whiten or decorrelate the audio signal components, as the echo compensation system may be more effective when it is carried out on a whitened audio signal. A whitened signal generally indicates that the spectrum contains equal power per cycle, i.e., the signal has a flat spectrum that contains all different frequencies in equal amount. The filtering for whitening the audio signal furthermore decorrelates the different channels of the audio signal. One of skill in the art would understand that the filter unit 21 is optional.
  • The filtered audio signal channels xL(n) and xR(n) are then transmitted to an audio amplifier 22 for amplifying the audio signals before they are emitted via the loudspeakers 11. The filtered audio signal channels are also supplied to an echo compensation unit 23 where the audio signal components of a detected sound signal (not shown) may be removed. The audio signals emitted from the loudspeakers 11 propagate in the environment and may be diffracted different times before they are detected by one or more the microphones 13. The detected sound signal, comprising audio signal components as emitted by the loudspeaker 11 and also comprising speech signal components (such as from one or more of the passengers) are then fed to a processing unit 24 where linear processing (beam forming etc.) of the detected sound signal can be done. The output signals of the two units 23 and 24 are then fed to a subtracting unit 25 where the signal output from the echo compensation unit 23, {circumflex over (d)}(n), is subtracted from the detected signal output from the processing unit 24, d(n). The subtraction results in an error signal as discussed further below. The better the echo compensation can simulate the signal path from the loudspeakers 11 to the microphone 13, the smaller is the error signal e(n).
  • In the following, an example of the compensation of audio signal components according to the implementation illustrated in FIG. 2 will be discussed in more detail. The explanation is done on the basis of a stereo signal source. However, the following explanation is also valid for an audio signal having multiple channels, such as five channels for a DVD. The radio signal of the left audio channel xL(n) and of the right audio channel xR(n) of the example stereo signal are output via one or more loudspeakers 11 and reach the microphone(s) 13 after having passed the interior of the vehicle. The audio signal component detected by the microphone(s) 13 comprises the direct audio signal as well as signal components diffracted, for example, by obstacles in the path of the sound signals. This signal transmission from the loudspeaker 11 output to the microphone 13 as illustrated in FIG. 2 can be described with finite pulse responses:
    h L(n)=[h L,0(n),h L,1(n), . . . , h L,L-1(n)]T   (1)
    h R(n)=[h R,0(n),h R,1(n), . . . , h R,L-1(n)]T   (2)
  • The index n in equations (1) and (2) indicate the time dependence of the pulse responses. In one example, the signal path from the loudspeaker 11 to the microphone 13 is simulated by filtering the audio signal in such a way that after filtering, the filtered audio signal corresponds substantially to the audio signal as it was detected by the microphone 13. In this case, the unwanted audio signal component can be removed from the sound signal by subtracting the simulated audio signal component from the detected sound signal.
  • For compensating the acoustic echoes, one or more adaptive filters having the following pulse responses can be used:
    ĥ L(n)=[ĥ L,0(n),ĥ L,1(n), . . . , ĥ L,N-1(n)]T   (3)
    ĥ R(n)=[ĥ R,0(n),ĥ R,1(n), . . . , ĥ R,N-1(n)]T   (4)
  • Normally, digital filters are used having a large number of filter coefficients, e.g. 300-500 coefficients. The audio signal components as received by the microphones 13 can then be removed by subtracting the simulated signal component from the detected sound signal. The resulting signal is called an error signal e(n) and is defined as follows: e ( n ) = d ( n ) - i = 0 N - 1 h ^ L , i ( n ) x L ( n - i ) - i = 0 N - 1 h ^ R , i ( n ) x R ( n - i ) . ( 5 )
  • The signal d(n) is either the signal from the microphone 13 or the signal of a linear time invariant processing. A good compensation of the audio signal component can be achieved when the estimated pulse response corresponds to the actual pulse responses and when a sufficient number of coefficients are used. In echo compensation systems, the left and the right audio signal channels can have very different cross correlation characteristics. When music is reproduced as an audio sound signal, the square of the modulus of the coherence may be defined as: C ( Ω ) = S XLXR ( Ω ) S XLXL ( Ω ) S XRXR ( Ω ) 2 ( 6 )
  • C(Ω) normally has values of C(Ω)<1. When reproducing a news signal or other signal comprising one speaker, the left and the right audio signals may be linearly dependent signals, meaning that the coherence is approximately 1. In the above-shown equation (6) the values SxLxR(Ω),SxLxL(Ω) and SxRxR(Ω) are called the cross power spectral density or auto power spectral density of the left and right audio signal channels xL(n) and xR(n). When one of the audio signal components is an audio component that depends linearly on the other component, the adaptation algorithm compensating the acoustic echoes may not have a non-ambiguous single solution.
  • FIG. 3 shows one implementation of an echo compensation system in greater detail. In FIG. 3, the sound signal as detected by the microphone 13 comprising the audio signal component and the speech signal component is shown by y(n), and the audio signal itself (in this case, one channel of the audio signal) is represented by the signal x(n). In the example shown in FIG. 3, time-dependent decorrelation filter coefficients are used. For calculating the time-dependent decorrelation filter coefficients, a calculation unit 31 is provided where the time-dependent filter decorrelation coefficients are calculated. The system of FIG. 3 may also include one or more decorrelation filters 32, 33 a, 33 b for whitening the different signal components. A first decorrelation filter 32 may be provided for whitening the sound signal as detected by the microphone 13. In addition, decorrelation filters 33 a and 33 b may be provided for filtering the audio signal itself. With decorrelated signals, it is possible that the echo compensation can be carried out faster and in a more effective way.
  • In the example illustrated in FIG. 3, the audio signal x(n) may be processed in predetermined time intervals, and for each time interval the filter coefficients may be calculated. The filter coefficient of the first interval, e.g., an audio signal of 100 ms, once calculated by the calculation unit 31, may be supplied to the first filter 33 a through a switch 34. When the first filter 33 a has received a predetermined amount of input samples (e.g., 500 samples), the switch 34 switches to the second filter 33 b, and the calculated filter coefficients calculated by calculation unit 31 are then transmitted to the other decorrelation filter 33 b. The switch 34 switches every N cycles, N being the length of the echo compensation filters 35 a and 35 b. During the time the filter coefficients are supplied to the first decorrelation filter 33 a, the echo compensation filter 35 b may be used for the actual echo compensation. When the input samples for the echo compensation filter 35 a have been completely renewed, the switch 34 changes its position and transmits the calculated filter coefficients to the filter 33 b.
  • The audio signals are filtered by the echo compensation filters 35 a, 35 b in such a way that the signal path in the vehicle is simulated. The echo compensation filters 35 a, 35 b determine the pulse response between the loudspeaker and the microphone. This can be done by using gradient methods and using least mean square (LMS) algorithms or normalized least mean square algorithms (NLMS). These methods and algorithms are known in the art and will not be discussed in detail.
  • When the acoustic path of the vehicle is simulated in the echo compensation filters 35 a and 35 b, the output signal is then fed to another switch 36, the switch 36 switching every N cycles, so that the filtered signals from echo compensation filter 35 a are transmitted to the subtracting unit 37 for N cycles, before the switch 36 is switched and the signal from the echo compensation filter 35 b is fed to the subtracting unit 37 for the next N cycles.
  • In the foregoing example, the two switches 34 and 36 change their respective states every N cycles, while at the same time each respectively maintaining a different actual state. Thus, when the switch 34 supplies data to the upper branch 33 a and 35 a, the switch 36 receives signal data from the lower branch 33 b and 35 b. In this example, the signal parameters in the filters 33 a and 33 b are renewed every 2N cycles, where the signal parameters in the filter 32 are renewed every N cycle. The output signal of filter 32 and the output signal of the echo compensation filters 35 a or 35 b are then used in the subtracting unit where the simulated signal from the respective echo compensation filter 35 a, 35 b is subtracted from the filtered sound signal as detected by the microphone 13. The result is a whitened error signal {tilde over (e)}(n). As it is known in adaptive filter systems, this whitened error signal {tilde over (e)}(n) is then used as a feedback control signal to adapt the audio signal echo compensation filters. The whitened error signal {tilde over (e)}(n) is then transmitted to an inverse filter 38 for removing the decorrelation. This inverse filter 38 also receives the calculated filter parameters every N cycles. The resulting error signal e(n) output from the inverse filter 38 then corresponds to the signal that will be output through the loudspeakers of the communication system. In this error signal e(n), the audio signal component is removed or suppressed. With the system shown in FIG. 3, a changing audio signal source, such as a change from a piece of music to a person speaking, can be detected within N cycles, and the decorrelation filters can follow this change in music also in N cycles.
  • In the example shown in FIG. 3, the signal processing is shown for one channel of the audio signal x(n). It should be understood that this structure of the two filter branches together with the two switches can be applied for each audio channel or certain selected audio channels. Thus, the echo compensation system may comprise a plurality of decorrelation filters for whitening the audio signal and the sound signal before the echo compensation, where one decorrelation filter is provided for each channel of the audio signal. By way of example, as explained above, the channel shown in FIG. 3 may be the left channel of a stereo signal, and the right channel (xR(n)) of the stereo audio signal may utilize a second filter coefficient calculating unit having another two branches of filters. In this example, the filtered audio signal for the right channel may then be combined with the filtered audio signal for the left channel before the combined signal is transmitted to the subtracting unit 37. In the subtracting unit, the detected sound signal comprises all of the individual audio channels, each channel having been processed as shown in FIG. 3, the different channels being combined before they are transmitted to the subtracting unit 37.
  • FIG. 4 is a flowchart illustrating an example of an implementation of a method for compensating audio signal components in a communication system. The method of FIG. 4 uses time-dependent filter coefficients. The method starts at step 41. First, an audio signal from an audio source is output via the loudspeakers (step 42). When an in-vehicle communication system is used, a microphone may be provided for detecting a sound signal in the vehicle (step 43). The detected sound signal may comprise components of the audio signal output via the loudspeakers, as well as speech signal components corresponding to speech signals from one or more passengers. Thus, the detected sound signal detected in step 43 generally comprises two different components—the audio signal component and a speech signal component. Next, the detected sound signal and the audio signal are whitened (step 44).
  • After whitening 44 (also referred to as decorrelating, since the whitening of a signal decorrelates the different channels of the signal), the acoustic echoes are compensated by compensating the audio signal components in the sound signal (step 45). This compensation may be carried out as explained in connection with FIG. 3 using time-dependent decorrelation filter coefficients and using alternating compensation units. Next, the whitening of the different signals is removed in step 46 resulting in an improved error signal and the method ends at step 47.
  • FIG. 5 shows in further detail a flowchart comprising the steps for using time-dependent filter coefficients for decorrelation. In particular, the alternating transmission of the filter coefficients for the decorrelation filter is described in greater detail with respect to FIG. 5. As previously explained, according to this aspect of the invention, the whitening of the audio signal may be performed using at least two filters in all alternating way, each filter having time-dependent filter coefficients. When time-dependent filter coefficients are used, the actual characteristic of the audio signal may be taken into account. Accordingly, it is not necessary to use an average signal characteristic, as the filtering may be adapted to the actual audio signal. In this method, when one filter is being used for filtering, the other filter may continue to receive the audio signal so that filter coefficients for this new part of the audio signal can be calculated. With the use of time-dependent filter coefficients, the actual speed of the echo compensation filter compensating the audio signal components can be improved. Furthermore, the use of two different filters in an alternating way may help to keep signal processing power low.
  • As illustrated in FIG. 5, the audio signal from the audio signal source is first supplied to a calculation unit 31 where the time-dependent filter coefficients are calculated for the decorrelation filters every N cycles (step 51). The filter coefficients are typically calculated based on the audio signal itself (step 51), the filter coefficients being renewed every N cycles, N being the length of the compensation filter. By way of example, the length of the echo compensation filter may be chosen in such a way that it comprises 500 filter coefficients (i.e. N=500). Accordingly, in step 51, according to this example, the calculated filter parameters are calculated by calculation unit 31 (see FIG. 3) every 500 (“N”) cycles.
  • Next, the filter coefficients calculated by the calculation unit 31 based, in this example, on the last 500 (N) cycles or input samples are transmitted to the first decorrelation filter 33 a (step 52), which will use and/or store this set of filter coefficients for 2N cycles. During the time the filter coefficients are being calculated for the decorrelation filter 33 a (i.e., the first N cycles), the other echo compensation filter 35 b is being used (step 52 a). The calculated filter coefficients calculated for the next N cycles are calculated in step 53 and are then transmitted to the other decorrelation filter 33 b (step 54). For this next N cycles during which new filter coefficients are being calculated, the first echo compensation filter 35 a is used (step 54 a). In the method described with respect to FIG. 5, the audio signal for a given decorrelation filter, once whitened or decorrelated, may then be supplied to a switch 37, the switch changing every N cycles from one echo compensation filter to the other from where the signal is transmitted to the subtracting unit where it is subtracted from the whitened sound signal.
  • When the filter coefficients are supplied to the first decorrelation filter 33 a as shown in FIG. 3 (step 52), the filter coefficients calculated the N cycles before are used for decorrelation and for compensating the audio signal component in filter 33 b and 35 b. The echo compensation filters 35 a and 35 b may each include a memory storage unit in which the signals which were decorrelated with old filter parameters may be stored. When the filter parameters of the decorrelation filters are changed, the decorrelation of the signal in the echo compensation filters may be removed, and then the signal may be decorrelated with the new filter parameters. For this kind of filtering, high computer power may be used to do the calculations. With the use of two different decorrelation filters and two different echo compensation filters which are used in an alternating way the amount of computer power required may be reduced.
  • FIG. 6 shows an example of an implementation of a dual echo compensation system in greater detail. The dual echo compensation system of FIG. 6 uses two echo compensation units in combination—a mono echo compensation unit 62 and a multi-channel echo compensation unit 63. Generally, in the example of FIG. 6, mono echo compensation and multi-channel or “stereo” echo compensation are carried out at the same time, and the compensation achieving the more desirable results is used. Again, the signal y(n) in this example represents the sound signal detected by the microphones 13 comprising the audio signal component and the speech signal component. The detected sound signal is supplied to a decorrelation filter 61 for whitening the detected sound signal.
  • In the example of FIG. 6, echo compensation of a stereo signal is shown. The stereo signal has a first audio channel xL(n) and the second audio channel xR(n). These two signals are supplied to decorrelation filters 61 for whitening the audio signal as was discussed in connection with FIG. 3. The whitened left audio signal is then input into a mono echo compensation unit 62 and to a stereo echo compensation unit 63. The mono echo compensation unit 62 comprises an echo compensation unit 621 where the audio signal component of the sound signal as detected by the microphone is simulated. The simulated audio signal is then input into a subtracting unit 622 where it is subtracted from the whitened sound signal resulting in a whitened mono error signal {tilde over (e)}M(n). The left audio channel is, after passing the decorrelation filter 61, also input into the stereo echo compensation unit 63 where it is fed to an echo compensation unit 631 where the signal path is simulated as in the other echo compensation unit 621 and as described in connection with FIGS. 1-5. Additionally, the whitened audio channel is, after passing the decorrelation filter 61, fed to a second signal compensation unit 632. The output signals of the two echo compensation units 631 and 632 are combined in the adder 635 before this combined signal is subtracted from the whitened sound signal in subtracting unit 634. The output signal of the subtracting unit 634 is a whitened stereo error signal {tilde over (e)}s(n).
  • The system of FIG. 6 now has two output error signals, a mono error signal {tilde over (e)}M(n) and a stereo error signal {tilde over (e)}s(n). Depending on the actual composition of the audio signal, either the mono echo compensation unit or the stereo echo compensation unit achieves a more desirable result in removing the audio signal component in the detected sound signal. When the audio signal is a mono signal or a linearly dependent stereo signal, the mono echo compensation unit will generally achieve the more desirable compensation results. Additionally, the mono echo compensation is generally faster. When the audio signal is a stereo signal having non-linearly dependent signal components, the stereo echo compensation unit will be able to compensate acoustic echoes. In order to compare the two signals, a comparison unit 65 is provided having two inputs, one input being the output of the mono echo compensation unit {tilde over (e)}M(n), one input being the output of the stereo echo compensation unit {tilde over (e)}s(n). Comparison unit 65 compares the signal power of the two error signals and selects the signal having the lower signal power as an output signal {tilde over (e)}(n). This output signal {tilde over (e)}(n) of the comparison 65 unit is then transmitted to an inverse decorrelation filter unit 66 removing the whitening of the echo compensated signal. The output error signal e(n) is then the signal that might be output by the loudspeakers in which the audio signal components were effectively removed.
  • The echo compensation unit shown in FIG. 6 can be single filters compensating the echo. However, it is also possible to combine the mono and the multi-channel echo compensation with the time-dependent filter coefficients described in connection with FIGS. 1-5. This means that for each audio channel, a filter coefficient calculating unit such as calculation unit 31 would be provided, and each of the echo compensation units 621, 631 and 632 may be an echo compensation unit as shown in FIG. 3 comprising a switch for supplying the calculated decorrelation filter coefficients to one of the two branches of each echo compensation unit, another switch being provided for supplying the echo compensated signal to the subtracting unit. In this implementation of the invention, the time-dependent filter coefficients would be combined with the mono and multi-channel echo compensation units.
  • FIG. 7 is a flowchart illustrating another example of an implementation of a method for compensating audio signal components in a communication system. According to the method of FIG. 7, a mono echo compensation unit and a multiple channel echo compensation unit are used in combination. The method of FIG. 7 starts at step 71. According to this method, the audio signal is output via the loudspeaker in step 72. In step 73 a sound signal is detected by the microphone, the sound signal having a speech signal component and an audio signal component. In one example, the audio signal components may be removed in the detected sound signal, thus compensating any acoustic echoes. According to this example, the compensation may comprise two different components. One channel of the audio signal may be supplied to a mono echo compensation unit in step 74, and in step 75 two or more channels of the multi-channel audio signal are supplied to a multi-channel echo compensation unit. In both echo compensation units, the echo compensation is carried out, be it with time invariant decorrelation filter coefficients or be it in connection with time-dependent decorrelation filter coefficients as described in connection with FIGS. 1-5. In the next step 76, the output of the mono echo compensation unit is compared to the output of the multi-channel echo compensation unit. In step 77, the signal output having the lower signal power is selected and used as an echo compensated output signal of the sound signal detected by the microphones 13. The method ends in step 78.
  • When a mono audio signal or a multi-channel (stereo) audio signal having two linearly dependent signal channels is emitted through the loudspeakers, a mono echo compensation unit may achieve more desirable results than a multi-channel stereo echo compensation unit. When the sound signal has non-linearly depending signal channels, the stereo echo compensation unit can compensate the audio signal components in the sound signal and therefore the acoustic echoes more effectively. As both filters in the example described with respect to FIGS. 6 and 7 are used in parallel, the compensation unit having the more desirable result is selected. Thus, by using two different echo compensation units, a non-linear processing of the audio signals before the acoustic echoes are removed is not necessary, and the non-linear decorrelation of the audio signals as a further step may be omitted. Moreover, this use of two different echo compensation units may improve signal quality.
  • Furthermore, in the case of a linearly dependent stereo signal or a mono signal, (e.g., an interview or other speech-only audio signal), the use of two different compensation units may increase the speed of echo compensation, as the mono echo compensation unit finds a solution in the approximation method much faster than the multi-channel echo compensation unit. Further, when the audio signal changes, for example, from a piece of music to a person speaking, the echo compensation may be adapted more quickly with a mono and multi-channel echo compensation unit operating in parallel, than it would be if only a multi-channel echo compensation unit were used. Moreover, the output from the echo compensation unit that would achieve the best echo compensation result (e.g., the mono echo compensation unit or the multi-channel echo compensation unit) may be selected.
  • In accordance with the system described with respect to FIGS. 6 and 7, echo compensation may be carried out for each channel of an audio signal in the multi-channel echo compensation unit, the echo compensated signals of each channel being added before the resulting signal is compared to the signal output of the mono echo compensation unit. Furthermore, before carrying out the echo compensation, a linear decorrelation can be carried out for whitening the audio signal as discussed above. When the audio signal is a stereo signal, two channels of the audio signal may be supplied to a multi-channel echo compensation unit, and one channel of the audio signal may be supplied to the mono echo compensation unit. Furthermore, the echo compensation may be carried out by simulating the audio signal components of the sound signal as they are detected by the microphone 13 in the mono echo compensation unit and the multi echo compensation unit and by subtracting the mono and the multi-channel simulated audio signal components from the detected sound signal comprising both components. This subtraction results in a mono and a multi-channel error signal, the power of the mono error signal and the power of the multi-channel error signal being compared in order to select the signal having the lower signal power. In order to improve the echo compensation time-dependent filter coefficients can be used for whitening the sound signal and for whitening the audio signal as was discussed in connection with the first aspect of the invention. Alternatively, the echoes may be compensated as discussed above in connection with the time-dependent filter coefficients, with two different filters being used in an alternating way as discussed above.
  • FIG. 8-10 illustrate a further aspect of one implementation of the invention. FIG. 8 shows pulse responses of an audio signal in a stereo amplification mode and in a surround sound mode. Specifically, the upper graph 81 of FIG. 8 illustrates a pulse response of a stereo amplification mode, and the lower part of FIG. 8 shows a graph 82 of a pulse response of an audio signal in a surround sound mode. As can be seen by the comparison of the two graphs 81 and 82, an additional time delay was introduced in the audio signal in the surround sound mode.
  • FIG. 9 shows part of an echo compensation system introducing a variable time delay during an echo compensation. In the implementation of FIG. 9, a loudspeaker of the system may output the audio signal and the sound signal received by the microphone or microphones. In general, as previously explained, an echo compensation unit may compensate acoustic echoes by simulating the audio signal components in the sound signal as they were detected by the microphone and by subtracting the simulated audio signal components from the detected sound signal. Also as previously explained, the echo compensation unit may comprise a filter for filtering the audio signal to obtain the pulse response of the audio signal. In addition to the filter, a delay element introducing a variable time delay into the audio signal before filtering may be provided, a delay control unit being provided controlling the delay element in such a way that the maximum of the pulse response is located within a predetermined range of filter coefficients of the filter. The delay element introducing a variable time delay into the audio signal before filtering allows keeping the length of the filter simulating the audio signal component as received by the microphone 13, at a constant length. The variable time delay introduced by the amplifier in the different reproduction modes is introduced by the delay element. Thus, it is not necessary to provide a length of the filter that would be able to simulate a maximum time delay introduced by the amplifier. This helps to keep the computation time comparatively low.
  • According to one implementation of the invention, the delay element comprises a delay element 92 of variable length, the delay element of variable length being connected to a signal memory 93 of the filter filtering the audio signal, the signal memory 93 of the filter having a constant length. With the delay element 92 of variable length it is possible to simulate the different time delays introduced by the amplifier of the audio signal. At the same time the signal memory 93 of the filter compensating the acoustic echoes can be of a relatively short length. In one example, the length of the delay element 92 is selected in such a way that the maximum of the pulse response calculated by the filter is located within a predetermined range of filter coefficients.
  • FIG. 9 will now be described in greater detail. In the upper part of FIG. 9, graph 91 shows an example view of an audio signal. The echo compensation filter comprises a delay element 92 receiving an audio signal or excitation signal 91. As previously stated, and as will be discussed further below, the delay element 92 is of variable length. The delay element 92 introduces a variable delay before the audio signal is transmitted to a signal memory 93 of the echo compensation filter. Additionally, a memory 94 for storing the filter coefficients of the adaptive filter is provided. As it is known to those skilled in the art, different entries of the signal memory 93 are multiplied with the filter coefficients and the different terms are added in an adder 96, resulting in an output signal of the adapted filter. Graph 95 shows the pulse response calculated by the filter. As can be seen by the indicated pulse response in graph 95, the maximum of the pulse response is located at a filter coefficient having a relatively large number.
  • At the beginning the filter coefficients are 0. This pulse response was calculated based on the predetermined length of the delay memory. Above, the part 91 a of the audio signal 91 is shown, which is comprised in the delay element 92. The other part 91 b of the audio signal 91 is comprised in the signal memory 93 of the filter. With the length of the delay element 92 shown in FIG. 9, a pulse response is calculated as shown by graph 95 having a maximum 95 a, which is located at a filter coefficient having a relatively large number. When the pulse response 95 is interpreted, one can deduce from the position of the maximum of the pulse response that the time delay introduced by the delay memory was shorter than desired.
  • When it is detected that the maximum 95 a of the pulse response is not located at a predetermined filter coefficient, the pulse response is shifted as shown in FIG. 10. By shifting the pulse response as shown by graph 105, so that the maximum 105 a is located at a predetermined position of the filter coefficients, the non-existing parts of the pulse response can be filled with zeroes as shown by the part 105 b of the graph 105. In addition to the pulse response, the length of the delay element 92 is also adjusted. In the example, shown the length of the delay element 92 is increased, so that a larger part 91 c of the audio signal is now comprised in the delay element 92, where only a smaller part of the audio signal 91 d is now comprised in the signal memory 93 of the filter. The new parts of the audio signal generated by the increasing length of the delay element 92 can be filled with zeros as represented by part 91 e of the graph shown in FIG. 10. When comparing the length of the respective delay elements 92 of FIGS. 9 and 10, it can be deduced that by varying the length of the delay element 92, time delays introduced in the different audio modes of an audio system can be simulated in an echo compensation unit. According to one implementation of the invention, the length of the delay element 92 can be controlled in such a way that the maximum of the pulse response is located at a filter coefficient which has a number around 30. It should be understood that any other number can be selected. However, the number of the filter coefficient at which the maximum of the pulse response is to be located may be selected in such a way that this filter coefficient is positioned at the beginning of the filter length. If the number is selected to be too small, the system may not be able to precisely detect whether the determined maximum of the pulse response is actually the maximum or whether the maximum is not represented in the filter coefficients. By way of example, if it is detected that the maximum of the pulse response is located within the first ten filter coefficients, it can be followed that the time delay introduced by the delay element is larger than desired. Accordingly, the length of the delay element 92 may be shortened and the impulse response may be shifted, i.e. the filter coefficients in the coefficient memory 94 may be shifted. Again, the added parts generated by the shifting are filled with zeroes.
  • This means that the direct sound as it is simulated by the echo compensation filter is situated at a predetermined filter coefficient of the filter. By way of example, the maximum of the pulse response can be arranged at a filter coefficient which is between one tenth and one twentieth of the maximum filter coefficient. By way of example, it is supposed that the filter compensating the acoustic echoes has a length of 500 coefficients. In this example the delay element may be controlled in such a way that the maximum of the pulse response in the calculated pulse response is positioned between the 20th and the 40th filter coefficient, preferably between the 25th and 35th filter coefficient, even preferably between the 28th and the 32nd filter coefficient.
  • Preferably, the maximum of the pulse response can be calculated by the following equation:
    i D(n)=arg max(|h i(n)|γi).   (7)
  • As can be seen by equation (7), the coefficient representing the direct sound can be found by searching for the maximum of a weighted modulus of the pulse response. Preferably, the parameter γ is chosen to be between 0 and 1. By introducing this parameter γ, reflections of the sound signal may be attenuated relative to the direct sound. When the maximum of the pulse response in the simulated signal path in the echo compensation filter is found to be at a much larger filter coefficient, this means that the simulated time delay may be smaller than desired. In this case, a further time delay may be introduced. If, however, it is determined that the maximum of the pulse response is located at a filter coefficient having a number which is smaller than the number of the predetermined range, it can be followed that the simulated time delay may be larger than desired. In this case, the delay introduced by the delay element may be made shorter.
  • It should be understood that the implementations described in connection with FIGS. 9 and 10 can be combined with one of the implementations described in connection with FIGS. 1-5 and 6-7. It is also possible to combine all three aspects of the invention, meaning that the time-dependent decorrelation filter coefficients may be used in combination with the mono and multiple echo compensation units. Additionally, the echo compensation can be further improved by adjusting the time delay as described in FIGS. 9 and 10. By way of example, when time-dependent decorrelation filter coefficients are used, the calculation of the time-dependent filter coefficients can be stopped from time to time. When the calculation of the filter coefficients is stopped, the calculating power can be used to adapt the length of the delay element by calculating the position of the maximum of the pulse response, by verifying whether this position is within a predetermined range and if not, by shifting the pulse response and by adapting the length of the delay element accordingly.
  • Although the invention has been shown and described with respect to example implementations thereof, it should be understood by those skilled in the art that the description is example rather than limiting in nature, and that many changes, additions and omissions are all possible without departing from the scope and spirit of the present invention, which should be determined from the following claims.

Claims (54)

1. A method for compensating an audio signal in a communication system comprising the steps of:
detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal and a speech signal component;
filtering the sound signal in order to create a whitened sound signal;
filtering the audio signal component in order to create a whitened audio signal component, where the step of filtering the audio signal component is performed using at least two filters in an alternating way, each filter using time-dependent filter coefficients;
compensating the audio signal component in the whitened sound signal; and
inverse filtering the compensated whitened sound signal.
2. The method of claim 1, further comprising the step of calculating the time-dependent filter coefficients.
3. The method of claim 2, where the step of filtering the sound signal is performed using the time-dependent filter coefficients.
4. The method of claim 3, further comprising the step of renewing the time-dependent filter coefficients every N cycles.
5. The method of claim 3, further comprising alternately supplying the time-dependent filter coefficients to a first filter and a second filter, where time-dependent filter coefficients calculated for a first set of N cycles are supplied to the first filter, and time-dependent filter coefficients calculated for a next set of N cycles are supplied to the second filter, such that the time-dependent filter coefficients for the first filter and the second filter, respectively, are renewed every 2N cycles.
6. The method of claim 1, where the step of compensating the audio signal component in the whitened sound signal further comprises: simulating the whitened audio signal component to create a whitened simulated audio signal component; and determining a whitened error signal by subtracting the simulated audio signal component from the sound signal.
7. The method of claim 6, further comprising determining an estimated sound signal component using the error signal as a feedback control signal.
8. The method of claim 7, where the step of simulating the audio signal component of the sound signal is performed by an echo compensation filter having a length equal to N.
9. The method of claim 6, where the step of determining a whitened error signal comprises alternately subtracting a first whitened simulated audio signal component from the whitened sound signal, and a second whitened simulated audio signal component from the whitened sound signal.
10. The method of claim 9, further comprising inverse filtering the whitened simulated error signal, resulting in an error signal corresponding to an echo compensated sound signal.
11. The method of claim 9, where the step of determining a whitened error signal comprises alternately subtracting a first whitened simulated audio signal component from the whitened sound signal for a first set of N cycles, and a second whitened simulated audio signal component from the whitened sound signal for a next set of N cycles.
12. A method for compensating an audio signal comprising the steps of:
detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal, and a speech signal component;
calculating time dependent filter coefficients;
filtering the sound signal to create a whitened sound signal using a decorrelation filter, said decorrelation filter being supplied with the time dependent filter coefficients every N cycles;
filtering the audio signal component to create a whitened audio signal component where the step of filtering the audio signal component is performed using at least two filters in an alternate way, said two filters being supplied alternately every 2N cycles with said time dependent filter coefficients;
compensating the audio signal component in the whitened sound signal; and
inverse filtering the compensated whitened sound signal.
13. An echo compensation system comprising:
at least one microphone for detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal and a speech signal component;
at least one loudspeaker for outputting the sound signal and the audio signal;
a filter unit comprising a first filter and a second filter used in an alternating way for filtering the audio signal component, where each filter uses time-dependent filter coefficients; and
an echo compensation unit for compensating the audio signal component received by the microphone.
14. The echo compensation system of claim 13, further comprising a calculating unit for calculating the time-dependent filter coefficients.
15. The echo compensation system of claim 14, further comprising a first switch in communication with the calculating unit and the first and second filters, for alternately supplying the time-dependent filter coefficients to the first filter and the second filter.
16. The echo compensation system of claim 15, where the first switch switches between a first position and a second position every N cycles.
17. The echo compensation system of claim 13, where the filter unit further comprises a third filter for filtering the sound signal and outputting a whitened sound signal component, where the third filter receives the time-dependent filter coefficients calculated by the calculating unit, and the time-dependent filter coefficients received by the third filter are refreshed every N cycles.
18. The echo compensation system of claim 13, where the echo compensation unit comprises a first echo compensation filter in communication with the first filter and a second echo compensation filter in communication with the second filter, where the first echo compensation filter receives a first whitened audio signal component from the first filter and outputs a first whitened simulated audio signal component, and the second echo compensation filter receives a second whitened audio signal component from the second filter and outputs a second whitened simulated audio signal component.
19. The echo compensation system of claim 18, where the echo compensation unit further comprises a subtracting unit where the first and second whitened simulated audio signal components are subtracted from the whitened sound signal component, resulting in a whitened error signal.
20. The echo compensation unit of claim 19, where the whitened error signal is used as a feedback control signal for the echo compensation filters.
21. The echo compensation unit of claim 13, further comprising an inverse filter for inverse filtering the whitened error signal, and outputting an echo compensated sound signal.
22. The echo compensation unit of 13, further comprising a third filter and a fourth filter, where the first and third filters correspond to a first audio signal component, and the second and fourth filters correspond to a second audio signal component; and four echo compensation filters, where two of the echo compensations filters correspond to the first audio signal component and the other two echo compensation filters correspond to the second audio signal component.
23. The echo compensation unit of claim 18, further comprising a switch for alternately supplying the first whitened simulated audio signal component and the second whitened simulated audio signal component to the subtracting unit, the switch alternating every N cycles.
24. An echo compensation system comprising:
at least one microphone for detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal and a speech signal component;
at least one loudspeaker for outputting the sound signal and the audio signal;
a calculating unit for calculating time dependent filter coefficients based on the audio signal;
at least two filters for alternately filtering the audio signal, said filters being alternately supplied with said time-dependent filter coefficients every 2N cycles;
a sound signal filter for filtering the sound signal, the sound signal filter being supplied with said time dependent filter coefficients every N cycles;
an echo compensation unit for compensating the audio signal component.
25. A method for compensating audio signal components comprising the steps of:
detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal comprising a first channel and a second channel, and a speech signal component;
generating an echo compensated sound signal to compensate acoustic echoes in the sound signal due to the detected audio signal component in the sound signal, where the generating step comprises the steps of:
supplying the first channel of the audio signal to a mono echo compensation unit;
supplying the first and second channels of the audio signal to a multi channel echo compensation unit;
outputting a first output associated with a first signal power from the mono echo compensation unit, and a second output associated with a second signal power from the multi channel echo compensation unit;
comparing the first signal power and the second signal power;
selecting the first output if the first signal power is smaller than the second signal power; and
selecting the second output if the second signal power is smaller than the first signal power.
26. The method of claim 25, further comprising the step of filtering the sound signal in order to obtain a whitened sound signal before the step of generating the echo compensated sound signal, and inverse filtering the selected output.
27. The method of claim 25, where the step of generating an echo compensated sound signal further comprises: generating a first simulated audio signal component for the first channel and a second simulated audio signal component for the second channel using the multi channel echo compensation unit; and adding the first and second simulated audio signals to obtain a combined simulated audio signal component.
28. The method of claim 26, further comprising calculating time-dependent filter coefficients to be used for obtaining the whitened sound signal.
29. The method of claim 27, further comprising subtracting a mono simulated audio signal component from the sound signal to obtain the first output, and subtracting the combined simulated audio signal component from the sound signal to obtain the second output.
30. A method for compensating audio signal components comprising the steps of:
detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal comprising a first channel and a second channel, and a speech signal component;
filtering the sound signal to obtain a whitened sound signal;
filtering the first channel to obtain a first whitened audio signal component;
filtering the second channel to obtain a second whitened audio signal component;
supplying the first whitened audio signal component and the whitened sound signal to a mono echo compensation unit;
outputting a first output having a first signal power from the mono echo compensation unit;
supplying the first whitened audio signal component, the second whitened audio signal component, and the whitened sound signal to a multi channel echo compensation unit;
outputting a second output having a second signal power from the multi channel echo compensation unit;
comparing the first signal power and the second signal power;
selecting the first output if the first signal power is smaller than the second signal power; and
selecting the second output if the second signal power is smaller than the first signal power.
31. An echo compensation system comprising:
at least one microphone for detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal comprising a first channel and a second channel, and a speech signal component;
at least one loudspeaker for outputting the sound signal;
a mono echo compensation unit for receiving the first channel of the audio signal and outputting first output having a first signal power;
a multi channel echo compensation unit for receiving the first and second channels of the audio signal and outputting a second output having a second signal power; and
a comparison unit for comparing the first signal power and the second signal power; and
selecting the first output if the first signal power is lower than the second signal power, or the second output if the second signal power is lower than the first signal power.
32. The echo compensation system of claim 31, further comprising a plurality of filters to whiten the audio signal and the sound signal, and an inverse filter for inverse filtering at least one of the first output and the second output.
33. The echo compensation system of claim 32, where the plurality of filters includes at least one filter for the first channel and at least one filter for the second channel.
34. An echo compensation system comprising:
at least one microphone for detecting a sound signal, the sound signal comprising a detected audio signal component from an audio signal comprising a first channel and a second channel, and a speech signal component;
at least one loudspeaker for outputting the sound signal;
a filter unit for generating a whitened sound signal;
a plurality of filter units for generating a whitened audio signal, the whitened audio signal comprising a first whitened audio signal corresponding to the first channel and a second whitened audio signal corresponding to the second channel;
a mono echo compensation unit being supplied with the first whitened audio signal and with the whitened sound signal, and outputting a first output;
a multi channel echo compensation unit being supplied with the first whitened audio signal, the second audio signal, and the whitened sound signal, and outputting a second output; and
a comparison unit for comparing a signal power of the first output and a signal power of the second output, and selecting whichever of the first output or second output has a lower signal power.
35. An echo compensation system comprising:
an audio source for generating an audio signal having a first channel with a first time delay and a second channel with a second time delay, where the first and second time delays are adjustable relative to each other;
at least one microphone for detecting a sound signal, the sound signal comprising a detected audio signal component from the audio signal, and a speech signal;
a loudspeaker unit for outputting the audio signal and the sound signal;
an echo compensation unit for simulating the audio signal component to obtain a simulated audio signal component, and subtracting the simulated audio signal component from the sound signal, the echo compensation unit comprising:
a filter for filtering the audio signal to obtain a pulse response of the audio signal, the pulse response having a maximum value;
a plurality of filter coefficients corresponding to the filter;
a delay element for introducing a variable time delay corresponding to the audio signal; and
a delay control unit for controlling the delay element so that the maximum value of the pulse response is located within a predetermined range of the filter coefficients.
36. The echo compensation system of claim 35, where the delay element comprises a delay memory having a variable length.
37. The echo compensation system of claim 36, where the delay element is in communication with a signal memory, the signal memory of the filter having a constant length.
38. The echo compensation system of claim 35, where a filter coefficient corresponding to the maximum value of the pulse response is located between a tenth and a twentieth filter coefficient.
39. The echo compensation system of claim 35, where the maximum value of the pulse response is located between a twentieth and a fortieth filter coefficient
40. The echo compensation system of claim 35, where the maximum value of the pulse response is located between a twenty-fifth and a thirty-fifth filter coefficient.
41. The echo compensation system of claim 35, where the maximum value of the pulse response is located between a twenty-eighth and a thirty-second filter coefficient.
42. The echo compensation system of claim 35, where the delay control unit determines at which filter coefficient the maximum value of the impulse response is positioned.
43. The echo compensation system of claim 35, further comprising:
a filter for generating a whitened sound signal using time-dependent filter coefficients;
a plurality of filter units for generating a whitened delayed audio signal, where at least one filter unit comprises two audio signal filters, each audio signal filter using time-dependent filter coefficients for generating corresponding whitened delayed audio signals, said at least two audio signal filters being used in an alternating way for generating the whitened delayed audio signals;
a mono echo compensation unit comprising at least two echo compensation filters alternately receiving the whitened delayed audio signals from the audio signal filters, and outputting a mono compensated sound signal having a first signal power;
a multi channel echo compensation unit comprising at least two echo compensation filters alternately receiving the whitened delayed audio signals from the audio signal filters, and outputting a multi channel compensated sound signal having a second signal power; and
a comparison unit for comparing the first signal power and the second signal power, and selecting whichever of the mono compensated sound signal and the multi channel compensated sound signal has a lower signal power.
44. An echo compensation system comprising:
an audio source for generating an audio signal having a first channel with a first time delay and a second channel with a second time delay, where the first and second time delays are adjustable relative to each other;
at least one microphone for detecting a sound signal, the sound signal comprising a detected audio signal component from the audio signal, and a speech signal;
a loudspeaker unit for outputting the audio signal and the sound signal;
a delay element comprising a delay memory for generating a delayed audio signal;
a calculating unit for calculating a pulse response corresponding to the delayed audio signal and the sound signal, the pulse response having a maximum value;
an echo compensation unit for obtaining a compensated audio signal component and
a delay control unit for controlling the delay element so that the maximum value of the pulse response is located within a predetermined range of filter coefficients.
45. A method for compensating audio signal components comprising the steps of:
reproducing an audio signal, the audio signal having a first channel with a first time delay and a second channel with a second time delay, where the first and second time delays are adjustable relative to each other;
outputting the audio signal;
detecting a sound signal, the sound signal comprising a detected audio signal component from the audio signal, and a speech signal component;
outputting the sound signal;
generating a simulated audio signal component;
subtracting the simulated audio signal components from the sound signal;
simulating a signal path of the audio signal from the loudspeaker to the microphone by determining a pulse response of the audio signal; the pulse response having a maximum value; and
introducing a variable time delay selected so that the maximum value of the pulse response is located within a predetermined range of filter coefficients of the filter.
46. The method of claim 45, further comprising the step of adding a variable time delay to the audio signal by supplying the audio signal to a delay element of variable length.
47. The method of claim 45, further comprising the step of determining the maximum value of the pulse response and determining at which filter coefficient the determined maximum value is located.
48. The method of claim 47 where the step of determining the maximum value of the pulse response comprises determining the maximum value of a weighted modulus of the pulse response.
49. The method of claim 45, further comprising varying the length of a delay element.
50. The method of claim 49, further comprising increasing the delay element when it is determined that the maximum value of the pulse response is positioned at a filter coefficient having a number larger than the predetermined range.
51. The method of claim 50, further comprising decreasing the delay element when it is determined that the maximum value of the pulse response is positioned at a filter coefficient having a number smaller than the predetermined range.
52. The method of claim 45, further comprising shifting the pulse response so that the maximum of the pulse response is located within the predetermined range of filter coefficients, if the determined pulse response is not located within a predetermined range of filter coefficients.
53. The method of claim 45, further comprising the steps of:
filtering the sound signal to obtain a whitened sound signal;
filtering the first channel and the second channel to obtain a first whitened delayed channel and a second whitened delayed channel, where the filtering of the first and second channels is performed using at least two audio filters per channel in an alternating way, each audio filter using time-dependent filter coefficients;
obtaining a compensated mono sound signal having a first signal power using a mono echo compensation unit;
obtaining a compensated multi channel sound signal having a second signal power using a multi channel echo compensation unit;
comparing the compensated first signal power and the second signal power; and
selecting whichever of the mono sound signal and the compensated multi channel sound signal has a lower signal power.
54. A method for compensating audio signal components comprising the steps of:
reproducing an audio signal, the audio signal having a first channel with a first time delay and a second channel with a second time delay, where the first and second time delays are adjustable relative to each other;
outputting the audio signal;
detecting a sound signal, the sound signal comprising a detected audio signal component from the audio signal, and a speech signal component;
outputting the sound signal;
delaying the audio signal using a delay element;
calculating a pulse response from the delayed audio signal and the sound signal, the pulse response having a maximum value;
generating a simulated audio component using the delayed audio signal and a filter, said filter using the calculated pulse response as filter coefficients;
controlling a delay introduced by the delay element so that the maximum value of the pulse response is positioned within a predetermined range of filter coefficients; and
subtracting the simulated audio component from the sound signal.
US11/776,432 2006-07-11 2007-07-11 Audio signal component compensation system Abandoned US20080015845A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/368,092 US9111544B2 (en) 2006-07-11 2012-02-07 Mono and multi-channel echo compensation from selective output

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP06014366.6A EP1879181B1 (en) 2006-07-11 2006-07-11 Method for compensation audio signal components in a vehicle communication system and system therefor
EP06014366.6 2006-07-11

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/368,092 Division US9111544B2 (en) 2006-07-11 2012-02-07 Mono and multi-channel echo compensation from selective output

Publications (1)

Publication Number Publication Date
US20080015845A1 true US20080015845A1 (en) 2008-01-17

Family

ID=37256674

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/776,432 Abandoned US20080015845A1 (en) 2006-07-11 2007-07-11 Audio signal component compensation system
US13/368,092 Active 2028-12-22 US9111544B2 (en) 2006-07-11 2012-02-07 Mono and multi-channel echo compensation from selective output

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/368,092 Active 2028-12-22 US9111544B2 (en) 2006-07-11 2012-02-07 Mono and multi-channel echo compensation from selective output

Country Status (3)

Country Link
US (2) US20080015845A1 (en)
EP (1) EP1879181B1 (en)
JP (1) JP5166777B2 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120189138A1 (en) * 2009-10-01 2012-07-26 Nec Corporation Signal processing method, signal processing apparatus, and signal processing program
US20130185064A1 (en) * 2011-07-27 2013-07-18 Sony Corporation Echo removing apparatus, echo removing method, program and recording medium
US8761407B2 (en) 2009-01-30 2014-06-24 Dolby International Ab Method for determining inverse filter from critically banded impulse response data
US20160019907A1 (en) * 2013-04-11 2016-01-21 Nuance Communications, Inc. System For Automatic Speech Recognition And Audio Entertainment
US20160127827A1 (en) * 2014-10-29 2016-05-05 GM Global Technology Operations LLC Systems and methods for selecting audio filtering schemes
US9691378B1 (en) * 2015-11-05 2017-06-27 Amazon Technologies, Inc. Methods and devices for selectively ignoring captured audio data
JP2018505587A (en) * 2014-12-12 2018-02-22 クゥアルコム・インコーポレイテッドQualcomm Incorporated Feedback cancellation on enhanced conversational communication in shared acoustic spaces
US20180108689A1 (en) * 2015-08-27 2018-04-19 Samsung Display Co., Ltd. Display device and manufacturing method thereof
US20190335144A1 (en) * 2008-09-25 2019-10-31 Maxell, Ltd. Television receiver with a tv phone function
CN111031448A (en) * 2019-11-12 2020-04-17 西安讯飞超脑信息科技有限公司 Echo cancellation method, echo cancellation device, electronic equipment and storage medium
US20200184981A1 (en) * 2016-11-23 2020-06-11 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for adaptive control of decorrelation filters
DE102019105458A1 (en) * 2019-03-04 2020-09-10 Harman Becker Automotive Systems Gmbh TIME DELAY ESTIMATION
US10984815B1 (en) * 2019-09-27 2021-04-20 Cypress Semiconductor Corporation Techniques for removing non-linear echo in acoustic echo cancellers

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008039330A1 (en) * 2008-01-31 2009-08-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for calculating filter coefficients for echo cancellation
GB2465047B (en) * 2009-09-03 2010-09-22 Peter Graham Craven Prediction of signals
JP5649488B2 (en) * 2011-03-11 2015-01-07 株式会社東芝 Voice discrimination device, voice discrimination method, and voice discrimination program
EP2850611B1 (en) * 2012-06-10 2019-08-21 Nuance Communications, Inc. Noise dependent signal processing for in-car communication systems with multiple acoustic zones
CN104737475B (en) 2012-06-10 2016-12-14 纽昂斯通讯公司 Wind noise detection for the Vehicular communication system with multiple acoustical area
US9497544B2 (en) 2012-07-02 2016-11-15 Qualcomm Incorporated Systems and methods for surround sound echo reduction
CN103067821B (en) * 2012-12-12 2015-03-11 歌尔声学股份有限公司 Method of and device for reducing voice reverberation based on double microphones
US9613634B2 (en) * 2014-06-19 2017-04-04 Yang Gao Control of acoustic echo canceller adaptive filter for speech enhancement
US11038482B2 (en) 2017-04-07 2021-06-15 Dirac Research Ab Parametric equalization for audio applications
US10291996B1 (en) * 2018-01-12 2019-05-14 Ford Global Tehnologies, LLC Vehicle multi-passenger phone mode
CN112840670B (en) * 2018-09-07 2022-11-08 杜比实验室特许公司 Dynamic environment overlay instability detection and suppression in media compensated pass-through devices

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5305307A (en) * 1991-01-04 1994-04-19 Picturetel Corporation Adaptive acoustic echo canceller having means for reducing or eliminating echo in a plurality of signal bandwidths
US5428605A (en) * 1993-05-14 1995-06-27 Telefonaktiebolaget Lm Ericsson Method and echo canceller for echo cancellation with a number of cascade-connected adaptive filters
US5619566A (en) * 1993-08-27 1997-04-08 Motorola, Inc. Voice activity detector for an echo suppressor and an echo suppressor
US6510225B1 (en) * 1999-02-16 2003-01-21 Denso Corporation Ultrasonically-calibrated fast-start echo canceller for cellular and pcs telephone car kits
US6522753B1 (en) * 1998-10-07 2003-02-18 Fujitsu Limited Active noise control method and receiver device
US6738480B1 (en) * 1999-05-12 2004-05-18 Matra Nortel Communications Method and device for cancelling stereophonic echo with frequency domain filtering
US20040266383A1 (en) * 2003-06-27 2004-12-30 Mattellini Gian Paolo Method and apparatus for suppressing co-channel interference in a receiver
US6839426B1 (en) * 1999-01-20 2005-01-04 Oki Electric Industry Co., Ltd. Echo cancellor
US6873704B1 (en) * 1998-10-13 2005-03-29 Samsung Electronics Co., Ltd Apparatus for removing echo from speech signals with variable rate
US6895095B1 (en) * 1998-04-03 2005-05-17 Daimlerchrysler Ag Method of eliminating interference in a microphone
US7778408B2 (en) * 2004-12-30 2010-08-17 Texas Instruments Incorporated Method and apparatus for acoustic echo cancellation utilizing dual filters

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5555310A (en) * 1993-02-12 1996-09-10 Kabushiki Kaisha Toshiba Stereo voice transmission apparatus, stereo signal coding/decoding apparatus, echo canceler, and voice input/output apparatus to which this echo canceler is applied
US6263078B1 (en) * 1999-01-07 2001-07-17 Signalworks, Inc. Acoustic echo canceller with fast volume control compensation
US6580696B1 (en) * 1999-03-15 2003-06-17 Cisco Systems, Inc. Multi-adaptation for a voice packet based
DE10153188C2 (en) * 2001-10-27 2003-08-21 Grundig Ag I Ins Device and method for multi-channel acoustic echo cancellation with a variable number of channels
CA2399159A1 (en) * 2002-08-16 2004-02-16 Dspfactory Ltd. Convergence improvement for oversampled subband adaptive filters
JP4138449B2 (en) * 2002-09-24 2008-08-27 株式会社ディーアンドエムホールディングス Voice input system and communication system
US20040059571A1 (en) * 2002-09-24 2004-03-25 Marantz Japan, Inc. System for inputting speech, radio receiver and communication system
JP4041770B2 (en) * 2003-05-20 2008-01-30 日本電信電話株式会社 Acoustic echo cancellation method, apparatus, program, and recording medium
US20050213747A1 (en) * 2003-10-07 2005-09-29 Vtel Products, Inc. Hybrid monaural and multichannel audio for conferencing
NO319467B1 (en) * 2003-12-29 2005-08-15 Tandberg Telecom As System and method for improved subjective stereo sound
US7352858B2 (en) * 2004-06-30 2008-04-01 Microsoft Corporation Multi-channel echo cancellation with round robin regularization
ATE405925T1 (en) * 2004-09-23 2008-09-15 Harman Becker Automotive Sys MULTI-CHANNEL ADAPTIVE VOICE SIGNAL PROCESSING WITH NOISE CANCELLATION
DE602005015426D1 (en) * 2005-05-04 2009-08-27 Harman Becker Automotive Sys System and method for intensifying audio signals
ATE423433T1 (en) * 2006-04-18 2009-03-15 Harman Becker Automotive Sys SYSTEM AND METHOD FOR MULTI-CHANNEL ECHO COMPENSATION
EP1855457B1 (en) * 2006-05-10 2009-07-08 Harman Becker Automotive Systems GmbH Multi channel echo compensation using a decorrelation stage

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5305307A (en) * 1991-01-04 1994-04-19 Picturetel Corporation Adaptive acoustic echo canceller having means for reducing or eliminating echo in a plurality of signal bandwidths
US5428605A (en) * 1993-05-14 1995-06-27 Telefonaktiebolaget Lm Ericsson Method and echo canceller for echo cancellation with a number of cascade-connected adaptive filters
US5619566A (en) * 1993-08-27 1997-04-08 Motorola, Inc. Voice activity detector for an echo suppressor and an echo suppressor
US6895095B1 (en) * 1998-04-03 2005-05-17 Daimlerchrysler Ag Method of eliminating interference in a microphone
US6522753B1 (en) * 1998-10-07 2003-02-18 Fujitsu Limited Active noise control method and receiver device
US6873704B1 (en) * 1998-10-13 2005-03-29 Samsung Electronics Co., Ltd Apparatus for removing echo from speech signals with variable rate
US6839426B1 (en) * 1999-01-20 2005-01-04 Oki Electric Industry Co., Ltd. Echo cancellor
US6510225B1 (en) * 1999-02-16 2003-01-21 Denso Corporation Ultrasonically-calibrated fast-start echo canceller for cellular and pcs telephone car kits
US6738480B1 (en) * 1999-05-12 2004-05-18 Matra Nortel Communications Method and device for cancelling stereophonic echo with frequency domain filtering
US20040266383A1 (en) * 2003-06-27 2004-12-30 Mattellini Gian Paolo Method and apparatus for suppressing co-channel interference in a receiver
US7778408B2 (en) * 2004-12-30 2010-08-17 Texas Instruments Incorporated Method and apparatus for acoustic echo cancellation utilizing dual filters

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190335144A1 (en) * 2008-09-25 2019-10-31 Maxell, Ltd. Television receiver with a tv phone function
US11539921B2 (en) * 2008-09-25 2022-12-27 Maxell, Ltd. Television receiver with a TV phone function
US10911719B2 (en) * 2008-09-25 2021-02-02 Maxell, Ltd. Communication apparatus for transmitting and receiving digital information to and from another communication apparatus
US8761407B2 (en) 2009-01-30 2014-06-24 Dolby International Ab Method for determining inverse filter from critically banded impulse response data
US20120189138A1 (en) * 2009-10-01 2012-07-26 Nec Corporation Signal processing method, signal processing apparatus, and signal processing program
US9384757B2 (en) * 2009-10-01 2016-07-05 Nec Corporation Signal processing method, signal processing apparatus, and signal processing program
US20130185064A1 (en) * 2011-07-27 2013-07-18 Sony Corporation Echo removing apparatus, echo removing method, program and recording medium
US20160019907A1 (en) * 2013-04-11 2016-01-21 Nuance Communications, Inc. System For Automatic Speech Recognition And Audio Entertainment
US9767819B2 (en) * 2013-04-11 2017-09-19 Nuance Communications, Inc. System for automatic speech recognition and audio entertainment
CN105575399A (en) * 2014-10-29 2016-05-11 通用汽车环球科技运作有限责任公司 Systems and methods for selecting audio filtering schemes
US20160127827A1 (en) * 2014-10-29 2016-05-05 GM Global Technology Operations LLC Systems and methods for selecting audio filtering schemes
JP2018505587A (en) * 2014-12-12 2018-02-22 クゥアルコム・インコーポレイテッドQualcomm Incorporated Feedback cancellation on enhanced conversational communication in shared acoustic spaces
US20180108689A1 (en) * 2015-08-27 2018-04-19 Samsung Display Co., Ltd. Display device and manufacturing method thereof
US9691378B1 (en) * 2015-11-05 2017-06-27 Amazon Technologies, Inc. Methods and devices for selectively ignoring captured audio data
US20200184981A1 (en) * 2016-11-23 2020-06-11 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for adaptive control of decorrelation filters
US10950247B2 (en) * 2016-11-23 2021-03-16 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for adaptive control of decorrelation filters
US11501785B2 (en) 2016-11-23 2022-11-15 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for adaptive control of decorrelation filters
US11942098B2 (en) 2016-11-23 2024-03-26 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for adaptive control of decorrelation filters
DE102019105458A1 (en) * 2019-03-04 2020-09-10 Harman Becker Automotive Systems Gmbh TIME DELAY ESTIMATION
DE102019105458B4 (en) * 2019-03-04 2021-06-10 Harman Becker Automotive Systems Gmbh System and method for time delay estimation
US10984815B1 (en) * 2019-09-27 2021-04-20 Cypress Semiconductor Corporation Techniques for removing non-linear echo in acoustic echo cancellers
CN111031448A (en) * 2019-11-12 2020-04-17 西安讯飞超脑信息科技有限公司 Echo cancellation method, echo cancellation device, electronic equipment and storage medium

Also Published As

Publication number Publication date
JP5166777B2 (en) 2013-03-21
JP2008020897A (en) 2008-01-31
EP1879181B1 (en) 2014-05-21
EP1879181A1 (en) 2008-01-16
US9111544B2 (en) 2015-08-18
US20120201396A1 (en) 2012-08-09

Similar Documents

Publication Publication Date Title
US9111544B2 (en) Mono and multi-channel echo compensation from selective output
US10257613B2 (en) Managing telephony and entertainment audio in a vehicle audio platform
EP1848243B1 (en) Multi-channel echo compensation system and method
US6674865B1 (en) Automatic volume control for communication system
US7117145B1 (en) Adaptive filter for speech enhancement in a noisy environment
EP1855457B1 (en) Multi channel echo compensation using a decorrelation stage
US7171003B1 (en) Robust and reliable acoustic echo and noise cancellation system for cabin communication
US8189765B2 (en) Multichannel echo canceller
EP2043383B1 (en) Active noise control using bass management
US7747028B2 (en) Apparatus and method for improving voice clarity
EP1858295B1 (en) Equalization in acoustic signal processing
EP1718103B1 (en) Compensation of reverberation and feedback
US7039197B1 (en) User interface for communication system
US8483396B2 (en) Method for the sound processing of a stereophonic signal inside a motor vehicle and motor vehicle implementing said method
EP0874514B1 (en) Method and apparatus for cancelling multi-channel echo
EP1860911A1 (en) System and method for improving communication in a room
Schmidt et al. Signal processing for in-car communication systems
EP1001652A2 (en) Automatic loudspeaker equalizer
US20060182268A1 (en) Audio system
CN109076302B (en) Signal processing device
JP3423849B2 (en) Audio equipment
JP2023036332A (en) Acoustic system
Christoph Dynamic sound control algorithms in automobiles

Legal Events

Date Code Title Description
AS Assignment

Owner name: NUANCE COMMUNICATIONS, INC., MASSACHUSETTS

Free format text: ASSET PURCHASE AGREEMENT;ASSIGNOR:HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH;REEL/FRAME:023810/0001

Effective date: 20090501

Owner name: NUANCE COMMUNICATIONS, INC.,MASSACHUSETTS

Free format text: ASSET PURCHASE AGREEMENT;ASSIGNOR:HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH;REEL/FRAME:023810/0001

Effective date: 20090501

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION