US20040208312A1 - Echo canceling method, echo canceller, and voice switch - Google Patents
Echo canceling method, echo canceller, and voice switch Download PDFInfo
- Publication number
- US20040208312A1 US20040208312A1 US10/834,261 US83426104A US2004208312A1 US 20040208312 A1 US20040208312 A1 US 20040208312A1 US 83426104 A US83426104 A US 83426104A US 2004208312 A1 US2004208312 A1 US 2004208312A1
- Authority
- US
- United States
- Prior art keywords
- speech communication
- voice
- end speaker
- communication state
- far
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B3/00—Line transmission systems
- H04B3/02—Details
- H04B3/20—Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other
- H04B3/23—Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other using a replica of transmitted signal in the time domain, e.g. echo cancellers
Definitions
- the present invention relates generally to an echo canceling method and an echo canceller, and more particularly, to an echo canceling method and an echo canceller which are utilized in order to realize full duplex in a hands-free telephone set or a television conference, for example.
- the present invention relates to a voice switch used for a hands-free speech communication system capable of carrying out telephone conversation using a speaker and a microphone.
- FIG. 1 illustrates an example of a conventional echo canceller 1 .
- the echo canceller 1 is constructed as a hybrid (line) echo canceller for canceling a hybrid echo, and updates an adaptive filter coefficient by the NLMS Method.
- An echo signal y, an echo replica signal (a pseudo echo signal) Y, an adaptive filter coefficient, a value x in a reference input signal buffer, a cancellation error signal e, and so forth are initialized (step 1).
- a microphone input signal which is digitized by an analog-to-digital (A/D) converter 2 is sampled, and is inputted to a reference input signal buffer 3 as a reference input signal X (step 3).
- An adaptive filter coefficient Pj(i) in an adaptive filter 4 and the reference input signal X i.e., a value xj(i) in the reference input signal buffer 3 at time j are multiplied and accumulated by a multiply and accumulate unit 5 , thereby to generate an echo replica signal Yj at the time j, as expressed by the following equation (1) (step 5):
- a subtractor 7 subtracts the echo replica signal Yj from an echo signal yj outputted from an A/D converter 6 , thereby to calculate a cancellation error signal ej at the time j, as expressed by the following equation (2), (step 7):
- yj denotes an echo signal at the time j
- Yj denotes an echo replica signal at the time j
- Pj(i) denotes a coefficient of the i-th delay element in the adaptive filter at the time j
- xj(i) denotes the i-th value of the reference input signal buffer at the time j
- ej denotes a cancellation error signal at the time j
- N denotes the number of taps in the adaptive filter
- ⁇ denotes a relaxation coefficient called a step gain.
- the reference input signal is a voice signal which is high in auto-correlation, so that the learning speed is reduced.
- the vector of the reference input signal is a value, grasped as a vector, in the reference input signal buffer 3 .
- the frequency characteristics of a voice signal are generally as shown in FIGS. 3 a and 3 b . That is, voiced speech (a voiced sound) has the property of decreasing in level by 6 dB when the frequency thereof increases by one octave ( ⁇ 6 dB/oct), as shown in FIG. 3 a . Unvoiced speech (a voiceless sound) has the property of increasing in level by 6 dB when the frequency thereof increases by one octave (+6 dB/oct), as shown in FIG. 3 b.
- a whitening filter 9 for decreasing the deviation in frequency characteristics of a voice signal is inserted between the A/D converter 2 and a digital-to-analog (D/A) converter 9 , as in an echo canceller 1 a shown in FIG. 4.
- D/A digital-to-analog
- An object of the present invention is to provide echo canceling means and an echo canceller capable of improving the learning speed and the learning precision without degrading the sound quality of an output signal.
- a signal in a communication path through which the voice of one of a near-end speaker and a far-end speaker who is talking by phone passes is passed, while a signal in a communication path through which the voice of the speaker who is talking by phone does not pass is attenuated by an attenuator, thereby preventing an echo from being returned to the communication path through which the voice of the speaker who is talking by phone does not pass.
- the voice switch when one of the near-end speaker and the far-end speaker starts to talk by phone from a state where both the speakers do not talk by phone, the beginning or the ending, for example, of a word may, in some cases, be cut.
- An object of the present invention is to provide a voice switch capable of preventing the beginning or the ending of a word from being cut, for example, when one of a near-end speaker and a far-end speaker starts to talk by phone from a state where both the speakers do not talk by phone as well as capable of carrying out more natural telephone conversation which hardly has a switching feeling.
- An echo canceling method is an echo canceling method for updating an adaptive filter coefficient utilizing a digitized input signal to cancel an echo, characterized by comprising the steps of obtaining a reference input signal from the input signal; spuriously whitening the reference input signal, to obtain a pseudo whitened signal; generating an echo replica signal on the basis of the pseudo whitened signal and the adaptive filter coefficient; obtaining a cancellation error signal on the basis of an echo signal and the echo replica signal; and updating the adaptive filter coefficient on the basis of the cancellation error signal, the adaptive filter coefficient and the pseudo whitened signal.
- An echo canceller for updating an adaptive filter coefficient utilizing a digitized input signal to cancel an echo, comprising whitening means for spuriously whitening a reference input signal obtained from the input signal, to obtain a pseudo whitened signal; echo replica signal generation means for generating an echo replica signal on the basis of the pseudo whitened signal and the adaptive filter coefficient; cancellation error signal calculation means for obtaining a cancellation error signal on the basis of the echo signal and the echo replica signal; and coefficient updating means for updating the adaptive filter coefficient on the basis of the cancellation error signal, the adaptive filter coefficient and the pseudo whitened signal.
- the whitening means is composed of an IIR filter or an FIR filter, for example.
- the reference input signal obtained by sampling the digitized input signal is spuriously whitened by the whitening means composed of the IIR filter, the FIR filter, or the like, to obtain the pseudo whitened signal in which the deviation in frequency of the input signal is decreased. That is, the voice signal that is the reference input signal has the property of varying in level as the frequency thereof increases. In order to decrease the deviation in frequency of the reference input signal, therefore, a filter capable of reducing the variation in level corresponding to the increase in frequency of the reference input signal is used, to whiten the reference input signal by filtering.
- the echo replica signal is generated on the basis of the pseudo whitened signal whose deviation in frequency is decreased and the adaptive filter coefficient, and the cancellation error signal is obtained on the basis of the echo signal and the echo replica signal. Specifically, the pseudo whitened signal and the adaptive filter coefficient are multiplied and accumulated, to generate the echo replica signal. The echo replica signal is subtracted from the echo signal, to obtain the cancellation error signal. Thereafter, the adaptive filter coefficient is updated on the basis of the cancellation error signal, the adaptive filter coefficient, and the pseudo whitened signal.
- the pseudo whitened signal is obtained from the reference input signal obtained by sampling the input signal, and the input signal is fed to the D/A converter as it is. Accordingly, an output signal obtained by the D/A converter is outputted without degrading the sound quality thereof.
- a first voice switch is characterized by comprising near-end speaker's voice judgment means for judging whether a near-end speaker's voice is present or absent; far-end speaker's voice judgment means for judging whether a far-end speaker's voice is present or absent; and speech communication state determination means for determining which of a near-end speaker speech communication state, a far-end speaker speech communication state, and an intermediate state is the current speech communication state on the basis of the results of the judgment by the near-end speaker's voice judgment means and the far-end speaker's voice judgment means, the preceding speech communication state determined, and the hysteresis of speech communication states preceding the preceding speech communication state.
- a second voice switch is characterized by comprising near-end speaker's voice attenuation means for attenuating a near-end speaker's voice; far-end speaker's voice attenuation means for attenuating a far-end speaker's voice; near-end speaker's voice judgment means for judging whether the near-end speaker's voice is present or absent; far-end speaker's voice judgment means for judging whether the far-end speaker's voice is present or absent; speech communication state determination means for determining which of a near-end speaker speech communication state, a far-end speaker speech communication state and an intermediate state is the current speech communication state on the basis of the results of the judgment by the near-end speaker's voice judgment means and the far-end speaker's voice judgment means, the preceding speech communication state determined, and the hysteresis of speech communication states preceding the preceding speech communication state; means for controlling, when it is determined that the current speech communication state is the near-end speaker speech communication state, an attenuation
- the speech communication state determination means comprises, in a case where the transition from the near-end speaker speech communication state or the far-end speaker speech communication state to the intermediate state occurs, means for determining, when it is judged that the near-end speaker's voice or the far-end speaker's voice is present after the intermediate state is continued for not less than a predetermined time period, the speech communication state so as to proceed to a speaker speech communication state corresponding to the speaker's voice which is judged to be present, determining, when it is judged that the speaker's voice in a direction of speech communication before the transition to the intermediate state is present in a case where the time period during which the intermediate state is continued is shorter than the predetermined time period, the speech communication state so as to immediately return to a speaker speech communication state before the transition, and determining, even when it is judged that the speaker's voice in a direction of speech communication opposite to the direction of speech communication before the transition to the intermediate state is present in a case where a time period during which the intermediate state is continued
- the number of types of the intermediate states is not limited to one. A plurality of types of intermediate states may be set.
- the voice switch in a case where one of a near-end speaker and a far-end speaker starts to talk by phone from a state where both the speakers do not talk by phone, it is possible to prevent the beginning or the ending of a word from being cut, for example, as well as to carry out more natural telephone conversation which hardly has a switching feeling.
- FIG. 1 is a block diagram showing a conventional echo canceller
- FIG. 2 is a flow chart showing an example of the operation of a conventional technique shown in FIG. 1;
- FIGS. 3 a and 3 b are graphs showing frequency characteristics of a voice signal
- FIG. 4 is a functional block diagram showing an example of another echo canceller
- FIG. 5 is a block diagram showing the configuration of an echo canceller
- FIG. 6 is a functional block diagram showing the function of the echo canceller shown in FIG. 5;
- FIG. 7 is a diagram showing an equivalent circuit of a principal part of FIG. 6;
- FIG. 8 is a block diagram showing a specific example of a whitening filter
- FIG. 9 is a graph showing the frequency characteristics of the whitening filter shown in FIG. 8;
- FIG. 10 is a flow chart showing the operation of the echo canceller shown in FIG. 5;
- FIG. 11 a is a graph showing the effect of a learning method in the echo canceller shown in FIG. 5 in comparison with the conventional NLMS Method
- FIG. 11 b is a waveform diagram showing an input voice signal
- FIGS. 12 a and 12 b are graphs showing the characteristics of a whitening filter
- FIG. 13 is a block diagram showing the configuration of a voice switch
- FIG. 14 is a schematic view showing the type of speech communication state and the type of transition of the speech communication state.
- FIG. 15 is a timing chart showing attenuation amounts by attenuators 102 and 104 in each speech communication state and attenuation amounts by attenuators 102 and 104 in a case where the transition of the speech communication state occurs.
- FIGS. 5 to 12 a first embodiment of the present invention will be described.
- FIG. 5 illustrates an echo canceller 10 and its peripheral circuits.
- the echo canceller 10 comprises a CPU 12 , a ROM 14 , and a RAM 16 .
- the ROM 14 stores a program for controlling the operation of the echo canceller 10 , including the foregoing equations for calculation (1) to (3), and a previously set data.
- the data stored in the ROM 14 include the number of taps N in an adaptive filter 28 (described later), a step gain ⁇ , and so forth.
- the RAM 16 temporarily stores data such as a calculated value obtained by an operation in the CPU 12 .
- the data stored in the RAM 16 include an echo signal y, an echo replica signal Y, an adaptive filter coefficient, a value x in a reference input signal buffer, a cancellation error signal e, and so forth.
- the number of taps N in the adaptive filter and the step gain ⁇ may be stored in the RAM 16 .
- the CPU 12 is operated using the program and the data which are stored in the ROM 14 and the RAM 16 , to realize the echo canceller 10 .
- FIG. 6 is a functional block diagram showing the function of the echo canceller 10 shown in FIG. 5.
- the echo canceller 10 shown in FIG. 6 is an example constructed as a hybrid echo canceller for canceling a hybrid echo.
- the echo canceller 10 comprises a whitening filter 18 for emphasizing a high frequency region.
- the whitening filter 18 is composed of an IIR (Infinite Impulse Response) filter, for example.
- a signal obtained by digitizing a microphone input signal using an A/D converter 20 is sampled, and is inputted as a reference input signal X to the whitening filter 18 .
- a pseudo whitened signal X 1 is outputted from the whitening filter 18 .
- the pseudo whitened signal X 1 is temporarily stored in a reference input signal buffer 22 .
- the pseudo whitened signal X 1 stored in the reference input signal buffer 22 is fed to a multiply and accumulate unit 24 and a coefficient updating unit 26 at predetermined timing.
- an echo replica signal Y is calculated on the basis of the pseudo whitened signal X 1 and an adaptive filter coefficient in an adaptive filter 28 .
- a subtractor 30 subtracts the echo replica signal Y from an echo signal y from an A/D converter 32 , to obtain a cancellation error signal e.
- the cancellation error signal e is converted into an analog signal by a D/A converter 34 , and the analog signal is then outputted as a speaker output signal.
- the adaptive filter coefficient is updated such that it approaches an impulse response H (z) of an echo path on the basis of the pseudo whitened signal X 1 , the adaptive filter coefficient, and the cancellation error signal e.
- the echo canceller 10 is characterized in the place where the whitening filter 18 is inserted.
- the whitening filter 18 is inserted into not a path A from the A/D converter 20 to a D/A converter 36 but a path B branched from the path A. Consequently, the digitized microphone input signal from the A/D converter 20 is fed as it is to the D/A converter 36 , so that the sound quality of a hybrid output signal outputted from the D/A converter 36 is not degraded.
- FIG. 7 illustrates an equivalent circuit of a principal part of the echo canceller 10 shown in FIG. 6.
- the impulse response of the echo path as viewed from an echo canceller 10 a is changed into H(z) ⁇ 1/C(z) by inserting the whitening filter 18 . That is, a hybrid output signal outputted from an inverse filter 18 a becomes a value equal to the reference input signal X.
- the echo canceller 10 a can estimate the impulse response H(z) of the echo path in a case where the same signal as the reference input signal X is outputted as the hybrid output signal on the basis of the pseudo whitened signal X 1 . Consequently, there arises no problem in an operation of estimating the impulse response H(z) of the echo path.
- a 1st order IIR-type high-pass filter as shown in FIG. 8, for example, is used as the whitening filter 18 .
- the 1st order IIR-type high-pass filter is a high-pass emphasizing filter whose cut-off frequency corresponding to a sampling signal having a frequency of 8 KHz is set to 2 KHz, to increase a voice signal in level by 3 dB as the frequency thereof increases by one octave.
- Voiced speech in the voice signal has the property of decreasing in level by approximately 6 dB every time the frequency thereof statistically increases by one octave.
- the whitening filter 18 has multipliers 37 , 38 , 40 , and 42 respectively having coefficients of 0.5, ⁇ 0.5, 1.0, and 0.0, for example, delay circuits 44 and 46 for delaying an input signal by one sample, and an adder 48 .
- the frequency characteristics of the whitening filter 18 are as shown in FIG. 9. As can be seen from the coefficient of the whitening filter 18 , the whitening filter 18 performs the function of canceling 1st order auto-correlation.
- the whitening filter 18 When the whitening filter 18 is used, there are few frequency components which are less than approximately 300 Hz. Accordingly, learning in a region having few frequency components may be degraded.
- the echo canceller 10 When the echo canceller 10 is employed for a telephone system, for example, however, the frequency band is limited such that its normal frequency band becomes 300 Hz to 3200 Hz, which does not particularly cause a problem.
- the adaptive filter coefficient is updated by the NLMS Method using the pseudo whitened signal X 1 which has been spuriously whitened by the whitening filter 18 .
- an echo signal y, an echo replica signal Y, an adaptive filter coefficient, a value x in the reference input signal buffer 22 , a cancellation error signal e, and so forth which are stored in the RAM 10 are first initialized (step 11).
- a microphone input signal which has been digitized by the A/D converter 20 is sampled, and is inputted to the whitening filter 18 as a reference input signal X.
- the reference input signal X is filtered by the whitening filter 18 , to obtain a pseudo whitened signal X 1 (step 13).
- the obtained pseudo whitened signal X 1 is inputted to the reference input signal buffer 22 (step 15).
- an adaptive filter coefficient Pj(i) in the adaptive filter 28 and the pseudo whitened signal X 1 i.e. a value xj(i) in the reference input signal buffer 22 at time j are multiplied and accumulated by the multiply and accumulate unit 24 , to generate an echo replica signal Yj at the time j.
- the subtractor 30 subtracts the echo replica signal Yj from an echo signal yj outputted from the A/D converter 32 , to calculate a cancellation error signal ej at the time j (step 19).
- the echo canceller 10 learning can be performed using the pseudo whitened signal X 1 which hardly deviates in frequency, that is, is low in auto-correlation, thereby making it possible to improve the learning speed and the learning precision.
- the echo canceller 10 is constructed by only adding the whitening filter 18 for spurious whitening to the conventional echo canceller 1 . Accordingly, an echo canceller, whose capability is improved, can be realized in approximately the same amount of processing as that by the conventional echo canceller 1 .
- a learning method in the echo canceller 10 (a whitening filter+the NLMS Method) and the NLMS Method in the conventional echo canceller 1 shown in FIG. 1 are compared with each other by calculating evaluated values using the following equation (4).
- the evaluated value represents the progress of learning. If the learning progresses, the evaluated value approaches 1.0.
- H (i) indicates an impulse response of an echo path
- h(i) indicates a learning coefficient.
- the evaluated value is calculated by inputting a voice signal shown in FIG.
- the deviation in frequency of the voice signal to be the reference input signal X may be decreased. For example, if a whitening filter having the property of increasing a voice signal in level by 5 to 6 dB every time the frequency thereof increases by one octave, as shown in FIG. 12 a , is used, it is possible to cancel the attenuation of the level of voiced speech.
- the appearance ratio of the voiced speech and the appearance ratio of the unvoiced speech differ in general conversation. Further, when processing of stopping the learning when it is judged that the input voice is absent is performed as control of the echo canceller, the frequency at which the learning is stopped is increased with respect to the unvoiced speech which is relatively low in level. By using a whitening filter which produces a large effect as a whole in consideration of the foregoing, therefore, it is possible to improve the learning speed and the learning precision.
- the characteristics of the whitening filter are determined by the statistical frequencies of appearance of voiced speech and unvoiced speech and a method of controlling the learning in the echo canceller.
- the whitening filter maybe constituted by an FIR (Finite Impulse Response) filter.
- the CPU 12 may be replaced with a DSP.
- the present invention is applicable to not only the hybrid echo canceller but also an acoustic echo canceller.
- the echo canceller 10 is also applicable to a facsimile modem with a voice recording/reproduction function, for example.
- the pseudo whitening filter is inserted, thereby making it possible to update the adaptive filter coefficient using the pseudo whitened signal whose deviation in frequency is decreased, and improve the learning speed and the learning precision without substantially changing the echo canceller. Only the reference input signal in the echo canceller is spuriously whitened, to generate the pseudo whitened signal. Accordingly, the sound quality of a signal outputted outward is not degraded.
- FIGS. 13 to 15 a second embodiment of the present invention will be described.
- FIG. 13 illustrates the configuration of a voice switch.
- the voice switch comprises a near-end speaker's voice detector (near-end speaker's voice judgment means) 101 for detecting a near-end speaker's voice which is sent to a transmission path 111 , an attenuator 102 provided in the transmission path 111 , a far-end speaker's voice detector (far-end speaker's voice judgment means) 103 for detecting a far-end speaker's voice which is sent to a receiving path 112 , an attenuator 104 provided in the receiving path 112 , and a control unit 105 for respectively controlling the attenuators 102 and 104 on the basis of both the speech detectors 101 and 103 .
- a near-end speaker's voice detector near-end speaker's voice judgment means
- the near-end speaker's voice detector 101 judges whether the near-end speaker's voice is present or absent, and sends the result of the judgment to the control unit 105 . For example, when the power average of a voice signal fed to the transmission path Ill is larger than a power average corresponding to noises stationarily produced, it is judged that the near-end speaker's voice is present. On the other hand, when the power average of the voice signal fed to the transmission path 111 is not more than the power average corresponding to noises stationarily produced, it is judged that the near-end speaker's voice is absent.
- the far-end speaker's voice detector 103 judges whether the far-end speaker's voice is present or absent, and sends the result of the judgment to the control unit 105 .
- FIG. 14 illustrates the type of speech communication state and the type of transition of the speech communication state.
- the type of speech communication state include the following three states.
- ⁇ circle over (1) ⁇ to ⁇ circle over (7) ⁇ represent the types of transition.
- ⁇ circle over (1) ⁇ indicates the transition from the near-end speaker speech communication state (I) to the near-end speaker speech communication state (I).
- ⁇ circle over (2) ⁇ indicates the transition from the near-end speaker speech communication state (I) to the intermediate state (II).
- ⁇ circle over (3) ⁇ indicates the transition from the intermediate state (II) to the near-end speaker speech communication state (I).
- the control unit 105 determines the current speech communication state (a speech communication state after the transition) on the basis of the results of judgment whether the speaker's voice is present or absent by the near-end speaker's voice detector 101 and the far-end speaker's voice detector 103 , the preceding speech communication state determined (a speech communication state before the transition), and the hysteresis of speech communication states preceding the preceding speech communication state.
- the attenuators 102 and 104 are controlled depending on the state before the transition and the state after the transition.
- the preceding speech communication state is the near-end speaker speech communication state (I)
- the near-end speaker's voice detector 101 judges that the near-end speaker's voice is present
- the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number ⁇ circle over (1) ⁇ ).
- the preceding speech communication state is the near-end speaker speech communication state (I)
- the near-end speaker's voice detector 101 judges that the near-end speaker's voice is absent, and a time period during which a state where the near-end speaker's voice is absent is continued is less than a previously set time period during which the ending of a word is held
- the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number ⁇ circle over (1) ⁇ ).
- the preceding speech communication state is the near-end speaker speech communication state (I)
- the near-end speaker's voice detector 101 judges that the near-end speaker's voice is absent, and a time period during which a state where the near-end speaker's voice is absent is continued is not less than a time period during which the ending of a word is held
- the current speech communication state is determined as the intermediate state (II) (the transition number ⁇ circle over (2) ⁇ ).
- the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number ⁇ circle over (7) ⁇ ).
- the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number ⁇ circle over (7) ⁇ ).
- the preceding speech communication state is the far-end speaker speech communication state (III)
- the far-end speaker's voice detector 103 judges that the far-end speaker's voice is absent, and a time period during which a state where the far-end speaker's voice is absent is continued is not less than a time period during which the ending of a word is held
- the current speech communication state is determined as the intermediate state (II) (the transition number ⁇ circle over (5) ⁇ ).
- the preceding speech communication state is the intermediate state (II) when the near-end speaker's voice detector 101 judges that the near-end speaker's voice is present, and a time period during which the intermediate state is continued is not less than a previously set time period during which the intermediate state is held, the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number ⁇ circle over (3) ⁇ ).
- the preceding speech communication state is the intermediate state (II) when the near-end speaker's voice detector 101 judges that the near-end speaker's voice is present
- a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held
- a speech communication state before the current intermediate state is the near-end speaker speech communication state (I)
- the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number ⁇ circle over (3) ⁇ ).
- the preceding speech communication state is the intermediate state (II) when the near-end speaker's voice detector 101 judges that the near-end speaker's voice is present
- a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held
- a state before the current intermediate state is other than the near-end speaker speech communication state (I)
- the current speech communication state is determined as the intermediate state (II) (the transition number ⁇ circle over (4) ⁇ ).
- the preceding speech communication state is the intermediate state (II) when the far-end speaker's voice detector 103 judges that the far-end speaker's voice is present, and a time period during which the intermediate state is continued is not less than a time period during which the intermediate state is held, the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number ⁇ circle over (6) ⁇ ).
- the preceding speech communication state is the intermediate state (II) when the far-end speaker's voice detector 103 judges that the far-end speaker's voice is present
- a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held
- a state before the current intermediate state is the far-end speaker speech communication state (III)
- the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number ⁇ circle over (6) ⁇ ).
- the preceding speech communication state is the intermediate state (II) when the far-end speaker's voice detector 103 judges that the far-end speaker's voice is present, a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held, and a state before the current intermediate state is other than the far-end speaker speech communication state (III), the current speech communication state is determined as the intermediate state (II) (the transition number ⁇ circle over (4) ⁇ ).
- the current speech communication state is determined as the intermediate state (II) (the transition number ⁇ circle over (4) ⁇ ).
- FIG. 15 illustrates attenuation amounts by the attenuators 102 and 104 in each of the speech communication states and attenuation amounts by the attenuators 102 and 104 in a case where the transition of the speech communication state occurs.
- the speech communication state is the near-end speaker speech communication state (I)
- the attenuation amount by the attenuator 102 is set to a low level (the near-end speaker's voice level is set to a speech communication level), and the attenuation amount by the attenuator 104 is set to a high level (the far-end speaker's voice level is set to an attenuation level), as indicated by a section C in FIG. 15.
- the speech communication state is the far-end speaker speech communication state (III)
- the attenuation amount by the attenuator 102 is set to a high level (the near-end speaker's voice level is set to an attenuation level), and the attenuation amount by the attenuator 104 is set to a low level (the far-end speaker's voice level is set to a speech communication level), as indicated by a section G in FIG. 15.
- the speech communication state is the intermediate state (II)
- the attenuation amount by the attenuator 102 is set to an intermediate level (the near-end speaker's voice level is set to an intermediate level)
- the attenuation amount by the attenuator 104 is set to an intermediate level (the far-end speaker's voice level is set to an intermediate level), as indicated by a section A or E in FIG. 15.
- the attenuation amount by the attenuator 102 is controlled such that the near-end speaker's voice level is rapidly changed from the intermediate level to the speech communication level
- the attenuation amount by the attenuator 104 is controlled such that the far-end speaker's voice level is rapidly changed from the intermediate level to the attenuation level, as indicated by a section B in FIG. 15.
- the attenuation amount by the attenuator 102 is controlled such that the near-end speaker's voice level is gently changed from the speech communication level to the intermediate level
- the attenuation amount by the attenuator 104 is controlled such that the far-end speaker's voice level is gently changed from the attenuation level to the intermediate level, as indicated by a section D in FIG. 15.
- the attenuation amount by the attenuator 102 is controlled such that the near-end speaker's voice level is rapidly changed from the intermediate level to the attenuation level
- the attenuation amount by the attenuator 104 is controlled such that the far-end speaker's voice level is rapidly changed from the intermediate level to the speech communication level, as indicated by a section F in FIG. 15.
- the attenuation amount by the attenuator 102 is controlled such that the near-end speaker's voice level is gently changed from the attenuation level to the intermediate level
- the attenuation amount by the attenuator 104 is controlled such that the far-end speaker's voice level is gently changed from the speech communication level to the intermediate level, as indicated by a section H in FIG. 15.
- the attenuation amounts are increased or decreased such that the product of the attenuation amount by the attenuator 102 , the attenuation amount by the attenuator 104 , and a loop gain is less than 1.0.
- the current speech communication state is determined on the basis of not the level of the input signal but the judgment whether the input voice is present or absent. Accordingly, the communication state is not easily affected by variations in level by movement of a near-end speaker, a line fault, and so forth.
- the near-end speaker speech communication state even if it is judged that the near-end speaker's voice is absent, the near-end speaker speech communication state is maintained when a state where the near-end speaker's voice is absent is shorter than a time period during which the ending of a word is held. Accordingly, the ending of the word is not easily cut.
- the near-end speaker speech communication state even if it is judged that the far-end speaker's voice is absent, the near-end speaker speech communication state is maintained when a state where the far-end speaker's voice is absent is shorter than a time period during which the ending of a word is held. Accordingly, the ending of the word is not easily cut.
Abstract
A digitized input signal is sampled, to obtain a reference input signal. The reference input signal is spuriously whitened, to obtain a pseudo whitened signal. An echo replica signal is generated on the basis of the pseudo whitened signal and an adaptive filter coefficient. A cancellation error signal is obtained on the basis of an echo signal and the echo replica signal. The adaptive filter coefficient is updated on the basis of the cancellation error signal, the adaptive filter coefficient, and the pseudo whitened signal.
Description
- The present invention relates generally to an echo canceling method and an echo canceller, and more particularly, to an echo canceling method and an echo canceller which are utilized in order to realize full duplex in a hands-free telephone set or a television conference, for example.
- Furthermore, the present invention relates to a voice switch used for a hands-free speech communication system capable of carrying out telephone conversation using a speaker and a microphone.
- [1] In an echo canceller utilized in order to realize full duplex in a hands-free telephone set, a television conference, and so forth, an adaptive filter coefficient has been conventionally updated using an alternate voice, to estimate an impulse response of an echo path. As this estimation algorithm, the Normalized Least Mean Square Method (the NLMS Method) having a relatively small amount of operation has been frequently used.
- FIG. 1 illustrates an example of a
conventional echo canceller 1. Theecho canceller 1 is constructed as a hybrid (line) echo canceller for canceling a hybrid echo, and updates an adaptive filter coefficient by the NLMS Method. - Referring to FIGS. 1 and 2, description is made of the operation of the
echo canceller 1. - An echo signal y, an echo replica signal (a pseudo echo signal) Y, an adaptive filter coefficient, a value x in a reference input signal buffer, a cancellation error signal e, and so forth are initialized (step 1).
- A microphone input signal which is digitized by an analog-to-digital (A/D)
converter 2 is sampled, and is inputted to a referenceinput signal buffer 3 as a reference input signal X (step 3). - An adaptive filter coefficient Pj(i) in an
adaptive filter 4 and the reference input signal X, i.e., a value xj(i) in the referenceinput signal buffer 3 at time j are multiplied and accumulated by a multiply and accumulateunit 5, thereby to generate an echo replica signal Yj at the time j, as expressed by the following equation (1) (step 5): - A
subtractor 7 subtracts the echo replica signal Yj from an echo signal yj outputted from an A/D converter 6, thereby to calculate a cancellation error signal ej at the time j, as expressed by the following equation (2), (step 7): - ej=yj−Yj (2)
- Thereafter, an adaptive filter coefficient Pj+1(i) is updated by a
coefficient updating unit 8 on the basis of the cancellation error signal ej the adaptive filter coefficient Pj(i), and the reference input signal X (=xj(i)) at the time j, as expressed by the following equation (3) (step 9). That is, an adaptive filter coefficient at time (j+1) is found: - The processing at the
foregoing steps 3 to 9 is repeated, so that the adaptive filter coefficient is updated. - In the above-mentioned equations (1) to (3), yj denotes an echo signal at the time j, Yj denotes an echo replica signal at the time j, Pj(i) denotes a coefficient of the i-th delay element in the adaptive filter at the time j, xj(i) denotes the i-th value of the reference input signal buffer at the time j ej denotes a cancellation error signal at the time j, N denotes the number of taps in the adaptive filter, and μ denotes a relaxation coefficient called a step gain. The same is true for embodiments of the invention, described later.
- In the above-mentioned
echo canceller 1, the adaptive filter coefficient is updated along the vector of the reference input signal X(=xj (i)), as expressed by the foregoing equation (3). However, the reference input signal is a voice signal which is high in auto-correlation, so that the learning speed is reduced. The vector of the reference input signal is a value, grasped as a vector, in the referenceinput signal buffer 3. - As indicated by the second term on the right side of the equation (3), μej·xj (i) is normalized by the norm=Σxj(i)2 of the vector of the reference signal. Accordingly, the learning precision in a frequency area having a small number of frequency components is degraded by the deviation in frequency components of a voice signal.
- When an impulse response of an echo path is estimated using an alternate voice, as in the
echo canceller 1, therefore, frequency components of an input signal deviate. Even when learning is sufficiently performed, therefore, howling may, in some cases, occur. - The frequency characteristics of a voice signal are generally as shown in FIGS. 3a and 3 b. That is, voiced speech (a voiced sound) has the property of decreasing in level by 6 dB when the frequency thereof increases by one octave (−6 dB/oct), as shown in FIG. 3a. Unvoiced speech (a voiceless sound) has the property of increasing in level by 6 dB when the frequency thereof increases by one octave (+6 dB/oct), as shown in FIG. 3b.
- In order to improve the learning speed and the learning precision of an echo canceller using the NLMS Method, therefore, it is considered that the deviation in frequency characteristics of a signal used for learning is decreased.
- Therefore, it is considered that a
whitening filter 9 for decreasing the deviation in frequency characteristics of a voice signal is inserted between the A/D converter 2 and a digital-to-analog (D/A)converter 9, as in an echo canceller 1 a shown in FIG. 4. In the echo canceller 1 a, however, an output signal of thewhitening filter 9 is outputted toward the hybrid side through the D/A converter 9, so that the sound quality of the output signal is degraded. - An object of the present invention is to provide echo canceling means and an echo canceller capable of improving the learning speed and the learning precision without degrading the sound quality of an output signal.
- [2] In a voice switch used for a hands-free speech communication system, a signal in a communication path through which the voice of one of a near-end speaker and a far-end speaker who is talking by phone passes is passed, while a signal in a communication path through which the voice of the speaker who is talking by phone does not pass is attenuated by an attenuator, thereby preventing an echo from being returned to the communication path through which the voice of the speaker who is talking by phone does not pass.
- In the voice switch, when one of the near-end speaker and the far-end speaker starts to talk by phone from a state where both the speakers do not talk by phone, the beginning or the ending, for example, of a word may, in some cases, be cut.
- An object of the present invention is to provide a voice switch capable of preventing the beginning or the ending of a word from being cut, for example, when one of a near-end speaker and a far-end speaker starts to talk by phone from a state where both the speakers do not talk by phone as well as capable of carrying out more natural telephone conversation which hardly has a switching feeling.
- An echo canceling method according to the present invention is an echo canceling method for updating an adaptive filter coefficient utilizing a digitized input signal to cancel an echo, characterized by comprising the steps of obtaining a reference input signal from the input signal; spuriously whitening the reference input signal, to obtain a pseudo whitened signal; generating an echo replica signal on the basis of the pseudo whitened signal and the adaptive filter coefficient; obtaining a cancellation error signal on the basis of an echo signal and the echo replica signal; and updating the adaptive filter coefficient on the basis of the cancellation error signal, the adaptive filter coefficient and the pseudo whitened signal.
- An echo canceller according to the present invention is an echo canceller for updating an adaptive filter coefficient utilizing a digitized input signal to cancel an echo, comprising whitening means for spuriously whitening a reference input signal obtained from the input signal, to obtain a pseudo whitened signal; echo replica signal generation means for generating an echo replica signal on the basis of the pseudo whitened signal and the adaptive filter coefficient; cancellation error signal calculation means for obtaining a cancellation error signal on the basis of the echo signal and the echo replica signal; and coefficient updating means for updating the adaptive filter coefficient on the basis of the cancellation error signal, the adaptive filter coefficient and the pseudo whitened signal.
- The whitening means is composed of an IIR filter or an FIR filter, for example.
- In the echo canceling method and the echo canceller, the reference input signal obtained by sampling the digitized input signal is spuriously whitened by the whitening means composed of the IIR filter, the FIR filter, or the like, to obtain the pseudo whitened signal in which the deviation in frequency of the input signal is decreased. That is, the voice signal that is the reference input signal has the property of varying in level as the frequency thereof increases. In order to decrease the deviation in frequency of the reference input signal, therefore, a filter capable of reducing the variation in level corresponding to the increase in frequency of the reference input signal is used, to whiten the reference input signal by filtering.
- The echo replica signal is generated on the basis of the pseudo whitened signal whose deviation in frequency is decreased and the adaptive filter coefficient, and the cancellation error signal is obtained on the basis of the echo signal and the echo replica signal. Specifically, the pseudo whitened signal and the adaptive filter coefficient are multiplied and accumulated, to generate the echo replica signal. The echo replica signal is subtracted from the echo signal, to obtain the cancellation error signal. Thereafter, the adaptive filter coefficient is updated on the basis of the cancellation error signal, the adaptive filter coefficient, and the pseudo whitened signal.
- The pseudo whitened signal is obtained from the reference input signal obtained by sampling the input signal, and the input signal is fed to the D/A converter as it is. Accordingly, an output signal obtained by the D/A converter is outputted without degrading the sound quality thereof.
- A first voice switch according to the present invention is characterized by comprising near-end speaker's voice judgment means for judging whether a near-end speaker's voice is present or absent; far-end speaker's voice judgment means for judging whether a far-end speaker's voice is present or absent; and speech communication state determination means for determining which of a near-end speaker speech communication state, a far-end speaker speech communication state, and an intermediate state is the current speech communication state on the basis of the results of the judgment by the near-end speaker's voice judgment means and the far-end speaker's voice judgment means, the preceding speech communication state determined, and the hysteresis of speech communication states preceding the preceding speech communication state.
- A second voice switch according to the present invention is characterized by comprising near-end speaker's voice attenuation means for attenuating a near-end speaker's voice; far-end speaker's voice attenuation means for attenuating a far-end speaker's voice; near-end speaker's voice judgment means for judging whether the near-end speaker's voice is present or absent; far-end speaker's voice judgment means for judging whether the far-end speaker's voice is present or absent; speech communication state determination means for determining which of a near-end speaker speech communication state, a far-end speaker speech communication state and an intermediate state is the current speech communication state on the basis of the results of the judgment by the near-end speaker's voice judgment means and the far-end speaker's voice judgment means, the preceding speech communication state determined, and the hysteresis of speech communication states preceding the preceding speech communication state; means for controlling, when it is determined that the current speech communication state is the near-end speaker speech communication state, an attenuation amount by the near-end speaker's voice attenuation means at a low level, while controlling an attenuation amount by the far-end speaker's voice attenuation means at a high level; means for controlling, when it is determined that the current speech communication state is the far-end speaker speech communication state, an attenuation amount by the near-end speaker's voice attenuation means at a high level, while controlling an attenuation amount by the far-end speaker's voice attenuation means at a low level; and means for controlling, when it is determined that the current speech communication state is the intermediate state, both the attenuation amount by the near-end speaker's voice attenuation means and the attenuation amount by the far-end speaker's voice attenuation means at an intermediate level, the speech communication state determination means comprising means for determining, when the transition of the speech communication state between the near-end speaker speech communication state and the far-end speaker speech communication state occurs, the speech communication state such that the transition always occurs via the intermediate state.
- It is preferable that the speech communication state determination means comprises, in a case where the transition from the near-end speaker speech communication state or the far-end speaker speech communication state to the intermediate state occurs, means for determining, when it is judged that the near-end speaker's voice or the far-end speaker's voice is present after the intermediate state is continued for not less than a predetermined time period, the speech communication state so as to proceed to a speaker speech communication state corresponding to the speaker's voice which is judged to be present, determining, when it is judged that the speaker's voice in a direction of speech communication before the transition to the intermediate state is present in a case where the time period during which the intermediate state is continued is shorter than the predetermined time period, the speech communication state so as to immediately return to a speaker speech communication state before the transition, and determining, even when it is judged that the speaker's voice in a direction of speech communication opposite to the direction of speech communication before the transition to the intermediate state is present in a case where a time period during which the intermediate state is continued is shorter than the predetermined time period, the speech communication state so as to maintain the intermediate state.
- The number of types of the intermediate states is not limited to one. A plurality of types of intermediate states may be set.
- According to the voice switch, in a case where one of a near-end speaker and a far-end speaker starts to talk by phone from a state where both the speakers do not talk by phone, it is possible to prevent the beginning or the ending of a word from being cut, for example, as well as to carry out more natural telephone conversation which hardly has a switching feeling.
- FIG. 1 is a block diagram showing a conventional echo canceller;
- FIG. 2 is a flow chart showing an example of the operation of a conventional technique shown in FIG. 1;
- FIGS. 3a and 3 b are graphs showing frequency characteristics of a voice signal;
- FIG. 4 is a functional block diagram showing an example of another echo canceller;
- FIG. 5 is a block diagram showing the configuration of an echo canceller;
- FIG. 6 is a functional block diagram showing the function of the echo canceller shown in FIG. 5;
- FIG. 7 is a diagram showing an equivalent circuit of a principal part of FIG. 6;
- FIG. 8 is a block diagram showing a specific example of a whitening filter;
- FIG. 9 is a graph showing the frequency characteristics of the whitening filter shown in FIG. 8;
- FIG. 10 is a flow chart showing the operation of the echo canceller shown in FIG. 5;
- FIG. 11a is a graph showing the effect of a learning method in the echo canceller shown in FIG. 5 in comparison with the conventional NLMS Method, and FIG. 11b is a waveform diagram showing an input voice signal;
- FIGS. 12a and 12 b are graphs showing the characteristics of a whitening filter;
- FIG. 13 is a block diagram showing the configuration of a voice switch;
- FIG. 14 is a schematic view showing the type of speech communication state and the type of transition of the speech communication state; and
- FIG. 15 is a timing chart showing attenuation amounts by
attenuators attenuators - [1] Description of First Embodiment
- Referring now to FIGS.5 to 12, a first embodiment of the present invention will be described.
- FIG. 5 illustrates an
echo canceller 10 and its peripheral circuits. - The
echo canceller 10 comprises aCPU 12, aROM 14, and aRAM 16. - The
ROM 14 stores a program for controlling the operation of theecho canceller 10, including the foregoing equations for calculation (1) to (3), and a previously set data. The data stored in theROM 14 include the number of taps N in an adaptive filter 28 (described later), a step gain μ, and so forth. - The
RAM 16 temporarily stores data such as a calculated value obtained by an operation in theCPU 12. The data stored in theRAM 16 include an echo signal y, an echo replica signal Y, an adaptive filter coefficient, a value x in a reference input signal buffer, a cancellation error signal e, and so forth. The number of taps N in the adaptive filter and the step gain μ may be stored in theRAM 16. - The
CPU 12 is operated using the program and the data which are stored in theROM 14 and theRAM 16, to realize theecho canceller 10. - FIG. 6 is a functional block diagram showing the function of the
echo canceller 10 shown in FIG. 5. - The
echo canceller 10 shown in FIG. 6 is an example constructed as a hybrid echo canceller for canceling a hybrid echo. Theecho canceller 10 comprises awhitening filter 18 for emphasizing a high frequency region. Thewhitening filter 18 is composed of an IIR (Infinite Impulse Response) filter, for example. - A signal obtained by digitizing a microphone input signal using an A/
D converter 20 is sampled, and is inputted as a reference input signal X to thewhitening filter 18. A pseudo whitened signal X1 is outputted from the whiteningfilter 18. The pseudo whitened signal X1 is temporarily stored in a referenceinput signal buffer 22. - The pseudo whitened signal X1 stored in the reference
input signal buffer 22 is fed to a multiply and accumulateunit 24 and acoefficient updating unit 26 at predetermined timing. In the multiply and accumulateunit 24, an echo replica signal Y is calculated on the basis of the pseudo whitened signal X1 and an adaptive filter coefficient in anadaptive filter 28. - A
subtractor 30 subtracts the echo replica signal Y from an echo signal y from an A/D converter 32, to obtain a cancellation error signal e. The cancellation error signal e is converted into an analog signal by a D/A converter 34, and the analog signal is then outputted as a speaker output signal. In acoefficient updating unit 26, the adaptive filter coefficient is updated such that it approaches an impulse response H (z) of an echo path on the basis of the pseudo whitened signal X1, the adaptive filter coefficient, and the cancellation error signal e. - The
echo canceller 10 is characterized in the place where thewhitening filter 18 is inserted. Thewhitening filter 18 is inserted into not a path A from the A/D converter 20 to a D/A converter 36 but a path B branched from the path A. Consequently, the digitized microphone input signal from the A/D converter 20 is fed as it is to the D/A converter 36, so that the sound quality of a hybrid output signal outputted from the D/A converter 36 is not degraded. - FIG. 7 illustrates an equivalent circuit of a principal part of the
echo canceller 10 shown in FIG. 6. As can be seen from FIG. 7, the impulse response of the echo path as viewed from anecho canceller 10 a is changed into H(z)·1/C(z) by inserting thewhitening filter 18. That is, a hybrid output signal outputted from aninverse filter 18 a becomes a value equal to the reference input signal X. Accordingly, theecho canceller 10 a can estimate the impulse response H(z) of the echo path in a case where the same signal as the reference input signal X is outputted as the hybrid output signal on the basis of the pseudo whitened signal X1. Consequently, there arises no problem in an operation of estimating the impulse response H(z) of the echo path. - A 1st order IIR-type high-pass filter as shown in FIG. 8, for example, is used as the
whitening filter 18. The 1st order IIR-type high-pass filter is a high-pass emphasizing filter whose cut-off frequency corresponding to a sampling signal having a frequency of 8 KHz is set to 2 KHz, to increase a voice signal in level by 3 dB as the frequency thereof increases by one octave. Voiced speech in the voice signal has the property of decreasing in level by approximately 6 dB every time the frequency thereof statistically increases by one octave. By using the 1st order IIR type high-pass filter, however, the attenuation characteristics of the voice signal are reduced, thereby obtaining a pseudo whitened signal X1 in which the deviation in frequency of the voice signal is decreased. - The
whitening filter 18 hasmultipliers circuits adder 48. The frequency characteristics of thewhitening filter 18 are as shown in FIG. 9. As can be seen from the coefficient of thewhitening filter 18, the whiteningfilter 18 performs the function of canceling 1st order auto-correlation. - When the
whitening filter 18 is used, there are few frequency components which are less than approximately 300 Hz. Accordingly, learning in a region having few frequency components may be degraded. When theecho canceller 10 is employed for a telephone system, for example, however, the frequency band is limited such that its normal frequency band becomes 300 Hz to 3200 Hz, which does not particularly cause a problem. - In the
echo canceller 10, the adaptive filter coefficient is updated by the NLMS Method using the pseudo whitened signal X1 which has been spuriously whitened by the whiteningfilter 18. - Referring to FIG. 10, the operation of the
echo canceller 10 will be described. - First, an echo signal y, an echo replica signal Y, an adaptive filter coefficient, a value x in the reference
input signal buffer 22, a cancellation error signal e, and so forth which are stored in theRAM 10 are first initialized (step 11). - A microphone input signal which has been digitized by the A/
D converter 20 is sampled, and is inputted to thewhitening filter 18 as a reference input signal X. The reference input signal X is filtered by the whiteningfilter 18, to obtain a pseudo whitened signal X1 (step 13). The obtained pseudo whitened signal X1 is inputted to the reference input signal buffer 22 (step 15). - As expressed by the foregoing equation (1), an adaptive filter coefficient Pj(i) in the
adaptive filter 28 and the pseudo whitened signal X1, i.e. a value xj(i) in the referenceinput signal buffer 22 at time j are multiplied and accumulated by the multiply and accumulateunit 24, to generate an echo replica signal Yj at the time j. - As expressed by the foregoing equation (2), the
subtractor 30 subtracts the echo replica signal Yj from an echo signal yj outputted from the A/D converter 32, to calculate a cancellation error signal ej at the time j (step 19). - Thereafter, as expressed by the foregoing equation (3), an adaptive filter coefficient Pj+1(j) is updated on the basis of the cancellation error signal ej, the adaptive filter coefficient Pj(i), and the pseudo whitened signal X1 (=Xj(i)) at the time j by the
coefficient updating unit 26. That is, an adaptive filter coefficient at time (j+1) is found. - The processing at the foregoing steps 11 to 21 is repeated, thereby updating the adaptive filter coefficient.
- According to the
echo canceller 10, learning can be performed using the pseudo whitened signal X1 which hardly deviates in frequency, that is, is low in auto-correlation, thereby making it possible to improve the learning speed and the learning precision. - Not an output of the
whitening filter 18 but an output of the A/D converter 20 (a digital signal corresponding to the microphone input signal) is fed as it is to the D/A converter 36 for generating a hybrid output signal, so that the sound quality of the hybrid output signal is not degraded. - The
echo canceller 10 is constructed by only adding thewhitening filter 18 for spurious whitening to theconventional echo canceller 1. Accordingly, an echo canceller, whose capability is improved, can be realized in approximately the same amount of processing as that by theconventional echo canceller 1. - Furthermore, a learning method in the echo canceller10 (a whitening filter+the NLMS Method) and the NLMS Method in the
conventional echo canceller 1 shown in FIG. 1 are compared with each other by calculating evaluated values using the following equation (4). The evaluated value represents the progress of learning. If the learning progresses, the evaluated value approaches 1.0. In the equation (4), H (i) indicates an impulse response of an echo path, and h(i) indicates a learning coefficient. The evaluated value is calculated by inputting a voice signal shown in FIG. 11b under common conditions that the step gain μ is 0.05 and the number of taps is 128: - As can be seen from FIG. 11a, the learning in the
echo canceller 10 progresses at higher speed, as compared with that in theconventional echo canceller 1. - As described above, in order to improve the learning speed and the learning precision in the NLMS Method, the deviation in frequency of the voice signal to be the reference input signal X may be decreased. For example, if a whitening filter having the property of increasing a voice signal in level by 5 to 6 dB every time the frequency thereof increases by one octave, as shown in FIG. 12a, is used, it is possible to cancel the attenuation of the level of voiced speech.
- When the whitening filter is used with respect to unvoiced speech, however, results as shown in FIG. 12b are obtained. Accordingly, the learning speed may be reduced and the learning precision may be degraded. Therefore, it is considered that different whitening filters are respectively prepared with respect to the voiced speech and the unvoiced speech. When the property of the whitening filter is changed for each input signal, however, an impulse response H(z) of an echo path varies as viewed from the
echo canceller 10, so that the performance of the whitening filter is rather degraded. - Actually, the appearance ratio of the voiced speech and the appearance ratio of the unvoiced speech differ in general conversation. Further, when processing of stopping the learning when it is judged that the input voice is absent is performed as control of the echo canceller, the frequency at which the learning is stopped is increased with respect to the unvoiced speech which is relatively low in level. By using a whitening filter which produces a large effect as a whole in consideration of the foregoing, therefore, it is possible to improve the learning speed and the learning precision.
- It is preferable that the characteristics of the whitening filter are determined by the statistical frequencies of appearance of voiced speech and unvoiced speech and a method of controlling the learning in the echo canceller. The whitening filter maybe constituted by an FIR (Finite Impulse Response) filter. The
CPU 12 may be replaced with a DSP. - The present invention is applicable to not only the hybrid echo canceller but also an acoustic echo canceller. The
echo canceller 10 is also applicable to a facsimile modem with a voice recording/reproduction function, for example. - According to the above-mentioned embodiment, the pseudo whitening filter is inserted, thereby making it possible to update the adaptive filter coefficient using the pseudo whitened signal whose deviation in frequency is decreased, and improve the learning speed and the learning precision without substantially changing the echo canceller. Only the reference input signal in the echo canceller is spuriously whitened, to generate the pseudo whitened signal. Accordingly, the sound quality of a signal outputted outward is not degraded.
- [2] Description of Second Embodiment
- Referring now to FIGS.13 to 15, a second embodiment of the present invention will be described.
- FIG. 13 illustrates the configuration of a voice switch.
- The voice switch comprises a near-end speaker's voice detector (near-end speaker's voice judgment means)101 for detecting a near-end speaker's voice which is sent to a
transmission path 111, anattenuator 102 provided in thetransmission path 111, a far-end speaker's voice detector (far-end speaker's voice judgment means) 103 for detecting a far-end speaker's voice which is sent to a receivingpath 112, anattenuator 104 provided in the receivingpath 112, and acontrol unit 105 for respectively controlling theattenuators speech detectors - The near-end speaker's
voice detector 101 judges whether the near-end speaker's voice is present or absent, and sends the result of the judgment to thecontrol unit 105. For example, when the power average of a voice signal fed to the transmission path Ill is larger than a power average corresponding to noises stationarily produced, it is judged that the near-end speaker's voice is present. On the other hand, when the power average of the voice signal fed to thetransmission path 111 is not more than the power average corresponding to noises stationarily produced, it is judged that the near-end speaker's voice is absent. The far-end speaker'svoice detector 103 judges whether the far-end speaker's voice is present or absent, and sends the result of the judgment to thecontrol unit 105. - FIG. 14 illustrates the type of speech communication state and the type of transition of the speech communication state.
- The type of speech communication state include the following three states.
- (I) A state where a near-end speaker is talking by phone (referred to as a near-end speaker speech communication state (I))
- (II) An intermediate state (referred to as an intermediate state (II))
- (III) A state where a far-end speaker is talking by phone (referred to as a far-end speaker speech communication state (III))
- In FIG. 14, {circle over (1)} to {circle over (7)} represent the types of transition.
- {circle over (1)} indicates the transition from the near-end speaker speech communication state (I) to the near-end speaker speech communication state (I).
- {circle over (2)} indicates the transition from the near-end speaker speech communication state (I) to the intermediate state (II).
- {circle over (3)} indicates the transition from the intermediate state (II) to the near-end speaker speech communication state (I).
- {circle over (4)} indicates the transition from the intermediate state (II) to the intermediate state (II).
- {circle over (5)} indicates the transition from the far-end speaker speech communication state (III) to the intermediate state (II).
- {circle over (6)} indicates the transition from the intermediate state (II) to the far-end speaker speech communication state (III).
- {circle over (7)} indicates the transition from the far-end speaker speech communication state (III) to the far-end speaker speech communication state (III).
- The
control unit 105 determines the current speech communication state (a speech communication state after the transition) on the basis of the results of judgment whether the speaker's voice is present or absent by the near-end speaker'svoice detector 101 and the far-end speaker'svoice detector 103, the preceding speech communication state determined (a speech communication state before the transition), and the hysteresis of speech communication states preceding the preceding speech communication state. Theattenuators - Description is now made of a method of judging the speech communication state by the
control unit 105. - (1) In a case where the preceding speech communication state is the near-end speaker speech communication state (I), when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is present, the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number {circle over (1)}). - (2) In a case where the preceding speech communication state is the near-end speaker speech communication state (I), when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is absent, and a time period during which a state where the near-end speaker's voice is absent is continued is less than a previously set time period during which the ending of a word is held, the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number {circle over (1)}). - (3) In a case where the preceding speech communication state is the near-end speaker speech communication state (I), when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is absent, and a time period during which a state where the near-end speaker's voice is absent is continued is not less than a time period during which the ending of a word is held, the current speech communication state is determined as the intermediate state (II) (the transition number {circle over (2)}). - (4) In a case where the preceding speech communication state is the far-end speaker speech communication state (III), when the far-end speaker's
voice detector 103 judges that the far-end speaker's voice is present, the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number {circle over (7)}). - (5) In a case where the preceding speech communication state is the far-end speaker speech communication state (III), when the far-end speaker's
voice detector 103 judges that the far-end speaker's voice is absent, and a time period during which a state where the far-end speaker's voice is absent is continued is less than a time period during which the ending of a word is held, the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number {circle over (7)}). - (6) In a case where the preceding speech communication state is the far-end speaker speech communication state (III), when the far-end speaker's
voice detector 103 judges that the far-end speaker's voice is absent, and a time period during which a state where the far-end speaker's voice is absent is continued is not less than a time period during which the ending of a word is held, the current speech communication state is determined as the intermediate state (II) (the transition number {circle over (5)}). - (7) In a case where the preceding speech communication state is the intermediate state (II) when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is present, and a time period during which the intermediate state is continued is not less than a previously set time period during which the intermediate state is held, the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number {circle over (3)}). - (8) In a case where the preceding speech communication state is the intermediate state (II) when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is present, a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held, and a speech communication state before the current intermediate state is the near-end speaker speech communication state (I), the current speech communication state is determined as the near-end speaker speech communication state (I) (the transition number {circle over (3)}). - (9) In a case where the preceding speech communication state is the intermediate state (II) when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is present, a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held, and a state before the current intermediate state is other than the near-end speaker speech communication state (I), the current speech communication state is determined as the intermediate state (II) (the transition number {circle over (4)}). - (10) In a case where the preceding speech communication state is the intermediate state (II) when the far-end speaker's
voice detector 103 judges that the far-end speaker's voice is present, and a time period during which the intermediate state is continued is not less than a time period during which the intermediate state is held, the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number {circle over (6)}). - (11) In a case where the preceding speech communication state is the intermediate state (II) when the far-end speaker's
voice detector 103 judges that the far-end speaker's voice is present, a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held, and a state before the current intermediate state is the far-end speaker speech communication state (III), the current speech communication state is determined as the far-end speaker speech communication state (III) (the transition number {circle over (6)}). - (12) In a case where the preceding speech communication state is the intermediate state (II) when the far-end speaker's
voice detector 103 judges that the far-end speaker's voice is present, a time period during which the intermediate state is continued is less than a time period during which the intermediate state is held, and a state before the current intermediate state is other than the far-end speaker speech communication state (III), the current speech communication state is determined as the intermediate state (II) (the transition number {circle over (4)}). - (13) In a case where the preceding speech communication state is the intermediate state (II) when the near-end speaker's
voice detector 101 judges that the near-end speaker's voice is absent, and the far-end speaker'svoice detector 103 judges that the far-end speaker's voice is absent, the current speech communication state is determined as the intermediate state (II) (the transition number {circle over (4)}). - FIG. 15 illustrates attenuation amounts by the
attenuators attenuators - When the speech communication state is the near-end speaker speech communication state (I), the attenuation amount by the
attenuator 102 is set to a low level (the near-end speaker's voice level is set to a speech communication level), and the attenuation amount by theattenuator 104 is set to a high level (the far-end speaker's voice level is set to an attenuation level), as indicated by a section C in FIG. 15. - When the speech communication state is the far-end speaker speech communication state (III), the attenuation amount by the
attenuator 102 is set to a high level (the near-end speaker's voice level is set to an attenuation level), and the attenuation amount by theattenuator 104 is set to a low level (the far-end speaker's voice level is set to a speech communication level), as indicated by a section G in FIG. 15. - When the speech communication state is the intermediate state (II), the attenuation amount by the
attenuator 102 is set to an intermediate level (the near-end speaker's voice level is set to an intermediate level), and the attenuation amount by theattenuator 104 is set to an intermediate level (the far-end speaker's voice level is set to an intermediate level), as indicated by a section A or E in FIG. 15. - In the case of the transition from the intermediate state (II) to the near-end speaker speech communication state (I) in FIG. 14 (the transition number {circle over (3)}), the attenuation amount by the
attenuator 102 is controlled such that the near-end speaker's voice level is rapidly changed from the intermediate level to the speech communication level, and the attenuation amount by theattenuator 104 is controlled such that the far-end speaker's voice level is rapidly changed from the intermediate level to the attenuation level, as indicated by a section B in FIG. 15. - In the case of the transition from the near-end speaker speech communication state (I) to the intermediate state (II) in FIG. 14 (the transition number {circle over (2)}), the attenuation amount by the
attenuator 102 is controlled such that the near-end speaker's voice level is gently changed from the speech communication level to the intermediate level, and the attenuation amount by theattenuator 104 is controlled such that the far-end speaker's voice level is gently changed from the attenuation level to the intermediate level, as indicated by a section D in FIG. 15. - In the case of the transition from the intermediate state (II) to the far-end speaker speech communication state (III) in FIG. 14 (the transition number {circle over (6)}), the attenuation amount by the
attenuator 102 is controlled such that the near-end speaker's voice level is rapidly changed from the intermediate level to the attenuation level, and the attenuation amount by theattenuator 104 is controlled such that the far-end speaker's voice level is rapidly changed from the intermediate level to the speech communication level, as indicated by a section F in FIG. 15. - In the case of the transition from the far-end speaker speech communication state (III) to the intermediate state (II) in FIG. 14 (the transition number {circle over (5)}), the attenuation amount by the
attenuator 102 is controlled such that the near-end speaker's voice level is gently changed from the attenuation level to the intermediate level, and the attenuation amount by theattenuator 104 is controlled such that the far-end speaker's voice level is gently changed from the speech communication level to the intermediate level, as indicated by a section H in FIG. 15. - In the above-mentioned control of the attenuation amounts, the attenuation amounts are increased or decreased such that the product of the attenuation amount by the
attenuator 102, the attenuation amount by theattenuator 104, and a loop gain is less than 1.0. - According to the above-mentioned embodiment, the current speech communication state is determined on the basis of not the level of the input signal but the judgment whether the input voice is present or absent. Accordingly, the communication state is not easily affected by variations in level by movement of a near-end speaker, a line fault, and so forth.
- The transition between the near-end speaker speech communication state and the far-end speaker speech communication state always occurs via the intermediate state, so that a switching feeling is reduced.
- In a time period from the transition to the intermediate state to the time when a time period during which the intermediate state is held has elapsed, the intermediate state is maintained in principle, thereby making it possible to minimize the cutting of the beginning or the ending of a word.
- Even in a case where the transition to the intermediate state occurs, and a time period during which the intermediate state is continued is shorter than a time period during which the intermediate state is held, when it is judged that the speaker's voice in the same direction of speech communication as that in a speaker speech communication state before the transition to the intermediate state is present, the intermediate state is rapidly returned to the speaker speech communication state before the transition to the intermediate state. Accordingly, an operation in a section where speaker's voice is absent, such as a breathing portion, is stabilized.
- Furthermore, in the case of the near-end speaker speech communication state, even if it is judged that the near-end speaker's voice is absent, the near-end speaker speech communication state is maintained when a state where the near-end speaker's voice is absent is shorter than a time period during which the ending of a word is held. Accordingly, the ending of the word is not easily cut. Similarly, in the case of the far-end speaker speech communication state, even if it is judged that the far-end speaker's voice is absent, the near-end speaker speech communication state is maintained when a state where the far-end speaker's voice is absent is shorter than a time period during which the ending of a word is held. Accordingly, the ending of the word is not easily cut.
Claims (7)
1-4. (Canceled)
5. A voice switch comprising:
near-end speaker's voice judgment means for judging whether a near-end speaker's voice is present or absent;
far-end speaker's voice judgment means for judging whether a far-end speaker's voice is present or absent; and
speech communication state determination means for determining which of a near-end speaker speech communication state, a far-end speaker speech communication state, and an intermediate state is the current speech communication state on the basis of the results of the judgment by the near-end speaker's voice judgment means and the far-end speaker's voice judgment means, the preceding speech communication state determined, and the hysteresis of speech communication states preceding the preceding speech communication state.
6. The voice switch according to claim 5 , wherein
the speech communication state determination means comprises, in a case where the transition from the near-end speaker speech communication state or the far-end speaker speech communication state to the intermediate state occurs, means for
determining, when it is judged that the near-end speaker's voice or the far-end speaker's voice is present after the intermediate state is continued for not less than a predetermined time period, the speech communication state so as to proceed to a speaker speech communication state corresponding to the speaker's voice which is judged to be present,
determining, when it is judged that the speaker's voice in a direction of speech communication before the transition to the intermediate state is present in a case where the time period during which the intermediate state is continued is shorter than said predetermined time period, the speech communication state so as to immediately return to a speaker speech communication state before the transition, and
determining, even when it is judged that the speaker's voice in a direction of speech communication opposite to the direction of speech communication before the transition to the intermediate state is present in a case where a time period during which the intermediate state is continued is shorter than said predetermined time period, the speech communication state so as to maintain the intermediate state.
7. The voice switch according to claim 5 , wherein a plurality of types of intermediate states are set.
8. A voice switch comprising:
near-end speaker's voice attenuation means for attenuating a near-end speaker's voice;
far-end speaker's voice attenuation means for attenuating a far-end speaker's voice;
near-end speaker's voice judgment means for judging whether the near-end speaker's voice is present or absent;
far-end speaker's voice judgment means for judging whether the far-end speaker's voice is present or absent;
speech communication state determination means for determining which of a near-end speaker speech communication state, a far-end speaker speech communication state and an intermediate state is the current speech communication state on the basis of the results of the judgment by the near-end speaker's voice judgment means and the far-end speaker's voice judgment means, the preceding speech communication state determined, and the hysteresis of speech communication states preceding the preceding speech communication state;
means for controlling, when it is determined that the current speech communication state is the near-end speaker speech communication state, an attenuation amount by the near-end speaker's voice attenuation means at a low level, while controlling an attenuation amount by the far-end speaker's voice attenuation means at a high level;
means for controlling, when it is determined that the current speech communication state is the far-end speaker speech communication state, an attenuation amount by the near-end speaker's voice attenuation means at a high level, while controlling an attenuation amount by the far-end speaker's voice attenuation means at a low level; and
means for controlling, when it is determined that the current speech communication state is the intermediate state, both the attenuation amount by the near-end speaker's voice attenuation means and the attenuation amount by the far-end speaker's voice attenuation means at an intermediate level,
the speech communication state determination means comprising means for determining, when the transition of the speech communication state between the near-end speaker speech communication state and the far-end speaker speech communication state occurs, the speech communication state such that the transition always occurs via the intermediate state.
9. The voice switch according to claim 8 , wherein the speech communication state determination means comprises, in a case where the transition from the near-end speaker speech communication state or the far-end speaker speech communication state to the intermediate state occurs, means for
determining, when it is judged that the near-end speaker's voice or the far-end speaker's voice is present after the intermediate state is continued for not less than a predetermined time period, the speech communication state so as to proceed to a speaker speech communication state corresponding to the speaker's voice which is judged to be present,
determining, when it is judged that the speaker's voice in a direction of speech communication before the transition to the intermediate state is present in a case where the time period during which the intermediate state is continued is shorter than said predetermined time period, the speech communication state to immediately return to a speaker speech communication state before the transition, and
determining, even when it is judged that the speaker's voice in a direction of speech communication opposite to the direction of speech communication before the transition to the intermediate state is present in a case where the time period during which the intermediate state is continued is shorter than said predetermined time period, the speech communication state so as to maintain the intermediate state.
10. The voice switch according to claim 8 , wherein a plurality of types of intermediate states are set.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/834,261 US20040208312A1 (en) | 1997-09-16 | 2004-04-29 | Echo canceling method, echo canceller, and voice switch |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP25046597A JP3561609B2 (en) | 1997-09-16 | 1997-09-16 | Voice switch |
JP9-250465 | 1997-09-16 | ||
JP10-105696 | 1998-03-31 | ||
JP10569698A JP3609611B2 (en) | 1998-03-31 | 1998-03-31 | Echo cancellation method and echo canceller |
US09/508,579 US6868157B1 (en) | 1997-09-16 | 1998-09-10 | Echo canceling method, echo canceller and voice switch |
US10/834,261 US20040208312A1 (en) | 1997-09-16 | 2004-04-29 | Echo canceling method, echo canceller, and voice switch |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/508,579 Division US6868157B1 (en) | 1997-09-16 | 1998-09-10 | Echo canceling method, echo canceller and voice switch |
PCT/JP1998/004107 Division WO1999014868A1 (en) | 1997-09-16 | 1998-09-10 | Echo elimination method, echo canceler and voice switch |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040208312A1 true US20040208312A1 (en) | 2004-10-21 |
Family
ID=26445941
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/508,579 Expired - Fee Related US6868157B1 (en) | 1997-09-16 | 1998-09-10 | Echo canceling method, echo canceller and voice switch |
US10/834,261 Abandoned US20040208312A1 (en) | 1997-09-16 | 2004-04-29 | Echo canceling method, echo canceller, and voice switch |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/508,579 Expired - Fee Related US6868157B1 (en) | 1997-09-16 | 1998-09-10 | Echo canceling method, echo canceller and voice switch |
Country Status (3)
Country | Link |
---|---|
US (2) | US6868157B1 (en) |
EP (2) | EP1569357A1 (en) |
WO (1) | WO1999014868A1 (en) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7194037B1 (en) * | 2000-05-23 | 2007-03-20 | Marvell International Ltd. | Active replica transformer hybrid |
US7280060B1 (en) | 2000-05-23 | 2007-10-09 | Marvell International Ltd. | Communication driver |
US7298173B1 (en) | 2004-10-26 | 2007-11-20 | Marvell International Ltd. | Slew rate control circuit for small computer system interface (SCSI) differential driver |
US20080219431A1 (en) * | 2007-03-09 | 2008-09-11 | Fortemedia, Inc. | Method and apparatus for echo cancellation |
US20090132248A1 (en) * | 2007-11-15 | 2009-05-21 | Rajeev Nongpiur | Time-domain receive-side dynamic control |
US7649483B1 (en) | 2000-05-23 | 2010-01-19 | Marvell International Ltd. | Communication driver |
US7737788B1 (en) | 2005-08-09 | 2010-06-15 | Marvell International Ltd. | Cascode gain boosting system and method for a transmitter |
US7761076B1 (en) | 2000-07-31 | 2010-07-20 | Marvell International Ltd. | Apparatus and method for converting single-ended signals to a differential signal, and transceiver employing same |
USRE41831E1 (en) | 2000-05-23 | 2010-10-19 | Marvell International Ltd. | Class B driver |
US7853855B1 (en) | 2005-08-25 | 2010-12-14 | Marvell International Ltd. | High speed iterative decoder |
US8045946B2 (en) | 2000-07-31 | 2011-10-25 | Marvell International Ltd. | Active resistive summer for a transformer hybrid |
US8050645B1 (en) | 2000-07-31 | 2011-11-01 | Marvell International Ltd. | Active resistive summer for a transformer hybrid |
US8050398B1 (en) | 2007-10-31 | 2011-11-01 | Clearone Communications, Inc. | Adaptive conferencing pod sidetone compensator connecting to a telephonic device having intermittent sidetone |
US8199927B1 (en) | 2007-10-31 | 2012-06-12 | ClearOnce Communications, Inc. | Conferencing system implementing echo cancellation and push-to-talk microphone detection using two-stage frequency filter |
US8457614B2 (en) | 2005-04-07 | 2013-06-04 | Clearone Communications, Inc. | Wireless multi-unit conference phone |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7933295B2 (en) | 1999-04-13 | 2011-04-26 | Broadcom Corporation | Cable modem with voice processing capability |
US8295475B2 (en) * | 2006-01-13 | 2012-10-23 | Microsoft Corporation | Selective glitch detection, clock drift compensation, and anti-clipping in audio echo cancellation |
US7831035B2 (en) * | 2006-04-28 | 2010-11-09 | Microsoft Corporation | Integration of a microphone array with acoustic echo cancellation and center clipping |
US7773743B2 (en) * | 2006-04-28 | 2010-08-10 | Microsoft Corporation | Integration of a microphone array with acoustic echo cancellation and residual echo suppression |
JP4678349B2 (en) | 2006-08-31 | 2011-04-27 | ヤマハ株式会社 | Call determination device |
US8433061B2 (en) * | 2007-12-10 | 2013-04-30 | Microsoft Corporation | Reducing echo |
US8744069B2 (en) * | 2007-12-10 | 2014-06-03 | Microsoft Corporation | Removing near-end frequencies from far-end sound |
US8219387B2 (en) * | 2007-12-10 | 2012-07-10 | Microsoft Corporation | Identifying far-end sound |
EP2086250B1 (en) * | 2008-02-01 | 2020-05-13 | Oticon A/S | A listening system with an improved feedback cancellation system, a method and use |
US8380253B2 (en) * | 2008-02-15 | 2013-02-19 | Microsoft Corporation | Voice switching for voice communication on computers |
US8369251B2 (en) * | 2008-06-20 | 2013-02-05 | Microsoft Corporation | Timestamp quality assessment for assuring acoustic echo canceller operability |
WO2010027722A1 (en) * | 2008-08-25 | 2010-03-11 | Dolby Laboratories Licensing Corporation | Method for determining updated filter coefficients of an adaptive filter adapted by an lms algorithm with pre-whitening |
US8252653B2 (en) * | 2008-10-21 | 2012-08-28 | Applied Materials, Inc. | Method of forming a non-volatile memory having a silicon nitride charge trap layer |
US8564449B2 (en) * | 2010-01-12 | 2013-10-22 | Siemens Energy, Inc. | Open circuit wear sensor for use with a conductive wear counterface |
US8718275B2 (en) * | 2011-12-22 | 2014-05-06 | Google Inc. | Low complex and robust delay estimation |
US9613634B2 (en) * | 2014-06-19 | 2017-04-04 | Yang Gao | Control of acoustic echo canceller adaptive filter for speech enhancement |
US10951859B2 (en) | 2018-05-30 | 2021-03-16 | Microsoft Technology Licensing, Llc | Videoconferencing device and method |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4029912A (en) * | 1975-12-10 | 1977-06-14 | Bell Telephone Laboratories, Incorporated | Common control digital echo suppressor |
US5187741A (en) * | 1990-11-30 | 1993-02-16 | At&T Bell Laboratories | Enhanced acoustic calibration procedure for a voice switched speakerphone |
US5305307A (en) * | 1991-01-04 | 1994-04-19 | Picturetel Corporation | Adaptive acoustic echo canceller having means for reducing or eliminating echo in a plurality of signal bandwidths |
US5307405A (en) * | 1992-09-25 | 1994-04-26 | Qualcomm Incorporated | Network echo canceller |
US5430796A (en) * | 1990-11-19 | 1995-07-04 | Nec Corporation | Auxiliary attenuator arrangement for use in voice-switched speakerphone and method of selectively inserting communication loss in speakerphone paths |
US5479474A (en) * | 1992-10-05 | 1995-12-26 | Motorola, Inc. | Communication system having a remote unit, a fixed unit and a half-duplex communication channel |
US5544242A (en) * | 1993-05-25 | 1996-08-06 | Exar Corporation | Speakerphone with event driven control circuit |
US5553014A (en) * | 1994-10-31 | 1996-09-03 | Lucent Technologies Inc. | Adaptive finite impulse response filtering method and apparatus |
US5649012A (en) * | 1995-09-15 | 1997-07-15 | Hughes Electronics | Method for synthesizing an echo path in an echo canceller |
US5764753A (en) * | 1995-09-29 | 1998-06-09 | Crystal Semiconductor Corp. | Half-duplex controller |
US5774561A (en) * | 1995-08-14 | 1998-06-30 | Nippon Telegraph And Telephone Corp. | Subband acoustic echo canceller |
US5852661A (en) * | 1995-02-17 | 1998-12-22 | Advanced Micro Devices, Inc. | Adaptive echo cancellation used with echo suppression to reduce short and long duration echoes |
US5912966A (en) * | 1996-08-01 | 1999-06-15 | Northern Telecom Limited | Enhanced echo canceller for digital cellular application |
US6442273B1 (en) * | 1997-09-16 | 2002-08-27 | Sanyo Electric Co., Ltd. | Echo canceller and echo cancelling method |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6271362A (en) | 1985-09-25 | 1987-04-02 | Matsushita Electric Works Ltd | Transmission and reception changeover circuit |
JPS642424A (en) | 1987-06-25 | 1989-01-06 | Matsushita Electric Ind Co Ltd | Howling suppression device |
JPH01157655A (en) | 1987-12-14 | 1989-06-20 | Sharp Corp | Attenuating quantity control device for speakerphone |
US4901346A (en) | 1988-12-28 | 1990-02-13 | American Telephone And Telegraph Co. | Computer controlled speakerphone for adapting to a communication line |
US5007046A (en) | 1988-12-28 | 1991-04-09 | At&T Bell Laboratories | Computer controlled adaptive speakerphone |
JPH02309851A (en) | 1989-05-25 | 1990-12-25 | Fujitsu Ltd | Method for switching talking state of loundspeaker telephone set |
JPH05145378A (en) | 1991-11-21 | 1993-06-11 | Hitachi Commun Syst Inc | Adaptive digital filter having adaptive input signal white level processing |
JPH0648832A (en) | 1992-07-30 | 1994-02-22 | Sumitomo Durez Co Ltd | Carbon-carbon composite molded body |
JPH0678046A (en) | 1992-08-25 | 1994-03-18 | Fujitsu Ltd | Voice switch for hand-free system |
DE4317043B4 (en) | 1993-05-21 | 2004-03-25 | Deutsche Telekom Ag | Method and device for echo cancellation in transmission systems |
IT1273963B (en) | 1995-02-24 | 1997-07-11 | Alcatel Italia | FRACTIONAL SPACING EQUALIZATION METHOD AND CIRCUITS |
JPH08251082A (en) | 1995-03-13 | 1996-09-27 | Sony Corp | Echo removing device |
JPH09233002A (en) | 1996-02-27 | 1997-09-05 | Fujitsu Ltd | Voice switch |
-
1998
- 1998-09-10 WO PCT/JP1998/004107 patent/WO1999014868A1/en not_active Application Discontinuation
- 1998-09-10 EP EP05004158A patent/EP1569357A1/en not_active Withdrawn
- 1998-09-10 EP EP98941839A patent/EP1022866A4/en not_active Withdrawn
- 1998-09-10 US US09/508,579 patent/US6868157B1/en not_active Expired - Fee Related
-
2004
- 2004-04-29 US US10/834,261 patent/US20040208312A1/en not_active Abandoned
Patent Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4029912A (en) * | 1975-12-10 | 1977-06-14 | Bell Telephone Laboratories, Incorporated | Common control digital echo suppressor |
US5430796A (en) * | 1990-11-19 | 1995-07-04 | Nec Corporation | Auxiliary attenuator arrangement for use in voice-switched speakerphone and method of selectively inserting communication loss in speakerphone paths |
US5187741A (en) * | 1990-11-30 | 1993-02-16 | At&T Bell Laboratories | Enhanced acoustic calibration procedure for a voice switched speakerphone |
US5305307A (en) * | 1991-01-04 | 1994-04-19 | Picturetel Corporation | Adaptive acoustic echo canceller having means for reducing or eliminating echo in a plurality of signal bandwidths |
US5559881A (en) * | 1992-09-25 | 1996-09-24 | Qualcomm Incorporated | Network echo canceller |
US5307405A (en) * | 1992-09-25 | 1994-04-26 | Qualcomm Incorporated | Network echo canceller |
US5646991A (en) * | 1992-09-25 | 1997-07-08 | Qualcomm Incorporated | Noise replacement system and method in an echo canceller |
US5687229A (en) * | 1992-09-25 | 1997-11-11 | Qualcomm Incorporated | Method for controlling echo canceling in an echo canceller |
US5479474A (en) * | 1992-10-05 | 1995-12-26 | Motorola, Inc. | Communication system having a remote unit, a fixed unit and a half-duplex communication channel |
US5544242A (en) * | 1993-05-25 | 1996-08-06 | Exar Corporation | Speakerphone with event driven control circuit |
US5553014A (en) * | 1994-10-31 | 1996-09-03 | Lucent Technologies Inc. | Adaptive finite impulse response filtering method and apparatus |
US5852661A (en) * | 1995-02-17 | 1998-12-22 | Advanced Micro Devices, Inc. | Adaptive echo cancellation used with echo suppression to reduce short and long duration echoes |
US5774561A (en) * | 1995-08-14 | 1998-06-30 | Nippon Telegraph And Telephone Corp. | Subband acoustic echo canceller |
US5649012A (en) * | 1995-09-15 | 1997-07-15 | Hughes Electronics | Method for synthesizing an echo path in an echo canceller |
US5764753A (en) * | 1995-09-29 | 1998-06-09 | Crystal Semiconductor Corp. | Half-duplex controller |
US5912966A (en) * | 1996-08-01 | 1999-06-15 | Northern Telecom Limited | Enhanced echo canceller for digital cellular application |
US6442273B1 (en) * | 1997-09-16 | 2002-08-27 | Sanyo Electric Co., Ltd. | Echo canceller and echo cancelling method |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7729429B1 (en) | 2000-05-23 | 2010-06-01 | Marvell International Ltd. | Active replica transformer hybrid |
US7280060B1 (en) | 2000-05-23 | 2007-10-09 | Marvell International Ltd. | Communication driver |
US7194037B1 (en) * | 2000-05-23 | 2007-03-20 | Marvell International Ltd. | Active replica transformer hybrid |
US8009073B2 (en) | 2000-05-23 | 2011-08-30 | Marvell International Ltd. | Method and apparatus for generating an analog signal having a pre-determined pattern |
USRE41831E1 (en) | 2000-05-23 | 2010-10-19 | Marvell International Ltd. | Class B driver |
US7804904B1 (en) | 2000-05-23 | 2010-09-28 | Marvell International Ltd. | Active replica transformer hybrid |
US7649483B1 (en) | 2000-05-23 | 2010-01-19 | Marvell International Ltd. | Communication driver |
US8045946B2 (en) | 2000-07-31 | 2011-10-25 | Marvell International Ltd. | Active resistive summer for a transformer hybrid |
US7761076B1 (en) | 2000-07-31 | 2010-07-20 | Marvell International Ltd. | Apparatus and method for converting single-ended signals to a differential signal, and transceiver employing same |
US8880017B1 (en) | 2000-07-31 | 2014-11-04 | Marvell International Ltd. | Active resistive summer for a transformer hybrid |
US8050645B1 (en) | 2000-07-31 | 2011-11-01 | Marvell International Ltd. | Active resistive summer for a transformer hybrid |
US8503961B1 (en) | 2000-07-31 | 2013-08-06 | Marvell International Ltd. | Active resistive summer for a transformer hybrid |
US7579873B1 (en) | 2004-10-26 | 2009-08-25 | Marvell International Ltd. | Slew rate control circuit for small computer system interface (SCSI) differential driver |
US7719314B1 (en) | 2004-10-26 | 2010-05-18 | Marvell International Ltd. | Slew rate control circuit for small computer system interface (SCSI) differential driver |
US7298173B1 (en) | 2004-10-26 | 2007-11-20 | Marvell International Ltd. | Slew rate control circuit for small computer system interface (SCSI) differential driver |
US8457614B2 (en) | 2005-04-07 | 2013-06-04 | Clearone Communications, Inc. | Wireless multi-unit conference phone |
US7737788B1 (en) | 2005-08-09 | 2010-06-15 | Marvell International Ltd. | Cascode gain boosting system and method for a transmitter |
US7853855B1 (en) | 2005-08-25 | 2010-12-14 | Marvell International Ltd. | High speed iterative decoder |
US20080219431A1 (en) * | 2007-03-09 | 2008-09-11 | Fortemedia, Inc. | Method and apparatus for echo cancellation |
US8199927B1 (en) | 2007-10-31 | 2012-06-12 | ClearOnce Communications, Inc. | Conferencing system implementing echo cancellation and push-to-talk microphone detection using two-stage frequency filter |
US8050398B1 (en) | 2007-10-31 | 2011-11-01 | Clearone Communications, Inc. | Adaptive conferencing pod sidetone compensator connecting to a telephonic device having intermittent sidetone |
US8296136B2 (en) * | 2007-11-15 | 2012-10-23 | Qnx Software Systems Limited | Dynamic controller for improving speech intelligibility |
US20090132248A1 (en) * | 2007-11-15 | 2009-05-21 | Rajeev Nongpiur | Time-domain receive-side dynamic control |
Also Published As
Publication number | Publication date |
---|---|
EP1569357A1 (en) | 2005-08-31 |
EP1022866A4 (en) | 2003-06-25 |
WO1999014868A1 (en) | 1999-03-25 |
EP1022866A1 (en) | 2000-07-26 |
US6868157B1 (en) | 2005-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6868157B1 (en) | Echo canceling method, echo canceller and voice switch | |
JP2538176B2 (en) | Eco-control device | |
KR100716377B1 (en) | Digital adaptive filter and acoustic echo canceller using the same | |
Gustafsson et al. | Combined acoustic echo control and noise reduction for hands-free telephony | |
EP1298815B1 (en) | Echo processor generating pseudo background noise with high naturalness | |
JP4257113B2 (en) | Gain control method for performing acoustic echo cancellation and suppression | |
US5598468A (en) | Method and apparatus for echo removal in a communication system | |
EP1129526B1 (en) | Methods and apparatus for providing echo suppression using frequency domain nonlinear processing | |
US7787613B2 (en) | Method and apparatus for double-talk detection in a hands-free communication system | |
US7203308B2 (en) | Echo canceller ensuring further reduction in residual echo | |
US7477735B2 (en) | System and method for enhanced stereo audio | |
KR100595799B1 (en) | Signal noise reduction by spectral subtraction using spectrum dependent exponential gain function averaging | |
US20030039353A1 (en) | Echo cancellation processing system | |
US20040264610A1 (en) | Interference cancelling method and system for multisensor antenna | |
CA2242510A1 (en) | Coupled acoustic echo cancellation system | |
US6744887B1 (en) | Acoustic echo processing system | |
EP1783923B1 (en) | Double-talk detector for acoustic echo cancellation | |
US6834108B1 (en) | Method for improving acoustic noise attenuation in hand-free devices | |
US6560332B1 (en) | Methods and apparatus for improving echo suppression in bi-directional communications systems | |
US6970558B1 (en) | Method and device for suppressing noise in telephone devices | |
US20050220292A1 (en) | Method of discriminating between double-talk state and single-talk state | |
US20040204933A1 (en) | Virtual microphone array | |
US6850783B1 (en) | Methods and apparatus for mitigating the effects of microphone overload in echo cancelation systems | |
KR100272131B1 (en) | Adaptive reverbation cancelling apparatus | |
JP3609611B2 (en) | Echo cancellation method and echo canceller |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |