WO1999012155A1 - Channel gain modification system and method for noise reduction in voice communication - Google Patents
Channel gain modification system and method for noise reduction in voice communication Download PDFInfo
- Publication number
- WO1999012155A1 WO1999012155A1 PCT/US1997/017656 US9717656W WO9912155A1 WO 1999012155 A1 WO1999012155 A1 WO 1999012155A1 US 9717656 W US9717656 W US 9717656W WO 9912155 A1 WO9912155 A1 WO 9912155A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- speech
- noise
- channel
- gain
- audio signal
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02168—Noise filtering characterised by the method used for estimating noise the estimation exclusively taking place during speech pauses
Definitions
- the present invention relates to speech processing. More particularly, the present invention relates to a noise suppression system and method for use in speech processing.
- Noise suppression in a speech communication system generally serves the purpose of improving the overall quality of the desired audio signal by filtering environmental background noise from the desired speech signal.
- This speech enhancement process is particularly necessary in environments having abnormally high levels of ambient background noise, such as an aircraft, a moving vehicle, or a noisy factory.
- One noise suppression technique is the spectral subtraction, or spectral gain modification, technique.
- the input audio signal is divided into frequency channels, and particular frequency channels are attenuated according to their noise energy content.
- a background noise estimate for each frequency channel is utilized to generate a signal-to-noise ratio (SNR) of the speech in the channel, and the SNR is used to compute a gain factor for each channel.
- the gain factor determines the attenuation for the particular channel.
- the attenuated channels are recombined to produce the noise-suppressed output signal.
- the speakerphone option provides hands-free operation for the automobile driver.
- the hands-free microphone is typically located at a greater distance from the user, such as being mounted overhead on the visor.
- the distant microphone delivers a poor SNR to the land-end party due to road and wind noise conditions.
- the received speech at the land-end is usually intelligible, continuous exposure to such background noise levels often increases listener fatigue.
- Spectral subtraction techniques update the background noise estimate during periods when speech is absent. When speech is absent, the measured spectral energy is attributed to noise, and the noise estimate is updated based on the measured spectral energy. Therefore, it is important to distinguish between periods of speech and absence of speech in order to obtain an accurate noise energy estimate for computation of the SNR.
- An exemplary technique for speech detection uses a voice metric calculator to perform the noise update decision.
- a voice metric is a measurement of the overall voice-like characteristics of the channel energy.
- raw SNR estimates are used to index a voice metric table to obtain voice metric values for each channel.
- the individual channel voice metric values are summed to create an energy parameter, which is compared with a background noise update threshold. If the voice metric sum meets or exceeds the threshold, then the signal is said to contain speech. If the voice metric sum does not meet the threshold, the input frame is deemed to be noise, and a background noise update is performed.
- SNR measurements will be large, resulting in a high voice metric, which negates a noise estimate update.
- a refinement to the voice metric calculator technique measures the channel energy deviation. This method assumes that noise exhibits constant spectral energy over time, while speech exhibits variable spectral energy over time. Thus, the channel energy is integrated over time, and speech is detected if there is substantial channel energy deviation, while noise is detected if there is little channel energy deviation.
- a speech detector which measures channel energy deviation will detect a sudden increase in the level of noise.
- the channel energy deviation method provides an inaccurate result when the input speech signal is of constant energy.
- changes in the input energy will cause the energy deviation to be large, negating a noise estimate update even though an update is necessary.
- the noise suppression system must appropriately adjust channel gains.
- Channel gains should be adjusted so that noise suppression is achieved without sacrificing the voice quality.
- One method of channel gain adjustment computes the gain as a function of the total noise estimate and the SNR of the speech signal. In general, an increase in the total noise estimate results in a lower gain factor for a given SNR. A lower gain factor is indicative of a greater attenuation factor. This technique imposes a minimum gain value to prevent excess attenuation of the channel gain when the total noise estimate is very high.
- a hard clamped minimum gain value By using a hard clamped minimum gain value, a tradeoff between noise suppression and voice quality is introduced. When the clamp is relatively low, noise suppression is improved but voice quality is degraded. When the clamp is relatively high, noise suppression is degraded but the voice quality is improved. In order to provide an improved noise suppression system, the limitations of the current techniques for speech detection and channel gain computation need to be addressed. These problems and deficiencies are solved by the present invention in the manner described below.
- the present invention is a noise suppression system and method for use in speech processing systems.
- An objective of the present invention is to provide a speech detector which determines the presence of speech in an input signal.
- a reliable speech detector is needed for an accurate determination of the signal-to-noise ratio (SNR) of speech.
- SNR signal-to-noise ratio
- the input signal is assumed to be entirely a noise signal, and the noise energy may be measured.
- the noise energy is then used for determination of the SNR.
- Another objective of the present invention is to provide an improved gain determination element for realization of noise suppression.
- the noise suppression system comprises a speech detector which determines if speech is present in a frame of the input signal.
- the speech decision may be based on the SNR measure of speech in an input signal.
- a SNR estimator estimates the SNR based on the signal energy estimate generated by an energy estimator and the noise energy estimate generated by a noise energy estimator.
- the speech decision may also be based on the encoding rate of the input signal.
- each input frame is assigned an encoding rate selected from a predetermined set of rates based oh the content of the input frame.
- the rate is dependent on the level of speech activity, so that a frame containing speech would be assigned a high rate, whereas a frame not containing speech would be assigned a low rate.
- the speech decision may be based on one or more mode measures which are descriptive of the characteristics of the input signal. If it is determined that speech is not present in the input frame, then the noise energy estimator updates the noise energy estimate.
- a channel gain estimator determines the gain for the frame of input signal. If speech is not present in the frame, then the gain is set to be a predetermined minimum. Otherwise, the gain is determined based on the frequency content of the frame.
- a gain factor is determined for each of a set of predefined frequency channels. For each channel, the gain is determined in accordance with the SNR of the speech in the channel. For each channel, the gain is defined using a function that is suitable for the characteristics of the frequency band within which the channel is located. Typically, for a predefined frequency band, the gain is set to increase linearly with increasing SNR. Additionally, the minimum gain for each frequency band may be adjustable based on the environmental characteristics. For example, a user-selectable minimum gain may be implemented.
- the channel SNRs are based on channel energy estimates generated by an energy estimator and channel noise energy estimates generated by a noise energy estimator.
- the gain factors are used to adjust the gain of the signal in the different channels, and the gain adjusted channels are combined to produce the noise suppressed output signal.
- FIG. 1 is a block diagram of a communications system in which a noise suppressor is utilized;
- FIG. 2 is a block diagram illustrating a noise suppressor in accordance with the present invention
- FIG. 3 is a graph of gain factors based on frequency, for realization of noise suppression in accordance with the present invention
- FIG. 4 is a flow chart illustrating an exemplary embodiment - of the processing steps involved in noise suppression as implemented by the processing elements of FIG. 2.
- noise suppressors are commonly used to suppress undesirable environmental background noise.
- Most noise suppressors operate by estimating the background noise characteristics of the input data signal in one or more frequency bands and subtracting an average of the estimate(s) from the input signal. The estimate of the average background noise is updated during periods of the absence of speech.
- Noise suppressors require an accurate determination of the background noise level for proper operation.
- the level of noise suppression must be properly adjusted based on the speech and noise characteristics of the input signal.
- System 100 comprises microphone 102, A/D converter 104, speech processor 106, transmitter 110, and antenna 112.
- Microphone 102 may be located in a cellular telephone together with the other elements illustrated in FIG. 1.
- microphone 102 may be the hands-free microphone of the vehicle speakerphone option to a cellular communication system.
- the vehicle speakerphone assembly is sometimes referred to as a carkit. Where microphone 102 is part of a carkit, the noise suppression function is particularly important. Because the hands-free microphone is generally positioned at some distance from the user, the received acoustic signal tends to have a poor speech SNR due to road and wind noise conditions.
- the input audio signal comprising speech and /or background noise
- the input audio signal is transformed by microphone 102 into an electro-acoustic signal represented by the term s(t).
- the electro-acoustic signal may be converted from an analog signal to pulse code modulated (PCM) samples by Analog-to- Digital converter 104.
- PCM samples are output by A/D converter 104 at 64 kbps and are represented by signal s(n) as shown in FIG. 1.
- Digital signal s(n) is received by speech processor 106, which comprises, among other elements, noise suppressor 108. Noise suppressor 108 suppresses noise in signal s(n) in accordance with the present invention.
- noise suppressor 108 determines the level of background environmental noise and adjusts the gain of the signal to mitigate the effects of such environmental noise.
- speech processor 106 generally comprises a voice coder, or a vocoder (not shown), which compresses speech by extracting parameters that relate to a model of human speech generation. Speech processor 106 may also comprise an echo canceller (not shown), which eliminates acoustic echo resulting from the feedback between a speaker (not shown) and microphone 102.
- transmitter 110 Following processing by speech processor 106, the signal is provided to transmitter 110, which performs modulation in accordance with a predetermined format such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), or Frequency Division Multiple Access (FDMA).
- CDMA Code Division Multiple Access
- TDMA Time Division Multiple Access
- FDMA Frequency Division Multiple Access
- transmitter 110 modulates the signal in accordance with a CDMA modulation format as described in U.S. Pat. No. 4,901,307, entitled "SPREAD SPECTRUM MULTIPLE ACCESS COMMUNICATION SYSTEM USING SATELLITE OR TERRESTRIAL REPEATERS,” which is assigned to the assignee of the present invention and incorporated by reference herein.
- Transmitter 110 then upconverts and amplifies the modulated signal, and the modulated signal is transmitted through antenna 112.
- noise suppressor 108 may be embodied in speech processing systems that are not identical to system 100 of FIG. 1.
- noise suppressor 108 may be utilized within an electronic mail application having a voice mail option.
- transmitter 110 and antenna 112 of FIG. 1 will not be necessary.
- the noise suppressed signal will be formatted by speech processor 106 for transmission through the electronic mail network.
- An exemplary embodiment of noise suppressor 108 is illustrated in
- the input audio signal is received by preprocessor 202, as shown in FIG. 2.
- Preprocessor 202 prepares the input signal for noise suppression by performing preemphasis and frame generation. Preemphasis redistributes the power spectral density of the speech signal by emphasizing the high frequency speech components of the signal. Essentially performing a high pass filtering function, preemphasis emphasizes the important speech components to enhance the SNR of these components in the frequency domain.
- Preprocessor 202 may also generate frames from the samples of the input signal. In a preferred embodiment, 10 ms frames of 80 samples /frame are generated. The frames may have overlapped samples for- better processing accuracy. The frames may be generated by windowing and zero padding of the samples of the input signal.
- transform element 204 generates a 128 point Fast Fourier Transform (FFT) for each frame of input signal. It should be understood, however, that alternative schemes may be used to analyze the frequency components of the input signal.
- FFT Fast Fourier Transform
- channel energy estimator 206a which generates an energy estimate for each of N channels of the transformed signal.
- channel energy estimator 206a For each channel, one technique for updating the channel energy estimates the update to be the current channel energy smoothed over channel energies of previous frames as follows:
- the low frequency channel corresponds to frequency range from 250 to 2250 Hz
- the high frequency channel corresponds to frequency range from 2250 to 3500 Hz.
- the current channel energy of the low frequency channel may be determined by summing the energy of the FFT points corresponding to 250-2250 Hz
- the current channel energy of the high frequency channel may be determined by summing the energy of the FFT points corresponding to 2250-3500 Hz.
- the energy estimates are provided to speech detector 208, which determines whether or not speech is present in the received audio signal.
- SNR estimator 210a of speech detector 208 receives the energy estimates.
- SNR estimator 210a determines the signal-to-noise ratio (SNR) of the speech in each of the N channels based on the channel energy estimates and the channel noise energy estimates.
- the channel noise energy estimates are provided by noise energy estimator 214a, and generally correspond to the estimated noise energy smoothed over the previous frames which do not contain speech.
- Speech detector 208 also comprises rate decision element 212, which selects the data rate of the input signal from a predetermined set of data rates.
- data is encoded so that the data rate may be varied from one frame to another. This is known as a variable rate communication system.
- the voice coder which encodes data based on a variable rate scheme is typically called a variable rate vocoder.
- An exemplary embodiment of a variable rate vocoder is described in U.S. Pat. No. 5,414,796, entitled "VARIABLE RATE VOCODER,” assigned to the assignee of the present invention and incorporated by reference herein.
- the use of a variable rate communications channel eliminates unnecessary transmissions when there is no useful speech to be transmitted.
- Algorithms are utilized within the vocoder for generating a varying number of information bits in each frame in accordance with variations in speech activity. For example, a vocoder with a set of four rates may produce 20 millisecond data frames containing 16, 40, 80, or 171 information bits, depending on the activity of the speaker. It is desired to transmit each data frame in a fixed amount of time by varying the transmission rate of communications.
- determining the rate will provide information on whether speech is present or not.
- a determination that a frame should be encoded at the highest rate generally indicates the presence of speech, while a determination that a frame should be encoded at the lowest rate generally indicates the absence of speech.
- Intermediate rates typically indicate transitions between the presence and the absence of speech.
- Rate decision element 212 may implement any of a number of rate decision algorithms.
- One such rate decision algorithm is disclosed in copending U.S. patent application Serial No. 08/286,842, entitled “METHOD AND APPARATUS FOR PERFORMING REDUCED RATE VARIABLE RATE VOCODING,” assigned to the assignee of the present invention and incorporated by reference herein.
- This technique provides a set of rate decision criteria referred to as mode measures.
- a first mode measure is the target matching signal to noise ratio (TMSNR) from the previous encoding frame, which provides information on how well the encoding model is performing by comparing a synthesized speech signal with the input speech signal.
- a second mode measure is the normalized autocorrelation function (NACF), which measures periodicity in the speech frame.
- TMSNR target matching signal to noise ratio
- NACF normalized autocorrelation function
- a third mode measure is the zero crossings (ZC) parameter, which measures high frequency content in an input speech frame.
- ZC zero crossings
- PPD prediction gain differential
- ED energy differential
- rate decision element 212 is shown in FIG. 2 as an included element of noise suppressor 108, the rate information may instead be provided to noise suppressor 108 by another component of speech processor 106 (FIG. 1).
- speech processor 106 may comprise a variable rate vocoder (not shown) which determines the encoding rate for each frame of input signal.
- the rate information may be provided to noise suppressor 108 by the variable rate vocoder.
- speech detector 208 may use a subset of the mode measures that contribute to the rate decision.
- rate decision element 212 may be substituted by a NACF element (not shown), which, as explained earlier, measures periodicity in the speech frame.
- NACF is evaluated in accordance with the relationship below:
- N refers to the numbers of samples of the speech frame
- tl and t2 refer to the boundaries within the T samples for which the NACF is evaluated.
- the NACF is evaluated based on the formant residual signal, e(n).
- Formant frequencies are the resonance frequencies of speech.
- a short term filter is used to filter the speech signal to obtain the formant frequencies.
- the residual signal obtained after filtering by the short term filter is the formant residual signal, and contains the long term speech information, such as the pitch, of the signal.
- the NACF mode measure is suitable for determining the presence of speech because the periodicity of a signal containing voiced speech is different from a signal which does not contain voiced speech.
- a voiced speech signal tends to be characterized by periodic components. When voiced speech is not present, the signal generally will not have periodic components.
- the NACF measure is a good indicator which may be used by speech detector 208.
- Speech detector 208 may use measures such as the NACF instead of the rate decision in situations where it is not practicable to generate the rate decision. For example, if the rate decision is not available from the variable rate vocoder, and noise processor 108 does not have the processing power to generate its own rate decision, then mode measures like the NACF offer a desirable alternative. This may be the case in a carkit application where processing power is generally limited. Additionally, it should be understood that speech detector 208 may make a determination regarding the presence of speech based on the rate decision, the mode measure(s), or the SNR estimate alone. Although additional measures should improve the accuracy of the determination, any one of the measures alone may provide an adequate result.
- measures such as the NACF instead of the rate decision in situations where it is not practicable to generate the rate decision. For example, if the rate decision is not available from the variable rate vocoder, and noise processor 108 does not have the processing power to generate its own rate decision, then mode measures like the NACF offer a desirable alternative. This may be the case in a carkit application where processing power
- the rate decision (or the mode measure(s)) and the SNR estimate generated by SNR estimator 210a are provided to speech decision element 216.
- Speech decision element 216 generates a decision on whether or not speech is present in the input signal based on its inputs. The decision on the presence of speech will determine if a noise energy estimate update should be performed. The noise energy estimate is used by SNR estimator 210a to determine the SNR of the speech in the input signal. The SNR will in turn will be used to compute the level of attenuation of the input signal for noise suppression. If it is determined that speech is present, then speech decision element 216 opens switch 218a, preventing noise energy estimator 214a from updating the noise energy estimate.
- speech decision element 216 closes switch 218a, causing noise energy estimator 214a to update the noise estimate.
- switch 218a it should be understood that an enable signal provided by speech decision element 216 to noise energy estimator 214a may perform the same function.
- the channel SNR estimates provided by SNR estimator 210a are denoted by chsnrl and chsnr2.
- the rate of the input signal, provided by rate decision element 212, is denoted by rate.
- a counter, ratecount keeps track of the number of frames based on certain conditions as described below.
- Speech decision element 216 determines that speech is not present, and that the noise estimate should be updated, if the rate is the minimum rate of the variable rates, either chsnrl is greater than threshold Tl or chsnr2 is greater than threshold T2, and ratecount is greater than threshold T3. If the rate is minimum, and either chsnrl is greater than Tl or chsnr2 is greater than T2, but ratecount is less than T3, then the ratecount is increased by one but no noise estimate update is performed.
- the counter, ratecount detects the case of a sudden increased level of noise or an increasing noise source by counting the number of frames having minimum rate but also having high energy in at least one of the channels.
- the counter which provides an indicator that the high SNR signal contains no speech, is set to count until speech is detected in the signal.
- speech decision element 216 will determine that speech is not present and that a noise estimate update should be performed. In addition, ratecount is reset to zero.
- speech decision element 216 will determine that the frame contains speech, and no noise estimate update is performed, but ratecount is reset to zero.
- Speech decision element 216 may make use of the NACF measure to determine the presence of speech, and thus the noise update decision, in accordance with the procedure below:
- pitchPresent is defined as follows:
- channel SNR estimates provided by SNR estimator 210a are denoted by chsnrl and chsnr2.
- a NACF element (not shown) generates a measure indicative of the presence of pitch, pitchPresent, as defined above.
- a counter, pitchCount keeps track of the number of frames based on certain conditions as described below.
- the measure pitchPresent determines that pitch is present if NACF is above threshold TT1. If NACF falls within a mid range (TT2 ⁇ NACF ⁇ TT1) for a number of frames greater than threshold TT3, then pitch is also determined to be present.
- the counter, pitchCount is used to detect the case of a sudden increased level of noise or an increasing noise source.
- speech decision element 216 will determine that the frame contains speech, and no noise estimate update is performed. However, pitchCount is reset to zero.
- Noise energy estimator 214a Upon determination that speech is not present, switch 218a is closed, causing noise energy estimator 214a to update the noise estimate.
- Noise energy estimator 214a generally generates a noise energy estimate for each of the N channels of the input signal. Since speech is not present, the energy is presumed to be wholly contributed by noise. For each channel, the noise energy update is estimated to be the current channel energy smoothed over channel energies of previous frames which do not contain speech. For example, the updated estimate may be obtained based on the relationship below:
- the updated estimate, E ⁇ t is defined as a function of the current channel energy, E ch , and the previous estimated channel noise energy, E n (t- 1).
- the updated channel noise energy estimates are presented to SNR estimator 210a. These channel noise energy estimates will be used to obtain channel SNR estimate updates for the next frame of input signal.
- Channel gain estimator 220 determines the gain, and thus the level of noise suppression, for the frame of input signal. If speech decision element 216 has determined that speech is not present, then the gain for the frame is set at a predetermined minimum gain level. Otherwise, the gain is determined as a function of frequency. In a preferred embodiment, the gain is computed based on the graph shown in FIG. 3. Although shown in graphical form in FIG. 3, it should be understood that the function illustrated in FIG. 3 may be implemented as a look-up table in channel gain estimator 220.
- a preferred embodiment of the present invention defines a separate gain curve for each of L frequency bands.
- the gain factor for a channel in the low band may be determined using the low band curve
- the gain factor for a channel in the mid band may be determined using the mid band curve
- the gain factor for a channel in the high band may be determined using the high band curve.
- environmental noise such as road and wind noise
- the energy of the noise signal is greater at the lower frequencies, and the energy generally decreases with increasing frequency.
- the preferred embodiment assigns the low band as 125 - 375 Hz, the mid band as 375 - 2625 Hz, and the high band as 2625 - 4000 Hz.
- the slopes and the y intercepts are experimentally determined.
- the preferred embodiment uses the same slope, 0.39, for each of the three bands, although a different slope may be used for each frequency band.
- lowBandYintercept is set at -17 dB
- midBandYintercept is set at 13 dB
- highBandYintercept is set at -13 dB.
- An optional feature would provide the user of the device comprising the noise suppressor to select the desired y-intercepts.
- more noise suppression (a lower y-intercept) may be chosen at the expense of some voice degradation.
- the y-intercepts may be variable as a function of some measure determined by noise suppressor 108. For example, more noise suppression (a lower y-intercept) may be desired when an excessive noise energy is detected for a predetermined period of time.
- less noise suppression (a high y-intercept) may be desired when a condition such as babble is detected. During a babble condition, background speakers are present, and less noise suppression may be warranted to prevent cut out of the main speaker.
- Another optional feature would provide for selectable slopes of the gain curves. Further, it should be understood that a curve other than the lines described by equations (4)-(6) may be found to be more suitable for determining the gain factor under certain circumstances.
- a gain factor is determined for each of M frequency channels of the input signal, where M is the predetermined number of channels to be evaluated.
- M is the predetermined number of channels to be evaluated.
- the channel SNR is used to derive the gain factor based on the appropriate curve.
- the channel SNRs are shown, in FIG. 2, to be evaluated by channel energy estimator 206b, noise energy estimator 214b, and SNR estimator 210b.
- channel energy estimator 206b For each frame of input signal, channel energy estimator 206b generates energy estimates for each of M channels of the transformed input signal, and provides the energy estimates to SNR estimator 210b.
- the channel energy estimates may be updated using the relationship of Equation (1) above. If it is determined by speech decision element 216 that no speech is present in the input signal, then switch 218b is closed, and noise energy estimator 214b updates the estimates of the channel noise energy.
- the updated noise energy estimate is based on the channel energy estimate determined by channel energy estimator 206b.
- the updated estimate may be evaluated using the relationship of Equation (3) above.
- the channel noise estimates are provided to SNR estimator 210b.
- SNR estimator 210b determines channel SNR estimates for each frame of speech based on the channel energy estimates for the particular frame of speech and the channel noise energy estimates provided by noise energy estimator 214b.
- channel energy estimator 206a, noise energy estimator 214a, switch 218a, and SNR estimator 210a perform functions similar to channel energy estimator 206b, noise energy estimator 214b, switch 218b, and SNR estimator 210b, respectively.
- channel energy estimators 206a and 206b may be combined as one processing element
- noise energy estimators 214a and 214b may be combined as one processing element
- switches 218a and 218b may be combined as one processing element
- SNR estimators 210a and 210b may be combined as one processing element.
- the channel gain factors are provided by channel gain estimator 220 to gain adjuster 224.
- Gain adjuster 224 also receives the FFT transformed input signal from transform element 204.
- the gain adjusted signal generated by gain adjuster 224 is then provided to inverse transform element 226, which in a preferred embodiment generates the Inverse Fast Fourier Transform (IFFT) of the signal.
- IFFT Inverse Fast Fourier Transform
- the inverse transformed signal is provided to post processing element 228. If the frames of input had been formed with overlapped samples, then post processing element 228 adjusts the output signal for the overlap. Post processing element 228 also performs deemphasis if the signal had undergone preemphasis. Deemphasis attenuates the frequency components that were emphasized during preemphasis. The preemphasis /deemphasis process effectively contributes to - noise suppression by reducing the noise components lying outside of the range of the processed frequency components.
- IFFT Inverse Fast Fourier Transform
- FIG. 2 a flow chart is shown illustrating some of the steps involved in the processing as discussed with reference to FIGS. 2 and 3. Although shown as consecutive steps, one skilled in the art would recognize that ordering of some of the steps are interchangeable.
- transform element 204 transforms the input audio signal into a transformed signal, generally a FFT signal.
- SNR estimator 210b determines the speech SNR for M channels of the input signal based on the channel energy estimates provided by channel energy estimator 206b and the channel noise energy estimates provided by noise energy estimator 214b.
- channel gain estimator 220 determines gain factors for the M channels of the input signal based on the frequency of the channels. Channel gain estimator 220 sets the gain at a minimum level if speech has been found to be absent in the frame of input signal. Otherwise, a gain factor is determined, for each of the M channels, based on a predetermined function. For example, referring to FIG.
- a function defined by line equations having fixed slopes and y-intercepts, wherein each line equation defines the gain for a predetermined frequency band may be used.
- gain adjuster 224 adjusts the gain of the M channels of the transformed signal using the M gain factors.
- inverse transform element 226 inverse transforms the gain adjusted transformed signal, producing the noise suppressed audio signal.
- SNR estimator 210a determines the speech SNR for N channels of the input signal based on the channel energy estimates provided by channel energy estimator 206a and the channel noise energy estimates provided by noise energy estimator 214a.
- rate decision element 212 determines the encoding rate for the input signal through analysis of the input signal. Alternatively, one or more mode measures, such as the NACF, may be determined.
- speech decision element 216 determines if speech is present in the input signal based on the SNR provided by SNR estimator 210a, the rate provided by rate decision element 212, and/or the mode measure(s).
- Noise energy estimator 214a updates the noise estimate based on the channel energy determined by channel energy estimator 206a. Whether or not speech is detected, the procedure continues to process the next frame of the input signal.
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2000509079A JP4194749B2 (en) | 1997-09-02 | 1997-09-30 | Channel gain correction system and noise reduction method in voice communication |
EP97945400A EP1010169B1 (en) | 1997-09-02 | 1997-09-30 | Channel gain modification system and method for noise reduction in voice communication |
DE69736198T DE69736198T2 (en) | 1997-09-02 | 1997-09-30 | SYSTEM AND METHOD FOR REGULATING CHANNEL GAIN FOR NOISE REDUCTION IN LANGUAGE COMMUNICATION |
PCT/US1997/017656 WO1999012155A1 (en) | 1997-09-30 | 1997-09-30 | Channel gain modification system and method for noise reduction in voice communication |
AU46614/97A AU4661497A (en) | 1997-09-30 | 1997-09-30 | Channel gain modification system and method for noise reduction in voice communication |
HK00108203A HK1034136A1 (en) | 1997-09-02 | 2000-12-19 | Channel gain modification system and method for noise reduction in voice communication |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US1997/017656 WO1999012155A1 (en) | 1997-09-30 | 1997-09-30 | Channel gain modification system and method for noise reduction in voice communication |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1999012155A1 true WO1999012155A1 (en) | 1999-03-11 |
Family
ID=22261787
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US1997/017656 WO1999012155A1 (en) | 1997-09-02 | 1997-09-30 | Channel gain modification system and method for noise reduction in voice communication |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU4661497A (en) |
WO (1) | WO1999012155A1 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2349259A (en) * | 1999-04-23 | 2000-10-25 | Canon Kk | Speech processing apparatus |
WO2001011604A1 (en) | 1999-08-10 | 2001-02-15 | Telogy Networks, Inc. | Background energy estimation |
EP1104096A2 (en) * | 1999-11-27 | 2001-05-30 | Alcatel | Noise suppression adapted to actual Noise Level |
WO2002017299A1 (en) * | 2000-08-21 | 2002-02-28 | Conexant Systems, Inc. | Method for noise robust classification in speech coding |
EP1287520A1 (en) * | 2000-03-28 | 2003-03-05 | Tellabs Operations, Inc. | Spectrally interdependent gain adjustment techniques |
JP2009271556A (en) * | 2009-08-18 | 2009-11-19 | Kddi Corp | Audio information classifying device |
WO2013162994A3 (en) * | 2012-04-23 | 2014-04-03 | Qualcomm Incorporated | Systems and methods for audio signal processing |
US9043214B2 (en) | 2005-04-22 | 2015-05-26 | Qualcomm Incorporated | Systems, methods, and apparatus for gain factor attenuation |
EP2866229B1 (en) * | 2006-05-12 | 2021-04-14 | BlackBerry Limited | Voice activity detector |
CN113782011A (en) * | 2021-08-26 | 2021-12-10 | 清华大学苏州汽车研究院(相城) | Training method of frequency band gain model and voice noise reduction method for vehicle-mounted scene |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4630305A (en) * | 1985-07-01 | 1986-12-16 | Motorola, Inc. | Automatic gain selector for a noise suppression system |
US4811404A (en) * | 1987-10-01 | 1989-03-07 | Motorola, Inc. | Noise suppression system |
WO1992022891A1 (en) * | 1991-06-11 | 1992-12-23 | Qualcomm Incorporated | Variable rate vocoder |
-
1997
- 1997-09-30 WO PCT/US1997/017656 patent/WO1999012155A1/en active IP Right Grant
- 1997-09-30 AU AU46614/97A patent/AU4661497A/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4630305A (en) * | 1985-07-01 | 1986-12-16 | Motorola, Inc. | Automatic gain selector for a noise suppression system |
US4811404A (en) * | 1987-10-01 | 1989-03-07 | Motorola, Inc. | Noise suppression system |
WO1992022891A1 (en) * | 1991-06-11 | 1992-12-23 | Qualcomm Incorporated | Variable rate vocoder |
Non-Patent Citations (2)
Title |
---|
LAURENT P A ET AL: "A ROBUST 2400 BPS SUBBAND LPC VOCODER", PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), DETROIT, MAY 9 - 12, 1995 SPEECH, vol. VOL. 1, 9 May 1995 (1995-05-09), INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS, pages 500 - 503, XP000658040 * |
SWAMINATHAN K ET AL: "SPEECH AND CHANNEL CODEC CANDIDATE FOR THE HALF RATE DIGITAL CELLULAR CHANNEL", PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, SIGNAL PROCESSING (ICASSP), SPEECH PROCESSING 1. ADELAIDE, APR. 19 - 22, 1994, vol. VOL. 1, 19 April 1994 (1994-04-19), INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS, pages 265 - 268, XP002045415 * |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2349259A (en) * | 1999-04-23 | 2000-10-25 | Canon Kk | Speech processing apparatus |
GB2349259B (en) * | 1999-04-23 | 2003-11-12 | Canon Kk | Speech processing apparatus and method |
US6965860B1 (en) | 1999-04-23 | 2005-11-15 | Canon Kabushiki Kaisha | Speech processing apparatus and method measuring signal to noise ratio and scaling speech and noise |
WO2001011604A1 (en) | 1999-08-10 | 2001-02-15 | Telogy Networks, Inc. | Background energy estimation |
EP1125275A1 (en) * | 1999-08-10 | 2001-08-22 | Telogy Networks Inc. | Background energy estimation |
EP1125275A4 (en) * | 1999-08-10 | 2009-06-24 | Telogy Networks Inc | Background energy estimation |
EP1104096A2 (en) * | 1999-11-27 | 2001-05-30 | Alcatel | Noise suppression adapted to actual Noise Level |
EP1104096A3 (en) * | 1999-11-27 | 2003-01-08 | Alcatel | Noise suppression adapted to actual Noise Level |
EP1287520A1 (en) * | 2000-03-28 | 2003-03-05 | Tellabs Operations, Inc. | Spectrally interdependent gain adjustment techniques |
EP1287520A4 (en) * | 2000-03-28 | 2005-09-28 | Tellabs Operations Inc | Spectrally interdependent gain adjustment techniques |
CN1302460C (en) * | 2000-08-21 | 2007-02-28 | 曼德斯必德技术公司 | Method for noise robust classification in speech coding |
WO2002017299A1 (en) * | 2000-08-21 | 2002-02-28 | Conexant Systems, Inc. | Method for noise robust classification in speech coding |
US9043214B2 (en) | 2005-04-22 | 2015-05-26 | Qualcomm Incorporated | Systems, methods, and apparatus for gain factor attenuation |
EP2866229B1 (en) * | 2006-05-12 | 2021-04-14 | BlackBerry Limited | Voice activity detector |
JP2009271556A (en) * | 2009-08-18 | 2009-11-19 | Kddi Corp | Audio information classifying device |
JP4497485B2 (en) * | 2009-08-18 | 2010-07-07 | Kddi株式会社 | Audio information classification device |
WO2013162994A3 (en) * | 2012-04-23 | 2014-04-03 | Qualcomm Incorporated | Systems and methods for audio signal processing |
US9305567B2 (en) | 2012-04-23 | 2016-04-05 | Qualcomm Incorporated | Systems and methods for audio signal processing |
CN113782011A (en) * | 2021-08-26 | 2021-12-10 | 清华大学苏州汽车研究院(相城) | Training method of frequency band gain model and voice noise reduction method for vehicle-mounted scene |
CN113782011B (en) * | 2021-08-26 | 2024-04-09 | 清华大学苏州汽车研究院(相城) | Training method of frequency band gain model and voice noise reduction method for vehicle-mounted scene |
Also Published As
Publication number | Publication date |
---|---|
AU4661497A (en) | 1999-03-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6122384A (en) | Noise suppression system and method | |
US6233549B1 (en) | Low frequency spectral enhancement system and method | |
US5544250A (en) | Noise suppression system and method therefor | |
US7555075B2 (en) | Adjustable noise suppression system | |
US9646621B2 (en) | Voice detector and a method for suppressing sub-bands in a voice detector | |
US9502048B2 (en) | Adaptively reducing noise to limit speech distortion | |
JP4163267B2 (en) | Noise suppressor, mobile station, and noise suppression method | |
US4630305A (en) | Automatic gain selector for a noise suppression system | |
EP0707763B1 (en) | Reduction of background noise for speech enhancement | |
EP1232496B1 (en) | Noise suppression | |
EP1769492A1 (en) | Comfort noise generator using modified doblinger noise estimate | |
WO2008121436A1 (en) | Method and apparatus for quickly detecting a presence of abrupt noise and updating a noise estimate | |
US5666429A (en) | Energy estimator and method therefor | |
WO1999012155A1 (en) | Channel gain modification system and method for noise reduction in voice communication | |
EP1242992B1 (en) | A noise suppressor | |
WO1998058448A1 (en) | Method and apparatus for low complexity noise reduction | |
EP1010169B1 (en) | Channel gain modification system and method for noise reduction in voice communication | |
WO2001041334A1 (en) | Method and apparatus for suppressing acoustic background noise in a communication system | |
KR20090019113A (en) | Apparatus and method for noise eradication of voice signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 97182430.4 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020007002227 Country of ref document: KR |
|
NENP | Non-entry into the national phase |
Ref document number: 1999516745 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1997945400 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 1997945400 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: CA |
|
WWP | Wipo information: published in national office |
Ref document number: 1020007002227 Country of ref document: KR |
|
WWG | Wipo information: grant in national office |
Ref document number: 1020007002227 Country of ref document: KR |
|
WWG | Wipo information: grant in national office |
Ref document number: 1997945400 Country of ref document: EP |