CA2602804C - Systems, methods, and apparatus for highband burst suppression - Google Patents
Systems, methods, and apparatus for highband burst suppression Download PDFInfo
- Publication number
- CA2602804C CA2602804C CA2602804A CA2602804A CA2602804C CA 2602804 C CA2602804 C CA 2602804C CA 2602804 A CA2602804 A CA 2602804A CA 2602804 A CA2602804 A CA 2602804A CA 2602804 C CA2602804 C CA 2602804C
- Authority
- CA
- Canada
- Prior art keywords
- signal
- burst
- highband
- speech
- indication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
- G10L19/0208—Subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
- G10L21/0388—Details of processing therefor
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/032—Quantisation or dequantisation of spectral components
- G10L19/038—Vector quantisation, e.g. TwinVQ audio
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
Abstract
In one embodiment, a highband burst suppressor includes a first burst detector configured to detect bursts in a lowband speech signal, and a second burst detector configured to detect bursts in a corresponding highband speech signal. The lowband and highband speech signals may be different (possibly overlapping) frequency regions of a wideband speech signal. The highband burst suppressor also includes an attenuation control signal calculator configured to calculate an attenuation control signal according to a difference between outputs of the first and second burst detectors. A gain control element is configured to apply the attenuation control signal to the highband speech signal. In one example, the attenuation control signal indicates an attenuation when a burst is found in the highband speech signal but is absent from a corresponding region in time of the lowband speech signal.
Description
SYSTEMS, METHODS, AND APPARATUS FOR HIGHBAND
BURST SUPPRESSION
FIELD OF THE INVENTION
BURST SUPPRESSION
FIELD OF THE INVENTION
[0002] This invention relates to signal processing.
BACKGROUND
BACKGROUND
[0003] Voice communications over the public switched telephone network (PSTN) have traditionally been limited in bandwidth to the frequency range of 300-3400 kHz.
New networks for voice communications, such as cellular telephony and voice over IP
(VolP), may not have the same bandwidth limits, and it may be desirable to transmit and receive voice communications that include a wideband frequency range over such networks. For example, it may be desirable to support an audio frequency range that extends down to 50 Hz and/or up to 7 or 8 kHz. It may also be desirable to support other applications, such as high-quality audio or audio/video conferencing, that may have audio speech content in ranges outside the traditional PSTN limits.
New networks for voice communications, such as cellular telephony and voice over IP
(VolP), may not have the same bandwidth limits, and it may be desirable to transmit and receive voice communications that include a wideband frequency range over such networks. For example, it may be desirable to support an audio frequency range that extends down to 50 Hz and/or up to 7 or 8 kHz. It may also be desirable to support other applications, such as high-quality audio or audio/video conferencing, that may have audio speech content in ranges outside the traditional PSTN limits.
[0004] Extension of the range supported by a speech coder into higher frequencies may improve intelligibility. For example, the information that differentiates fricatives such as 's' and `f is largely in the high frequencies. Highband extension may also improve other qualities of speech, such as presence. For example, even a voiced vowel may have spectral energy far above the PSTN limit.
[0005] In conducting research on wideband speech signals, the inventors have occasionally observed pulses of high energy, or "bursts", in the upper part of the spectrum. These highband bursts typically last only a few milliseconds (typically 2 milliseconds, with a maximum length of about 3 milliseconds), may span up to several kilohertz (kHz) in frequency, and occur apparently randomly during different types of speech sounds, both voiced and unvoiced. For some speakers, a highband burst may occur in every sentence, while for other speakers such bursts may not occur at all.
While these events do not generally occur frequently, they do seem to be ubiquitous, as the inventors have found examples of them in wideband speech samples from several different databases and from several other sources.
While these events do not generally occur frequently, they do seem to be ubiquitous, as the inventors have found examples of them in wideband speech samples from several different databases and from several other sources.
[0006] Ilighband bursts have a wide frequency range but typically only occur in the higher band of the spectrum, such as the region from 3.5 to 7 kHz, and not in the lower band. For example, FIGURE 1 shows a spectrogram of the word 'can'. In this widoband speech signal, a highband burst may be seen at 0.1 seconds extending across a wide frequency region around 6 kHz (in this figure, darker regions indicate higher intensity). It is possible that at least some highband bursts are generated by an interaction between the speaker's mouth and the microphone and/or are due to clicks emitted by the speaker's mouth during speech.
2a SUMMARY
[0006a] According to a first broad aspect of the present invention, there is provided a method of signal processing, said method comprising: calculating a first burst indication signal that indicates whether a burst is detected in a low-frequency portion of a speech signal;
calculating a second burst indication signal that indicates whether a burst is detected in a high-frequency portion of the speech signal; generating an attenuation control signal according to a relation between the first and second burst indication signals; applying the attenuation control signal to the high-frequency portion of the speech signal to generate a processed high-frequency signal portion, wherein calculating at least one of the first and second burst indication signals comprises: producing a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction; indicating an initial region of a burst in the forward smoothed envelope;
producing a backward smoothed envelope of the corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction;
and indicating a terminal region of a burst in the backward smoothed envelope.
[0006b] According to a second broad aspect of the present invention, there is provided a non-transitory data storage medium having machine-executable instructions that when executed by a processor cause the processor to perform the method of signal processing according to the first broad aspect of the present invention.
10006c1 According to a third broad aspect of the present invention, there is provided an apparatus comprising a highband burst suppressor, said highband burst suppressor comprising: a first burst detector configured to output a first burst indication signal indicating whether a burst is detected in a low-frequency portion of a speech signal; a second burst detector configured to output a second burst indication signal indicating whether a burst is detected in a high-frequency portion of the speech signal; an attenuation control signal generator configured to generate an attenuation control signal according to a relation between the first and second burst indication signals; and a gain control element configured to apply the attenuation control signal to the high-frequency portion of the signal, wherein at least one 2b of said first and second burst detectors comprises: a forward smoother configured to produce a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction; a first region indicator configured to indicate an initial region of a burst in the forward smoothed envelope; a backward smoother configured to produce a backward smoothed envelope of a corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction; and a second region indicator configured to indicate a terminal region of a burst in the backward smoothed envelope.
CA 0 2 6 0 2 8 0 4 2 0 1 2 ¨ 0 8 ¨ 3 0 2c [000'7] A method of signal processing according to one embodiment includes processing a wideband speech signal to obtain a lowband speech signal and a highband speech signal; determining that a burst is present in a region of the highband speech signal; and determining that the burst is absent from a corresponding region of the lowband speech signal. The method also includes, based on determining that the burst is present and on determining that the burst is absent, attenuating the highband speech signal over the region.
[0008] An apparatus according to an embodiment includes a first burst detector configured to detect bursts in the lowband speech signal; a second burst detector configured to detect bursts in a corresponding highband speech signal; an attenuation control signal calculator configured to calculate an attenuation control signal according to a difference between outputs of the first and second burst detectors; and a gain control element configured to apply the attenuation control signal to the highband speech signal.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] FIGURE 1 shows a spectrogram of a signal including a highband burst.
[00010] FIGURE 2 shows a spectrogram of a signal in which a highband burst has been suppressed.
[00011] FIGURE 3 shows a block diagram of an arrangement including a filter bank A110 and a highband burst suppressor C200 according to an embodiment.
[00012] FIGURE 4 shows a block diagram of an arrangement including filter bank A110, highband burst suppressor C200, and a filter bank B120.
[00013] FIGURE 5a shows a block diagram of an implementation A112 of filter bank A110.
[00014] FIGURE 5b shows a block diagram of an implementation B122 of filter bank B120.
[00015] FIGURE 6a shows bandwidth coverage of the low and high bands for one example of filter bank A110.
[00016] FIGURE 6b shows bandwidth coverage of the low and high bands for another example of filter bank A110.
[00017] FIGURE 6c shows a block diagram of an implementation A114 of filter bank A112.
[00018] FIGURE 6d shows a block diagram of an implementation B124 of filter bank B122.
[00019] FIGURE 7 shows a block diagram of an arrangement including filter bank A110, highband burst suppressor C200, and a highband speech encoder A200.
[00020] FIGURE 8 shows a block diagram of an arrangement including filter bank A110, highband burst suppressor C200, filter bank B120, and a wideband speech encoder A100.
[00021] FIGURE 9 shows a block diagram of a wideband speech encoder A102 that includes highband burst suppressor C200.
[00022] FIGURE 10 shows a block diagram of an implementation A104 of wideband speech encoder A102.
[00023] FIGURE 11 shows a block diagram of an arrangement including wideband speech encoder A104 and a multiplexer A130.
[00024] FIGURE 12 shows a block diagram of an implementation C202 of highband burst suppressor C200.
[00025] FIGURE 13 shows a block diagram of an implementation C12 of burst detector C10.
[00026] FIGURES 14a and 14b show block diagrams of implementations C52-1, C52-2 of initial region indicator C50-1 and terminal region indicator C50-2, respectively.
[00027] FIGURE 15 shows a block diagram of an implementation C62 of coincidence detector C60.
[00028] FIGURE 16 shows a block diagram of an implementation C22 of attenuation control signal generator C20.
[00029] FIGURE 17 shows a block diagram of an implementation C14 of burst detector C12.
[00030] FIGURE 18 shows a block diagram of an implementation C16 of burst detector C14.
[00031] FIGURE 19 shows a block diagram of an implementation C18 of burst detector C16.
[00032] FIGURE 20 shows a block diagram of an implementation C24 of attenuation control signal generator C22.
DETAILED DESCRIPTION
[00033] Unless expressly limited by its context, the term "calculating" is used herein to indicate any of its ordinary meanings, such as computing, generating, and selecting from a list of values. Where the term "comprising" is used in the present description and claims, it does not exclude other elements or operations.
[00034] Highband bursts are quite audible in the original speech signal, but they do not contribute to intelligibility, and the quality of the signal may be improved by suppressing them. Highband bursts may also be detrimental to encoding of the highband speech signal, such that efficiency of coding the signal, and especially of encoding the temporal envelope, may be improved by suppressing the bursts from the highband speech signal.
[00035] Highband bursts may negatively affect high-band coding systems in several ways. First, these bursts may cause the energy envelope of the speech signal over time to be much less smooth by introducing a sharp peak at the time of the burst.
Unless the coder models the temporal envelope of the signal with high resolution, which increases the amount of information to be sent to the decoder, the energy of the burst may become smeared out over time in the decoded signal and cause artifacts. Second, highband bursts tend to dominate the spectral envelope as modeled by, for example, a set of parameters such as linear prediction filter coefficients. Such modeling is typically performed for each frame of the speech signal (about 20 milliseconds).
Consequently, the frame containing the click may be synthesized according to a spectral envelope that is different from the preceding and following frames, which can lead to a perceptually objectionable discontinuity.
[00036] Highband bursts may cause another problem for a speech coding system in which an excitation signal for the highband synthesis filter is derived from or otherwise represents a narrowband residual. In such case, presence of a highband burst may complicate coding of the highband speech signal because the highband speech signal includes a structure that is absent from the narrowband speech signal.
2a SUMMARY
[0006a] According to a first broad aspect of the present invention, there is provided a method of signal processing, said method comprising: calculating a first burst indication signal that indicates whether a burst is detected in a low-frequency portion of a speech signal;
calculating a second burst indication signal that indicates whether a burst is detected in a high-frequency portion of the speech signal; generating an attenuation control signal according to a relation between the first and second burst indication signals; applying the attenuation control signal to the high-frequency portion of the speech signal to generate a processed high-frequency signal portion, wherein calculating at least one of the first and second burst indication signals comprises: producing a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction; indicating an initial region of a burst in the forward smoothed envelope;
producing a backward smoothed envelope of the corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction;
and indicating a terminal region of a burst in the backward smoothed envelope.
[0006b] According to a second broad aspect of the present invention, there is provided a non-transitory data storage medium having machine-executable instructions that when executed by a processor cause the processor to perform the method of signal processing according to the first broad aspect of the present invention.
10006c1 According to a third broad aspect of the present invention, there is provided an apparatus comprising a highband burst suppressor, said highband burst suppressor comprising: a first burst detector configured to output a first burst indication signal indicating whether a burst is detected in a low-frequency portion of a speech signal; a second burst detector configured to output a second burst indication signal indicating whether a burst is detected in a high-frequency portion of the speech signal; an attenuation control signal generator configured to generate an attenuation control signal according to a relation between the first and second burst indication signals; and a gain control element configured to apply the attenuation control signal to the high-frequency portion of the signal, wherein at least one 2b of said first and second burst detectors comprises: a forward smoother configured to produce a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction; a first region indicator configured to indicate an initial region of a burst in the forward smoothed envelope; a backward smoother configured to produce a backward smoothed envelope of a corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction; and a second region indicator configured to indicate a terminal region of a burst in the backward smoothed envelope.
CA 0 2 6 0 2 8 0 4 2 0 1 2 ¨ 0 8 ¨ 3 0 2c [000'7] A method of signal processing according to one embodiment includes processing a wideband speech signal to obtain a lowband speech signal and a highband speech signal; determining that a burst is present in a region of the highband speech signal; and determining that the burst is absent from a corresponding region of the lowband speech signal. The method also includes, based on determining that the burst is present and on determining that the burst is absent, attenuating the highband speech signal over the region.
[0008] An apparatus according to an embodiment includes a first burst detector configured to detect bursts in the lowband speech signal; a second burst detector configured to detect bursts in a corresponding highband speech signal; an attenuation control signal calculator configured to calculate an attenuation control signal according to a difference between outputs of the first and second burst detectors; and a gain control element configured to apply the attenuation control signal to the highband speech signal.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] FIGURE 1 shows a spectrogram of a signal including a highband burst.
[00010] FIGURE 2 shows a spectrogram of a signal in which a highband burst has been suppressed.
[00011] FIGURE 3 shows a block diagram of an arrangement including a filter bank A110 and a highband burst suppressor C200 according to an embodiment.
[00012] FIGURE 4 shows a block diagram of an arrangement including filter bank A110, highband burst suppressor C200, and a filter bank B120.
[00013] FIGURE 5a shows a block diagram of an implementation A112 of filter bank A110.
[00014] FIGURE 5b shows a block diagram of an implementation B122 of filter bank B120.
[00015] FIGURE 6a shows bandwidth coverage of the low and high bands for one example of filter bank A110.
[00016] FIGURE 6b shows bandwidth coverage of the low and high bands for another example of filter bank A110.
[00017] FIGURE 6c shows a block diagram of an implementation A114 of filter bank A112.
[00018] FIGURE 6d shows a block diagram of an implementation B124 of filter bank B122.
[00019] FIGURE 7 shows a block diagram of an arrangement including filter bank A110, highband burst suppressor C200, and a highband speech encoder A200.
[00020] FIGURE 8 shows a block diagram of an arrangement including filter bank A110, highband burst suppressor C200, filter bank B120, and a wideband speech encoder A100.
[00021] FIGURE 9 shows a block diagram of a wideband speech encoder A102 that includes highband burst suppressor C200.
[00022] FIGURE 10 shows a block diagram of an implementation A104 of wideband speech encoder A102.
[00023] FIGURE 11 shows a block diagram of an arrangement including wideband speech encoder A104 and a multiplexer A130.
[00024] FIGURE 12 shows a block diagram of an implementation C202 of highband burst suppressor C200.
[00025] FIGURE 13 shows a block diagram of an implementation C12 of burst detector C10.
[00026] FIGURES 14a and 14b show block diagrams of implementations C52-1, C52-2 of initial region indicator C50-1 and terminal region indicator C50-2, respectively.
[00027] FIGURE 15 shows a block diagram of an implementation C62 of coincidence detector C60.
[00028] FIGURE 16 shows a block diagram of an implementation C22 of attenuation control signal generator C20.
[00029] FIGURE 17 shows a block diagram of an implementation C14 of burst detector C12.
[00030] FIGURE 18 shows a block diagram of an implementation C16 of burst detector C14.
[00031] FIGURE 19 shows a block diagram of an implementation C18 of burst detector C16.
[00032] FIGURE 20 shows a block diagram of an implementation C24 of attenuation control signal generator C22.
DETAILED DESCRIPTION
[00033] Unless expressly limited by its context, the term "calculating" is used herein to indicate any of its ordinary meanings, such as computing, generating, and selecting from a list of values. Where the term "comprising" is used in the present description and claims, it does not exclude other elements or operations.
[00034] Highband bursts are quite audible in the original speech signal, but they do not contribute to intelligibility, and the quality of the signal may be improved by suppressing them. Highband bursts may also be detrimental to encoding of the highband speech signal, such that efficiency of coding the signal, and especially of encoding the temporal envelope, may be improved by suppressing the bursts from the highband speech signal.
[00035] Highband bursts may negatively affect high-band coding systems in several ways. First, these bursts may cause the energy envelope of the speech signal over time to be much less smooth by introducing a sharp peak at the time of the burst.
Unless the coder models the temporal envelope of the signal with high resolution, which increases the amount of information to be sent to the decoder, the energy of the burst may become smeared out over time in the decoded signal and cause artifacts. Second, highband bursts tend to dominate the spectral envelope as modeled by, for example, a set of parameters such as linear prediction filter coefficients. Such modeling is typically performed for each frame of the speech signal (about 20 milliseconds).
Consequently, the frame containing the click may be synthesized according to a spectral envelope that is different from the preceding and following frames, which can lead to a perceptually objectionable discontinuity.
[00036] Highband bursts may cause another problem for a speech coding system in which an excitation signal for the highband synthesis filter is derived from or otherwise represents a narrowband residual. In such case, presence of a highband burst may complicate coding of the highband speech signal because the highband speech signal includes a structure that is absent from the narrowband speech signal.
[00037] Embodiments include systems, methods, and apparatus configured to detect bursts that exist in a highband speech signal, but not in a corresponding lowband speech signal, and to reduce a level of the highband speech signal during each of the bursts.
Potential advantages of such embodiments include avoiding artifacts in the decoded signal and/or avoiding a loss of coding efficiency without noticeably degrading the quality of the original signal. FIGURE 2 shows a spectrogram of the wideband signal shown in FIGURE 1 after suppression of the highband burst according to such a method.
[00038] FIGURE 3 shows a block diagram of an arrangement including a filter bank A110 and a highband burst suppressor C200 according to an embodiment. Filter bank A110 is configured to filter wideband speech signal S10 to produce a lowband speech signal S20 and a highband speech signal S30. Highband burst suppressor C200 is configured to output a processed highband speech signal 330a based on highband speech signal 530, in which bursts that occur in highband speech signal S30 but are absent from lowband speech signal S20 have been suppressed.
[00039] FIGURE 4 shows a block diagram of the arrangement shown in FIGURE 3 that also includes a filter bank B120. Filter bank B120 is configured to combine lowband speech signal S20 and processed highband speech signal S30a to produce a processed wideband speech signal SlOa. The quality of processed wideband speech signal SlOa may be improved over that of wideband speech signal S10 due to suppression of highband bursts.
[00040] Filter bank A110 is configured to filter an input signal according to a split-band scheme to produce a low-frequency subband and a high-frequency subband.
Depending on the design criteria for the particular application, the output subbands may have equal or unequal bandwidths and may be overlapping or nonoverlapping. A
configuration of filter bank A110 that produces more than two subbands is also possible. For example, such a filter bank may be configured to produce a very-low-band signal that includes components in a frequency range below that of narrowband signal S20 (such as the range of 50-300 Hz). In such case, wideband speech encoder A100 (as introduced with reference to FIG. 8 below) may be implemented to encode this very-low-band signal separately, and multiplexer A130 (as introduced with reference to FIG. 11 below) may be configured to include the encoded very-low-band signal in multiplexed signal S70 (e.g., as a separable portion).
[00041] FIGURE 5a shows a block diagram of an implementation A112 of filter bank A110 that is configured to produce two subband signals having reduced sampling rates.
Filter bank A110 is arranged to receive a wideband speech signal S10 having a high-frequency (or highband) portion and a low-frequency (or lowband) portion.
Filter bank A112 includes a lowband processing path configured to receive wideband speech signal S10 and to produce lowband speech signal S20, and a highband processing path configured to receive wideband speech signal S10 and to produce highband speech signal S30. Lowpass filter 110 filters wideband speech signal S10 to pass a selected low-frequency subband, and highpass filter 130 filters wideband speech signal S10 to pass a selected high-frequency subband. Because both subband signals have more narrow bandwidths than wideband speech signal S10, their sampling rates can be reduced to some extent without loss of information. Downsampler 120 reduces the sampling rate of the lowpass signal according to a desired decimation factor (e.g., by removing samples of the signal and/or replacing samples with average values), and downsampler 140 likewise reduces the sampling rate of the highpass signal according to .
another desired decimation factor.
[00042] FIGURE 5b shows a block diagram of a corresponding implementation B122 of filter bank B120. Upsampler 150 increases the sampling rate of lowband speech signal S20 (e.g., by zero-stuffing and/or by duplicating samples), and lowpass filter 160 filters the upsampled signal to pass only a lowband portion (e.g., to prevent aliasing).
Likewise, upsampler 170 increases the sampling rate of processed highband signal S30a and highpass filter 180 filters the upsampled signal to pass only a highband portion. The two passband signals are then summed to form wideband speech signal Si Oa. In some implementations of an apparatus that includes filter bank B120, filter bank B120 is configured to produce a weighted sum of the two passband signals according to one or more weights received and/or calculated by the apparatus. A configuration of filter bank B120 that combines more than two passband signals is also contemplated.
[00043] Each of the filters 110, 130, 160, 180 may be implemented as a finite-impulse-response (FIR) filter or as an infinite-impulse-response (BR) filter. The frequency responses of filters 110 and 130 may have symmetric or dissimilarly shaped transition regions between stopband and passband. Likewise, the frequency responses of filters 160 and 180 may have symmetric or dissimilarly shaped transition regions between stopband and passband. It may be desirable but is not strictly necessary for lowpass filter 110 to have the same response as lowpass filter 160, and for highpass filter 130 to have the same response as highpass filter 180. In one example, the two filter pairs 110, 130 and 160, 180 are quadrature mirror filter (QMF) banks, with filter pair 110, 130 having the same coefficients as filter pair 160, 180.
[00044] In a typical example, lowpass filter 110 has a passband that includes the limited PSTN range of 300-3400 Hz (e.g., the band from 0 to 4 kHz). FIGURES 6a and 6b show relative bandwidths of wideband speech signal S10, lowband speech signal S20, and highband speech signal S30 in two different implementational examples. In both of these particular examples, wideband speech signal S10 has a sampling rate of 16 kHz (representing frequency components within the range of 0 to 8 kHz), and lowband signal S20 has a sampling rate of 8 kHz (representing frequency components within the range of 0 to 4 kHz).
[00045] In the example of FIGURE 6a, there is no significant overlap between the two subbands. A highband signal S30 as shown in this example may be obtained using a highpass filter 130 with a passband of 4-8 kHz. In such a case, it may be desirable to reduce the sampling rate to 8 kHz by downsampling the filtered signal by a factor of two. Such an operation, which may be expected to significantly reduce the computational complexity of further processing operations on the signal, will move the passband energy down to the range of 0 to 4 kHz without loss of information.
[00046] In the alternative example of FIGURE 6b, the upper and lower subbands have an appreciable overlap, such that the region of 3.5 to 4 kHz is described by both subband signals. A highband signal S30 as in this example may be obtained using a highpass filter 130 with a passband of 3.5-7 kHz. In such a case, it may be desirable to reduce the sampling rate to 7 kHz by downsampling the filtered signal by a factor of 16/7. Such an operation, which may be expected to significantly reduce the computational complexity of further processing operations on the signal, will move the passband energy down to the range of 0 to 3.5 kHz without loss of information.
[00047] In a typical handset for telephonic communication, one or more of the transducers (i.e., the microphone and the earpiece or loudspeaker) lacks an appreciable response over the frequency range of 7-8 kHz. In the example of FIGURE 6b, the portion of wideband speech signal S10 between 7 and 8 kHz is not included in the encoded signal. Other particular examples of highpass filter 130 have passbands of 3.5-'73 kHz and 3.5-8 kHz.
[00048] In some implementations, providing an overlap between subbands as in the example of FIGURE 6b allows for the use of a lowpass and/or a highpass filter having a smooth rolloff over the overlapped region. Such filters are typically less computationally complex and/or introduce less delay than filters with sharper or "brick-wall" responses. Filters having sharp transition regions tend to have higher sidelobes (which may cause aliasing) than filters of similar order that have smooth rolloffs.
Filters having sharp transition regions may also have long impulse responses which may cause ringing artifacts. For filter bank implementations having one or more DR
filters, allowing for a smooth rolloff over the overlapped region may enable the use of a filter or filters whose poles are farther away from the unit circle, which may be important to ensure a stable fixed-point implementation.
[00049] Overlapping of subbands allows a smooth blending of lowband and highband that may lead to fewer audible artifacts, reduced aliasing, and/or a less noticeable transition from one band to the other. Moreover, in an application where the lowband and highband speech signals S20, S30 are subsequently encoded by different speech encoders, the coding efficiency of the lowband speech encoder (for example, a waveform coder) may drop with increasing frequency. For example, coding quality of the lowband speech coder may be reduced at low bit rates, especially in the presence of background noise. In such cases, providing an overlap of the subbands may increase the quality of reproduced frequency components in the overlapped region.
[00050] Moreover, overlapping of subbands allows a smooth blending of lowband and highband that may lead to fewer audible artifacts, reduced aliasing, and/or a less noticeable transition from one band to the other. Such a feature may be especially desirable for an implementation in which lowband speech encoder A120 and highband speech encoder A200 as discussed below operate according to different coding methodologies.=
For example, different coding techniques may produce signals that sound quite different. A
coder that encodes a spectral envelope in the form of codebook indices may produce a signal having a different sound than a coder that encodes the amplitude spectrum instead. A time-domain coder (e.g., a pulse-code-modulation or PCM coder) may =
produce a signal having a different sound than a frequency-domain coder. A
coder that encodes a signal with a representation of the spectral envelope and the corresponding residual signal may produce a signal having a different sound than a coder that encodes a signal with only a representation of the spectral envelope. A coder that encodes a signal as a representation of its waveform may produce an output having a different sound than that from a sinusoidal coder. In such cases, using filters having sharp transition regions to define nonoverlapping subbands may lead to an abrupt and perceptually noticeable transition between the subbands in the synthesized wideband signal.
[00051] Although QMF filter banks having complementary overlapping frequency responses are often used in subband techniques, such filters are unsuitable for at least some of the wideband coding implementations described herein. A QMF filter bank at the encoder is configured to create a significant degree of aliasing that is canceled in the corresponding QMF filter bank at the decoder. Such an arrangement may not be appropriate for an application in which the signal incurs a significant amount of distortion between the filter banks, as the distortion may reduce the effectiveness of the alias cancellation property. For example, applications described herein include coding implementations configured to operate at very low bit rates. As a consequence of the very low bit rate, the decoded signal is likely to appear significantly distorted as compared to the original signal, such that use of QMF filter banks may lead to uncanceled aliasing. Applications that use QMF filter banks typically have higher bit rates (e.g., over 12 kbps for AMR, and 64 kbps for G.722).
[00052] Additionally, a coder may be configured to produce a synthesized signal that is perceptually similar to the original signal but which actually differs significantly from the original signal. For example, a coder that derives the highband excitation from the narrowband residual as described herein may produce such a signal, as the actual highband residual may be completely absent from the decoded signal. Use of QMF
filter banks in such applications may lead to a significant degree of distortion caused by uncanceled aliasing.
[00053] The amount of distortion caused by QMF aliasing may be reduced if the affected subband is narrow, as the effect of the aliasing is limited to a bandwidth equal to the width of the subband. For examples as described herein in which each subband includes about half of the wideband bandwidth, however, distortion caused by uncanceled aliasing could affect a significant part of the signal. The quality of the signal may also be affected by the location of the frequency band over which the uncanceled aliasing occurs. For example, distortion created near the center of a wideband speech signal (e.g., between 3 and 4 kHz) may be much more objectionable than distortion that occurs near an edge of the signal (e.g., above 6 kHz).
[00054] While the responses of the filters of a WY filter bank are strictly related to one another, the lowband and highband paths of filter banks A110 and B120 may be configured to have spectra that are completely unrelated apart from the overlapping of the two subbands. We define the overlap of the two subbands as the distance from the point at which the frequency response of the highband filter drops to ¨20 dB
up to the point at which the frequency response of the lowband filter drops to ¨20 dB.
In various examples of filter bank A110 and/or B120, this overlap ranges from around 200 Hz to around 1 kHz. The range of about 400 to about 600 Hz may represent a desirable tradeoff between coding efficiency and perceptual smoothness. In one particular example as mentioned above, the overlap is around 500 Hz.
[00055] It may be desirable to implement filter bank A112 and/or B122 to perform operations as illustrated in FIGURES 6a and 6b in several stages. For example, FIGURE 6c shows a block diagram of an implementation A114 of filter bank A112 that performs a functional equivalent of highpass filtering and downsampling operations using a series of interpolation, resampling, decimation, and other operations.
Such an implementation may be easier to design and/or may allow reuse of functional blocks of logic and/or code. For example, the same functional block may be used to perform the operations of decimation to 14 kHz and decimation to 7 kHz as shown in FIGURE
6c.
The spectral reversal operation may be implemented by multiplying the signal with the function eft"' or the sequence (-1)fl, whose values alternate between +1 and ¨1. The spectral shaping operation may be implemented as a lowpass filter configured to shape the signal to obtain a desired overall filter response.
[00056] It is noted that as a consequence of the spectral reversal operation, the spectrum of highband signal S30 is reversed. Subsequent operations in the encoder and corresponding decoder may be configured accordingly. For example, it may be desired to produce a corresponding excitation signal that also has a spectrally reversed form.
[00057] FIGURE 6d shows a block diagram of an implementation B124 of filter bank 13122 that performs a functional equivalent of upsampling and highpass filtering operations using a series of interpolation, resampling, and other operations.
Filter bank B124 includes a spectral reversal operation in the highband that reverses a similar operation as performed, for example, in a filter bank of the encoder such as filter bank A114. In this particular example, filter bank B124 also includes notch filters in the lowband and highband that attenuate a component of the signal at 7100 Hz, although such filters are optional and need not be included. The Patent Application "SYSTEMS, METHODS, AND APPARATUS FOR SPF.FCH SIGNAL FILTERING" filed herewith, published as U.S. Pub. No. 2007/0088558, includes additional description and figures relating to responses of elements of particular implementations of filter banks A110 and B120.
[00058] As noted above, highband burst suppression may improve the efficiency of coding highband speech signal S30. FIGURE 7 shows a block diagram of an arrangement in which processed highband speech signal S30a, as produced by highband burst suppressor C200, is encoded by a highband speech encoder A200 to produce encoded highband speech signal S30b.
[00059] One approach to wideband speech coding involves scaling a narrowband speech coding technique (e.g., one configured to encode the range of 0-4 kHz) to cover the wideband spectrum. For example, a speech signal may be sampled at a higher rate to include components at high frequencies, and a narrowband coding technique may be reconfigured to use more filter coefficients to represent this wideband signal. FIGURE
8 shows a block diagram of an example in which a wideband speech encoder A100 is arranged to encode processed wideband speech signal SlOa to produce encoded wideband speech signal SlOb.
[00060] Narrowband coding techniques such as CELP (codebook excited linear prediction) are computationally intensive, however, and a wideband CR1 .P
coder may consume too many processing cycles to be practical for many mobile and other embedded applications. Encoding the entire spectrum of a wideband signal to a desired quality using such a technique may also lead to an unacceptably large increase in bandwidth. Moreover, transcoding of such an encoded signal would be required before even its narrowband portion could be transmitted into and/or decoded by a system that only supports narrowband coding_ FIGURE 9 shows a block diagram of a wideband speech encoder A102 that includes separate lowband and highband speech encoders A120 and A200, respectively.
[000611 It may be desirable to implement wideband speech coding such that at least the narrowband portion of the encoded signal may be sent through a narrowband channel (such as a PSTN channel) without transcoding or other significant modification.
Efficiency of the wideband coding extension may also be desirable, for example, to avoid a significant reduction in the number of users that may be serviced in applications such as wireless cellular telephony and broadcasting over wired and wireless channels.
[00062] One approach to wideband speech coding involves extrapolating the highband spectral envelope from the encoded narrowband spectral envelope. While such an approach may be implemented without any increase in bandwidth and without a need -for transcoding, however, the coarse spectral envelope or formant structure of the highband portion of a speech signal generally cannot be predicted accurately from the spectral envelope of the narrowband portion_ [000631 FIGURE 10 shows a block diagram of a wideband speech encoder A104 that uses another approach to encoding the highband speech signal according to information -from the lowband speech signal. In this example, the highband excitation signal is derived from the encoded lowband excitation signal S50. Encoder A104 may be configured to encode a gain envelope based on a signal based on the highband excitation signal, for example, according to one or more such embodiments as described in the published patent application WO 2006/107837 entitled METHODS
AND APPARATUS FOR ENCODING AND DECODING AN HIGHBAND PORTION
OF A SPEECH SIGNAL. One particular example of wideband speech encoder A104 is configured to encode wideband speech signal S10 at a rate of about 8.55 kbps (kilobits per second), with about 7.55 kbps being used for lowband filter parameters S40 and encoded lowband excitation signal S50, and about 1 kbps being used for encoded highband speech S30b.
[00064] It may be desired to combine the encoded lowband and highband signals into a single bitstream. For example, it may be desired to multiplex the encoded signals together for transmission (e.g., over a wired, optical, or wireless transmission channel), or for storage, as an encoded wideband speech signal. FIGURE 11 shows a block diagram of an arrangement including wideband speech encoder A104 and a multiplexer A130 configured to combine lowband filter parameters S40, encoded lowband excitation signal S50, and encoded highband speech signal S30b into a multiplexed signal S70.
[00065] It may be desirable for multiplexer A130 to be configured to embed the encoded lowband signal (including lowband filter parameters S40 and encoded lowband excitation signal S50) as a separable substream of multiplexed signal S70, such that the encoded lowband signal may be recovered and decoded independently of another portion of multiplexed signal S70 such as a highband and/or very-low-band signal. For example, multiplexed signal S70 may be arranged such that the encoded lowband signal may be recovered by stripping away the encoded highband speech signal S30b.
One potential advantage of such a feature is to avoid the need for transcoding the encoded wideband signal before passing it to a system that supports decoding of the lowband signal but does not support decoding of the highhand portion.
[00066] An apparatus including a lowband, highband, and/or wideband speech encoder as described herein may also include circuitry configured to transmit the encoded signal into a transmission channel such as a wired, optical, or wireless channel.
Such an apparatus may also be configured to perform one or more channel encoding operations on the signal, such as error correction encoding (e.g., rate-compatible convolutional encoding) and/or error detection encoding (e.g., cyclic redundancy encoding), and/or one or more layers of network protocol encoding (e.g., Ethernet, TCP/IP, cdma2000).
[00067] Any or all of the lowband, highband, and wideband speech encoders described herein may be implemented according to a source-filter model that encodes the input speech signal as (A) a set of parameters that describe a filter and (B) an excitation signal that drives the described filter to produce a synthesized reproduction of the input speech signal. For example, a spectral envelope of a speech signal is characterized by a number of peaks that represent resonances of the vocal tract and are called formants.
Most speech coders encode at least this coarse spectral structure as a set of parameters such as filter coefficients.
[00068] In one example of a basic source-filter arrangement, an analysis module calculates a set of parameters that characterize a filter corresponding to the speech =
sound over a period of time (typically 20 msec). A whitening filter (also called an analysis or prediction error filter) configured according to those filter parameters removes the spectral envelope to spectrally flatten the signal. The resulting whitened signal (also called a residual) has less energy and thus less variance and is easier to encode than the original speech signal. Errors resulting from coding of the residual signal may also be spread more evenly over the spectrum. The filter parameters and residual are typically quantized for efficient transmission over the channel.
At the decoder, a synthesis filter configured according to the filter parameters is excited by the residual to produce a synthesized version of the original speech sound. The synthesis filter is typically configured to have a transfer function that is the inverse of the transfer function of the whitening filter.
[00069] The analysis module may be implemented as a linear prediction coding (LPC) analysis module that encodes the spectral envelope of the speech signal as a set of linear prediction (LP) coefficients (e.g., coefficients of an all-pole filter 1/A(z)). The analysis module typically processes the input signal as a series of nonoverlapping frames, with a new set of coefficients being calculated for each frame. The frame period is generally a period over which the signal may be expected to be locally stationary; one common example is 20 milliseconds (equivalent to 160 samples at a sampling rate of 8 kHz).
One example of a lowband LPC analysis module is configured to calculate a set of ten LP filter coefficients to characterize the formant structure of each 20-millisecond frame of lowband speech signal S20, and one example of a highband LPC analysis module is configured to calculate a set of six (alternatively, eight) LP filter coefficients to characterize the formant structure of each 20-millisecond frame of highband speech signal S30. It is also possible to implement the analysis module to process the input signal as a series of overlapping frames.
[00070] The analysis module may be configured to analyze the samples of each frame directly, or the samples may be weighted first according to a windowing function (for example, a Hamming window). The analysis may also be performed over a window that is larger than the frame, such as a 30-msec window. This window may be symmetric (e.g. 5-20-5, such that it includes the 5 milliseconds immediately before and after the 20-millisecond frame) or asymmetric (e.g. 10-20, such that it includes the last 10 milliseconds of the preceding frame). An LPC analysis module is typically configured to calculate the LP filter coefficients using a Levinson-Durbin recursion or the Leroux-Gueguen algorithm. In another implementation, the analysis module may be configured to calculate a set of cepstral coefficients for each frame instead of a set of LP
filter coefficients.
[00071] The output rate of a speech encoder may be reduced significantly, with relatively little effect on reproduction quality, by quantizing the filter parameters.
Linear prediction filter coefficients are difficult to quantize efficiently and are usually mapped by the speech encoder into another representation, such as line spectral pairs (LSPs) or line spectral frequencies (LSFs), for quantization and/or entropy encoding.
Other one-to-one representations of LP filter coefficients include parcor coefficients;
log-area-ratio values; immittance spectral pairs (ISPs); and immittance spectral frequencies (ISFs), which are used in the GSM (Global System for Mobile Communications) AMR-WB (Adaptive Multirate-Wideband) codec. Typically a transform between a set of LP filter coefficients and a corresponding set of LSFs is reversible, but embodiments also include implementations of a speech encoder in which the transform is not reversible without error.
[00072] A speech encoder is typically configured to quantize the set of narrowband LSFs (or other coefficient representation) and to output the result of this quantization as the filter parameters. Quantization is typically performed using a vector quantizer that encodes the input vector as an index to a corresponding vector entry in a table or codebook. Such a quantizer may also be configured to perform classified vector quantization. For example, such a quantizer may be configured to select one of a set of codebooks based on information that has already been coded within the same frame (e.g., in the lowband channel and/or in the highband channel). Such a technique typically provides increased coding efficiency at the expense of additional codebook storage.
[00073] A speech encoder may also be configured to generate a residual signal by passing the speech signal through a whitening filter (also called an analysis or prediction error filter) that is configured according to the set of filter coefficients.
The whitening filter is typically implemented as a FIR filter, although IIR implementations may also be used. This residual signal will typically contain perceptually important information of the speech frame, such as long-term structure relating to pitch, that is not represented in the filter parameters. Again, this residual signal is typically quantized for output. For example, lowband speech encoder A122 may be configured to calculate a quantized representation of the residual signal for output as encoded lowband excitation signal S50. Such quantization is typically performed using a vector quantizer that encodes the input vector as an index to a corresponding vector entry in a table or codebook and that may be configured to perform classified vector quantization as described above.
[000741 Alternatively, such a quantizer may be configured to send one or more parameters from which the vector may be generated dynamically at the decoder, rather than retrieved from storage, as in a sparse codebook method. Such a method is used in coding schemes such as algebraic CELP (codebook excitation linear prediction) and codecs such as 3GPP2 (Third Generation Partnership 2) EVRC (Enhanced Variable Rate Codec).
[00075] Some implementations of lowband speech encoder A120 are configured to calculate encoded lowband excitation signal S50 by identifying one among a set of codebook vectors that best matches the residual signal. It is noted, however, that lowband speech encoder A120 may also be implemented to calculate a quantized representation of the residual signal without actually generating the residual signal. For example, lowband speech encoder A120 may be configured to use a number of codebook vectors to generate corresponding synthesized signals (e.g., according to a current set of filter parameters), and to select the codebook vector associated with the generated signal that best matches the original lowband speech signal S20 in a perceptually weighted domain.
[00076] It may be desirable to implement lowband speech encoder A120 or A122 as an analysis-by-synthesis speech encoder. Codebook excitation linear prediction (CELP) coding is one popular family of analysis-by-synthesis coding, and implementations of such coders may perform waveform, encoding of the residual, including such operations as selection of entries from fixed and adaptive codeboolcs, error minimization operations, and/or perceptual weighting operations. Other implementations of analysis-by-synthesis coding include mixed excitation linear prediction (MELP), algebraic CFI P
(ACELP), relaxation CELP (RCELP), regular pulse excitation (RPE), multi-pulse CELP
(WE), and vector-sum excited linear prediction (VSFIP) coding. Related coding methods include multi-band excitation (MBE) and prototype waveform interpolation (PWI) coding. Examples of standardized analysis-by-synthesis speech codecs include the ETSI (European Telecommunications Standards Institute)-GSM full rate codec (GSM 06.10), which uses residual excited linear prediction (RELP); the GSM
enhanced full rate codec (ETSI-GSM 06.60); the ITU (International Telecommunication Union) standard 11.8 kb/s G.729 Annex E coder; the IS (Interim Standard)-641 codecs for IS-136 (a time-division multiple access scheme); the GSM adaptive multirate (GSM-AMR) codecs; and the 4GVTM (Fourth-Generation VocoderTM) codec (QUALCOMM
Incorporated, San Diego, CA). Existing implementations of RCELP coders include the Enhanced Variable Rate Codec (EVRC), as described in Telecommunications Industry Association (TIA) IS-127, and the Third Generation Partnership Project 2 (3GPP2) Selectable Mode Vocoder (SMV). The various lowband, highband, and wideband encoders described herein may be implemented according to any of these technologies, or any other speech coding technology (whether known or to be developed) that represents a speech signal as (A) a set of parameters that describe a filter and (B) a residual signal that provides at least part of an excitation used to drive the described filter to reproduce the speech signal.
[00077] FIGURE 12 shows a block diagram of an implementation C202 of highband burst suppressor C200 that includes two implementations C10-1, C10-2 of burst detector C10. Burst detector C10-1 is configured to produce a lowband burst indication signal SB10 that indicates a presence of a burst in lowband speech signal S20.
Burst detector C10-2 is configured to produce a highband burst indication signal SB20 that indicates a presence of a burst in highband speech signal S30. Burst detectors and C10-2 may be identical or may be instances of different implementations of burst detector C10. Highband burst suppressor C202 also includes an attenuation control signal generator C20 configured to generate an attenuation control signal SB70 according to a relation between lowband burst indication signal SB10 and highband burst indication signal SB20, and a gain control element C150 (e.g., a multiplier or amplifier) configured to apply attenuation control signal SB70 to highband speech signal S30 to produce processed highband speech signal S30a.
[00078] In the particular examples described herein, it may be assumed that highband burst suppressor C202 processes highband speech signal S30 in 20-millisecond frames, and that lowband speech signal S20 and highband speech signal S30 are both sampled at 8 kHz. However, these particular values are examples only, and not limitations, and other values may also be used according to particular design choices and/or as noted herein.
[00079] Burst detector C10 is configured to calculate forward and backward smoothed envelopes of the speech signal and to indicate the presence of a burst according to a time relation between an edge in the forward smoothed envelope and an edge in the backward smoothed envelope. Burst suppressor C202 includes two instances of burst detector C10, each arranged to receive a respective one of speech signals S20, S30 and to output a corresponding burst indication signal SB10, SB20.
[00080] FIGURE 13 shows a block diagram of an implementation C12 of burst detector C10 that is arranged to receive one of speech signals S20, S30 and to output a corresponding burst indication signal SB10, SB20. Burst detector C12 is configured to calculate each of the forward and backward smoothed envelopes in two stages.
In the first stage, a calculator C30 is configured to convert the speech signal to a constant-polarity signal. In one example, calculator C30 is configured to compute the constant-polarity signal as the square of each sample of the current frame of the corresponding speech signal. Such a signal may be smoothed to obtain an energy envelope. In another example, calculator C30 is configured to compute the absolute value of each incoming sample. Such a signal may be smoothed to obtain an amplitude envelope. Further implementations of calculator C30 may be configured to compute the constant-polarity signal according to another function such as clipping.
[00081] In the second stage, a forward smoother C40-1 is configured to smooth the constant-polarity signal in a forward time direction to produce a forward smoothed envelope, and a backward smoother C40-2 is configured to smooth the constant-polarity signal in a backward time direction to produce a backward smoothed envelope.
The forward smoothed envelope indicates a difference in the level of the corresponding speech signal over time in the forward direction, and the backward smoothed envelope indicates a difference in the level of the corresponding speech signal over time in the backward direction.
[00082] In one example, forward smoother C40-1 is implemented as a first-order infinite-impulse-response (Mt) filter configured to smooth the constant-polarity signal according to an expression such as the following:
Sf (n) = aSf (n-1) + (1¨ a)P(n), and backward smoother C40-2 is implemented as a first-order IIR filter configured to smooth the constant-polarity signal according to an expression such as the following:
S b() aS b (11 + +(la)P(n) , where n is a time index, P(n) is the constant-polarity signal, Sf (n) is the forward smoothed envelope, S b (n) is the backward smoothed envelope, and a is a decay factor having a value between 0 (no smoothing) and I. It may be noted that due in part to operations such as calculation of a backward smoothed envelope, a delay of at least one frame may be incurred in processed highband speech signal S30a. However, such a delay is relatively unimportant perceptually and is not uncommon even in real-time speech processing operations.
[00083] It may be desirable to select a value for a such that the decay time of the smoother is similar to the expected duration of a highband burst.
Typically forward smoother C40-1 and backward smoother C40-2 are configured to perform complementary versions of the same smoothing operation, and to use the same value of a , but in some implementations the two smoothers may be configured to perform different operations and/or to use different values.
Other recursive or non-recursive smoothing functions, including finite-impulse-response (FIR) or 111( filters of higher order, may also be used.
[00084] In other implementations of burst detector C12, one or both of forward smoother C40-1 and backward smoother C40-2 are configured to perform an adaptive smoothing operation. For example, forward smoother C40-1 may be configured to perform an adaptive smoothing operation according to an expression such as the following:
P(n), if P(n)f(n ¨1) S
f(fl) ={
aS f (n ¨1) + (1¨ a)P(n), if P(n) < S f (n in which smoothing is reduced or, as in this case, disabled at strong leading edges of the constant-polarity signal. In this or another implementation of burst detector C12, backward smoother C40-2 may be configured to perform an adaptive smoothing operation according to an expression such as the following:
P(n), if P(n) S b (n +1) S b (n) =
OeS b (n + 1) + (1¨ a)P(n), if P(n) < S b(n+1)' in which smoothing is reduced or, as in this case, disabled at strong trailing edges of the constant-polarity signal. Such adaptive smoothing may help to define the beginnings of burst events in the forward smoothed envelope and the ends of burst events in the backward smoothed envelope.
[00085] Burst detector C12 includes an instance of a region indicator C50 (initial region indicator C50-1) that is configured to indicate the beginning of a high-level event (e.g., a burst) in the forward smoothed envelope. Burst detector C12 also includes an instance of region indicator C50 (terminal region indicator C50-2) that is configured to indicate the ending of a high-level event (e.g., a burst) in the backward smoothed envelope.
[00086] FIGURE 14a shows a block diagram of an implementation C52-1 of initial region indicator C50-1 that includes a delay element C70-1 and an adder. Delay is configured to apply a delay having a positive magnitude, such that the forward smoothed envelope is reduced by a delayed version of itself. In another example, the current sample or the delayed sample may be weighted according to a desired weighting factor.
[00087] FIGURE 14b shows a block diagram of an implementation C52-2 of terminal region indicator C50-2 that includes a delay element C70-2 and an adder. Delay is configured to apply a delay having a negative magnitude, such that the backward smoothed envelope is reduced by an advanced version of itself. In another example, the current sample or the advanced sample may be weighted according to a desired weighting factor.
[00088] Various delay values may be used in different implementations of region indicator C52, and delay values having different magnitudes may be used in initial region indicator C52-1 and terminal region indicator C52-2. The magnitude of the delay may be selected according to a desired width of the detected region. For example, small delay values may be used to perform detection of a narrow edge region.
To obtain strong edge detection, it may be desired to use a delay having a magnitude similar to the expected edge width (for example, about 3 or 5 samples).
[00089] Alternatively, a region indicator C50 may be configured to indicate a wider region that extends beyond the corresponding edge. For example, it may be desirable for initial region indicator C50-1 to indicate an initial region of an event that extends in the forward direction for some time after the leading edge. Likewise, it may be desirable for terminal region indicator C50-2 to indicate a teiminal region of an event that extends in the backward direction for some time before the trailing edge.
In such case, it may be desirable to use a delay value having a larger magnitude, such as a magnitude similar to that of the expected length of a burst. In one such example, a delay of about 4 milliseconds is used.
[00090] Processing by a region indicator C50 may extend beyond the boundaries of the current frame of the speech signal, according to the magnitude and direction of the delay. For example, processing by initial region indicator C50-1 may extend into the preceding frame, and processing by terminal region indicator C50-2 may extend into the following frame.
[00091] As compared to other high-level events that may occur in the speech signal, a burst is distinguished by an initial region, as indicated in initial region indication signal SB50, that coincides in time with a terminal region, as indicated in terminal region indication signal SB60. For example, a burst may be indicated when the time distance between the initial and terminal regions is not greater than (alternatively, is less than) a predetermined coincidence interval, such as the expected duration of a burst.
Coincidence detector C60 is configured to indicate detection of a burst according to a coincidence in time of initial and terminal regions in the region indication signals SB50 and SB60. For an implementation in which initial and terminal region indication signals SB50, SB60 indicate regions that extend from the respective leading and trailing edges, for example, coincidence detector C60 may be configured to indicate an overlap in time of the extended regions.
[00092] FIGURE 15 shows a block diagram of an implementation C62 of coincidence detector C60 that includes a first instance C80-1 of clipper C80 configured to clip initial region indication signal SB50, a second instance C80-2 of clipper C80 configured to clip terminal region indication signal SB60, and a mean calculator C90 configured to output a corresponding burst indication signal according to a mean of the clipped signals. Clipper C80 is configured to clip values of the input signal according to an expression such as the following:
out = max(in,0).
[000931 Alternatively, clipper C80 may be configured to threshold the input signal according to an expression such as the following:
in, in out =c 0,0, hz < TL, where threshold 71. has a value greater than zero. Typically the instances C80-1 and C80-2 of clipper C80 will use the same threshold value, but it is possible for the two instances C80-1 and C80-2 to use different threshold values.
[00094] Mean calculator C90 is configured to output a corresponding burst indication signal SBIO, SB20, according to a mean of the clipped signals, that indicates the time location and strength of bursts in the input signal and has a value equal to or larger than zero. The geometric mean may provide better results than the arithmetic mean, especially for distinguishing bursts with defined initial and terminal regions from other events that have only a strong initial or terminal region. For example, the arithmetic mean of an event with only one strong edge may still be high, whereas the =
geometric mean of an event lacking one of the edges will be low or zero.
However, the geometric mean is typically more computationally intensive than the arithmetic mean.
In one example, an instance of mean calculator C90 arranged to process lowband results uses the arithmetic mean (i(a+ b)), and an instance of mean calculator C90 arranged to process highband results uses the more conservative geometric mean (4-a-T).
[00095] Other implementations of mean calculator C90 may be configured to use a different kind of mean, such as the harmonic mean. In a further implementation of coincidence detector C62, one or both of the initial and terminal region indication signals SB50, SB60 is weighted with respect to the other before or after clipping.
[00096] Other implementations of coincidence detector C60 are configured to detect bursts by measuring a time distance between leading and trailing edges. For example, one such implementation is configured to identify a burst as the region between a leading edge in initial region indication signal SB50 and a trailing edge in terminal region indication signal SB60 that are no more than a predetermined width apart. The predetermined width is based on an expected duration of a highband burst, and in one example a width of about 4 milliseconds is used.
[00097] A further implementation of coincidence detector C60 is configured to expand each leading edge in initial region indication signal SB50 in the forward direction by a desired time period (e.g. based on an expected duration of a highband burst), and to expand each trailing edge in terminal region indication signal SB60 in the backward direction by a desired time period (e.g. based on an expected duration of a highband burst). Such an implementation may be configured to generate the corresponding burst indication signal SB10, SB20 as the logical AND of these two expanded signals or, alternatively, to generate the corresponding burst indication signal SB10, SB20 to indicate a relative strength of the burst across an area where the regions overlap (e.g. by calculating a mean of the expanded signals). Such an implementation may be configured to expand only edges that exceed a threshold value. In one example, the edges are expanded by a time period of about 4 milliseconds.
[00098] Attenuation control signal generator C20 is configured to generate attenuation control signal SB70 according to a relation between lowband burst indication signal SB10 and highband burst indication signal SB20. For example, attenuation control signal generator C20 may be configured to generate attenuation control signal according to an arithmetic relation between burst indication signals SB10 and SB20, such as a difference.
[00099] FIGURE 16 shows a block diagram of an implementation C22 of attenuation control signal generator C20 that is configured to combine lowband burst indication signal SB10 and highband burst indication signal SB20 by subtracting the former from the latter. The resulting difference signal indicates where bursts exist in the high band that do not occur (or are weaker) in the low band. In a further implementation, one or both of the lowband and highband burst indication signals SB10, SB20 is weighted with respect to the other.
[000100] Attenuation control signal calculator C100 outputs attenuation control signal SB70 according to a value of the difference signal. For example, attenuation control signal calculator C100 may be configured to indicate an attenuation that varies according to the degree to which the difference signal exceeds a threshold value.
[000101]It may be desired for attenuation control signal generator C20 to be configured to perform operations on logarithmically scaled values. For example, it may be desirable to attenuate highband speech signal S30 according to a ratio between the levels of the burst indication signals (for example, according to a value in decibels or dB), and such a ratio may be easily calculated as the difference of logarithmically scaled values. The logarithmic scaling warps the signal along the magnitude axis but does not otherwise change its shape. FIGURE 17 shows an implementation C14 of burst detector C12 that includes an instance C130-1, C130-2 of logarithm calculator configured to logarithmically scale (e.g., according to a base of 10) the smoothed envelope in each of the forward and backward processing paths.
[000102]In one example, attenuation control signal calculator C100 is configured to calculate values of attenuation control signal SB70 in dB according to the following formula:
0, D dB < TdB
[000103] AdB = 201-2 ___________ 7 if D dB > TdB, 1+ exP(D as /1 ) [000104] where D dB denotes the difference between highband burst indication signal SB20 and lowband burst indication signal SB10, TdB denotes a threshold value, and AdB is the corresponding value of attenuation control signal SB70. In one particular example, threshold TdB has a value of 8 dB.
[000105]In another implementation, attenuation control signal calculator C100 is configured to indicate a linear attenuation according to the degree to which the difference signal exceeds a threshold value (e.g., 3 dB or 4 dB). In this example, attenuation control signal Sl370 indicates no attenuation until the difference signal exceeds the threshold value. When the difference signal exceeds the threshold value, attenuation control signal SB70 indicates an attenuation value that is linearly proportional to the amount by which the threshold value is currently exceeded.
[000106]Highband burst suppressor C202 includes a gain control element C150, such as a multiplier or amplifier, that is configured to attenuate highband speech signal S30 according to the current value of attenuation control signal SB70 to produce processed highband speech signal S30a. Typically, attenuation control signal SB70 indicates a value of no attenuation (e.g., a gain of 1.0 or 0 dB) unless a highband burst has been detected at the current location of highband speech signal S30, in which case a typical attenuation value is a gain reduction of 0.3 or about 10 dB.
[0001071An alternative implementation of attenuation control signal generator C22 may be configured to combine lowband burst indication signal SB10 and highband burst indication signal SB20 according to a logical relation. In one such example, the burst indication signals are combined by computing the logical AND of highband burst indication signal SB20 and the logical inverse of lowband burst indication signal SB10.
In this case, each of the burst indication signals may first be thresholded to obtain a binary-valued signal, and attenuation control signal calculator C100 may be configured to indicate a corresponding one of two attenuation states (e.g., one state indicating no attenuation) according to the state of the combined signal.
[000108]Before performing the envelope calculation, it may be desirable to shape the spectrum of one or both of speech signals 520 and S30 in order to flatten the spectrum and/or to emphasize or attenuate one or more particular frequency regions.
Lowband speech signal S20, for example, may tend to have more energy at low frequencies, and it may be desirable to reduce this energy. It may also be desirable to reduce high-frequency components of lowband speech signal S20 such that the burst detection is based primarily on the middle frequencies. Spectral shaping is an optional operation that may improve the performance of burst suppressor C200.
=
[000109]FIGURE 18 shows a block diagram of an implementation C16 of burst detector C14 that includes a shaping filter C110. In one example, filter C110 is configured to filter lowband speech signal S20 according to a passband transfer function such as the following:
1+0.96z-' +0.96C2 +
FIB (Z) 1-0.5z' which attenuates very low and high frequencies.
[000110]It may be desired to attenuate low frequencies of highband speech signal S30 and/or to boost higher frequencies. In one example, filter C110 is configured to filter highband speech signal S30 according to a highpass transfer function such as the following:
0.5+z' +0.5z-2 = FRB (z) +0.5z4 + 0.3z-2 which attenuates frequencies around 4 kHz.
[0001111It may be unnecessary in a practical sense to perform at least some of the burst detection operations at the full sampling rate of the corresponding speech signal S20, S30. FIGURE 19 shows a block diagram of an implementation c18 of burst detector C16 that includes an instance C120-1 of a downsampler C120 that is configured to downsample the smoothed envelope in the forward processing path and an instance C120-2 of downsampler C120 that is configured to downsample the smoothed envelope in the backward processing path. In one example, each instance of downsampler C120 is configured to downsample the envelope by a factor of eight. For the particular example of a 20-millisecond frame sampled at 8 kHz (160 samples), such a downsampler reduces the envelope to a 1 kHz sampling rate, of20 samples per frame. Downsampling may considerably reduce the computational complexity of a highband burst suppression operation without significantly affecting performance.
[000112] It may be desirable for the attenuation control signal applied by gain control element C150 to have the same sampling rate as highband speech signal S30.
FIGURE
20 shows a block diagram of an implementation C24 of attenuation control signal generator C22 that may be used in conjunction with a downsampling version of burst detector C10. Attenuation control signal generator C24 includes an upsampler configured to upsample attenuation control signal SB70 to a signal SB70a having a sampling rate equal to that of highband speech signal S30.
[000113] In one example, upsampler C140 is configured to perform the upsampling by zeroth-order interpolation of attenuation control signal SB70. In another example, upsampler C140 is configured to perform the upsampling by otherwise interpolating between the values of attenuation control signal SB70 (e.g., by passing attenuation control signal SB70 through an FIR filter) to obtain less abrupt transitions.
In a further example, upsampler C140 is configured to perform the upsampling using windowed sine functions.
[000114] In some cases, such as in a battery-powered device (e.g., a cellular telephone), highband burst suppressor C200 may be configured to be selectively disabled.
For example, it may be desired to disable an operation such as highband burst suppression in a power-saving mode of the device.
[000115] As mentioned above, embodiments as described herein include implementations that may be used to perform embedded coding, supporting compatibility with narrowband systems and avoiding a need for transcoding.
Support for highband coding may also serve to differentiate on a cost basis between chips, chipsets, devices, and/or networks having wideband support with backward compatibility, and those having narrowband support only. Support for highband coding as described herein may also be used in conjunction with a technique for supporting lowband coding, and a system, method, or apparatus according to such an embodiment may support coding of frequency components from, for example, about 50 or 100 Hz up to about 7 or 8 kHz.
[000116] As mentioned above, adding highband support to a speech coder may improve intelligibility, especially regarding differentiation of fricatives. Although such differentiation may usually be derived by a human listener from the particular context, highband support may serve as an enabling feature in speech recognition and other machine interpretation applications, such as systems for automated voice menu navigation and/or automatic call processing. Highband burst suppression may increase accuracy in a machine interpretation application, and it is contemplated that an implementation of highband burst suppressor C200 may be used in one or more such applications without or without speech encoding.
[000117] An apparatus according to an embodiment may be embedded into a portable device for wireless communications such as a cellular telephone or personal digital assistant (PDA). Alternatively, such an apparatus may be included in another communications device such as a VolP handset, a personal computer configured to support Volt) communications, or a network device configured to route telephonic or VolP communications. For example, an apparatus according to an embodiment may be implemented in a chip or chipset for a communications device. Depending upon the particular application, such a device may also include such features as analog-to-digital and/or digital-to-analog conversion of a speech signal, circuitry for performing amplification and/or other signal processing operations on a speech signal, and/or radio-frequency circuitry for transmission and/or reception of the coded speech signal.
[000118] It is explicitly contemplated and disclosed that embodiments may include and/or be used with any one or more of the other features disclosed in the published patent applications cited herein. Such features include generation of a highband excitation signal from a lowband excitation signal, which may include other features such as anti-sparseness filtering, harmonic extension using a nonlinear function, mixing of a modulated noise signal with a spectrally extended signal, and/or adaptive whitening. Such features include time-warping a highband speech signal according to a regularization performed in a lowband encoder.
Such features include encoding of a gain envelope according to a relation between an original speech signal and a synthesized speech signal. Such features include use of overlapping filter banks to obtain lowband and highband speech signals from a wideband speech signal. Such features include shifting of highband signal S30 and/or a highband excitation signal according to a regularization or other shift of lowband excitation signal S50. Such features include fixed or adaptive smoothing of coefficient representations such as highband LSFs. Such features include fixed or adaptive shaping of noise associated with quantization of coefficient representations such as LSFs. Such features also include fixed or adaptive smoothing of a gain envelope, and adaptive attenuation of a gain envelope.
[000119]The foregoing presentation of the described embodiments is provided to enable any person skilled in the art to make or use the present invention.
Various modifications to these embodiments are possible, and the generic principles presented herein may be applied to other embodiments as well. For example, an embodiment may be implemented in part or in whole as a hard-wired circuit, as a circuit configuration fabricated into an application-specific integrated circuit, or as a firmware program loaded into non-volatile storage or a software program loaded from or into a data storage medium as machine-readable code, such code being instructions executable by an array of logic elements such as a microprocessor or other digital signal processing unit. The data storage medium may be an array of storage elements such as semiconductor memory (which may include without limitation dynamic or static RAM
(random-access memory), ROM (read-only memory), and/or flash RAM), or ferroelectric, magnetoresistive, ovonic, polymeric, or phase-change memory; or a disk medium such as a magnetic or optical disk. The term "software" should be understood to include source code, assembly language code, machine code, binary code, firmware, macrocode, microcode, any one or more sets or sequences of instructions executable by an array of logic elements, and any combination of such examples.
[000120]The various elements of implementations of highband speech encoder A200;
wideband speech encoder A100, A102, and A104; and highband burst suppressor C200;
and arrangements including one or more such apparatus, may be implemented as electronic and/or optical devices residing, for example, on the same chip or among two or more chips in a chipset, although other arrangements without such limitation are also contemplated. One or more elements of such an apparatus may be implemented in whole or in part as one or more sets of instructions arranged to execute on one or more fixed or programmable arrays of logic elements (e.g., transistors, gates) such as microprocessors, embedded processors, IP cores, digital signal processors, FPGAs (field-programmable gate arrays), ASSPs (application-specific standard products), and ASICs (application-specific integrated circuits). It is also possible for one or more such elements to have structure in common (e.g., a processor used to execute portions of code corresponding to different elements at different times, a set of instructions executed to perform tasks corresponding to different elements at different times, or an arrangement of electronic and/or optical devices performing operations for different elements at different times). Moreover, it is possible for one or more such elements to be used to perform tasks or execute other sets of instructions that are not directly related to an operation of the apparatus, such as a task relating to another operation of a device or system in which the apparatus is embedded.
[000121]Embodiments also include additional methods of speech processing, speech encoding, and highband burst suppression as are expressly disclosed herein, e.g., by descriptions of structural embodiments configured to perform such methods.
Each of these methods may also be tangibly embodied (for example, in one or more data storage media as listed above) as one or more sets of instructions readable and/or executable by a machine including an array of logic elements (e.g., a processor, microprocessor, microcontroller, or other finite state machine). Thus, the present invention is not intended to be limited to the embodiments shown above but rather is to be accorded the widest scope consistent with the principles and novel features disclosed in any fashion herein.
Potential advantages of such embodiments include avoiding artifacts in the decoded signal and/or avoiding a loss of coding efficiency without noticeably degrading the quality of the original signal. FIGURE 2 shows a spectrogram of the wideband signal shown in FIGURE 1 after suppression of the highband burst according to such a method.
[00038] FIGURE 3 shows a block diagram of an arrangement including a filter bank A110 and a highband burst suppressor C200 according to an embodiment. Filter bank A110 is configured to filter wideband speech signal S10 to produce a lowband speech signal S20 and a highband speech signal S30. Highband burst suppressor C200 is configured to output a processed highband speech signal 330a based on highband speech signal 530, in which bursts that occur in highband speech signal S30 but are absent from lowband speech signal S20 have been suppressed.
[00039] FIGURE 4 shows a block diagram of the arrangement shown in FIGURE 3 that also includes a filter bank B120. Filter bank B120 is configured to combine lowband speech signal S20 and processed highband speech signal S30a to produce a processed wideband speech signal SlOa. The quality of processed wideband speech signal SlOa may be improved over that of wideband speech signal S10 due to suppression of highband bursts.
[00040] Filter bank A110 is configured to filter an input signal according to a split-band scheme to produce a low-frequency subband and a high-frequency subband.
Depending on the design criteria for the particular application, the output subbands may have equal or unequal bandwidths and may be overlapping or nonoverlapping. A
configuration of filter bank A110 that produces more than two subbands is also possible. For example, such a filter bank may be configured to produce a very-low-band signal that includes components in a frequency range below that of narrowband signal S20 (such as the range of 50-300 Hz). In such case, wideband speech encoder A100 (as introduced with reference to FIG. 8 below) may be implemented to encode this very-low-band signal separately, and multiplexer A130 (as introduced with reference to FIG. 11 below) may be configured to include the encoded very-low-band signal in multiplexed signal S70 (e.g., as a separable portion).
[00041] FIGURE 5a shows a block diagram of an implementation A112 of filter bank A110 that is configured to produce two subband signals having reduced sampling rates.
Filter bank A110 is arranged to receive a wideband speech signal S10 having a high-frequency (or highband) portion and a low-frequency (or lowband) portion.
Filter bank A112 includes a lowband processing path configured to receive wideband speech signal S10 and to produce lowband speech signal S20, and a highband processing path configured to receive wideband speech signal S10 and to produce highband speech signal S30. Lowpass filter 110 filters wideband speech signal S10 to pass a selected low-frequency subband, and highpass filter 130 filters wideband speech signal S10 to pass a selected high-frequency subband. Because both subband signals have more narrow bandwidths than wideband speech signal S10, their sampling rates can be reduced to some extent without loss of information. Downsampler 120 reduces the sampling rate of the lowpass signal according to a desired decimation factor (e.g., by removing samples of the signal and/or replacing samples with average values), and downsampler 140 likewise reduces the sampling rate of the highpass signal according to .
another desired decimation factor.
[00042] FIGURE 5b shows a block diagram of a corresponding implementation B122 of filter bank B120. Upsampler 150 increases the sampling rate of lowband speech signal S20 (e.g., by zero-stuffing and/or by duplicating samples), and lowpass filter 160 filters the upsampled signal to pass only a lowband portion (e.g., to prevent aliasing).
Likewise, upsampler 170 increases the sampling rate of processed highband signal S30a and highpass filter 180 filters the upsampled signal to pass only a highband portion. The two passband signals are then summed to form wideband speech signal Si Oa. In some implementations of an apparatus that includes filter bank B120, filter bank B120 is configured to produce a weighted sum of the two passband signals according to one or more weights received and/or calculated by the apparatus. A configuration of filter bank B120 that combines more than two passband signals is also contemplated.
[00043] Each of the filters 110, 130, 160, 180 may be implemented as a finite-impulse-response (FIR) filter or as an infinite-impulse-response (BR) filter. The frequency responses of filters 110 and 130 may have symmetric or dissimilarly shaped transition regions between stopband and passband. Likewise, the frequency responses of filters 160 and 180 may have symmetric or dissimilarly shaped transition regions between stopband and passband. It may be desirable but is not strictly necessary for lowpass filter 110 to have the same response as lowpass filter 160, and for highpass filter 130 to have the same response as highpass filter 180. In one example, the two filter pairs 110, 130 and 160, 180 are quadrature mirror filter (QMF) banks, with filter pair 110, 130 having the same coefficients as filter pair 160, 180.
[00044] In a typical example, lowpass filter 110 has a passband that includes the limited PSTN range of 300-3400 Hz (e.g., the band from 0 to 4 kHz). FIGURES 6a and 6b show relative bandwidths of wideband speech signal S10, lowband speech signal S20, and highband speech signal S30 in two different implementational examples. In both of these particular examples, wideband speech signal S10 has a sampling rate of 16 kHz (representing frequency components within the range of 0 to 8 kHz), and lowband signal S20 has a sampling rate of 8 kHz (representing frequency components within the range of 0 to 4 kHz).
[00045] In the example of FIGURE 6a, there is no significant overlap between the two subbands. A highband signal S30 as shown in this example may be obtained using a highpass filter 130 with a passband of 4-8 kHz. In such a case, it may be desirable to reduce the sampling rate to 8 kHz by downsampling the filtered signal by a factor of two. Such an operation, which may be expected to significantly reduce the computational complexity of further processing operations on the signal, will move the passband energy down to the range of 0 to 4 kHz without loss of information.
[00046] In the alternative example of FIGURE 6b, the upper and lower subbands have an appreciable overlap, such that the region of 3.5 to 4 kHz is described by both subband signals. A highband signal S30 as in this example may be obtained using a highpass filter 130 with a passband of 3.5-7 kHz. In such a case, it may be desirable to reduce the sampling rate to 7 kHz by downsampling the filtered signal by a factor of 16/7. Such an operation, which may be expected to significantly reduce the computational complexity of further processing operations on the signal, will move the passband energy down to the range of 0 to 3.5 kHz without loss of information.
[00047] In a typical handset for telephonic communication, one or more of the transducers (i.e., the microphone and the earpiece or loudspeaker) lacks an appreciable response over the frequency range of 7-8 kHz. In the example of FIGURE 6b, the portion of wideband speech signal S10 between 7 and 8 kHz is not included in the encoded signal. Other particular examples of highpass filter 130 have passbands of 3.5-'73 kHz and 3.5-8 kHz.
[00048] In some implementations, providing an overlap between subbands as in the example of FIGURE 6b allows for the use of a lowpass and/or a highpass filter having a smooth rolloff over the overlapped region. Such filters are typically less computationally complex and/or introduce less delay than filters with sharper or "brick-wall" responses. Filters having sharp transition regions tend to have higher sidelobes (which may cause aliasing) than filters of similar order that have smooth rolloffs.
Filters having sharp transition regions may also have long impulse responses which may cause ringing artifacts. For filter bank implementations having one or more DR
filters, allowing for a smooth rolloff over the overlapped region may enable the use of a filter or filters whose poles are farther away from the unit circle, which may be important to ensure a stable fixed-point implementation.
[00049] Overlapping of subbands allows a smooth blending of lowband and highband that may lead to fewer audible artifacts, reduced aliasing, and/or a less noticeable transition from one band to the other. Moreover, in an application where the lowband and highband speech signals S20, S30 are subsequently encoded by different speech encoders, the coding efficiency of the lowband speech encoder (for example, a waveform coder) may drop with increasing frequency. For example, coding quality of the lowband speech coder may be reduced at low bit rates, especially in the presence of background noise. In such cases, providing an overlap of the subbands may increase the quality of reproduced frequency components in the overlapped region.
[00050] Moreover, overlapping of subbands allows a smooth blending of lowband and highband that may lead to fewer audible artifacts, reduced aliasing, and/or a less noticeable transition from one band to the other. Such a feature may be especially desirable for an implementation in which lowband speech encoder A120 and highband speech encoder A200 as discussed below operate according to different coding methodologies.=
For example, different coding techniques may produce signals that sound quite different. A
coder that encodes a spectral envelope in the form of codebook indices may produce a signal having a different sound than a coder that encodes the amplitude spectrum instead. A time-domain coder (e.g., a pulse-code-modulation or PCM coder) may =
produce a signal having a different sound than a frequency-domain coder. A
coder that encodes a signal with a representation of the spectral envelope and the corresponding residual signal may produce a signal having a different sound than a coder that encodes a signal with only a representation of the spectral envelope. A coder that encodes a signal as a representation of its waveform may produce an output having a different sound than that from a sinusoidal coder. In such cases, using filters having sharp transition regions to define nonoverlapping subbands may lead to an abrupt and perceptually noticeable transition between the subbands in the synthesized wideband signal.
[00051] Although QMF filter banks having complementary overlapping frequency responses are often used in subband techniques, such filters are unsuitable for at least some of the wideband coding implementations described herein. A QMF filter bank at the encoder is configured to create a significant degree of aliasing that is canceled in the corresponding QMF filter bank at the decoder. Such an arrangement may not be appropriate for an application in which the signal incurs a significant amount of distortion between the filter banks, as the distortion may reduce the effectiveness of the alias cancellation property. For example, applications described herein include coding implementations configured to operate at very low bit rates. As a consequence of the very low bit rate, the decoded signal is likely to appear significantly distorted as compared to the original signal, such that use of QMF filter banks may lead to uncanceled aliasing. Applications that use QMF filter banks typically have higher bit rates (e.g., over 12 kbps for AMR, and 64 kbps for G.722).
[00052] Additionally, a coder may be configured to produce a synthesized signal that is perceptually similar to the original signal but which actually differs significantly from the original signal. For example, a coder that derives the highband excitation from the narrowband residual as described herein may produce such a signal, as the actual highband residual may be completely absent from the decoded signal. Use of QMF
filter banks in such applications may lead to a significant degree of distortion caused by uncanceled aliasing.
[00053] The amount of distortion caused by QMF aliasing may be reduced if the affected subband is narrow, as the effect of the aliasing is limited to a bandwidth equal to the width of the subband. For examples as described herein in which each subband includes about half of the wideband bandwidth, however, distortion caused by uncanceled aliasing could affect a significant part of the signal. The quality of the signal may also be affected by the location of the frequency band over which the uncanceled aliasing occurs. For example, distortion created near the center of a wideband speech signal (e.g., between 3 and 4 kHz) may be much more objectionable than distortion that occurs near an edge of the signal (e.g., above 6 kHz).
[00054] While the responses of the filters of a WY filter bank are strictly related to one another, the lowband and highband paths of filter banks A110 and B120 may be configured to have spectra that are completely unrelated apart from the overlapping of the two subbands. We define the overlap of the two subbands as the distance from the point at which the frequency response of the highband filter drops to ¨20 dB
up to the point at which the frequency response of the lowband filter drops to ¨20 dB.
In various examples of filter bank A110 and/or B120, this overlap ranges from around 200 Hz to around 1 kHz. The range of about 400 to about 600 Hz may represent a desirable tradeoff between coding efficiency and perceptual smoothness. In one particular example as mentioned above, the overlap is around 500 Hz.
[00055] It may be desirable to implement filter bank A112 and/or B122 to perform operations as illustrated in FIGURES 6a and 6b in several stages. For example, FIGURE 6c shows a block diagram of an implementation A114 of filter bank A112 that performs a functional equivalent of highpass filtering and downsampling operations using a series of interpolation, resampling, decimation, and other operations.
Such an implementation may be easier to design and/or may allow reuse of functional blocks of logic and/or code. For example, the same functional block may be used to perform the operations of decimation to 14 kHz and decimation to 7 kHz as shown in FIGURE
6c.
The spectral reversal operation may be implemented by multiplying the signal with the function eft"' or the sequence (-1)fl, whose values alternate between +1 and ¨1. The spectral shaping operation may be implemented as a lowpass filter configured to shape the signal to obtain a desired overall filter response.
[00056] It is noted that as a consequence of the spectral reversal operation, the spectrum of highband signal S30 is reversed. Subsequent operations in the encoder and corresponding decoder may be configured accordingly. For example, it may be desired to produce a corresponding excitation signal that also has a spectrally reversed form.
[00057] FIGURE 6d shows a block diagram of an implementation B124 of filter bank 13122 that performs a functional equivalent of upsampling and highpass filtering operations using a series of interpolation, resampling, and other operations.
Filter bank B124 includes a spectral reversal operation in the highband that reverses a similar operation as performed, for example, in a filter bank of the encoder such as filter bank A114. In this particular example, filter bank B124 also includes notch filters in the lowband and highband that attenuate a component of the signal at 7100 Hz, although such filters are optional and need not be included. The Patent Application "SYSTEMS, METHODS, AND APPARATUS FOR SPF.FCH SIGNAL FILTERING" filed herewith, published as U.S. Pub. No. 2007/0088558, includes additional description and figures relating to responses of elements of particular implementations of filter banks A110 and B120.
[00058] As noted above, highband burst suppression may improve the efficiency of coding highband speech signal S30. FIGURE 7 shows a block diagram of an arrangement in which processed highband speech signal S30a, as produced by highband burst suppressor C200, is encoded by a highband speech encoder A200 to produce encoded highband speech signal S30b.
[00059] One approach to wideband speech coding involves scaling a narrowband speech coding technique (e.g., one configured to encode the range of 0-4 kHz) to cover the wideband spectrum. For example, a speech signal may be sampled at a higher rate to include components at high frequencies, and a narrowband coding technique may be reconfigured to use more filter coefficients to represent this wideband signal. FIGURE
8 shows a block diagram of an example in which a wideband speech encoder A100 is arranged to encode processed wideband speech signal SlOa to produce encoded wideband speech signal SlOb.
[00060] Narrowband coding techniques such as CELP (codebook excited linear prediction) are computationally intensive, however, and a wideband CR1 .P
coder may consume too many processing cycles to be practical for many mobile and other embedded applications. Encoding the entire spectrum of a wideband signal to a desired quality using such a technique may also lead to an unacceptably large increase in bandwidth. Moreover, transcoding of such an encoded signal would be required before even its narrowband portion could be transmitted into and/or decoded by a system that only supports narrowband coding_ FIGURE 9 shows a block diagram of a wideband speech encoder A102 that includes separate lowband and highband speech encoders A120 and A200, respectively.
[000611 It may be desirable to implement wideband speech coding such that at least the narrowband portion of the encoded signal may be sent through a narrowband channel (such as a PSTN channel) without transcoding or other significant modification.
Efficiency of the wideband coding extension may also be desirable, for example, to avoid a significant reduction in the number of users that may be serviced in applications such as wireless cellular telephony and broadcasting over wired and wireless channels.
[00062] One approach to wideband speech coding involves extrapolating the highband spectral envelope from the encoded narrowband spectral envelope. While such an approach may be implemented without any increase in bandwidth and without a need -for transcoding, however, the coarse spectral envelope or formant structure of the highband portion of a speech signal generally cannot be predicted accurately from the spectral envelope of the narrowband portion_ [000631 FIGURE 10 shows a block diagram of a wideband speech encoder A104 that uses another approach to encoding the highband speech signal according to information -from the lowband speech signal. In this example, the highband excitation signal is derived from the encoded lowband excitation signal S50. Encoder A104 may be configured to encode a gain envelope based on a signal based on the highband excitation signal, for example, according to one or more such embodiments as described in the published patent application WO 2006/107837 entitled METHODS
AND APPARATUS FOR ENCODING AND DECODING AN HIGHBAND PORTION
OF A SPEECH SIGNAL. One particular example of wideband speech encoder A104 is configured to encode wideband speech signal S10 at a rate of about 8.55 kbps (kilobits per second), with about 7.55 kbps being used for lowband filter parameters S40 and encoded lowband excitation signal S50, and about 1 kbps being used for encoded highband speech S30b.
[00064] It may be desired to combine the encoded lowband and highband signals into a single bitstream. For example, it may be desired to multiplex the encoded signals together for transmission (e.g., over a wired, optical, or wireless transmission channel), or for storage, as an encoded wideband speech signal. FIGURE 11 shows a block diagram of an arrangement including wideband speech encoder A104 and a multiplexer A130 configured to combine lowband filter parameters S40, encoded lowband excitation signal S50, and encoded highband speech signal S30b into a multiplexed signal S70.
[00065] It may be desirable for multiplexer A130 to be configured to embed the encoded lowband signal (including lowband filter parameters S40 and encoded lowband excitation signal S50) as a separable substream of multiplexed signal S70, such that the encoded lowband signal may be recovered and decoded independently of another portion of multiplexed signal S70 such as a highband and/or very-low-band signal. For example, multiplexed signal S70 may be arranged such that the encoded lowband signal may be recovered by stripping away the encoded highband speech signal S30b.
One potential advantage of such a feature is to avoid the need for transcoding the encoded wideband signal before passing it to a system that supports decoding of the lowband signal but does not support decoding of the highhand portion.
[00066] An apparatus including a lowband, highband, and/or wideband speech encoder as described herein may also include circuitry configured to transmit the encoded signal into a transmission channel such as a wired, optical, or wireless channel.
Such an apparatus may also be configured to perform one or more channel encoding operations on the signal, such as error correction encoding (e.g., rate-compatible convolutional encoding) and/or error detection encoding (e.g., cyclic redundancy encoding), and/or one or more layers of network protocol encoding (e.g., Ethernet, TCP/IP, cdma2000).
[00067] Any or all of the lowband, highband, and wideband speech encoders described herein may be implemented according to a source-filter model that encodes the input speech signal as (A) a set of parameters that describe a filter and (B) an excitation signal that drives the described filter to produce a synthesized reproduction of the input speech signal. For example, a spectral envelope of a speech signal is characterized by a number of peaks that represent resonances of the vocal tract and are called formants.
Most speech coders encode at least this coarse spectral structure as a set of parameters such as filter coefficients.
[00068] In one example of a basic source-filter arrangement, an analysis module calculates a set of parameters that characterize a filter corresponding to the speech =
sound over a period of time (typically 20 msec). A whitening filter (also called an analysis or prediction error filter) configured according to those filter parameters removes the spectral envelope to spectrally flatten the signal. The resulting whitened signal (also called a residual) has less energy and thus less variance and is easier to encode than the original speech signal. Errors resulting from coding of the residual signal may also be spread more evenly over the spectrum. The filter parameters and residual are typically quantized for efficient transmission over the channel.
At the decoder, a synthesis filter configured according to the filter parameters is excited by the residual to produce a synthesized version of the original speech sound. The synthesis filter is typically configured to have a transfer function that is the inverse of the transfer function of the whitening filter.
[00069] The analysis module may be implemented as a linear prediction coding (LPC) analysis module that encodes the spectral envelope of the speech signal as a set of linear prediction (LP) coefficients (e.g., coefficients of an all-pole filter 1/A(z)). The analysis module typically processes the input signal as a series of nonoverlapping frames, with a new set of coefficients being calculated for each frame. The frame period is generally a period over which the signal may be expected to be locally stationary; one common example is 20 milliseconds (equivalent to 160 samples at a sampling rate of 8 kHz).
One example of a lowband LPC analysis module is configured to calculate a set of ten LP filter coefficients to characterize the formant structure of each 20-millisecond frame of lowband speech signal S20, and one example of a highband LPC analysis module is configured to calculate a set of six (alternatively, eight) LP filter coefficients to characterize the formant structure of each 20-millisecond frame of highband speech signal S30. It is also possible to implement the analysis module to process the input signal as a series of overlapping frames.
[00070] The analysis module may be configured to analyze the samples of each frame directly, or the samples may be weighted first according to a windowing function (for example, a Hamming window). The analysis may also be performed over a window that is larger than the frame, such as a 30-msec window. This window may be symmetric (e.g. 5-20-5, such that it includes the 5 milliseconds immediately before and after the 20-millisecond frame) or asymmetric (e.g. 10-20, such that it includes the last 10 milliseconds of the preceding frame). An LPC analysis module is typically configured to calculate the LP filter coefficients using a Levinson-Durbin recursion or the Leroux-Gueguen algorithm. In another implementation, the analysis module may be configured to calculate a set of cepstral coefficients for each frame instead of a set of LP
filter coefficients.
[00071] The output rate of a speech encoder may be reduced significantly, with relatively little effect on reproduction quality, by quantizing the filter parameters.
Linear prediction filter coefficients are difficult to quantize efficiently and are usually mapped by the speech encoder into another representation, such as line spectral pairs (LSPs) or line spectral frequencies (LSFs), for quantization and/or entropy encoding.
Other one-to-one representations of LP filter coefficients include parcor coefficients;
log-area-ratio values; immittance spectral pairs (ISPs); and immittance spectral frequencies (ISFs), which are used in the GSM (Global System for Mobile Communications) AMR-WB (Adaptive Multirate-Wideband) codec. Typically a transform between a set of LP filter coefficients and a corresponding set of LSFs is reversible, but embodiments also include implementations of a speech encoder in which the transform is not reversible without error.
[00072] A speech encoder is typically configured to quantize the set of narrowband LSFs (or other coefficient representation) and to output the result of this quantization as the filter parameters. Quantization is typically performed using a vector quantizer that encodes the input vector as an index to a corresponding vector entry in a table or codebook. Such a quantizer may also be configured to perform classified vector quantization. For example, such a quantizer may be configured to select one of a set of codebooks based on information that has already been coded within the same frame (e.g., in the lowband channel and/or in the highband channel). Such a technique typically provides increased coding efficiency at the expense of additional codebook storage.
[00073] A speech encoder may also be configured to generate a residual signal by passing the speech signal through a whitening filter (also called an analysis or prediction error filter) that is configured according to the set of filter coefficients.
The whitening filter is typically implemented as a FIR filter, although IIR implementations may also be used. This residual signal will typically contain perceptually important information of the speech frame, such as long-term structure relating to pitch, that is not represented in the filter parameters. Again, this residual signal is typically quantized for output. For example, lowband speech encoder A122 may be configured to calculate a quantized representation of the residual signal for output as encoded lowband excitation signal S50. Such quantization is typically performed using a vector quantizer that encodes the input vector as an index to a corresponding vector entry in a table or codebook and that may be configured to perform classified vector quantization as described above.
[000741 Alternatively, such a quantizer may be configured to send one or more parameters from which the vector may be generated dynamically at the decoder, rather than retrieved from storage, as in a sparse codebook method. Such a method is used in coding schemes such as algebraic CELP (codebook excitation linear prediction) and codecs such as 3GPP2 (Third Generation Partnership 2) EVRC (Enhanced Variable Rate Codec).
[00075] Some implementations of lowband speech encoder A120 are configured to calculate encoded lowband excitation signal S50 by identifying one among a set of codebook vectors that best matches the residual signal. It is noted, however, that lowband speech encoder A120 may also be implemented to calculate a quantized representation of the residual signal without actually generating the residual signal. For example, lowband speech encoder A120 may be configured to use a number of codebook vectors to generate corresponding synthesized signals (e.g., according to a current set of filter parameters), and to select the codebook vector associated with the generated signal that best matches the original lowband speech signal S20 in a perceptually weighted domain.
[00076] It may be desirable to implement lowband speech encoder A120 or A122 as an analysis-by-synthesis speech encoder. Codebook excitation linear prediction (CELP) coding is one popular family of analysis-by-synthesis coding, and implementations of such coders may perform waveform, encoding of the residual, including such operations as selection of entries from fixed and adaptive codeboolcs, error minimization operations, and/or perceptual weighting operations. Other implementations of analysis-by-synthesis coding include mixed excitation linear prediction (MELP), algebraic CFI P
(ACELP), relaxation CELP (RCELP), regular pulse excitation (RPE), multi-pulse CELP
(WE), and vector-sum excited linear prediction (VSFIP) coding. Related coding methods include multi-band excitation (MBE) and prototype waveform interpolation (PWI) coding. Examples of standardized analysis-by-synthesis speech codecs include the ETSI (European Telecommunications Standards Institute)-GSM full rate codec (GSM 06.10), which uses residual excited linear prediction (RELP); the GSM
enhanced full rate codec (ETSI-GSM 06.60); the ITU (International Telecommunication Union) standard 11.8 kb/s G.729 Annex E coder; the IS (Interim Standard)-641 codecs for IS-136 (a time-division multiple access scheme); the GSM adaptive multirate (GSM-AMR) codecs; and the 4GVTM (Fourth-Generation VocoderTM) codec (QUALCOMM
Incorporated, San Diego, CA). Existing implementations of RCELP coders include the Enhanced Variable Rate Codec (EVRC), as described in Telecommunications Industry Association (TIA) IS-127, and the Third Generation Partnership Project 2 (3GPP2) Selectable Mode Vocoder (SMV). The various lowband, highband, and wideband encoders described herein may be implemented according to any of these technologies, or any other speech coding technology (whether known or to be developed) that represents a speech signal as (A) a set of parameters that describe a filter and (B) a residual signal that provides at least part of an excitation used to drive the described filter to reproduce the speech signal.
[00077] FIGURE 12 shows a block diagram of an implementation C202 of highband burst suppressor C200 that includes two implementations C10-1, C10-2 of burst detector C10. Burst detector C10-1 is configured to produce a lowband burst indication signal SB10 that indicates a presence of a burst in lowband speech signal S20.
Burst detector C10-2 is configured to produce a highband burst indication signal SB20 that indicates a presence of a burst in highband speech signal S30. Burst detectors and C10-2 may be identical or may be instances of different implementations of burst detector C10. Highband burst suppressor C202 also includes an attenuation control signal generator C20 configured to generate an attenuation control signal SB70 according to a relation between lowband burst indication signal SB10 and highband burst indication signal SB20, and a gain control element C150 (e.g., a multiplier or amplifier) configured to apply attenuation control signal SB70 to highband speech signal S30 to produce processed highband speech signal S30a.
[00078] In the particular examples described herein, it may be assumed that highband burst suppressor C202 processes highband speech signal S30 in 20-millisecond frames, and that lowband speech signal S20 and highband speech signal S30 are both sampled at 8 kHz. However, these particular values are examples only, and not limitations, and other values may also be used according to particular design choices and/or as noted herein.
[00079] Burst detector C10 is configured to calculate forward and backward smoothed envelopes of the speech signal and to indicate the presence of a burst according to a time relation between an edge in the forward smoothed envelope and an edge in the backward smoothed envelope. Burst suppressor C202 includes two instances of burst detector C10, each arranged to receive a respective one of speech signals S20, S30 and to output a corresponding burst indication signal SB10, SB20.
[00080] FIGURE 13 shows a block diagram of an implementation C12 of burst detector C10 that is arranged to receive one of speech signals S20, S30 and to output a corresponding burst indication signal SB10, SB20. Burst detector C12 is configured to calculate each of the forward and backward smoothed envelopes in two stages.
In the first stage, a calculator C30 is configured to convert the speech signal to a constant-polarity signal. In one example, calculator C30 is configured to compute the constant-polarity signal as the square of each sample of the current frame of the corresponding speech signal. Such a signal may be smoothed to obtain an energy envelope. In another example, calculator C30 is configured to compute the absolute value of each incoming sample. Such a signal may be smoothed to obtain an amplitude envelope. Further implementations of calculator C30 may be configured to compute the constant-polarity signal according to another function such as clipping.
[00081] In the second stage, a forward smoother C40-1 is configured to smooth the constant-polarity signal in a forward time direction to produce a forward smoothed envelope, and a backward smoother C40-2 is configured to smooth the constant-polarity signal in a backward time direction to produce a backward smoothed envelope.
The forward smoothed envelope indicates a difference in the level of the corresponding speech signal over time in the forward direction, and the backward smoothed envelope indicates a difference in the level of the corresponding speech signal over time in the backward direction.
[00082] In one example, forward smoother C40-1 is implemented as a first-order infinite-impulse-response (Mt) filter configured to smooth the constant-polarity signal according to an expression such as the following:
Sf (n) = aSf (n-1) + (1¨ a)P(n), and backward smoother C40-2 is implemented as a first-order IIR filter configured to smooth the constant-polarity signal according to an expression such as the following:
S b() aS b (11 + +(la)P(n) , where n is a time index, P(n) is the constant-polarity signal, Sf (n) is the forward smoothed envelope, S b (n) is the backward smoothed envelope, and a is a decay factor having a value between 0 (no smoothing) and I. It may be noted that due in part to operations such as calculation of a backward smoothed envelope, a delay of at least one frame may be incurred in processed highband speech signal S30a. However, such a delay is relatively unimportant perceptually and is not uncommon even in real-time speech processing operations.
[00083] It may be desirable to select a value for a such that the decay time of the smoother is similar to the expected duration of a highband burst.
Typically forward smoother C40-1 and backward smoother C40-2 are configured to perform complementary versions of the same smoothing operation, and to use the same value of a , but in some implementations the two smoothers may be configured to perform different operations and/or to use different values.
Other recursive or non-recursive smoothing functions, including finite-impulse-response (FIR) or 111( filters of higher order, may also be used.
[00084] In other implementations of burst detector C12, one or both of forward smoother C40-1 and backward smoother C40-2 are configured to perform an adaptive smoothing operation. For example, forward smoother C40-1 may be configured to perform an adaptive smoothing operation according to an expression such as the following:
P(n), if P(n)f(n ¨1) S
f(fl) ={
aS f (n ¨1) + (1¨ a)P(n), if P(n) < S f (n in which smoothing is reduced or, as in this case, disabled at strong leading edges of the constant-polarity signal. In this or another implementation of burst detector C12, backward smoother C40-2 may be configured to perform an adaptive smoothing operation according to an expression such as the following:
P(n), if P(n) S b (n +1) S b (n) =
OeS b (n + 1) + (1¨ a)P(n), if P(n) < S b(n+1)' in which smoothing is reduced or, as in this case, disabled at strong trailing edges of the constant-polarity signal. Such adaptive smoothing may help to define the beginnings of burst events in the forward smoothed envelope and the ends of burst events in the backward smoothed envelope.
[00085] Burst detector C12 includes an instance of a region indicator C50 (initial region indicator C50-1) that is configured to indicate the beginning of a high-level event (e.g., a burst) in the forward smoothed envelope. Burst detector C12 also includes an instance of region indicator C50 (terminal region indicator C50-2) that is configured to indicate the ending of a high-level event (e.g., a burst) in the backward smoothed envelope.
[00086] FIGURE 14a shows a block diagram of an implementation C52-1 of initial region indicator C50-1 that includes a delay element C70-1 and an adder. Delay is configured to apply a delay having a positive magnitude, such that the forward smoothed envelope is reduced by a delayed version of itself. In another example, the current sample or the delayed sample may be weighted according to a desired weighting factor.
[00087] FIGURE 14b shows a block diagram of an implementation C52-2 of terminal region indicator C50-2 that includes a delay element C70-2 and an adder. Delay is configured to apply a delay having a negative magnitude, such that the backward smoothed envelope is reduced by an advanced version of itself. In another example, the current sample or the advanced sample may be weighted according to a desired weighting factor.
[00088] Various delay values may be used in different implementations of region indicator C52, and delay values having different magnitudes may be used in initial region indicator C52-1 and terminal region indicator C52-2. The magnitude of the delay may be selected according to a desired width of the detected region. For example, small delay values may be used to perform detection of a narrow edge region.
To obtain strong edge detection, it may be desired to use a delay having a magnitude similar to the expected edge width (for example, about 3 or 5 samples).
[00089] Alternatively, a region indicator C50 may be configured to indicate a wider region that extends beyond the corresponding edge. For example, it may be desirable for initial region indicator C50-1 to indicate an initial region of an event that extends in the forward direction for some time after the leading edge. Likewise, it may be desirable for terminal region indicator C50-2 to indicate a teiminal region of an event that extends in the backward direction for some time before the trailing edge.
In such case, it may be desirable to use a delay value having a larger magnitude, such as a magnitude similar to that of the expected length of a burst. In one such example, a delay of about 4 milliseconds is used.
[00090] Processing by a region indicator C50 may extend beyond the boundaries of the current frame of the speech signal, according to the magnitude and direction of the delay. For example, processing by initial region indicator C50-1 may extend into the preceding frame, and processing by terminal region indicator C50-2 may extend into the following frame.
[00091] As compared to other high-level events that may occur in the speech signal, a burst is distinguished by an initial region, as indicated in initial region indication signal SB50, that coincides in time with a terminal region, as indicated in terminal region indication signal SB60. For example, a burst may be indicated when the time distance between the initial and terminal regions is not greater than (alternatively, is less than) a predetermined coincidence interval, such as the expected duration of a burst.
Coincidence detector C60 is configured to indicate detection of a burst according to a coincidence in time of initial and terminal regions in the region indication signals SB50 and SB60. For an implementation in which initial and terminal region indication signals SB50, SB60 indicate regions that extend from the respective leading and trailing edges, for example, coincidence detector C60 may be configured to indicate an overlap in time of the extended regions.
[00092] FIGURE 15 shows a block diagram of an implementation C62 of coincidence detector C60 that includes a first instance C80-1 of clipper C80 configured to clip initial region indication signal SB50, a second instance C80-2 of clipper C80 configured to clip terminal region indication signal SB60, and a mean calculator C90 configured to output a corresponding burst indication signal according to a mean of the clipped signals. Clipper C80 is configured to clip values of the input signal according to an expression such as the following:
out = max(in,0).
[000931 Alternatively, clipper C80 may be configured to threshold the input signal according to an expression such as the following:
in, in out =c 0,0, hz < TL, where threshold 71. has a value greater than zero. Typically the instances C80-1 and C80-2 of clipper C80 will use the same threshold value, but it is possible for the two instances C80-1 and C80-2 to use different threshold values.
[00094] Mean calculator C90 is configured to output a corresponding burst indication signal SBIO, SB20, according to a mean of the clipped signals, that indicates the time location and strength of bursts in the input signal and has a value equal to or larger than zero. The geometric mean may provide better results than the arithmetic mean, especially for distinguishing bursts with defined initial and terminal regions from other events that have only a strong initial or terminal region. For example, the arithmetic mean of an event with only one strong edge may still be high, whereas the =
geometric mean of an event lacking one of the edges will be low or zero.
However, the geometric mean is typically more computationally intensive than the arithmetic mean.
In one example, an instance of mean calculator C90 arranged to process lowband results uses the arithmetic mean (i(a+ b)), and an instance of mean calculator C90 arranged to process highband results uses the more conservative geometric mean (4-a-T).
[00095] Other implementations of mean calculator C90 may be configured to use a different kind of mean, such as the harmonic mean. In a further implementation of coincidence detector C62, one or both of the initial and terminal region indication signals SB50, SB60 is weighted with respect to the other before or after clipping.
[00096] Other implementations of coincidence detector C60 are configured to detect bursts by measuring a time distance between leading and trailing edges. For example, one such implementation is configured to identify a burst as the region between a leading edge in initial region indication signal SB50 and a trailing edge in terminal region indication signal SB60 that are no more than a predetermined width apart. The predetermined width is based on an expected duration of a highband burst, and in one example a width of about 4 milliseconds is used.
[00097] A further implementation of coincidence detector C60 is configured to expand each leading edge in initial region indication signal SB50 in the forward direction by a desired time period (e.g. based on an expected duration of a highband burst), and to expand each trailing edge in terminal region indication signal SB60 in the backward direction by a desired time period (e.g. based on an expected duration of a highband burst). Such an implementation may be configured to generate the corresponding burst indication signal SB10, SB20 as the logical AND of these two expanded signals or, alternatively, to generate the corresponding burst indication signal SB10, SB20 to indicate a relative strength of the burst across an area where the regions overlap (e.g. by calculating a mean of the expanded signals). Such an implementation may be configured to expand only edges that exceed a threshold value. In one example, the edges are expanded by a time period of about 4 milliseconds.
[00098] Attenuation control signal generator C20 is configured to generate attenuation control signal SB70 according to a relation between lowband burst indication signal SB10 and highband burst indication signal SB20. For example, attenuation control signal generator C20 may be configured to generate attenuation control signal according to an arithmetic relation between burst indication signals SB10 and SB20, such as a difference.
[00099] FIGURE 16 shows a block diagram of an implementation C22 of attenuation control signal generator C20 that is configured to combine lowband burst indication signal SB10 and highband burst indication signal SB20 by subtracting the former from the latter. The resulting difference signal indicates where bursts exist in the high band that do not occur (or are weaker) in the low band. In a further implementation, one or both of the lowband and highband burst indication signals SB10, SB20 is weighted with respect to the other.
[000100] Attenuation control signal calculator C100 outputs attenuation control signal SB70 according to a value of the difference signal. For example, attenuation control signal calculator C100 may be configured to indicate an attenuation that varies according to the degree to which the difference signal exceeds a threshold value.
[000101]It may be desired for attenuation control signal generator C20 to be configured to perform operations on logarithmically scaled values. For example, it may be desirable to attenuate highband speech signal S30 according to a ratio between the levels of the burst indication signals (for example, according to a value in decibels or dB), and such a ratio may be easily calculated as the difference of logarithmically scaled values. The logarithmic scaling warps the signal along the magnitude axis but does not otherwise change its shape. FIGURE 17 shows an implementation C14 of burst detector C12 that includes an instance C130-1, C130-2 of logarithm calculator configured to logarithmically scale (e.g., according to a base of 10) the smoothed envelope in each of the forward and backward processing paths.
[000102]In one example, attenuation control signal calculator C100 is configured to calculate values of attenuation control signal SB70 in dB according to the following formula:
0, D dB < TdB
[000103] AdB = 201-2 ___________ 7 if D dB > TdB, 1+ exP(D as /1 ) [000104] where D dB denotes the difference between highband burst indication signal SB20 and lowband burst indication signal SB10, TdB denotes a threshold value, and AdB is the corresponding value of attenuation control signal SB70. In one particular example, threshold TdB has a value of 8 dB.
[000105]In another implementation, attenuation control signal calculator C100 is configured to indicate a linear attenuation according to the degree to which the difference signal exceeds a threshold value (e.g., 3 dB or 4 dB). In this example, attenuation control signal Sl370 indicates no attenuation until the difference signal exceeds the threshold value. When the difference signal exceeds the threshold value, attenuation control signal SB70 indicates an attenuation value that is linearly proportional to the amount by which the threshold value is currently exceeded.
[000106]Highband burst suppressor C202 includes a gain control element C150, such as a multiplier or amplifier, that is configured to attenuate highband speech signal S30 according to the current value of attenuation control signal SB70 to produce processed highband speech signal S30a. Typically, attenuation control signal SB70 indicates a value of no attenuation (e.g., a gain of 1.0 or 0 dB) unless a highband burst has been detected at the current location of highband speech signal S30, in which case a typical attenuation value is a gain reduction of 0.3 or about 10 dB.
[0001071An alternative implementation of attenuation control signal generator C22 may be configured to combine lowband burst indication signal SB10 and highband burst indication signal SB20 according to a logical relation. In one such example, the burst indication signals are combined by computing the logical AND of highband burst indication signal SB20 and the logical inverse of lowband burst indication signal SB10.
In this case, each of the burst indication signals may first be thresholded to obtain a binary-valued signal, and attenuation control signal calculator C100 may be configured to indicate a corresponding one of two attenuation states (e.g., one state indicating no attenuation) according to the state of the combined signal.
[000108]Before performing the envelope calculation, it may be desirable to shape the spectrum of one or both of speech signals 520 and S30 in order to flatten the spectrum and/or to emphasize or attenuate one or more particular frequency regions.
Lowband speech signal S20, for example, may tend to have more energy at low frequencies, and it may be desirable to reduce this energy. It may also be desirable to reduce high-frequency components of lowband speech signal S20 such that the burst detection is based primarily on the middle frequencies. Spectral shaping is an optional operation that may improve the performance of burst suppressor C200.
=
[000109]FIGURE 18 shows a block diagram of an implementation C16 of burst detector C14 that includes a shaping filter C110. In one example, filter C110 is configured to filter lowband speech signal S20 according to a passband transfer function such as the following:
1+0.96z-' +0.96C2 +
FIB (Z) 1-0.5z' which attenuates very low and high frequencies.
[000110]It may be desired to attenuate low frequencies of highband speech signal S30 and/or to boost higher frequencies. In one example, filter C110 is configured to filter highband speech signal S30 according to a highpass transfer function such as the following:
0.5+z' +0.5z-2 = FRB (z) +0.5z4 + 0.3z-2 which attenuates frequencies around 4 kHz.
[0001111It may be unnecessary in a practical sense to perform at least some of the burst detection operations at the full sampling rate of the corresponding speech signal S20, S30. FIGURE 19 shows a block diagram of an implementation c18 of burst detector C16 that includes an instance C120-1 of a downsampler C120 that is configured to downsample the smoothed envelope in the forward processing path and an instance C120-2 of downsampler C120 that is configured to downsample the smoothed envelope in the backward processing path. In one example, each instance of downsampler C120 is configured to downsample the envelope by a factor of eight. For the particular example of a 20-millisecond frame sampled at 8 kHz (160 samples), such a downsampler reduces the envelope to a 1 kHz sampling rate, of20 samples per frame. Downsampling may considerably reduce the computational complexity of a highband burst suppression operation without significantly affecting performance.
[000112] It may be desirable for the attenuation control signal applied by gain control element C150 to have the same sampling rate as highband speech signal S30.
FIGURE
20 shows a block diagram of an implementation C24 of attenuation control signal generator C22 that may be used in conjunction with a downsampling version of burst detector C10. Attenuation control signal generator C24 includes an upsampler configured to upsample attenuation control signal SB70 to a signal SB70a having a sampling rate equal to that of highband speech signal S30.
[000113] In one example, upsampler C140 is configured to perform the upsampling by zeroth-order interpolation of attenuation control signal SB70. In another example, upsampler C140 is configured to perform the upsampling by otherwise interpolating between the values of attenuation control signal SB70 (e.g., by passing attenuation control signal SB70 through an FIR filter) to obtain less abrupt transitions.
In a further example, upsampler C140 is configured to perform the upsampling using windowed sine functions.
[000114] In some cases, such as in a battery-powered device (e.g., a cellular telephone), highband burst suppressor C200 may be configured to be selectively disabled.
For example, it may be desired to disable an operation such as highband burst suppression in a power-saving mode of the device.
[000115] As mentioned above, embodiments as described herein include implementations that may be used to perform embedded coding, supporting compatibility with narrowband systems and avoiding a need for transcoding.
Support for highband coding may also serve to differentiate on a cost basis between chips, chipsets, devices, and/or networks having wideband support with backward compatibility, and those having narrowband support only. Support for highband coding as described herein may also be used in conjunction with a technique for supporting lowband coding, and a system, method, or apparatus according to such an embodiment may support coding of frequency components from, for example, about 50 or 100 Hz up to about 7 or 8 kHz.
[000116] As mentioned above, adding highband support to a speech coder may improve intelligibility, especially regarding differentiation of fricatives. Although such differentiation may usually be derived by a human listener from the particular context, highband support may serve as an enabling feature in speech recognition and other machine interpretation applications, such as systems for automated voice menu navigation and/or automatic call processing. Highband burst suppression may increase accuracy in a machine interpretation application, and it is contemplated that an implementation of highband burst suppressor C200 may be used in one or more such applications without or without speech encoding.
[000117] An apparatus according to an embodiment may be embedded into a portable device for wireless communications such as a cellular telephone or personal digital assistant (PDA). Alternatively, such an apparatus may be included in another communications device such as a VolP handset, a personal computer configured to support Volt) communications, or a network device configured to route telephonic or VolP communications. For example, an apparatus according to an embodiment may be implemented in a chip or chipset for a communications device. Depending upon the particular application, such a device may also include such features as analog-to-digital and/or digital-to-analog conversion of a speech signal, circuitry for performing amplification and/or other signal processing operations on a speech signal, and/or radio-frequency circuitry for transmission and/or reception of the coded speech signal.
[000118] It is explicitly contemplated and disclosed that embodiments may include and/or be used with any one or more of the other features disclosed in the published patent applications cited herein. Such features include generation of a highband excitation signal from a lowband excitation signal, which may include other features such as anti-sparseness filtering, harmonic extension using a nonlinear function, mixing of a modulated noise signal with a spectrally extended signal, and/or adaptive whitening. Such features include time-warping a highband speech signal according to a regularization performed in a lowband encoder.
Such features include encoding of a gain envelope according to a relation between an original speech signal and a synthesized speech signal. Such features include use of overlapping filter banks to obtain lowband and highband speech signals from a wideband speech signal. Such features include shifting of highband signal S30 and/or a highband excitation signal according to a regularization or other shift of lowband excitation signal S50. Such features include fixed or adaptive smoothing of coefficient representations such as highband LSFs. Such features include fixed or adaptive shaping of noise associated with quantization of coefficient representations such as LSFs. Such features also include fixed or adaptive smoothing of a gain envelope, and adaptive attenuation of a gain envelope.
[000119]The foregoing presentation of the described embodiments is provided to enable any person skilled in the art to make or use the present invention.
Various modifications to these embodiments are possible, and the generic principles presented herein may be applied to other embodiments as well. For example, an embodiment may be implemented in part or in whole as a hard-wired circuit, as a circuit configuration fabricated into an application-specific integrated circuit, or as a firmware program loaded into non-volatile storage or a software program loaded from or into a data storage medium as machine-readable code, such code being instructions executable by an array of logic elements such as a microprocessor or other digital signal processing unit. The data storage medium may be an array of storage elements such as semiconductor memory (which may include without limitation dynamic or static RAM
(random-access memory), ROM (read-only memory), and/or flash RAM), or ferroelectric, magnetoresistive, ovonic, polymeric, or phase-change memory; or a disk medium such as a magnetic or optical disk. The term "software" should be understood to include source code, assembly language code, machine code, binary code, firmware, macrocode, microcode, any one or more sets or sequences of instructions executable by an array of logic elements, and any combination of such examples.
[000120]The various elements of implementations of highband speech encoder A200;
wideband speech encoder A100, A102, and A104; and highband burst suppressor C200;
and arrangements including one or more such apparatus, may be implemented as electronic and/or optical devices residing, for example, on the same chip or among two or more chips in a chipset, although other arrangements without such limitation are also contemplated. One or more elements of such an apparatus may be implemented in whole or in part as one or more sets of instructions arranged to execute on one or more fixed or programmable arrays of logic elements (e.g., transistors, gates) such as microprocessors, embedded processors, IP cores, digital signal processors, FPGAs (field-programmable gate arrays), ASSPs (application-specific standard products), and ASICs (application-specific integrated circuits). It is also possible for one or more such elements to have structure in common (e.g., a processor used to execute portions of code corresponding to different elements at different times, a set of instructions executed to perform tasks corresponding to different elements at different times, or an arrangement of electronic and/or optical devices performing operations for different elements at different times). Moreover, it is possible for one or more such elements to be used to perform tasks or execute other sets of instructions that are not directly related to an operation of the apparatus, such as a task relating to another operation of a device or system in which the apparatus is embedded.
[000121]Embodiments also include additional methods of speech processing, speech encoding, and highband burst suppression as are expressly disclosed herein, e.g., by descriptions of structural embodiments configured to perform such methods.
Each of these methods may also be tangibly embodied (for example, in one or more data storage media as listed above) as one or more sets of instructions readable and/or executable by a machine including an array of logic elements (e.g., a processor, microprocessor, microcontroller, or other finite state machine). Thus, the present invention is not intended to be limited to the embodiments shown above but rather is to be accorded the widest scope consistent with the principles and novel features disclosed in any fashion herein.
Claims (28)
1. A method of signal processing, said method comprising:
calculating a first burst indication signal that indicates whether a burst is detected in a low-frequency portion of a speech signal;
calculating a second burst indication signal that indicates whether a burst is detected in a high-frequency portion of the speech signal;
generating an attenuation control signal according to a relation between the first and second burst indication signals;
applying the attenuation control signal to the high-frequency portion of the speech signal to generate a processed high-frequency signal portion, wherein calculating at least one of the first and second burst indication signals comprises:
producing a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction;
indicating an initial region of a burst in the forward smoothed envelope;
producing a backward smoothed envelope of the corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction; and indicating a terminal region of a burst in the backward smoothed envelope.
calculating a first burst indication signal that indicates whether a burst is detected in a low-frequency portion of a speech signal;
calculating a second burst indication signal that indicates whether a burst is detected in a high-frequency portion of the speech signal;
generating an attenuation control signal according to a relation between the first and second burst indication signals;
applying the attenuation control signal to the high-frequency portion of the speech signal to generate a processed high-frequency signal portion, wherein calculating at least one of the first and second burst indication signals comprises:
producing a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction;
indicating an initial region of a burst in the forward smoothed envelope;
producing a backward smoothed envelope of the corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction; and indicating a terminal region of a burst in the backward smoothed envelope.
2. The method of signal processing according to claim 1, wherein the speech signal is an audio-frequency speech signal.
3. The method of signal processing according to claim 1, wherein at least one of said calculating the first burst indication signal and calculating the second burst indication signal comprises detecting a coincidence in time of the initial and terminal regions.
4. The method of signal processing according to claim 1, wherein at least one of said calculating the first burst indication signal and calculating the second burst indication signal comprises indicating the burst according to an overlap in time of the initial and terminal regions.
5. The method according to claim 1, wherein at least one of said calculating the first burst indication signal and calculating the second burst indication signal comprises calculating the corresponding burst indication signal according to a mean of (A) a signal based on the indication of the initial region and (B) a signal based on the indication of the terminal region.
6. The method according to claim 1, wherein at least one of the first and second burst indication signals indicates a level of a detected burst on a logarithmic scale.
7. The method according to claim 1, wherein said generating an attenuation control signal includes generating the attenuation control signal according to a difference between the first burst indication signal and the second burst indication signal.
8. The method according to claim 1, wherein said generating an attenuation control signal includes generating the attenuation control signal according to a degree to which a level of the second burst indication signal exceeds a level of the first burst indication signal.
9. The method according to claim 1, wherein said applying the attenuation control signal to the high-frequency portion of the speech signal comprises at least one among (A) multiplying the high-frequency portion by the attenuation control signal and (B) amplifying the high-frequency portion according to the attenuation control signal.
10. The method according to claim 1, said method comprising processing the speech signal to obtain the low-frequency portion and the high-frequency portion.
11. The method according to claim 1, said method comprising encoding a signal based on the processed high-frequency signal portion into at least a plurality of linear prediction filter coefficients.
12. The method according to claim 11, said method comprising encoding the low-frequency portion into at least a second plurality of linear prediction filter coefficients and an encoded excitation signal, wherein said encoding the signal based on the processed high-frequency signal portion includes encoding, according to a signal based on the encoded excitation signal, a gain envelope of the signal that is based on the processed high-frequency signal portion.
13. The method according to claim 11, said method comprising:
encoding the low-frequency portion into at least a second plurality of linear prediction filter coefficients and an encoded excitation signal; and generating a highband excitation signal based on the encoded excitation signal, wherein said encoding the signal based on the processed high-frequency signal portion includes encoding, according to a signal based on the highband excitation signal, a gain envelope of the signal that is based on the processed high-frequency signal portion.
encoding the low-frequency portion into at least a second plurality of linear prediction filter coefficients and an encoded excitation signal; and generating a highband excitation signal based on the encoded excitation signal, wherein said encoding the signal based on the processed high-frequency signal portion includes encoding, according to a signal based on the highband excitation signal, a gain envelope of the signal that is based on the processed high-frequency signal portion.
14. A non-transitory data storage medium having machine-executable instructions that when executed by a processor cause the processor to perform the method of signal processing according to any one of claims 1 to 13.
15. An apparatus comprising a highband burst suppressor, said highband burst suppressor comprising:
a first burst detector configured to output a first burst indication signal indicating whether a burst is detected in a low-frequency portion of a speech signal;
a second burst detector configured to output a second burst indication signal indicating whether a burst is detected in a high-frequency portion of the speech signal;
an attenuation control signal generator configured to generate an attenuation control signal according to a relation between the first and second burst indication signals; and a gain control element configured to apply the attenuation control signal to the high-frequency portion of the signal, wherein at least one of said first and second burst detectors comprises:
a forward smoother configured to produce a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction;
a first region indicator configured to indicate an initial region of a burst in the forward smoothed envelope;
a backward smoother configured to produce a backward smoothed envelope of a corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction; and a second region indicator configured to indicate a terminal region of a burst in the backward smoothed envelope.
a first burst detector configured to output a first burst indication signal indicating whether a burst is detected in a low-frequency portion of a speech signal;
a second burst detector configured to output a second burst indication signal indicating whether a burst is detected in a high-frequency portion of the speech signal;
an attenuation control signal generator configured to generate an attenuation control signal according to a relation between the first and second burst indication signals; and a gain control element configured to apply the attenuation control signal to the high-frequency portion of the signal, wherein at least one of said first and second burst detectors comprises:
a forward smoother configured to produce a forward smoothed envelope of a corresponding portion of the speech signal, the forward smoothed envelope being smoothed in a positive time direction;
a first region indicator configured to indicate an initial region of a burst in the forward smoothed envelope;
a backward smoother configured to produce a backward smoothed envelope of a corresponding portion of the speech signal, the backward smoothed envelope being smoothed in a negative time direction; and a second region indicator configured to indicate a terminal region of a burst in the backward smoothed envelope.
16. The apparatus according to claim 15, wherein the speech signal is an audio-frequency speech signal.
17. The apparatus according to claim 15, the at least one of said first and second burst detectors comprising a coincidence detector configured to detect a coincidence in time of the initial and terminal regions.
18. The apparatus according to claim 15, the at least one of said first and second burst detectors comprising a coincidence detector configured to indicate the burst according to an overlap in time of the initial and terminal regions.
19. The apparatus according to claim 15, the at least one of said first and second burst detectors comprising a coincidence detector configured to output the corresponding burst indication signal according to a mean of (A) a signal based on the indication of the initial region and (B) a signal based on the indication of the terminal region.
20. The apparatus according to claim 15, wherein at least one of the first and second burst indication signals indicates a level of a detected burst on a logarithmic scale.
21. The apparatus according to claim 15, wherein the attenuation control signal generator is configured to generate the attenuation control signal according to a difference between the first burst indication signal and the second burst indication signal.
22. The apparatus according to claim 15, wherein the attenuation control signal generator is configured to generate the attenuation control signal according to a degree to which a level of the second burst indication signal exceeds a level of the first burst indication signal.
23. The apparatus according to claim 15, wherein the gain control element comprises at least one among a multiplier and an amplifier.
24. The apparatus according to claim 15, said apparatus comprising a filter bank configured to process the speech signal to obtain the low-frequency portion and the high-frequency portion.
25. The apparatus according to claim 15, said apparatus comprising a highband speech encoder configured to encode a signal based on an output of said gain control element into at least a plurality of linear prediction filter coefficients.
26. The apparatus according to claim 25, said apparatus comprising a lowband speech encoder configured to encode the low-frequency portion into at least a second plurality of linear prediction filter coefficients and an encoded excitation signal, wherein said highband speech encoder is configured to encode, according to a signal based on the encoded excitation signal, a gain envelope of the signal that is based on the output of said gain control element.
27. The apparatus according to claim 26, wherein said highband encoder is configured to generate a highband excitation signal based on the encoded excitation signal, and wherein said highband speech encoder is configured to encode, according to a signal based on the highband excitation signal, the gain envelope of the signal that is based on the output of said gain control element.
28. The apparatus according to claim 15, said apparatus comprising a cellular telephone.
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US66790105P | 2005-04-01 | 2005-04-01 | |
US60/667,901 | 2005-04-01 | ||
US67396505P | 2005-04-22 | 2005-04-22 | |
US60/673,965 | 2005-04-22 | ||
PCT/US2006/012228 WO2006107834A1 (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for highband burst suppression |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2602804A1 CA2602804A1 (en) | 2006-10-12 |
CA2602804C true CA2602804C (en) | 2013-12-24 |
Family
ID=36588741
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA2603246A Active CA2603246C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for anti-sparseness filtering |
CA2603255A Active CA2603255C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for wideband speech coding |
CA2602804A Active CA2602804C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for highband burst suppression |
CA2602806A Active CA2602806C (en) | 2005-04-01 | 2006-04-03 | Methods and apparatus for encoding and decoding an highband portion of a speech signal |
CA2603229A Active CA2603229C (en) | 2005-04-01 | 2006-04-03 | Method and apparatus for split-band encoding of speech signals |
CA2603219A Active CA2603219C (en) | 2005-04-01 | 2006-04-03 | Method and apparatus for vector quantizing of a spectral envelope representation |
CA2603187A Active CA2603187C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for highband excitation generation |
CA2603231A Active CA2603231C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for highband time warping |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA2603246A Active CA2603246C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for anti-sparseness filtering |
CA2603255A Active CA2603255C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for wideband speech coding |
Family Applications After (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA2602806A Active CA2602806C (en) | 2005-04-01 | 2006-04-03 | Methods and apparatus for encoding and decoding an highband portion of a speech signal |
CA2603229A Active CA2603229C (en) | 2005-04-01 | 2006-04-03 | Method and apparatus for split-band encoding of speech signals |
CA2603219A Active CA2603219C (en) | 2005-04-01 | 2006-04-03 | Method and apparatus for vector quantizing of a spectral envelope representation |
CA2603187A Active CA2603187C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for highband excitation generation |
CA2603231A Active CA2603231C (en) | 2005-04-01 | 2006-04-03 | Systems, methods, and apparatus for highband time warping |
Country Status (24)
Country | Link |
---|---|
US (8) | US8078474B2 (en) |
EP (8) | EP1869670B1 (en) |
JP (8) | JP5129116B2 (en) |
KR (8) | KR100956877B1 (en) |
CN (1) | CN102411935B (en) |
AT (4) | ATE482449T1 (en) |
AU (8) | AU2006232357C1 (en) |
BR (8) | BRPI0608269B8 (en) |
CA (8) | CA2603246C (en) |
DE (4) | DE602006018884D1 (en) |
DK (2) | DK1864101T3 (en) |
ES (3) | ES2636443T3 (en) |
HK (5) | HK1113848A1 (en) |
IL (8) | IL186439A0 (en) |
MX (8) | MX2007012187A (en) |
NO (7) | NO340566B1 (en) |
NZ (6) | NZ562182A (en) |
PL (4) | PL1866915T3 (en) |
PT (2) | PT1864101E (en) |
RU (9) | RU2402826C2 (en) |
SG (4) | SG163556A1 (en) |
SI (1) | SI1864282T1 (en) |
TW (8) | TWI321777B (en) |
WO (8) | WO2006130221A1 (en) |
Families Citing this family (322)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7987095B2 (en) * | 2002-09-27 | 2011-07-26 | Broadcom Corporation | Method and system for dual mode subband acoustic echo canceller with integrated noise suppression |
US7619995B1 (en) * | 2003-07-18 | 2009-11-17 | Nortel Networks Limited | Transcoders and mixers for voice-over-IP conferencing |
JP4679049B2 (en) | 2003-09-30 | 2011-04-27 | パナソニック株式会社 | Scalable decoding device |
US7668712B2 (en) | 2004-03-31 | 2010-02-23 | Microsoft Corporation | Audio encoding and decoding with intra frames and adaptive forward error correction |
US8417515B2 (en) * | 2004-05-14 | 2013-04-09 | Panasonic Corporation | Encoding device, decoding device, and method thereof |
WO2006009074A1 (en) * | 2004-07-20 | 2006-01-26 | Matsushita Electric Industrial Co., Ltd. | Audio decoding device and compensation frame generation method |
TWI454101B (en) * | 2004-08-30 | 2014-09-21 | Qualcomm Inc | Adaptive de-jitter buffer for packetized data commumications |
US8085678B2 (en) * | 2004-10-13 | 2011-12-27 | Qualcomm Incorporated | Media (voice) playback (de-jitter) buffer adjustments based on air interface |
US8355907B2 (en) * | 2005-03-11 | 2013-01-15 | Qualcomm Incorporated | Method and apparatus for phase matching frames in vocoders |
US8155965B2 (en) * | 2005-03-11 | 2012-04-10 | Qualcomm Incorporated | Time warping frames inside the vocoder by modifying the residual |
WO2006103488A1 (en) * | 2005-03-30 | 2006-10-05 | Nokia Corporation | Source coding and/or decoding |
PL1866915T3 (en) * | 2005-04-01 | 2011-05-31 | Qualcomm Inc | Method and apparatus for anti-sparseness filtering of a bandwidth extended speech prediction excitation signal |
WO2006116025A1 (en) * | 2005-04-22 | 2006-11-02 | Qualcomm Incorporated | Systems, methods, and apparatus for gain factor smoothing |
KR100915726B1 (en) * | 2005-04-28 | 2009-09-04 | 지멘스 악티엔게젤샤프트 | Noise suppression process and device |
US7831421B2 (en) * | 2005-05-31 | 2010-11-09 | Microsoft Corporation | Robust decoder |
US7707034B2 (en) * | 2005-05-31 | 2010-04-27 | Microsoft Corporation | Audio codec post-filter |
US7177804B2 (en) * | 2005-05-31 | 2007-02-13 | Microsoft Corporation | Sub-band voice codec with multi-stage codebooks and redundant coding |
DE102005032724B4 (en) * | 2005-07-13 | 2009-10-08 | Siemens Ag | Method and device for artificially expanding the bandwidth of speech signals |
ES2332108T3 (en) * | 2005-07-14 | 2010-01-26 | Koninklijke Philips Electronics N.V. | SYNTHESIS OF AUDIO SIGNAL. |
WO2007013973A2 (en) * | 2005-07-20 | 2007-02-01 | Shattil, Steve | Systems and method for high data rate ultra wideband communication |
KR101171098B1 (en) * | 2005-07-22 | 2012-08-20 | 삼성전자주식회사 | Scalable speech coding/decoding methods and apparatus using mixed structure |
CA2558595C (en) * | 2005-09-02 | 2015-05-26 | Nortel Networks Limited | Method and apparatus for extending the bandwidth of a speech signal |
US8326614B2 (en) * | 2005-09-02 | 2012-12-04 | Qnx Software Systems Limited | Speech enhancement system |
CN101273404B (en) * | 2005-09-30 | 2012-07-04 | 松下电器产业株式会社 | Audio encoding device and audio encoding method |
WO2007043643A1 (en) * | 2005-10-14 | 2007-04-19 | Matsushita Electric Industrial Co., Ltd. | Audio encoding device, audio decoding device, audio encoding method, and audio decoding method |
US8135588B2 (en) | 2005-10-14 | 2012-03-13 | Panasonic Corporation | Transform coder and transform coding method |
JP4876574B2 (en) * | 2005-12-26 | 2012-02-15 | ソニー株式会社 | Signal encoding apparatus and method, signal decoding apparatus and method, program, and recording medium |
EP1852848A1 (en) * | 2006-05-05 | 2007-11-07 | Deutsche Thomson-Brandt GmbH | Method and apparatus for lossless encoding of a source signal using a lossy encoded data stream and a lossless extension data stream |
US8949120B1 (en) | 2006-05-25 | 2015-02-03 | Audience, Inc. | Adaptive noise cancelation |
US7987089B2 (en) * | 2006-07-31 | 2011-07-26 | Qualcomm Incorporated | Systems and methods for modifying a zero pad region of a windowed frame of an audio signal |
US8135047B2 (en) | 2006-07-31 | 2012-03-13 | Qualcomm Incorporated | Systems and methods for including an identifier with a packet associated with a speech signal |
US8532984B2 (en) * | 2006-07-31 | 2013-09-10 | Qualcomm Incorporated | Systems, methods, and apparatus for wideband encoding and decoding of active frames |
US8260609B2 (en) | 2006-07-31 | 2012-09-04 | Qualcomm Incorporated | Systems, methods, and apparatus for wideband encoding and decoding of inactive frames |
US8725499B2 (en) * | 2006-07-31 | 2014-05-13 | Qualcomm Incorporated | Systems, methods, and apparatus for signal change detection |
ATE496365T1 (en) * | 2006-08-15 | 2011-02-15 | Dolby Lab Licensing Corp | ARBITRARY FORMING OF A TEMPORARY NOISE ENVELOPE WITHOUT ADDITIONAL INFORMATION |
WO2008022184A2 (en) * | 2006-08-15 | 2008-02-21 | Broadcom Corporation | Constrained and controlled decoding after packet loss |
US8239190B2 (en) * | 2006-08-22 | 2012-08-07 | Qualcomm Incorporated | Time-warping frames of wideband vocoder |
US8046218B2 (en) * | 2006-09-19 | 2011-10-25 | The Board Of Trustees Of The University Of Illinois | Speech and method for identifying perceptual features |
JP4972742B2 (en) * | 2006-10-17 | 2012-07-11 | 国立大学法人九州工業大学 | High-frequency signal interpolation method and high-frequency signal interpolation device |
WO2008049590A1 (en) * | 2006-10-25 | 2008-05-02 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating audio subband values and apparatus and method for generating time-domain audio samples |
US8639500B2 (en) | 2006-11-17 | 2014-01-28 | Samsung Electronics Co., Ltd. | Method, medium, and apparatus with bandwidth extension encoding and/or decoding |
KR101375582B1 (en) | 2006-11-17 | 2014-03-20 | 삼성전자주식회사 | Method and apparatus for bandwidth extension encoding and decoding |
KR101565919B1 (en) | 2006-11-17 | 2015-11-05 | 삼성전자주식회사 | Method and apparatus for encoding and decoding high frequency signal |
US8005671B2 (en) * | 2006-12-04 | 2011-08-23 | Qualcomm Incorporated | Systems and methods for dynamic normalization to reduce loss in precision for low-level signals |
GB2444757B (en) * | 2006-12-13 | 2009-04-22 | Motorola Inc | Code excited linear prediction speech coding |
US20080147389A1 (en) * | 2006-12-15 | 2008-06-19 | Motorola, Inc. | Method and Apparatus for Robust Speech Activity Detection |
FR2911020B1 (en) * | 2006-12-28 | 2009-05-01 | Actimagine Soc Par Actions Sim | AUDIO CODING METHOD AND DEVICE |
FR2911031B1 (en) * | 2006-12-28 | 2009-04-10 | Actimagine Soc Par Actions Sim | AUDIO CODING METHOD AND DEVICE |
KR101379263B1 (en) * | 2007-01-12 | 2014-03-28 | 삼성전자주식회사 | Method and apparatus for decoding bandwidth extension |
US7873064B1 (en) | 2007-02-12 | 2011-01-18 | Marvell International Ltd. | Adaptive jitter buffer-packet loss concealment |
US8032359B2 (en) * | 2007-02-14 | 2011-10-04 | Mindspeed Technologies, Inc. | Embedded silence and background noise compression |
GB0704622D0 (en) * | 2007-03-09 | 2007-04-18 | Skype Ltd | Speech coding system and method |
KR101411900B1 (en) * | 2007-05-08 | 2014-06-26 | 삼성전자주식회사 | Method and apparatus for encoding and decoding audio signal |
US9653088B2 (en) * | 2007-06-13 | 2017-05-16 | Qualcomm Incorporated | Systems, methods, and apparatus for signal encoding using pitch-regularizing and non-pitch-regularizing coding |
EP2186089B1 (en) | 2007-08-27 | 2018-10-03 | Telefonaktiebolaget LM Ericsson (publ) | Method and device for perceptual spectral decoding of an audio signal including filling of spectral holes |
FR2920545B1 (en) * | 2007-09-03 | 2011-06-10 | Univ Sud Toulon Var | METHOD FOR THE MULTIPLE CHARACTEROGRAPHY OF CETACEANS BY PASSIVE ACOUSTICS |
RU2449386C2 (en) * | 2007-11-02 | 2012-04-27 | Хуавэй Текнолоджиз Ко., Лтд. | Audio decoding method and apparatus |
WO2009059632A1 (en) * | 2007-11-06 | 2009-05-14 | Nokia Corporation | An encoder |
RU2483368C2 (en) * | 2007-11-06 | 2013-05-27 | Нокиа Корпорейшн | Encoder |
CA2704807A1 (en) * | 2007-11-06 | 2009-05-14 | Nokia Corporation | Audio coding apparatus and method thereof |
KR101444099B1 (en) * | 2007-11-13 | 2014-09-26 | 삼성전자주식회사 | Method and apparatus for detecting voice activity |
US8504377B2 (en) * | 2007-11-21 | 2013-08-06 | Lg Electronics Inc. | Method and an apparatus for processing a signal using length-adjusted window |
US8688441B2 (en) * | 2007-11-29 | 2014-04-01 | Motorola Mobility Llc | Method and apparatus to facilitate provision and use of an energy value to determine a spectral envelope shape for out-of-signal bandwidth content |
US8050934B2 (en) * | 2007-11-29 | 2011-11-01 | Texas Instruments Incorporated | Local pitch control based on seamless time scale modification and synchronized sampling rate conversion |
TWI356399B (en) * | 2007-12-14 | 2012-01-11 | Ind Tech Res Inst | Speech recognition system and method with cepstral |
KR101439205B1 (en) * | 2007-12-21 | 2014-09-11 | 삼성전자주식회사 | Method and apparatus for audio matrix encoding/decoding |
WO2009084221A1 (en) * | 2007-12-27 | 2009-07-09 | Panasonic Corporation | Encoding device, decoding device, and method thereof |
KR101413967B1 (en) * | 2008-01-29 | 2014-07-01 | 삼성전자주식회사 | Encoding method and decoding method of audio signal, and recording medium thereof, encoding apparatus and decoding apparatus of audio signal |
KR101413968B1 (en) * | 2008-01-29 | 2014-07-01 | 삼성전자주식회사 | Method and apparatus for encoding audio signal, and method and apparatus for decoding audio signal |
DE102008015702B4 (en) | 2008-01-31 | 2010-03-11 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for bandwidth expansion of an audio signal |
US8433582B2 (en) * | 2008-02-01 | 2013-04-30 | Motorola Mobility Llc | Method and apparatus for estimating high-band energy in a bandwidth extension system |
US20090201983A1 (en) * | 2008-02-07 | 2009-08-13 | Motorola, Inc. | Method and apparatus for estimating high-band energy in a bandwidth extension system |
US8326641B2 (en) * | 2008-03-20 | 2012-12-04 | Samsung Electronics Co., Ltd. | Apparatus and method for encoding and decoding using bandwidth extension in portable terminal |
US8983832B2 (en) * | 2008-07-03 | 2015-03-17 | The Board Of Trustees Of The University Of Illinois | Systems and methods for identifying speech sound features |
CN102089810B (en) | 2008-07-10 | 2013-05-08 | 沃伊斯亚吉公司 | Multi-reference LPC filter quantization and inverse quantization device and method |
KR101400588B1 (en) | 2008-07-11 | 2014-05-28 | 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. | Providing a Time Warp Activation Signal and Encoding an Audio Signal Therewith |
MY154452A (en) * | 2008-07-11 | 2015-06-15 | Fraunhofer Ges Forschung | An apparatus and a method for decoding an encoded audio signal |
JP5010743B2 (en) | 2008-07-11 | 2012-08-29 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | Apparatus and method for calculating bandwidth extension data using spectral tilt controlled framing |
KR101614160B1 (en) * | 2008-07-16 | 2016-04-20 | 한국전자통신연구원 | Apparatus for encoding and decoding multi-object audio supporting post downmix signal |
US20110178799A1 (en) * | 2008-07-25 | 2011-07-21 | The Board Of Trustees Of The University Of Illinois | Methods and systems for identifying speech sounds using multi-dimensional analysis |
US8463412B2 (en) * | 2008-08-21 | 2013-06-11 | Motorola Mobility Llc | Method and apparatus to facilitate determining signal bounding frequencies |
US8532983B2 (en) * | 2008-09-06 | 2013-09-10 | Huawei Technologies Co., Ltd. | Adaptive frequency prediction for encoding or decoding an audio signal |
WO2010028299A1 (en) * | 2008-09-06 | 2010-03-11 | Huawei Technologies Co., Ltd. | Noise-feedback for spectral envelope quantization |
US8515747B2 (en) * | 2008-09-06 | 2013-08-20 | Huawei Technologies Co., Ltd. | Spectrum harmonic/noise sharpness control |
US8352279B2 (en) * | 2008-09-06 | 2013-01-08 | Huawei Technologies Co., Ltd. | Efficient temporal envelope coding approach by prediction between low band signal and high band signal |
US8532998B2 (en) | 2008-09-06 | 2013-09-10 | Huawei Technologies Co., Ltd. | Selective bandwidth extension for encoding/decoding audio/speech signal |
US20100070550A1 (en) * | 2008-09-12 | 2010-03-18 | Cardinal Health 209 Inc. | Method and apparatus of a sensor amplifier configured for use in medical applications |
KR101178801B1 (en) * | 2008-12-09 | 2012-08-31 | 한국전자통신연구원 | Apparatus and method for speech recognition by using source separation and source identification |
WO2010031003A1 (en) | 2008-09-15 | 2010-03-18 | Huawei Technologies Co., Ltd. | Adding second enhancement layer to celp based core layer |
WO2010031049A1 (en) * | 2008-09-15 | 2010-03-18 | GH Innovation, Inc. | Improving celp post-processing for music signals |
US8831958B2 (en) * | 2008-09-25 | 2014-09-09 | Lg Electronics Inc. | Method and an apparatus for a bandwidth extension using different schemes |
WO2010053287A2 (en) * | 2008-11-04 | 2010-05-14 | Lg Electronics Inc. | An apparatus for processing an audio signal and method thereof |
DE102008058496B4 (en) * | 2008-11-21 | 2010-09-09 | Siemens Medical Instruments Pte. Ltd. | Filter bank system with specific stop attenuation components for a hearing device |
GB0822537D0 (en) | 2008-12-10 | 2009-01-14 | Skype Ltd | Regeneration of wideband speech |
GB2466201B (en) * | 2008-12-10 | 2012-07-11 | Skype Ltd | Regeneration of wideband speech |
US9947340B2 (en) * | 2008-12-10 | 2018-04-17 | Skype | Regeneration of wideband speech |
EP2360687A4 (en) * | 2008-12-19 | 2012-07-11 | Fujitsu Ltd | Voice band extension device and voice band extension method |
GB2466669B (en) * | 2009-01-06 | 2013-03-06 | Skype | Speech coding |
GB2466671B (en) * | 2009-01-06 | 2013-03-27 | Skype | Speech encoding |
GB2466674B (en) | 2009-01-06 | 2013-11-13 | Skype | Speech coding |
GB2466670B (en) * | 2009-01-06 | 2012-11-14 | Skype | Speech encoding |
GB2466672B (en) * | 2009-01-06 | 2013-03-13 | Skype | Speech coding |
GB2466675B (en) * | 2009-01-06 | 2013-03-06 | Skype | Speech coding |
GB2466673B (en) * | 2009-01-06 | 2012-11-07 | Skype | Quantization |
TR201910073T4 (en) * | 2009-01-16 | 2019-07-22 | Dolby Int Ab | Harmonic transfer with improved cross product. |
US8463599B2 (en) * | 2009-02-04 | 2013-06-11 | Motorola Mobility Llc | Bandwidth extension method and apparatus for a modified discrete cosine transform audio coder |
KR101320963B1 (en) * | 2009-03-31 | 2013-10-23 | 후아웨이 테크놀러지 컴퍼니 리미티드 | Signal de-noising method, signal de-noising apparatus, and audio decoding system |
JP4921611B2 (en) * | 2009-04-03 | 2012-04-25 | 株式会社エヌ・ティ・ティ・ドコモ | Speech decoding apparatus, speech decoding method, and speech decoding program |
JP4932917B2 (en) * | 2009-04-03 | 2012-05-16 | 株式会社エヌ・ティ・ティ・ドコモ | Speech decoding apparatus, speech decoding method, and speech decoding program |
JP5730860B2 (en) * | 2009-05-19 | 2015-06-10 | エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute | Audio signal encoding and decoding method and apparatus using hierarchical sinusoidal pulse coding |
CN101609680B (en) * | 2009-06-01 | 2012-01-04 | 华为技术有限公司 | Compression coding and decoding method, coder, decoder and coding device |
US8000485B2 (en) * | 2009-06-01 | 2011-08-16 | Dts, Inc. | Virtual audio processing for loudspeaker or headphone playback |
KR20110001130A (en) * | 2009-06-29 | 2011-01-06 | 삼성전자주식회사 | Apparatus and method for encoding and decoding audio signals using weighted linear prediction transform |
WO2011029484A1 (en) * | 2009-09-14 | 2011-03-17 | Nokia Corporation | Signal enhancement processing |
US9595257B2 (en) * | 2009-09-28 | 2017-03-14 | Nuance Communications, Inc. | Downsampling schemes in a hierarchical neural network structure for phoneme recognition |
US8452606B2 (en) * | 2009-09-29 | 2013-05-28 | Skype | Speech encoding using multiple bit rates |
JP5754899B2 (en) * | 2009-10-07 | 2015-07-29 | ソニー株式会社 | Decoding apparatus and method, and program |
CA2778323C (en) | 2009-10-20 | 2016-09-20 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio encoder, audio decoder, method for encoding an audio information, method for decoding an audio information and computer program using a detection of a group of previously-decoded spectral values |
US9026236B2 (en) | 2009-10-21 | 2015-05-05 | Panasonic Intellectual Property Corporation Of America | Audio signal processing apparatus, audio coding apparatus, and audio decoding apparatus |
BR112012009375B1 (en) | 2009-10-21 | 2020-09-24 | Dolby International Ab. | SYSTEM CONFIGURED TO GENERATE A HIGH FREQUENCY COMPONENT FROM AN AUDIO SIGNAL, METHOD TO GENERATE A HIGH FREQUENCY COMPONENT FROM AN AUDIO SIGNAL AND METHOD TO DESIGN A HARMONIC TRANSPOSITOR |
US8484020B2 (en) | 2009-10-23 | 2013-07-09 | Qualcomm Incorporated | Determining an upperband signal from a narrowband signal |
WO2011062536A1 (en) * | 2009-11-19 | 2011-05-26 | Telefonaktiebolaget Lm Ericsson (Publ) | Improved excitation signal bandwidth extension |
EP2502231B1 (en) * | 2009-11-19 | 2014-06-04 | Telefonaktiebolaget L M Ericsson (PUBL) | Bandwidth extension of a low band audio signal |
US8489393B2 (en) * | 2009-11-23 | 2013-07-16 | Cambridge Silicon Radio Limited | Speech intelligibility |
US9838784B2 (en) | 2009-12-02 | 2017-12-05 | Knowles Electronics, Llc | Directional audio capture |
RU2464651C2 (en) * | 2009-12-22 | 2012-10-20 | Общество с ограниченной ответственностью "Спирит Корп" | Method and apparatus for multilevel scalable information loss tolerant speech encoding for packet switched networks |
US8559749B2 (en) * | 2010-01-06 | 2013-10-15 | Streaming Appliances, Llc | Audiovisual content delivery system |
US8326607B2 (en) * | 2010-01-11 | 2012-12-04 | Sony Ericsson Mobile Communications Ab | Method and arrangement for enhancing speech quality |
SG182467A1 (en) * | 2010-01-12 | 2012-08-30 | Fraunhofer Ges Forschung | Audio encoder, audio decoder, method for encoding and audio information, method for decoding an audio information and computer program using a hash table describing both significant state values and interval boundaries |
US8699727B2 (en) | 2010-01-15 | 2014-04-15 | Apple Inc. | Visually-assisted mixing of audio using a spectral analyzer |
US9525569B2 (en) * | 2010-03-03 | 2016-12-20 | Skype | Enhanced circuit-switched calls |
CA2792504C (en) * | 2010-03-10 | 2016-05-31 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio signal decoder, audio signal encoder, method for decoding an audio signal, method for encoding an audio signal and computer program using a pitch-dependent adaptation of a coding context |
US8700391B1 (en) * | 2010-04-01 | 2014-04-15 | Audience, Inc. | Low complexity bandwidth expansion of speech |
EP2559026A1 (en) * | 2010-04-12 | 2013-02-20 | Freescale Semiconductor, Inc. | Audio communication device, method for outputting an audio signal, and communication system |
JP5652658B2 (en) | 2010-04-13 | 2015-01-14 | ソニー株式会社 | Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program |
JP5850216B2 (en) | 2010-04-13 | 2016-02-03 | ソニー株式会社 | Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program |
JP5609737B2 (en) | 2010-04-13 | 2014-10-22 | ソニー株式会社 | Signal processing apparatus and method, encoding apparatus and method, decoding apparatus and method, and program |
WO2011128342A1 (en) * | 2010-04-13 | 2011-10-20 | Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. | Method and encoder and decoder for gap - less playback of an audio signal |
RU2547238C2 (en) * | 2010-04-14 | 2015-04-10 | Войсэйдж Корпорейшн | Flexible and scalable combined updating codebook for use in celp coder and decoder |
US9443534B2 (en) * | 2010-04-14 | 2016-09-13 | Huawei Technologies Co., Ltd. | Bandwidth extension system and approach |
KR101430335B1 (en) | 2010-04-16 | 2014-08-13 | 프라운호퍼-게젤샤프트 추르 푀르데룽 데어 안제반텐 포르슝 에 파우 | Apparatus, method and computer program for generating a wideband signal using guided bandwidth extension and blind bandwidth extension |
US8473287B2 (en) | 2010-04-19 | 2013-06-25 | Audience, Inc. | Method for jointly optimizing noise reduction and voice quality in a mono or multi-microphone system |
US8538035B2 (en) | 2010-04-29 | 2013-09-17 | Audience, Inc. | Multi-microphone robust noise suppression |
US8798290B1 (en) | 2010-04-21 | 2014-08-05 | Audience, Inc. | Systems and methods for adaptive signal equalization |
US8781137B1 (en) | 2010-04-27 | 2014-07-15 | Audience, Inc. | Wind noise detection and suppression |
US9378754B1 (en) | 2010-04-28 | 2016-06-28 | Knowles Electronics, Llc | Adaptive spatial classifier for multi-microphone systems |
US9558755B1 (en) | 2010-05-20 | 2017-01-31 | Knowles Electronics, Llc | Noise suppression assisted automatic speech recognition |
KR101660843B1 (en) * | 2010-05-27 | 2016-09-29 | 삼성전자주식회사 | Apparatus and method for determining weighting function for lpc coefficients quantization |
US8600737B2 (en) | 2010-06-01 | 2013-12-03 | Qualcomm Incorporated | Systems, methods, apparatus, and computer program products for wideband speech coding |
ES2372202B2 (en) * | 2010-06-29 | 2012-08-08 | Universidad De Málaga | LOW CONSUMPTION SOUND RECOGNITION SYSTEM. |
ES2683648T3 (en) | 2010-07-02 | 2018-09-27 | Dolby International Ab | Audio decoding with selective post-filtering |
US8447596B2 (en) | 2010-07-12 | 2013-05-21 | Audience, Inc. | Monaural noise suppression based on computational auditory scene analysis |
JP5589631B2 (en) * | 2010-07-15 | 2014-09-17 | 富士通株式会社 | Voice processing apparatus, voice processing method, and telephone apparatus |
EP2593937B1 (en) | 2010-07-16 | 2015-11-11 | Telefonaktiebolaget LM Ericsson (publ) | Audio encoder and decoder and methods for encoding and decoding an audio signal |
JP5777041B2 (en) * | 2010-07-23 | 2015-09-09 | 沖電気工業株式会社 | Band expansion device and program, and voice communication device |
JP6075743B2 (en) | 2010-08-03 | 2017-02-08 | ソニー株式会社 | Signal processing apparatus and method, and program |
US20130310422A1 (en) | 2010-09-01 | 2013-11-21 | The General Hospital Corporation | Reversal of general anesthesia by administration of methylphenidate, amphetamine, modafinil, amantadine, and/or caffeine |
KR101924326B1 (en) * | 2010-09-16 | 2018-12-03 | 돌비 인터네셔널 에이비 | Cross product enhanced subband block based harmonic transposition |
US8924200B2 (en) | 2010-10-15 | 2014-12-30 | Motorola Mobility Llc | Audio signal bandwidth extension in CELP-based speech coder |
JP5707842B2 (en) | 2010-10-15 | 2015-04-30 | ソニー株式会社 | Encoding apparatus and method, decoding apparatus and method, and program |
WO2012053149A1 (en) * | 2010-10-22 | 2012-04-26 | パナソニック株式会社 | Speech analyzing device, quantization device, inverse quantization device, and method for same |
JP5743137B2 (en) * | 2011-01-14 | 2015-07-01 | ソニー株式会社 | Signal processing apparatus and method, and program |
US9767823B2 (en) | 2011-02-07 | 2017-09-19 | Qualcomm Incorporated | Devices for encoding and detecting a watermarked signal |
US9767822B2 (en) | 2011-02-07 | 2017-09-19 | Qualcomm Incorporated | Devices for encoding and decoding a watermarked signal |
SG192734A1 (en) | 2011-02-14 | 2013-09-30 | Fraunhofer Ges Forschung | Apparatus and method for error concealment in low-delay unified speech and audio coding (usac) |
WO2012110473A1 (en) | 2011-02-14 | 2012-08-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for encoding and decoding an audio signal using an aligned look-ahead portion |
SG192745A1 (en) * | 2011-02-14 | 2013-09-30 | Fraunhofer Ges Forschung | Noise generation in audio codecs |
EP2676267B1 (en) | 2011-02-14 | 2017-07-19 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Encoding and decoding of pulse positions of tracks of an audio signal |
MY159444A (en) | 2011-02-14 | 2017-01-13 | Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E V | Encoding and decoding of pulse positions of tracks of an audio signal |
JP5666021B2 (en) | 2011-02-14 | 2015-02-04 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | Apparatus and method for processing a decoded audio signal in the spectral domain |
WO2012110478A1 (en) | 2011-02-14 | 2012-08-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Information signal representation using lapped transform |
CA2827335C (en) | 2011-02-14 | 2016-08-30 | Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E.V. | Audio codec using noise synthesis during inactive phases |
JP5914527B2 (en) | 2011-02-14 | 2016-05-11 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | Apparatus and method for encoding a portion of an audio signal using transient detection and quality results |
JP5863830B2 (en) | 2011-02-16 | 2016-02-17 | ドルビー ラボラトリーズ ライセンシング コーポレイション | Method for generating filter coefficient and setting filter, encoder and decoder |
HUE058847T2 (en) * | 2011-02-18 | 2022-09-28 | Ntt Docomo Inc | Speech decoder, speech encoder, speech decoding method, speech encoding method, speech decoding program, and speech encoding program |
WO2012122397A1 (en) | 2011-03-09 | 2012-09-13 | Srs Labs, Inc. | System for dynamically creating and rendering audio objects |
JP5704397B2 (en) * | 2011-03-31 | 2015-04-22 | ソニー株式会社 | Encoding apparatus and method, and program |
US10642934B2 (en) | 2011-03-31 | 2020-05-05 | Microsoft Technology Licensing, Llc | Augmented conversational understanding architecture |
US9298287B2 (en) | 2011-03-31 | 2016-03-29 | Microsoft Technology Licensing, Llc | Combined activation for natural user interface systems |
US9760566B2 (en) | 2011-03-31 | 2017-09-12 | Microsoft Technology Licensing, Llc | Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof |
US9244984B2 (en) | 2011-03-31 | 2016-01-26 | Microsoft Technology Licensing, Llc | Location based conversational understanding |
US9842168B2 (en) | 2011-03-31 | 2017-12-12 | Microsoft Technology Licensing, Llc | Task driven user intents |
US9064006B2 (en) | 2012-08-23 | 2015-06-23 | Microsoft Technology Licensing, Llc | Translating natural language utterances to keyword search queries |
CN102811034A (en) | 2011-05-31 | 2012-12-05 | 财团法人工业技术研究院 | Signal processing device and signal processing method |
EP2709103B1 (en) * | 2011-06-09 | 2015-10-07 | Panasonic Intellectual Property Corporation of America | Voice coding device, voice decoding device, voice coding method and voice decoding method |
US9070361B2 (en) * | 2011-06-10 | 2015-06-30 | Google Technology Holdings LLC | Method and apparatus for encoding a wideband speech signal utilizing downmixing of a highband component |
MX370012B (en) | 2011-06-30 | 2019-11-28 | Samsung Electronics Co Ltd | Apparatus and method for generating bandwidth extension signal. |
US9059786B2 (en) * | 2011-07-07 | 2015-06-16 | Vecima Networks Inc. | Ingress suppression for communication systems |
JP5942358B2 (en) | 2011-08-24 | 2016-06-29 | ソニー株式会社 | Encoding apparatus and method, decoding apparatus and method, and program |
RU2486636C1 (en) * | 2011-11-14 | 2013-06-27 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method of generating high-frequency signals and apparatus for realising said method |
RU2486637C1 (en) * | 2011-11-15 | 2013-06-27 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method for generation and frequency-modulation of high-frequency signals and apparatus for realising said method |
RU2486638C1 (en) * | 2011-11-15 | 2013-06-27 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method of generating high-frequency signals and apparatus for realising said method |
RU2496222C2 (en) * | 2011-11-17 | 2013-10-20 | Федеральное государственное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method for generation and frequency-modulation of high-frequency signals and apparatus for realising said method |
RU2486639C1 (en) * | 2011-11-21 | 2013-06-27 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method for generation and frequency-modulation of high-frequency signals and apparatus for realising said method |
RU2496192C2 (en) * | 2011-11-21 | 2013-10-20 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method for generation and frequency-modulation of high-frequency signals and apparatus for realising said method |
RU2490727C2 (en) * | 2011-11-28 | 2013-08-20 | Федеральное государственное бюджетное образовательное учреждение высшего профессионального образования "Уральский государственный университет путей сообщения" (УрГУПС) | Method of transmitting speech signals (versions) |
RU2487443C1 (en) * | 2011-11-29 | 2013-07-10 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method of matching complex impedances and apparatus for realising said method |
JP5817499B2 (en) * | 2011-12-15 | 2015-11-18 | 富士通株式会社 | Decoding device, encoding device, encoding / decoding system, decoding method, encoding method, decoding program, and encoding program |
US9972325B2 (en) * | 2012-02-17 | 2018-05-15 | Huawei Technologies Co., Ltd. | System and method for mixed codebook excitation for speech coding |
US9082398B2 (en) * | 2012-02-28 | 2015-07-14 | Huawei Technologies Co., Ltd. | System and method for post excitation enhancement for low bit rate speech coding |
US9437213B2 (en) * | 2012-03-05 | 2016-09-06 | Malaspina Labs (Barbados) Inc. | Voice signal enhancement |
EP3611728A1 (en) | 2012-03-21 | 2020-02-19 | Samsung Electronics Co., Ltd. | Method and apparatus for high-frequency encoding/decoding for bandwidth extension |
TR201911121T4 (en) | 2012-03-29 | 2019-08-21 | Ericsson Telefon Ab L M | Vector quantizer. |
US10448161B2 (en) | 2012-04-02 | 2019-10-15 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for gestural manipulation of a sound field |
JP5998603B2 (en) * | 2012-04-18 | 2016-09-28 | ソニー株式会社 | Sound detection device, sound detection method, sound feature amount detection device, sound feature amount detection method, sound interval detection device, sound interval detection method, and program |
KR101343768B1 (en) * | 2012-04-19 | 2014-01-16 | 충북대학교 산학협력단 | Method for speech and audio signal classification using Spectral flux pattern |
RU2504898C1 (en) * | 2012-05-17 | 2014-01-20 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method of demodulating phase-modulated and frequency-modulated signals and apparatus for realising said method |
RU2504894C1 (en) * | 2012-05-17 | 2014-01-20 | Федеральное государственное военное образовательное учреждение высшего профессионального образования "Военный авиационный инженерный университет" (г. Воронеж) Министерства обороны Российской Федерации | Method of demodulating phase-modulated and frequency-modulated signals and apparatus for realising said method |
US20140006017A1 (en) * | 2012-06-29 | 2014-01-02 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for generating obfuscated speech signal |
US9472208B2 (en) * | 2012-08-31 | 2016-10-18 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and device for voice activity detection |
US9460729B2 (en) | 2012-09-21 | 2016-10-04 | Dolby Laboratories Licensing Corporation | Layered approach to spatial audio coding |
WO2014062859A1 (en) * | 2012-10-16 | 2014-04-24 | Audiologicall, Ltd. | Audio signal manipulation for speech enhancement before sound reproduction |
KR101413969B1 (en) | 2012-12-20 | 2014-07-08 | 삼성전자주식회사 | Method and apparatus for decoding audio signal |
CN105551497B (en) | 2013-01-15 | 2019-03-19 | 华为技术有限公司 | Coding method, coding/decoding method, encoding apparatus and decoding apparatus |
EP2951822B1 (en) * | 2013-01-29 | 2019-11-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder, audio decoder, method for providing an encoded audio information, method for providing a decoded audio information, computer program and encoded representation using a signal-adaptive bandwidth extension |
EP2951819B1 (en) * | 2013-01-29 | 2017-03-01 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus, method and computer medium for synthesizing an audio signal |
US9728200B2 (en) | 2013-01-29 | 2017-08-08 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for adaptive formant sharpening in linear prediction coding |
CN103971693B (en) | 2013-01-29 | 2017-02-22 | 华为技术有限公司 | Forecasting method for high-frequency band signal, encoding device and decoding device |
US20140213909A1 (en) * | 2013-01-31 | 2014-07-31 | Xerox Corporation | Control-based inversion for estimating a biological parameter vector for a biophysics model from diffused reflectance data |
US9711156B2 (en) | 2013-02-08 | 2017-07-18 | Qualcomm Incorporated | Systems and methods of performing filtering for gain determination |
US9741350B2 (en) * | 2013-02-08 | 2017-08-22 | Qualcomm Incorporated | Systems and methods of performing gain control |
US9601125B2 (en) | 2013-02-08 | 2017-03-21 | Qualcomm Incorporated | Systems and methods of performing noise modulation and gain adjustment |
US9336789B2 (en) * | 2013-02-21 | 2016-05-10 | Qualcomm Incorporated | Systems and methods for determining an interpolation factor set for synthesizing a speech signal |
US9715885B2 (en) * | 2013-03-05 | 2017-07-25 | Nec Corporation | Signal processing apparatus, signal processing method, and signal processing program |
EP2784775B1 (en) * | 2013-03-27 | 2016-09-14 | Binauric SE | Speech signal encoding/decoding method and apparatus |
SG11201507703SA (en) * | 2013-04-05 | 2015-10-29 | Dolby Int Ab | Audio encoder and decoder |
BR112015025022B1 (en) * | 2013-04-05 | 2022-03-29 | Dolby International Ab | Decoding method, decoder in an audio processing system, encoding method, and encoder in an audio processing system |
CN105264600B (en) | 2013-04-05 | 2019-06-07 | Dts有限责任公司 | Hierarchical audio coding and transmission |
MX358362B (en) * | 2013-06-21 | 2018-08-15 | Fraunhofer Ges Forschung | Audio decoder having a bandwidth extension module with an energy adjusting module. |
ES2746322T3 (en) * | 2013-06-21 | 2020-03-05 | Fraunhofer Ges Forschung | Tone delay estimation |
FR3007563A1 (en) * | 2013-06-25 | 2014-12-26 | France Telecom | ENHANCED FREQUENCY BAND EXTENSION IN AUDIO FREQUENCY SIGNAL DECODER |
US10314503B2 (en) | 2013-06-27 | 2019-06-11 | The General Hospital Corporation | Systems and methods for tracking non-stationary spectral structure and dynamics in physiological data |
US10383574B2 (en) | 2013-06-28 | 2019-08-20 | The General Hospital Corporation | Systems and methods to infer brain state during burst suppression |
CN104282308B (en) * | 2013-07-04 | 2017-07-14 | 华为技术有限公司 | The vector quantization method and device of spectral envelope |
FR3008533A1 (en) * | 2013-07-12 | 2015-01-16 | Orange | OPTIMIZED SCALE FACTOR FOR FREQUENCY BAND EXTENSION IN AUDIO FREQUENCY SIGNAL DECODER |
EP2830064A1 (en) | 2013-07-22 | 2015-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for decoding and encoding an audio signal using adaptive spectral tile selection |
CN105493182B (en) * | 2013-08-28 | 2020-01-21 | 杜比实验室特许公司 | Hybrid waveform coding and parametric coding speech enhancement |
TWI557726B (en) * | 2013-08-29 | 2016-11-11 | 杜比國際公司 | System and method for determining a master scale factor band table for a highband signal of an audio signal |
JP6586093B2 (en) | 2013-09-13 | 2019-10-02 | ザ ジェネラル ホスピタル コーポレイション | System for improved brain monitoring during general anesthesia and sedation |
CN105531762B (en) | 2013-09-19 | 2019-10-01 | 索尼公司 | Code device and method, decoding apparatus and method and program |
CN104517610B (en) * | 2013-09-26 | 2018-03-06 | 华为技术有限公司 | The method and device of bandspreading |
CN104517611B (en) * | 2013-09-26 | 2016-05-25 | 华为技术有限公司 | A kind of high-frequency excitation signal Forecasting Methodology and device |
US9224402B2 (en) | 2013-09-30 | 2015-12-29 | International Business Machines Corporation | Wideband speech parameterization for high quality synthesis, transformation and quantization |
US9620134B2 (en) * | 2013-10-10 | 2017-04-11 | Qualcomm Incorporated | Gain shape estimation for improved tracking of high-band temporal characteristics |
US10083708B2 (en) * | 2013-10-11 | 2018-09-25 | Qualcomm Incorporated | Estimation of mixing factors to generate high-band excitation signal |
US9384746B2 (en) * | 2013-10-14 | 2016-07-05 | Qualcomm Incorporated | Systems and methods of energy-scaled signal processing |
KR102271852B1 (en) | 2013-11-02 | 2021-07-01 | 삼성전자주식회사 | Method and apparatus for generating wideband signal and device employing the same |
EP2871641A1 (en) * | 2013-11-12 | 2015-05-13 | Dialog Semiconductor B.V. | Enhancement of narrowband audio signals using a single sideband AM modulation |
JP6345780B2 (en) | 2013-11-22 | 2018-06-20 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | Selective phase compensation in highband coding. |
US10163447B2 (en) * | 2013-12-16 | 2018-12-25 | Qualcomm Incorporated | High-band signal modeling |
CN103714822B (en) * | 2013-12-27 | 2017-01-11 | 广州华多网络科技有限公司 | Sub-band coding and decoding method and device based on SILK coder decoder |
KR102356012B1 (en) | 2013-12-27 | 2022-01-27 | 소니그룹주식회사 | Decoding device, method, and program |
FR3017484A1 (en) * | 2014-02-07 | 2015-08-14 | Orange | ENHANCED FREQUENCY BAND EXTENSION IN AUDIO FREQUENCY SIGNAL DECODER |
US9564141B2 (en) | 2014-02-13 | 2017-02-07 | Qualcomm Incorporated | Harmonic bandwidth extension of audio signals |
JP6281336B2 (en) * | 2014-03-12 | 2018-02-21 | 沖電気工業株式会社 | Speech decoding apparatus and program |
JP6035270B2 (en) * | 2014-03-24 | 2016-11-30 | 株式会社Nttドコモ | Speech decoding apparatus, speech encoding apparatus, speech decoding method, speech encoding method, speech decoding program, and speech encoding program |
US9542955B2 (en) * | 2014-03-31 | 2017-01-10 | Qualcomm Incorporated | High-band signal coding using multiple sub-bands |
RU2689181C2 (en) * | 2014-03-31 | 2019-05-24 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Encoder, decoder, encoding method, decoding method and program |
US9697843B2 (en) * | 2014-04-30 | 2017-07-04 | Qualcomm Incorporated | High band excitation signal generation |
CN105336336B (en) * | 2014-06-12 | 2016-12-28 | 华为技术有限公司 | The temporal envelope processing method and processing device of a kind of audio signal, encoder |
CN105336338B (en) | 2014-06-24 | 2017-04-12 | 华为技术有限公司 | Audio coding method and apparatus |
US9984699B2 (en) | 2014-06-26 | 2018-05-29 | Qualcomm Incorporated | High-band signal coding using mismatched frequency ranges |
US9626983B2 (en) * | 2014-06-26 | 2017-04-18 | Qualcomm Incorporated | Temporal gain adjustment based on high-band signal characteristic |
CN105225670B (en) * | 2014-06-27 | 2016-12-28 | 华为技术有限公司 | A kind of audio coding method and device |
US9721584B2 (en) * | 2014-07-14 | 2017-08-01 | Intel IP Corporation | Wind noise reduction for audio reception |
EP2980795A1 (en) | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoding and decoding using a frequency domain processor, a time domain processor and a cross processor for initialization of the time domain processor |
EP2980798A1 (en) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Harmonicity-dependent controlling of a harmonic filter tool |
EP2980792A1 (en) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating an enhanced signal using independent noise-filling |
EP2980794A1 (en) | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder and decoder using a frequency domain processor and a time domain processor |
US10304474B2 (en) * | 2014-08-15 | 2019-05-28 | Samsung Electronics Co., Ltd. | Sound quality improving method and device, sound decoding method and device, and multimedia device employing same |
CN104217730B (en) * | 2014-08-18 | 2017-07-21 | 大连理工大学 | A kind of artificial speech bandwidth expanding method and device based on K SVD |
US9978388B2 (en) | 2014-09-12 | 2018-05-22 | Knowles Electronics, Llc | Systems and methods for restoration of speech components |
TWI550945B (en) * | 2014-12-22 | 2016-09-21 | 國立彰化師範大學 | Method of designing composite filters with sharp transition bands and cascaded composite filters |
US9595269B2 (en) * | 2015-01-19 | 2017-03-14 | Qualcomm Incorporated | Scaling for gain shape circuitry |
CN107210824A (en) | 2015-01-30 | 2017-09-26 | 美商楼氏电子有限公司 | The environment changing of microphone |
RU2679254C1 (en) * | 2015-02-26 | 2019-02-06 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Device and method for audio signal processing to obtain a processed audio signal using a target envelope in a temporal area |
US10847170B2 (en) * | 2015-06-18 | 2020-11-24 | Qualcomm Incorporated | Device and method for generating a high-band signal from non-linearly processed sub-ranges |
US9837089B2 (en) * | 2015-06-18 | 2017-12-05 | Qualcomm Incorporated | High-band signal generation |
US9407989B1 (en) | 2015-06-30 | 2016-08-02 | Arthur Woodrow | Closed audio circuit |
US9830921B2 (en) * | 2015-08-17 | 2017-11-28 | Qualcomm Incorporated | High-band target signal control |
CN107924683B (en) * | 2015-10-15 | 2021-03-30 | 华为技术有限公司 | Sinusoidal coding and decoding method and device |
NO339664B1 (en) | 2015-10-15 | 2017-01-23 | St Tech As | A system for isolating an object |
EP3417544B1 (en) | 2016-02-17 | 2019-12-04 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Post-processor, pre-processor, audio encoder, audio decoder and related methods for enhancing transient processing |
FR3049084B1 (en) * | 2016-03-15 | 2022-11-11 | Fraunhofer Ges Forschung | CODING DEVICE FOR PROCESSING AN INPUT SIGNAL AND DECODING DEVICE FOR PROCESSING A CODED SIGNAL |
WO2017178329A1 (en) * | 2016-04-12 | 2017-10-19 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder for encoding an audio signal, method for encoding an audio signal and computer program under consideration of a detected peak spectral region in an upper frequency band |
CN109416913B (en) * | 2016-05-10 | 2024-03-15 | 易默森服务有限责任公司 | Adaptive audio coding and decoding system, method, device and medium |
US10770088B2 (en) * | 2016-05-10 | 2020-09-08 | Immersion Networks, Inc. | Adaptive audio decoder system, method and article |
US10699725B2 (en) * | 2016-05-10 | 2020-06-30 | Immersion Networks, Inc. | Adaptive audio encoder system, method and article |
US10756755B2 (en) * | 2016-05-10 | 2020-08-25 | Immersion Networks, Inc. | Adaptive audio codec system, method and article |
US20170330575A1 (en) * | 2016-05-10 | 2017-11-16 | Immersion Services LLC | Adaptive audio codec system, method and article |
US10264116B2 (en) * | 2016-11-02 | 2019-04-16 | Nokia Technologies Oy | Virtual duplex operation |
KR102507383B1 (en) * | 2016-11-08 | 2023-03-08 | 한국전자통신연구원 | Method and system for stereo matching by using rectangular window |
US10786168B2 (en) | 2016-11-29 | 2020-09-29 | The General Hospital Corporation | Systems and methods for analyzing electrophysiological data from patients undergoing medical treatments |
ES2784449T3 (en) * | 2017-01-06 | 2020-09-25 | Ericsson Telefon Ab L M | Methods and apparatus for signaling and determining displacements of reference signals |
KR20180092582A (en) * | 2017-02-10 | 2018-08-20 | 삼성전자주식회사 | WFST decoding system, speech recognition system including the same and Method for stroing WFST data |
US10553222B2 (en) * | 2017-03-09 | 2020-02-04 | Qualcomm Incorporated | Inter-channel bandwidth extension spectral mapping and adjustment |
US10304468B2 (en) * | 2017-03-20 | 2019-05-28 | Qualcomm Incorporated | Target sample generation |
TW202341126A (en) * | 2017-03-23 | 2023-10-16 | 瑞典商都比國際公司 | Backward-compatible integration of harmonic transposer for high frequency reconstruction of audio signals |
US10825467B2 (en) * | 2017-04-21 | 2020-11-03 | Qualcomm Incorporated | Non-harmonic speech detection and bandwidth extension in a multi-source environment |
US20190051286A1 (en) * | 2017-08-14 | 2019-02-14 | Microsoft Technology Licensing, Llc | Normalization of high band signals in network telephony communications |
US11876659B2 (en) | 2017-10-27 | 2024-01-16 | Terawave, Llc | Communication system using shape-shifted sinusoidal waveforms |
WO2019084565A1 (en) * | 2017-10-27 | 2019-05-02 | Terawave, Llc | Receiver for high spectral efficiency data communications system using encoded sinusoidal waveforms |
CN109729553B (en) * | 2017-10-30 | 2021-12-28 | 成都鼎桥通信技术有限公司 | Voice service processing method and device of LTE (Long term evolution) trunking communication system |
EP3483879A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Analysis/synthesis windowing function for modulated lapped transformation |
EP3483886A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Selecting pitch lag |
EP3483883A1 (en) * | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio coding and decoding with selective postfiltering |
EP3483880A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Temporal noise shaping |
EP3483878A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder supporting a set of different loss concealment tools |
EP3483884A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Signal filtering |
WO2019091576A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits |
EP3483882A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Controlling bandwidth in encoders and/or decoders |
WO2019091573A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for encoding and decoding an audio signal using downsampling or interpolation of scale parameters |
US10460749B1 (en) * | 2018-06-28 | 2019-10-29 | Nuvoton Technology Corporation | Voice activity detection using vocal tract area information |
US10957331B2 (en) | 2018-12-17 | 2021-03-23 | Microsoft Technology Licensing, Llc | Phase reconstruction in a speech decoder |
US10847172B2 (en) * | 2018-12-17 | 2020-11-24 | Microsoft Technology Licensing, Llc | Phase quantization in a speech encoder |
WO2020171034A1 (en) * | 2019-02-20 | 2020-08-27 | ヤマハ株式会社 | Sound signal generation method, generative model training method, sound signal generation system, and program |
CN110610713B (en) * | 2019-08-28 | 2021-11-16 | 南京梧桐微电子科技有限公司 | Vocoder residue spectrum amplitude parameter reconstruction method and system |
US11380343B2 (en) | 2019-09-12 | 2022-07-05 | Immersion Networks, Inc. | Systems and methods for processing high frequency audio signal |
TWI723545B (en) * | 2019-09-17 | 2021-04-01 | 宏碁股份有限公司 | Speech processing method and device thereof |
US11295751B2 (en) * | 2019-09-20 | 2022-04-05 | Tencent America LLC | Multi-band synchronized neural vocoder |
KR102201169B1 (en) * | 2019-10-23 | 2021-01-11 | 성균관대학교 산학협력단 | Method for generating time code and space-time code for controlling reflection coefficient of meta surface, recording medium storing program for executing the same, and method for signal modulation using meta surface |
CN114548442B (en) * | 2022-02-25 | 2022-10-21 | 万表名匠(广州)科技有限公司 | Wristwatch maintenance management system based on internet technology |
Family Cites Families (148)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US596689A (en) * | 1898-01-04 | Hose holder or support | ||
US525147A (en) * | 1894-08-28 | Steam-cooker | ||
US526468A (en) * | 1894-09-25 | Charles d | ||
US321993A (en) * | 1885-07-14 | Lantern | ||
US1126620A (en) * | 1911-01-30 | 1915-01-26 | Safety Car Heating & Lighting | Electric regulation. |
US1089258A (en) * | 1914-01-13 | 1914-03-03 | James Arnot Paterson | Facing or milling machine. |
US1300833A (en) * | 1918-12-12 | 1919-04-15 | Moline Mill Mfg Company | Idler-pulley structure. |
US1498873A (en) * | 1924-04-19 | 1924-06-24 | Bethlehem Steel Corp | Switch stand |
US2073913A (en) * | 1934-06-26 | 1937-03-16 | Wigan Edmund Ramsay | Means for gauging minute displacements |
US2086867A (en) * | 1936-06-19 | 1937-07-13 | Hall Lab Inc | Laundering composition and process |
US3044777A (en) * | 1959-10-19 | 1962-07-17 | Fibermold Corp | Bowling pin |
US3158693A (en) * | 1962-08-07 | 1964-11-24 | Bell Telephone Labor Inc | Speech interpolation communication system |
US3855416A (en) | 1972-12-01 | 1974-12-17 | F Fuller | Method and apparatus for phonation analysis leading to valid truth/lie decisions by fundamental speech-energy weighted vibratto component assessment |
US3855414A (en) | 1973-04-24 | 1974-12-17 | Anaconda Co | Cable armor clamp |
JPS59139099A (en) | 1983-01-31 | 1984-08-09 | 株式会社東芝 | Voice section detector |
US4616659A (en) * | 1985-05-06 | 1986-10-14 | At&T Bell Laboratories | Heart rate detection utilizing autoregressive analysis |
US4630305A (en) | 1985-07-01 | 1986-12-16 | Motorola, Inc. | Automatic gain selector for a noise suppression system |
US4747143A (en) * | 1985-07-12 | 1988-05-24 | Westinghouse Electric Corp. | Speech enhancement system having dynamic gain control |
NL8503152A (en) * | 1985-11-15 | 1987-06-01 | Optische Ind De Oude Delft Nv | DOSEMETER FOR IONIZING RADIATION. |
US4862168A (en) * | 1987-03-19 | 1989-08-29 | Beard Terry D | Audio digital/analog encoding and decoding |
US4805193A (en) * | 1987-06-04 | 1989-02-14 | Motorola, Inc. | Protection of energy information in sub-band coding |
US4852179A (en) | 1987-10-05 | 1989-07-25 | Motorola, Inc. | Variable frame rate, fixed bit rate vocoding method |
JP2707564B2 (en) * | 1987-12-14 | 1998-01-28 | 株式会社日立製作所 | Audio coding method |
US5285520A (en) * | 1988-03-02 | 1994-02-08 | Kokusai Denshin Denwa Kabushiki Kaisha | Predictive coding apparatus |
CA1321645C (en) | 1988-09-28 | 1993-08-24 | Akira Ichikawa | Method and system for voice coding based on vector quantization |
US5086475A (en) * | 1988-11-19 | 1992-02-04 | Sony Corporation | Apparatus for generating, recording or reproducing sound source data |
JPH02244100A (en) | 1989-03-16 | 1990-09-28 | Ricoh Co Ltd | Noise sound source signal forming device |
JPH05502539A (en) | 1990-09-19 | 1993-04-28 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Record carrier on which the main data file and control file are recorded, its recording method and device, and its reading device |
JP2779886B2 (en) | 1992-10-05 | 1998-07-23 | 日本電信電話株式会社 | Wideband audio signal restoration method |
JP3191457B2 (en) * | 1992-10-31 | 2001-07-23 | ソニー株式会社 | High efficiency coding apparatus, noise spectrum changing apparatus and method |
US5455888A (en) | 1992-12-04 | 1995-10-03 | Northern Telecom Limited | Speech bandwidth extension method and apparatus |
CN1099777C (en) | 1993-06-30 | 2003-01-22 | 索尼公司 | Digital signal encoding device, its decoding device, and its recording medium |
WO1995010760A2 (en) * | 1993-10-08 | 1995-04-20 | Comsat Corporation | Improved low bit rate vocoders and methods of operation therefor |
US5684920A (en) * | 1994-03-17 | 1997-11-04 | Nippon Telegraph And Telephone | Acoustic signal transform coding method and decoding method having a high efficiency envelope flattening method therein |
US5487087A (en) | 1994-05-17 | 1996-01-23 | Texas Instruments Incorporated | Signal quantizer with reduced output fluctuation |
US5797118A (en) | 1994-08-09 | 1998-08-18 | Yamaha Corporation | Learning vector quantization and a temporary memory such that the codebook contents are renewed when a first speaker returns |
JP2770137B2 (en) | 1994-09-22 | 1998-06-25 | 日本プレシジョン・サーキッツ株式会社 | Waveform data compression device |
US5699477A (en) | 1994-11-09 | 1997-12-16 | Texas Instruments Incorporated | Mixed excitation linear prediction with fractional pitch |
FI97182C (en) * | 1994-12-05 | 1996-10-25 | Nokia Telecommunications Oy | Procedure for replacing received bad speech frames in a digital receiver and receiver for a digital telecommunication system |
JP3365113B2 (en) * | 1994-12-22 | 2003-01-08 | ソニー株式会社 | Audio level control device |
EP0732687B2 (en) | 1995-03-13 | 2005-10-12 | Matsushita Electric Industrial Co., Ltd. | Apparatus for expanding speech bandwidth |
JP2798003B2 (en) | 1995-05-09 | 1998-09-17 | 松下電器産業株式会社 | Voice band expansion device and voice band expansion method |
JP2956548B2 (en) | 1995-10-05 | 1999-10-04 | 松下電器産業株式会社 | Voice band expansion device |
JP3189614B2 (en) * | 1995-03-13 | 2001-07-16 | 松下電器産業株式会社 | Voice band expansion device |
US6263307B1 (en) | 1995-04-19 | 2001-07-17 | Texas Instruments Incorporated | Adaptive weiner filtering using line spectral frequencies |
US5706395A (en) | 1995-04-19 | 1998-01-06 | Texas Instruments Incorporated | Adaptive weiner filtering using a dynamic suppression factor |
JP3334419B2 (en) | 1995-04-20 | 2002-10-15 | ソニー株式会社 | Noise reduction method and noise reduction device |
US5699485A (en) * | 1995-06-07 | 1997-12-16 | Lucent Technologies Inc. | Pitch delay modification during frame erasures |
US5704003A (en) | 1995-09-19 | 1997-12-30 | Lucent Technologies Inc. | RCELP coder |
US6097824A (en) | 1997-06-06 | 2000-08-01 | Audiologic, Incorporated | Continuous frequency dynamic range audio compressor |
EP0768569B1 (en) * | 1995-10-16 | 2003-04-02 | Agfa-Gevaert | New class of yellow dyes for use in photographic materials |
JP3707116B2 (en) | 1995-10-26 | 2005-10-19 | ソニー株式会社 | Speech decoding method and apparatus |
US5737716A (en) * | 1995-12-26 | 1998-04-07 | Motorola | Method and apparatus for encoding speech using neural network technology for speech classification |
JP3073919B2 (en) * | 1995-12-30 | 2000-08-07 | 松下電器産業株式会社 | Synchronizer |
US5689615A (en) * | 1996-01-22 | 1997-11-18 | Rockwell International Corporation | Usage of voice activity detection for efficient coding of speech |
TW307960B (en) | 1996-02-15 | 1997-06-11 | Philips Electronics Nv | Reduced complexity signal transmission system |
EP0814458B1 (en) * | 1996-06-19 | 2004-09-22 | Texas Instruments Incorporated | Improvements in or relating to speech coding |
JP3246715B2 (en) * | 1996-07-01 | 2002-01-15 | 松下電器産業株式会社 | Audio signal compression method and audio signal compression device |
EP1071078B1 (en) | 1996-11-07 | 2002-02-13 | Matsushita Electric Industrial Co., Ltd. | Vector quantization codebook generation method and apparatus |
US6009395A (en) | 1997-01-02 | 1999-12-28 | Texas Instruments Incorporated | Synthesizer and method using scaled excitation signal |
US6202046B1 (en) * | 1997-01-23 | 2001-03-13 | Kabushiki Kaisha Toshiba | Background noise/speech classification method |
US5890126A (en) | 1997-03-10 | 1999-03-30 | Euphonics, Incorporated | Audio data decompression and interpolation apparatus and method |
US6041297A (en) | 1997-03-10 | 2000-03-21 | At&T Corp | Vocoder for coding speech by using a correlation between spectral magnitudes and candidate excitations |
EP0878790A1 (en) * | 1997-05-15 | 1998-11-18 | Hewlett-Packard Company | Voice coding system and method |
SE512719C2 (en) * | 1997-06-10 | 2000-05-02 | Lars Gustaf Liljeryd | A method and apparatus for reducing data flow based on harmonic bandwidth expansion |
US6889185B1 (en) | 1997-08-28 | 2005-05-03 | Texas Instruments Incorporated | Quantization of linear prediction coefficients using perceptual weighting |
US6029125A (en) | 1997-09-02 | 2000-02-22 | Telefonaktiebolaget L M Ericsson, (Publ) | Reducing sparseness in coded speech signals |
US6122384A (en) * | 1997-09-02 | 2000-09-19 | Qualcomm Inc. | Noise suppression system and method |
US6231516B1 (en) * | 1997-10-14 | 2001-05-15 | Vacusense, Inc. | Endoluminal implant with therapeutic and diagnostic capability |
JPH11205166A (en) | 1998-01-19 | 1999-07-30 | Mitsubishi Electric Corp | Noise detector |
US6301556B1 (en) | 1998-03-04 | 2001-10-09 | Telefonaktiebolaget L M. Ericsson (Publ) | Reducing sparseness in coded speech signals |
US6449590B1 (en) | 1998-08-24 | 2002-09-10 | Conexant Systems, Inc. | Speech encoder using warping in long term preprocessing |
US6385573B1 (en) | 1998-08-24 | 2002-05-07 | Conexant Systems, Inc. | Adaptive tilt compensation for synthesized speech residual |
JP4170458B2 (en) | 1998-08-27 | 2008-10-22 | ローランド株式会社 | Time-axis compression / expansion device for waveform signals |
US6353808B1 (en) * | 1998-10-22 | 2002-03-05 | Sony Corporation | Apparatus and method for encoding a signal as well as apparatus and method for decoding a signal |
KR20000047944A (en) | 1998-12-11 | 2000-07-25 | 이데이 노부유끼 | Receiving apparatus and method, and communicating apparatus and method |
JP4354561B2 (en) | 1999-01-08 | 2009-10-28 | パナソニック株式会社 | Audio signal encoding apparatus and decoding apparatus |
US6223151B1 (en) | 1999-02-10 | 2001-04-24 | Telefon Aktie Bolaget Lm Ericsson | Method and apparatus for pre-processing speech signals prior to coding by transform-based speech coders |
DE60024963T2 (en) | 1999-05-14 | 2006-09-28 | Matsushita Electric Industrial Co., Ltd., Kadoma | METHOD AND DEVICE FOR BAND EXPANSION OF AN AUDIO SIGNAL |
US6604070B1 (en) * | 1999-09-22 | 2003-08-05 | Conexant Systems, Inc. | System of encoding and decoding speech signals |
JP4792613B2 (en) * | 1999-09-29 | 2011-10-12 | ソニー株式会社 | Information processing apparatus and method, and recording medium |
US6556950B1 (en) | 1999-09-30 | 2003-04-29 | Rockwell Automation Technologies, Inc. | Diagnostic method and apparatus for use with enterprise control |
US6715125B1 (en) | 1999-10-18 | 2004-03-30 | Agere Systems Inc. | Source coding and transmission with time diversity |
WO2001037263A1 (en) | 1999-11-16 | 2001-05-25 | Koninklijke Philips Electronics N.V. | Wideband audio transmission system |
CA2290037A1 (en) | 1999-11-18 | 2001-05-18 | Voiceage Corporation | Gain-smoothing amplifier device and method in codecs for wideband speech and audio signals |
US7260523B2 (en) * | 1999-12-21 | 2007-08-21 | Texas Instruments Incorporated | Sub-band speech coding system |
CN1187735C (en) * | 2000-01-11 | 2005-02-02 | 松下电器产业株式会社 | Multi-mode voice encoding device and decoding device |
US6757395B1 (en) | 2000-01-12 | 2004-06-29 | Sonic Innovations, Inc. | Noise reduction apparatus and method |
US6704711B2 (en) | 2000-01-28 | 2004-03-09 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for modifying speech signals |
US6732070B1 (en) * | 2000-02-16 | 2004-05-04 | Nokia Mobile Phones, Ltd. | Wideband speech codec using a higher sampling rate in analysis and synthesis filtering than in excitation searching |
JP3681105B2 (en) | 2000-02-24 | 2005-08-10 | アルパイン株式会社 | Data processing method |
FI119576B (en) * | 2000-03-07 | 2008-12-31 | Nokia Corp | Speech processing device and procedure for speech processing, as well as a digital radio telephone |
US6523003B1 (en) | 2000-03-28 | 2003-02-18 | Tellabs Operations, Inc. | Spectrally interdependent gain adjustment techniques |
US6757654B1 (en) | 2000-05-11 | 2004-06-29 | Telefonaktiebolaget Lm Ericsson | Forward error correction in speech coding |
US7136810B2 (en) | 2000-05-22 | 2006-11-14 | Texas Instruments Incorporated | Wideband speech coding system and method |
US7330814B2 (en) | 2000-05-22 | 2008-02-12 | Texas Instruments Incorporated | Wideband speech coding with modulated noise highband excitation system and method |
EP1158495B1 (en) | 2000-05-22 | 2004-04-28 | Texas Instruments Incorporated | Wideband speech coding system and method |
JP2002055699A (en) | 2000-08-10 | 2002-02-20 | Mitsubishi Electric Corp | Device and method for encoding voice |
IL149260A0 (en) * | 2000-08-25 | 2002-11-10 | Koninkl Philips Electronics Nv | Method and apparatus for reducing the word length of a digital input signal and method and apparatus for recovering the digital input signal |
US6515889B1 (en) * | 2000-08-31 | 2003-02-04 | Micron Technology, Inc. | Junction-isolated depletion mode ferroelectric memory |
US7386444B2 (en) | 2000-09-22 | 2008-06-10 | Texas Instruments Incorporated | Hybrid speech coding and system |
US6947888B1 (en) | 2000-10-17 | 2005-09-20 | Qualcomm Incorporated | Method and apparatus for high performance low bit-rate coding of unvoiced speech |
JP2002202799A (en) * | 2000-10-30 | 2002-07-19 | Fujitsu Ltd | Voice code conversion apparatus |
JP3558031B2 (en) * | 2000-11-06 | 2004-08-25 | 日本電気株式会社 | Speech decoding device |
EP1336175A1 (en) * | 2000-11-09 | 2003-08-20 | Koninklijke Philips Electronics N.V. | Wideband extension of telephone speech for higher perceptual quality |
SE0004163D0 (en) | 2000-11-14 | 2000-11-14 | Coding Technologies Sweden Ab | Enhancing perceptual performance or high frequency reconstruction coding methods by adaptive filtering |
SE0004187D0 (en) | 2000-11-15 | 2000-11-15 | Coding Technologies Sweden Ab | Enhancing the performance of coding systems that use high frequency reconstruction methods |
DE60137359D1 (en) | 2000-11-30 | 2009-02-26 | Nippon Telegraph & Telephone | VECTOR QUANTIZATION DEVICE FOR LPC PARAMETERS |
GB0031461D0 (en) | 2000-12-22 | 2001-02-07 | Thales Defence Ltd | Communication sets |
US20040204935A1 (en) | 2001-02-21 | 2004-10-14 | Krishnasamy Anandakumar | Adaptive voice playout in VOP |
JP2002268698A (en) | 2001-03-08 | 2002-09-20 | Nec Corp | Voice recognition device, device and method for standard pattern generation, and program |
US20030028386A1 (en) | 2001-04-02 | 2003-02-06 | Zinser Richard L. | Compressed domain universal transcoder |
SE522553C2 (en) * | 2001-04-23 | 2004-02-17 | Ericsson Telefon Ab L M | Bandwidth extension of acoustic signals |
WO2002093561A1 (en) | 2001-05-11 | 2002-11-21 | Siemens Aktiengesellschaft | Method for enlarging the band width of a narrow-band filtered voice signal, especially a voice signal emitted by a telecommunication appliance |
US7174135B2 (en) | 2001-06-28 | 2007-02-06 | Koninklijke Philips Electronics N. V. | Wideband signal transmission system |
US6879955B2 (en) | 2001-06-29 | 2005-04-12 | Microsoft Corporation | Signal modification based on continuous time warping for low bit rate CELP coding |
JP2003036097A (en) | 2001-07-25 | 2003-02-07 | Sony Corp | Device and method for detecting and retrieving information |
TW525147B (en) | 2001-09-28 | 2003-03-21 | Inventec Besta Co Ltd | Method of obtaining and decoding basic cycle of voice |
US6895375B2 (en) | 2001-10-04 | 2005-05-17 | At&T Corp. | System for bandwidth extension of Narrow-band speech |
US6988066B2 (en) | 2001-10-04 | 2006-01-17 | At&T Corp. | Method of bandwidth extension for narrow-band speech |
TW526468B (en) | 2001-10-19 | 2003-04-01 | Chunghwa Telecom Co Ltd | System and method for eliminating background noise of voice signal |
JP4245288B2 (en) | 2001-11-13 | 2009-03-25 | パナソニック株式会社 | Speech coding apparatus and speech decoding apparatus |
CN1282156C (en) * | 2001-11-23 | 2006-10-25 | 皇家飞利浦电子股份有限公司 | Audio signal bandwidth extension |
CA2365203A1 (en) * | 2001-12-14 | 2003-06-14 | Voiceage Corporation | A signal modification method for efficient coding of speech signals |
US6751587B2 (en) * | 2002-01-04 | 2004-06-15 | Broadcom Corporation | Efficient excitation quantization in noise feedback coding with general noise shaping |
JP4290917B2 (en) * | 2002-02-08 | 2009-07-08 | 株式会社エヌ・ティ・ティ・ドコモ | Decoding device, encoding device, decoding method, and encoding method |
JP3826813B2 (en) * | 2002-02-18 | 2006-09-27 | ソニー株式会社 | Digital signal processing apparatus and digital signal processing method |
CA2469674C (en) * | 2002-09-19 | 2012-04-24 | Matsushita Electric Industrial Co., Ltd. | Audio decoding apparatus and method |
JP3756864B2 (en) | 2002-09-30 | 2006-03-15 | 株式会社東芝 | Speech synthesis method and apparatus and speech synthesis program |
KR100841096B1 (en) | 2002-10-14 | 2008-06-25 | 리얼네트웍스아시아퍼시픽 주식회사 | Preprocessing of digital audio data for mobile speech codecs |
US20040098255A1 (en) | 2002-11-14 | 2004-05-20 | France Telecom | Generalized analysis-by-synthesis speech coding method, and coder implementing such method |
US7242763B2 (en) | 2002-11-26 | 2007-07-10 | Lucent Technologies Inc. | Systems and methods for far-end noise reduction and near-end noise compensation in a mixed time-frequency domain compander to improve signal quality in communications systems |
CA2415105A1 (en) | 2002-12-24 | 2004-06-24 | Voiceage Corporation | A method and device for robust predictive vector quantization of linear prediction parameters in variable bit rate speech coding |
KR100480341B1 (en) | 2003-03-13 | 2005-03-31 | 한국전자통신연구원 | Apparatus for coding wide-band low bit rate speech signal |
EP1618557B1 (en) | 2003-05-01 | 2007-07-25 | Nokia Corporation | Method and device for gain quantization in variable bit rate wideband speech coding |
JP4212591B2 (en) * | 2003-06-30 | 2009-01-21 | 富士通株式会社 | Audio encoding device |
US20050004793A1 (en) | 2003-07-03 | 2005-01-06 | Pasi Ojala | Signal adaptation for higher band coding in a codec utilizing band split coding |
FI118550B (en) | 2003-07-14 | 2007-12-14 | Nokia Corp | Enhanced excitation for higher frequency band coding in a codec utilizing band splitting based coding methods |
US7428490B2 (en) | 2003-09-30 | 2008-09-23 | Intel Corporation | Method for spectral subtraction in speech enhancement |
US7689579B2 (en) * | 2003-12-03 | 2010-03-30 | Siemens Aktiengesellschaft | Tag modeling within a decision, support, and reporting environment |
KR100587953B1 (en) * | 2003-12-26 | 2006-06-08 | 한국전자통신연구원 | Packet loss concealment apparatus for high-band in split-band wideband speech codec, and system for decoding bit-stream using the same |
CA2454296A1 (en) | 2003-12-29 | 2005-06-29 | Nokia Corporation | Method and device for speech enhancement in the presence of background noise |
JP4259401B2 (en) | 2004-06-02 | 2009-04-30 | カシオ計算機株式会社 | Speech processing apparatus and speech coding method |
US8000967B2 (en) * | 2005-03-09 | 2011-08-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Low-complexity code excited linear prediction encoding |
US8155965B2 (en) | 2005-03-11 | 2012-04-10 | Qualcomm Incorporated | Time warping frames inside the vocoder by modifying the residual |
PL1866915T3 (en) | 2005-04-01 | 2011-05-31 | Qualcomm Inc | Method and apparatus for anti-sparseness filtering of a bandwidth extended speech prediction excitation signal |
ES2351935T3 (en) * | 2005-04-01 | 2011-02-14 | Qualcomm Incorporated | PROCEDURE AND APPARATUS FOR VECTOR QUANTIFICATION OF A SPECTRAL ENVELOPE REPRESENTATION. |
WO2006116025A1 (en) | 2005-04-22 | 2006-11-02 | Qualcomm Incorporated | Systems, methods, and apparatus for gain factor smoothing |
-
2006
- 2006-04-03 PL PL06740357T patent/PL1866915T3/en unknown
- 2006-04-03 JP JP2008504477A patent/JP5129116B2/en active Active
- 2006-04-03 DE DE602006018884T patent/DE602006018884D1/en active Active
- 2006-04-03 AU AU2006232357A patent/AU2006232357C1/en active Active
- 2006-04-03 US US11/397,370 patent/US8078474B2/en active Active
- 2006-04-03 EP EP06740351A patent/EP1869670B1/en active Active
- 2006-04-03 DE DE602006017673T patent/DE602006017673D1/en active Active
- 2006-04-03 US US11/397,870 patent/US8260611B2/en active Active
- 2006-04-03 TW TW095111800A patent/TWI321777B/en active
- 2006-04-03 SG SG201004744-7A patent/SG163556A1/en unknown
- 2006-04-03 BR BRPI0608269A patent/BRPI0608269B8/en active IP Right Grant
- 2006-04-03 NZ NZ562182A patent/NZ562182A/en not_active IP Right Cessation
- 2006-04-03 CA CA2603246A patent/CA2603246C/en active Active
- 2006-04-03 ES ES06740358.4T patent/ES2636443T3/en active Active
- 2006-04-03 CA CA2603255A patent/CA2603255C/en active Active
- 2006-04-03 CA CA2602804A patent/CA2602804C/en active Active
- 2006-04-03 JP JP2008504475A patent/JP5129115B2/en active Active
- 2006-04-03 NZ NZ562188A patent/NZ562188A/en not_active IP Right Cessation
- 2006-04-03 MX MX2007012187A patent/MX2007012187A/en active IP Right Grant
- 2006-04-03 AU AU2006232364A patent/AU2006232364B2/en active Active
- 2006-04-03 SI SI200632188T patent/SI1864282T1/en unknown
- 2006-04-03 EP EP06740355A patent/EP1869673B1/en active Active
- 2006-04-03 RU RU2007140383/09A patent/RU2402826C2/en active
- 2006-04-03 CA CA2602806A patent/CA2602806C/en active Active
- 2006-04-03 WO PCT/US2006/012234 patent/WO2006130221A1/en active Application Filing
- 2006-04-03 EP EP06784345A patent/EP1864101B1/en active Active
- 2006-04-03 AU AU2006232363A patent/AU2006232363B2/en active Active
- 2006-04-03 MX MX2007012182A patent/MX2007012182A/en active IP Right Grant
- 2006-04-03 AT AT06740355T patent/ATE482449T1/en not_active IP Right Cessation
- 2006-04-03 US US11/397,432 patent/US8364494B2/en active Active
- 2006-04-03 AT AT06740354T patent/ATE459958T1/en not_active IP Right Cessation
- 2006-04-03 WO PCT/US2006/012235 patent/WO2006107840A1/en active Application Filing
- 2006-04-03 RU RU2007140429/09A patent/RU2387025C2/en active
- 2006-04-03 US US11/397,871 patent/US8140324B2/en active Active
- 2006-04-03 AT AT06740351T patent/ATE485582T1/en not_active IP Right Cessation
- 2006-04-03 JP JP2008504481A patent/JP4955649B2/en active Active
- 2006-04-03 RU RU2007140426/09A patent/RU2402827C2/en active
- 2006-04-03 TW TW095111851A patent/TWI319565B/en active
- 2006-04-03 BR BRPI0608305-6A patent/BRPI0608305B1/en active IP Right Grant
- 2006-04-03 SG SG201002300-0A patent/SG161223A1/en unknown
- 2006-04-03 CA CA2603229A patent/CA2603229C/en active Active
- 2006-04-03 ES ES06784345T patent/ES2391292T3/en active Active
- 2006-04-03 RU RU2007140381/09A patent/RU2386179C2/en active
- 2006-04-03 RU RU2009131435/08A patent/RU2491659C2/en active
- 2006-04-03 JP JP2008504478A patent/JP5129117B2/en active Active
- 2006-04-03 MX MX2007012181A patent/MX2007012181A/en active IP Right Grant
- 2006-04-03 SG SG201004741-3A patent/SG163555A1/en unknown
- 2006-04-03 KR KR1020077025400A patent/KR100956877B1/en active IP Right Grant
- 2006-04-03 MX MX2007012191A patent/MX2007012191A/en active IP Right Grant
- 2006-04-03 WO PCT/US2006/012227 patent/WO2006107833A1/en active Application Filing
- 2006-04-03 TW TW095111852A patent/TWI324335B/en active
- 2006-04-03 WO PCT/US2006/012231 patent/WO2006107837A1/en active Application Filing
- 2006-04-03 AU AU2006232362A patent/AU2006232362B2/en active Active
- 2006-04-03 MX MX2007012184A patent/MX2007012184A/en active IP Right Grant
- 2006-04-03 CA CA2603219A patent/CA2603219C/en active Active
- 2006-04-03 EP EP06740352A patent/EP1864281A1/en not_active Withdrawn
- 2006-04-03 SG SG201002303-4A patent/SG161224A1/en unknown
- 2006-04-03 NZ NZ562183A patent/NZ562183A/en unknown
- 2006-04-03 CA CA2603187A patent/CA2603187C/en active Active
- 2006-04-03 DK DK06784345.8T patent/DK1864101T3/en active
- 2006-04-03 NZ NZ562190A patent/NZ562190A/en not_active IP Right Cessation
- 2006-04-03 KR KR1020077025255A patent/KR100956624B1/en active IP Right Grant
- 2006-04-03 PT PT06784345T patent/PT1864101E/en unknown
- 2006-04-03 PL PL06740358T patent/PL1864282T3/en unknown
- 2006-04-03 BR BRPI0609530-5A patent/BRPI0609530B1/en active IP Right Grant
- 2006-04-03 EP EP06740354A patent/EP1866914B1/en active Active
- 2006-04-03 BR BRPI0608306-4A patent/BRPI0608306A2/en not_active Application Discontinuation
- 2006-04-03 US US11/397,872 patent/US8069040B2/en active Active
- 2006-04-03 DE DE602006017050T patent/DE602006017050D1/en active Active
- 2006-04-03 RU RU2007140382/09A patent/RU2381572C2/en active
- 2006-04-03 BR BRPI0607690A patent/BRPI0607690A8/en not_active Application Discontinuation
- 2006-04-03 TW TW095111814A patent/TWI330828B/en active
- 2006-04-03 AU AU2006232360A patent/AU2006232360B2/en active Active
- 2006-04-03 RU RU2007140406/09A patent/RU2390856C2/en active
- 2006-04-03 JP JP2008504482A patent/JP5161069B2/en active Active
- 2006-04-03 BR BRPI0607691A patent/BRPI0607691B1/en active IP Right Grant
- 2006-04-03 KR KR1020077025447A patent/KR101019940B1/en active IP Right Grant
- 2006-04-03 AU AU2006252957A patent/AU2006252957B2/en active Active
- 2006-04-03 PL PL06740355T patent/PL1869673T3/en unknown
- 2006-04-03 PT PT67403584T patent/PT1864282T/en unknown
- 2006-04-03 BR BRPI0607646-7A patent/BRPI0607646B1/en active IP Right Grant
- 2006-04-03 NZ NZ562186A patent/NZ562186A/en not_active IP Right Cessation
- 2006-04-03 EP EP06740356A patent/EP1864283B1/en active Active
- 2006-04-03 TW TW095111794A patent/TWI320923B/en active
- 2006-04-03 RU RU2007140394/09A patent/RU2413191C2/en active
- 2006-04-03 MX MX2007012185A patent/MX2007012185A/en active IP Right Grant
- 2006-04-03 KR KR1020077025421A patent/KR100956524B1/en active IP Right Grant
- 2006-04-03 US US11/397,794 patent/US8484036B2/en active Active
- 2006-04-03 TW TW095111804A patent/TWI321314B/en active
- 2006-04-03 PL PL06784345T patent/PL1864101T3/en unknown
- 2006-04-03 JP JP2008504474A patent/JP5203929B2/en active Active
- 2006-04-03 CN CN201110326747.2A patent/CN102411935B/en active Active
- 2006-04-03 JP JP2008504480A patent/JP5129118B2/en active Active
- 2006-04-03 WO PCT/US2006/012232 patent/WO2006107838A1/en active Application Filing
- 2006-04-03 KR KR1020077025293A patent/KR100982638B1/en active IP Right Grant
- 2006-04-03 NZ NZ562185A patent/NZ562185A/en not_active IP Right Cessation
- 2006-04-03 WO PCT/US2006/012228 patent/WO2006107834A1/en active Application Filing
- 2006-04-03 KR KR1020077025422A patent/KR100956523B1/en active IP Right Grant
- 2006-04-03 DE DE602006012637T patent/DE602006012637D1/en active Active
- 2006-04-03 BR BRPI0608270-0A patent/BRPI0608270A2/en not_active Application Discontinuation
- 2006-04-03 KR KR1020077025290A patent/KR100956876B1/en active IP Right Grant
- 2006-04-03 EP EP06740357A patent/EP1866915B1/en active Active
- 2006-04-03 EP EP06740358.4A patent/EP1864282B1/en active Active
- 2006-04-03 MX MX2007012189A patent/MX2007012189A/en active IP Right Grant
- 2006-04-03 DK DK06740358.4T patent/DK1864282T3/en active
- 2006-04-03 TW TW095111797A patent/TWI316225B/en active
- 2006-04-03 TW TW095111819A patent/TWI321315B/en active
- 2006-04-03 AT AT06740357T patent/ATE492016T1/en not_active IP Right Cessation
- 2006-04-03 KR KR1020077025432A patent/KR100956525B1/en active IP Right Grant
- 2006-04-03 AU AU2006232358A patent/AU2006232358B2/en not_active Expired - Fee Related
- 2006-04-03 ES ES06740354T patent/ES2340608T3/en active Active
- 2006-04-03 WO PCT/US2006/012230 patent/WO2006107836A1/en active Application Filing
- 2006-04-03 RU RU2007140365/09A patent/RU2376657C2/en active
- 2006-04-03 US US11/397,505 patent/US8332228B2/en active Active
- 2006-04-03 US US11/397,433 patent/US8244526B2/en active Active
- 2006-04-03 MX MX2007012183A patent/MX2007012183A/en active IP Right Grant
- 2006-04-03 WO PCT/US2006/012233 patent/WO2006107839A2/en active Application Filing
- 2006-04-03 JP JP2008504479A patent/JP5203930B2/en active Active
- 2006-04-03 AU AU2006232361A patent/AU2006232361B2/en active Active
- 2006-04-03 CA CA2603231A patent/CA2603231C/en active Active
-
2007
- 2007-10-07 IL IL186439A patent/IL186439A0/en unknown
- 2007-10-07 IL IL186405A patent/IL186405A/en active IP Right Grant
- 2007-10-07 IL IL186441A patent/IL186441A0/en active IP Right Grant
- 2007-10-07 IL IL186404A patent/IL186404A/en active IP Right Grant
- 2007-10-07 IL IL186443A patent/IL186443A/en active IP Right Grant
- 2007-10-07 IL IL186438A patent/IL186438A/en active IP Right Grant
- 2007-10-07 IL IL186442A patent/IL186442A/en active IP Right Grant
- 2007-10-07 IL IL186436A patent/IL186436A0/en active IP Right Grant
- 2007-10-31 NO NO20075515A patent/NO340566B1/en unknown
- 2007-10-31 NO NO20075503A patent/NO20075503L/en not_active Application Discontinuation
- 2007-10-31 NO NO20075512A patent/NO20075512L/en not_active Application Discontinuation
- 2007-10-31 NO NO20075514A patent/NO340434B1/en unknown
- 2007-10-31 NO NO20075513A patent/NO340428B1/en unknown
- 2007-10-31 NO NO20075510A patent/NO20075510L/en not_active Application Discontinuation
- 2007-10-31 NO NO20075511A patent/NO20075511L/en not_active Application Discontinuation
-
2008
- 2008-08-28 HK HK08109568.5A patent/HK1113848A1/en unknown
- 2008-09-19 HK HK08110384.5A patent/HK1115023A1/en unknown
- 2008-09-22 HK HK08110465.7A patent/HK1114901A1/en unknown
- 2008-09-24 HK HK08110589.8A patent/HK1115024A1/en unknown
- 2008-09-24 HK HK12110024.5A patent/HK1169509A1/en unknown
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2602804C (en) | Systems, methods, and apparatus for highband burst suppression | |
EP1875463B1 (en) | Systems, methods, and apparatus for gain factor smoothing | |
CA2657424C (en) | Systems and methods for including an identifier with a packet associated with a speech signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request |