Variable to variable length entropy encoding

(54) VARIABLE TO VARIABLE LENGTH ENTROPY ENCODING

(75) Inventors: Wei-ge Chen, Issaquah; Ming-Chieh Lee, Bellevue, both of WA (US)

(73) Assignee: Microsoft Corporation, Redmond, WA (US)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 0 days.

(21) Appl. No.: 09/211,294

(22) Filed: Dec. 14, 1998

(51) Int. CI.7 G10L 19/00; H03M 7/46

(52) U.S. CI 704/503; 704/504; 341/63

(58) Field of Search 704/503, 504;

341/106, 107, 51, 63, 67

(56) References Cited

U.S. PATENT DOCUMENTS

FOREIGN PATENT DOCUMENTS

OTHER PUBLICATIONS

Bell et al., Text Compression, "Contents," "Preface," "Chapter 8: Dictionary Techniques," "Chapter 9: Dictionary Versus Statistical Coding,"to "References, " Prentice Hall Advance Reference Series, pp. v-xi, xiii-xviii, 206-243, 244-273, 303-310 (1990).

De Agostino et al., "Parallel Algorithms for Optimal Compression using Dictionaries with the Prefix Property," in Proc. Data Compression Conference '92, IEEE Computer Society Press, pp. 52-62 (1992).

ISO/IEC 13818-7: Information Technology—Generic coding of moving pictures and associated audio information— Part 7: Advanced Audio Coding, pp. I-vi, 1-147 (1997).

(List continued on next page.)

Primary Examiner—Richemond Dorvil Assistant Examiner—Susan McFadden (74) Attorney, Agent, or Firm—Klarquist Sparkman, LLP

(List continued on next page.)

Entropy encoding and decoding of data with a code book containing variable length entropy-type codes that are assigned to variable length input symbol groupings. The variable length input sequences are identified by scanning an input channel, such as a live broadcast, non-volatile data storage, or network connection (e.g., LAN, WAN, Internet). Each time a symbol grouping is recognized, a corresponding entropy-type code is output as a replacement for the input stream. Decoding is the inverse process of encoding, where a code word is looked up in the code book and the corresponding original input is obtained.

25 Claims, 7 Drawing Sheets

OTHER PUBLICATIONS

ISO/IEC 13818-7: Information Technology—Generic coding of moving pictures and associated audio information— Part 7: Advanced Audio Coding, Technical Corrigendum 1, pp. 1-22 (Dec. 1998).

Tewfik et al., "Enhanced Wavelet Based Audio Coder," Proc.
ASILOMAR Conference, IEEE (1993).
Bailey et al., "Pipelining Data Compression Algorithms,"
The Computer Journal, vol. 33, No. 4, 6pp. (Aug. 1990).
Cohn et al., "Ziv-Lempel Compressors with Deferred Inno-
vation," in Image and Text Compression, ed. James Storer,
Kluwer Academic Publishers, pp. 145-157 (1992).
Gonzalez et al., Digital Image Processing, Addison-Wesley,
pp. 14, 339-359 (1993).

Howard et al., "Practical Implementations of Arithmetic
Coding," in Image and Text Compression, ed. James Storer,
Kluwer Academic Publishers, pp. 85-112 (1992).
Semon, "The Effects of Cascading Popular Text Compres-
sion Techniques," M.S. Thesis, East Stroudsburg University,
102 pp. (May 1993).

Stauffer et al., "Dictionary Compression on the PRAM," Technical Report 94—7, University of California, Irvine, 19 pp. (Jan. 18, 1994).

Video Coding For Low Bitrate Communication, "Line Transmission of Non-Telephone Signals," Telecommunication Standardization Sector of International Telecommunication Union, Dec. 5, 1995, pp. 22-23.

"Information Technology—Very Low Bitrate Audio-Visual Coding," Part 3: Audio, ISO/JTC1/SC29, N2203, May 15, 1998, pp. 4-9, including section on Huffman Coding.

Allen Gersho and Robert M. Gray, Vector Quantization and Signal Compression, "Entropy Coding," 1992, Chap. 9, pp. 259-305.

International Organisation for Standardisation Organisation Internationale De Normalisation, ISO/IEC JTC1/SC29/ WG11, N2202, Coding of Moving Pictures and Audio, Tokyo, Mar. 1998.

Stanley N. Baron, Mark I. Krivocheev, "Coding the Audio Signal," Digital Image and Audio Communications, 1996, pp. 101-128.

Image Processing Lab, City University of Hong Kong, "Auditory Predictive Lossy Lempel-Ziv Algorithm for Speech Coding: Theory," 40 pp. [online][retrieved on Nov. 21, 2000, from http://www.image.cityu.edu.hk/stkng/].

Storer, "Massively Parallel Systolic Algorithms for Real-Time Dictionary-Based Text Compression," in Image and Text Compression, ed. James Storer, Kluwer Academic Publishers, pp. 159-178 (1992).

Williams, Ross, Adaptive Data Compression, Chapter 1, "Introductory Survey," Fluwer Academic Publishers, pp. 1-33 (1991).

* cited by examiner