Recherche Images Maps Play YouTube Actualités Gmail Drive Plus »
Connexion
Les utilisateurs de lecteurs d'écran peuvent cliquer sur ce lien pour activer le mode d'accessibilité. Celui-ci propose les mêmes fonctionnalités principales, mais il est optimisé pour votre lecteur d'écran.

Brevets

  1. Recherche avancée dans les brevets
Numéro de publicationUS20030112863 A1
Type de publicationDemande
Numéro de demandeUS 09/905,039
Date de publication19 juin 2003
Date de dépôt12 juil. 2001
Date de priorité12 juil. 2001
Autre référence de publicationCA2452506A1, CA2452506C, CA2621107A1, CN1250003C, CN1526236A, EP1405515A2, EP1405515A4, EP1988712A2, EP1988712A3, EP2239943A1, EP2239943B1, EP2493178A1, EP2493179A1, EP2493180A1, EP2493181A1, EP2493182A1, EP2493183A1, EP2493184A1, EP2493185A1, EP2493186A1, EP2698991A2, US7961784, US20080273809, US20110038411, US20110286517, US20110286518, US20110286519, US20120033729, US20120087408, US20120087409, WO2003007126A2, WO2003007126A3
Numéro de publication09905039, 905039, US 2003/0112863 A1, US 2003/112863 A1, US 20030112863 A1, US 20030112863A1, US 2003112863 A1, US 2003112863A1, US-A1-20030112863, US-A1-2003112863, US2003/0112863A1, US2003/112863A1, US20030112863 A1, US20030112863A1, US2003112863 A1, US2003112863A1
InventeursGary Demos
Cessionnaire d'origineDemos Gary A.
Exporter la citationBiBTeX, EndNote, RefMan
Liens externes: USPTO, Cession USPTO, Espacenet
Method and system for improving compressed image chroma information
US 20030112863 A1
Résumé
Methods, systems, and computer programs for improving compressed image chroma information. In one aspect of the invention, a resolution for a red color component of a color video image is used that is higher than the resolution for a blue color component of the color video image. Another aspect includes utilizing a lower or higher value of a quantization parameter (QP) for one or more chroma channels as compared to the luminance channel. Another aspect is use of a logarithmic representation of a video image to benefit image coding. Another aspect uses more than two chroma channels to represent a video image.
Images(5)
Previous page
Next page
Revendications(87)
What is claimed is:
1. A method for compressing image chroma information of a color video image in a video image compression system, including selecting a resolution for a red color component of the color video image that is higher than the resolution for a blue color component of the color video image.
2. A method for compressing image chroma information of a color video image in a video image compression system, including:
(a) downfiltering a blue color component of the color video image to a processed blue color component having a first resolution along at least one of the horizontal and vertical image axes of the color video image; and
(b) filtering a red color component of the color video image to a processed red color component having a second resolution higher than the first resolution.
3. The method of claim 2, wherein the second resolution is in the range from 0.5 to 1.0 of the full resolution of the red color component along at least one of the horizontal and vertical image axes of the color video image.
4. The method of claim 2, further including compressing at least the processed blue color and red color components to a compressed output image.
5. The method of claim 4, further including decompressing the compressed output image to obtain uncompressed processed blue and red color components.
6. The method of claim 5, further including upsize filtering the processed blue and red color components to the full resolution of the color video image.
7. The method of claims 1 or 2, wherein the video image compression system is a motion-compensated video image compression system.
8. A method for reducing chroma noise during compression of a color video image in a YUV video image compression system utilizing a quantization parameter (QP) during compression, including utilizing a first QP value for the Y color channel of a color video image, and a second QP value for at least one of the U and V color channels of the color video image, wherein the second QP value is less than the first QP value.
9. The method of claim 8, wherein the second QP value is determined by applying a bias value to the first QP value.
10. The method of claim 8, further including compressing the color video image, after application of the first and second QP values, to a compressed output image.
11. The method of claim 10, further including decompressing the compressed output image using the first and second QP values to obtain an uncompressed video image.
12. A method for achieving higher compression during compression of a color video image in a YUV video image compression system utilizing a quantization parameter (QP) during compression, including utilizing a first QP value for the Y color channel of a color video image, and a second QP value for at least one of the U and V color channels of the color video image, wherein the second QP value is greater than the first QP value.
13. The method of claim 12, wherein the second QP value is determined by applying a bias value to the first QP value.
14. The method of claim 12, further including compressing the color video image, after application of the first and second QP values, to a compressed output image.
15. The method of claim 14, further including decompressing the compressed output image using the first and second QP values to obtain an uncompressed video image.
16. A method for improving the coding efficiency for a color space representation of a video image originally represented as linear RGB pixel values in a video image compression system, including transforming the linear RGB pixel values of the video image to a logarithmic representation of luminance and chroma channel information.
17. The method of claim 16, wherein transforming includes applying the following equations to obtain a YUV logarithmic representation of the video image:
Ylog=Log(Wr*R+Wg*G+Wb*B)
U chroma channel=Log(R)−Ylog
V chroma channel=Log(B)−Ylog
where Wr, Wg, and Wb are linear weightings for red, green, and blue components of luminance of the video image.
18. The method of claim 17, further including reducing the resolution of the U and V chroma channels of the YUV logarithmic representation.
19. The method of claim 17, further including compressing the YUV logarithmic representation of the video image to a compressed video image.
20. The method of claim 19, further including decompressing the compressed video image to a restored YUV logarithmic representation of the video image.
21. The method of claim 20, further including transforming restored YUV logarithmic representation of the video image to linear RGB pixel values.
22. The method of claim 21, wherein transforming includes applying the following equations to obtain the linear RGB pixel values:
R=anti-log(Y+U)
B=anti-log(Y+V)
G=(anti-log(Y)−Wr*R−Wb*B)/Wg.
23. A method for improving the video characteristics of a color video image in a video compression system, including:
(a) selecting a set of image channels to represent the color video image, including a luminance channel and n chroma channels, where n is at least three; and
(b) compressing the luminance channel and the n additional chroma channels to a compressed video image.
24. The method of claim 23, wherein at least one chroma channel represents non-visible wavelengths.
25. The method of claim 23, wherein the luminance channel is the image channel having the highest dynamic range and resolution.
26. The method of claim 23, further including coding each chroma channel independently from each other channel.
27. The method of claim 23, further including coding each chroma channel differentially with respect to a selected other channel.
28. The method of claim 23, further including reducing the resolution of at least one chroma channel.
29. The method of claim 23, further including applying a quantization parameter (QP) value to at least one chroma channel biased with respect to a QP value applied to the luminance channel.
30. A computer program, stored on a computer-readable medium, for compressing image chroma information of a color video image in a video image compression system, the computer program comprising instructions for causing a computer to permit selection of a resolution for a red color component of the color video image that is higher than the resolution for a blue color component of the color video image.
31. A computer program, stored on a computer-readable medium, for compressing image chroma information of a color video image in a video image compression system, the computer program comprising instructions for causing a computer to:
(a) downfilter a blue color component of the color video image to a processed blue color component having a first resolution along at least one of the horizontal and vertical image axes of the color video image; and
(b) filter a red color component of the color video image to a processed red color component having a second resolution higher than the first resolution.
32. The computer program of claim 31, wherein the second resolution is in the range from 0.5 to 1.0 of the full resolution of the red color component along at least one of the horizontal and vertical image axes of the color video image.
33. The computer program of claim 31, further including instructions for causing the computer to compress at least the processed blue color and red color components to a compressed output image.
34. The computer program of claim 33, further including instructions for causing a decompression computer to decompress the compressed output image to obtain uncompressed processed blue and red color components.
35. The computer program of claim 34, further including instructions for causing the decompression computer to upsize filter the processed blue and red color components to the full resolution of the color video image.
36. The computer program of claims 30 or 31, wherein the video image compression system is a motion-compensated video image compression system.
37. A computer program, stored on a computer-readable medium, for reducing chroma noise during compression of a color video image in a YUV video image compression system utilizing a quantization parameter (QP) during compression, the computer program comprising instructions for causing a computer to utilize a first QP value for the Y color channel of a color video image, and a second QP value for at least one of the U and V color channels of the color video image, wherein the second QP value is less than the first QP value.
38. The computer program of claim 37, wherein the second QP value is determined by applying a bias value to the first QP value.
39. The computer program of claim 37, further including instructions for causing the computer to compress the color video image, after application of the first and second QP values, to a compressed output image.
40. The computer program of claim 39, further including instructions for causing a decompression computer to decompress the compressed output image using the first and second QP values to obtain an uncompressed video image.
41. A computer program, stored on a computer-readable medium, for achieving higher compression during compression of a color video image in a YUV video image compression system utilizing a quantization parameter (QP) during compression, the computer program comprising instructions for causing a computer to utilize a first QP value for the Y color channel of a color video image, and a second QP value for at least one of the U and V color channels of the color video image, wherein the second QP value is greater than the first QP value.
42. The computer program of claim 41, wherein the second QP value is determined by applying a bias value to the first QP value.
43. The computer program of claim 41, further including instructions for causing the computer to compress the color video image, after application of the first and second QP values, to a compressed output image.
44. The computer program of claim 14, further including instructions for causing a decompression computer to decompress the compressed output image using the first and second QP values to obtain an uncompressed video image.
45. A computer program, stored on a computer-readable medium, for improving the coding efficiency for a color space representation of a video image originally represented as linear RGB pixel values in a video image compression system, the computer program comprising instructions for causing a computer to transform the linear RGB pixel values of the video image to a logarithmic representation of luminance and chroma channel information.
46. The computer program of claim 45, wherein the instructions for causing the computer to transform include instructions for causing the computer to apply the following equations to obtain a YUV logarithmic representation of the video image:
Ylog=Log(Wr*R+Wg*G+Wb*B)
U chroma channel=Log(R)−Ylog
V chroma channel=Log(B)−Ylog
where Wr, Wg, and Wb are linear weightings for red, green, and blue components of luminance of the video image.
47. The computer program of claim 46, further including instructions for causing the computer to reduce the resolution of the U and V chroma channels of the YUV logarithmic representation.
48. The computer program of claim 46, further including instructions for causing the computer to compress the YUV logarithmic representation of the video image to a compressed video image.
49. The computer program of claim 48, further including instructions for causing a decompression computer to decompress the compressed video image to a restored YUV logarithmic representation of the video image.
50. The computer program of claim 49, further including instructions for causing the decompression computer to transform restored YUV logarithmic representation of the video image to linear RGB pixel values.
51. The computer program of claim 50, wherein the instructions for causing the computer to transform includes instructions for causing the computer to apply the following equations to obtain the linear RGB pixel values:
R=anti-log(Y+U)
B=anti-log(Y+V)
G=(anti-log(Y)−Wr*R−Wb*B)/Wg.
52. A computer program, stored on a computer-readable medium, for improving the video characteristics of a color video image in a video compression system, the computer program comprising instructions for causing a computer to:
(a) select a set of image channels to represent the color video image, including a luminance channel and n chroma channels, where n is at least three; and
(b) compress the luminance channel and the n additional chroma channels to a compressed video image.
53. The computer program of claim 52, wherein at least one chroma channel represents non-visible wavelengths.
54. The computer program of claim 52, wherein the luminance channel is the image channel having the highest dynamic range and resolution.
55. The computer program of claim 52, further including instructions for causing a computer to code each chroma channel independently from each other channel.
56. The computer program of claim 52, further including instructions for causing a computer to code each chroma channel differentially with respect to a selected other channel.
57. The computer program of claim 52, further including instructions for causing a computer to reduce the resolution of at least one chroma channel.
58. The computer program of claim 52, further including instructions for causing a computer to apply a quantization parameter (QP) value to at least one chroma channel biased with respect to a QP value applied to the luminance channel.
59. A system for compressing image chroma information of a color video image a video image compression system, including:
(a) means for selecting a resolution for a red color component of the color video image that is higher than the resolution for a blue color component of the color video image; and
(b) means for applying the selected resolution to compress the color video image.
60. A system for compressing image chroma information of a color video image in a video image compression system, including means for:
(a) downfiltering a blue color component of the color video image to a processed blue color component having a first resolution along at least one of the horizontal and vertical image axes of the color video image; and
(b) filtering a red color component of the color video image to a processed red color component having a second resolution higher than the first resolution.
61. The system of claim 60, wherein the second resolution is in the range from 0.5 to 1.0 of the full resolution of the red color component along at least one of the horizontal and vertical image axes of the color video image.
62. The system of claim 60, further including means for compressing at least the processed blue color and red color components to a compressed output image.
63. The system of claim 62, further including means for decompressing the compressed output image to obtain uncompressed processed blue and red color components.
64. The system of claim 63, further including means for upsize filtering the processed blue and red color components to the full resolution of the color video image.
65. The system of claims 59 or 60, wherein the video image compression system is a motion-compensated video image compression system.
66. A system for reducing chroma noise during compression of a color video image in a YUV video image compression system utilizing a quantization parameter (QP) during compression, including
(a) means for utilizing a first QP value for the Y color channel of a color video image, and a second QP value for at least one of the U and V color channels of the color video image, wherein the second QP value is less than the first QP value; and
(b) means for applying the selected QP values during compression of the color video image.
67. The system of claim 66, wherein the second QP value is determined by applying a bias value to the first QP value.
68. The system of claim 66, further including means for compressing the color video image, after application of the first and second QP values, to a compressed output image.
69. The system of claim 68, further including means for decompressing the compressed output image using the first and second QP values to obtain an uncompressed video image.
70. A system for achieving higher compression during compression of a color video image in a YUV video image compression system utilizing a quantization parameter (QP) during compression, including:
(a) means for utilizing a first QP value for the Y color channel of a color video image, and a second QP value for at least one of the U and V color channels of the color video image, wherein the second QP value is greater than the first QP value
(b) means for applying the selected QP values during compression of the color video image.
71. The system of claim 70, wherein the second QP value is determined by applying a bias value to the first QP value.
72. The system of claim 70, further including means for compressing the color video image, after application of the first and second QP values, to a compressed output image.
73. The system of claim 72, further including means for decompressing the compressed output image using the first and second QP values to obtain an uncompressed video image.
74. A system for improving the coding efficiency for a color space representation of a video image originally represented as linear RGB pixel values in a video image compression system, including:
(a) means for inputting linear RGB pixel values of a video image; and
(b) means for transforming the linear RGB pixel values of the video image to a logarithmic representation of luminance and chroma channel information.
75. The system of claim 74, wherein transforming includes applying the following equations to obtain a YUV logarithmic representation of the video image:
Ylog=Log(Wr*R+Wg*G+Wb*B)
U chroma channel=Log(R)−Ylog
V chroma channel=Log(B)−Ylog
where Wr, Wg, and Wb are linear weightings for red, green, and blue components of luminance of the video image.
76. The system of claim 75, further including means for reducing the resolution of the U and V chroma channels of the YUV logarithmic representation.
77. The system of claim 75, further including means for compressing the YUV logarithmic representation of the video image to a compressed video image.
78. The system of claim 77, further including means for decompressing the compressed video image to a restored YUV logarithmic representation of the video image.
79. The system of claim 78, further including means for transforming restored YUV logarithmic representation of the video image to linear RGB pixel values.
80. The system of claim 79, wherein transforming includes applying the following equations to obtain the linear RGB pixel values:
R=anti-log(Y+U)
B=anti-log(Y+V)
G=(anti-log(Y)−Wr*R−Wb*B)/Wg.
81. A system for improving the video characteristics of a color video image in a video compression system, including means for:
(a) selecting a set of image channels to represent the color video image, including a luminance channel and n chroma channels, where n is at least three; and
(b) compressing the luminance channel and the n additional chroma channels to a compressed video image.
82. The system of claim 81, wherein at least one chroma channel represents non-visible wavelengths.
83. The system of claim 81, wherein the luminance channel is the image channel having the highest dynamic range and resolution.
84. The system of claim 81, further including means for coding each chroma channel independently from each other channel.
85. The system of claim 81, further including means for coding each chroma channel differentially with respect to a selected other channel.
86. The system of claim 81, further including means for reducing the resolution of at least one chroma channel.
87. The system of claim 81, further including means for applying a quantization parameter (QP) value to at least one chroma channel biased with respect to a QP value applied to the luminance channel.
Description
TECHNICAL FIELD

[0001] This invention relates to video compression, and more particularly to methods, systems, and computer programs for improving compressed image chroma information in MPEG-like video compression systems.

BACKGROUND

[0002] MPEG Background

[0003] MPEG-2 and MPEG-4 are international video compression standards defining a video syntax that provides an efficient way to represent image sequences in the form of more compact coded data. The language of the coded bits is the “syntax.” For example, a few tokens can represent an entire block of samples (e.g., 64 samples for MPEG-2). Both MPEG standards also describe a decoding (reconstruction) process where the coded bits are mapped from the compact representation into an approximation of the original format of the image sequence. For example, a flag in the coded bitstream signals whether the following bits are to be preceded with a prediction algorithm prior to being decoded with a discrete cosine transform (DCT) algorithm. The algorithms comprising the decoding process are regulated by the semantics defined by these MPEG standards. This syntax can be applied to exploit common video characteristics such as spatial redundancy, temporal redundancy, uniform motion, spatial masking, etc. In effect, these MPEG standards define a programming language as well as a data format. An MPEG decoder must be able to parse and decode an incoming data stream, but so long as the data stream complies with the corresponding MPEG syntax, a wide variety of possible data structures and compression techniques can be used (although technically this deviates from the standard since the semantics are not conformant). It is also possible to carry the needed semantics within an alternative syntax.

[0004] These MPEG standards use a variety of compression methods, including intraframe and interframe methods. In most video scenes, the background remains relatively stable while action takes place in the foreground. The background may move, but a great deal of the scene is redundant. These MPEG standards start compression by creating a reference frame called an “intra” frame or “I frame”. I frames are compressed without reference to other frames and thus contain an entire frame of video information. I frames provide entry points into a data bitstream for random access, but can only be moderately compressed. Typically, the data representing I frames is placed in the bitstream every 12 to 15 frames (although it is also useful in some circumstances to use much wider spacing between I frames). Thereafter, since only a small portion of the frames that fall between the reference I frames are different from the bracketing I frames, only the image differences are captured, compressed, and stored. Two types of frames are used for such differences—predicted or P frames, and bi-directional interpolated or B frames.

[0005] P frames generally are encoded with reference to a past frame (either an I frame or a previous P frame), and, in general, are used as a reference for subsequent P frames. P frames receive a fairly high amount of compression. B frames provide the highest amount of compression but require both a past and a future reference frame in order to be encoded. Bi-directional frames are never used for reference frames in standard compression technologies.

[0006] Macroblocks are regions of image pixels. For MPEG-2, a macroblock is a 16×16 pixel grouping of four 8×8 DCT blocks, together with one motion vector for P frames, and one or two motion vectors for B frames. Macroblocks within P frames may be individually encoded using either intra-frame or inter-frame (predicted) coding. Macroblocks within B frames may be individually encoded using intra-frame coding, forward predicted coding, backward predicted coding, or both forward and backward (i.e., bi-directionally interpolated) predicted coding. A slightly different but similar structure is used in MPEG-4 video coding.

[0007] After coding, an MPEG data bitstream comprises a sequence of I, P, and B frames. A sequence may consist of almost any pattern of I, P, and B frames (there are a few minor semantic restrictions on their placement). However, it is common in industrial practice to have a fixed pattern (e.g., IBBPBBPBBPBBPBB).

[0008] MPEG Color Space Representation

[0009] MPEG-1, MPEG-2, and MPEG-4 all utilize a Y, U, V color space for compression. There is a choice of luminance equation, but a typical conversion transformation between RGB (red-green-blue) to a YUV representation is expressed as:

[0010] Y=0.59 G+0.29 R+0.12 B

[0011] U=R−Y

[0012] V=B−Y

[0013] The Y luminance factors for green range from 0.55 up to 0.75, depending upon the color system. The factors for red range from 0.2 to 0.3, and the factors for blue range from 0.05 to 0.15.

[0014] This transformation can be cast as a matrix transformation, which is a linear operator intended for use on linear signals. However, this simple transformation is performed in MPEG 1, 2, and 4 in the non-linear video space, yielding various artifacts and problems.

[0015] It is typical in MPEG to reduce the resolution of the U and V chroma channels to achieve higher compression. The most commonly used reduction of resolution is to use half resolution both vertically and horizontally. MPEG-2 supports full resolution chroma, as well as half resolution horizontally. However, the most commonly used MPEG-2 profiles, Main Profile at Main Level (MP@ML) and Main Profile at High Level (MP@HL), use half resolution horizontally and vertically. MPEG-4 versions 1 and 2 use half resolution vertically and horizontally. Note that full chroma resolution is often called 4:4:4, half chroma horizontal resolution is often called 4:2:2, and half vertical and horizontal resolution is often called 4:2:0. (It should be noted that the 4:x:x nomenclature is flawed in its meaning and derivation, but it is common practice to use it to describe the chroma resolution relationship to luminance.)

[0016] The filter which reduces the horizontal and vertical chroma resolution under the various MPEG standards is applied to non-linear video signals as transformed into the U and V color representation. When the inverse transformation is applied to recover RGB, the non-linear signals and the filters interact in such a way as to produce artifacts and problems. These problems can be generalized as “crosstalk” between the Y luminance and the U and V chroma channels, along with spatial aliasing.

[0017] Further information on linear versus non-linear representations and transformations may be found in “The Use of Logarithmic and Density Units for Pixels” by Gary Demos, presented at the October 1990 SMPTE conference, and published in the SMPTE Journal (October 1991, vol. 100, no. 10). See also “An Example Representation for Image Color and Dynamic Range which is Scalable, Interoperable, and Extensible” by Gary Demos, presented at the October 1993 SMPTE conference and published in the proceedings and preprints. These papers describe the benefits of logarithmic and linear spaces at various stages of the image compression processing pipeline, and are hereby incorporated by reference.

[0018] Chroma Sub-Sampling

[0019] The reason for reducing chroma resolution for U and V is that the human visual system is less sensitive to changes in U and V than it is to changes in luminance, Y. Since Y is mostly green, and U and V are mostly red, and blue respectively, this can also be described as a human visual sensitivity being higher for green than for red and blue. However, although U and V are treated the same in MPEG-1, MPEG-2, and MPEG-4, the human visual system is more sensitive to U (with its red component) than to V (with its blue component).

[0020] This difference in chroma sensitivity is embodied in the 1951 NTSC-2 color standard that is used for television. NTSC-2 uses a YIQ color space, where I and Q are similar to U and V (with slightly different weightings). That is, the I channel primarily represents red minus luminance and the Q channel primarily represents blue minus luminance. In NTSC-2, the luminance is given 4.5 MHz of analog bandwidth, and the I chroma channel is given 1.5 MHz of analog bandwidth. The Q channel, representing the blue-yellow axis, is given only 0.5 MHz of analog bandwidth.

[0021] Thus, the NTSC-2 television system allocates three times as much information to the I channel than it does to the Q channel, and three times as much information to the Y luminance channel than to the I channel. Therefore, the bandwidth ratio between the Y luminance channel and the Q (blue minus luminance) channel is nine. These MPEG YUV and NTSC-2 relationships are summarized in the following table:

Ratio of Chroma Resolution to Luminance

[0022] Clearly there is a greater difference in treatment between the luminance channel and the U and V channels under the MPEG standards than the luminance and I and Q channels in the NTSC-2 standard.

SUMMARY

[0023] The invention is directed to methods, systems, and computer programs for improving compressed image chroma information.

[0024] More particularly, in one aspect of the invention, a color video image may be improved by increasing the red resolution for an RGB representation (or the U resolution for a YUV representation) above the resolution used for blue (or V). Using lower resolution for the blue color component means less information needs to be compressed, such as in a motion compensated color video image compression system. This aspect of the invention includes a method, system, and computer program for compressing image chroma information of a color video image in a video image compression system by selecting a resolution for a red color component of the color video image that is higher than the resolution for a blue color component of the color video image.

[0025] Another aspect of the invention is a technique for reducing the level of chroma noise that results from any given value of the quantization parameter (QP) used during compression, thereby improving image quality. This is accomplished by utilizing a lower value of QP for the U (=R−Y) channel than for the Y channel. Similarly, the quality of the V (=B−Y) channel may also be improved by utilizing a lower QP value for the V channel than for the Y channel.

[0026] Another aspect of the invention is a technique useful when higher compression is required. In this aspect, a positive QP bias is applied to the QP value for the Y channel for use with either or both of the U and V chroma channels.

[0027] Another aspect of the invention is use of a logarithmic representation to benefit image coding. Logarithmic coding, when feasible, can improve coding efficiency for YUV color space representations of images originally represented as linear RGB pixel values. At other processing steps, a conversion to and from linear representations can be beneficial.

[0028] Another aspect of the invention is a method for improving the video characteristics of a color video image in a video compression system, including: selecting a set of image channels to represent the color video image, including a luminance channel and n chroma channels, where n is at least three; and compressing the luminance channel and the n additional chroma channels to a compressed video image.

[0029] The details of one or more embodiments of the invention are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the invention will be apparent from the description and drawings, and from the claims.

DESCRIPTION OF DRAWINGS

[0030]FIG. 1 is a flowchart showing an illustrative method (which may be computer implemented) for increasing the resolution for U above the resolution used for V in a YUV color space representation.

[0031]FIG. 2 is a flowchart showing an illustrative method (which may be computer implemented) for applying a QP bias for chroma channels.

[0032]FIG. 3 is a flowchart showing an illustrative method (which may be computer implemented) for logarithmic coding of luminance and chroma information.

[0033]FIG. 4 is a flowchart showing an illustrative method (which may be computer implemented) for coding additional chroma channels in an image compression system.

[0034] Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

[0035] Improved Color Coding Precision

[0036] As the quality of images improves with respect to the attributes of reduced noise, extended dynamic range, and extended color range, human sensitivity to color also increases. In particular, it has been observed that red in an RGB representation (or U in a YUV representation) often requires higher precision and clarity than is commonly used in video compression.

[0037] Unless blue is being used for processing (such as blue-screen special effects compositing or image analysis), human sensitivity to the blue-yellow chroma axis, as embodied by either blue or V, is adequately addressed by half resolution sampling horizontally and vertically. Thus, one quarter of the total number of pixels of an image provides sufficient quality for representing the blue or V chroma axis. However, unlike blue and V, one-half resolution coding of red and/or U is sometimes insufficient in quality with respect to large wide-dynamic range displays and projectors.

[0038] Thus, an image may be improved by increasing the red resolution for an RGB representation (or the U resolution for a YUV representation) above the resolution used for blue (or V). Using lower resolution for the blue color component means less information needs to be compressed, such as in a motion compensated color video image compression system.

[0039] In accordance with the invention, there are three preferred methods of maintaining increased red (or U) resolution with respect to a downfiltered blue (or V) resolution:

[0040] 1) Use full resolution for red and/or U;

[0041] 2) Use one-half resolution on only one chroma axis, either vertically or horizontally, for red and/or U; or

[0042] 3) Use a filtered resolution between full size and one-half, such as ⅔ or ¾, on one or both chroma axes for red and/or U.

[0043]FIG. 1 is a flowchart showing an illustrative method (which may be computer implemented) utilizing higher resolution for U than the resolution used for V in a YUV color space representation (a similar method may be applied to an RGB color space representation):

[0044] Step 101: In an image compression system utilizing a YUV color space representation, downsize filter the V (=B−Y) channel of an input image to one-half resolution horizontally, and optionally to one-half resolution vertically.

[0045] Step 102: Downsize filter the U (=R−Y) channel of the image to a resolution higher than the V (=B−Y) channel, preferably being one of:

[0046] a) full resolution;

[0047] b) between one-half and full resolution horizontally, but full resolution vertically;

[0048] c) between one-half and full resolution horizontally and vertically;

[0049] d) between one-half and full resolution vertically, but full resolution horizontally.

[0050] Step 103: Compress the YUV image (having luminance Y and the downsize filtered U and V chroma information) using an MPEG-like compression system.

[0051] Step 104: Decompress the images into Y, U, and V channels (usually in a different computer).

[0052] Step 105: Convert the U and V channels to full resolution, using the appropriate resolution increase (i.e., the reciprocal of the downsize filter factor used in Step 101 above for V and Step 102 above for U).

[0053] Step 106: Optionally, convert the YUV picture to an RGB image for viewing, analysis, or further processing.

[0054] Differential QP Bias for Chroma

[0055] Co-pending U.S. patent application Ser. No. 09/798,346, entitled “High Precision Encoding and Decoding of Video Images” and assigned to the assignee of the present invention (which is hereby incorporated by reference), teaches various aspects of the use of the quantization parameter (QP) during compression. Another aspect of the present invention is a technique for reducing the level of chroma noise that results from any given value of the quantization parameter (QP) used during compression, thereby improving image quality. This is accomplished by utilizing a lower value of QP for the U (=R−Y) channel than for the Y channel. Similarly, the quality of V (=B−Y) may also be improved by utilizing a lower QP value for the V channel than for the Y channel.

[0056] A simple method of implementing a reduced chroma QP value is to subtract a constant value from the QP value used for the Y (luminance) channel. Alternatively, a separate constant value (lower than the QP value for Y) might be used for each of U and V. For example, “2” might be subtracted from the QP value for Y to yield the QP value for U, and “1” might be subtracted for the QP value for Y to yield the QP value for V. Any useful value of the amount to subtract can be used, limited only by a minimum value of “1” for the applied QP value.

[0057] This method works for constant QP values (variable bit rate). It also works as well for variable QP values (e.g., in both constant and variable bit rate motion compensated compression systems), since the instantaneous QP value can be biased by subtracting a specified difference value from the QP value for Y to yield a QP value for each of U and V.

[0058] Further, the range of these differential chroma-biased QP values can be extended using the extended QP range function or lookup, as described in the “High Precision Encoding and Decoding of Video Images” patent application referenced above.

[0059] It is necessary to signal the U and V bias values from the encoder to the decoder unless a pre-arranged value is used. These can be specified once, for example, for each session, group of pictures (GOP), frame, or image region.

[0060]FIG. 2 is a flowchart showing an illustrative method (which may be computer implemented) for applying a QP bias for chroma channels:

[0061] Step 201: In an image compression system, reduce the QP value for each of the U and V chroma channels by a selected value (which may be different for each channel).

[0062] Step 202: Utilize this reduced QP value for the U and V chroma channel compressions, respectively.

[0063] Step 203: Optionally, if variable QP values are used, ensure that the reduced U and V QP value is at least

[0064] Step 204: Unless a pre-set bias is to be used, signal or convey the QP value reduction amount to the decoder as often as it may change (once at a minimum).

[0065] Step 205: Decompress (usually in a different computer) the signal using the appropriate QP value for U and V (again ensuring that the reduced QP value is at least “1”).

[0066] Step 206: Optionally, view the decompressed images, or use the images for additional processing or analysis.

[0067] Another aspect of the invention is a technique useful when higher compression is required. In this aspect, a positive QP bias is applied to the QP value for the Y channel for use with either or both of the U and V chroma channels (preferably checking against a QP maximum value of a compression system, if any). Separate bias can be used for each of the U and V channels. Otherwise, the steps of such an embodiment would be similar to those shown in FIG. 2.

[0068] Logarithmic Coding of Luminance and Chroma

[0069] The paper entitled “The Use of Logarithmic and Density Units for Pixels,” referenced above, describes the benefits of a logarithmic representation for dynamic range. Log representations of a matching dynamic range are somewhat similar to commonly used video transfer functions. Even though similar, the logarithmic representation is more optimal in extensibility, calibration usage, and in orthogonality of color channels than are the various commonly used video representations.

[0070] Another aspect of the invention is use of a logarithmic representation to benefit image coding. It has been discovered that logarithmic coding, when feasible, can improve coding efficiency for YUV color space representations of images originally represented as linear RGB pixel values (such as at the sensor of a camera). At other processing steps, a conversion to and from linear representations can be beneficial.

[0071] As described in the “High Precision Encoding and Decoding of Video Images” patent application referenced above, chroma crosstalk with luminance is minimized when:

[0072] Ylog=Log(Wr*R+Wg*G+Wb*B)

[0073] U=Log(R)−Ylog

[0074] V=Log(B)−Ylog

[0075] where Wr, Wg, and Wb are the linear weightings for the red, green, and blue components of luminance, and where R, G, and B represent a linear light space. These relationships are useful in applying this aspect of the invention.

[0076]FIG. 3 is a flowchart showing an illustrative method (which may be computer implemented) for logarithmic coding of luminance and chroma information:

[0077] Step 301: In an image compression system, perform the following transformation on input (e.g., directly from a video camera) linear R, G, and B pixel values:

[0078] Ylog=Log(Wr*R+Wg*G+Wb*B)

[0079] U=Log(R)−Ylog

[0080] V=Log(B)−Ylog

[0081] where Wr, Wg, and Wb are the linear weightings for the red, green, and blue components of luminance.

[0082] Step 302: Optionally, reduce the resolution of the U and V chroma channels (as described above).

[0083] Step 303: Perform motion-compensated compression on this Y, U, and V representation of the moving image.

[0084] Step 304: Decompress the compressed images to restore Y, U, and V color components of the moving image (usually in a different computer).

[0085] Step 305: If optional Step 302 was applied, reverse the resolution reduction to restore full U and V resolution.

[0086] Step 306: Restore the linear R, G, and B pixel values using the following transformation:

[0087] R=anti-log(Y+U)

[0088] B=anti-log(Y+V)

[0089] G=(anti-log(Y)−Wr*R−Wb*B)/Wg

[0090] Step 307: Optionally, convert to other video RGB representations (alternatively, may be done in lieu of Step 306 rather than in addition to Step 306).

[0091] Additional Chroma Axes

[0092] In extended dynamic range and extended contrast range images, it may be beneficial to augment visible wavelength channels with additional channels of image information, both visible and non-visible.

[0093] The range of colors available from any given set of red, green, and blue primaries does not include all possible visible colors. The combining of proportions of red, green, and blue primary colors to create other visible colors such as yellow, orange, cyan, and brown, is a property of the human visual system known as the “metamerism”.

[0094] As pointed out in the paper entitled “An Example Representation for Image Color and Dynamic Range which is Scalable, Interoperable, and Extensible”, referenced above, it is possible to add additional color primaries to the three primaries of red, green, and blue. In particular, cyan, magenta, and yellow color primaries help to extend the color gamut beyond the range available from most common red, green, and blue primary values. Further, violet and ultraviolet (which brightens phosphorescent colors) can also be conveyed.

[0095] Beyond the visible colors, invisible infrared wavelengths have proven useful in penetrating clouds and haze, and in seeing in the dark. Ultraviolet wavelengths can also be useful for seeing low-amplitude visible image details, such as fingerprints and surface coatings.

[0096] Further, even in the visible wavelengths, various materials (e.g., smog and underwater algae) often reduce the amount of contrast or dynamic range of some wavelengths. This is why smog can appear brown, giving a brown tint to all objects in the distance, having reduced the blue contrast and dynamic range. This is also why underwater photography can appear green, blue-green, or blue, since the red end of the visible spectrum is reduced in contrast and dynamic range.

[0097] The logarithmic relationships between Y, U, and V, as described above, will optimize the coding of color relationships for visible light.

[0098] In this aspect of the invention, additional chroma channels are added to the channels encoding three primary wavelengths, typically embodied by RGB or YUV representations. Further, when using a YUV color space, it is also possible to change the makeup of the Y (luminance) channel to favor the highest amplitude image signals. Thus, for example, the green visible channel might be coded using its own chroma channel, with luminance moving to other wavelength regions. This concept can be extended to where Y luminance is infrared, with red, green, and blue (and perhaps other visible and non-visible primaries) each having their own chroma channels.

[0099] In accordance with this aspect of the invention, for each new chroma channel, the following should be determined:

[0100] 1) Should the channel be coded differentially from one or more other channels (usually from luminance, such as U=R−Y)?

[0101] 2) Should the channel be given full resolution with respect to luminance, or can resolution be reduced without impairing the image quality for a given intended usage?

[0102] The determination in 1) is based upon the correlation of each coded channel with other channels. For example, ultraviolet or far-infrared wavelength images may be relatively uncorrelated to visible wavelengths, or to each other. In such a case, these channels might be coded without reference to other channels. However, any visible wavelengths are highly correlated, and thus can almost always benefit from being coded with respect to each other.

[0103] Based upon these determinations, a set of image channels can be selected, usually exceeding (or replacing and exceeding) the three primary channels (e.g., YUV). For example, the set of selected image channels may comprise a Y′ luminance channel, and n chroma channels, such as a U′ first chroma channel, a V′ second chroma channel, and an X′ third chroma channel.

[0104] Using this example, and applying motion compensated compression, the selected value of Y′ would be coded with full resolution, and the various other chroma channels (U′, V′, X′) would be differentially or independently coded. All channels can utilize the same motion vector and macroblock motion compensation structure as would be used for conventional YUV representations, except that there would be additional channels. Each such channel would utilize an appropriate resolution with respect to Y (as determined in step 2 above). In addition, a QP bias (as described above) can be independently applied to each chroma channel, to ensure that the desired compression chroma quality is achieved.

[0105] Even when applied only to visible wavelengths, additional chroma channels can ensure not only extended color range and more accurate color, but also allow additional clarity, detail, and noise fidelity to be applied to such highly visible colors as magenta, orange, yellow, and aqua-cyan. These benefits can be particularly significant for wide-dynamic range and wide-contrast range images.

[0106]FIG. 4 is a flowchart showing an illustrative method (which may be computer implemented) for coding additional chroma channels in an image compression system:

[0107] Step 401: In an image compression system, determine an optimal luminance representation for an image, selected based upon widest dynamic range and highest resolution, including optional non-visible wavelength image signals.

[0108] Step 402: Determine n additional chroma channels to represent the image, where n is at least three.

[0109] Step 403: Optionally, for each chroma channel, determine whether it is beneficial to code differentially with respect to luminance and/or one or more other chroma channels.

[0110] Step 404: Determine the resolution desired for each chroma channel image signal from an input with respect to the luminance image signal, such resolution being equal to or less than the resolution of the luminance, and optionally apply a resolution reduction.

[0111] Step 405: Compress the Y+n chroma image signals using motion compensated compression.

[0112] Step 406: Decompress the Y+n chroma images (usually in a different computer).

[0113] Step 407: If resolution reduction was applied, restore the original resolutions of the chroma channels.

[0114] Step 408: Combine each chroma channel with its differential counterpart, if any, from Step 403 above.

[0115] Step 409: Optionally, perform any of the following:

[0116] a) Convert the chroma channels to a viewing space, such as RGB, or to spaces having more than three primaries, and view as a true-color image;

[0117] b) Perform the conversion of a) but view as a false-color image (such as mapping infrared to green);

[0118] c) Use the chroma channels without conversion for processing and/or analysis.

[0119] As another option, each chroma channel may have a biased QP value applied (either increasing or decreasing), relative to the QP value used for the luminance channel, to achieve a desired level of quality for each chroma channel (i.e., trading off chroma noise versus higher degree of compression).

[0120] Implementation

[0121] The invention may be implemented in hardware or software, or a combination of both (e.g., programmable logic arrays). Unless otherwise specified, the algorithms included as part of the invention are not inherently related to any particular computer or other apparatus. In particular, various general purpose machines may be used with programs written in accordance with the teachings herein, or it may be more convenient to construct more specialized apparatus (e.g., integrated circuits) to perform particular functions. Thus, the invention may be implemented in one or more computer programs executing on one or more programmable computer systems each comprising at least one processor, at least one data storage system (including volatile and non-volatile memory and/or storage elements), at least one input device or port, and at least one output device or port. Program code is applied to input data to perform the functions described herein and generate output information. The output information is applied to one or more output devices, in known fashion.

[0122] Each such program may be implemented in any desired computer language (including machine, assembly, or high level procedural, logical, or object oriented programming languages) to communicate with a computer system. In any case, the language may be a compiled or interpreted language.

[0123] Each such computer program is preferably stored on or downloaded to a storage media or device (e.g., solid state memory or media, or magnetic or optical media) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer system to perform the procedures described herein. The inventive system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer system to operate in a specific and predefined manner to perform the functions described herein.

[0124] A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, some of the steps described above may be order independent, and thus can be performed in an order different from that described. Accordingly, other embodiments are within the scope of the following claims.

Référencé par
Brevet citant Date de dépôt Date de publication Déposant Titre
US6937758 *7 août 200130 août 2005Hewlett-Packard Development Company, L.P.Method and apparatus for reproducing sepia-tone images
US726615028 juin 20024 sept. 2007Dolby Laboratories, Inc.Interpolation of video compression frames
US7324138 *27 janv. 200429 janv. 2008Pentax CorporationFalse-color reducing device
US742863921 juil. 200523 sept. 2008Dolby Laboratories Licensing CorporationEncrypted and watermarked temporal and resolution layering in advanced television
US77609498 févr. 200720 juil. 2010Sharp Laboratories Of America, Inc.Methods and systems for coding multiple dynamic range images
US782667323 janv. 20072 nov. 2010Sharp Laboratories Of America, Inc.Methods and systems for inter-layer image prediction with color-conversion
US784007831 mars 200723 nov. 2010Sharp Laboratories Of America, Inc.Methods and systems for image processing control based on adjacent block characteristics
US785309314 juil. 200614 déc. 2010Samsung Electronics Co., Ltd.System, medium, and method encoding/decoding a color image using inter-color-component prediction
US788547131 mars 20078 févr. 2011Sharp Laboratories Of America, Inc.Methods and systems for maintenance and use of coded block pattern information
US789452431 juil. 200722 févr. 2011Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US79611962 mai 200614 juin 2011Koninklijke Philips Electronics N.V.Cost effective rendering for 3D displays
US801444524 févr. 20066 sept. 2011Sharp Laboratories Of America, Inc.Methods and systems for high dynamic range video coding
US805032325 sept. 20091 nov. 2011Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US805971431 mars 200715 nov. 2011Sharp Laboratories Of America, Inc.Methods and systems for residual layer scaling
US811175413 oct. 20117 févr. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US813082231 mars 20076 mars 2012Sharp Laboratories Of America, Inc.Methods and systems for conditional transform-domain residual accumulation
US813963813 oct. 201120 mars 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US81396397 janv. 201120 mars 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US81396407 janv. 201120 mars 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US81396417 janv. 201120 mars 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US81447744 nov. 201127 mars 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US814991213 oct. 20113 avr. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US816014213 oct. 201117 avr. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US81751584 janv. 20088 mai 2012Sharp Laboratories Of America, Inc.Methods and systems for inter-layer image prediction parameter determination
US81949974 déc. 20065 juin 2012Sharp Laboratories Of America, Inc.Methods and systems for tone mapping messaging
US8208629 *20 nov. 200726 juin 2012Vimicro CorporationVideo monitoring system with video signal encrypted and the method for the same
US821350713 oct. 20113 juil. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US8218021 *8 janv. 201010 juil. 2012Canon Kabushiki KaishaImage capture apparatus, method of controlling the same, and program
US823353623 janv. 200731 juil. 2012Sharp Laboratories Of America, Inc.Methods and systems for multiplication-free inter-layer image prediction
US82491587 janv. 201121 août 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US82799297 janv. 20112 oct. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US82900437 févr. 201216 oct. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US832580913 oct. 20114 déc. 2012Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US83742372 mars 200112 févr. 2013Dolby Laboratories Licensing CorporationHigh precision encoding and decoding of video images
US837972014 mars 201219 févr. 2013Dolby Laboratories Licensing CorporationRegion sizing for macroblocks
US84010787 janv. 201119 mars 2013Dolby Laboratories Licensing CorporationInterpolation of video compression frames
US842254831 mars 200716 avr. 2013Sharp Laboratories Of America, Inc.Methods and systems for transform selection and management
US848867012 févr. 201316 juil. 2013Dolby Laboratories Licensing CorporationHigh precision encoding and decoding of video images
US850352423 janv. 20076 août 2013Sharp Laboratories Of America, Inc.Methods and systems for inter-layer image prediction
US852649613 nov. 20123 sept. 2013Dolby Laboratories Licensing CorporationRegion sizing for macroblocks
US853217631 mars 200710 sept. 2013Sharp Laboratories Of America, Inc.Methods and systems for combining layers in a multi-layer bitstream
US854273820 nov. 201224 sept. 2013Dolby Laboratories Licensing CorporationRegion sizing for macroblocks
US855951310 avr. 201315 oct. 2013Dobly Laboratories Licensing CorporationReferenceable frame expiration
US85769077 janv. 20115 nov. 2013Dolby Laboratories Licensing CorporationHigh precision encoding and decoding of video images
US85941887 janv. 201126 nov. 2013Dolby Laboratories Licensing CorporationHigh precision encoding and decoding of video images
US20080195977 *12 févr. 200814 août 2008Carroll Robert CColor management system
US20100194916 *8 janv. 20105 août 2010Canon Kabushiki KaishaImage capture apparatus, method of controlling the same, and program
US20130156311 *17 avr. 201220 juin 2013Samsung Electronics Co., Ltd.Method and apparatus for processing image signal
EP2254339A227 juin 200324 nov. 2010Dolby Laboratories Licensing CorporationImproved interpolation of compressed video frames
EP2262268A227 juin 200315 déc. 2010Dolby Laboratories Licensing CorporationImproved interpolation of video compression frames
EP2458863A227 juin 200330 mai 2012Dolby Laboratories Licensing CorporationImproved interpolation of compressed video frames
EP2458864A227 juin 200330 mai 2012Dolby Laboratories Licensing CorporationImproved interpolation of compressed video frames
WO2007027009A1 *14 juil. 20068 mars 2007Samsung Electronics Co LtdSystem, medium, and method encoding/decoding a color image using inter-color-component prediction
WO2008130069A1 *24 avr. 200730 oct. 2008Sang-Hwan ChoReal-time multilayer image synthesis recording system and method, and a recording medium using the system and method
Classifications
Classification aux États-Unis375/240.01, 375/E07.229, 348/386.1, 375/E07.226, 375/E07.185, 375/E07.166, 375/E07.14, 348/E07.045, 375/E07.211
Classification internationaleH04N11/04, H04N7/26, G06T9/00, G06T3/40, H04N7/12, H04N7/30
Classification coopérativeH04N19/00096, H04N19/00315, H04N19/00781, H04N7/12, G06T9/007, G06T3/4015
Classification européenneG06T3/40C, G06T9/00T, H04N7/12, H04N7/26A6C8, H04N7/26A4Q2, H04N7/50, H04N7/26A8U
Événements juridiques
DateCodeÉvénementDescription
8 sept. 2004ASAssignment
Owner name: DOLBY LABORATORIES LICENSING CORPORATION, CALIFORN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DEMOGRAFX, INC.;DOLBY LABORATORIES, INC.;REEL/FRAME:015116/0001;SIGNING DATES FROM 20030605 TO 20030905
Owner name: DOLBY LABORATORIES, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DEMOGRAFX, INC.;DOLBY LABORATORIES, INC.;SIGNING DATES FROM 20030605 TO 20030905;REEL/FRAME:015116/0001
5 févr. 2004ASAssignment
Owner name: DOLBY LABORATORIES, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DEMOGRAFX, INC.;REEL/FRAME:014301/0767
Effective date: 20030417
Owner name: DOLBY LICENSING CORPORATION, CALIFORNIA
5 mai 2003ASAssignment
Owner name: DOLBY LABORATORIES, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DEMOGRAFX, INC.;REEL/FRAME:014033/0401
Effective date: 20030407
5 oct. 2001ASAssignment
Owner name: DEMOGRAFX, CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DEMOS, GARY A.;REEL/FRAME:012267/0018
Effective date: 20010925