US20040258301A1 - Lossy JPEG compression/reconstruction using principal components transformation - Google Patents

Lossy JPEG compression/reconstruction using principal components transformation Download PDF

Info

Publication number
US20040258301A1
US20040258301A1 US10/870,422 US87042204A US2004258301A1 US 20040258301 A1 US20040258301 A1 US 20040258301A1 US 87042204 A US87042204 A US 87042204A US 2004258301 A1 US2004258301 A1 US 2004258301A1
Authority
US
United States
Prior art keywords
color
image
intrinsic
color information
color image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/870,422
Inventor
Paul Payton
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lockheed Martin Corp
Original Assignee
Lockheed Martin Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lockheed Martin Corp filed Critical Lockheed Martin Corp
Priority to US10/870,422 priority Critical patent/US20040258301A1/en
Priority to US10/919,397 priority patent/US7194128B1/en
Priority to US10/964,640 priority patent/US7181076B1/en
Priority to US10/985,999 priority patent/US7187798B1/en
Publication of US20040258301A1 publication Critical patent/US20040258301A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/64Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • H04N19/126Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets

Definitions

  • the present invention relates to true color image compression and reconstruction. More particularly, the present invention relates to lossy compression and reconstruction using an image specific color transformation.
  • JPEG (pronounced “jay-peg”) is a standardized image compression mechanism.
  • JPEG stands for Joint Photographic Experts Group, the original name of the committee that wrote the standard.
  • JPEG is designed for compressing either full-color or gray-scale images of natural, real-world scenes. It works well on photographs, naturalistic artwork, and similar material; not so well on lettering, simple cartoons, or line drawings.
  • JPEG handles only still images.
  • JPEG is “lossy,” meaning that the decompressed image isn't quite the same as the one you started with.
  • JPEG achieves much greater compression than is possible with lossless methods.
  • JPEG is designed to be lossy, and thus exploits the known limitations of the human eye. More specifically, the fact that small color changes are perceived less accurately than small changes in brightness. Thus, JPEG is intended for compressing images that will be looked at by humans. In contrast, the small errors introduced by JPEG may be a problem for images intended to be machine-analyzed.
  • a useful property of JPEG is that adjusting compression parameters can vary the degree of lossiness. This means that the image-maker can trade off file size against output image quality. You can make extremely small files if you don't mind poor quality, such as indexing image archives. Conversely, if you aren't happy with the output quality at the default compression setting, you can increase the quality until you are satisfied, and accept lesser compression.
  • JPEG compression algorithm may be implemented in both software and hardware.
  • C-Cubed Microsystems introduced the first JPEG chip for compressing digital video images.
  • Hardware provides the requisite speed for real-time compression.
  • JPEG++ an algorithm described in U.S. Pat. No. 5,014,198, developed by Storm Technology, is an extension to JPEG.
  • JPEG++ allows selected picture areas to be compressed at different ratios depending on the significance of the visual impact to the area in the image.
  • a fixed color space transformation is employed to transform an image from RGB into a luminance/chrominance color space (i.e., “YUV”), where luminance is the first component and chrominance the second and third components.
  • YUV luminance/chrominance color space
  • YCrCb luminance/chrominance color space represented in an unsigned byte form
  • the rationale for using a luminance/chrominance color space is that some chrominance information can be lost in an image since the human eye is less likely to perceive the changes in the chrominance or color component of a reconstructed image. As a result, the chrominance components are subsampled or reduced, while the luminance component is left at full resolution.
  • the present invention is a system, method, and computer program product for compression and reconstruction of a color image using principal components transformation.
  • the method is performed on a computer or other programmable data processing apparatus.
  • the method is performed in combination with the standard JPEG image compression technique.
  • the method receives color image information.
  • the received color image information is converted into intrinsic color information.
  • the intrinsic color information is based on the color image's intrinsic and unique color distribution. This intrinsic color information characterizes the color image in a manner that increases the image quality of a reconstructed image, reduces the size of a compressed file as well as image transmission time.
  • FIG. 1 is a functional block diagram of a computer in which the invention of the present invention can be carried out.
  • FIG. 2 consists of FIGS. 2A-2B, which depict block diagrams of the routines that implement the method of the present invention.
  • FIG. 3 is a flow diagram of the method performed in the computer of FIG. 1, in accordance with the present invention.
  • FIG. 4 is a flow diagram of the conversion function implemented by the method of the present invention.
  • FIG. 5 is a flow diagram of the sampling algorithm performed for generating the mean vector of a color image.
  • FIG. 6 is an illustration of the covariance matrix generated by the conversion function.
  • FIG. 7 is a block diagram of the process for reconstructing a color image, depicted as a block diagram.
  • FIG. 8 is a flow diagram for the method of converting the plurality of intrinsic value sets to numerical value sets.
  • FIG. 9 is a functional block diagram of a remote computer in which the invention of the present invention can be carried out.
  • the present invention is now described more fully hereinafter with reference to the accompanying drawings that show preferred embodiments of the invention.
  • This invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Appropriately, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention.
  • the present invention may be embodied as a method, data processing system, or computer program product. Accordingly, the present invention combines software and hardware to produce the embodiments described in further detail below.
  • the present invention may take the form of a computer program product on a computer-readable storage medium having computer-readable program code means embodied in the medium. Any suitable computer-readable medium may be utilized including hard disks, CD-ROMs, floppy disks, optical storage devices, magnetic storage devices, etc.
  • These computer program instructions may be stored in a computer-readable memory to direct a computer or other programmable data processing apparatus to function in a particular manner, producing an article of manufacture including instruction means which implement the function specified in the flowchart block or blocks.
  • the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed, producing a computer implemented process, such that the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.
  • these computer program instructions are written in the C programming language. It is to be appreciated, however, that these routines may be implemented in any of a wide variety of programming languages.
  • blocks of the flowchart illustrations support combinations of means for performing the specified functions, combinations of steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that each block of the flowchart illustrations, and combinations of blocks in the flowchart illustrations, can be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer instructions.
  • Computer system 100 includes a display interface 102 for visually displaying information to a computer user, a central processing unit (CPU) 104 , hard drive 106 , main memory 108 , network interface 112 , input device interface 114 , and output buffer 124 .
  • CPU 104 is a microprocessor, such as an INTEL PENTIUM® processor, but may also be any processor that executes program instructions in order to carry out the functions of the present invention.
  • Input device interface 114 provides the capability to input data to computer system 100 .
  • input device interface 114 may include a keyboard (not shown) or a mouse (not shown).
  • Network interface 112 provides for data to be transmitted and received over a network.
  • Systems Memory 108 stores data, such as compression routine 116 , reconstruction routine 118 , operating system 120 , and a plurality of data files 122 .
  • Compression processing routine 116 and reconstruction processing routine 118 are computer program instructions executed by CPU 104 that may be loaded into systems memory 108 .
  • the routines 116 and 118 implement the functions, as described in detail hereinafter, performed by the present invention.
  • processing routines 116 and 118 may also be stored on computer readable media and used therefrom by computer system 100 to perform the specified functions or steps in accordance with the present invention.
  • Operating system 120 provides overall system functionality.
  • the output buffer 124 in FIG. 1, stores uncompressed image data for display on display 102 .
  • FIG. 2A a more detailed view of the functions implementing the compression routine 116 is depicted.
  • the compression routine includes a conversion function 116 a , a transformation function 116 b , a quantizer function 116 c , and an encoder function 116 d .
  • FIG. 2B the functions implementing the reconstruction routine 118 are shown.
  • Reconstruction routine includes a de-conversion function 118 a , a de-transformation function 118 b , a dequantizer function 118 c , and a decoder function 118 d .
  • the present invention enables the computer system, under the direction of routines 116 a - 116 d and 118 a - 118 d to compress and reconstruct color images with less loss of image quality.
  • the process for compressing a color image is depicted as a block diagram.
  • the compression process begins.
  • the process receives input image information corresponding to a color image obtained and designated for compression.
  • the obtained color image can be one of a scanned raster image, a photograph from a digital camera, or a satellite image, such as Space Imaging's IKONOSTM, CNES/France's SPOT and the United State's Landsat.
  • the image can be obtained and designated in many forms, such as a user initiated download.
  • the input image information includes a plurality of numerical value sets representing the obtained color image in one of a plurality of normal color space signal formats.
  • a normal color space signal format is a set of three numerical values which characterizes an image's colors in a particular color system using spectral weighting functions.
  • the obtained color image is represented in the normal color space signal format RGB.
  • the color image can be represented in the CMYK normal color space signal format.
  • Each set of three numerical values of the plurality of numerical value sets is associated with a pixel in the array of pixels associated with the obtained color image.
  • the set of values in the normal color space signal format of the preferred embodiment is provided as a color triple, such as (0,0,0).
  • Each numerical value in the set corresponds to a color component used by the color system.
  • the color components are used in combination by the particular color system to represent colors. Variation of the numerical values in a set varies the represented color of the associated pixel.
  • the set of three numerical values or color triple 0 R ,0 G ,0 B represents the color black, where the numerical values correspond respectively to the red, green, and blue components for generating the color black in the RGB color system.
  • the plurality of numerical value sets enables the display of images for viewing on display 102 , as well as the compression and reconstruction of an image.
  • Step 320 the received input image information is converted into intrinsic color information in response to the CPU 104 executing the conversion function 116 a .
  • the Karhunen-Loeve transformation generates the intrinsic color information.
  • Intrinsic color information is image pixel information provided in a manner that the most information about an image is presented in the first component.
  • the intrinsic color information includes a plurality of value sets for the designated image.
  • the plurality of value sets represents the designated image in a principal components space signal format.
  • the principal components space signal format is based on, and defined by the color image's intrinsic color distribution.
  • Step 330 the CPU 104 , under the instruction of the transformation function 116 b , performs an approximation of the values in the plurality of intrinsic value sets, described more fully below, in response to receiving the intrinsic color information generated in Step 310 .
  • the transformation function 116 b applies trigonometric functions to the intrinsic color information, in accordance with the JPEG discrete cosine transform (“DCT”) compression standard, to generate a plurality of approximation values.
  • DCT JPEG discrete cosine transform
  • the DCT is a relative of the Fourier transform and likewise gives a frequency map. The motivation for doing this is that you can now throw away high-frequency information without affecting low-frequency information.
  • the DCT transform itself is reversible except for roundoff error.
  • the techniques and methods for implementing the JPEG discrete cosine transform are well known in the art.
  • Step 340 the CPU 104 , under the instruction of quantizer function 116 c , performs the quantization process in response to receiving the plurality of approximation values in Step 330 .
  • the quantization process reduces or truncates the plurality of approximation values to a predetermined range of integer values, and thus, reduces the number of bits that are required to represent the approximation values.
  • Quantization is performed by dividing each approximation value by a predetermined value.
  • the predetermined value is obtained from an entry in a quantization table. It will be readily apparent to one having ordinary skill in the art that the entries in the quantization table may vary to optimize operation with a particular type of image data.
  • Step 350 the CPU 104 , under the instruction of encoding function 116 d , performs the encoding process in response to receiving the plurality of quantized approximation values in Step 340 .
  • the encoding process reduces the number of bits that are used to represent the quantized approximation values. The reduction can be accomplished using Huffman coding.
  • the coding replaces subsets of bit information corresponding to quantized approximation values with bit information that more efficiently represents the subsets of bit information.
  • the encoding process generates a reduced stream of bits which compactly represents the quantized approximation values in a non-redundant manner.
  • the reduced bit stream generated by the encoding process corresponds to a compressed representation of the color image.
  • the techniques and methods for encoding information are well known in the art.
  • the reduced bit stream corresponding to the image is stored as a file.
  • the file can be stored in memory of computer 100 .
  • the file can be transmitted to remote computer 900 at remote location using network interface 112 and stored in memory 902 .
  • a user may access the file from memory at a future time for transmission and decompression.
  • the resultant file has dramatic size and image quality improvements over conventional methods.
  • compression-specific non-pixel information generated by the conversion routine 116 a is stored and or transmitted in association with the reduced bit stream representing the quantized approximation values to enable the reconstruction of the color image.
  • the non-pixel data includes the mean vector, the eigenmatrix and scale factors for the image.
  • the non-pixel information is used to restore the color image to near original form during reconstruction.
  • compression-specific non-pixel information is provided inside JPEG application-specific markers or tags and stored in the file as ASCII data.
  • the bit stream may be transmitted to a computer 900 at a remote location using a network interface 112 and stored in memory 902 .
  • One having ordinary skill in the art would recognize and appreciate such transmission modalities include but are not limited to modems and wireless devices.
  • the compression-specific non-pixel information is transmitted with the bit stream using markers or tags, and ultimately used by the remote system to reconstruct the compressed image.
  • the conversion function 116 a of the present invention is now fully set forth in a block diagram.
  • the conversion function implements a Karhunen-Loeve (KL) color transformation to generate intrinsic color information that is specific and unique to an individual color image.
  • KL transform uses a color image's color statistics and color distribution to compute and establish a principal components space having a coordinate system particular to the image.
  • the axes of the principal components space are defined by the color distribution of the image, and thus vary from image to image.
  • Step 400 the KL transform begins.
  • Step 410 input color information, obtained in Step 310 , is received to generate the mean vector for the color image.
  • Each floating-point number of the mean vector corresponds to the average value of the respective color component, as designated by the subscript, of sampled pixels.
  • the floating-point number m R will be the average of the red color component values for the sampled pixels.
  • the process samples every eighth pixel across in a row and down in a column starting from the upper left corner pixel to obtain a sufficient statistical sampling, customarily considered to be greater than two thousand pixels.
  • the sampling frequency and sampling set size can be modified without departing from the scope and spirit of the invention claimed herein.
  • Step 500 the process starts by locating the pixel in the upper left corner of the color image.
  • Step 510 the process determines whether there are any remaining rows of pixels in the image to be sampled. If there are rows in the image to be sampled, the process proceeds to Step 520 where the sampling process identifies an eighth row of pixels in the image. If there are no rows to be sampled in image, the process jumps to Step 560 .
  • Step 530 the process determines whether there are any remaining columns in the row of pixels to be sampled.
  • Step 540 the sampling process identifies an eighth column in the row. If there are no columns to be sampled in the row, the process returns to Step 510 .
  • Step 550 each value in the numerical value set for the pixel having the position corresponding to the identified row and column is taken and stored for subsequent statistical processing.
  • Step 560 the sampling process terminates.
  • Step 420 all the numerical values taken for a respective color component from sampled pixels are added together to calculate a total component value for the respective color component. For example, all the red color component values from the sample pixels are added to produce a red component total value. The green and blue components total values are generated in a like manner. Once calculated, each of the color component totals are divided by the number of pixels sampled producing the mean vector of the image. The generated mean vector is stored for later use as non-pixel data.
  • the covariance matrix is computed using the mean vector generated in Step 410 .
  • the covariance matrix is a 3 ⁇ 3 floating point matrix.
  • the covariance matrix is generated for the sampled points by subtracting each floating-point number of the mean vector from its corresponding color component value in the numerical value set of a sampled pixel.
  • the 3 ⁇ 3 covariance matrix C is illustrated in FIG. 6 with equations shown for obtaining each entry from the native (r,g,b) pixel triples.
  • Step 440 the statistical color distribution of the obtained and designated color image is used to establish a principal components space.
  • the principal components space is a coordinate system that uses the mean vector as the center of the system. As the center of the principal components space, the mean vector reduces the elimination of color information that has a high concentration in the image.
  • the subscript k ranges from 1 to 3. This can be accomplished using known programming packages for solving eigensystems (e.g., LINPACK, EISPACK).
  • the first eigenvector generated represents the first coordinate axis in principal components space. This first eigenvector passes through the center of the principal components space in a direction that explains the most color variation from the mean vector.
  • the first value in a value set of the intrinsic color information corresponds to a coordinate on the first coordinate axis.
  • the second eigenvector generated represents the second coordinate axis in principal components space. The second eigenvector is orthogonal to the first eigenvector and explains as much of the remaining color variance as possible.
  • the second value in a value set of the intrinsic color information corresponds to a coordinate on the second coordinate axis.
  • the third eigenvector generated represents the third coordinate axis in principal components space.
  • the third principal component is orthogonal to the first and second eigenvectors and explains the remaining color variation.
  • the third value in a value set of the intrinsic color information corresponds to a coordinate on the third coordinate axis.
  • the first, second and third eigenvectors are arranged into an eigenmatrix T.
  • the matrix T is specific to the image since the eigen vectors are defined by the image's color statistics, and thus varies from image to image.
  • the matrix has the property that the transpose of the matrix T is its own inverse. Accordingly, the eigenmatrix T is used to convert a color image represented, for example, in RGB color space to principal components color space. In a like manner, the transpose of the eigenmatrix T is used to convert a color image represented in principal components color space to RGB color space.
  • the generated eigen matrix T is stored for later use as non-pixel data.
  • Step 450 the sets of numerical values which characterize the image in a normal color space are converted into intrinsic color value sets that characterize the color image in principal components space.
  • the conversion uses the mean vector generated in Step 420 and the eigen matrix generated in Step 440 to generate intrinsic color values that characterize the color image in principal components space.
  • the intrinsic color value sets in principal components space are generated by subtracting the mean vector values from corresponding color component values in a numerical value set and multiplying the results of the subtractions by the eigen matrix T.
  • the intrinsic value sets are a plurality of three floating point values that correspond to the first, second and third principal component space coordinates. This conversion is performed for each numerical value set of a color image to produce a corresponding number of intrinsic color value sets.
  • Step 460 scale factors are generated to enable the principal components space coordinates to be mapped into integer byte values.
  • the scale factors include scale and offset values, in the form of floating point numbers, for each axis in principal components space.
  • To compute the scale and offset values the minimum and maximum principal components space coordinates for each principal components space axis must be identified.
  • scale and offset values are determined to map principal components space coordinates from the range [min . . . max] into the range [0 . . . 255], where [0 . . . 255] is the range of values an unsigned byte quantity can assume.
  • the offset values correspond to the minimum coordinate values associated with each principal coordinate axis.
  • the minimum coordinate value on each axis is selected as the offset for the axis.
  • the scale values correspond to the maximum coordinate values subtracted from the minimum coordinate values for each principal coordinate axis divided by 255.
  • the scale and offset values are stored for later use as non-pixel data.
  • the process terminates.
  • the plurality of intrinsic value sets of the intrinsic color information is provided to the transformation function 116 b described above for approximation and quantization using discrete cosine transformation (DCT).
  • DCT discrete cosine transformation
  • the process for reconstructing a color image is depicted as a block diagram.
  • the reconstruction can be performed on any computer system 100 or 900 having the reconstruction program stored therein.
  • the reconstruction process begins.
  • the process receives a file including information corresponding to an image compressed using the technique described in FIG. 3 through FIG. 6. Accordingly, the information provided in the file is reduced image information and non-pixel data.
  • the CPU 104 under the instruction of decoder function 118 d , performs an inverse encoding process.
  • the inverse encoding process replaces the reduced image information, which is a stream of bits that compactly represents the image in a non-redundant manner, with a bit stream that originally represented the color image. More specifically, the bit stream that originally represented the quantized approximation values is generated.
  • the techniques and methods for decoding information are well known in the art.
  • Step 730 the CPU 104 , under the instruction of dequantization function 118 c , performs an inverse quantization process in response to receiving the bit stream that originally represented the quantized approximation values.
  • the dequantization process returns the plurality of quantized approximation values to there near original range of approximation values.
  • the process is achieved using a quantization table.
  • Step 740 the CPU 104 , under the instruction of the transformation function 118 b , performs an inverse approximation of the original approximation values.
  • the process generates a plurality of value sets that are substantially similar to the original plurality of intrinsic value sets.
  • the transformation function 118 b applies the inverse of the JPEG discrete cosine transform (DCT) to generate the plurality of value sets that are substantially similar to the original plurality of intrinsic value sets.
  • DCT JPEG discrete cosine transform
  • Step 750 the substantially similar plurality of intrinsic value sets are converted back to numerical value sets that characterize the color image in normal color space.
  • the conversion of the intrinsic value sets to numerical value sets is accomplished using the non-pixel data.
  • the process converts the values of the intrinsic value sets from floating point numbers to unsigned byte numbers.
  • Step 760 the process ends.
  • Information corresponding to the numerical values sets are transmitted to the output buffer 124 for display on display interface 102 .
  • Step 800 the process begins.
  • Step 810 each principal coordinate value in an intrinsic value set is multiplied by its corresponding scale factor. This step is repeated for each intrinsic value set that is in the plurality of intrinsic value sets.
  • Step 820 each principal coordinate value in an intrinsic value set is added to its corresponding offset. Like Step 810 , this step is repeated for each intrinsic value set that is in the plurality of intrinsic value sets.
  • Step 830 each intrinsic value set in the plurality of intrinsic value sets is multiplied by the transpose of the eigenmatrix T.
  • Step 840 the mean vector is added to each intrinsic value in the plurality of intrinsic value sets.
  • Step 850 a value of 0.5 is added to each intrinsic value in the plurality of intrinsic value sets.
  • Step 860 each intrinsic value in the plurality of intrinsic value sets is truncated to a whole value. In addition, intrinsic values that are less than zero are made equal to zero and intrinsic values that are greater than 255 are made equal to 255. The process terminates in Step 870 .

Abstract

The present invention is a system, method, and computer program product for compression and reconstruction of a color image using principal components transformation. The method is performed on a computer or other programmable data processing apparatus. The method is performed in combination with the standard JPEG image compression technique. According to the invention, the method receives color image information. The received color image information is converted into intrinsic color information. The intrinsic color information is based on the color image's intrinsic and unique color distribution.

Description

    FIELD OF INVENTION
  • The present invention relates to true color image compression and reconstruction. More particularly, the present invention relates to lossy compression and reconstruction using an image specific color transformation. [0001]
  • BACKGROUND OF THE INVENTION
  • JPEG (pronounced “jay-peg”) is a standardized image compression mechanism. JPEG stands for Joint Photographic Experts Group, the original name of the committee that wrote the standard. JPEG is designed for compressing either full-color or gray-scale images of natural, real-world scenes. It works well on photographs, naturalistic artwork, and similar material; not so well on lettering, simple cartoons, or line drawings. JPEG handles only still images. JPEG is “lossy,” meaning that the decompressed image isn't quite the same as the one you started with. JPEG achieves much greater compression than is possible with lossless methods. JPEG is designed to be lossy, and thus exploits the known limitations of the human eye. More specifically, the fact that small color changes are perceived less accurately than small changes in brightness. Thus, JPEG is intended for compressing images that will be looked at by humans. In contrast, the small errors introduced by JPEG may be a problem for images intended to be machine-analyzed. [0002]
  • A useful property of JPEG is that adjusting compression parameters can vary the degree of lossiness. This means that the image-maker can trade off file size against output image quality. You can make extremely small files if you don't mind poor quality, such as indexing image archives. Conversely, if you aren't happy with the output quality at the default compression setting, you can increase the quality until you are satisfied, and accept lesser compression. [0003]
  • The JPEG compression algorithm may be implemented in both software and hardware. For example, C-Cubed Microsystems introduced the first JPEG chip for compressing digital video images. Hardware provides the requisite speed for real-time compression. JPEG++, an algorithm described in U.S. Pat. No. 5,014,198, developed by Storm Technology, is an extension to JPEG. JPEG++ allows selected picture areas to be compressed at different ratios depending on the significance of the visual impact to the area in the image. [0004]
  • A problem with the traditional JPEG algorithm, and each of the aforementioned techniques, is that they all employ a fixed color space transformation. Generally, a fixed color space transformation is employed to transform an image from RGB into a luminance/chrominance color space (i.e., “YUV”), where luminance is the first component and chrominance the second and third components. To perform the transform a fixed predetermined matrix is employed that transforms the image from a RGB color space into a luminance/chrominance color space represented in an unsigned byte form (i.e., “YCrCb”). The rationale for using a luminance/chrominance color space is that some chrominance information can be lost in an image since the human eye is less likely to perceive the changes in the chrominance or color component of a reconstructed image. As a result, the chrominance components are subsampled or reduced, while the luminance component is left at full resolution. [0005]
  • Unfortunately, the use of a predetermined matrix to execute the transformation does not assure that the most information is presented in the first component because it does not consider the wide variety of possible scene content. More specifically, the transformation does not actively control or attempt to provide the most information about an individual image in the first component. Consequently, all images are treated equally despite the errors that may occur when reconstructing a compressed image, and thus affect image perception. Accordingly, images or applications that have a lower tolerance for loss are compressed at lower ratios since more information in the second and third components is required. This results in larger files, and thus less file storage space. In addition, larger files require significantly more time to transmit from a host to a remote site than smaller files. As a result, a method is needed that provides optimal image compression to improve file storage capacity and transmission time, while reducing image quality degradation. [0006]
  • SUMMARY OF THE INVENTION
  • Based on the above and foregoing, it can be appreciated that there presently exists a need in the art for a computer system and corresponding operating method which overcomes the above-described deficiencies. The present invention was motivated by a desire to overcome the drawbacks and shortcomings of the presently available technology, and thereby fulfill this need in the art. [0007]
  • It is therefore a feature and advantage of the present invention to provide an image compression and reconstruction technique that improves the image quality of a reconstructed image. [0008]
  • It is another feature and advantage of the present invention to reduce image quality degradation at high compression ratios. [0009]
  • It is another feature and advantage of the invention to optimize utilization of file space. [0010]
  • It is a further feature and advantage of the invention to compress a color image utilizing a transformation that is different for each image. [0011]
  • It is another feature and advantage of the invention to generate a transformation based on the color image's color distribution. [0012]
  • It is a further feature and advantage of the invention to reduce transmission time in sending compressed images. [0013]
  • Further features and advantages of the invention will become apparent to those skilled in the art with reference to the accompanying figures and written description below. [0014]
  • The present invention is a system, method, and computer program product for compression and reconstruction of a color image using principal components transformation. The method is performed on a computer or other programmable data processing apparatus. The method is performed in combination with the standard JPEG image compression technique. According to the invention, the method receives color image information. The received color image information is converted into intrinsic color information. The intrinsic color information is based on the color image's intrinsic and unique color distribution. This intrinsic color information characterizes the color image in a manner that increases the image quality of a reconstructed image, reduces the size of a compressed file as well as image transmission time.[0015]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The details of the present invention, both as to its structure and operation can best be understood by referring to the following description with reference to the accompanying drawings in which: [0016]
  • FIG. 1 is a functional block diagram of a computer in which the invention of the present invention can be carried out. [0017]
  • FIG. 2 consists of FIGS. 2A-2B, which depict block diagrams of the routines that implement the method of the present invention. [0018]
  • FIG. 3 is a flow diagram of the method performed in the computer of FIG. 1, in accordance with the present invention. [0019]
  • FIG. 4 is a flow diagram of the conversion function implemented by the method of the present invention. [0020]
  • FIG. 5 is a flow diagram of the sampling algorithm performed for generating the mean vector of a color image. [0021]
  • FIG. 6 is an illustration of the covariance matrix generated by the conversion function. [0022]
  • FIG. 7 is a block diagram of the process for reconstructing a color image, depicted as a block diagram. [0023]
  • FIG. 8 is a flow diagram for the method of converting the plurality of intrinsic value sets to numerical value sets. [0024]
  • FIG. 9 is a functional block diagram of a remote computer in which the invention of the present invention can be carried out.[0025]
  • DETAILED DESCRIPTION OF THE INVENTION
  • The present invention is now described more fully hereinafter with reference to the accompanying drawings that show preferred embodiments of the invention. This invention, however, may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Appropriately, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention. As will be appreciated by one having skill in the art, the present invention may be embodied as a method, data processing system, or computer program product. Accordingly, the present invention combines software and hardware to produce the embodiments described in further detail below. Furthermore, the present invention may take the form of a computer program product on a computer-readable storage medium having computer-readable program code means embodied in the medium. Any suitable computer-readable medium may be utilized including hard disks, CD-ROMs, floppy disks, optical storage devices, magnetic storage devices, etc. [0026]
  • The present invention is described below with reference to flowchart illustrations of methods, apparatus (systems) and computer program products according to the invention. It will be understood that each block of the flowchart illustrations, and combinations of blocks in the flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be loaded onto a general-purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine. These computer program instructions, which execute on the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart block or blocks. These computer program instructions may be stored in a computer-readable memory to direct a computer or other programmable data processing apparatus to function in a particular manner, producing an article of manufacture including instruction means which implement the function specified in the flowchart block or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed, producing a computer implemented process, such that the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. In one implementation, these computer program instructions are written in the C programming language. It is to be appreciated, however, that these routines may be implemented in any of a wide variety of programming languages. [0027]
  • Accordingly, blocks of the flowchart illustrations support combinations of means for performing the specified functions, combinations of steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that each block of the flowchart illustrations, and combinations of blocks in the flowchart illustrations, can be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer instructions. [0028]
  • Referring now to FIG. 1, a block diagram of a computer system is illustrated for implementing the methods and computer program product in accordance with the preferred embodiment of the present invention. [0029] Computer system 100 includes a display interface 102 for visually displaying information to a computer user, a central processing unit (CPU) 104, hard drive 106, main memory 108, network interface 112, input device interface 114, and output buffer 124. As shown, the various components of the system 100 communicate through a system bus 110 or similar architecture. Typically, CPU 104 is a microprocessor, such as an INTEL PENTIUM® processor, but may also be any processor that executes program instructions in order to carry out the functions of the present invention. Input device interface 114 provides the capability to input data to computer system 100. For example, input device interface 114 may include a keyboard (not shown) or a mouse (not shown). Network interface 112 provides for data to be transmitted and received over a network.
  • [0030] Systems Memory 108 stores data, such as compression routine 116, reconstruction routine 118, operating system 120, and a plurality of data files 122. Compression processing routine 116 and reconstruction processing routine 118 are computer program instructions executed by CPU 104 that may be loaded into systems memory 108. The routines 116 and 118 implement the functions, as described in detail hereinafter, performed by the present invention. In addition, processing routines 116 and 118 may also be stored on computer readable media and used therefrom by computer system 100 to perform the specified functions or steps in accordance with the present invention. Operating system 120 provides overall system functionality. The output buffer 124, in FIG. 1, stores uncompressed image data for display on display 102. While the preferred embodiment is implemented on a computer system, one having ordinary skill in the art will recognize that the methods and computer program product in accordance with the present invention can be implemented on any system provided with a central processing unit, input/output circuitry, and a memory, such as a digital camera and the like.
  • In FIG. 2A, a more detailed view of the functions implementing the [0031] compression routine 116 is depicted. The compression routine includes a conversion function 116 a, a transformation function 116 b, a quantizer function 116 c, and an encoder function 116 d. In FIG. 2B, the functions implementing the reconstruction routine 118 are shown. Reconstruction routine includes a de-conversion function 118 a, a de-transformation function 118 b, a dequantizer function 118 c, and a decoder function 118 d. As will be described in detail below the present invention enables the computer system, under the direction of routines 116 a-116 d and 118 a-118 d to compress and reconstruct color images with less loss of image quality.
  • In FIG. 3, the process for compressing a color image is depicted as a block diagram. In [0032] Step 300, the compression process begins. In Step 310, the process receives input image information corresponding to a color image obtained and designated for compression. The obtained color image can be one of a scanned raster image, a photograph from a digital camera, or a satellite image, such as Space Imaging's IKONOS™, CNES/France's SPOT and the United State's Landsat. The image can be obtained and designated in many forms, such as a user initiated download. The input image information includes a plurality of numerical value sets representing the obtained color image in one of a plurality of normal color space signal formats. A normal color space signal format is a set of three numerical values which characterizes an image's colors in a particular color system using spectral weighting functions.
  • In the preferred embodiment, the obtained color image is represented in the normal color space signal format RGB. In an alternative embodiment, the color image can be represented in the CMYK normal color space signal format. Each set of three numerical values of the plurality of numerical value sets is associated with a pixel in the array of pixels associated with the obtained color image. The set of values in the normal color space signal format of the preferred embodiment is provided as a color triple, such as (0,0,0). Each numerical value in the set corresponds to a color component used by the color system. The color components are used in combination by the particular color system to represent colors. Variation of the numerical values in a set varies the represented color of the associated pixel. For example, the set of three numerical values or color triple 0[0033] R,0G,0B represents the color black, where the numerical values correspond respectively to the red, green, and blue components for generating the color black in the RGB color system. The plurality of numerical value sets enables the display of images for viewing on display 102, as well as the compression and reconstruction of an image.
  • In [0034] Step 320, the received input image information is converted into intrinsic color information in response to the CPU 104 executing the conversion function 116 a. The Karhunen-Loeve transformation generates the intrinsic color information. Intrinsic color information is image pixel information provided in a manner that the most information about an image is presented in the first component. The intrinsic color information includes a plurality of value sets for the designated image. The plurality of value sets represents the designated image in a principal components space signal format. The principal components space signal format is based on, and defined by the color image's intrinsic color distribution. The details for converting the received color image information into intrinsic color information Step 320 using the Karhunen-Loeve transformation will be described more fully below with reference to FIG. 4.
  • In [0035] Step 330, the CPU 104, under the instruction of the transformation function 116 b, performs an approximation of the values in the plurality of intrinsic value sets, described more fully below, in response to receiving the intrinsic color information generated in Step 310. The transformation function 116 b applies trigonometric functions to the intrinsic color information, in accordance with the JPEG discrete cosine transform (“DCT”) compression standard, to generate a plurality of approximation values. The DCT is a relative of the Fourier transform and likewise gives a frequency map. The motivation for doing this is that you can now throw away high-frequency information without affecting low-frequency information. The DCT transform itself is reversible except for roundoff error. The techniques and methods for implementing the JPEG discrete cosine transform are well known in the art.
  • In [0036] Step 340, the CPU 104, under the instruction of quantizer function 116 c, performs the quantization process in response to receiving the plurality of approximation values in Step 330. The quantization process reduces or truncates the plurality of approximation values to a predetermined range of integer values, and thus, reduces the number of bits that are required to represent the approximation values. Quantization is performed by dividing each approximation value by a predetermined value. Generally, the predetermined value is obtained from an entry in a quantization table. It will be readily apparent to one having ordinary skill in the art that the entries in the quantization table may vary to optimize operation with a particular type of image data.
  • In [0037] Step 350, the CPU 104, under the instruction of encoding function 116 d, performs the encoding process in response to receiving the plurality of quantized approximation values in Step 340. The encoding process reduces the number of bits that are used to represent the quantized approximation values. The reduction can be accomplished using Huffman coding. The coding replaces subsets of bit information corresponding to quantized approximation values with bit information that more efficiently represents the subsets of bit information. The encoding process generates a reduced stream of bits which compactly represents the quantized approximation values in a non-redundant manner. The reduced bit stream generated by the encoding process corresponds to a compressed representation of the color image. The techniques and methods for encoding information are well known in the art.
  • In [0038] Step 360, the reduced bit stream corresponding to the image is stored as a file. In one embodiment the file can be stored in memory of computer 100. In an alternative embodiment, the file can be transmitted to remote computer 900 at remote location using network interface 112 and stored in memory 902. A user may access the file from memory at a future time for transmission and decompression. The resultant file has dramatic size and image quality improvements over conventional methods. In addition, compression-specific non-pixel information generated by the conversion routine 116 a is stored and or transmitted in association with the reduced bit stream representing the quantized approximation values to enable the reconstruction of the color image.
  • The non-pixel data includes the mean vector, the eigenmatrix and scale factors for the image. The non-pixel information is used to restore the color image to near original form during reconstruction. In the preferred embodiment, compression-specific non-pixel information is provided inside JPEG application-specific markers or tags and stored in the file as ASCII data. In an alternative embodiment, the bit stream may be transmitted to a [0039] computer 900 at a remote location using a network interface 112 and stored in memory 902. One having ordinary skill in the art would recognize and appreciate such transmission modalities include but are not limited to modems and wireless devices. The compression-specific non-pixel information is transmitted with the bit stream using markers or tags, and ultimately used by the remote system to reconstruct the compressed image.
  • In FIG. 4, the [0040] conversion function 116 a of the present invention, discussed generally above in FIG. 3, is now fully set forth in a block diagram. The conversion function implements a Karhunen-Loeve (KL) color transformation to generate intrinsic color information that is specific and unique to an individual color image. The KL transform uses a color image's color statistics and color distribution to compute and establish a principal components space having a coordinate system particular to the image. The axes of the principal components space are defined by the color distribution of the image, and thus vary from image to image.
  • In [0041] Step 400, the KL transform begins. In Step 410, input color information, obtained in Step 310, is received to generate the mean vector for the color image. The mean vector consists of three floating-point numbers and is represented by the formula m=(mR mG mB)T. Each floating-point number of the mean vector corresponds to the average value of the respective color component, as designated by the subscript, of sampled pixels. For example, the floating-point number mR will be the average of the red color component values for the sampled pixels. In the preferred embodiment, the process samples every eighth pixel across in a row and down in a column starting from the upper left corner pixel to obtain a sufficient statistical sampling, customarily considered to be greater than two thousand pixels. One having ordinary skill in the art will recognize that the sampling frequency and sampling set size can be modified without departing from the scope and spirit of the invention claimed herein.
  • Referring briefly to FIG. 5, the sampling algorithm performed in [0042] Step 410 is provided in a flowchart. In Step 500, the process starts by locating the pixel in the upper left corner of the color image. In Step 510, the process determines whether there are any remaining rows of pixels in the image to be sampled. If there are rows in the image to be sampled, the process proceeds to Step 520 where the sampling process identifies an eighth row of pixels in the image. If there are no rows to be sampled in image, the process jumps to Step 560. In Step 530, the process determines whether there are any remaining columns in the row of pixels to be sampled. If there are columns in the row of pixels to be sampled, the process proceeds to Step 540 where the sampling process identifies an eighth column in the row. If there are no columns to be sampled in the row, the process returns to Step 510. In Step 550, each value in the numerical value set for the pixel having the position corresponding to the identified row and column is taken and stored for subsequent statistical processing. In Step 560, the sampling process terminates.
  • Returning again to FIG. 4, in [0043] Step 420 all the numerical values taken for a respective color component from sampled pixels are added together to calculate a total component value for the respective color component. For example, all the red color component values from the sample pixels are added to produce a red component total value. The green and blue components total values are generated in a like manner. Once calculated, each of the color component totals are divided by the number of pixels sampled producing the mean vector of the image. The generated mean vector is stored for later use as non-pixel data.
  • In [0044] Step 430, the covariance matrix is computed using the mean vector generated in Step 410. The covariance matrix is a 3×3 floating point matrix. The matrix is computed as defined by the formula C=E[(p−m)(p−m)T], where p represents the numerical value set of a pixel in the color image, m represents the mean vector, and E represents the expected value of the original image. The covariance matrix is generated for the sampled points by subtracting each floating-point number of the mean vector from its corresponding color component value in the numerical value set of a sampled pixel. The 3×3 covariance matrix C is illustrated in FIG. 6 with equations shown for obtaining each entry from the native (r,g,b) pixel triples.
  • Returning again to FIG. 4, in [0045] Step 440 the statistical color distribution of the obtained and designated color image is used to establish a principal components space. The principal components space is a coordinate system that uses the mean vector as the center of the system. As the center of the principal components space, the mean vector reduces the elimination of color information that has a high concentration in the image. The color image's statistical color distribution is considered when the eigenvalues of the covariance matrix C, and the respective eigenvectors are generated using the formula Ctkktk, where t represents an eigenvector, λ represents an eigenvalue, and C represents the covariance matrix generated in Step 430. The subscript k ranges from 1 to 3. This can be accomplished using known programming packages for solving eigensystems (e.g., LINPACK, EISPACK).
  • The first eigenvector generated represents the first coordinate axis in principal components space. This first eigenvector passes through the center of the principal components space in a direction that explains the most color variation from the mean vector. In addition, the first value in a value set of the intrinsic color information corresponds to a coordinate on the first coordinate axis. The second eigenvector generated represents the second coordinate axis in principal components space. The second eigenvector is orthogonal to the first eigenvector and explains as much of the remaining color variance as possible. The second value in a value set of the intrinsic color information corresponds to a coordinate on the second coordinate axis. The third eigenvector generated represents the third coordinate axis in principal components space. The third principal component is orthogonal to the first and second eigenvectors and explains the remaining color variation. The third value in a value set of the intrinsic color information corresponds to a coordinate on the third coordinate axis. The first, second and third eigenvectors are arranged into an eigenmatrix T. The matrix T is specific to the image since the eigen vectors are defined by the image's color statistics, and thus varies from image to image. Moreover, the matrix has the property that the transpose of the matrix T is its own inverse. Accordingly, the eigenmatrix T is used to convert a color image represented, for example, in RGB color space to principal components color space. In a like manner, the transpose of the eigenmatrix T is used to convert a color image represented in principal components color space to RGB color space. The generated eigen matrix T is stored for later use as non-pixel data. [0046]
  • In [0047] Step 450, the sets of numerical values which characterize the image in a normal color space are converted into intrinsic color value sets that characterize the color image in principal components space. The conversion uses the mean vector generated in Step 420 and the eigen matrix generated in Step 440 to generate intrinsic color values that characterize the color image in principal components space. The formula for performing the conversion is defined by pc=T(p−m), where T is the eigen matrix, m is the mean vector and p is the numerical value set of a pixel in the image. The intrinsic color value sets in principal components space are generated by subtracting the mean vector values from corresponding color component values in a numerical value set and multiplying the results of the subtractions by the eigen matrix T. The intrinsic value sets are a plurality of three floating point values that correspond to the first, second and third principal component space coordinates. This conversion is performed for each numerical value set of a color image to produce a corresponding number of intrinsic color value sets.
  • In [0048] Step 460, scale factors are generated to enable the principal components space coordinates to be mapped into integer byte values. The scale factors include scale and offset values, in the form of floating point numbers, for each axis in principal components space. To compute the scale and offset values, the minimum and maximum principal components space coordinates for each principal components space axis must be identified. Upon identifying the minimum and maximum principal space coordinates, scale and offset values are determined to map principal components space coordinates from the range [min . . . max] into the range [0 . . . 255], where [0 . . . 255] is the range of values an unsigned byte quantity can assume. The offset values correspond to the minimum coordinate values associated with each principal coordinate axis. Accordingly, the minimum coordinate value on each axis is selected as the offset for the axis. The scale values correspond to the maximum coordinate values subtracted from the minimum coordinate values for each principal coordinate axis divided by 255. The scale and offset values are stored for later use as non-pixel data. In Step 470, the process terminates. Upon completion, the plurality of intrinsic value sets of the intrinsic color information is provided to the transformation function 116 b described above for approximation and quantization using discrete cosine transformation (DCT).
  • In FIG. 7, the process for reconstructing a color image is depicted as a block diagram. The reconstruction can be performed on any [0049] computer system 100 or 900 having the reconstruction program stored therein. In Step 700, the reconstruction process begins. In Step 710, the process receives a file including information corresponding to an image compressed using the technique described in FIG. 3 through FIG. 6. Accordingly, the information provided in the file is reduced image information and non-pixel data. In Step 720, the CPU 104, under the instruction of decoder function 118 d, performs an inverse encoding process. The inverse encoding process replaces the reduced image information, which is a stream of bits that compactly represents the image in a non-redundant manner, with a bit stream that originally represented the color image. More specifically, the bit stream that originally represented the quantized approximation values is generated. The techniques and methods for decoding information are well known in the art.
  • In [0050] Step 730, the CPU 104, under the instruction of dequantization function 118 c, performs an inverse quantization process in response to receiving the bit stream that originally represented the quantized approximation values. The dequantization process returns the plurality of quantized approximation values to there near original range of approximation values. As in the quantization Step 340 above, the process is achieved using a quantization table.
  • In [0051] Step 740, the CPU 104, under the instruction of the transformation function 118 b, performs an inverse approximation of the original approximation values. The process generates a plurality of value sets that are substantially similar to the original plurality of intrinsic value sets. The transformation function 118 b applies the inverse of the JPEG discrete cosine transform (DCT) to generate the plurality of value sets that are substantially similar to the original plurality of intrinsic value sets. The techniques and methods for implementing the inverse JPEG discrete cosine transform (DCT) are well known in the art.
  • In [0052] Step 750, the substantially similar plurality of intrinsic value sets are converted back to numerical value sets that characterize the color image in normal color space. The conversion of the intrinsic value sets to numerical value sets is accomplished using the non-pixel data. The process converts the values of the intrinsic value sets from floating point numbers to unsigned byte numbers.
  • In [0053] Step 760 the process ends. Information corresponding to the numerical values sets are transmitted to the output buffer 124 for display on display interface 102.
  • Referring briefly to FIG. 8 where the method of converting the plurality of intrinsic value sets to numerical value sets is depicted. In [0054] Step 800 the process begins. In Step 810, each principal coordinate value in an intrinsic value set is multiplied by its corresponding scale factor. This step is repeated for each intrinsic value set that is in the plurality of intrinsic value sets. In Step 820, each principal coordinate value in an intrinsic value set is added to its corresponding offset. Like Step 810, this step is repeated for each intrinsic value set that is in the plurality of intrinsic value sets. In Step 830, each intrinsic value set in the plurality of intrinsic value sets is multiplied by the transpose of the eigenmatrix T. In Step 840, the mean vector is added to each intrinsic value in the plurality of intrinsic value sets. In Step 850, a value of 0.5 is added to each intrinsic value in the plurality of intrinsic value sets. In Step 860, each intrinsic value in the plurality of intrinsic value sets is truncated to a whole value. In addition, intrinsic values that are less than zero are made equal to zero and intrinsic values that are greater than 255 are made equal to 255. The process terminates in Step 870.
  • Although specific embodiments of the present invention have been described, it will be understood by those skilled in the art that there are other embodiments that are equivalent to the described embodiments. Accordingly it is to be understood that the invention is not to be limited by the specific illustrated embodiments, but only be the scope of the appended claims. [0055]

Claims (10)

1-29. (Cancelled)
30. A system for compressing a color image comprising:
a memory for storing color information of the color image; and
at least one processor, the at least one processor performs the functions of converting the color information into approximate color values.
31. The system according to claim 30, wherein, in the converting step, the at least one processing performs the functions of:
sampling the color information of the color image;
generating a mean vector for the color image using sampled color information;
calculating a covariance matrix using the generated mean vector;
establishing principal components spacing using the calculated covariance matrix;
generating intrinsic color values that characterize the color image in the principal component space;
determining the scale factors for coordinates in the principal component space; and
mapping principal components space coordinates into a range of integer byte values.
32. A system for processing a color image comprising:
a memory for storing color information of the color image; and
at least one processor, the at least one processing performs the functions of 1) converting color information in the color image to intrinsic color information, 2) transforming the intrinsic color information into a plurality of approximation values in accordance with JPEG discrete cosine transform compression standard, 3) detransforming the intrinsic color information, 4) determining a first intrinsic image space associated with a first image coordinate system, and 5) converting the intrinsic color information to a second image space.
33. The system according to claim 32, wherein, in the converting step, the at least one processing performs the functions of:
sampling the color information of the color image;
generating a mean vector for the color image using sampled color information;
calculating a covariance matrix using the generated mean vector;
establishing principal components spacing using the calculated covariance matrix;
generating intrinsic color values that characterize the color image in the principal component space;
determining the scale factors for coordinates in the principal component space; and
mapping principal components space coordinates into a range of integer byte values.
34. A system for processing a color image that has been compressed by converting color information into color to intrinsic color information and transforming that intrinsic color information into a plurality of approximation values, comprising:
a memory for storing color information in the color image; and
at least one processor, the at least one processor for 1) detransforming the intrinsic color information, 2) determining a first intrinsic image space associated with a first image coordinate system, and 3) converting the intrinsic color information into a second image space.
35. Computer-executable process steps stored on a computer-readable medium, the steps for performing compression of a color image, comprising:
converting the color information in the color image to intrinsic color information; and
transforming the intrinsic color information into a plurality of approximation values in accordance with a JPEG discrete cosine transform compression standard.
36. The computer-executable process steps of claim 35, wherein the steps of converting the color information in the color image to intrinsic color information comprises the steps of:
sampling the color information of the color image;
generating a mean vector for the color image using the sampled color information;
calculating a covariance matrix using the generated mean vector;
establishing principal component space using the calculated covariance matrix;
generating intrinsic color values that characterize the color image in the principal component space;
determining scale factors for coordinates in principal component space; and
mapping principal component space coordinates into a range of integer byte values.
37. Computer executable process steps stored on a computer readable medium, the steps for processing of a color image, comprising:
converting color information in the color image to intrinsic color information;
transforming the intrinsic color information into a plurality of approximation values in accordance with JPEG discrete cosine transform compression standard;
detransforming the intrinsic color information;
determining a first intrinsic image space associated with a first image coordinate system; and
converting the intrinsic color information to a second image space.
38. Computer-executable process steps stored on a computer-readable medium, the steps for performing processing of a color image that has been compressed by converting color information in the color image to intrinsic color information and transforming that intrinsic color information into a plurality of approximation values, said steps comprising:
detransforming the intrinsic color information;
determining a first intrinsic image space associated with a first image coordinate system based on a detransformed intrinsic color information; and
converting the intrinsic color image to a second image space.
US10/870,422 2000-07-26 2004-06-18 Lossy JPEG compression/reconstruction using principal components transformation Abandoned US20040258301A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US10/870,422 US20040258301A1 (en) 2000-07-26 2004-06-18 Lossy JPEG compression/reconstruction using principal components transformation
US10/919,397 US7194128B1 (en) 2000-07-26 2004-08-17 Data compression using principal components transformation
US10/964,640 US7181076B1 (en) 2000-07-26 2004-10-15 Wavelet-based data compression using principal components transformation
US10/985,999 US7187798B1 (en) 2000-07-26 2004-11-12 Region-based karhunen-loeve transformation

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/625,859 US6754383B1 (en) 2000-07-26 2000-07-26 Lossy JPEG compression/reconstruction using principal components transformation
US10/870,422 US20040258301A1 (en) 2000-07-26 2004-06-18 Lossy JPEG compression/reconstruction using principal components transformation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/625,859 Continuation US6754383B1 (en) 2000-07-26 2000-07-26 Lossy JPEG compression/reconstruction using principal components transformation

Related Child Applications (3)

Application Number Title Priority Date Filing Date
US10/919,397 Continuation-In-Part US7194128B1 (en) 2000-07-26 2004-08-17 Data compression using principal components transformation
US10/964,640 Continuation-In-Part US7181076B1 (en) 2000-07-26 2004-10-15 Wavelet-based data compression using principal components transformation
US10/985,999 Continuation-In-Part US7187798B1 (en) 2000-07-26 2004-11-12 Region-based karhunen-loeve transformation

Publications (1)

Publication Number Publication Date
US20040258301A1 true US20040258301A1 (en) 2004-12-23

Family

ID=24507905

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/625,859 Expired - Lifetime US6754383B1 (en) 2000-07-26 2000-07-26 Lossy JPEG compression/reconstruction using principal components transformation
US10/870,422 Abandoned US20040258301A1 (en) 2000-07-26 2004-06-18 Lossy JPEG compression/reconstruction using principal components transformation

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/625,859 Expired - Lifetime US6754383B1 (en) 2000-07-26 2000-07-26 Lossy JPEG compression/reconstruction using principal components transformation

Country Status (2)

Country Link
US (2) US6754383B1 (en)
EP (1) EP1176832A3 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7181076B1 (en) 2000-07-26 2007-02-20 Lockheed Martin Corporation Wavelet-based data compression using principal components transformation
US20090164465A1 (en) * 2007-12-21 2009-06-25 Fuji Xerox Co., Ltd. Image search system, image search apparatus, and computer readable medium
US20090192711A1 (en) * 2008-01-25 2009-07-30 Pathfinder Energy Services, Inc. Data compression method for use in downhole applications
US20090190850A1 (en) * 2008-01-25 2009-07-30 Pathfinder Energy Services, Inc. Data compression transforms for use in downhole applications
CN101796843A (en) * 2008-07-08 2010-08-04 松下电器产业株式会社 Image coding method, image decoding method, image coding device, image decoding device, program, and integrated circuit
US20110075897A1 (en) * 2009-09-30 2011-03-31 Genera Electric Company Stain-based optimized compression of digital pathology slides
WO2013055556A1 (en) * 2011-10-11 2013-04-18 Tandent Vision Science, Inc. System and method for digital image signal compression using intrinsic images
US8437545B1 (en) * 2012-04-18 2013-05-07 Tandent Vision Science, Inc. System and method for digital image signal compression using intrinsic images
US20140314318A1 (en) * 2009-04-30 2014-10-23 Tandent Vision Science, Inc. Method for image modification
US20160353123A1 (en) * 2014-01-07 2016-12-01 Dolby Laboratories Licensing Corporation Techniques for Encoding, Decoding and Representing High Dynamic Range Images
US11227125B2 (en) 2016-09-27 2022-01-18 Dolby Laboratories Licensing Corporation Translation techniques with adjustable utterance gaps

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6754383B1 (en) * 2000-07-26 2004-06-22 Lockheed Martin Corporation Lossy JPEG compression/reconstruction using principal components transformation
US20030093451A1 (en) * 2001-09-21 2003-05-15 International Business Machines Corporation Reversible arithmetic coding for quantum data compression
KR100925427B1 (en) * 2002-12-27 2009-11-06 엘지전자 주식회사 Channel Equalizer
EP1538826A3 (en) * 2003-12-05 2007-03-07 Samsung Electronics Co., Ltd. Color transformation method and apparatus
US7454055B1 (en) 2004-11-12 2008-11-18 Payton Paul M Enhanced image compression utilizing Hilbert curve scanning of quantized discrete cosine transform coefficients
US20080044097A1 (en) * 2006-08-21 2008-02-21 Siemens Medical Solutions Usa, Inc. Fast JPEG-LS Based Compression Method for Medical Images
US9563815B2 (en) * 2009-09-15 2017-02-07 Tandent Vision Science, Inc. Method and system for processing an image received from a remote source
US9225991B2 (en) * 2013-05-30 2015-12-29 Apple Inc. Adaptive color space transform coding
US9225988B2 (en) 2013-05-30 2015-12-29 Apple Inc. Adaptive color space transform coding
US9479799B1 (en) * 2014-09-05 2016-10-25 Quantenna Communications, Inc. Compression using an iterative data derived basis set
EP3151562B1 (en) 2015-09-29 2020-06-17 Dolby Laboratories Licensing Corporation Feature based bitrate allocation in non-backward compatible multi-layer codec via machine learning

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5253078A (en) * 1990-03-14 1993-10-12 C-Cube Microsystems, Inc. System for compression and decompression of video data using discrete cosine transform and coding techniques
US20030016233A1 (en) * 2001-06-29 2003-01-23 Bitflash Graphics, Inc. Method and system for manipulation of graphics information
US20030174896A1 (en) * 2002-03-12 2003-09-18 Nokia Corporation Method and apparatus for selecting a format in which to re-encode a quantized image
US6754383B1 (en) * 2000-07-26 2004-06-22 Lockheed Martin Corporation Lossy JPEG compression/reconstruction using principal components transformation
US20040212692A1 (en) * 2001-10-09 2004-10-28 Yoshihiro Nakami Image data output image adjustment
US6832006B2 (en) * 2001-07-23 2004-12-14 Eastman Kodak Company System and method for controlling image compression based on image emphasis
US6868190B1 (en) * 2000-10-19 2005-03-15 Eastman Kodak Company Methods for automatically and semi-automatically transforming digital image data to provide a desired image look

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63173485A (en) 1987-01-13 1988-07-18 Toshiba Corp Image data compressing device
US5196946A (en) 1990-03-14 1993-03-23 C-Cube Microsystems System for compression and decompression of video data using discrete cosine transform and coding techniques
US5422736A (en) * 1991-03-22 1995-06-06 Canon Kabushiki Kaisha Multi-mode image processing permitting selection of quantization process according to image characteristics
JPH05167863A (en) * 1991-04-15 1993-07-02 Canon Inc Method and device for processing image
US5611038A (en) * 1991-04-17 1997-03-11 Shaw; Venson M. Audio/video transceiver provided with a device for reconfiguration of incompatibly received or transmitted video and audio information
AU698055B2 (en) * 1994-07-14 1998-10-22 Johnson-Grace Company Method and apparatus for compressing images
US5680129A (en) 1995-07-18 1997-10-21 Hewlett-Packard Company System and method for lossless image compression
JP3901287B2 (en) * 1997-02-27 2007-04-04 松下電器産業株式会社 Video signal conversion apparatus, video signal conversion method, and video providing system
US6058215A (en) 1997-04-30 2000-05-02 Ricoh Company, Ltd. Reversible DCT for lossless-lossy compression
US6125201A (en) * 1997-06-25 2000-09-26 Andrew Michael Zador Method, apparatus and system for compressing data
JP3469438B2 (en) * 1997-08-28 2003-11-25 カスタム・テクノロジー株式会社 Image signal processing method and apparatus, recording medium
JPH11122495A (en) * 1997-10-09 1999-04-30 Olympus Optical Co Ltd Picture encoding device
JPH11164152A (en) * 1997-11-26 1999-06-18 Ricoh Co Ltd Color image data compression device
US6049775A (en) 1998-01-30 2000-04-11 Bell & Howell Mail And Messaging Technologies Company Systems, methods and computer program products for monitoring and controlling mail processing devices
KR100270799B1 (en) 1998-01-30 2000-11-01 김영환 Dct/idct processor
US6236749B1 (en) 1998-03-23 2001-05-22 Matsushita Electronics Corporation Image recognition method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5253078A (en) * 1990-03-14 1993-10-12 C-Cube Microsystems, Inc. System for compression and decompression of video data using discrete cosine transform and coding techniques
US6754383B1 (en) * 2000-07-26 2004-06-22 Lockheed Martin Corporation Lossy JPEG compression/reconstruction using principal components transformation
US6868190B1 (en) * 2000-10-19 2005-03-15 Eastman Kodak Company Methods for automatically and semi-automatically transforming digital image data to provide a desired image look
US20030016233A1 (en) * 2001-06-29 2003-01-23 Bitflash Graphics, Inc. Method and system for manipulation of graphics information
US6832006B2 (en) * 2001-07-23 2004-12-14 Eastman Kodak Company System and method for controlling image compression based on image emphasis
US20040212692A1 (en) * 2001-10-09 2004-10-28 Yoshihiro Nakami Image data output image adjustment
US20030174896A1 (en) * 2002-03-12 2003-09-18 Nokia Corporation Method and apparatus for selecting a format in which to re-encode a quantized image

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7187798B1 (en) 2000-07-26 2007-03-06 Lockheed Martin Corporation Region-based karhunen-loeve transformation
US7194128B1 (en) * 2000-07-26 2007-03-20 Lockheed Martin Corporation Data compression using principal components transformation
US7181076B1 (en) 2000-07-26 2007-02-20 Lockheed Martin Corporation Wavelet-based data compression using principal components transformation
US20090164465A1 (en) * 2007-12-21 2009-06-25 Fuji Xerox Co., Ltd. Image search system, image search apparatus, and computer readable medium
US8024121B2 (en) 2008-01-25 2011-09-20 Smith International, Inc. Data compression method for use in downhole applications
US20090192711A1 (en) * 2008-01-25 2009-07-30 Pathfinder Energy Services, Inc. Data compression method for use in downhole applications
US20090190850A1 (en) * 2008-01-25 2009-07-30 Pathfinder Energy Services, Inc. Data compression transforms for use in downhole applications
WO2009094520A1 (en) * 2008-01-25 2009-07-30 Smith International, Inc. Data compression method for use in downhole applications
US8788206B2 (en) 2008-01-25 2014-07-22 Schlumberger Technology Corporation Data compression transforms for use in downhole applications
GB2469416A (en) * 2008-01-25 2010-10-13 Smith International Data compression method for use in downhole applications
GB2469416B (en) * 2008-01-25 2012-07-11 Smith International Data compression method for use in downhole applications
US20100208989A1 (en) * 2008-07-08 2010-08-19 Matthias Narroschke Image coding method, image decoding method, image coding apparatus, image decoding apparatus, program and integrated circuit
CN101796843A (en) * 2008-07-08 2010-08-04 松下电器产业株式会社 Image coding method, image decoding method, image coding device, image decoding device, program, and integrated circuit
US10043249B2 (en) * 2009-04-30 2018-08-07 Tandent Vision Science, Inc. Method for image modification
US20140314318A1 (en) * 2009-04-30 2014-10-23 Tandent Vision Science, Inc. Method for image modification
US8077959B2 (en) 2009-09-30 2011-12-13 General Electric Company Stain-based optimized compression of digital pathology slides
US20110075897A1 (en) * 2009-09-30 2011-03-31 Genera Electric Company Stain-based optimized compression of digital pathology slides
WO2013055556A1 (en) * 2011-10-11 2013-04-18 Tandent Vision Science, Inc. System and method for digital image signal compression using intrinsic images
CN103917990A (en) * 2011-10-11 2014-07-09 昙盾特视觉科学有限公司 System and method for digital image signal compression using intrinsic images
US8693772B2 (en) 2011-10-11 2014-04-08 Tandent Vision Science, Inc. System and method for digital image signal compression using intrinsic images
US8879849B2 (en) 2011-10-11 2014-11-04 Tandent Vision Science, Inc. System and method for digital image signal compression using intrinsic images
EP2766853A4 (en) * 2011-10-11 2016-06-01 Tandent Vision Science Inc System and method for digital image signal compression using intrinsic images
US8437545B1 (en) * 2012-04-18 2013-05-07 Tandent Vision Science, Inc. System and method for digital image signal compression using intrinsic images
US20160353123A1 (en) * 2014-01-07 2016-12-01 Dolby Laboratories Licensing Corporation Techniques for Encoding, Decoding and Representing High Dynamic Range Images
CN109889845A (en) * 2014-01-07 2019-06-14 杜比实验室特许公司 Technology for being encoded, being decoded and being indicated to high dynamic range images
CN109889843A (en) * 2014-01-07 2019-06-14 杜比实验室特许公司 Technology for being encoded, being decoded and being indicated to high dynamic range images
CN109922344A (en) * 2014-01-07 2019-06-21 杜比实验室特许公司 Technology for being encoded, being decoded and being indicated to high dynamic range images
US10440379B2 (en) * 2014-01-07 2019-10-08 Dolby Laboratories Licensing Corporation Techniques for encoding, decoding and representing high dynamic range images
US11227125B2 (en) 2016-09-27 2022-01-18 Dolby Laboratories Licensing Corporation Translation techniques with adjustable utterance gaps

Also Published As

Publication number Publication date
EP1176832A3 (en) 2005-05-04
EP1176832A2 (en) 2002-01-30
US6754383B1 (en) 2004-06-22

Similar Documents

Publication Publication Date Title
US6754383B1 (en) Lossy JPEG compression/reconstruction using principal components transformation
US7194128B1 (en) Data compression using principal components transformation
US6757439B2 (en) JPEG packed block structure
JP2968582B2 (en) Method and apparatus for processing digital data
US5327254A (en) Method and apparatus for compressing and decompressing image data
US5850484A (en) Text and image sharpening of JPEG compressed images in the frequency domain
CN102523367B (en) Real time imaging based on many palettes compresses and method of reducing
US6825876B1 (en) Digital camera device with methodology for efficient color conversion
US7724948B2 (en) Enhanced image compression utilizing Hilbert curve scanning of quantized discrete cosine transform coefficients
JP3830009B2 (en) Data processing system and color conversion method
US7499592B2 (en) Image decoding apparatus and its control method
EP0605893B1 (en) Methods and apparatus for attaching compressed look-up table (LUT) representations of N to M-dimensional transforms to image data and for processing image data utilizing the attached compressed luts
US7489827B2 (en) Scaling of multi-dimensional data in a hybrid domain
US9449401B2 (en) System, method and article of manufacture for decompressing digital camera sensor data
JP2000501593A (en) Download image graphics with accelerated text characters and line art formation
US6415058B2 (en) System for compression of digital images comprising low detail areas
US20010012397A1 (en) Image processing apparatus and method
US6597811B1 (en) Method and device for image digitized data compression and decompression
EP0875858B1 (en) Method and apparatus for compressing and decompressing image data
US6721455B1 (en) Method and apparatus for icon compression and decompression
US20040264787A1 (en) Image processing decompression apparatus and method of using same different scaling algorithms simultaneously
JP2002077657A (en) Apparatus of image processing, method thereof and recording medium
JPH0487460A (en) Picture processor
JPH05176173A (en) Picture data compression method
EP0605892A1 (en) Methods and apparatus for processing image data utilizing stored compressed look-up table (LUT) representations of N to M-dimensional transforms

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION