US20020114513A1 - Color image processing device and color image processing method - Google Patents
Color image processing device and color image processing method Download PDFInfo
- Publication number
- US20020114513A1 US20020114513A1 US10/066,671 US6667102A US2002114513A1 US 20020114513 A1 US20020114513 A1 US 20020114513A1 US 6667102 A US6667102 A US 6667102A US 2002114513 A1 US2002114513 A1 US 2002114513A1
- Authority
- US
- United States
- Prior art keywords
- signal
- target pixel
- saturation
- correcting
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 230000015654 memory Effects 0.000 description 42
- 239000003086 colorant Substances 0.000 description 16
- 238000009499 grossing Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 239000000284 extract Substances 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 239000000049 pigment Substances 0.000 description 4
- 230000006866 deterioration Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/46—Colour picture communication systems
- H04N1/56—Processing of colour picture signals
- H04N1/60—Colour correction or control
- H04N1/6077—Colour balance, e.g. colour cast correction
- H04N1/608—Colour balance, e.g. colour cast correction within the L, C1, C2 colour signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration by the use of local operators
-
- G06T5/73—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20192—Edge enhancement; Edge preservation
Definitions
- the present invention relates to a device and a method for color image processing. More particularly, the present invention relates to a color image processing device and a color image processing method for performing sharpness processing to image data.
- Japanese Patent Laid-Open Application No. 2000-175046 discloses an image processing method and an image processing device for noise reduction and sharpness enhancement of a digital image.
- the image processing device described in Related Art 1 is provided with a sharpness processor, a smoothing processor, an edge/noise-mixed component extractor, an edge detector, a noise region weighting factor operator, a noise component identifier and an output image operator.
- the sharpness processor performs sharpness enhancement to the original image data to sharpen the image and the noise included in the image, thereby generating sharpness-enhanced image data.
- the smoothing processor smoothes the original image data to generate a smoothed image data.
- the edge/noise-mixed component extractor subtracts the smoothed image data from the sharpness-enhanced image data to generate an edge/noise-mixed object image data including both of the sharpness-enhanced edge of the object image and the sharpness-enhanced noise.
- the edge detector detects the edge of the original image data to obtain weighting data of the edge region for identifying the edge and noise regions of the object image.
- the noise region weighting factor operator obtains weighting data of the noise region from the obtained weighting data of the edge region.
- the noise component identifier multiplies the edge/noise-mixed object image data by the noise region weighting data to obtain noise data for each color in the noise region, calculates color correlation of the noise data for each color, obtain black-and-white noise components and color noise components present in all colors based on the obtained color correlation components and multiply both of the obtained black-and-white noise components and color noise components by their reduction factor, thereby obtaining a black-and-white noise reduction component and a color noise reduction component.
- the output image operator selectively removes the black-and-white noise reduction component and the color noise reduction component from the sharpness-enhanced image data to reduce the noise, thereby generating a processed image that retains sharpness enhancement in the image edge region.
- Japanese Patent Laid-Open Application No. 2000-175047 discloses an image processing method and an image processing device for noise reduction and sharpness enhancement of a digital image.
- the image processing device described in Related Art 2 is provided with a sharpness processor, a smoothing processor, an edge/granularity-mixed component extractor, an edge detector, a granularity region weighting factor operator, a granularity component identifier and an output image operator.
- the sharpness processor performs sharpness enhancement to the original image data to sharpen the image as well as the granularity or the noise included in the image, thereby generating sharpness-enhanced image data.
- the smoothing processor performs smoothing process to the original image data to generate a smoothed image data.
- the edge/granularity-mixed component extractor subtracts the smoothed image data from the sharpness-enhanced image data to generate an edge/granularity-mixed object image data that includes both of the edge of the sharpness-enhanced object image and the sharpness-enhanced granularity.
- the edge detector detects the edge of the original image data to obtain weighting data of the edge region for identifying the object image edge region and the granularity region.
- the granularity region weighting factor operator obtains weighting data of the granularity region from the obtained weighting data of the edge region.
- the granularity component identifier multiplies the edge/granularity-mixed object image data by the granularity region weighting data to obtain granularity data for each color in the granularity region, calculates, based on the granularity data of each color, a local granularity factor indicating the spatial size and the magnitude of a change in density of the granularity, identify and separate black-and-white granularity components and pigment granularity components, and multiply both of the obtained black-and-white granularity component and the pigment granularity component by their reduction factor, thereby obtaining a black-and-white granularity reduction component and a pigment granularity reduction component.
- the output image operator selectively removes the black-and-white granularity reduction component and the pigment granularity reduction component from the sharpness-enhanced image data to reduce granularity, thereby generating a processed image that retains sharpness enhancement in the image edge region.
- Japanese Patent Laid-Open Application No. 2000-278542 discloses an image processing device which is capable of natural edge enhancement between colors that have little difference in lightness and densities.
- the image processing device described in Related Art 3 processes and outputs color image information input from a certain image input device.
- the image processing device is provided with a color difference information extracting means, a color difference edge detecting means, a color difference enhancement level calculating means and a color difference enhancement correcting means.
- the color difference information extracting means extracts color difference information from the color image information.
- the color difference edge detecting means detects a color difference edge from the color difference information extracted by the color difference information extracting means, thereby calculating the color difference edge value at the color difference edge.
- the color difference enhancement level calculating means calculates a color difference enhancement level based on the color difference edge value calculated by the color difference edge detecting means.
- the color difference enhancement correcting means performs enhancement correction to the color difference information based on the color difference enhancement level calculated by the color difference enhancement level calculating means.
- Japanese Patent Laid-Open Application No. 9-284560 discloses a sharpness processing device which is capable of providing an excellently-sharpened printed matter at a low cost.
- the sharpness processing device described in Related Art 4 performs sharpness processing to an input image signal.
- the device is provided with a storing means, a selecting means, a processing means and an outputting means.
- the storing means stores a plurality of values corresponding to a plurality of image display conditions as parameters for sharpness processing.
- the selecting means selects a particular value from the plurality of parameters according to a particular image display condition selected among the plurality of image display conditions.
- the processing means performs sharpness processing to the input image signal in accordance with the particular value.
- the outputting means outputs an output image signal resulting from the sharpness processing to an image displaying means that is appropriate for the particular image display condition.
- the sharpness processor described in Related Art 4 is characterized in that the plurality of parameters give substantially equal sharpness presentations for the plurality of image display conditions.
- Japanese Patent Laid-Open Application No. 10-42152 discloses an image processing device and method in which a circuit configuration required for edge enhancement correction is simplified.
- the image processor described in Related Art 5, which performs sharpness correction to an input image signal is provided with an extracting means, an edge value extracting means, a saturation extracting means, a dividing means and an edge enhancement means.
- the extracting means extracts a lightness signal and a chromaticity signal from of the input image signal.
- the edge value extracting means extracts an edge value based on the lightness signal.
- the saturation extracting means extracts a saturation component based on the chromaticity signal.
- the dividing means divides the enhancement level of the edge portion, which is based on the edge value extracted by the edge value extracting means, for a lightness signal and a chromaticity signal according to the saturation component extracted by the saturation extracting means.
- the edge enhancement means corrects the lightness signal and the chromaticity signal by the enhancement levels of the edge portion divided by the dividing means.
- the image processing device described in Related Art 6 is provided with an edge detecting means for obtaining an edge value signal from a luminance signal of a luminance/chromaticity-separated signal, an edge enhancement means for enhancing an edge portion in an image represented by the luminance signal, a smoothing means for smoothing the luminance signal, a saturation detecting means for detecting a saturation signal of the image based on the chromaticity signal of the luminance/chromaticity-separated signal, a means for converting luminance by mixing the output from the edge enhancement means and the output from the smoothing means based on the edge value signal detected by the edge detecting means, and means for converting chromaticity of the chromaticity signal corresponding to compression or expansion of saturation using the output from the edge detecting means and the output from the saturation detecting means.
- the present invention has an objective of providing a color image processing device and a color image processing method which enable natural and excellent sharpness processing of image data.
- Another objective of the present invention is to provide a color image processing device and a color image processing method which can sufficiently cope with difference of any of luminance, saturation and hue components of the pixels.
- a color image processing device of the invention comprises: a color space converter ( 1 ) for converting image signals (RGB) to luminance signals (L) corresponding to luminance and first and second chromaticity signals (C 1 , C 2 ) corresponding to chromaticity; a luminance signal correcting unit for correcting the luminance signal (L) of a target pixel based on an average luminance signal (L A ) obtained from luminance signals of the target pixel and predetermined pixels surrounding the target pixel, and a saturation signal (S) corresponding to saturation of the target pixel; a chromaticity signal correcting unit for correcting the first and second chromaticity signals (C 1 , C 2 ) of the target pixel based on first and second average chromaticity signals (C 1 A , C 2 A ) obtained from the chromaticity signals of the target pixel and the predetermined pixels surrounding the target pixel, the saturation signal (S) of the target pixel, an average saturation signal (S A ) of the target pixel and
- the luminance signal correcting unit comprises a luminance correcting factor calculator ( 11 ) for determining a luminance correcting level (K L ) for correcting the luminance signal (L) of the target pixel based on the average luminance signal (L A ) and the saturation signal (S) of the target pixel.
- K L luminance correcting level
- the luminance signal correcting unit comprises a luminance corrector ( 13 ) for correcting the luminance signal (L) of the target pixel based on the luminance correcting level (K L ).
- the color image processing device of the invention may further comprise: a saturation calculator ( 8 ) for generating a saturation signal (S) of the target pixel based on the first and second chromaticity signals (C 1 , C 2 ); an average saturation calculator ( 9 ) for generating the average saturation signal (S A ) based on the first and second average chromaticity signals (C 1 A , C 2 A ); and a hue difference calculator ( 10 ) for generating the hue difference signal (DC) based on the first and second chromaticity signals (C 1 , C 2 ) as well as the first and second average chromaticity signals (C 1 A , C 2 A )
- the chromaticity signal correcting unit comprises a color correcting factor calculator ( 12 ) for determining the chromaticity correcting level (K C ) for correcting the first and second chromaticity signals (C 1 , C 2 ) of the target pixel based on the saturation signal (S) of the target
- chromaticity signal correcting unit comprises a chromaticity corrector ( 14 ) for correcting the first and second chromaticity signals (C 1 , C 2 ) based on the chromaticity correcting level (K C ).
- the present invention is capable of performing natural and excellent sharpness processing to a color image regardless of a monochrome gray region or a color region in the image.
- a color image processing device of the invention comprises: a color space converter ( 101 ) for converting image signals (RGB) to lightness signals (V) corresponding to lightness, saturation signals (S) corresponding to saturation and hue signals (H) corresponding to hue; a lightness signal correcting unit for correcting the lightness signal (V) of a target pixel based on an average lightness signal (V A ) obtained from the lightness signals of the target pixel and predetermined pixels surrounding the target pixel, and the saturation signal (S); a saturation signal correcting unit for correcting the saturation signal (S) of the target pixel based on an average saturation signal (S A ) obtained from the saturation signals of the target pixel and the predetermined pixels surrounding the target pixel, and an average hue signal (H A ) obtained from the hue signals of the target pixel and the predetermined pixels surrounding the target pixel; and a color space inverter ( 112 ) for inverting the corrected lightness signal (V′), the corrected saturation signal (S′) and the hue signal (H
- the lightness signal correcting unit comprises a lightness correcting factor calculator ( 108 ) for determining a lightness correcting level (K V ) for correcting the lightness signal (V) of the target pixel based on the average lightness signal (V A ) and the saturation signal (S).
- the lightness signal correcting unit comprises a lightness corrector ( 110 ) for correcting the lightness signal (V) of the target pixel based on the lightness correcting level (K V ).
- the saturation signal correcting unit comprises a saturation correcting factor calculator ( 109 ) for determining a saturation correcting level (K S ) for correcting the saturation signal (S) of the target pixel based on the average saturation signal (S A ) and the average hue signal (H A ).
- the saturation signal correcting unit comprises a saturation corrector ( 111 ) for correcting the saturation signal (S) of the target pixel based on the saturation correcting level (K S ).
- the present invention is capable of performing natural and excellent sharpness processing to a color image regardless of a monochrome gray region or a color region in the image.
- a color image processing method of the invention comprises the steps of: (a) converting image signals (RGB) to luminance signals (L) corresponding to luminance, and first and second chromaticity signals (C 1 , C 2 ) corresponding to chromaticity; (b) correcting the luminance signal (L) of a target pixel based on an average luminance signal (L A ) obtained from the luminance signals of the target pixel and predetermined pixels surrounding the target pixel, and a saturation signal (S) corresponding to saturation of the target pixel; (c) correcting the first and second chromaticity signals (C 1 , C 2 ) of the target pixel based on first and second average chromaticity signals (C 1 A , C 2 A ) obtained from the chromaticity signals of the target pixel and the predetermined pixels surrounding the target pixel, the saturation signal (S) of the target pixel, the average saturation signal (S A ), and a hue difference signal (DC) representing color similarity obtained from the first and second chromati
- the step of (b) for correcting the luminance signal further comprises the steps of: (e) determining the luminance correcting level (K L ) for correcting the luminance signal (L) of the target pixel based on the average luminance signal (L A ) and the saturation signal (S) of the target pixel; and (f) correcting the luminance signal (L) based on the luminance correcting level (K L ).
- the step of (c) for correcting the chromaticity signals further comprises the steps of: (g) generating the saturation signal (S) of the target pixel based on the first and second chromaticity signals (C 1 , C 2 ); (h) generating the average saturation signal (S A ) based on the first and second average chromaticity signals (C 1 A , C 2 A ); and (i) generating the hue difference signal (DC) based on the first and second chromaticity signals (C 1 , C 2 ) as well as first and second average chromaticity signals (C 1 A , C 2 A ).
- the step of (c) for correcting the chromaticity signals further comprises the steps of: (j) determining a chromaticity correcting level (K C ) for correcting the first and second chromaticity signals (C 1 , C 2 ) of the target pixel based on the saturation signal (S) of the target pixel, the average saturation signal (S A ) and the hue difference signal (DC); and (k) correcting the first and second chromaticity signals (C 1 , C 2 ) of the target pixel based on the chromaticity correcting level (K C ).
- the present invention is capable of performing natural and excellent sharpness processing to a part of an image where enhancement would not take place according to the difference of luminance.
- a color image processing method of the invention comprises the steps of: (a) converting image signals (RGB) to lightness signals (V) corresponding to lightness, saturation signals (S) corresponding to saturation and hue signals (H) corresponding to hue; (b) correcting the lightness signal (V) of a target pixel based on an average lightness signal (V A ) obtained from the lightness signals of the first target pixel and pixels surrounding the first target pixel, and the saturation signal (S); (c) correcting the saturation signal (S) of the target pixel based on an average saturation signal (S A ) obtained from the saturation signals of the target pixel and the predetermined pixels surrounding the target pixel, and an average hue signal (H A ) obtained from the hue signals of the target pixel and the predetermined pixels surrounding the target pixel; and (d) inverting the corrected lightness signal (V′), the corrected saturation signal (S′) and the hue signal (H) to image signals (R′G′B′).
- the step of (b) for correcting the lightness signal further comprises the steps of: (e) determining a lightness correcting level (K V ) for correcting the lightness signal (V) of the target pixel based on the average lightness signal (V A ) and the saturation signal (S); and (f) correcting the lightness signal (V) of the target pixel based on the lightness correcting level (K V ).
- the step of (c) for correcting the saturation signal further comprises the steps of: (g) determining a saturation correcting level (K S ) for correcting the saturation signal (S) of the target pixel based on the average saturation signal (S A ) and the average hue signal (H A ); and (h) correcting the saturation signal (S) of the target pixel based on the saturation correcting level (K S ).
- FIG. 1 is a block diagram showing a configuration of a color image processing device according to Embodiment 1 of the invention.
- FIG. 2 is a plan view showing a size of a filter used in the color image processing device of Embodiment 1;
- FIG. 3 is a diagram showing relationship between values indicated by color component data C 1 and values indicated by color component data C 2 ;
- FIG. 4 is a flowchart showing a series of operations performed by the color image processing device of Embodiment 1;
- FIG. 5 is a block diagram showing a configuration of a color image processing device according to Embodiment 2 of the invention.
- FIG. 6 is a flowchart showing a series of operations performed by the color image processing device of Embodiment 2.
- FIG. 1 is a block diagram showing a configuration of a color image processing device 30 according to Embodiment 1 of the present invention.
- the color image processing device 30 of Embodiment 1 is provided with a color space converter 1 , line memories 2 to 4 , filters 5 to 7 , a saturation calculator 8 , an average saturation calculator 9 , a hue difference calculator 10 , a luminance correcting factor calculator 11 , a color correcting factor calculator 12 , a luminance corrector 13 , a color corrector 14 and a color space inverter 15 . Furthermore, the color image processing device 30 is connected to peripherals such as an input unit 40 including a scanner and the like, and an output unit 50 including a display unit, a printer and the like.
- the input unit 40 scans RGB color image signals (RGB signals) in the x-direction (main-scanning direction) and inputs signals of each line by each element of a color space.
- one line refers to a line of adjacent pixels (including target pixel) scanned in the main-scanning direction.
- the input unit 40 outputs the input RGB signals for each element of the color space to the color space converter 1 .
- the input unit 40 scans in the y-direction (sub-scanning direction) and scans the RGB color image signals (RGB signals) in the main-scanning direction to input signals of the next line by each element of the color space.
- the input RGB signals for each element of the color space are output to the color space converter 1 .
- the color space converter 1 converts the RGB signals input from the input unit 40 into elements of color space represented by luminance signals L corresponding to a luminous intensity of light from a light source per orthogonal unit area, and chromaticity signals C 1 and C 2 representing degrees of color.
- the luminance signals L and the chromaticity signals C 1 and C 2 represent a color space such as a CIELAB color space, a CIELUV color space and a YCbCr color space, and are converted using computing or a table.
- the color space converter 1 outputs the converted luminance signals L to the line memory 2 and the filter 5 , the converted chromaticity signals C 1 to the line memory 3 and the filter 6 , and the converted chromaticity signals C 2 to the line memory 4 and the filter 7 .
- the sizes of the line memories 2 to 4 depend on the sizes of the filters 5 to 7 .
- the line memory needs to have a size for at least (M ⁇ 1) lines.
- the line memories each have a size for (M ⁇ 1) lines
- the line memory 2 can store luminance signals L for (M ⁇ 1) lines given from the color space converter 1
- the line memory 3 can store chromaticity signals C 1 for (M ⁇ 1) lines given from the color space converter 1
- the line memory 4 can store chromaticity signals C 2 for (M ⁇ 1) lines given from the color space converter 1 .
- the filters 5 to 7 read out the signals (luminance signals L and chromaticity signals C 1 and C 2 ) that are converted into a color space for a line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memories 2 to 4 , respectively, and read out the signals for the present line from the color space converter 1 .
- the filters 5 to 7 use the read-out signals (luminance signals L and chromaticity signals C 1 and C 2 ) that are converted into the color space to calculate average values of L, C 1 and C 2 based on L, C 1 and C 2 values (edge values) of the target pixel and pixels surrounding the target pixel.
- FIG. 2 is a plan view showing a size of the filters used in the color image processing device of Embodiment 1.
- the filter size of the filters 5 to 7 may be adaptive for 5 ⁇ 5 adjacent pixels as shown in FIG. 2.
- the filter 5 has a pixel 20 at the center.
- the filter 5 reads out the luminance signals L for the line that is four lines before the present line to the immediately preceding line from the line memory 2 and reads out the luminance signals L for the present line from the color space converter 1 .
- the center pixel 20 is referred to as a “sharpness processing target pixel” or a “target pixel”.
- the filter 5 calculates an average value of the values (luminance edge values) indicated by the luminance signals L of the 25 pixels including the target pixel to generate an average luminance signal L A .
- the filter 5 outputs the luminance signal L of the target pixel and the calculated average luminance signal L A to the luminance correcting factor calculator 11 .
- the filter 6 has the pixel 20 at the center.
- the filter 6 reads out the chromaticity signals C 1 for the line that is four lines before the present line to the immediately preceding line from the line memory 3 and reads out the chromaticity signals C 1 for the present line from the color space converter 1 .
- the center pixel 20 is referred to as a “sharpness processing target pixel” or a “target pixel”.
- the filter 6 calculates an average value of the values (color edge values) indicated by the chromaticity signals C 1 of the 25 pixels including the target pixel to generate an average chromaticity signal C 1 A .
- the filter 6 outputs the chromaticity signal C 1 of the target pixel to the saturation calculator 8 and the hue difference calculator 10 , and the calculated average chromaticity signal C 1 A to the average saturation calculator 9 and the hue difference calculator 10 .
- the filter 7 has the pixel 20 at the center.
- the filter 7 reads out the chromaticity signals C 2 for the line that is four lines before the present line to the immediately preceding line from the line memory 4 as well as the chromaticity signals C 2 for the present line from the color space converter 1 .
- the center pixel 20 is referred to as a “sharpness processing target pixel” or a “target pixel”.
- the filter 7 calculates an average value of the values (color edge values) indicated by the chromaticity signals C 2 of the 25 pixels including the target pixel to generate an average chromaticity signal C 2 A .
- the filter 7 outputs the chromaticity signal C 2 of the target pixel to the saturation calculator 8 and the hue difference calculator 10 , and the calculated average chromaticity signal C 2 A to the average saturation calculator 9 and the hue difference calculator 10 .
- the filters 5 to 7 calculate the average values based on the 5 ⁇ 5 adjacent pixels including the target pixel.
- the filters 5 to 7 can also calculate the average values based on the 5 ⁇ 5 adjacent pixels without the target pixel.
- the filter sizes of the filters 5 to 7 are not necessarily equal.
- the filter sizes may differ between the luminance component filter and the color component filters.
- the saturation calculator 8 obtains (calculates) saturation S representing the vividness of the color based on the values (color edge values) indicated by the chromaticity signals C 1 and C 2 , thereby generating a saturation signal S.
- the saturation calculator 8 calculates saturation based on the chromaticity signals C 1 and C 2 of the target pixel according to the following Equation (1).
- the saturation calculator 8 may also calculate saturation S by the following simplified equations (2) or (3).
- saturation S is calculated using computing or a table.
- the saturation calculator 8 outputs the saturation signal S (calculated saturation S) to the luminance correcting factor calculator 11 and outputs the saturation signal S (calculated saturation S) as well as the chromaticity signals C 1 and C 2 of the target pixel to the color correcting factor calculator 12 .
- the average chromaticity signal C 1 A from the filter 6 and the average chromaticity signal C 2 A from the filter 7 are input to the average saturation calculator 9 .
- the average saturation calculator 9 obtains (calculates) average saturation S A representing the average vividness of the colors based on the values (mean color edge values) indicated by the average chromaticity signals C 1 A and C 2 A , thereby generating an average saturation signal S A .
- the average saturation calculator 9 calculates average saturation S A according to the following Equation (4) based on the average chromaticity signals C 1 A and C 2 A Alternatively, the average saturation calculator 9 may also calculate average saturation sA by the following simplified equations (5) or (6).
- the average saturation S A is calculated using computing or a table corresponding to the computing system of the saturation calculator 8 .
- the average saturation calculator 9 outputs the average saturation signal S A (calculated average saturation S A ) to the color correcting factor calculator 12 .
- the chromaticity signal C 1 of the target pixel and the average chromaticity signal C 1 A from the filter 6 as well as the chromaticity signal C 2 of the target pixel and the average chromaticity signal C 2 A from the filter 7 are input to the hue difference calculator 10 .
- the hue difference calculator 10 obtains (calculates) hue difference indicating color similarity based on the values (color edge values) indicated by the chromaticity signals C 1 and C 2 and the values (mean color edge values) indicated by the average chromaticity signals C 1 A and C 2 A , thereby generating a hue difference signal DC.
- FIG. 3 is a diagram showing the relationship between values indicated by the chromaticity signals C 1 and values indicated by the chromaticity signals C 2 .
- a vector (C 1 , C 2 ) is generated based on the values indicated by the chromaticity signals C 1 and C 2 of the target pixel.
- a vector (C 1 A , C 2 A ) is generated based on the values indicated by the average chromaticity signals C 1 A and C 2 A .
- the hue difference signal DC is cosine ⁇ where ⁇ is an angle between the vector (C 1 , C 2 ) and the vector (C 1 A , C 2 A ) on the two-dimensional plane produced by two color components.
- the hue difference calculator 10 gives hue difference DC based on the values indicated by the chromaticity signals C 1 and C 2 and the values indicated by the average chromaticity signals C 1 A and C 2 A according to the following equation (7).
- the hue difference calculator 10 may give the hue difference DC according to the following simplified equation (8).
- hue difference DC cos ⁇ , ⁇ 1 ⁇ DC ⁇ 1.
- DC is 1 when the colors are the same, and a higher DC value indicates higher similarity between the colors.
- a lower DC value indicates higher similarity.
- the hue difference calculator 10 outputs the hue difference signal DC (calculated hue difference DC) to the color correcting factor calculator 12 .
- the luminance signal L of the target pixel and the average luminance signal L A from the filter 5 as well as the saturation signal S from the saturation calculator 8 are input to the luminance correcting factor calculator 11 .
- the luminance correcting factor calculator 11 obtains (calculates) a luminance sharpness correcting factor K L (a luminance sharpness correcting factor signal K L ) for the luminance corrector 13 to perform sharpness correction, based on a value (luminance edge value) indicated by the luminance signal L of the target pixel, a value (mean luminance edge value) indicated by the average luminance signal L A and the saturation signal S. Enhancement according to the luminance component is more effective in a monochrome gray region than in a color region.
- Enhancement in a color region may cause color turbidity or the like, resulting in image deterioration. Accordingly, the luminance sharpness correcting factor is calculated only when the saturation signal S of the sharpness processing target pixel (target pixel) is lower than the luminance correction threshold.
- the enhancement level of the luminance components of the entire color image is indicated as K AL .
- the luminance correcting factor calculator 11 calculates a luminance sharpness correcting factor K L according to the following equation (9), based on the value indicated by the luminance signal L of the target pixel, the value indicated by the average luminance signal L A and the saturation signal S.
- K L K AL ⁇ ( L ⁇ L A ) (9)
- the luminance correcting factor calculator 11 outputs the luminance signal L of the target pixel and the luminance sharpness correcting factor signal K L (calculated luminance sharpness correcting factor K L ) to the luminance corrector 13 .
- the luminance signal L of the target pixel and the luminance sharpness correcting factor signal K L from the luminance correcting factor calculator 11 are input to the luminance corrector 13 .
- the luminance corrector 13 obtains (calculates/generates) a sharpness-corrected luminance signal L′ of the target pixel based on the value (luminance edge value) indicated by the luminance signal L of the target pixel and the luminance sharpness correcting factor signal K L .
- the luminance corrector 13 calculates the luminance signal L′ according to the following equation (10) based on the value indicated by the luminance signal L of the target pixel and the luminance sharpness correcting factor signal K L .
- the luminance corrector 13 outputs the calculated luminance signal L′ of the target pixel to the color space inverter 15 .
- the chromaticity signals C 1 and C 2 and the saturation signal S of the target pixel from the saturation calculator 8 , the average saturation signal S A from the average saturation calculator 9 , and the hue difference signal DC from the hue difference calculator 10 are input to the color correcting factor calculator 12 .
- the chromaticity signals C 1 and C 2 of the target pixel are used for the later-described color corrector 14 to perform sharpness correction.
- the color correcting factor calculator 12 obtains (calculates) a color sharpness correcting factor K C (a color sharpness correcting factor signal K C ) for the color corrector 14 to perform sharpness correction based on the saturation signal S of the target pixel, the average saturation signal S A , and the hue difference signal DC.
- color sharpness is performed only when the saturation signal S of the sharpness processing target pixel (target pixel) is greater than the color correction threshold.
- the saturation signal S and the average saturation signal S A of pixels may be generally equal while the hue difference signal DC is high, in order words, the pixels may greatly differ in colors.
- the color sharpness correcting factor K C is calculated in a different manner according to the magnitude of the hue difference signal DC.
- the color correcting factor calculator 12 calculates a color sharpness correcting factor K C according to the following equation (11), based on the saturation signal S, the average saturation signal S A and the hue difference signal DC, where the enhancement level of the color components in the entire color image is represented by K AS .
- the color correcting factor calculator 12 calculates a color sharpness correcting factor K C according to the following equation (12) (although there are other various calculations) based on the saturation signal S, the average saturation signal S A and the hue difference signal DC, where the enhancement level of the color components differing in colors in the entire color image is represented by K AC .
- a table may be produced based on the hue difference signal DC and the saturation difference (S ⁇ S A ) to calculate K C .
- the color sharpness correcting factor is calculated considering the hue difference signal DC and the saturation difference.
- the color correcting factor calculator 12 outputs the color sharpness correcting factor signal K C (the calculated color sharpness correcting factor K C ) and the chromaticity signals C 1 and C 2 of the target pixel to the color corrector 14 .
- the chromaticity signals C 1 and C 2 of the target pixel and the color sharpness correcting factor signal K C from the color correcting factor calculator 12 is input to the color corrector 14 .
- the color corrector 14 obtains (calculates/generates) sharpness-corrected chromaticity signals C 1 ′ and C 2 ′ of the target pixel based on values (color edge values) indicated by the chromaticity signals C 1 and C 2 of the target pixel and the color sharpness correcting factor signal K C .
- the color corrector 14 calculates the chromaticity signals C 1 ′ and C 2 ′ according to the following equations (13) and (14) based on the values indicated by the chromaticity signals C 1 and C 2 of the target pixel and the color sharpness correcting factor signal K C .
- the color corrector 14 outputs the calculated chromaticity signals C 1 ′ and C 2 ′ of the target pixel to the color space inverter 15 .
- the luminance signal L′ of the target pixel from the luminance corrector 13 and the chromaticity signals C 1 ′ and C 2 ′ of the target pixel from the color corrector 14 are input to the color space inverter 15 .
- the color space inverter 15 inverts the color space represented by the luminance signal L′ and the chromaticity signals C 1 ′ and C 2 ′ of the target pixel into luminance- and color-corrected RGB (R′G′B′) signals based on the luminance signal L′ and the chromaticity signals C 1 ′ and C 2 ′ of the target pixel.
- the color space inverter 15 outputs the converted RGB (R′G′B′) signals to the output unit 50 .
- the output unit 50 displays or prints out the converted RGB (R′G′B′) signals.
- the color image processing device 30 is able to perform natural and excellent sharpness processing to image signals regardless of the monochrome gray region or the color region of the image.
- FIG. 4 is a flowchart showing a series of operations performed by the color image processing device according to Embodiment 1.
- RGB signals are input from the input unit 40 to the color space converter 1 (Step S 1 ).
- the color space converter 1 converts the RGB signals input from the input unit 40 into a color space represented by luminance signals L and chromaticity signals C 1 and C 2 (Step S 2 ).
- the color space converter 1 outputs the converted luminance signals L to the line memory 2 and the filter 5 , the converted chromaticity signals C 1 to the line memory 3 and the filter 6 , and the converted chromaticity signals C 2 to the line memory 4 and the filter 7 .
- the line memories 2 to 4 store the luminance signals L, the chromaticity signals C 1 and the chromaticity signals C 2 from the color space converter 1 , respectively (Step S 3 ).
- the filter 5 reads out the luminance signals L for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 2 as well as the luminance signals L for the present line from the color space converter 1 , thereby generating an average luminance signal L A from the values (luminance edge values) indicated by the luminance signals L of the M ⁇ M pixels including the target pixel (Step S 4 ).
- the filter 5 outputs the luminance signal L of the target pixel and the generated average luminance signal L A to the luminance correcting factor calculator 11 .
- Step S 4 for M ⁇ M (where M is an integer) adjacent pixels with a target pixel at the center, the filter 6 reads out the chromaticity signals C 1 for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 3 as well as the chromaticity signals C 1 for the present line from the color space converter 1 , thereby generating an average chromaticity signal C 1 A based on the values (color edge values) indicated by the chromaticity signals C 1 of the M ⁇ M pixels including the target pixel.
- the filter 6 outputs the chromaticity signal C 1 of the target pixel to the saturation calculator 8 and the hue difference calculator 10 , and the generated average chromaticity signal C 1 A to the average saturation calculator 9 and the hue difference calculator 10 .
- Step S 4 for M ⁇ M (where M is an integer) adjacent pixels with a target pixel at the center, the filter 7 reads out the chromaticity signals C 2 for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 4 as well as the chromaticity signals C 2 for the present line from the color space converter 1 , thereby generating an average chromaticity signal C 2 A based on the values (color edge values) indicated by the chromaticity signals C 2 of the M ⁇ M pixels including the target pixel.
- the filter 7 outputs the chromaticity signal C 2 of the target pixel to the saturation calculator 8 and the hue difference calculator 10 , and the generated average chromaticity signal C 2 A to the average saturation calculator 9 and the hue difference calculator 10 .
- the saturation calculator 8 generates a saturation signal S based on values (color edge values) indicated by the chromaticity signals C 1 and C 2 of the target pixel (Step S 5 ).
- the saturation calculator 8 outputs the generated saturation signal S to the luminance correcting factor calculator 11 , and outputs the generated saturation signal S and the chromaticity signals C 1 and C 2 of the target pixel to the color correcting factor calculator 12 .
- Step-S 5 with the average chromaticity signals C 1 A and C 2 A from the respective filters 6 and 7 , the average saturation calculator 9 generates an average saturation signal S A based on the values (mean color edge values) indicated by the average chromaticity signals C 1 A and C 2 A .
- the average saturation calculator 9 outputs the generated average saturation signal S A to the color correcting factor calculator 12 .
- Step S 5 with the chromaticity signal C 1 of the target pixel and the average chromaticity signal C 1 A from the filter 6 as well as the chromaticity signal C 2 of the target pixel and the average chromaticity signal C 2 A from the filter 7 , the hue difference calculator 10 generates a hue difference signal DC based on the values (color edge values) indicated by the chromaticity signals C 1 and C 2 and values (mean color edge values) indicated by the average chromaticity signals C 1 A and C 2 A The hue difference calculator 10 outputs the generated hue difference signal DC to the color correcting factor calculator 12 .
- the luminance correcting factor calculator 11 With the luminance signal L of the target pixel and the average luminance signal L A from the filter 5 as well as the saturation signal S from the saturation calculator 8 , the luminance correcting factor calculator 11 generates a luminance sharpness correcting factor signal K L based on the value (luminance edge value) indicated by the luminance signal L of the target pixel and the value (mean luminance edge value) indicated by the average luminance signal L A and the saturation signal (Step S 6 ). The luminance correcting factor calculator 11 outputs the luminance signal L of the target pixel and the generated luminance sharpness correcting factor signal K L to the luminance corrector 13 .
- Step S 6 with the chromaticity signals C 1 and C 2 of the target pixel from the saturation calculator 8 , the average saturation signal S A from the average saturation signal calculator 9 as well as the hue difference signal DC from the hue difference calculator 10 , the color correcting factor calculator 12 generates a color sharpness correcting factor signal K C based on the saturation signal S of the target pixel, the average saturation signal S A and the hue difference signal DC.
- the color correcting factor calculator 12 outputs the generated color sharpness correcting factor signal K C and the chromaticity signals C 1 and C 2 of the target pixel to the color corrector 14 .
- the luminance corrector 13 In order to perform sharpness correction to the luminance signal L of the target pixel, with the luminance signal L of the target pixel and the luminance sharpness correcting factor signal K L from the luminance correcting factor calculator 11 , the luminance corrector 13 generates a sharpness-processed luminance signal L′ of the target pixel based on the value (luminance edge value) indicated by the luminance signal L of the target pixel and the luminance sharpness correcting factor signal K L (Step S 7 ) The luminance corrector 13 outputs the generated luminance signal L′ of the target pixel to the color space inverter 15 .
- Step S 7 in order to perform sharpness correction to the chromaticity signals C 1 and C 2 of the target pixel, with the chromaticity signals C 1 and C 2 of the target pixel and the color sharpness correcting factor signal K C from the color correcting factor calculator 12 , the color corrector 14 generates sharpness-processed chromaticity signals C 1 ′ and C 2 ′ of the target pixel based on the values (color edge values) indicated by the chromaticity signals C 1 and C 2 of the target pixel and the color sharpness correcting factor signal K C . The color corrector 14 outputs the generated chromaticity signals C 1 ′ and C 2 ′ of the target pixel to the color space inverter 15 .
- the color space inverter 15 inverts the color space represented by the luminance signal L′ and the chromaticity signals C 1 ′ and C 2 ′ of the target pixel to luminance- and color-corrected RGB signals based on the luminance signal L′ and the chromaticity signals C 1 ′ and C 2 ′ of the target pixel (Step S 8 ).
- the color space inverter 15 outputs the inverted RGB signals to the output unit 50 (Step S 9 ).
- the color image processing device 30 performs sharpness correction to the color components by using the difference between the saturation of the sharpness processing target pixel and the average saturation of the pixels surrounding the target pixel as well as the difference between the color component of the sharpness processing target pixel and the average color component of the pixels surrounding the target pixel. Accordingly, sharpness correction can be performed to a part having an edge of a color that would not be corrected to a satisfactory extent by only a luminance component.
- the color image processing device 30 corrects by using the saturation difference.
- the color image processing device 30 performs correction by using both of the hue difference and the saturation difference. Thus, sufficient sharpness correction can be realized even for a part where saturation difference is small.
- the sharpness processing according to Embodiment 1 is performed based on a color space represented by luminance signals L and chromaticity signals C 1 and C 2 .
- sharpness processing is performed based on a color space (e.g., HSV color space, HSL color space, etc.) represented by three attributes, namely, hue, saturation and lightness.
- a color space e.g., HSV color space, HSL color space, etc.
- the present invention also has the advantages of Embodiment 2 which enables to perform sharpness processing to input image signals.
- FIG. 5 is a block diagram showing a configuration of the color image processing device of Embodiment 2.
- the color image processing device 130 is provided with a color space converter 101 , line memories 102 to 104 , filters 105 to 107 , a lightness correcting factor calculator 108 , a saturation correcting factor calculator 109 , a lightness corrector 110 , a saturation corrector 111 and a color space inverter 112 . Furthermore, the color image processing device 130 is connected to peripherals such as an input unit 140 including a scanner and the like, and an output unit 150 including a display unit, a printer and the like.
- the input unit 140 scans RGB color image signals (RGB signals) in the x-direction (main scanning direction) and inputs signals on each line by each element of a color space.
- one line refers to a line of adjacent pixels (including a target pixel) scanned in the main scanning direction.
- the input unit 140 outputs the input RGB signals for each element of color space to the color space converter 101 .
- the input unit 140 scans in the y-direction (sub-scanning direction) and scans the RGB color image signals (RGB signals) in the main scanning direction to input signals of the next line by each element of the color space.
- the input RGB signals for each element of the color space are then output to the color space converter 101 .
- the color space converter 101 converts the RGB signals input from the input unit 140 into a color space represented by lightness signals V representing lightness, saturation signals S representing a degree of vividness of the color and hue signals H representing a tinge of the color.
- the lightness signals V, the saturation signals S and the hue signals H are converted using computing or a table.
- the color space converter 101 outputs the converted lightness signals V to the line memory 102 and the filter 105 , the converted saturation signals S to the line memory 103 and the filter 106 , and the converted hue signals H to the line memory 104 and the filter 107 .
- the sizes of the line memories 102 to 104 depend on the sizes of the filters 105 to 107 .
- the line memory needs to have a size for at least (M ⁇ 1) lines.
- the line memories each have a size for (M ⁇ 1) lines
- the line memory 102 can store lightness signals V for (M ⁇ 1) lines given from the color space converter 101
- the line memory 103 can store saturation signals S for (M ⁇ 1) lines given from the color space converter 101
- the line memory 104 can store hue signals H for (M ⁇ 1) lines given from the color space converter 101 .
- the filters 105 to 107 read out the signals that are converted into the color space (lightness signals V, saturation signals S and hue signals H) for a line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memories 102 to 104 , respectively, and also read out the signals for the present line from the color space converter 101 .
- the filters 105 to 107 use the read-out signals (lightness signals V, saturation signals S and hue signals H) that are converted into the color space to calculate average values of V, S and H based on V, S and H values (edge values) of the target pixel and the pixels surrounding the target pixel.
- the filter 105 recognizes a pixel at the center of the M ⁇ M (where M is an integer) adjacent pixels as a target pixel.
- the filter 105 reads out the lightness signals V for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 102 , and reads out the lightness signals V for the present line from the color space converter 101 .
- the filter 105 calculates an average value of the values (lightness edge values) indicated by the lightness signals V of the M ⁇ M pixels including the target pixel to generate an average lightness signal V A .
- the filter 105 outputs the lightness signal V of the target pixel and the calculated average lightness signal V A to the lightness correcting factor calculator 108 .
- the filter 106 recognizes a pixel at the center of the M ⁇ M (where M is an integer) adjacent pixels as a target pixel.
- the filter 106 reads out the saturation signals S for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 103 , and reads out the saturation signals S for the present line from the color space converter 101 .
- the filter 106 calculates an average value of the values (saturation edge values) indicated by the saturation signals S of the M ⁇ M pixels including the target pixel to generate an average saturation signal S A
- the filter 106 outputs the saturation signal S of the target pixel to the lightness correcting factor calculator 108 and the saturation correcting factor calculator 109 , and the calculated average saturation signal S A to the saturation correcting factor calculator 109 .
- the filter 107 recognizes a pixel at the center of the M ⁇ M (where M is an integer) adjacent pixels as a target pixel.
- the filter 107 reads out the hue signals H for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 104 and reads out the hue signals H for the present line from the color space converter 101 .
- the filter 107 calculates an average value of the values (hue edge values) indicated by the hue signals H of the M ⁇ M pixels including the target pixel to generate an average hue signal H A .
- the filter 107 outputs the hue signal H of the target pixel and the calculated average hue signal H A to the saturation correcting factor calculator 109 .
- the lightness signal V of the target pixel and the average lightness signal V A from the filter 105 , and the saturation signal S of the target pixel from the filter 106 are input to the lightness correcting factor calculator 108 .
- the lightness correcting factor calculator 108 obtains (calculates) a lightness sharpness correcting factor K V to generate a luminance sharpness correcting factor signal K V for the lightness corrector 110 to perform sharpness correction, based on the lightness signal V (lightness edge value) of the target pixel and the average lightness signal V A (mean lightness edge value). Enhancement based on the lightness component is more effective in a monochrome gray region than in a color region.
- Enhancement in a color region may cause color turbidity or the like, resulting in image deterioration. Accordingly, the lightness sharpness correcting factor is calculated only when the saturation signal S of the sharpness processing target pixel (target pixel) is lower than the lightness correction threshold.
- the lightness correcting factor calculator 108 calculates the lightness sharpness correcting factor K V according to the following equation (15) based on the value indicated by the lightness signal V of the target pixel, the value indicated by the average lightness signal V A and the saturation signal S, where the enhancement level of the lightness of the entire color image is indicated as K AV .
- the lightness correcting factor calculator 108 outputs the lightness signal V of the target pixel and the lightness sharpness correcting factor signal K V (the calculated lightness sharpness correcting factor K V ) to the lightness corrector 110 .
- the lightness signal V of the target pixel and the lightness sharpness correcting factor signal K V from the lightness correcting factor calculator 108 are input to the lightness corrector 110 .
- the lightness corrector 110 obtains (calculates/generates) a sharpness-corrected lightness signal V′ of the target pixel based on the value (lightness edge value) indicated by the lightness signal V of the target pixel and the lightness sharpness correcting factor signal K V .
- the lightness corrector 110 calculates the lightness signal V′ according to the following equation (16) based on the value indicated by the lightness signal V of the target pixel and the lightness sharpness correcting factor signal K V .
- V′ V+K V (16)
- the lightness corrector 110 outputs the calculated lightness signal V′ of the target pixel to the color space inverter 112 .
- the saturation signal S of the target pixel and the average saturation signal S A from the filter 106 as well as the hue signal H of the target pixel and the average hue signal H A from the filter 107 are input to the saturation correcting factor calculator 109 .
- the saturation correcting factor calculator 109 obtains (calculates) a saturation sharpness correcting factor K S for the saturation corrector 111 to perform sharpness correction, based on the saturation signal S of the target pixel, the average saturation signal S A , the hue signal H of the target pixel and the means hue signal H A .
- the saturation correcting factor calculator 109 calculates a saturation sharpness correcting factor K S according to the following equation (17) based on the saturation signal S of the target pixel, the average saturation signal S A , the hue signal H of the target pixel and the average hue signal H A , where K AS is an enhancement level for the color components in the entire color image.
- K S 1+ K AS ⁇ ( S ⁇ S A ) (17)
- the saturation correcting factor calculator 109 calculates a saturation sharpness correcting factor K S according to the following equation (18) (although there are other various calculations) based on the saturation signal S of the target pixel, the average saturation signal S A , the hue signal H of the target pixel and the average hue signal H A ′ where K AH is an enhancement level for the color components in the entire color image.
- a table may be produced based on hue difference
- the saturation sharpness correcting factor is calculated considering the hue difference and the saturation difference.
- the saturation correcting factor calculator 109 outputs the saturation sharpness correcting factor signal K S (the calculated saturation sharpness correcting factor K S ) and the saturation signal S of the target pixel to the saturation corrector 111 , and the hue signal H of the target pixel to the color space inverter 112 .
- the saturation signal S of the target pixel and the saturation sharpness correcting factor signal K S from the saturation correcting factor calculator 109 are input to the saturation corrector 111 .
- the saturation corrector 111 obtains (calculates/generates) a sharpness-corrected saturation signal S′ of the target pixel, based on the value (saturation edge value) indicated by the saturation signal S of the target pixel and the saturation sharpness correcting factor signal K S .
- the saturation corrector 111 calculates the saturation signal S′ according to the following equation (19) based on the value indicated by the saturation signal S of the target pixel and the saturation sharpness correcting factor-signal K S .
- the saturation corrector 111 outputs the calculated saturation signal S′ of the target pixel to the color space inverter 112 .
- the lightness signal V′ of the target pixel from the lightness corrector 110 , the saturation signal S′ of the target pixel from the saturation corrector 111 and the hue signal H of the target pixel from the saturation correcting factor calculator 109 are input to the color space inverter 112 .
- the color space inverter 112 inverts the color space represented by the input lightness signal V′, the input saturation signal S′ and the input hue signal H of the target pixel to lightness- and saturation-corrected RGB (R′G′B′) signals based on the lightness signal V′, the saturation signal S′ and the hue signal H of the target pixel.
- the color space inverter 112 outputs the inverted RGB (R′G′B′) signals to the output unit 150 .
- the output unit 150 displays or prints out the converted RGB (R′G′B′) signals.
- the color image processing device 130 is capable of performing natural and excellent sharpness processing to image signals regardless of a monochrome gray region or a color region in the color image.
- the color image processing device 130 can perform sharpness processing to a color space represented by the three attributes, namely, hue, saturation and lightness to cope with difference of any of lightness, saturation and hue components of pixels.
- FIG. 6 is a flowchart showing a series of operations performed by the color image processing device 130 according to Embodiment 2.
- RGB signals are input from the input unit 140 to the color space converter 101 (Step S 101 ).
- the color space converter 101 converts the input RGB signals from the input unit 140 into a-color space represented by lightness signals V, saturation signals S and hue signals H (Step S 102 ).
- the color space converter 101 outputs the converted lightness signals V to the line memory 102 and the filter 105 , the converted saturation signals S to the line memory 103 and the filter 106 , and the converted hue signals H to the line memory 104 and the filter 107 .
- the line memories 102 to 104 store the lightness signals V, the saturation signals S and the hue signals H from the color space converter 101 , respectively (Step S 103 ).
- the filter 105 reads out the lightness signals V for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 102 as well as the lightness signals V for the present line from the color space converter 101 , thereby generating an average lightness signal V A based on the values (lightness edge values) indicated by the lightness signals V of the M ⁇ M pixels including the target pixel (Step S 104 ).
- the filter 105 outputs the lightness signal V of the target pixel and the generated average lightness signal V A to the lightness correcting factor calculator 108 .
- Step S 104 for M ⁇ M (where M is an integer) adjacent pixels with a target pixel at the center, the filter 106 reads out the saturation signals S for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 103 as well as the saturation signals S for the present line from the color space converter 101 , thereby generating an average saturation signal S A from the values (saturation edge values) indicated by the saturation signals S of the M ⁇ M pixels including the target pixel.
- the filter 106 outputs the saturation signal S of the target pixel to the lightness correcting factor calculator 108 and the saturation correcting factor calculator 109 , and the generated average saturation signal S A to the saturation correcting factor calculator 109 .
- Step S 104 for M ⁇ M (where M is an integer) adjacent pixels with a target pixel at the center, the filter 107 reads out the hue signals H for the line that is (M ⁇ 1) lines before the present line to the immediately preceding line from the line memory 104 as well as the hue signals H for the present line from the color space converter 101 , thereby generating an average hue signal H A from the values (hue edge values) indicated by the hue signals H of the M ⁇ M pixels including the target pixel.
- the filter 107 outputs the hue signal H of the target pixel and the generated average hue signal H A to the saturation correcting factor calculator 109 .
- the lightness correcting factor calculator 108 generates a lightness sharpness correcting factor signal K V based on values (lightness edge value and average lightness edge value) indicated by the lightness signal V of the target pixel and the average lightness signal V A (Step S 105 ).
- the lightness correcting factor calculator 108 outputs the lightness signal V of the target pixel and the generated lightness sharpness correcting factor signal K V to the lightness corrector 110 .
- Step S 105 with the saturation signal S of the target pixel and the average saturation signal S A from the filter 106 as well as the hue signal of the target pixel and the average hue signal H A from the filter 107 , the saturation correcting factor calculator 109 generates a saturation sharpness correcting factor signal K S based on the saturation signal S of the target pixel, the average saturation signal S A , the hue signal H of the target pixel and the average hue signal H A .
- the saturation correcting factor calculator 109 outputs the generated saturation sharpness correcting factor signal K S and the saturation signal S of the target pixel to the saturation corrector 111 and the hue signal H of the target pixel to the color space inverter 112 .
- the lightness corrector 110 In order to perform sharpness correction to the lightness signal V of the target pixel, with the lightness signal V of the target pixel and the lightness sharpness correcting factor signal K V from the lightness correcting factor calculator 108 , the lightness corrector 110 generates a sharpness-processed lightness signal V′ of the target pixel based on the a value (lightness edge value) indicated by the lightness signal V of the target pixel and the lightness sharpness correcting factor signal K V (Step S 106 ). The lightness corrector 110 outputs the generated lightness signal V′ of the target pixel to the color space inverter 112 .
- Step S 106 in order to perform sharpness correction to the saturation signal S of the target pixel, with the saturation signal S of the target pixel and the saturation sharpness correcting factor signal K S from the saturation correcting factor calculator 109 , the saturation corrector 111 generates a sharpness-processed saturation signal S′ of the target pixel based on the value (saturation edge value) indicated by the saturation signal S of the target pixel and the saturation sharpness correcting factor signal K S .
- the saturation corrector 111 outputs the generated saturation signal S′ of the target pixel to the color space inverter 112 .
- the color space inverter 112 inverts the color space represented by the lightness signal V′, the saturation signal S′ and the hue signal H of the target pixel to lightness- and saturation-corrected RGB (R′G′B′) signals based on the lightness signal V′, the saturation signal S′ and the hue signal H of the target pixel (Step S 107 ).
- the color space inverter 112 outputs the inverted RGB (R′G′B) signals to the output unit 150 (Step S 108 ).
- the color image processing device 130 can perform natural and excellent sharpness processing to image signals.
- the color image processing device 130 can perform natural and excellent sharpness processing to a color image regardless of a monochrome gray region or a color region in a color image.
- natural and effective sharpness processing can be performed even to a part where image enhancement would not take place according to difference of lightness. Since the color image processing device 130 can perform sharpness processing according to the color space represented by the three attributes, namely, hue, saturation and lightness, it can sufficiently cope with difference of any of lightness, saturation and hue components.
- the color image processing device of Embodiment 2 can sufficiently cope with difference of any of lightness, saturation and hue components.
- the color image processing device of the invention can perform natural and excellent sharpness processing to image data.
Abstract
Description
- The present invention relates to a device and a method for color image processing. More particularly, the present invention relates to a color image processing device and a color image processing method for performing sharpness processing to image data.
- In order to perform sharpness processing to a color space represented by luminance and color components, such as a CIELAB color space, a CIELUV color space and a YCbCr color space, conventional image processing devices determine the correction value for the luminance component according to the saturation value of the pixel, and at the same time correct the color component. In this manner, problems such as color turbidity after the correction are solved.
- As a conventional technique of an image processing device, Japanese Patent Laid-Open Application No. 2000-175046 (Related Art 1) discloses an image processing method and an image processing device for noise reduction and sharpness enhancement of a digital image.
- The image processing device described in
Related Art 1 is provided with a sharpness processor, a smoothing processor, an edge/noise-mixed component extractor, an edge detector, a noise region weighting factor operator, a noise component identifier and an output image operator. - The sharpness processor performs sharpness enhancement to the original image data to sharpen the image and the noise included in the image, thereby generating sharpness-enhanced image data. The smoothing processor smoothes the original image data to generate a smoothed image data. The edge/noise-mixed component extractor subtracts the smoothed image data from the sharpness-enhanced image data to generate an edge/noise-mixed object image data including both of the sharpness-enhanced edge of the object image and the sharpness-enhanced noise. The edge detector detects the edge of the original image data to obtain weighting data of the edge region for identifying the edge and noise regions of the object image. The noise region weighting factor operator obtains weighting data of the noise region from the obtained weighting data of the edge region. The noise component identifier multiplies the edge/noise-mixed object image data by the noise region weighting data to obtain noise data for each color in the noise region, calculates color correlation of the noise data for each color, obtain black-and-white noise components and color noise components present in all colors based on the obtained color correlation components and multiply both of the obtained black-and-white noise components and color noise components by their reduction factor, thereby obtaining a black-and-white noise reduction component and a color noise reduction component. The output image operator selectively removes the black-and-white noise reduction component and the color noise reduction component from the sharpness-enhanced image data to reduce the noise, thereby generating a processed image that retains sharpness enhancement in the image edge region.
- Japanese Patent Laid-Open Application No. 2000-175047 (Related Art 2) discloses an image processing method and an image processing device for noise reduction and sharpness enhancement of a digital image.
- The image processing device described in
Related Art 2 is provided with a sharpness processor, a smoothing processor, an edge/granularity-mixed component extractor, an edge detector, a granularity region weighting factor operator, a granularity component identifier and an output image operator. - The sharpness processor performs sharpness enhancement to the original image data to sharpen the image as well as the granularity or the noise included in the image, thereby generating sharpness-enhanced image data. The smoothing processor performs smoothing process to the original image data to generate a smoothed image data. The edge/granularity-mixed component extractor subtracts the smoothed image data from the sharpness-enhanced image data to generate an edge/granularity-mixed object image data that includes both of the edge of the sharpness-enhanced object image and the sharpness-enhanced granularity. The edge detector detects the edge of the original image data to obtain weighting data of the edge region for identifying the object image edge region and the granularity region. The granularity region weighting factor operator obtains weighting data of the granularity region from the obtained weighting data of the edge region. The granularity component identifier multiplies the edge/granularity-mixed object image data by the granularity region weighting data to obtain granularity data for each color in the granularity region, calculates, based on the granularity data of each color, a local granularity factor indicating the spatial size and the magnitude of a change in density of the granularity, identify and separate black-and-white granularity components and pigment granularity components, and multiply both of the obtained black-and-white granularity component and the pigment granularity component by their reduction factor, thereby obtaining a black-and-white granularity reduction component and a pigment granularity reduction component. The output image operator selectively removes the black-and-white granularity reduction component and the pigment granularity reduction component from the sharpness-enhanced image data to reduce granularity, thereby generating a processed image that retains sharpness enhancement in the image edge region.
- Japanese Patent Laid-Open Application No. 2000-278542 (Related Art 3) discloses an image processing device which is capable of natural edge enhancement between colors that have little difference in lightness and densities.
- The image processing device described in
Related Art 3 processes and outputs color image information input from a certain image input device. The image processing device is provided with a color difference information extracting means, a color difference edge detecting means, a color difference enhancement level calculating means and a color difference enhancement correcting means. The color difference information extracting means extracts color difference information from the color image information. The color difference edge detecting means detects a color difference edge from the color difference information extracted by the color difference information extracting means, thereby calculating the color difference edge value at the color difference edge. The color difference enhancement level calculating means calculates a color difference enhancement level based on the color difference edge value calculated by the color difference edge detecting means. The color difference enhancement correcting means performs enhancement correction to the color difference information based on the color difference enhancement level calculated by the color difference enhancement level calculating means. - Japanese Patent Laid-Open Application No. 9-284560 (Related Art 4) discloses a sharpness processing device which is capable of providing an excellently-sharpened printed matter at a low cost.
- The sharpness processing device described in Related Art4 performs sharpness processing to an input image signal. The device is provided with a storing means, a selecting means, a processing means and an outputting means. The storing means stores a plurality of values corresponding to a plurality of image display conditions as parameters for sharpness processing. The selecting means selects a particular value from the plurality of parameters according to a particular image display condition selected among the plurality of image display conditions. The processing means performs sharpness processing to the input image signal in accordance with the particular value. The outputting means outputs an output image signal resulting from the sharpness processing to an image displaying means that is appropriate for the particular image display condition. The sharpness processor described in Related Art 4 is characterized in that the plurality of parameters give substantially equal sharpness presentations for the plurality of image display conditions.
- Japanese Patent Laid-Open Application No. 10-42152 (Related Art 5) discloses an image processing device and method in which a circuit configuration required for edge enhancement correction is simplified.
- The image processor described in
Related Art 5, which performs sharpness correction to an input image signal, is provided with an extracting means, an edge value extracting means, a saturation extracting means, a dividing means and an edge enhancement means. The extracting means extracts a lightness signal and a chromaticity signal from of the input image signal. The edge value extracting means extracts an edge value based on the lightness signal. The saturation extracting means extracts a saturation component based on the chromaticity signal. The dividing means divides the enhancement level of the edge portion, which is based on the edge value extracted by the edge value extracting means, for a lightness signal and a chromaticity signal according to the saturation component extracted by the saturation extracting means. The edge enhancement means corrects the lightness signal and the chromaticity signal by the enhancement levels of the edge portion divided by the dividing means. - From Japanese Patent No. 2906975 (Related Art 6), a color image processing method and device which can reduce an image noise caused by edge enhancement processing and which can perform visually natural edge enhancement are known.
- The image processing device described in
Related Art 6 is provided with an edge detecting means for obtaining an edge value signal from a luminance signal of a luminance/chromaticity-separated signal, an edge enhancement means for enhancing an edge portion in an image represented by the luminance signal, a smoothing means for smoothing the luminance signal, a saturation detecting means for detecting a saturation signal of the image based on the chromaticity signal of the luminance/chromaticity-separated signal, a means for converting luminance by mixing the output from the edge enhancement means and the output from the smoothing means based on the edge value signal detected by the edge detecting means, and means for converting chromaticity of the chromaticity signal corresponding to compression or expansion of saturation using the output from the edge detecting means and the output from the saturation detecting means. - In order to correct color components, conventional image processing devices perform sharpness processing to the color components by extracting and using an edge value based on the changing point (edge) of the lightness (characteristic) of the image through edge detection of the luminance component. In this case, sharpness processing cannot be performed in a satisfactory manner when values of the luminance components at an edge portion of a letter or a line are generally equal but values of the color components are entirely different. For example, when a yellow letter or a yellow line is on a white background, conventional image processing devices cannot sufficiently cope with the difference of any of luminance, saturation and hue components of the pixels in the color image since the luminance of white and yellow colors are generally equal.
- The present invention has an objective of providing a color image processing device and a color image processing method which enable natural and excellent sharpness processing of image data.
- Another objective of the present invention is to provide a color image processing device and a color image processing method which can sufficiently cope with difference of any of luminance, saturation and hue components of the pixels.
- Means for achieving the above-described objectives will be described below. In the following descriptions that correspond to the appended claims, reference numerals and symbols are indicated within parentheses. The reference numerals and symbols correspond to those appearing in the description of at least one of a plurality of embodiments or examples of the invention, particularly those appearing in the appended drawings corresponding to the plurality of embodiments or examples of the invention. The reference numerals and symbols aid to clarify correspondence between the descriptions of the claims and the descriptions of the embodiments or examples of the present invention. Such correspondence, however, does not limit the description of the claims to the descriptions of the embodiment or the example.
- A color image processing device of the invention comprises: a color space converter (1) for converting image signals (RGB) to luminance signals (L) corresponding to luminance and first and second chromaticity signals (C1, C2) corresponding to chromaticity; a luminance signal correcting unit for correcting the luminance signal (L) of a target pixel based on an average luminance signal (LA) obtained from luminance signals of the target pixel and predetermined pixels surrounding the target pixel, and a saturation signal (S) corresponding to saturation of the target pixel; a chromaticity signal correcting unit for correcting the first and second chromaticity signals (C1, C2) of the target pixel based on first and second average chromaticity signals (C1 A, C2 A) obtained from the chromaticity signals of the target pixel and the predetermined pixels surrounding the target pixel, the saturation signal (S) of the target pixel, an average saturation signal (SA) of the target pixel and the predetermined pixels surrounding the target pixel, and a hue difference signal (DC) representing color similarity which is obtained from the first and second chromaticity signals and the first and second average chromaticity signals; and a color space inverter (15) for inverting the corrected luminance signal (L′), the corrected first chromaticity signal (C1′) and the corrected second chromaticity signal (C2′) to image signals (R′G′B′).
- In a color image processing device of the invention, the luminance signal correcting unit comprises a luminance correcting factor calculator (11) for determining a luminance correcting level (KL) for correcting the luminance signal (L) of the target pixel based on the average luminance signal (LA) and the saturation signal (S) of the target pixel.
- In a color image processing device of the invention, the luminance signal correcting unit comprises a luminance corrector (13) for correcting the luminance signal (L) of the target pixel based on the luminance correcting level (KL).
- The color image processing device of the invention may further comprise: a saturation calculator (8) for generating a saturation signal (S) of the target pixel based on the first and second chromaticity signals (C1, C2); an average saturation calculator (9) for generating the average saturation signal (SA) based on the first and second average chromaticity signals (C1 A, C2 A); and a hue difference calculator (10) for generating the hue difference signal (DC) based on the first and second chromaticity signals (C1, C2) as well as the first and second average chromaticity signals (C1 A, C2 A) In a color image processing device of the invention, the chromaticity signal correcting unit comprises a color correcting factor calculator (12) for determining the chromaticity correcting level (KC) for correcting the first and second chromaticity signals (C1, C2) of the target pixel based on the saturation signal (S) of the target pixel, the average saturation signal (SA) and the hue difference signal (DC).
- In a color image processing device of the invention, chromaticity signal correcting unit comprises a chromaticity corrector (14) for correcting the first and second chromaticity signals (C1, C2) based on the chromaticity correcting level (KC).
- Accordingly, the present invention is capable of performing natural and excellent sharpness processing to a color image regardless of a monochrome gray region or a color region in the image.
- A color image processing device of the invention comprises: a color space converter (101) for converting image signals (RGB) to lightness signals (V) corresponding to lightness, saturation signals (S) corresponding to saturation and hue signals (H) corresponding to hue; a lightness signal correcting unit for correcting the lightness signal (V) of a target pixel based on an average lightness signal (VA) obtained from the lightness signals of the target pixel and predetermined pixels surrounding the target pixel, and the saturation signal (S); a saturation signal correcting unit for correcting the saturation signal (S) of the target pixel based on an average saturation signal (SA) obtained from the saturation signals of the target pixel and the predetermined pixels surrounding the target pixel, and an average hue signal (HA) obtained from the hue signals of the target pixel and the predetermined pixels surrounding the target pixel; and a color space inverter (112) for inverting the corrected lightness signal (V′), the corrected saturation signal (S′) and the hue signal (H′) to image signals (R′G′B′).
- In the color image processing device of the invention, the lightness signal correcting unit comprises a lightness correcting factor calculator (108) for determining a lightness correcting level (KV) for correcting the lightness signal (V) of the target pixel based on the average lightness signal (VA) and the saturation signal (S).
- In the color image processing device of the invention, the lightness signal correcting unit comprises a lightness corrector (110) for correcting the lightness signal (V) of the target pixel based on the lightness correcting level (KV).
- In the color image processing device of the invention, the saturation signal correcting unit comprises a saturation correcting factor calculator (109) for determining a saturation correcting level (KS) for correcting the saturation signal (S) of the target pixel based on the average saturation signal (SA) and the average hue signal (HA).
- In the color image processing device of the invention, the saturation signal correcting unit comprises a saturation corrector (111) for correcting the saturation signal (S) of the target pixel based on the saturation correcting level (KS).
- Accordingly, the present invention is capable of performing natural and excellent sharpness processing to a color image regardless of a monochrome gray region or a color region in the image.
- A color image processing method of the invention comprises the steps of: (a) converting image signals (RGB) to luminance signals (L) corresponding to luminance, and first and second chromaticity signals (C1, C2) corresponding to chromaticity; (b) correcting the luminance signal (L) of a target pixel based on an average luminance signal (LA) obtained from the luminance signals of the target pixel and predetermined pixels surrounding the target pixel, and a saturation signal (S) corresponding to saturation of the target pixel; (c) correcting the first and second chromaticity signals (C1, C2) of the target pixel based on first and second average chromaticity signals (C1 A, C2 A) obtained from the chromaticity signals of the target pixel and the predetermined pixels surrounding the target pixel, the saturation signal (S) of the target pixel, the average saturation signal (SA), and a hue difference signal (DC) representing color similarity obtained from the first and second chromaticity signals and the first and second average chromaticity signals; and (d) inverting the corrected luminance signal (L′), the corrected first chromaticity signal (C1′) and the corrected second chromaticity signal (C2′) to image signals (R′G′B′).
- In the color image processing method of the invention, the step of (b) for correcting the luminance signal further comprises the steps of: (e) determining the luminance correcting level (KL) for correcting the luminance signal (L) of the target pixel based on the average luminance signal (LA) and the saturation signal (S) of the target pixel; and (f) correcting the luminance signal (L) based on the luminance correcting level (KL).
- In the color image processing method of the invention, the step of (c) for correcting the chromaticity signals further comprises the steps of: (g) generating the saturation signal (S) of the target pixel based on the first and second chromaticity signals (C1, C2); (h) generating the average saturation signal (SA) based on the first and second average chromaticity signals (C1 A, C2 A); and (i) generating the hue difference signal (DC) based on the first and second chromaticity signals (C1, C2) as well as first and second average chromaticity signals (C1 A, C2 A).
- In the color image processing method of the invention, the step of (c) for correcting the chromaticity signals further comprises the steps of: (j) determining a chromaticity correcting level (KC) for correcting the first and second chromaticity signals (C1, C2) of the target pixel based on the saturation signal (S) of the target pixel, the average saturation signal (SA) and the hue difference signal (DC); and (k) correcting the first and second chromaticity signals (C1, C2) of the target pixel based on the chromaticity correcting level (KC).
- Accordingly, the present invention is capable of performing natural and excellent sharpness processing to a part of an image where enhancement would not take place according to the difference of luminance.
- A color image processing method of the invention comprises the steps of: (a) converting image signals (RGB) to lightness signals (V) corresponding to lightness, saturation signals (S) corresponding to saturation and hue signals (H) corresponding to hue; (b) correcting the lightness signal (V) of a target pixel based on an average lightness signal (VA) obtained from the lightness signals of the first target pixel and pixels surrounding the first target pixel, and the saturation signal (S); (c) correcting the saturation signal (S) of the target pixel based on an average saturation signal (SA) obtained from the saturation signals of the target pixel and the predetermined pixels surrounding the target pixel, and an average hue signal (HA) obtained from the hue signals of the target pixel and the predetermined pixels surrounding the target pixel; and (d) inverting the corrected lightness signal (V′), the corrected saturation signal (S′) and the hue signal (H) to image signals (R′G′B′).
- In a color image processing method of the invention, the step of (b) for correcting the lightness signal further comprises the steps of: (e) determining a lightness correcting level (KV) for correcting the lightness signal (V) of the target pixel based on the average lightness signal (VA) and the saturation signal (S); and (f) correcting the lightness signal (V) of the target pixel based on the lightness correcting level (KV).
- In a color image processing method of the invention, the step of (c) for correcting the saturation signal further comprises the steps of: (g) determining a saturation correcting level (KS) for correcting the saturation signal (S) of the target pixel based on the average saturation signal (SA) and the average hue signal (HA); and (h) correcting the saturation signal (S) of the target pixel based on the saturation correcting level (KS).
- Accordingly, natural and effective sharpness processing can be performed even to a part of the image that would not be enhanced according to the difference of the luminance.
- FIG. 1 is a block diagram showing a configuration of a color image processing device according to
Embodiment 1 of the invention; - FIG. 2 is a plan view showing a size of a filter used in the color image processing device of
Embodiment 1; - FIG. 3 is a diagram showing relationship between values indicated by color component data C1 and values indicated by color component data C2;
- FIG. 4 is a flowchart showing a series of operations performed by the color image processing device of
Embodiment 1; - FIG. 5 is a block diagram showing a configuration of a color image processing device according to
Embodiment 2 of the invention; and - FIG. 6 is a flowchart showing a series of operations performed by the color image processing device of
Embodiment 2. - Hereinafter, embodiments of a color image processing device of the present invention will be described with reference to the accompanying drawings.
-
Embodiment 1 - FIG. 1 is a block diagram showing a configuration of a color
image processing device 30 according toEmbodiment 1 of the present invention. - Referring to FIG. 1, the color
image processing device 30 ofEmbodiment 1 is provided with acolor space converter 1,line memories 2 to 4,filters 5 to 7, asaturation calculator 8, anaverage saturation calculator 9, ahue difference calculator 10, a luminance correctingfactor calculator 11, a color correctingfactor calculator 12, aluminance corrector 13, acolor corrector 14 and acolor space inverter 15. Furthermore, the colorimage processing device 30 is connected to peripherals such as aninput unit 40 including a scanner and the like, and anoutput unit 50 including a display unit, a printer and the like. - The
input unit 40 scans RGB color image signals (RGB signals) in the x-direction (main-scanning direction) and inputs signals of each line by each element of a color space. Here, one line refers to a line of adjacent pixels (including target pixel) scanned in the main-scanning direction. Theinput unit 40 outputs the input RGB signals for each element of the color space to thecolor space converter 1. Then, theinput unit 40 scans in the y-direction (sub-scanning direction) and scans the RGB color image signals (RGB signals) in the main-scanning direction to input signals of the next line by each element of the color space. The input RGB signals for each element of the color space are output to thecolor space converter 1. - The
color space converter 1 converts the RGB signals input from theinput unit 40 into elements of color space represented by luminance signals L corresponding to a luminous intensity of light from a light source per orthogonal unit area, and chromaticity signals C1 and C2 representing degrees of color. Herein, the luminance signals L and the chromaticity signals C1 and C2 represent a color space such as a CIELAB color space, a CIELUV color space and a YCbCr color space, and are converted using computing or a table. Thecolor space converter 1 outputs the converted luminance signals L to theline memory 2 and thefilter 5, the converted chromaticity signals C1 to theline memory 3 and thefilter 6, and the converted chromaticity signals C2 to the line memory 4 and thefilter 7. - The sizes of the
line memories 2 to 4 depend on the sizes of thefilters 5 to 7. When a filter has a size for M×M adjacent pixels (where M is an integer), the line memory needs to have a size for at least (M−1) lines. When the line memories each have a size for (M−1) lines, theline memory 2 can store luminance signals L for (M−1) lines given from thecolor space converter 1, theline memory 3 can store chromaticity signals C1 for (M−1) lines given from thecolor space converter 1, and the line memory 4 can store chromaticity signals C2 for (M−1) lines given from thecolor space converter 1. - The
filters 5 to 7 read out the signals (luminance signals L and chromaticity signals C1 and C2) that are converted into a color space for a line that is (M−1) lines before the present line to the immediately preceding line from theline memories 2 to 4, respectively, and read out the signals for the present line from thecolor space converter 1. Thefilters 5 to 7 use the read-out signals (luminance signals L and chromaticity signals C1 and C2) that are converted into the color space to calculate average values of L, C1 and C2 based on L, C1 and C2 values (edge values) of the target pixel and pixels surrounding the target pixel. - Hereinafter, the above-mentioned
filters 5 to 7 will be described in more detail with reference to FIG. 2. - FIG. 2 is a plan view showing a size of the filters used in the color image processing device of
Embodiment 1. - For example, the filter size of the
filters 5 to 7 may be adaptive for 5×5 adjacent pixels as shown in FIG. 2. - According to this example, the
filter 5 has apixel 20 at the center. Thefilter 5 reads out the luminance signals L for the line that is four lines before the present line to the immediately preceding line from theline memory 2 and reads out the luminance signals L for the present line from thecolor space converter 1. Herein, thecenter pixel 20 is referred to as a “sharpness processing target pixel” or a “target pixel”. Thefilter 5 calculates an average value of the values (luminance edge values) indicated by the luminance signals L of the 25 pixels including the target pixel to generate an average luminance signal LA. Thefilter 5 outputs the luminance signal L of the target pixel and the calculated average luminance signal LA to the luminance correctingfactor calculator 11. - According to this example, the
filter 6 has thepixel 20 at the center. Thefilter 6 reads out the chromaticity signals C1 for the line that is four lines before the present line to the immediately preceding line from theline memory 3 and reads out the chromaticity signals C1 for the present line from thecolor space converter 1. Herein, thecenter pixel 20 is referred to as a “sharpness processing target pixel” or a “target pixel”. Thefilter 6 calculates an average value of the values (color edge values) indicated by the chromaticity signals C1 of the 25 pixels including the target pixel to generate an average chromaticity signal C1 A. Thefilter 6 outputs the chromaticity signal C1 of the target pixel to thesaturation calculator 8 and thehue difference calculator 10, and the calculated average chromaticity signal C1 A to theaverage saturation calculator 9 and thehue difference calculator 10. - According to this example, the
filter 7 has thepixel 20 at the center. Thefilter 7 reads out the chromaticity signals C2 for the line that is four lines before the present line to the immediately preceding line from the line memory 4 as well as the chromaticity signals C2 for the present line from thecolor space converter 1. Herein, thecenter pixel 20 is referred to as a “sharpness processing target pixel” or a “target pixel”. Thefilter 7 calculates an average value of the values (color edge values) indicated by the chromaticity signals C2 of the 25 pixels including the target pixel to generate an average chromaticity signal C2 A. Thefilter 7 outputs the chromaticity signal C2 of the target pixel to thesaturation calculator 8 and thehue difference calculator 10, and the calculated average chromaticity signal C2 A to theaverage saturation calculator 9 and thehue difference calculator 10. - In the above-described example shown in FIG. 2, the
filters 5 to 7 calculate the average values based on the 5×5 adjacent pixels including the target pixel. Alternatively, thefilters 5 to 7 can also calculate the average values based on the 5×5 adjacent pixels without the target pixel. The filter sizes of thefilters 5 to 7 are not necessarily equal. For example, the filter sizes may differ between the luminance component filter and the color component filters. - As shown in FIG. 1, the chromaticity signal C1 of the target pixel from
filter 6 and the chromaticity signal C2 of the target pixel fromfilter 7 are input to thesaturation calculator 8. Thesaturation calculator 8 obtains (calculates) saturation S representing the vividness of the color based on the values (color edge values) indicated by the chromaticity signals C1 and C2, thereby generating a saturation signal S. Thesaturation calculator 8 calculates saturation based on the chromaticity signals C1 and C2 of the target pixel according to the following Equation (1). Alternatively, thesaturation calculator 8 may also calculate saturation S by the following simplified equations (2) or (3). - S=(C1 2+C2 2)½ (1)
- S=C1 2+C2 2 (2)
- S=max(C1, C2) (3)
- In the above equations, saturation S is calculated using computing or a table. The
saturation calculator 8 outputs the saturation signal S (calculated saturation S) to the luminance correctingfactor calculator 11 and outputs the saturation signal S (calculated saturation S) as well as the chromaticity signals C1 and C2 of the target pixel to the color correctingfactor calculator 12. - The average chromaticity signal C1 A from the
filter 6 and the average chromaticity signal C2 A from thefilter 7 are input to theaverage saturation calculator 9. Theaverage saturation calculator 9 obtains (calculates) average saturation SA representing the average vividness of the colors based on the values (mean color edge values) indicated by the average chromaticity signals C1 A and C2 A, thereby generating an average saturation signal SA. Theaverage saturation calculator 9 calculates average saturation SA according to the following Equation (4) based on the average chromaticity signals C1 A and C2 A Alternatively, theaverage saturation calculator 9 may also calculate average saturation sA by the following simplified equations (5) or (6). - S A=(C1 A 2+C2 A 2)½ (4)
- S A=C1 A 2+C2 A 2 (5)
- S A=max(C1 A, C2 A) (6)
- In the above equations, the average saturation SA is calculated using computing or a table corresponding to the computing system of the
saturation calculator 8. Theaverage saturation calculator 9 outputs the average saturation signal SA (calculated average saturation SA) to the color correctingfactor calculator 12. - The chromaticity signal C1 of the target pixel and the average chromaticity signal C1 A from the
filter 6 as well as the chromaticity signal C2 of the target pixel and the average chromaticity signal C2 A from thefilter 7 are input to thehue difference calculator 10. Thehue difference calculator 10 obtains (calculates) hue difference indicating color similarity based on the values (color edge values) indicated by the chromaticity signals C1 and C2 and the values (mean color edge values) indicated by the average chromaticity signals C1 A and C2 A, thereby generating a hue difference signal DC. - Hereinafter, the above-described
hue difference calculator 10 will be described in more detail with reference to FIG. 3. - FIG. 3 is a diagram showing the relationship between values indicated by the chromaticity signals C1 and values indicated by the chromaticity signals C2.
- For example, as shown in FIG. 3 where a predetermined reference value (e.g., color edge value of 0) indicated by the chromaticity signals C1 and C2 are set as the base point, a vector (C1, C2) is generated based on the values indicated by the chromaticity signals C1 and C2 of the target pixel. In addition, a vector (C1 A, C2 A) is generated based on the values indicated by the average chromaticity signals C1 A and C2 A. The hue difference signal DC is cosine θ where θ is an angle between the vector (C1, C2) and the vector (C1 A, C2 A) on the two-dimensional plane produced by two color components.
- The
hue difference calculator 10 gives hue difference DC based on the values indicated by the chromaticity signals C1 and C2 and the values indicated by the average chromaticity signals C1 A and C2 A according to the following equation (7). Alternatively, thehue difference calculator 10 may give the hue difference DC according to the following simplified equation (8). - DC=cox θ=(C1×C1 A +C2×C2 A)/((C1 2+C2 2)½×(C1 A 2+C2 A 2)½) (7)
- DC=max(|C1−C1 A|, |C2−C2 A|) (8)
- Where hue difference DC=cosθ, −1≦DC≦1. DC is 1 when the colors are the same, and a higher DC value indicates higher similarity between the colors. For Equation (8), a lower DC value indicates higher similarity. The
hue difference calculator 10 outputs the hue difference signal DC (calculated hue difference DC) to the color correctingfactor calculator 12. - As shown in FIG. 1, the luminance signal L of the target pixel and the average luminance signal LA from the
filter 5 as well as the saturation signal S from thesaturation calculator 8 are input to the luminance correctingfactor calculator 11. The luminance correctingfactor calculator 11 obtains (calculates) a luminance sharpness correcting factor KL (a luminance sharpness correcting factor signal KL) for theluminance corrector 13 to perform sharpness correction, based on a value (luminance edge value) indicated by the luminance signal L of the target pixel, a value (mean luminance edge value) indicated by the average luminance signal LA and the saturation signal S. Enhancement according to the luminance component is more effective in a monochrome gray region than in a color region. Enhancement in a color region may cause color turbidity or the like, resulting in image deterioration. Accordingly, the luminance sharpness correcting factor is calculated only when the saturation signal S of the sharpness processing target pixel (target pixel) is lower than the luminance correction threshold. The enhancement level of the luminance components of the entire color image is indicated as KAL. The luminance correctingfactor calculator 11 calculates a luminance sharpness correcting factor KL according to the following equation (9), based on the value indicated by the luminance signal L of the target pixel, the value indicated by the average luminance signal LA and the saturation signal S. - K L =K AL×(L−L A) (9)
- The luminance correcting
factor calculator 11 outputs the luminance signal L of the target pixel and the luminance sharpness correcting factor signal KL (calculated luminance sharpness correcting factor KL) to theluminance corrector 13. - The luminance signal L of the target pixel and the luminance sharpness correcting factor signal KL from the luminance correcting
factor calculator 11 are input to theluminance corrector 13. In order to perform sharpness correction to the luminance signal L of the target pixel, theluminance corrector 13 obtains (calculates/generates) a sharpness-corrected luminance signal L′ of the target pixel based on the value (luminance edge value) indicated by the luminance signal L of the target pixel and the luminance sharpness correcting factor signal KL. Theluminance corrector 13 calculates the luminance signal L′ according to the following equation (10) based on the value indicated by the luminance signal L of the target pixel and the luminance sharpness correcting factor signal KL. - L′=L+K L (10)
- The
luminance corrector 13 outputs the calculated luminance signal L′ of the target pixel to thecolor space inverter 15. - The chromaticity signals C1 and C2 and the saturation signal S of the target pixel from the
saturation calculator 8, the average saturation signal SA from theaverage saturation calculator 9, and the hue difference signal DC from thehue difference calculator 10 are input to the color correctingfactor calculator 12. The chromaticity signals C1 and C2 of the target pixel are used for the later-describedcolor corrector 14 to perform sharpness correction. The color correctingfactor calculator 12 obtains (calculates) a color sharpness correcting factor KC (a color sharpness correcting factor signal KC) for thecolor corrector 14 to perform sharpness correction based on the saturation signal S of the target pixel, the average saturation signal SA, and the hue difference signal DC. When correction according to color components takes place in the monochrome gray region, color may be caused in the monochrome area. Accordingly, color sharpness is performed only when the saturation signal S of the sharpness processing target pixel (target pixel) is greater than the color correction threshold. The saturation signal S and the average saturation signal SA of pixels may be generally equal while the hue difference signal DC is high, in order words, the pixels may greatly differ in colors. In this case, the color sharpness correcting factor KC is calculated in a different manner according to the magnitude of the hue difference signal DC. - Specifically, when the hue difference signal DC is calculated by Equation (7) (DC=cos θ) and the hue difference signal DC is smaller than the hue difference threshold (when the colors are similar), the color correcting
factor calculator 12 calculates a color sharpness correcting factor KC according to the following equation (11), based on the saturation signal S, the average saturation signal SA and the hue difference signal DC, where the enhancement level of the color components in the entire color image is represented by KAS. - K C=1+K AS×(S×S A) (11)
- When the hue difference signal DC is greater than the hue difference threshold (i.e., when the colors are different), the color correcting
factor calculator 12 calculates a color sharpness correcting factor KC according to the following equation (12) (although there are other various calculations) based on the saturation signal S, the average saturation signal SA and the hue difference signal DC, where the enhancement level of the color components differing in colors in the entire color image is represented by KAC. - K C=1+K AC×(S−S A) (12)
- When the colors are different, a table may be produced based on the hue difference signal DC and the saturation difference (S−SA) to calculate KC. In either case, the color sharpness correcting factor is calculated considering the hue difference signal DC and the saturation difference. The color correcting
factor calculator 12 outputs the color sharpness correcting factor signal KC (the calculated color sharpness correcting factor KC) and the chromaticity signals C1 and C2 of the target pixel to thecolor corrector 14. - The chromaticity signals C1 and C2 of the target pixel and the color sharpness correcting factor signal KC from the color correcting
factor calculator 12 is input to thecolor corrector 14. In order to perform sharpness correction to the chromaticity signals C1 and C2 of the target pixel, thecolor corrector 14 obtains (calculates/generates) sharpness-corrected chromaticity signals C1′ and C2′ of the target pixel based on values (color edge values) indicated by the chromaticity signals C1 and C2 of the target pixel and the color sharpness correcting factor signal KC. Thecolor corrector 14 calculates the chromaticity signals C1′ and C2′ according to the following equations (13) and (14) based on the values indicated by the chromaticity signals C1 and C2 of the target pixel and the color sharpness correcting factor signal KC. - C1′=C1×K C (13)
- C2′=C2×K C (14)
- The
color corrector 14 outputs the calculated chromaticity signals C1′ and C2′ of the target pixel to thecolor space inverter 15. - The luminance signal L′ of the target pixel from the
luminance corrector 13 and the chromaticity signals C1′ and C2′ of the target pixel from thecolor corrector 14 are input to thecolor space inverter 15. Thecolor space inverter 15 inverts the color space represented by the luminance signal L′ and the chromaticity signals C1′ and C2′ of the target pixel into luminance- and color-corrected RGB (R′G′B′) signals based on the luminance signal L′ and the chromaticity signals C1′ and C2′ of the target pixel. Thecolor space inverter 15 outputs the converted RGB (R′G′B′) signals to theoutput unit 50. - The
output unit 50 displays or prints out the converted RGB (R′G′B′) signals. - Accordingly, the color
image processing device 30 is able to perform natural and excellent sharpness processing to image signals regardless of the monochrome gray region or the color region of the image. - Hereinafter, operations performed by the above-described color
image processing device 30 will be described with reference to FIG. 4. - FIG. 4 is a flowchart showing a series of operations performed by the color image processing device according to
Embodiment 1. - Referring to FIG. 4, RGB signals are input from the
input unit 40 to the color space converter 1 (Step S1). - The
color space converter 1 converts the RGB signals input from theinput unit 40 into a color space represented by luminance signals L and chromaticity signals C1 and C2 (Step S2). Thecolor space converter 1 outputs the converted luminance signals L to theline memory 2 and thefilter 5, the converted chromaticity signals C1 to theline memory 3 and thefilter 6, and the converted chromaticity signals C2 to the line memory 4 and thefilter 7. - Thus, the
line memories 2 to 4 store the luminance signals L, the chromaticity signals C1 and the chromaticity signals C2 from thecolor space converter 1, respectively (Step S3). - Next, for M×M (where M is an integer) adjacent pixels with a target pixel at the center, the
filter 5 reads out the luminance signals L for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 2 as well as the luminance signals L for the present line from thecolor space converter 1, thereby generating an average luminance signal LA from the values (luminance edge values) indicated by the luminance signals L of the M×M pixels including the target pixel (Step S4). Thefilter 5 outputs the luminance signal L of the target pixel and the generated average luminance signal LA to the luminance correctingfactor calculator 11. - In Step S4, for M×M (where M is an integer) adjacent pixels with a target pixel at the center, the
filter 6 reads out the chromaticity signals C1 for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 3 as well as the chromaticity signals C1 for the present line from thecolor space converter 1, thereby generating an average chromaticity signal C1 A based on the values (color edge values) indicated by the chromaticity signals C1 of the M×M pixels including the target pixel. Thefilter 6 outputs the chromaticity signal C1 of the target pixel to thesaturation calculator 8 and thehue difference calculator 10, and the generated average chromaticity signal C1 A to theaverage saturation calculator 9 and thehue difference calculator 10. - In Step S4, for M×M (where M is an integer) adjacent pixels with a target pixel at the center, the
filter 7 reads out the chromaticity signals C2 for the line that is (M−1) lines before the present line to the immediately preceding line from the line memory 4 as well as the chromaticity signals C2 for the present line from thecolor space converter 1, thereby generating an average chromaticity signal C2 A based on the values (color edge values) indicated by the chromaticity signals C2 of the M×M pixels including the target pixel. Thefilter 7 outputs the chromaticity signal C2 of the target pixel to thesaturation calculator 8 and thehue difference calculator 10, and the generated average chromaticity signal C2 A to theaverage saturation calculator 9 and thehue difference calculator 10. - Next, with the chromaticity signals C1 and C2 of the target pixel from the
respective filters saturation calculator 8 generates a saturation signal S based on values (color edge values) indicated by the chromaticity signals C1 and C2 of the target pixel (Step S5). Thesaturation calculator 8 outputs the generated saturation signal S to the luminance correctingfactor calculator 11, and outputs the generated saturation signal S and the chromaticity signals C1 and C2 of the target pixel to the color correctingfactor calculator 12. - In Step-S5, with the average chromaticity signals C1 A and C2 A from the
respective filters average saturation calculator 9 generates an average saturation signal SA based on the values (mean color edge values) indicated by the average chromaticity signals C1 A and C2 A. Theaverage saturation calculator 9 outputs the generated average saturation signal SA to the color correctingfactor calculator 12. - In Step S5, with the chromaticity signal C1 of the target pixel and the average chromaticity signal C1 A from the
filter 6 as well as the chromaticity signal C2 of the target pixel and the average chromaticity signal C2 A from thefilter 7, thehue difference calculator 10 generates a hue difference signal DC based on the values (color edge values) indicated by the chromaticity signals C1 and C2 and values (mean color edge values) indicated by the average chromaticity signals C1 A and C2 A Thehue difference calculator 10 outputs the generated hue difference signal DC to the color correctingfactor calculator 12. - Next, with the luminance signal L of the target pixel and the average luminance signal LA from the
filter 5 as well as the saturation signal S from thesaturation calculator 8, the luminance correctingfactor calculator 11 generates a luminance sharpness correcting factor signal KL based on the value (luminance edge value) indicated by the luminance signal L of the target pixel and the value (mean luminance edge value) indicated by the average luminance signal LA and the saturation signal (Step S6). The luminance correctingfactor calculator 11 outputs the luminance signal L of the target pixel and the generated luminance sharpness correcting factor signal KL to theluminance corrector 13. - In Step S6, with the chromaticity signals C1 and C2 of the target pixel from the
saturation calculator 8, the average saturation signal SA from the averagesaturation signal calculator 9 as well as the hue difference signal DC from thehue difference calculator 10, the color correctingfactor calculator 12 generates a color sharpness correcting factor signal KC based on the saturation signal S of the target pixel, the average saturation signal SA and the hue difference signal DC. The color correctingfactor calculator 12 outputs the generated color sharpness correcting factor signal KC and the chromaticity signals C1 and C2 of the target pixel to thecolor corrector 14. - Next, in order to perform sharpness correction to the luminance signal L of the target pixel, with the luminance signal L of the target pixel and the luminance sharpness correcting factor signal KL from the luminance correcting
factor calculator 11, theluminance corrector 13 generates a sharpness-processed luminance signal L′ of the target pixel based on the value (luminance edge value) indicated by the luminance signal L of the target pixel and the luminance sharpness correcting factor signal KL (Step S7) Theluminance corrector 13 outputs the generated luminance signal L′ of the target pixel to thecolor space inverter 15. - In Step S7, in order to perform sharpness correction to the chromaticity signals C1 and C2 of the target pixel, with the chromaticity signals C1 and C2 of the target pixel and the color sharpness correcting factor signal KC from the color correcting
factor calculator 12, thecolor corrector 14 generates sharpness-processed chromaticity signals C1′ and C2′ of the target pixel based on the values (color edge values) indicated by the chromaticity signals C1 and C2 of the target pixel and the color sharpness correcting factor signal KC. Thecolor corrector 14 outputs the generated chromaticity signals C1′ and C2′ of the target pixel to thecolor space inverter 15. - Next, with the luminance signal L′ of the target pixel from the
luminance corrector 13 and the chromaticity signals C1′ and C2′ of the target pixel from thecolor corrector 14, thecolor space inverter 15 inverts the color space represented by the luminance signal L′ and the chromaticity signals C1′ and C2′ of the target pixel to luminance- and color-corrected RGB signals based on the luminance signal L′ and the chromaticity signals C1′ and C2′ of the target pixel (Step S8). - The
color space inverter 15 outputs the inverted RGB signals to the output unit 50 (Step S9). - The color
image processing device 30 performs sharpness correction to the color components by using the difference between the saturation of the sharpness processing target pixel and the average saturation of the pixels surrounding the target pixel as well as the difference between the color component of the sharpness processing target pixel and the average color component of the pixels surrounding the target pixel. Accordingly, sharpness correction can be performed to a part having an edge of a color that would not be corrected to a satisfactory extent by only a luminance component. - According to the above-described configuration, natural and excellent sharpness processing can be performed to a color image regardless of the monochrome gray region or the color region included in the image. In addition, natural and effective sharpness processing can be performed even to a part where image enhancement would not take place according to the change in luminance.
- When the color of the sharpness processing target pixel is similar to the colors of the surrounding pixels, the color
image processing device 30 corrects by using the saturation difference. When the color of the sharpness processing target pixel is different from the colors of the surrounding pixels, the colorimage processing device 30 performs correction by using both of the hue difference and the saturation difference. Thus, sufficient sharpness correction can be realized even for a part where saturation difference is small. - According to the color image processing device of
Embodiment 1, natural and excellent sharpness processing can be performed to image signals. -
Embodiment 2 - The sharpness processing according to
Embodiment 1 is performed based on a color space represented by luminance signals L and chromaticity signals C1 and C2. According toEmbodiment 2, sharpness processing is performed based on a color space (e.g., HSV color space, HSL color space, etc.) represented by three attributes, namely, hue, saturation and lightness. Thus, in addition to the advantages ofEmbodiment 1, the present invention also has the advantages ofEmbodiment 2 which enables to perform sharpness processing to input image signals. - Hereinafter, a color image processing device according to
Embodiment 2 of the invention will be described with reference to FIG. 5. - FIG. 5 is a block diagram showing a configuration of the color image processing device of
Embodiment 2. - Referring to FIG. 5, the color
image processing device 130 according toEmbodiment 2 is provided with acolor space converter 101,line memories 102 to 104,filters 105 to 107, a lightness correctingfactor calculator 108, a saturation correctingfactor calculator 109, alightness corrector 110, asaturation corrector 111 and acolor space inverter 112. Furthermore, the colorimage processing device 130 is connected to peripherals such as aninput unit 140 including a scanner and the like, and anoutput unit 150 including a display unit, a printer and the like. - The
input unit 140 scans RGB color image signals (RGB signals) in the x-direction (main scanning direction) and inputs signals on each line by each element of a color space. Here, one line refers to a line of adjacent pixels (including a target pixel) scanned in the main scanning direction. Theinput unit 140 outputs the input RGB signals for each element of color space to thecolor space converter 101. Then, theinput unit 140 scans in the y-direction (sub-scanning direction) and scans the RGB color image signals (RGB signals) in the main scanning direction to input signals of the next line by each element of the color space. The input RGB signals for each element of the color space are then output to thecolor space converter 101. - The
color space converter 101 converts the RGB signals input from theinput unit 140 into a color space represented by lightness signals V representing lightness, saturation signals S representing a degree of vividness of the color and hue signals H representing a tinge of the color. Herein, the lightness signals V, the saturation signals S and the hue signals H are converted using computing or a table. Thecolor space converter 101 outputs the converted lightness signals V to theline memory 102 and thefilter 105, the converted saturation signals S to theline memory 103 and thefilter 106, and the converted hue signals H to theline memory 104 and thefilter 107. - Similar to
Embodiment 1, the sizes of theline memories 102 to 104 depend on the sizes of thefilters 105 to 107. When a filter has a size for M×M adjacent pixels (where M is an integer), the line memory needs to have a size for at least (M−1) lines. When the line memories each have a size for (M−1) lines, theline memory 102 can store lightness signals V for (M−1) lines given from thecolor space converter 101, theline memory 103 can store saturation signals S for (M−1) lines given from thecolor space converter 101, and theline memory 104 can store hue signals H for (M−1) lines given from thecolor space converter 101. - The
filters 105 to 107 read out the signals that are converted into the color space (lightness signals V, saturation signals S and hue signals H) for a line that is (M−1) lines before the present line to the immediately preceding line from theline memories 102 to 104, respectively, and also read out the signals for the present line from thecolor space converter 101. Thefilters 105 to 107 use the read-out signals (lightness signals V, saturation signals S and hue signals H) that are converted into the color space to calculate average values of V, S and H based on V, S and H values (edge values) of the target pixel and the pixels surrounding the target pixel. - The
filter 105 recognizes a pixel at the center of the M×M (where M is an integer) adjacent pixels as a target pixel. Thefilter 105 reads out the lightness signals V for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 102, and reads out the lightness signals V for the present line from thecolor space converter 101. Thefilter 105 calculates an average value of the values (lightness edge values) indicated by the lightness signals V of the M×M pixels including the target pixel to generate an average lightness signal VA. Thefilter 105 outputs the lightness signal V of the target pixel and the calculated average lightness signal VA to the lightness correctingfactor calculator 108. - The
filter 106 recognizes a pixel at the center of the M×M (where M is an integer) adjacent pixels as a target pixel. Thefilter 106 reads out the saturation signals S for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 103, and reads out the saturation signals S for the present line from thecolor space converter 101. Thefilter 106 calculates an average value of the values (saturation edge values) indicated by the saturation signals S of the M×M pixels including the target pixel to generate an average saturation signal SA Thefilter 106 outputs the saturation signal S of the target pixel to the lightness correctingfactor calculator 108 and the saturation correctingfactor calculator 109, and the calculated average saturation signal SA to the saturation correctingfactor calculator 109. - The
filter 107 recognizes a pixel at the center of the M×M (where M is an integer) adjacent pixels as a target pixel. Thefilter 107 reads out the hue signals H for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 104 and reads out the hue signals H for the present line from thecolor space converter 101. Thefilter 107 calculates an average value of the values (hue edge values) indicated by the hue signals H of the M×M pixels including the target pixel to generate an average hue signal HA. Thefilter 107 outputs the hue signal H of the target pixel and the calculated average hue signal HA to the saturation correctingfactor calculator 109. - The lightness signal V of the target pixel and the average lightness signal VA from the
filter 105, and the saturation signal S of the target pixel from thefilter 106 are input to the lightness correctingfactor calculator 108. The lightness correctingfactor calculator 108 obtains (calculates) a lightness sharpness correcting factor KV to generate a luminance sharpness correcting factor signal KV for thelightness corrector 110 to perform sharpness correction, based on the lightness signal V (lightness edge value) of the target pixel and the average lightness signal VA (mean lightness edge value). Enhancement based on the lightness component is more effective in a monochrome gray region than in a color region. Enhancement in a color region may cause color turbidity or the like, resulting in image deterioration. Accordingly, the lightness sharpness correcting factor is calculated only when the saturation signal S of the sharpness processing target pixel (target pixel) is lower than the lightness correction threshold. The lightness correctingfactor calculator 108 calculates the lightness sharpness correcting factor KV according to the following equation (15) based on the value indicated by the lightness signal V of the target pixel, the value indicated by the average lightness signal VA and the saturation signal S, where the enhancement level of the lightness of the entire color image is indicated as KAV. - K V =K AV×(V A) (15)
- The lightness correcting
factor calculator 108 outputs the lightness signal V of the target pixel and the lightness sharpness correcting factor signal KV (the calculated lightness sharpness correcting factor KV) to thelightness corrector 110. - The lightness signal V of the target pixel and the lightness sharpness correcting factor signal KV from the lightness correcting
factor calculator 108 are input to thelightness corrector 110. In order to perform sharpness correction to the lightness signal V of the target pixel, thelightness corrector 110 obtains (calculates/generates) a sharpness-corrected lightness signal V′ of the target pixel based on the value (lightness edge value) indicated by the lightness signal V of the target pixel and the lightness sharpness correcting factor signal KV. Thelightness corrector 110 calculates the lightness signal V′ according to the following equation (16) based on the value indicated by the lightness signal V of the target pixel and the lightness sharpness correcting factor signal KV. - V′=V+K V (16)
- The
lightness corrector 110 outputs the calculated lightness signal V′ of the target pixel to thecolor space inverter 112. - The saturation signal S of the target pixel and the average saturation signal SA from the
filter 106 as well as the hue signal H of the target pixel and the average hue signal HA from thefilter 107 are input to the saturation correctingfactor calculator 109. The saturation correctingfactor calculator 109 obtains (calculates) a saturation sharpness correcting factor KS for thesaturation corrector 111 to perform sharpness correction, based on the saturation signal S of the target pixel, the average saturation signal SA, the hue signal H of the target pixel and the means hue signal HA. - Similar to
Embodiment 1, when the hue difference |H−HA| is smaller than the saturation correction threshold (when the colors are similar), the saturation correctingfactor calculator 109 calculates a saturation sharpness correcting factor KS according to the following equation (17) based on the saturation signal S of the target pixel, the average saturation signal SA, the hue signal H of the target pixel and the average hue signal HA, where KAS is an enhancement level for the color components in the entire color image. - K S=1+K AS×(S−S A) (17)
- When the hue difference |H−HA| is greater than the saturation correction threshold (when the colors are different), the saturation correcting
factor calculator 109 calculates a saturation sharpness correcting factor KS according to the following equation (18) (although there are other various calculations) based on the saturation signal S of the target pixel, the average saturation signal SA, the hue signal H of the target pixel and the average hue signal HA′ where KAH is an enhancement level for the color components in the entire color image. - K S=1+K AH×(S−S A) (18)
- Alternatively, when the colors are different, a table may be produced based on hue difference |H−HA| and saturation difference (S−SA) to calculate KS. In either case, the saturation sharpness correcting factor is calculated considering the hue difference and the saturation difference. The saturation correcting
factor calculator 109 outputs the saturation sharpness correcting factor signal KS (the calculated saturation sharpness correcting factor KS) and the saturation signal S of the target pixel to thesaturation corrector 111, and the hue signal H of the target pixel to thecolor space inverter 112. - The saturation signal S of the target pixel and the saturation sharpness correcting factor signal KS from the saturation correcting
factor calculator 109 are input to thesaturation corrector 111. In order to perform sharpness correction to the saturation signal S of the target pixel, thesaturation corrector 111 obtains (calculates/generates) a sharpness-corrected saturation signal S′ of the target pixel, based on the value (saturation edge value) indicated by the saturation signal S of the target pixel and the saturation sharpness correcting factor signal KS. Thesaturation corrector 111 calculates the saturation signal S′ according to the following equation (19) based on the value indicated by the saturation signal S of the target pixel and the saturation sharpness correcting factor-signal KS. - S′=S×K (19)
- The
saturation corrector 111 outputs the calculated saturation signal S′ of the target pixel to thecolor space inverter 112. - The lightness signal V′ of the target pixel from the
lightness corrector 110, the saturation signal S′ of the target pixel from thesaturation corrector 111 and the hue signal H of the target pixel from the saturation correctingfactor calculator 109 are input to thecolor space inverter 112. Thecolor space inverter 112 inverts the color space represented by the input lightness signal V′, the input saturation signal S′ and the input hue signal H of the target pixel to lightness- and saturation-corrected RGB (R′G′B′) signals based on the lightness signal V′, the saturation signal S′ and the hue signal H of the target pixel. Thecolor space inverter 112 outputs the inverted RGB (R′G′B′) signals to theoutput unit 150. - The
output unit 150 displays or prints out the converted RGB (R′G′B′) signals. - Accordingly, the color
image processing device 130 is capable of performing natural and excellent sharpness processing to image signals regardless of a monochrome gray region or a color region in the color image. The colorimage processing device 130 can perform sharpness processing to a color space represented by the three attributes, namely, hue, saturation and lightness to cope with difference of any of lightness, saturation and hue components of pixels. - Hereinafter, operations performed by the above-described color
image processing device 130 will be described with reference to FIG. 6. - FIG. 6 is a flowchart showing a series of operations performed by the color
image processing device 130 according toEmbodiment 2. - Referring to FIG. 6, RGB signals are input from the
input unit 140 to the color space converter 101 (Step S101). - The
color space converter 101 converts the input RGB signals from theinput unit 140 into a-color space represented by lightness signals V, saturation signals S and hue signals H (Step S102). Thecolor space converter 101 outputs the converted lightness signals V to theline memory 102 and thefilter 105, the converted saturation signals S to theline memory 103 and thefilter 106, and the converted hue signals H to theline memory 104 and thefilter 107. - The
line memories 102 to 104 store the lightness signals V, the saturation signals S and the hue signals H from thecolor space converter 101, respectively (Step S103). - Next, for M×M (where M is an integer) adjacent pixels with a target pixel at the center, the
filter 105 reads out the lightness signals V for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 102 as well as the lightness signals V for the present line from thecolor space converter 101, thereby generating an average lightness signal VA based on the values (lightness edge values) indicated by the lightness signals V of the M×M pixels including the target pixel (Step S104). Thefilter 105 outputs the lightness signal V of the target pixel and the generated average lightness signal VA to the lightness correctingfactor calculator 108. - In Step S104, for M×M (where M is an integer) adjacent pixels with a target pixel at the center, the
filter 106 reads out the saturation signals S for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 103 as well as the saturation signals S for the present line from thecolor space converter 101, thereby generating an average saturation signal SA from the values (saturation edge values) indicated by the saturation signals S of the M×M pixels including the target pixel. Thefilter 106 outputs the saturation signal S of the target pixel to the lightness correctingfactor calculator 108 and the saturation correctingfactor calculator 109, and the generated average saturation signal SA to the saturation correctingfactor calculator 109. - In Step S104, for M×M (where M is an integer) adjacent pixels with a target pixel at the center, the
filter 107 reads out the hue signals H for the line that is (M−1) lines before the present line to the immediately preceding line from theline memory 104 as well as the hue signals H for the present line from thecolor space converter 101, thereby generating an average hue signal HA from the values (hue edge values) indicated by the hue signals H of the M×M pixels including the target pixel. Thefilter 107 outputs the hue signal H of the target pixel and the generated average hue signal HA to the saturation correctingfactor calculator 109. - Next, with the lightness signal V of the target pixel and the average lightness signal VA from the
filter 105 as well as the saturation signal S of the target pixel from thefilter 106, the lightness correctingfactor calculator 108 generates a lightness sharpness correcting factor signal KV based on values (lightness edge value and average lightness edge value) indicated by the lightness signal V of the target pixel and the average lightness signal VA (Step S105). The lightness correctingfactor calculator 108 outputs the lightness signal V of the target pixel and the generated lightness sharpness correcting factor signal KV to thelightness corrector 110. - In Step S105, with the saturation signal S of the target pixel and the average saturation signal SA from the
filter 106 as well as the hue signal of the target pixel and the average hue signal HA from thefilter 107, the saturation correctingfactor calculator 109 generates a saturation sharpness correcting factor signal KS based on the saturation signal S of the target pixel, the average saturation signal SA, the hue signal H of the target pixel and the average hue signal HA. The saturation correctingfactor calculator 109 outputs the generated saturation sharpness correcting factor signal KS and the saturation signal S of the target pixel to thesaturation corrector 111 and the hue signal H of the target pixel to thecolor space inverter 112. - Next, in order to perform sharpness correction to the lightness signal V of the target pixel, with the lightness signal V of the target pixel and the lightness sharpness correcting factor signal KV from the lightness correcting
factor calculator 108, thelightness corrector 110 generates a sharpness-processed lightness signal V′ of the target pixel based on the a value (lightness edge value) indicated by the lightness signal V of the target pixel and the lightness sharpness correcting factor signal KV (Step S106). Thelightness corrector 110 outputs the generated lightness signal V′ of the target pixel to thecolor space inverter 112. - In Step S106, in order to perform sharpness correction to the saturation signal S of the target pixel, with the saturation signal S of the target pixel and the saturation sharpness correcting factor signal KS from the saturation correcting
factor calculator 109, thesaturation corrector 111 generates a sharpness-processed saturation signal S′ of the target pixel based on the value (saturation edge value) indicated by the saturation signal S of the target pixel and the saturation sharpness correcting factor signal KS. Thesaturation corrector 111 outputs the generated saturation signal S′ of the target pixel to thecolor space inverter 112. - Next, with the lightness signal V′ of the target pixel from the
lightness corrector 110, the saturation signal S′ of the target pixel from thesaturation corrector 111 and the hue signal H of the target pixel from the saturation correctingfactor calculator 109, thecolor space inverter 112 inverts the color space represented by the lightness signal V′, the saturation signal S′ and the hue signal H of the target pixel to lightness- and saturation-corrected RGB (R′G′B′) signals based on the lightness signal V′, the saturation signal S′ and the hue signal H of the target pixel (Step S107). - The
color space inverter 112 outputs the inverted RGB (R′G′B) signals to the output unit 150 (Step S108). - Accordingly, the color
image processing device 130 can perform natural and excellent sharpness processing to image signals. The colorimage processing device 130 can perform natural and excellent sharpness processing to a color image regardless of a monochrome gray region or a color region in a color image. In addition, natural and effective sharpness processing can be performed even to a part where image enhancement would not take place according to difference of lightness. Since the colorimage processing device 130 can perform sharpness processing according to the color space represented by the three attributes, namely, hue, saturation and lightness, it can sufficiently cope with difference of any of lightness, saturation and hue components. - Thus, in addition to the advantage of
Embodiment 1, the color image processing device ofEmbodiment 2 can sufficiently cope with difference of any of lightness, saturation and hue components. - The color image processing device of the invention can perform natural and excellent sharpness processing to image data.
- The invention may be embodied in other specific forms without departing from the spirit or essential characteristic thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description and all changes which come within the meaning and rage of equivalency of the claims are therefore intended to be embraced therein.
- The entire disclosure of Japanese Patent Application No. 2001-044143 (Filed on Feb. 20, 2001) including specification, claims, drawings and summary are incorporated herein by reference in its entirety.
Claims (19)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2001-044143 | 2001-02-20 | ||
JP2001044143A JP4666274B2 (en) | 2001-02-20 | 2001-02-20 | Color image processing apparatus and method |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020114513A1 true US20020114513A1 (en) | 2002-08-22 |
US7227990B2 US7227990B2 (en) | 2007-06-05 |
Family
ID=18906183
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/066,671 Expired - Fee Related US7227990B2 (en) | 2001-02-20 | 2002-02-06 | Color image processing device and color image processing method |
Country Status (2)
Country | Link |
---|---|
US (1) | US7227990B2 (en) |
JP (1) | JP4666274B2 (en) |
Cited By (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030214661A1 (en) * | 2002-05-15 | 2003-11-20 | Fuji Photo Film Co., Ltd. | Color conversion definition correction apparatus, and color conversion definition correction program storage medium |
US20040184670A1 (en) * | 2002-02-22 | 2004-09-23 | Nick Jarman | Detection correction of red-eye features in digital images |
US20050012944A1 (en) * | 2003-07-14 | 2005-01-20 | Xerox Corporation | Color saturation adjustment |
US20050200728A1 (en) * | 2003-11-28 | 2005-09-15 | Victor Company Of Japan, Ltd. | Noise suppressing circuit using luminance detection |
US20070024638A1 (en) * | 2005-07-28 | 2007-02-01 | Microsoft Corporation | Image processing using saltating samples |
US20070140578A1 (en) * | 2005-12-16 | 2007-06-21 | Fuji Xerox Co., Ltd. | Image adjustment apparatus, image adjustment method and computer readable medium |
US20070189606A1 (en) * | 2006-02-14 | 2007-08-16 | Fotonation Vision Limited | Automatic detection and correction of non-red eye flash defects |
US20070252845A1 (en) * | 2004-06-22 | 2007-11-01 | Nikon Corporation | Image Processing Device Emphasizing on Texture, Image Processing Program, Electronic Camera, and Image Processing Method |
US20070292045A1 (en) * | 2006-06-12 | 2007-12-20 | Nissan Motor Co., Ltd. | Image processing apparatus and image processing method |
US20080043121A1 (en) * | 2003-08-05 | 2008-02-21 | Fotonation Vision Limited | Optimized Performance and Performance for Red-Eye Filter Method and Apparatus |
US20080181493A1 (en) * | 2007-01-09 | 2008-07-31 | Samsung Electronics Co., Ltd. | Method, medium, and system classifying images based on image properties |
US20090022395A1 (en) * | 2007-07-20 | 2009-01-22 | Samsung Electronics Co., Ltd. | Apparatus and method of enhancing color of image |
US20090046166A1 (en) * | 2006-02-27 | 2009-02-19 | Nikon Corporation | Image processing apparatus, image processing program, image processing method, and electronic camera for correcting texture of image |
US20090136150A1 (en) * | 2007-11-26 | 2009-05-28 | Micron Technology, Inc. | Method and apparatus for reducing image artifacts based on aperture-driven color kill with color saturation assessment |
WO2009113023A1 (en) * | 2008-03-13 | 2009-09-17 | Koninklijke Philips Electronics N.V. | Color image enhancement |
US7689009B2 (en) | 2005-11-18 | 2010-03-30 | Fotonation Vision Ltd. | Two stage detection for photographic eye artifacts |
US7724400B2 (en) | 2003-04-02 | 2010-05-25 | Lexmark International, Inc. | Simple and configurable all-in-one operator panel |
US7738015B2 (en) | 1997-10-09 | 2010-06-15 | Fotonation Vision Limited | Red-eye filter method and apparatus |
US20100158368A1 (en) * | 2008-12-24 | 2010-06-24 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US20100166336A1 (en) * | 2008-12-25 | 2010-07-01 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US7804531B2 (en) | 1997-10-09 | 2010-09-28 | Fotonation Vision Limited | Detecting red eye filter and apparatus using meta-data |
US7865036B2 (en) | 2005-11-18 | 2011-01-04 | Tessera Technologies Ireland Limited | Method and apparatus of correcting hybrid flash artifacts in digital images |
US7916190B1 (en) | 1997-10-09 | 2011-03-29 | Tessera Technologies Ireland Limited | Red-eye filter method and apparatus |
US7920723B2 (en) | 2005-11-18 | 2011-04-05 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US7962629B2 (en) | 2005-06-17 | 2011-06-14 | Tessera Technologies Ireland Limited | Method for establishing a paired connection between media devices |
US7965875B2 (en) | 2006-06-12 | 2011-06-21 | Tessera Technologies Ireland Limited | Advances in extending the AAM techniques from grayscale to color images |
US7970182B2 (en) | 2005-11-18 | 2011-06-28 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US7995804B2 (en) | 2007-03-05 | 2011-08-09 | Tessera Technologies Ireland Limited | Red eye false positive filtering using face location and orientation |
US8000526B2 (en) | 2007-11-08 | 2011-08-16 | Tessera Technologies Ireland Limited | Detecting redeye defects in digital images |
US8036460B2 (en) | 2004-10-28 | 2011-10-11 | DigitalOptics Corporation Europe Limited | Analyzing partial face regions for red-eye detection in acquired digital images |
US8055067B2 (en) | 2007-01-18 | 2011-11-08 | DigitalOptics Corporation Europe Limited | Color segmentation |
US8081254B2 (en) | 2008-08-14 | 2011-12-20 | DigitalOptics Corporation Europe Limited | In-camera based method of detecting defect eye with high accuracy |
US8126208B2 (en) | 2003-06-26 | 2012-02-28 | DigitalOptics Corporation Europe Limited | Digital image processing using face detection information |
US8170294B2 (en) | 2006-11-10 | 2012-05-01 | DigitalOptics Corporation Europe Limited | Method of detecting redeye in a digital image |
US8212864B2 (en) | 2008-01-30 | 2012-07-03 | DigitalOptics Corporation Europe Limited | Methods and apparatuses for using image acquisition data to detect and correct image defects |
WO2012155525A1 (en) * | 2011-05-13 | 2012-11-22 | 中兴通讯股份有限公司 | Method, device and apparatus for processing video images |
US8428351B2 (en) | 2008-12-24 | 2013-04-23 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US8503818B2 (en) | 2007-09-25 | 2013-08-06 | DigitalOptics Corporation Europe Limited | Eye defect detection in international standards organization images |
US8520093B2 (en) | 2003-08-05 | 2013-08-27 | DigitalOptics Corporation Europe Limited | Face tracker and partial face tracker for red-eye filter method and apparatus |
US20140369601A1 (en) * | 2012-01-03 | 2014-12-18 | Chung-Ang University Industry-Academy Cooperation Foundation | Apparatus and method for enhancing image using color channel |
US9412007B2 (en) | 2003-08-05 | 2016-08-09 | Fotonation Limited | Partial face detector red-eye filter method and apparatus |
CN110225223A (en) * | 2018-03-02 | 2019-09-10 | 佳能株式会社 | Image processing equipment and its control method |
CN110276727A (en) * | 2019-05-21 | 2019-09-24 | 杭州电子科技大学 | A kind of color image color Enhancement Method towards dyschromatopsia |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7545976B2 (en) * | 2002-05-01 | 2009-06-09 | Hewlett-Packard Development Company, L.P. | Method and apparatus for associating image enhancement with color |
JP4238992B2 (en) * | 2003-12-15 | 2009-03-18 | 富士ゼロックス株式会社 | Color image processing method, color image processing apparatus, color image processing program, and storage medium |
JP2006142004A (en) * | 2004-10-20 | 2006-06-08 | Fuji Photo Film Co Ltd | Sharpness adjustment method, program and electronic endoscope apparatus |
KR100791380B1 (en) * | 2006-01-17 | 2008-01-07 | 삼성전자주식회사 | Method and apparatus for image improvement using complementary color |
JP4716026B2 (en) | 2006-05-24 | 2011-07-06 | セイコーエプソン株式会社 | Projection apparatus, image display system, program, information storage medium, and projection method |
KR100866492B1 (en) * | 2007-05-30 | 2008-11-03 | 삼성전자주식회사 | Apparatus for noise reduction with edge enhancement and method thereof |
US8411943B2 (en) * | 2008-03-31 | 2013-04-02 | Aptina Imaging Corporation | Method and apparatus for image signal color correction with reduced noise |
US8441499B2 (en) | 2009-08-05 | 2013-05-14 | Apple Inc. | User interface contrast filter |
JP5397632B2 (en) * | 2010-06-23 | 2014-01-22 | セイコーエプソン株式会社 | Projection apparatus, image display system, program, information storage medium, and projection method |
US20130239051A1 (en) | 2012-03-06 | 2013-09-12 | Apple Inc. | Non-destructive editing for a media editing application |
US9202433B2 (en) | 2012-03-06 | 2015-12-01 | Apple Inc. | Multi operation slider |
US9131192B2 (en) | 2012-03-06 | 2015-09-08 | Apple Inc. | Unified slider control for modifying multiple image properties |
US9041727B2 (en) | 2012-03-06 | 2015-05-26 | Apple Inc. | User interface tools for selectively applying effects to image |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6078686A (en) * | 1996-09-30 | 2000-06-20 | Samsung Electronics Co., Ltd. | Image quality enhancement circuit and method therefor |
US6823083B1 (en) * | 1999-11-25 | 2004-11-23 | Fuji Photo Film Co., Ltd. | Saturation correcting apparatus and method |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS60167574A (en) * | 1984-02-10 | 1985-08-30 | Toshiba Corp | Picture noise eliminating device |
JPH07152904A (en) * | 1993-10-08 | 1995-06-16 | Fuji Xerox Co Ltd | Image processor |
JP2906974B2 (en) * | 1994-01-14 | 1999-06-21 | 富士ゼロックス株式会社 | Color image processing method and apparatus |
JP2906975B2 (en) * | 1994-01-14 | 1999-06-21 | 富士ゼロックス株式会社 | Color image processing method and apparatus |
US5450216A (en) * | 1994-08-12 | 1995-09-12 | International Business Machines Corporation | Color image gamut-mapping system with chroma enhancement at human-insensitive spatial frequencies |
JPH09284560A (en) | 1996-04-15 | 1997-10-31 | Dainippon Screen Mfg Co Ltd | Sharpness processor |
JP3787393B2 (en) | 1996-07-22 | 2006-06-21 | キヤノン株式会社 | Image processing apparatus and method |
JP3671616B2 (en) * | 1997-08-21 | 2005-07-13 | 富士ゼロックス株式会社 | Image processing device |
JPH11205616A (en) * | 1998-01-08 | 1999-07-30 | Minolta Co Ltd | Image evaluating method and its device |
JP3539665B2 (en) * | 1998-03-05 | 2004-07-07 | 日本電信電話株式会社 | Face area correction method, face area correction apparatus, and recording medium storing face area correction program |
JP2000175046A (en) | 1998-09-30 | 2000-06-23 | Fuji Photo Film Co Ltd | Image processing method and image processor |
JP2000175047A (en) | 1998-09-30 | 2000-06-23 | Fuji Photo Film Co Ltd | Image processing method and image processor |
JP2000207560A (en) * | 1999-01-18 | 2000-07-28 | Fuji Xerox Co Ltd | Method and device for evaluating image |
JP2000224607A (en) * | 1999-01-28 | 2000-08-11 | Matsushita Electric Ind Co Ltd | Image processor |
JP3061614B1 (en) * | 1999-03-11 | 2000-07-10 | 工業技術院長 | Color image quality improvement method and apparatus |
JP2000278542A (en) | 1999-03-24 | 2000-10-06 | Minolta Co Ltd | Image processor |
-
2001
- 2001-02-20 JP JP2001044143A patent/JP4666274B2/en not_active Expired - Fee Related
-
2002
- 2002-02-06 US US10/066,671 patent/US7227990B2/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6078686A (en) * | 1996-09-30 | 2000-06-20 | Samsung Electronics Co., Ltd. | Image quality enhancement circuit and method therefor |
US6823083B1 (en) * | 1999-11-25 | 2004-11-23 | Fuji Photo Film Co., Ltd. | Saturation correcting apparatus and method |
Cited By (88)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8264575B1 (en) | 1997-10-09 | 2012-09-11 | DigitalOptics Corporation Europe Limited | Red eye filter method and apparatus |
US7852384B2 (en) | 1997-10-09 | 2010-12-14 | Fotonation Vision Limited | Detecting red eye filter and apparatus using meta-data |
US7847840B2 (en) | 1997-10-09 | 2010-12-07 | Fotonation Vision Limited | Detecting red eye filter and apparatus using meta-data |
US7847839B2 (en) | 1997-10-09 | 2010-12-07 | Fotonation Vision Limited | Detecting red eye filter and apparatus using meta-data |
US7804531B2 (en) | 1997-10-09 | 2010-09-28 | Fotonation Vision Limited | Detecting red eye filter and apparatus using meta-data |
US7787022B2 (en) | 1997-10-09 | 2010-08-31 | Fotonation Vision Limited | Red-eye filter method and apparatus |
US7746385B2 (en) | 1997-10-09 | 2010-06-29 | Fotonation Vision Limited | Red-eye filter method and apparatus |
US7738015B2 (en) | 1997-10-09 | 2010-06-15 | Fotonation Vision Limited | Red-eye filter method and apparatus |
US8203621B2 (en) | 1997-10-09 | 2012-06-19 | DigitalOptics Corporation Europe Limited | Red-eye filter method and apparatus |
US7916190B1 (en) | 1997-10-09 | 2011-03-29 | Tessera Technologies Ireland Limited | Red-eye filter method and apparatus |
US20040184670A1 (en) * | 2002-02-22 | 2004-09-23 | Nick Jarman | Detection correction of red-eye features in digital images |
US7466463B2 (en) * | 2002-05-15 | 2008-12-16 | Fujifilm Corporation | Color conversion definition correction apparatus, and color conversion definition correction program storage medium |
US20030214661A1 (en) * | 2002-05-15 | 2003-11-20 | Fuji Photo Film Co., Ltd. | Color conversion definition correction apparatus, and color conversion definition correction program storage medium |
US7724400B2 (en) | 2003-04-02 | 2010-05-25 | Lexmark International, Inc. | Simple and configurable all-in-one operator panel |
US8224108B2 (en) | 2003-06-26 | 2012-07-17 | DigitalOptics Corporation Europe Limited | Digital image processing using face detection information |
US8131016B2 (en) | 2003-06-26 | 2012-03-06 | DigitalOptics Corporation Europe Limited | Digital image processing using face detection information |
US8126208B2 (en) | 2003-06-26 | 2012-02-28 | DigitalOptics Corporation Europe Limited | Digital image processing using face detection information |
US7355753B2 (en) * | 2003-07-14 | 2008-04-08 | Xerox Corporation | Color saturation adjustment |
US20050012944A1 (en) * | 2003-07-14 | 2005-01-20 | Xerox Corporation | Color saturation adjustment |
US20080043121A1 (en) * | 2003-08-05 | 2008-02-21 | Fotonation Vision Limited | Optimized Performance and Performance for Red-Eye Filter Method and Apparatus |
US8520093B2 (en) | 2003-08-05 | 2013-08-27 | DigitalOptics Corporation Europe Limited | Face tracker and partial face tracker for red-eye filter method and apparatus |
US9412007B2 (en) | 2003-08-05 | 2016-08-09 | Fotonation Limited | Partial face detector red-eye filter method and apparatus |
US7362361B2 (en) * | 2003-11-28 | 2008-04-22 | Victor Compay Of Japan, Ltd. | Noise suppressing circuit using luminance detection |
US20050200728A1 (en) * | 2003-11-28 | 2005-09-15 | Victor Company Of Japan, Ltd. | Noise suppressing circuit using luminance detection |
US20070252845A1 (en) * | 2004-06-22 | 2007-11-01 | Nikon Corporation | Image Processing Device Emphasizing on Texture, Image Processing Program, Electronic Camera, and Image Processing Method |
EP1775936A4 (en) * | 2004-06-22 | 2016-05-11 | Nikon Corp | Image processing device emphasizing on texture, image processing program, electronic camera, and image processing method |
US7924288B2 (en) * | 2004-06-22 | 2011-04-12 | Nikon Corporation | Image processing device emphasizing on texture, image processing program, electronic camera, and image processing method |
US8036460B2 (en) | 2004-10-28 | 2011-10-11 | DigitalOptics Corporation Europe Limited | Analyzing partial face regions for red-eye detection in acquired digital images |
US8265388B2 (en) | 2004-10-28 | 2012-09-11 | DigitalOptics Corporation Europe Limited | Analyzing partial face regions for red-eye detection in acquired digital images |
US7962629B2 (en) | 2005-06-17 | 2011-06-14 | Tessera Technologies Ireland Limited | Method for establishing a paired connection between media devices |
WO2007014365A3 (en) * | 2005-07-28 | 2007-05-03 | Microsoft Corp | Image processing using saltating samples |
WO2007014365A2 (en) * | 2005-07-28 | 2007-02-01 | Microsoft Corporation | Image processing using saltating samples |
US20070024638A1 (en) * | 2005-07-28 | 2007-02-01 | Microsoft Corporation | Image processing using saltating samples |
US7679620B2 (en) * | 2005-07-28 | 2010-03-16 | Microsoft Corp. | Image processing using saltating samples |
US7970184B2 (en) | 2005-11-18 | 2011-06-28 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US8126218B2 (en) | 2005-11-18 | 2012-02-28 | DigitalOptics Corporation Europe Limited | Two stage detection for photographic eye artifacts |
US7869628B2 (en) | 2005-11-18 | 2011-01-11 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US7865036B2 (en) | 2005-11-18 | 2011-01-04 | Tessera Technologies Ireland Limited | Method and apparatus of correcting hybrid flash artifacts in digital images |
US7920723B2 (en) | 2005-11-18 | 2011-04-05 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US8180115B2 (en) | 2005-11-18 | 2012-05-15 | DigitalOptics Corporation Europe Limited | Two stage detection for photographic eye artifacts |
US7953252B2 (en) | 2005-11-18 | 2011-05-31 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US8175342B2 (en) | 2005-11-18 | 2012-05-08 | DigitalOptics Corporation Europe Limited | Two stage detection for photographic eye artifacts |
US8160308B2 (en) | 2005-11-18 | 2012-04-17 | DigitalOptics Corporation Europe Limited | Two stage detection for photographic eye artifacts |
US7970183B2 (en) | 2005-11-18 | 2011-06-28 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US8131021B2 (en) | 2005-11-18 | 2012-03-06 | DigitalOptics Corporation Europe Limited | Two stage detection for photographic eye artifacts |
US7970182B2 (en) | 2005-11-18 | 2011-06-28 | Tessera Technologies Ireland Limited | Two stage detection for photographic eye artifacts |
US8126217B2 (en) | 2005-11-18 | 2012-02-28 | DigitalOptics Corporation Europe Limited | Two stage detection for photographic eye artifacts |
US7689009B2 (en) | 2005-11-18 | 2010-03-30 | Fotonation Vision Ltd. | Two stage detection for photographic eye artifacts |
US20070140578A1 (en) * | 2005-12-16 | 2007-06-21 | Fuji Xerox Co., Ltd. | Image adjustment apparatus, image adjustment method and computer readable medium |
US7336821B2 (en) * | 2006-02-14 | 2008-02-26 | Fotonation Vision Limited | Automatic detection and correction of non-red eye flash defects |
US8184900B2 (en) | 2006-02-14 | 2012-05-22 | DigitalOptics Corporation Europe Limited | Automatic detection and correction of non-red eye flash defects |
US20070189606A1 (en) * | 2006-02-14 | 2007-08-16 | Fotonation Vision Limited | Automatic detection and correction of non-red eye flash defects |
US20090046166A1 (en) * | 2006-02-27 | 2009-02-19 | Nikon Corporation | Image processing apparatus, image processing program, image processing method, and electronic camera for correcting texture of image |
US8040387B2 (en) | 2006-02-27 | 2011-10-18 | Nikon Corporation | Image processing apparatus, image processing program, image processing method, and electronic camera for correcting texture of image |
US8189949B2 (en) * | 2006-06-12 | 2012-05-29 | Nissan Motor Co., Ltd. | Image processing apparatus and image processing method |
US20070292045A1 (en) * | 2006-06-12 | 2007-12-20 | Nissan Motor Co., Ltd. | Image processing apparatus and image processing method |
US7965875B2 (en) | 2006-06-12 | 2011-06-21 | Tessera Technologies Ireland Limited | Advances in extending the AAM techniques from grayscale to color images |
US8170294B2 (en) | 2006-11-10 | 2012-05-01 | DigitalOptics Corporation Europe Limited | Method of detecting redeye in a digital image |
US20080181493A1 (en) * | 2007-01-09 | 2008-07-31 | Samsung Electronics Co., Ltd. | Method, medium, and system classifying images based on image properties |
US8055067B2 (en) | 2007-01-18 | 2011-11-08 | DigitalOptics Corporation Europe Limited | Color segmentation |
US7995804B2 (en) | 2007-03-05 | 2011-08-09 | Tessera Technologies Ireland Limited | Red eye false positive filtering using face location and orientation |
US8233674B2 (en) | 2007-03-05 | 2012-07-31 | DigitalOptics Corporation Europe Limited | Red eye false positive filtering using face location and orientation |
US20090022395A1 (en) * | 2007-07-20 | 2009-01-22 | Samsung Electronics Co., Ltd. | Apparatus and method of enhancing color of image |
US8111915B2 (en) * | 2007-07-20 | 2012-02-07 | Samsung Electronics Co., Ltd. | Apparatus and method of enhancing color of image |
KR101321396B1 (en) | 2007-07-20 | 2013-10-25 | 삼성전자주식회사 | System of enhancing color of images and method using the same |
US8503818B2 (en) | 2007-09-25 | 2013-08-06 | DigitalOptics Corporation Europe Limited | Eye defect detection in international standards organization images |
US8000526B2 (en) | 2007-11-08 | 2011-08-16 | Tessera Technologies Ireland Limited | Detecting redeye defects in digital images |
US8036458B2 (en) | 2007-11-08 | 2011-10-11 | DigitalOptics Corporation Europe Limited | Detecting redeye defects in digital images |
US20090136150A1 (en) * | 2007-11-26 | 2009-05-28 | Micron Technology, Inc. | Method and apparatus for reducing image artifacts based on aperture-driven color kill with color saturation assessment |
US8131072B2 (en) * | 2007-11-26 | 2012-03-06 | Aptina Imaging Corporation | Method and apparatus for reducing image artifacts based on aperture-driven color kill with color saturation assessment |
US8212864B2 (en) | 2008-01-30 | 2012-07-03 | DigitalOptics Corporation Europe Limited | Methods and apparatuses for using image acquisition data to detect and correct image defects |
US20110002540A1 (en) * | 2008-03-13 | 2011-01-06 | Koninklijke Philips Electronics N.V. | Color image enhancement |
WO2009113023A1 (en) * | 2008-03-13 | 2009-09-17 | Koninklijke Philips Electronics N.V. | Color image enhancement |
KR101598555B1 (en) | 2008-03-13 | 2016-02-29 | 티피 비전 홀딩 비.브이. | Color image enhancement |
US9196019B2 (en) | 2008-03-13 | 2015-11-24 | Tp Vision Holding B.V. | Color image enhancement |
KR20100132520A (en) * | 2008-03-13 | 2010-12-17 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Color image enhancement |
US8081254B2 (en) | 2008-08-14 | 2011-12-20 | DigitalOptics Corporation Europe Limited | In-camera based method of detecting defect eye with high accuracy |
US20100158368A1 (en) * | 2008-12-24 | 2010-06-24 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US8705858B2 (en) | 2008-12-24 | 2014-04-22 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US8787665B2 (en) | 2008-12-24 | 2014-07-22 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US8428351B2 (en) | 2008-12-24 | 2013-04-23 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US8411945B2 (en) * | 2008-12-25 | 2013-04-02 | Brother Kogyo Kabushiki Kaisha | Image processing device |
US20100166336A1 (en) * | 2008-12-25 | 2010-07-01 | Brother Kogyo Kabushiki Kaisha | Image processing device |
WO2012155525A1 (en) * | 2011-05-13 | 2012-11-22 | 中兴通讯股份有限公司 | Method, device and apparatus for processing video images |
US9230304B2 (en) * | 2012-01-03 | 2016-01-05 | Chung-Ang University Industry-Academy Cooperation Foundation | Apparatus and method for enhancing image using color channel |
US20140369601A1 (en) * | 2012-01-03 | 2014-12-18 | Chung-Ang University Industry-Academy Cooperation Foundation | Apparatus and method for enhancing image using color channel |
CN110225223A (en) * | 2018-03-02 | 2019-09-10 | 佳能株式会社 | Image processing equipment and its control method |
CN110276727A (en) * | 2019-05-21 | 2019-09-24 | 杭州电子科技大学 | A kind of color image color Enhancement Method towards dyschromatopsia |
Also Published As
Publication number | Publication date |
---|---|
US7227990B2 (en) | 2007-06-05 |
JP4666274B2 (en) | 2011-04-06 |
JP2002245446A (en) | 2002-08-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7227990B2 (en) | Color image processing device and color image processing method | |
US8477324B2 (en) | Image processor and image processing method that uses s-shaped gamma curve | |
JP3399486B2 (en) | Color image processing apparatus and method | |
US7382915B2 (en) | Color to grayscale conversion method and apparatus | |
KR101172399B1 (en) | Image forming apparatus and image improvement method thereof | |
US8335375B2 (en) | Image processing apparatus and control method thereof | |
JP2010093684A (en) | Image processor | |
US10194050B2 (en) | Image processing apparatus, image processing method, and storage medium in which background removal is performed to remove a background included in an input image based on pixel values | |
JP3868654B2 (en) | Image processing device | |
JP2003219191A (en) | Image processor and image forming apparatus comprising it | |
JP4771428B2 (en) | Image processing apparatus, image processing method, program, and recording medium | |
JP2007053439A (en) | Isolated point discrimination apparatus, image processing apparatus, image reading apparatus, image forming apparatus, isolated point discrimination method, isolated point discrimination program, image processing program, and computer-readable recording medium | |
KR100406944B1 (en) | Method and apparatus for improving printing quality of document in which a text and an image exist together | |
US11108999B2 (en) | Image processing apparatus, image processing method, and non-transitory computer-readable storage medium | |
JP2003209704A (en) | Image processing method, image processor, image forming device, image processing program, and recording medium | |
JP2000358166A (en) | Image process, image reader with the processor, image forming device, image processing method and computer readable storage medium storing image processing procedure | |
JP6024363B2 (en) | Image processing device | |
JP4792893B2 (en) | Image processing apparatus and program | |
JP3944032B2 (en) | Image processing apparatus and method | |
JP3966404B2 (en) | Image processing method, image processing apparatus, and image forming apparatus | |
JP4176053B2 (en) | Image processing method, image processing apparatus, image forming apparatus, and computer program | |
JP2000357237A (en) | Image processor, image reading device and image forming device mounted with the processor, image processing method, and computer-readable storage medium stored with image processing procedure | |
JP2001352453A (en) | Image-reproducing device | |
JP2005175824A (en) | Image processing method, image processor and image forming apparatus, and computer program | |
JP2002354253A (en) | Image processor and its program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NEC CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HIRAO, KOICHIRO;REEL/FRAME:012570/0709 Effective date: 20020128 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20190605 |