US20080170086A1 - Front end signal processing method and front end signal processor - Google Patents
Front end signal processing method and front end signal processor Download PDFInfo
- Publication number
- US20080170086A1 US20080170086A1 US11/971,865 US97186508A US2008170086A1 US 20080170086 A1 US20080170086 A1 US 20080170086A1 US 97186508 A US97186508 A US 97186508A US 2008170086 A1 US2008170086 A1 US 2008170086A1
- Authority
- US
- United States
- Prior art keywords
- section
- pixels
- signal
- luminance
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/63—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
Definitions
- the present invention relates to a front end signal processing method and a front end signal processor for an image sensor.
- FIG. 6 Conventionally, a structure as shown in FIG. 6 has been used as a frond end signal processor that processes a signal from an image sensor.
- FIG. 6 a front end signal processor shown in Japanese Unexamined Patent Application Publication No. 2001-189892 will be described as an example of the related art.
- a luminance signal from an image sensor 51 is detected and sampled by a correlated double sampler 52 (CDS) , and then, digitized by an A/D converter 53 (ADC).
- CDS correlated double sampler 52
- ADC A/D converter 53
- a reference level signal 55 is subtracted from a digital luminance signal 54 obtained from the A/D converter 53 , thereby obtaining a zero-based digital luminance signal 56 .
- the digital luminance signal 56 is converted into an analog signal by a D/A converter 57 (DAC), and the clamp level is held at a capacitor 59 by rendering a clamp switch 58 on only during the period of the OB (optical black) part of the image sensor 51 and is returned to the correlated double sampler 52 by a buffer 60 .
- the reference level of the digital luminance signal 56 is clamped to zero under an ideal condition where there is no DC offset in the blocks such as the correlated double sampler 52 , the A/D converter 53 , and the D/A converter 57 constituting the clamp feedback loop.
- the digital luminance signal 56 is amplified by a digital gain variable amplifier (DPGA) 61 with a gain set by a gain control signal (digital value) 62 , and an OB level reference signal 63 is added thereto by an adder 64 , thereby obtaining a final front end output luminance signal 65 .
- DPGA digital gain variable amplifier
- the correlated double sampler 52 and the A/D converter 53 constitute a luminance detecting and digitizing section 210 .
- the D/A converter 57 , the clamp switch 58 , the capacitor 59 , and the buffer 60 constitute a black level clamping section 220 .
- the digital gain variable amplifier 61 and the adder 64 constitute a signal processing section 250 .
- the digital luminance signal 56 is D/A-converted as it is in this example, a structure is sometimes adopted in which a signal obtained by performing averaging only on the luminance signals of the period of the OB part of the image sensor 51 previously is D/A-converted, because the clamp level is fed back only while the clamp switch 58 is on.
- FIG. 7 a front end signal processor shown in Japanese Unexamined Patent Application Publication No. 2006-072348 will be described as an example of the related art.
- This front end signal processor has (a) a luminance detecting and digitizing section 210 , (b) a black level clamping section 220 , (c) a black level luminance detecting section 230 , (d) an offset correcting section (black level correcting section) 240 , and (e) a signal processing section 250 , and corrects the offset of the black level of the output.
- the luminance detecting and digitizing section 210 is constituted by a correlated double sampler (CDS) 72 that detects the luminance information included in the output signal from an image sensor 71 , and an A/D converter (ADC) 73 .
- CDS correlated double sampler
- ADC A/D converter
- the black level clamping section 220 is constituted by a D/A converter 78 (DAC), a capacitor 79 for holding the clamp level, a switch 80 that is on only during a predetermined (arbitrary) charging period, and a buffer 81 .
- DAC D/A converter 78
- the black level luminance detecting section 230 is constituted by a switch 74 that is on during the digital luminance signal period of the OB part pixels, a low-pass digital filter 75 that is fed with the output of the switch 74 being on during the digital luminance signal period of the OB part pixels, a subtracter 77 that subtracts a reference black level 76 from the output of the low-pass digital filter 75 , and a low-pass digital filter 82 that is fed with the output of the switch 74 being on during the digital luminance signal period of the OB part pixels.
- the offset correcting section 240 is constituted by a subtracter 83 that subtracts the output of the low-pass digital filter 82 from the output of the A/D converter 73 .
- the signal processing section 250 is constituted by a digital gain variable amplifier 85 that amplifies an output signal 88 of the subtracter 83 by being controlled by a gain control signal (digital value) 84 and an adder 87 that adds an OB reference level 86 to the output of the digital gain variable amplifier 85 .
- a front end output luminance signal 89 is obtained from the adder 87 .
- the offset is corrected so that the black level of the luminance signal fed to the succeeding signal processing section 250 is zero. Consequently, a stable black level luminance signal output can be obtained without affected by the DC offset of the blocks such as the correlated double sampler 72 , the A/D converter 73 , and the D/A converter 78 constituting the OB clamp feedback loop.
- the image sensor 500 has an effective pixel area 501 in the center thereof, has horizontal OB pixel areas 502 and 503 on both the right and left sides of the effective pixel area 501 , and has vertical OB line pixel areas 504 and 505 on both the upper and lower sides of the effective pixel area.
- An arbitrary horizontal line luminance output 510 of the image sensor 500 includes a horizontal blanking part, an effective pixel part corresponding to the effective pixel area, and OB parts corresponding to horizontal OB part pixels.
- the illustration which is an OB part of the horizontal line luminance output 510 that is shown in enlargement is an actual sensor output signal 520 .
- the difference in voltage between a feed-through part 520 a and a data part 520 b corresponds to the luminance level of one OB part pixel in the waveform of the OB part.
- pixel mixture driving is performed in which a plurality of pixel signals are mixed together and outputted or pixel thinning-out driving is performed. As the number of pixels of image sensors increases, a higher thinning-out rate is required of these drivings.
- An object of the present invention is to provide a front end signal processing method and a front end signal processor in which a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of an image sensor.
- a first front end signal processing method of the present invention is a front end signal processing method for processing an output signal of an image sensor, the method including:
- the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and the black level of the output signal of the image sensor is determined from the averaged luminance level in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- the above-described front end signal processing method further includes (g) a seventh step of subtracting the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal.
- control signal is generated at the fourth step at a timing when the count value of the number of pixels reaches the predetermined value.
- control signal may be generated at the fourth step at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- the number of pixels on which averaging is performed may be different between the averaged luminance level at the seventh step and the averaged luminance level at the fifth step.
- a second front end signal processing method of the present invention is a front end signal processing method for processing an output signal of an image sensor, the method including:
- the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and in response to the control signal, the averaged luminance level is subtracted from the digitized luminance levels of the effective part pixels in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- control signal is generated at the fourth step at a timing when the count value of the number of pixels reaches the predetermined value.
- control signal may be generated at the fourth step at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- a first front end signal processor of the present invention is a front end signal processor that processes an output signal of an image sensor, the processor including:
- a luminance detecting and digitizing section that detects and digitizes a luminance level of an optical black part pixel included in the output signal of the image sensor, and detects and digitizes a luminance level of an effective part pixel included in the output signal of the image sensor;
- a black level clamping section that determines a black level of the output signal of the image sensor from the luminance level averaged by the black level luminance averaging section, in response to the control signal of the control section,
- the black level of the output signal of the image sensor when the luminance level of the effective part pixel included in the output signal of the image sensor is detected by the luminance detecting and digitizing section is determined by the black level clamping section.
- the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and the black level of the output signal of the image sensor is determined from the averaged luminance level in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- the above-described front end signal processor further includes a black level correcting section that subtracts the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal from the control section.
- the clamp control section generates the control signal at a timing when the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- the clamp control section may generate the control signal at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- the number of pixels on which averaging is performed may be different between the averaged luminance level in the black level correcting section and the averaged luminance level in the black level clamping section.
- a second front end signal processor of the present invention is a front end signal processor that processes an output signal of an image sensor, the processor including:
- a luminance detecting and digitizing section that detects and digitizes a luminance level of an optical black part pixel included in the output signal of the image sensor, and detects and digitizes a luminance level of an effective part pixel included in the output signal of the image sensor;
- a black level correcting section that subtracts the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal from the control section.
- the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and the averaged luminance level is subtracted from the luminance levels of the digitized effective part pixels in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- the clamp control section generates the control signal at a timing when the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- the clamp control section may generate the control signal at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor. In realizing this, the increase in circuit scale can be suppressed.
- FIG. 1 is a block diagram showing the structure of a first embodiment of the present invention.
- FIG. 2 is a block diagram showing the structure of a second embodiment of the present invention.
- FIG. 3 is a block diagram showing the structure of a third embodiment of the present invention.
- FIG. 4 is a block diagram showing the structure of a fourth embodiment of the present invention.
- FIG. 5 is a block diagram showing the structure of a fifth embodiment of the present invention.
- FIG. 6 is a block diagram showing the structure of the first conventional example.
- FIG. 7 is a block diagram showing the structure of the second conventional example.
- FIG. 8 is a schematic view showing the outline of the output signal of the image sensor.
- FIG. 9 is a flowchart showing a front end signal processing method for the front end signal processor of FIG. 1 .
- FIG. 10 is a flowchart showing a front end signal processing method for the front end signal processor of FIG. 2 .
- FIG. 11 is a flowchart showing a front end signal processing method for the front end signal processor of FIG. 5 .
- FIG. 1 is a block diagram showing the basic structure of a front end signal processor according to a first embodiment of the present invention.
- This front end signal processor has (a) a luminance detecting and digitizing section 2 , (b) a black level luminance detecting section 3 that detects the black level of the luminance signal, (c) a pixel number counting section 4 , (d) a clamp control section 5 , and (e) a black level clamping section 6 .
- Reference numeral 7 represents an output signal of the luminance detecting and digitizing section 2 .
- the luminance detecting and digitizing section 2 detects and digitizes the luminance levels of the optical black part pixels included in the output signal of an image sensor 1 , and detects and digitizes the luminance levels of the effective part pixels included in the output signal of the image sensor 1 .
- the black level luminance detecting section 3 averages the luminance levels of the optical black part pixels digitized by the luminance detecting and digitizing section 2 .
- the pixel number counting section 4 counts the number of pixels on which averaging is performed by the black level luminance detecting section 3 .
- the clamp control section 5 generates a clamp control signal when the count value of the number of pixels by the pixel number counting section 4 reaches a predetermined value.
- the black level clamping section 6 determines the black level of the output signal of the image sensor 1 from the averaged luminance level obtained by the black level detecting section 3 , in response to the clamp control signal of the clamp control section 5 .
- the black level of the output signal of the image sensor 1 when the luminance levels of the effective part pixels included in the output signal of the image sensor 1 are detected by the luminance detecting and digitizing section 2 is determined by the black level clamping section 6 .
- a CCD image sensor As the image sensor 1 , a CCD image sensor, a CMOS image sensor, or any other arbitrary image sensor may be used.
- the signals from the image sensor 1 are broadly divided into luminance signals from the effective pixel part of the light receiving section in the center of the sensor and luminance signals from the light intercepted section (OB part) disposed around the light receiving section.
- the luminance signal detecting and digitizing section 2 detects the luminances of the effective pixel signals and the OB part pixel signals, and converts them into digital luminance signals.
- the black level luminance detecting section 3 stores the luminance information of the OB part pixels, and outputs the luminance information to the black level clamping section 6 .
- the luminance information outputted here can also be calculated by the stored average value of the OB part pixels or by an arbitrary calculation method other than that.
- the pixel number counting section 4 integrates (counts) the number of OB pixels stored in the black level luminance detecting section 3 , and outputs the value to the clamp control section 5 .
- the clamp control section 5 outputs the clamp control signal for starting the clamping operation, to the black level clamping section 6 when the integrated number of pixels reaches a predetermined number.
- the black level clamping section 6 performs feedback to the luminance signal detecting and digitizing section 2 so that the difference between the OB part luminance information from the black level luminance detecting section 3 and the reference black level is zero, by the above-mentioned clamp control signal for starting the clamping operation.
- the clamp control signal may be outputted either immediately after the number of pixels reaches a given number or during the next horizontal or vertical blanking period after the number of pixels reaches the given number.
- the clamp control signal When the number of OB part pixels of one horizontal line is less than the predetermined number, the clamp control signal is not inputted on the horizontal line, the integrated number of pixels and luminance information of the OB part are carried forward to the next horizontal line, and the number of pixels and luminance information of the horizontal line are integrated. After integration is repeated until the number of pixels reaches the predetermined number in this manner, the clamp control signal for starting the clamping operation is outputted.
- the clamping operation may be performed after all the pixels of the OB part of the horizontal line are integrated, to further improve the accuracy of the OB part luminance information.
- the clamping operation is performed only when the number of OB part pixels reaches a given number even in a case where the number of OB part pixels is small such as at the time of pixel mixture driving or pixel thinning-out driving of the image sensor, clamp accuracy degradation due to an insufficient integrated number of pixels does not occur, and image quality degradation due to the occurrence of a lateral line arising from clamp accuracy degradation can be prevented.
- the clamping operation can be performed every OB part when there are a sufficient number of horizontal OB part pixels and when there are a sufficient number of OB part pixels on the vertical OB line, pulling at the time of clamp pulling from high luminance or at the time of power-on can be performed as previously done, and a defect that the pulling time is long is absent.
- a front end signal processing method carried out by the above-described front end signal processor will be described.
- This front end signal processing method is a front end signal processing method for processing the output signal of an image sensor, and includes, as shown FIG. 9 :
- control signal is generated at the fourth step S 4 at the timing when the count value of the number of pixels reaches the predetermined value, or the control signal is generated at the fourth step S 4 at the timing of the next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- FIG. 2 is a block diagram showing the basic structure of a front end signal processor according to a second embodiment of the present invention.
- This front end signal processor has (a) a luminance detecting and digitizing section 12 , (b) a black level luminance detecting section 13 that detects the black level of the luminance signal, (c) a pixel number counting section 14 , (d) a clamp control section 15 , (e) a black level clamping section 16 , and (f) an offset correcting section 18 .
- Reference numeral 19 represents an output signal of the offset correcting section 18 .
- the luminance detecting and digitizing section 12 (a) the luminance detecting and digitizing section 12 , (b) the black level luminance detecting section 13 that detects the black level of the luminance signal, (c) the pixel number counting section 14 , (d) the clamp control section 15 , and (e) the black level clamping section 16 are similar to those of the front end signal processor of FIG. 1 .
- This embodiment is different from the first embodiment in that (f) the offset correcting section 18 is further provided.
- the offset correcting section 18 subtracts the averaged luminance level from the digitized luminance levels of the effective pixels in response to the control signal from the clamp control section 15 , thereby correcting the offset.
- the offset correcting section 17 corrects the offset.
- the offset value is calculated from the difference between the luminance information and the reference black level by the black level luminance detecting section 13 .
- This offset value is calculated as the average value of the luminance level of the OB part, and is outputted to the offset correcting section 18 after the integrated number of pixels by the pixel counting section 14 reaches a predetermined value.
- the luminance information can be calculated by taking the average value of the luminances of the OB part pixels by the black level detecting section 13 , in addition thereto, a value calculated by an arbitrary low-pass digital filter may be used.
- the offset correcting section 18 digitally subtracts the averaged luminance level (corresponding to the offset) detected by the black level luminance detecting section 13 , from the digital luminance signal outputted from the luminance signal detecting and digitizing section 12 . Thereby, the offset-corrected digital luminance signal is a signal whose black level is clamped to zero.
- the number of OB pixels used for offset correction is not necessarily the same as the number of OB pixels used for controlling the black level clamping section 16 .
- Clamp control and offset correction can each be performed at an independent timing according to the characteristics of the preceding feedback loop for black level clamping and the succeeding feed-forward loop for offset correction.
- the present invention is also applicable to a front end signal processor in which the offset caused in the feedback loop for black level clamping is corrected to obtain a luminance signal output having a stabilized black level.
- a front end signal processing method carried out by the above-described front end signal processor will be described.
- This front end signal processing method is a front end signal processing method for processing the output signal of an image sensor, and as shown in FIG. 10 , is a processing in which (g) a seventh step S 7 of subtracting the averaged luminance level from the digitized luminance levels of the effective part pixels in response to the control signal is added to the last of the flow chart of FIG. 9 .
- the number of pixels on which averaging is performed may be different between the averaged luminance level at the step S 7 and the averaged luminance level at the step S 5 .
- FIG. 3 is a block diagram showing a front end signal processor which is the structure of FIG. 2 that is made more concrete.
- This front end signal processor has (a) a luminance detecting and digitizing section 310 , (b) a pixel number counter 25 , (c) a clamp control section 28 , (d) a black level clamping section 320 , (e) a black level luminance detecting section 330 , (f) an offset correcting section 340 , and (g) a signal processing section 350 , and corrects the black level of the output to the reference black level with stability.
- the luminance detecting and digitizing section 310 is constituted by a correlated double sampler (CDS) 22 that detects the luminance information included in the output signal from an image sensor 21 and an A/D converter (ADC) 23 .
- CDS correlated double sampler
- ADC A/D converter
- the pixel number counter 25 integrates (counts) the number of OB part pixels based on the digital luminance signal of the OB part pixels inputted through a switch 24 that is on during the digital luminance signal period of the OB part pixels.
- the clamp control circuit 28 generates a clamp start signal 26 and an offset correction start signal 27 when the count value of the OB part pixels, that is, the integrated number of pixels reaches a predetermined value.
- the black level clamping section 320 is constituted by a D/A converter (DAC) 34 , a capacitor 35 for holding the clamp level, a switch 36 that is on only during a predetermined charging period by the clamp start signal 26 , and a buffer 37 .
- DAC D/A converter
- the black level luminance detecting section 330 is constituted by a pixel signal averaging section 29 that averages the OB part pixel signals of the period during which the switch 24 is on, a switch 30 that is turned on by the clamp start signal, a low-pass digital filter 31 that is fed with the output of the OB part pixel averaging section 29 through a switch 38 , a subtracter 33 that subtracts a reference black level 32 from the output of the low-pass digital filter 31 , the switch 38 that is turned on by the offset correction start signal 27 , and a low-pass digital filter 39 that is fed with the output of the OB part pixel averaging section 29 through the switch 38 .
- the offset correcting section 340 is constituted by a subtracter 40 that subtracts the output of the low-pass digital filter 39 from the output of the A/D converter 23 .
- the signal processor 350 is constituted by a digital gain variable amplifier 42 that amplifies an output signal 45 of the subtracter 40 by being controlled by a gain control signal 41 and an adder 44 that adds an OB reference level 43 .
- a front end output luminance signal 46 is obtained from the adder 44 .
- the clamp start signal 26 and the offset correction start signal 27 are not necessarily the same, and may be each generated at a point of time when a given number of OB pixels are accumulated. Since the timing can be independently set as mentioned above, the optimum number of pixels can be selected according to the characteristic of each of the clamp loop and the offset correction loop.
- the clamp start signal 26 and the offset correction start signal 27 are on (at the time of update) during the normal blanking period, and the values thereof are held. For this reason, the clamp start signal 26 and the offset correction start signal 27 may be turned off at any time.
- a front end signal processor is provided in which a stable black level luminance signal output is obtained even when the number of OB part pixels is small.
- FIG. 4 shows a front end signal processor which is the structure of FIG. 1 that is made more concrete.
- the structure thereof is similar to a structure in which the structure of the offset correcting section 340 is omitted from the structure of FIG. 3 and accordingly, the switch 38 and the low-pass digital filter 39 are omitted from the black level luminance detecting section 330 .
- FIG. 4 shows a front end signal processor which is the structure of FIG. 1 that is made more concrete.
- the structure thereof is similar to a structure in which the structure of the offset correcting section 340 is omitted from the structure of FIG. 3 and accordingly, the switch 38 and the low-pass digital filter 39 are omitted from the black level luminance detecting section 330 .
- reference numeral 91 represents an image sensor
- reference numeral 92 represents a correlated double sampler (CDS)
- reference numeral 93 represents an A/D converter (ADC)
- reference numeral 94 represents a switch
- reference numeral 95 represents a pixel number counter
- reference numeral 96 represents a clamp control section
- reference numeral 97 represents a clamp start signal
- reference numeral 98 represents a pixel signal averaging section
- reference numeral 99 represents a low-pass digital filter
- reference numeral 100 represents a reference black level
- reference numeral 101 represents a subtracter
- reference numeral 102 represents a D/A converter
- reference numeral 103 represents a switch
- reference numeral 104 represents a capacitor
- reference numeral 105 represents a buffer
- reference numeral 106 represents a front end output luminance signal.
- Reference numeral 410 represents a luminance detecting and digitizing section
- reference numeral 420 represents a black level clamping section
- reference numeral 430 represents
- FIG. 5 shows an embodiment in which averaging and pixel number counting are performed on the feed-forward loop and are not applied to the feedback loop.
- FIG. 5 of this embodiment is a structure in which the switch 30 is omitted from FIG. 3 and the switch 36 is not controlled by the clamp control signal 26 but turned on every horizontal line or in the OB pixel part of each field.
- a front end signal processing method carried out by the above-described front end signal processor will be described.
- This front end signal processing method is a front end signal processing method for processing the output signal of an image sensor, and includes, as shown FIG. 11 :
- control signal is generated at the fourth step S 4 at the timing when the count value of the number of pixels reaches the predetermined value, or the control signal is generated at the fourth step S 4 at the timing of the next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- the present invention is useful for a front end signal processing method or signal processor for an image sensor, and a signal processing system and a semiconductor integrated device system having these.
Abstract
Description
- 1. Field of the Invention
- The present invention relates to a front end signal processing method and a front end signal processor for an image sensor.
- 2. Related Art
- Conventionally, a structure as shown in
FIG. 6 has been used as a frond end signal processor that processes a signal from an image sensor. - Referring to
FIG. 6 , a front end signal processor shown in Japanese Unexamined Patent Application Publication No. 2001-189892 will be described as an example of the related art. - In this conventional front end signal processor, a luminance signal from an
image sensor 51 is detected and sampled by a correlated double sampler 52 (CDS) , and then, digitized by an A/D converter 53 (ADC). - Then, a
reference level signal 55 is subtracted from adigital luminance signal 54 obtained from the A/D converter 53, thereby obtaining a zero-baseddigital luminance signal 56. Thedigital luminance signal 56 is converted into an analog signal by a D/A converter 57 (DAC), and the clamp level is held at acapacitor 59 by rendering aclamp switch 58 on only during the period of the OB (optical black) part of theimage sensor 51 and is returned to the correlateddouble sampler 52 by abuffer 60. - The reference level of the
digital luminance signal 56 is clamped to zero under an ideal condition where there is no DC offset in the blocks such as the correlateddouble sampler 52, the A/D converter 53, and the D/A converter 57 constituting the clamp feedback loop. - Further, the
digital luminance signal 56 is amplified by a digital gain variable amplifier (DPGA) 61 with a gain set by a gain control signal (digital value) 62, and an OBlevel reference signal 63 is added thereto by anadder 64, thereby obtaining a final front endoutput luminance signal 65. When there is no offset under the above-mentioned ideal condition, the black level of the final front endoutput luminance signal 65 coincides with the OBlevel reference signal 63. - In the above-described
FIG. 6 , the correlateddouble sampler 52 and the A/D converter 53 constitute a luminance detecting and digitizingsection 210. The D/A converter 57, theclamp switch 58, thecapacitor 59, and thebuffer 60 constitute a blacklevel clamping section 220. The digitalgain variable amplifier 61 and theadder 64 constitute asignal processing section 250. - While the
digital luminance signal 56 is D/A-converted as it is in this example, a structure is sometimes adopted in which a signal obtained by performing averaging only on the luminance signals of the period of the OB part of theimage sensor 51 previously is D/A-converted, because the clamp level is fed back only while theclamp switch 58 is on. - While black level clamping is performed by the feedback loop constituted by the correlated
double sampler 52, the A/D converter 53, and the D/A converter 57 in the above-described Japanese Unexamined Patent Application Publication No. 2001-189892, there is an example in which a feed-forward loop is further formed in order to increase the accuracy of the clamp level. - Referring to
FIG. 7 , a front end signal processor shown in Japanese Unexamined Patent Application Publication No. 2006-072348 will be described as an example of the related art. - This front end signal processor has (a) a luminance detecting and digitizing
section 210, (b) a blacklevel clamping section 220, (c) a black levelluminance detecting section 230, (d) an offset correcting section (black level correcting section) 240, and (e) asignal processing section 250, and corrects the offset of the black level of the output. - (a) The luminance detecting and digitizing
section 210 is constituted by a correlated double sampler (CDS) 72 that detects the luminance information included in the output signal from animage sensor 71, and an A/D converter (ADC) 73. - (b) The black
level clamping section 220 is constituted by a D/A converter 78 (DAC), acapacitor 79 for holding the clamp level, aswitch 80 that is on only during a predetermined (arbitrary) charging period, and abuffer 81. - (c) The black level
luminance detecting section 230 is constituted by aswitch 74 that is on during the digital luminance signal period of the OB part pixels, a low-passdigital filter 75 that is fed with the output of theswitch 74 being on during the digital luminance signal period of the OB part pixels, asubtracter 77 that subtracts a referenceblack level 76 from the output of the low-passdigital filter 75, and a low-passdigital filter 82 that is fed with the output of theswitch 74 being on during the digital luminance signal period of the OB part pixels. - (d) The
offset correcting section 240 is constituted by asubtracter 83 that subtracts the output of the low-passdigital filter 82 from the output of the A/D converter 73. - (e) The
signal processing section 250 is constituted by a digitalgain variable amplifier 85 that amplifies anoutput signal 88 of thesubtracter 83 by being controlled by a gain control signal (digital value) 84 and anadder 87 that adds anOB reference level 86 to the output of the digitalgain variable amplifier 85. A front endoutput luminance signal 89 is obtained from theadder 87. - In this conventional example, by subtracting the output of the low-pass
digital filter 82 from the digital luminance signal output of the A/D converter 73, the offset is corrected so that the black level of the luminance signal fed to the succeedingsignal processing section 250 is zero. Consequently, a stable black level luminance signal output can be obtained without affected by the DC offset of the blocks such as the correlateddouble sampler 72, the A/D converter 73, and the D/A converter 78 constituting the OB clamp feedback loop. - Referring now to
FIG. 8 , the outline of the output signal of the image sensor will be described. Theimage sensor 500 has aneffective pixel area 501 in the center thereof, has horizontalOB pixel areas 502 and 503 on both the right and left sides of theeffective pixel area 501, and has vertical OBline pixel areas - An arbitrary horizontal
line luminance output 510 of theimage sensor 500 includes a horizontal blanking part, an effective pixel part corresponding to the effective pixel area, and OB parts corresponding to horizontal OB part pixels. The illustration which is an OB part of the horizontalline luminance output 510 that is shown in enlargement is an actualsensor output signal 520. In thissensor output signal 520, the difference in voltage between a feed-throughpart 520 a and adata part 520 b corresponds to the luminance level of one OB part pixel in the waveform of the OB part. - Because of market demands for high frame rate photographing by image sensors, pixel mixture driving is performed in which a plurality of pixel signals are mixed together and outputted or pixel thinning-out driving is performed. As the number of pixels of image sensors increases, a higher thinning-out rate is required of these drivings.
- However, when pixel mixture driving or pixel thinning-out driving is performed, the OB part pixels necessary for black level clamping are thinned out as well as the effective pixel area of the image sensor outputted as an image. For this reason, as the number of OB part pixels used for determining the clamp level is reduced, the luminance information is reduced, so that the accuracy sufficient for the clamp level is not obtained. Consequently, image quality degradation such as a lateral line occurs in the taken image because of the clamp level error of each horizontal line.
- As described above, when the luminance information from the OB part is reduced by pixel thinning-out driving, degradation in clamp level occurs in the conventional example of
FIG. 6 and the conventional example ofFIG. 7 . To avoid this, a measure such as optimizing the time constant of the filter in accordance with the driving mode is required. However, this increases the circuit scale. - An object of the present invention is to provide a front end signal processing method and a front end signal processor in which a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of an image sensor.
- A first front end signal processing method of the present invention is a front end signal processing method for processing an output signal of an image sensor, the method including:
- (a) a first step of detecting and digitizing a luminance level of an optical black part pixel included in the output signal of the image sensor;
- (b) a second step of averaging the digitized luminance level of the optical black part pixel;
- (c) a third step of counting the number of pixels on which averaging is performed;
- (d) a fourth step of generating a control signal when a count value of the number of pixels reaches a predetermined value;
- (e) a fifth step of determining a black level of the output signal of the image sensor from the averaged luminance level in response to the control signal; and
- (f) a sixth step of detecting and digitizing a luminance level of an effective part pixel included in the output signal of the image sensor whose black level is determined.
- According to this method, the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and the black level of the output signal of the image sensor is determined from the averaged luminance level in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- It is preferable that the above-described front end signal processing method further includes (g) a seventh step of subtracting the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal.
- Moreover, in the front end signal processing method of the above-described structure, it is preferable that the control signal is generated at the fourth step at a timing when the count value of the number of pixels reaches the predetermined value.
- Moreover, in the front end signal processing method of the above-described structure, the control signal may be generated at the fourth step at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- Now, the difference in effects between when clamping is performed immediately after the count value at the pixel number counting step reaches the predetermined value and when clamping is performed during the next horizontal or vertical blanking period after a wait for the blanking period will be described. For example, when clamping is immediately performed, although responsivity is excellent, the image of the period is influenced when the timing of the clamping is the effective pixel or OB pixel period. On the other hand, when clamping is performed during the blanking period, although there is no influence on the image, responsivity is poor. Thus, whether to perform clamping immediately or during the blanking period is necessarily determined in accordance with the situation.
- Further, in the front end signal processing method of the above-described structure, the number of pixels on which averaging is performed may be different between the averaged luminance level at the seventh step and the averaged luminance level at the fifth step.
- A second front end signal processing method of the present invention is a front end signal processing method for processing an output signal of an image sensor, the method including:
- (a) a first step of detecting and digitizing a luminance level of an optical black part pixel included in the output signal of the image sensor;
- (b) a second step of averaging the digitized luminance level of the optical black part pixel;
- (c) a third step of counting the number of pixels on which averaging is performed;
- (d) a fourth step of generating a control signal when a count value of the number of pixels reaches a predetermined value;
- (e) a fifth step of detecting and digitizing a luminance level of an effective part pixel included in the output signal of the image sensor; and
- (f) a sixth step of subtracting the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal.
- According to this method, the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and in response to the control signal, the averaged luminance level is subtracted from the digitized luminance levels of the effective part pixels in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- Moreover, in the front end signal processing method of the above-described structure, it is preferable that the control signal is generated at the fourth step at a timing when the count value of the number of pixels reaches the predetermined value.
- Moreover, in the front end signal processing method of the above-described structure, the control signal may be generated at the fourth step at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- A first front end signal processor of the present invention is a front end signal processor that processes an output signal of an image sensor, the processor including:
- (a) a luminance detecting and digitizing section that detects and digitizes a luminance level of an optical black part pixel included in the output signal of the image sensor, and detects and digitizes a luminance level of an effective part pixel included in the output signal of the image sensor;
- (b) a pixel signal averaging section that averages the luminance level of the optical black part pixel digitized by the luminance detecting and digitizing section;
- (c) a pixel number counting section that counts the number of pixels on which averaging is performed by the pixel signal averaging section;
- (d) a control section that generates a control signal when a count value of the number of pixels by the pixel number counting section reaches a predetermined value; and
- (e) a black level clamping section that determines a black level of the output signal of the image sensor from the luminance level averaged by the black level luminance averaging section, in response to the control signal of the control section,
- wherein the black level of the output signal of the image sensor when the luminance level of the effective part pixel included in the output signal of the image sensor is detected by the luminance detecting and digitizing section is determined by the black level clamping section.
- According to this structure, the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and the black level of the output signal of the image sensor is determined from the averaged luminance level in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- It is preferable that the above-described front end signal processor further includes a black level correcting section that subtracts the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal from the control section.
- Moreover, it is preferable that the clamp control section generates the control signal at a timing when the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- Moreover, the clamp control section may generate the control signal at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- Further, the number of pixels on which averaging is performed may be different between the averaged luminance level in the black level correcting section and the averaged luminance level in the black level clamping section.
- A second front end signal processor of the present invention is a front end signal processor that processes an output signal of an image sensor, the processor including:
- (a) a luminance detecting and digitizing section that detects and digitizes a luminance level of an optical black part pixel included in the output signal of the image sensor, and detects and digitizes a luminance level of an effective part pixel included in the output signal of the image sensor;
- (b) a pixel signal averaging section that averages the luminance level of the optical black part pixel digitized by the luminance detecting and digitizing section;
- (c) a pixel number counting section that counts the number of pixels on which averaging is performed by the pixel signal averaging section;
- (d) a control section that generates a control signal when a count value of the number of pixels by the pixel number counting section reaches a predetermined value; and
- (e) a black level correcting section that subtracts the averaged luminance level from the digitized luminance level of the effective part pixel in response to the control signal from the control section.
- According to this method, the digitized luminance levels of the optical black part pixels are averaged, the control signal is generated when the count value of the number of pixels on which averaging is performed reaches the predetermined value, and the averaged luminance level is subtracted from the luminance levels of the digitized effective part pixels in response to the control signal, so that a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor.
- In the above-described front end signal processor, it is preferable that the clamp control section generates the control signal at a timing when the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- Moreover, the clamp control section may generate the control signal at a timing of a next horizontal or vertical blanking period after the count value of the number of pixels by the pixel number counting section reaches the predetermined value.
- According to the present invention, a stable black level signal output can be obtained even when the number of OB part pixels is small at the time of pixel mixture driving or thinning-out driving of the image sensor. In realizing this, the increase in circuit scale can be suppressed.
-
FIG. 1 is a block diagram showing the structure of a first embodiment of the present invention. -
FIG. 2 is a block diagram showing the structure of a second embodiment of the present invention. -
FIG. 3 is a block diagram showing the structure of a third embodiment of the present invention. -
FIG. 4 is a block diagram showing the structure of a fourth embodiment of the present invention. -
FIG. 5 is a block diagram showing the structure of a fifth embodiment of the present invention. -
FIG. 6 is a block diagram showing the structure of the first conventional example. -
FIG. 7 is a block diagram showing the structure of the second conventional example. -
FIG. 8 is a schematic view showing the outline of the output signal of the image sensor. -
FIG. 9 is a flowchart showing a front end signal processing method for the front end signal processor ofFIG. 1 . -
FIG. 10 is a flowchart showing a front end signal processing method for the front end signal processor ofFIG. 2 . -
FIG. 11 is a flowchart showing a front end signal processing method for the front end signal processor ofFIG. 5 . - Hereinafter, embodiments of the present invention will be described with reference to the drawings.
-
FIG. 1 is a block diagram showing the basic structure of a front end signal processor according to a first embodiment of the present invention. This front end signal processor has (a) a luminance detecting and digitizingsection 2, (b) a black level luminance detecting section 3 that detects the black level of the luminance signal, (c) a pixel number counting section 4, (d) aclamp control section 5, and (e) a blacklevel clamping section 6.Reference numeral 7 represents an output signal of the luminance detecting and digitizingsection 2. - (a) The luminance detecting and digitizing
section 2 detects and digitizes the luminance levels of the optical black part pixels included in the output signal of animage sensor 1, and detects and digitizes the luminance levels of the effective part pixels included in the output signal of theimage sensor 1. - (b) The black level luminance detecting section 3 averages the luminance levels of the optical black part pixels digitized by the luminance detecting and digitizing
section 2. - (c) The pixel number counting section 4 counts the number of pixels on which averaging is performed by the black level luminance detecting section 3.
- (d) The
clamp control section 5 generates a clamp control signal when the count value of the number of pixels by the pixel number counting section 4 reaches a predetermined value. - (e) The black
level clamping section 6 determines the black level of the output signal of theimage sensor 1 from the averaged luminance level obtained by the black level detecting section 3, in response to the clamp control signal of theclamp control section 5. - The black level of the output signal of the
image sensor 1 when the luminance levels of the effective part pixels included in the output signal of theimage sensor 1 are detected by the luminance detecting and digitizingsection 2 is determined by the blacklevel clamping section 6. - As the
image sensor 1, a CCD image sensor, a CMOS image sensor, or any other arbitrary image sensor may be used. - The signals from the
image sensor 1 are broadly divided into luminance signals from the effective pixel part of the light receiving section in the center of the sensor and luminance signals from the light intercepted section (OB part) disposed around the light receiving section. The luminance signal detecting and digitizingsection 2 detects the luminances of the effective pixel signals and the OB part pixel signals, and converts them into digital luminance signals. - The black level luminance detecting section 3 stores the luminance information of the OB part pixels, and outputs the luminance information to the black
level clamping section 6. The luminance information outputted here can also be calculated by the stored average value of the OB part pixels or by an arbitrary calculation method other than that. - The pixel number counting section 4 integrates (counts) the number of OB pixels stored in the black level luminance detecting section 3, and outputs the value to the
clamp control section 5. - The
clamp control section 5 outputs the clamp control signal for starting the clamping operation, to the blacklevel clamping section 6 when the integrated number of pixels reaches a predetermined number. - The black
level clamping section 6 performs feedback to the luminance signal detecting and digitizingsection 2 so that the difference between the OB part luminance information from the black level luminance detecting section 3 and the reference black level is zero, by the above-mentioned clamp control signal for starting the clamping operation. - The clamp control signal may be outputted either immediately after the number of pixels reaches a given number or during the next horizontal or vertical blanking period after the number of pixels reaches the given number.
- When the number of OB part pixels of one horizontal line is less than the predetermined number, the clamp control signal is not inputted on the horizontal line, the integrated number of pixels and luminance information of the OB part are carried forward to the next horizontal line, and the number of pixels and luminance information of the horizontal line are integrated. After integration is repeated until the number of pixels reaches the predetermined number in this manner, the clamp control signal for starting the clamping operation is outputted.
- While when the number of OB part pixels of one horizontal line is equal to or more than the predetermined number, integration may be ended at that point of time, the clamping operation may be performed after all the pixels of the OB part of the horizontal line are integrated, to further improve the accuracy of the OB part luminance information.
- As described above, in the front end signal processor according to the embodiment of the present invention, since the clamping operation is performed only when the number of OB part pixels reaches a given number even in a case where the number of OB part pixels is small such as at the time of pixel mixture driving or pixel thinning-out driving of the image sensor, clamp accuracy degradation due to an insufficient integrated number of pixels does not occur, and image quality degradation due to the occurrence of a lateral line arising from clamp accuracy degradation can be prevented.
- In addition, since the clamping operation can be performed every OB part when there are a sufficient number of horizontal OB part pixels and when there are a sufficient number of OB part pixels on the vertical OB line, pulling at the time of clamp pulling from high luminance or at the time of power-on can be performed as previously done, and a defect that the pulling time is long is absent.
- A front end signal processing method carried out by the above-described front end signal processor will be described.
- This front end signal processing method is a front end signal processing method for processing the output signal of an image sensor, and includes, as shown
FIG. 9 : - (a) a first step S1 of detecting and digitizing the luminance levels of the optical black part pixels included in the output signal of the image sensor;
- (b) a second step S2 of averaging the digitized luminance levels of the optical black part pixels;
- (c) a third step S3 of counting the number of pixels on which averaging is performed;
- (d) a fourth step S4 of generating a control signal when the count value of the number of pixels reaches a predetermined value;
- (e) a fifth step S5 of determining the black level of the output signal of the image sensor from the averaged luminance level in response to the control signal; and
- (f) a sixth step S6 of detecting and digitizing the luminance levels of the effective part pixels included in the output signal of the image sensor whose black level is determined.
- In the above-described front end signal processing method, the control signal is generated at the fourth step S4 at the timing when the count value of the number of pixels reaches the predetermined value, or the control signal is generated at the fourth step S4 at the timing of the next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
-
FIG. 2 is a block diagram showing the basic structure of a front end signal processor according to a second embodiment of the present invention. This front end signal processor has (a) a luminance detecting and digitizingsection 12, (b) a black levelluminance detecting section 13 that detects the black level of the luminance signal, (c) a pixelnumber counting section 14, (d) aclamp control section 15, (e) a blacklevel clamping section 16, and (f) an offset correctingsection 18.Reference numeral 19 represents an output signal of the offset correctingsection 18. - In the front end signal processor of
FIG. 2 , (a) the luminance detecting and digitizingsection 12, (b) the black levelluminance detecting section 13 that detects the black level of the luminance signal, (c) the pixelnumber counting section 14, (d) theclamp control section 15, and (e) the blacklevel clamping section 16 are similar to those of the front end signal processor ofFIG. 1 . This embodiment is different from the first embodiment in that (f) the offset correctingsection 18 is further provided. - (f) The offset correcting
section 18 subtracts the averaged luminance level from the digitized luminance levels of the effective pixels in response to the control signal from theclamp control section 15, thereby correcting the offset. - In the feedback loop constituted by the luminance signal detecting and digitizing
section 12, the black levelluminance detecting section 13, and the blacklevel clamping section 16, there are cases where an offset from the reference black level is caused due to the offsets of the analog blocks constituting the sections, and the offset correcting section 17 corrects the offset. - The offset value is calculated from the difference between the luminance information and the reference black level by the black level
luminance detecting section 13. This offset value is calculated as the average value of the luminance level of the OB part, and is outputted to the offset correctingsection 18 after the integrated number of pixels by thepixel counting section 14 reaches a predetermined value. While the luminance information can be calculated by taking the average value of the luminances of the OB part pixels by the blacklevel detecting section 13, in addition thereto, a value calculated by an arbitrary low-pass digital filter may be used. - The offset correcting
section 18 digitally subtracts the averaged luminance level (corresponding to the offset) detected by the black levelluminance detecting section 13, from the digital luminance signal outputted from the luminance signal detecting and digitizingsection 12. Thereby, the offset-corrected digital luminance signal is a signal whose black level is clamped to zero. - The number of OB pixels used for offset correction is not necessarily the same as the number of OB pixels used for controlling the black
level clamping section 16. Clamp control and offset correction can each be performed at an independent timing according to the characteristics of the preceding feedback loop for black level clamping and the succeeding feed-forward loop for offset correction. - As described above, the present invention is also applicable to a front end signal processor in which the offset caused in the feedback loop for black level clamping is corrected to obtain a luminance signal output having a stabilized black level.
- A front end signal processing method carried out by the above-described front end signal processor will be described.
- This front end signal processing method is a front end signal processing method for processing the output signal of an image sensor, and as shown in
FIG. 10 , is a processing in which (g) a seventh step S7 of subtracting the averaged luminance level from the digitized luminance levels of the effective part pixels in response to the control signal is added to the last of the flow chart ofFIG. 9 . - In the above-described front end signal processing method, the number of pixels on which averaging is performed may be different between the averaged luminance level at the step S7 and the averaged luminance level at the step S5.
-
FIG. 3 is a block diagram showing a front end signal processor which is the structure ofFIG. 2 that is made more concrete. This front end signal processor has (a) a luminance detecting and digitizingsection 310, (b) apixel number counter 25, (c) aclamp control section 28, (d) a blacklevel clamping section 320, (e) a black levelluminance detecting section 330, (f) an offset correctingsection 340, and (g) asignal processing section 350, and corrects the black level of the output to the reference black level with stability. - (a) The luminance detecting and digitizing
section 310 is constituted by a correlated double sampler (CDS) 22 that detects the luminance information included in the output signal from animage sensor 21 and an A/D converter (ADC) 23. - (b) The
pixel number counter 25 integrates (counts) the number of OB part pixels based on the digital luminance signal of the OB part pixels inputted through aswitch 24 that is on during the digital luminance signal period of the OB part pixels. - (c) The
clamp control circuit 28 generates aclamp start signal 26 and an offsetcorrection start signal 27 when the count value of the OB part pixels, that is, the integrated number of pixels reaches a predetermined value. - (d) The black
level clamping section 320 is constituted by a D/A converter (DAC) 34, acapacitor 35 for holding the clamp level, aswitch 36 that is on only during a predetermined charging period by theclamp start signal 26, and abuffer 37. - (e) The black level
luminance detecting section 330 is constituted by a pixelsignal averaging section 29 that averages the OB part pixel signals of the period during which theswitch 24 is on, aswitch 30 that is turned on by the clamp start signal, a low-passdigital filter 31 that is fed with the output of the OB partpixel averaging section 29 through aswitch 38, asubtracter 33 that subtracts a referenceblack level 32 from the output of the low-passdigital filter 31, theswitch 38 that is turned on by the offsetcorrection start signal 27, and a low-passdigital filter 39 that is fed with the output of the OB partpixel averaging section 29 through theswitch 38. - (f) The offset correcting
section 340 is constituted by asubtracter 40 that subtracts the output of the low-passdigital filter 39 from the output of the A/D converter 23. - (g) The
signal processor 350 is constituted by a digitalgain variable amplifier 42 that amplifies anoutput signal 45 of thesubtracter 40 by being controlled by again control signal 41 and anadder 44 that adds anOB reference level 43. A front endoutput luminance signal 46 is obtained from theadder 44. - The clamp start
signal 26 and the offsetcorrection start signal 27 are not necessarily the same, and may be each generated at a point of time when a given number of OB pixels are accumulated. Since the timing can be independently set as mentioned above, the optimum number of pixels can be selected according to the characteristic of each of the clamp loop and the offset correction loop. The clamp startsignal 26 and the offsetcorrection start signal 27 are on (at the time of update) during the normal blanking period, and the values thereof are held. For this reason, theclamp start signal 26 and the offsetcorrection start signal 27 may be turned off at any time. - Moreover, since the clamping operation is not performed when the number of pixels of the OB period is insufficient and the clamping operation is performed after a predetermined number of pixels are accumulated, no degradation in clamp accuracy occurs.
- As described above, according to the embodiment of the present invention, a front end signal processor is provided in which a stable black level luminance signal output is obtained even when the number of OB part pixels is small.
- While both the feedback loop and the feed-forward loop use the result of pixel number counting in the structure of
FIG. 3 , a structure may be adopted in which pixel number counting is applied to only one of them. -
FIG. 4 shows a front end signal processor which is the structure ofFIG. 1 that is made more concrete. The structure thereof is similar to a structure in which the structure of the offset correctingsection 340 is omitted from the structure ofFIG. 3 and accordingly, theswitch 38 and the low-passdigital filter 39 are omitted from the black levelluminance detecting section 330. InFIG. 4 ,reference numeral 91 represents an image sensor,reference numeral 92 represents a correlated double sampler (CDS),reference numeral 93 represents an A/D converter (ADC),reference numeral 94 represents a switch,reference numeral 95 represents a pixel number counter,reference numeral 96 represents a clamp control section,reference numeral 97 represents a clamp start signal,reference numeral 98 represents a pixel signal averaging section,reference numeral 99 represents a low-pass digital filter,reference numeral 100 represents a reference black level,reference numeral 101 represents a subtracter,reference numeral 102 represents a D/A converter,reference numeral 103 represents a switch,reference numeral 104 represents a capacitor,reference numeral 105 represents a buffer, andreference numeral 106 represents a front end output luminance signal.Reference numeral 410 represents a luminance detecting and digitizing section,reference numeral 420 represents a black level clamping section, andreference numeral 430 represents a black level luminance detecting section. - The effects of this embodiment are similar to those of the first embodiment.
-
FIG. 5 shows an embodiment in which averaging and pixel number counting are performed on the feed-forward loop and are not applied to the feedback loop.FIG. 5 of this embodiment is a structure in which theswitch 30 is omitted fromFIG. 3 and theswitch 36 is not controlled by theclamp control signal 26 but turned on every horizontal line or in the OB pixel part of each field. - The effects of this embodiment are similar to those of the first embodiment.
- A front end signal processing method carried out by the above-described front end signal processor will be described.
- This front end signal processing method is a front end signal processing method for processing the output signal of an image sensor, and includes, as shown
FIG. 11 : - (a) a first step S11 of detecting and digitizing the luminance levels of the optical black part pixels included in the output signal of the image sensor;
- (b) a second step S12 of averaging the digitized luminance levels of the optical black part pixels;
- (c) a third step S13 of counting the number of pixels on which averaging is performed;
- (d) a fourth step S14 of generating a control signal when the count value of the number of pixels reaches a predetermined value;
- (e) a fifth step S15 of detecting and digitizing the luminance levels of the effective part pixels included in the output signal of the image sensor; and
- (f) a sixth step S16 of subtracting the averaged luminance level from the digitized luminance levels of the effective pixels in response to the control signal.
- In the above-described front end signal processing method, the control signal is generated at the fourth step S4 at the timing when the count value of the number of pixels reaches the predetermined value, or the control signal is generated at the fourth step S4 at the timing of the next horizontal or vertical blanking period after the count value of the number of pixels reaches the predetermined value.
- As described above, the present invention is useful for a front end signal processing method or signal processor for an image sensor, and a signal processing system and a semiconductor integrated device system having these.
Claims (16)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007003343A JP2008172493A (en) | 2007-01-11 | 2007-01-11 | Method and apparatus for processing front end signal |
JP2007-003343 | 2007-01-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080170086A1 true US20080170086A1 (en) | 2008-07-17 |
Family
ID=39617419
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/971,865 Abandoned US20080170086A1 (en) | 2007-01-11 | 2008-01-09 | Front end signal processing method and front end signal processor |
Country Status (3)
Country | Link |
---|---|
US (1) | US20080170086A1 (en) |
JP (1) | JP2008172493A (en) |
TW (1) | TW200840345A (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100033601A1 (en) * | 2008-08-08 | 2010-02-11 | Takahiro Matsuda | Solid-state imaging device with a sensor core unit and method of driving the same |
US20100231762A1 (en) * | 2004-08-31 | 2010-09-16 | Canon Kabushiki Kaisha | Image signal processing apparatus, image signal processing method and camera using the image signal processing apparatus |
US20100271514A1 (en) * | 2009-04-24 | 2010-10-28 | Sony Corporation | Black level correction circuit and solid-state imaging device |
US20110074986A1 (en) * | 2009-09-25 | 2011-03-31 | Kabushiki Kaisha Toshiba | Black level adjusting apparatus, method for the same, and solid-state imaging device |
KR20110065859A (en) * | 2009-12-10 | 2011-06-16 | 삼성전자주식회사 | Optical touch panel and method of driving the same |
US20150070545A1 (en) * | 2013-09-12 | 2015-03-12 | Kabushiki Kaisha Toshiba | Solid-state imaging device |
CN104683711A (en) * | 2013-12-02 | 2015-06-03 | 佳能株式会社 | Image sensor, image capturing apparatus, and cellular phone |
US20160344962A1 (en) * | 2015-05-21 | 2016-11-24 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and image capturing apparatus |
US20180041722A1 (en) * | 2015-01-28 | 2018-02-08 | Analog Devices, Inc. | Circuits and techniques for noise control in digital imaging |
US20180176489A1 (en) * | 2015-06-18 | 2018-06-21 | Hamamatsu Photonics K.K. | Image-capture device, image acquisition device, image acquisition method, image processing device, and image processing program |
TWI636558B (en) * | 2013-09-12 | 2018-09-21 | 索尼半導體解決方案公司 | Electronic device and image sensor |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012169121A1 (en) * | 2011-06-10 | 2012-12-13 | パナソニック株式会社 | Solid-state imaging device |
JP5959834B2 (en) * | 2011-12-02 | 2016-08-02 | キヤノン株式会社 | Imaging device |
US20140062899A1 (en) * | 2012-08-31 | 2014-03-06 | Au Optronics Corporation | Dynamic stop display driving mechanism for touch sensing |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6005615A (en) * | 1995-03-27 | 1999-12-21 | Canon Kabushiki Kaisha | Correcting an optical black level by feeding forward a calculated correction amount |
US6304292B1 (en) * | 1996-01-12 | 2001-10-16 | Sanyo Electric Co., Ltd. | Digital video camera with high-speed mode |
US20020047934A1 (en) * | 1999-12-28 | 2002-04-25 | Shozo Nitta | Method and apparatus for processing front end signal for image sensor |
US6791607B1 (en) * | 1998-07-15 | 2004-09-14 | Texas Instruments Incorporated | Optical black and offset correction in CCD signal processing |
US20040218063A1 (en) * | 2003-05-02 | 2004-11-04 | Yuuichirou Hattori | Correction apparatus |
US20050237410A1 (en) * | 2004-03-10 | 2005-10-27 | Seiko Epson Corporation | Image quality display apparatus, digital camera, developing device, image quailty display method, and image quality display program |
US20050271294A1 (en) * | 1999-04-21 | 2005-12-08 | Sadao Takahashi | Image binarization apparatus, image binarization method, image pickup apparatus, image pickup method, and a computer product |
US20060274173A1 (en) * | 2005-05-19 | 2006-12-07 | Casio Computer Co., Ltd. | Digital camera comprising smear removal function |
US20070040916A1 (en) * | 2005-08-16 | 2007-02-22 | Fuji Photo Film Co., Ltd. | Signal processing method for image capturing apparatus, and image capturing apparatus |
US20070081721A1 (en) * | 2005-08-31 | 2007-04-12 | Sony Corporation | Apparatus, method, and program for taking an image, and apparatus, method, and program for processing an image |
US20070182845A1 (en) * | 2006-02-03 | 2007-08-09 | Micron Technology, Inc. | Auto exposure for digital imagers |
US20070269132A1 (en) * | 2006-05-17 | 2007-11-22 | Xerox Corporation | Histogram adjustment for high dynamic range image mapping |
US20080297620A1 (en) * | 2007-06-04 | 2008-12-04 | Nvidia Corporation | Reducing Computational Complexity in Determining an Illuminant of a Scene |
-
2007
- 2007-01-11 JP JP2007003343A patent/JP2008172493A/en not_active Withdrawn
-
2008
- 2008-01-09 US US11/971,865 patent/US20080170086A1/en not_active Abandoned
- 2008-01-10 TW TW097100958A patent/TW200840345A/en unknown
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6005615A (en) * | 1995-03-27 | 1999-12-21 | Canon Kabushiki Kaisha | Correcting an optical black level by feeding forward a calculated correction amount |
US6304292B1 (en) * | 1996-01-12 | 2001-10-16 | Sanyo Electric Co., Ltd. | Digital video camera with high-speed mode |
US6791607B1 (en) * | 1998-07-15 | 2004-09-14 | Texas Instruments Incorporated | Optical black and offset correction in CCD signal processing |
US20050271294A1 (en) * | 1999-04-21 | 2005-12-08 | Sadao Takahashi | Image binarization apparatus, image binarization method, image pickup apparatus, image pickup method, and a computer product |
US20020047934A1 (en) * | 1999-12-28 | 2002-04-25 | Shozo Nitta | Method and apparatus for processing front end signal for image sensor |
US7081921B2 (en) * | 1999-12-28 | 2006-07-25 | Shozo Nitta | Method and apparatus for processing front end signal for image sensor |
US20040218063A1 (en) * | 2003-05-02 | 2004-11-04 | Yuuichirou Hattori | Correction apparatus |
US20050237410A1 (en) * | 2004-03-10 | 2005-10-27 | Seiko Epson Corporation | Image quality display apparatus, digital camera, developing device, image quailty display method, and image quality display program |
US20060274173A1 (en) * | 2005-05-19 | 2006-12-07 | Casio Computer Co., Ltd. | Digital camera comprising smear removal function |
US20070040916A1 (en) * | 2005-08-16 | 2007-02-22 | Fuji Photo Film Co., Ltd. | Signal processing method for image capturing apparatus, and image capturing apparatus |
US20070081721A1 (en) * | 2005-08-31 | 2007-04-12 | Sony Corporation | Apparatus, method, and program for taking an image, and apparatus, method, and program for processing an image |
US20070182845A1 (en) * | 2006-02-03 | 2007-08-09 | Micron Technology, Inc. | Auto exposure for digital imagers |
US20070269132A1 (en) * | 2006-05-17 | 2007-11-22 | Xerox Corporation | Histogram adjustment for high dynamic range image mapping |
US20080297620A1 (en) * | 2007-06-04 | 2008-12-04 | Nvidia Corporation | Reducing Computational Complexity in Determining an Illuminant of a Scene |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8223228B2 (en) * | 2004-08-31 | 2012-07-17 | Canon Kabushiki Kaisha | Image signal processing apparatus, image signal processing method and camera using the image signal processing apparatus |
US20100231762A1 (en) * | 2004-08-31 | 2010-09-16 | Canon Kabushiki Kaisha | Image signal processing apparatus, image signal processing method and camera using the image signal processing apparatus |
US20100033601A1 (en) * | 2008-08-08 | 2010-02-11 | Takahiro Matsuda | Solid-state imaging device with a sensor core unit and method of driving the same |
US20100271514A1 (en) * | 2009-04-24 | 2010-10-28 | Sony Corporation | Black level correction circuit and solid-state imaging device |
US8411173B2 (en) * | 2009-04-24 | 2013-04-02 | Sony Corporation | Black level correction circuit and solid-state imaging device |
US20110074986A1 (en) * | 2009-09-25 | 2011-03-31 | Kabushiki Kaisha Toshiba | Black level adjusting apparatus, method for the same, and solid-state imaging device |
US8917260B2 (en) * | 2009-12-10 | 2014-12-23 | Samsung Electronics Co., Ltd. | Optical touch panels and methods of driving the same |
US20110141060A1 (en) * | 2009-12-10 | 2011-06-16 | Samsung Electronics Co., Ltd. | Optical touch panels and methods of driving the same |
KR20110065859A (en) * | 2009-12-10 | 2011-06-16 | 삼성전자주식회사 | Optical touch panel and method of driving the same |
KR101672343B1 (en) * | 2009-12-10 | 2016-11-04 | 삼성전자주식회사 | Optical touch panel and Method of driving the same |
US20150070545A1 (en) * | 2013-09-12 | 2015-03-12 | Kabushiki Kaisha Toshiba | Solid-state imaging device |
TWI636558B (en) * | 2013-09-12 | 2018-09-21 | 索尼半導體解決方案公司 | Electronic device and image sensor |
CN104683711A (en) * | 2013-12-02 | 2015-06-03 | 佳能株式会社 | Image sensor, image capturing apparatus, and cellular phone |
US20180041722A1 (en) * | 2015-01-28 | 2018-02-08 | Analog Devices, Inc. | Circuits and techniques for noise control in digital imaging |
US20160344962A1 (en) * | 2015-05-21 | 2016-11-24 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and image capturing apparatus |
US9948879B2 (en) * | 2015-05-21 | 2018-04-17 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and image capturing apparatus |
US20180176489A1 (en) * | 2015-06-18 | 2018-06-21 | Hamamatsu Photonics K.K. | Image-capture device, image acquisition device, image acquisition method, image processing device, and image processing program |
Also Published As
Publication number | Publication date |
---|---|
JP2008172493A (en) | 2008-07-24 |
TW200840345A (en) | 2008-10-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20080170086A1 (en) | Front end signal processing method and front end signal processor | |
US6774942B1 (en) | Black level offset calibration system for CCD image digitizer | |
US9736406B2 (en) | Image capturing apparatus and control method thereof | |
KR101252275B1 (en) | The signal process apparatus and method of the solid-state image pickup device and imaging device | |
KR101211117B1 (en) | Signal processing apparatus and signal processing method for solid-state image pickup element and image pickup apparatus | |
JP4649155B2 (en) | Imaging apparatus and imaging method | |
JP5350466B2 (en) | Column fixed pattern noise correction method | |
US20100231762A1 (en) | Image signal processing apparatus, image signal processing method and camera using the image signal processing apparatus | |
US20080192131A1 (en) | Image pickup apparatus and method for extending dynamic range thereof | |
US20070127046A1 (en) | Offset adjusting device, correcting device, and method of adjusting analog image signal | |
US9918033B2 (en) | Signal processing apparatus and signal processing method, and image capturing apparatus | |
US7652690B2 (en) | Front-end signal processing circuit and imaging device | |
US7417669B2 (en) | Digital clamping circuit and digital clamping method | |
JPH08265605A (en) | Image pickup device | |
JP4791122B2 (en) | Clamp circuit and digital camera system having the clamp circuit | |
JP6494301B2 (en) | Imaging apparatus and control method thereof | |
JP5091550B2 (en) | White balance adjusting device and white balance adjusting method | |
JP6525602B2 (en) | Image pickup apparatus and control method thereof | |
JPH11112884A (en) | Method for correcting dark current of video camera device and video camera device using the method | |
JP2013150144A (en) | Imaging method and imaging apparatus | |
US8564694B2 (en) | Image pickup device and noise reduction method thereof | |
JP2008060779A (en) | Video signal processing apparatus and video signal processing method | |
JP2007282204A (en) | Front-end signal processing circuit and imaging device | |
JP2006148539A (en) | Image pickup device | |
JPH10285432A (en) | Clamp device for video signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HATANI, NAOHISA;OTANI, MITSUHIKO;YAMAGUCHI, KOUJI;AND OTHERS;REEL/FRAME:020806/0520;SIGNING DATES FROM 20080220 TO 20080221 |
|
AS | Assignment |
Owner name: PANASONIC CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021897/0516 Effective date: 20081001 Owner name: PANASONIC CORPORATION,JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021897/0516 Effective date: 20081001 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |