US20060244853A1 - Solid-state imaging device - Google Patents
Solid-state imaging device Download PDFInfo
- Publication number
- US20060244853A1 US20060244853A1 US11/409,209 US40920906A US2006244853A1 US 20060244853 A1 US20060244853 A1 US 20060244853A1 US 40920906 A US40920906 A US 40920906A US 2006244853 A1 US2006244853 A1 US 2006244853A1
- Authority
- US
- United States
- Prior art keywords
- picture signal
- imaging device
- solid
- state imaging
- processing unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N3/00—Scanning details of television systems; Combination thereof with generation of supply voltages
- H04N3/10—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical
- H04N3/14—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by means of electrically scanned solid-state devices
- H04N3/15—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by means of electrically scanned solid-state devices for picture signal generation
- H04N3/155—Control of the image-sensor operation, e.g. image processing within the image-sensor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4007—Interpolation-based scaling, e.g. bilinear interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
- H04N1/393—Enlarging or reducing
- H04N1/3935—Enlarging or reducing with modification of image resolution, i.e. determining the values of picture elements at new relative positions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
- H04N25/443—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/745—Circuitry for generating timing or clock signals
Definitions
- the present invention relates to a signal processing circuit for a solid-state imaging device of a portable telephone with a built-in camera, a digital still camera, etc., and to a solid-state imaging device.
- Imaging devices such as a portable telephone, digital still camera and the like have an enlargement zoom mechanism mounted thereon as an essential function of the camera.
- the enlargement zoom functions there are an optical enlargement zoom function that zooms in and out by controlling a lens, and an electronic enlargement zoom mechanism that zooms by interpolation of digital data.
- the optical enlargement zoom mechanism tends to be large-scaled since it requires mechanisms such as a zoom lens and a motor to drive the zoom lens. Therefore, an electronic enlargement zoom mechanism of a smaller-scale is frequently used for a small-size imaging device such as a portable camera.
- FIG. 9A A picture image captured by the electronic enlargement mechanism will be described by referring to FIG. 9 and FIG. 10 .
- an output picture of four third magnification can be obtained with a reduction rate of one third, and the output picture of twice the size can be obtained with the reduction rate of one half.
- Enlargement zoom can be achieved in this way.
- the maximum enlargement rate is the four times (1/1 reduction rate) which corresponds to the case where a subject area 83 picked up by the solid-state imaging device is cut out in an output picture size of QVGA (picked-up output area 84 of the output picture).
- enlargement zoom can be achieved by storing the picked-up data of a part of a subject area 93 in one scene to a frame memory and carrying out electronic interpolation (output picture area 94 ).
- the frame memory is required additionally in such a case.
- the frame memory for performing the electronic enlargement zoom when the ratio between the picked-up size and the output size (output size/picked-up size) is 1 or more.
- the ratio between the picked-up size and the output size is 1 or more.
- MOS-type sensor In addition to a CCD sensor, there is also an MOS-type sensor as the imaging sensor.
- the MOS-type sensor is characterized by a low power consumption, a single power drive, etc., and used frequently for a small-size portable apparatus such as a portable telephone with a built-in camera.
- the MOS-type sensor faces the above-described problems.
- the main object of the present invention therefore is to provide an imaging sensor capable of the electronic enlargement zoom without a frame memory even under a condition where the ratio between the picked-up size and the output size (output size/picked-up size) is 1 or more, and to provide a driving method thereof.
- a signal processing circuit of the present invention is consisted of signal-processing an analog picture signal outputted from a solid-state imaging device that comprises: a pixel part arranged two-dimensionally; an electronic shutter shift register that supplies an electronic shutter shift pulse to a pixel part for resetting an electric charge of the pixel part; and a readout shift register that supplies a vertical readout shift pulse to the pixel part for reading out the electric charge of the pixel part in order, wherein the signal processing circuit comprises a drive unit, an A/D converter, a processing unit for picture signal, and a control unit, wherein:
- the drive unit supplies each of the shift pulses separately to the electronic shutter shift register and the readout shift register;
- the A/D converter converts the analog picture signal outputted from the solid-state imaging device to a digital picture signal;
- the processing unit for picture signal designates a control start position of the digital picture signal outputted from the A/D converter and performs interpolation processing thereon along a horizontal direction and a vertical direction;
- the control unit controls the drive unit and the processing unit for picture signal;
- the drive unit adjusts cycles of each of the shift pulses to control a vertical-line readout rate of the solid-state imaging device, and then intermittently reads out the analog picture signal from the solid-state imaging device;
- the processing unit for picture signal performs vertical-line interpolation processing in accordance with the vertical-line readout rate to extend a part of picture area of the digital picture signal.
- a signal processing circuit of the present invention is the one to do signal-processing of an analog picture signal outputted from a solid-state imaging device that comprises: a pixel part arranged two-dimensionally; an electronic shutter shift register that supplies an electronic shutter shift pulse to a pixel part in order to reset an electric charge of the pixel part; and a readout shift register that supplies a vertical readout shift pulse to the pixel part to read out the electric charge of the pixel part in order.
- the signal processing unit comprises a drive unit, an A/D converter, a processing unit for picture signal, and a control unit, wherein: the drive unit supplies each of the shift pulses separately to the shift register for the electronic shutter and the read shift register; the A/D converter converts the analog picture signal outputted from the solid-state imaging device to a digital picture signal; the processing unit for picture signal designates a control start position of the digital picture signal outputted from the A/D converter, and performs interpolation processing thereon along a horizontal direction and a vertical direction; the control unit controls the drive unit and the processing unit for picture signal; the drive unit extends a horizontal blanking period of the solid-state imaging device to be longer than a valid period in one line of the analog picture signal; and the processing unit for picture signal performs vertical-line interpolation processing to extend a part of picture area of the digital picture signal.
- the drive unit controls the vertical-line readout rate of the solid-state imaging device in accordance with a zoom magnification
- the processing unit for picture signal adjusts the horizontal blanking period of the digital picture signal outputted from the processing unit for picture signal such that periodicity of a synchronizing signal of the digital picture signal outputted from the processing unit for picture signal becomes constant regardless of the zoom magnification.
- the synchronizing signal of the digital picture signal outputted from the processing unit for picture signal can be provided with a uniform periodicity regardless of the zoom magnifications and without intermittence. Therefore, the interface between the digital picture signal and the circuit or the device to be connected thereto can be simplified.
- the construction of the above signal processing circuit can be applied to a solid-state imaging device.
- the pixel part is preferable to be constituted with a MOS-type sensor consisted of a focal plane shutter system.
- the present invention enables the electronic enlargement zoom even without a frame memory under a condition where the output size to the picked-up size is one or more times.
- the present invention can be utilized in the solid-state imaging devices such as digital still cameras. Particularly, it can be applied to a portable telephone with a built-in camera, on which an optical zoom is hard to mount.
- FIG. 1 is a block diagram for showing the structure of a solid-state imaging device according to the first to third embodiments of the present invention
- FIG. 2 is a timing chart for showing action of the solid-state imaging device according to the first embodiment of the present invention
- FIG. 3 is an illustration for describing the electronic enlargement zoom action of the solid-state imaging device according to the first embodiment of the present invention
- FIG. 4 is a vertical timing chart for showing the action of the solid-state imaging device according to the first embodiment of the present invention
- FIG. 5 is a horizontal timing chart for showing the action of the solid-state imaging device according to the first embodiment of the present invention.
- FIG. 6A is a illustration for describing the first action of interpolation performed by a processing unit for picture signal according to the first embodiment of the present invention
- FIG. 6B is a illustration for describing the second action of interpolation performed by the processing unit for picture signal according to the first embodiment of the present invention.
- FIG. 7A is an illustration of a pixel structure in the state where a blanking period is extended in the solid-state imaging device according to the second embodiment of the present invention.
- FIG. 7B is an illustration for describing a synchronizing signal of the solid-state imaging device according to the second embodiment of the present invention.
- FIG. 8 is a timing chart where the external synchronizing signals are made constant in the solid-state imaging device according to the third embodiment of the present invention.
- FIG. 9A is an illustration of a first picture image of the electronic enlargement zoom of a conventional case where a frame memory is not used;
- FIG. 9B is an illustration of a second picture image of the electronic enlargement zoom of a conventional case where a frame memory is not used;
- FIG. 10A is an illustration of a first picture image of the electronic enlargement zoom of a conventional case where a frame memory is used.
- FIG. 10B is an illustration of a second picture image of the electronic enlargement zoom of a conventional case where a frame memory is used.
- FIG. 1 is a block diagram for showing the structure of a solid-state imaging device according to a first embodiment of the present invention.
- the solid-state imaging device comprises a solid-state imaging device 10 and a signal processing circuit 20 .
- the signal processing circuit 20 comprises a control unit 21 , a drive unit 22 , an A/D converter 23 , and a processing unit for picture signal 24 .
- the solid-state imaging device 10 comprises: a pixel part 11 arranged: two-dimensionally; an electronic shutter shift register 12 for transferring electronic shutter shift pulse Pd in order; a vertical readout shift register 13 to transfer vertical readout shift pulse Pr for reading out an electric charge to the pixel part 11 in order; a horizontal readout shift register 14 to transfer the electric charge read out from the pixel part 11 in order to the horizontal direction; and an output amplifier 15 .
- the pixel part 11 is consisted of a random-accessible MOS-type sensor with a focal-plane shutter system. As shown in FIG. 2 , both registers 12 and 13 have high-rate transfer pulses Pd and Pr, which are constructed with a shorter pulse than a regular pulse at least in a part of period within one cycle.
- the solid-state imaging device takes a frame period consisted of successive electronic-shutter frame period F 1 and readout frame period F 2 as one cycle.
- the electronic shutter shift pulse Pd is supplied from the drive unit 22 to the electronic shutter register 12 and, in the readout frame period F 2 , the vertical readout shift register Pr is supplied from the drive unit 22 to the vertical readout shift register 13 .
- the processing unit for picture signal 24 achieves the electronic enlargement zoom mechanism in the same frame period.
- the control unit 21 controls the drive unit 22 and the processing unit for picture signal 24 while synchronizing one another.
- the drive unit 22 generates the electronic shutter shift pulse Pd and supplies it to the electronic shutter shift register 12 in the electronic shutter frame period F 1 .
- a high-rate transfer pulse is contained in a part of the electronic-shutter shift pulse Pd.
- the electronic shutter shift register 12 resets the electric charge by supplying the electronic shutter shift pulse Pd to the pixel part 11 . Thereby, the electric charges of the optical image of the subject are accumulated from immediately after the reset.
- the drive unit 22 generates the readout shift pulse Pr and supplies it to the vertical readout shift register 13 in the readout frame F 2 .
- a high-rate transfer pulse is contained in a part of the readout shift pulse Pr.
- the readout shift register 13 reads out the accumulated electric charge by supplying the readout shift pulse Pr to the pixel part 11 .
- the electric charge read out from the pixel part 11 in the vertical direction is transferred in the horizontal direction by the horizontal readout shift register 14 , which is converted into a voltage signal by the output amplifier 15 and outputted to the A/D converter unit 23 of the signal processing circuit 20 as an analog picture signal.
- the A/D converter unit 23 converts the inputted analog picture signal to a digital picture signal and outputs it to the processing unit for picture signal 24 .
- the processing unit for picture signal 24 performs format conversion of the inputted digital picture signal as well as processing such as interpolation, and outputs the signal-processed digital picture signal and the synchronizing signal.
- the synchronizing signal is corresponded to the signal-processed digital picture signal.
- reading-out rate of the lines is controlled in the vertical direction.
- the processing unit for picture signal 24 performs line interpolation in the vertical direction in accordance with the line reading-out rate in order to achieve the electronic enlargement zoom mechanism.
- FIG. 2 is a timing chart for showing the action of the solid-state imaging device having the structure described above.
- a period of “L” level in a vertical synchronizing signal VD is a period when picture-signal is valid, and that of an “H” level is a period when picture-signal is invalid (vertical blanking period).
- the electric charge is reset as a unit of each line according to an electronic shutter start pulse Pds and the electronic shutter shift pulse Pd.
- the electronic shutter shift pulse Pd has a high-rate electronic shutter period T 1 and an intermittent electronic shutter period T 2 in the electronic shutter frame period F 1 .
- An electronic shutter period T 3 may be under a high rate like the period T 1 or may be under a normal rate.
- Q is an electric charge accumulation period.
- the electric charge is read out as a unit of each line according to a readout start pulse Prs and the vertical readout shift pulse Pr.
- the readout shift pulse Pr has a high-rate readout period T 4 and an intermittent readout period T 5 in the readout frame period F 2 .
- R is a readout period.
- FIG. 3 shows image illustrations of picture configurations from inputting of the digital picture signal from the A/D converter 23 to the processing unit for picture signal 24 until outputting.
- Reference numeral g 1 is an image illustration of the picture configuration in the solid-state imaging device 10
- g 2 is an image illustration of the picture configuration when reading out is carried out intermittently in the vertical direction
- g 3 is an image illustration of the picture configuration when pixel-interpolation is performed in the horizontal direction.
- the electric charge is transferred at a high rate until the readout start position a in the vertical direction of the j ⁇ n pixels in the high-rate readout period T 4 , while the electric charge is transferred at a slower rate than a normal rate between the start position a of the prescribed picture and the end position b.
- the A/D-converted picture signal (referred to as a digital picture signal hereinafter) is sent out to the processing unit for picture signal 24 .
- the electric charge is transferred again at a high rate or at a normal rate.
- the processing unit for picture signal 24 performs signal interpolation between the lines to the digital picture signal supplied from the solid-state imaging device 10 (it is read out intermittently in the vertical direction).
- the picture configuration g 2 shows the picture image of the digital signal to which the signal interpolation is performed.
- the processing unit for picture signal 24 performs the other signal interpolation processing simultaneously with the above-described interpolation signal processing.
- a start position c of a desired picture is designated in the horizontal direction.
- the area of m-pixels is extended in a region until reaching the area of j-pixels in the horizontal direction.
- the picture configuration g 3 shows the picture image of the digital picture signal where interpolation processing are performed to both signals. By performing interpolation processing to both signals, the picture region of m ⁇ n is zoomed by electronic enlargement to the picture region of j ⁇ k.
- FIG. 4 the digital picture signal inputted to the signal processing circuit 20 and the digital picture signal outputted from the signal processing circuit 20 are shown by the vertical rate as a standard.
- the digital picture signal S 1 including in the n-lines from H 1 to Hn being read out intermittently is inputted to the processing unit for picture signal 24 under synchronizing with the input horizontal synchronizing signal HD 1 .
- the processing unit for picture signal 24 performs interpolation processing on the inputted digital picture signal S 1 including in the n-lines to generate and output a digital picture signal S 2 including in the k-lines from h 1 to hk.
- Reference numeral T 7 is a delay amount in the vertical direction from the input of the picture signal S 1 until the output of the picture signal S 2 .
- the digital picture signal inputted to the signal processing circuit 20 and the digital picture signal outputted from the signal processing circuit 20 are shown by the horizontal rate as a standard.
- the digital picture signal S 1 is inputted to the processing unit for picture signal 24 under synchronizing with the input horizontal synchronizing signal HD 1 .
- the processing unit for picture signal 24 performs signal interpolation to the region including m-pixels within the range between c and d to the area of j-pixels (m ⁇ j) to generate the digital signal S 2 .
- Reference numeral T 8 is a delay amount in the horizontal direction.
- FIG. 6A and FIG. 6B show the interpolation processing performed in the processing unit for picture signal 24 .
- the interpolation processing is described herein by a cubic interpolation method that uses a cubic function.
- FIG. 6A shows one-dimensional image i 1 in the horizontal direction or vertical direction.
- Y′ F ( Y 2 ,Y 3 ,Y 4 ,Y 5 ,K ) (1) data of one pixel is interpolated from four pixels.
- Y′ is the pixel data of the interpolation pixel
- F is the interpolation function
- Y 2 is the pixel data of the interpolation start pixel
- Y 2 -Y 5 are pixel data of respective pixels
- K is the interpolation coefficient, respectively.
- FIG. 6B shows two-dimensional image i 2 of 4 ⁇ 4 pixels.
- the interpolation pixel data Y 1 ′ can be obtained by substituting pixel data of four pixels in the vertical direction, Y 11 , Y 21 , Y 31 , Y 41 to the interpolation expression (1).
- the interpolation pixel data Y 2 ′, Y 3 ′, and Y 4 ′ can be obtained.
- the final picture data Y can be obtained.
- the interpolation pixel data of one pixel is generated from the pixel data of 4 ⁇ 4 pixels.
- the interpolation processing according to the embodiment will be described specifically. For example, it is tried to achieve an electronic enlargement zoom of twice the size under the assumption that the pick-up size of the solid-state imaging device 10 is 1,280 pixels ⁇ 960 lines and the output picture size is 1,280 pixels ⁇ 960 lines.
- the digital picture signal of 480 lines is inputted to the processing unit for picture signal 24 from the solid-state imaging device 10 .
- the digital picture signal is inputted under intermittent state of two lines to the processing unit for picture signal 24 .
- the electronic enlargement zoom of twice the size can be achieved.
- the interpolation processing has been described by referring to the cubic interpolation method using a cubic function, however, other interpolation processing such as a linear or quadratic interpolation method may be used as well.
- the embodiment of the invention it is possible to achieve the electronic enlargement zoom without using a frame memory even under the condition where the output ratio (output size/picked-up size) is 1 or more, by performing at a combination of the accumulation/readout control of the electric charge by the solid-state imaging device 10 through the drive unit 22 and the interpolation processing by the processing unit for picture signal 24 .
- a second embodiment of the present invention achieves electronic enlargement zoom without performing the high-rate transfer and intermittent readout in the solid-state imaging device 10 .
- the embodiment therefore is characterized by that the blanking period of the horizontal synchronizing signal (referred to as a horizontal blanking period hereinafter) is extended to be more than the valid period of the picture signal by the drive unit 22 .
- the fundamental structure of the solid-state imaging device according to this embodiment is the same as that of the first embodiment shown in FIG. 1 .
- horizontal blanking period ⁇ 2 corresponding to “H” level of the horizontal synchronizing signal HD is extended to be more than picture signal valid period ⁇ 1 .
- the horizontal line continues to the horizontal line of the next line, so that the horizontal blanking period becomes the period ⁇ 2 of the invalid signal area A 2 , i.e. a period ⁇ 3 +a period ⁇ 4 .
- FIG. 7B is a horizontal timing chart of this embodiment.
- the horizontal synchronizing signal HD repeats the same cycle at all times. That is, the high-rate transfer and the intermittent readout like the case of the first embodiment become unnecessary.
- the horizontal blanking period ⁇ 2 is more than the picture signal valid period ⁇ 1 ( ⁇ 1 ⁇ 2 ).
- the electronic enlargement zoom of N ⁇ (M+1) times at the maximum by combining the configuration to intermittently read out the picture signal by N-line (the constitution of the first embodiment) and the configuration of the second embodiment.
- the N-line intermittent readout is performed on the picture signal inputted from the solid-state imaging device 10 , and the horizontal blanking period ⁇ 2 is extended to the length that is M-times the picture signal valid period ⁇ 1 .
- the signal output time becomes N ⁇ (M+1) times comparing to the signal input time.
- this margin of time it becomes possible to perform line interpolation without a memory frame.
- the solid-state imaging device 10 is of 1,280 pixels ⁇ 960 lines and the output picture size is 1,280 pixels and 960 lines.
- the control unit 21 sets the drive unit 22 such that the electronic shutter shift pulse Pd operates by the intermittent cycle of two-lines in the electronic shutter frame period F 1 . Then, the control unit 21 sets the drive unit 22 such that the vertical readout shift pulse Pr operates by the intermittent cycle of two-lines in the readout frame period F 2 . Furthermore, the control unit 21 sets the drive unit 22 such that the horizontal blanking period ⁇ 2 extends to one or more times the picture signal period ⁇ 1 which corresponds to 1,280 pixels.
- the analog picture signal of 240 pixels is inputted under two-line intermittent state to the processing unit for picture signal 24 from the solid-state imaging device 10 .
- delay period of 2 ⁇ (1+1) 4 times in the signal output time compared to the signal input time. Therefore, interpolation of every three lines can be performed between the lines.
- control unit 21 controls the processing unit for picture signal 24 to perform interpolation such that the output pixel interval in the horizontal direction becomes one fourth to give the output of 1,280 pixels.
- the embodiment achieves the electronic enlargement zoom of four times by combining the two-line intermittent drive control and control of making the horizontal blanking period to one or more times the picture signal period.
- the embodiment enables the signal output time to have a margin of time compared to the signal input time by extending the horizontal blanking period ⁇ 2 to the length that is one or more times the picture signal valid period ⁇ 1 .
- the line interpolation within the margin of time, it is possible to achieve the electronic enlargement zoom without using a frame memory even under a condition where the output size to the picked-up size is one or more times.
- a third embodiment of the present invention allows the synchronizing signal to have the constant cycle regardless of the magnifications (zoom magnifications) in the electronic enlargement zoom.
- the fundamental structure of the solid-state imaging device according to this embodiment is the same as that of the first embodiment shown in FIG. 1 .
- reference numeral HD 3 is a horizontal synchronizing signal of the picture signal inputted from the solid-state imaging device 10 .
- a horizontal synchronizing signal H 4 at the magnification of 3 ⁇ 4 times has a periodicity of one valid line, one invalid line, and two valid lines as a unit, however, it becomes in “H”, “L”, “H”, and “H”, which has no uniform periodicity when it is seen as the line unit.
- there occurs a period where the picture signal is not outputted thereby it gives difficulty to the interface between the output signal of the solid-state imaging device and the circuit or the device to which the output signal is inputted.
- the third embodiment performs the vertical-line readout control of the solid-state imaging device 10 and the interpolation processing of the processing unit for picture signal 24 simultaneously in accordance with the enlargement magnification, and adjusts the length of the horizontal blanking period.
- the synchronizing signal outputted from the processing unit for picture signal 24 can be made constant without having intermittence, regardless of the zoom magnification of the electronic enlargement zoom.
- the electric charge having no periodicity in terms of the pixel unit is read out under a intermittent state from the pixel part 11 .
- the electric charge is read out from the pixel part 11 by repeating the order of 1,000 valid pixels, 1,000 invalid pixels, and 1,000 ⁇ 2 valid pixels.
- the horizontal blanking period of the horizontal synchronizing signal HD 4 outputted from the processing unit for picture signal 24 at this time is separated into ⁇ 4 and ( ⁇ 4 ⁇ 2+1,000 pixels), thus becoming unstable.
- This instability i.e. the fluctuation of the horizontal blanking period, differs in accordance with the zoom magnifications.
- the horizontal synchronizing signal HD 5 becomes to have a uniform periodicity without having the intermittence as shown in FIG. 8 .
- the intermittence cycle of the lines in the solid-state image senor 10 is altered.
- the line intermittence cycle becomes (4 ⁇ 5) ⁇ ( 4/3) ⁇ 1.06.
- the line intermittence cycle of 1.06 line means that about six lines among one-hundred lines becomes invalid lines.
- the zoom magnification when the zoom magnification is set as 4/3, after fixing the output cycle of the output picture signal (specifically, its horizontal synchronizing signal); calculating the relative magnification for changing the zoom magnification from 4/3 to 4 ⁇ 5; and setting the calculated relative magnification as the line intermittence cycle of the solid-state imaging device 10 , it becomes possible to make the output cycle of the output picture signal always constant regardless of the magnification.
- an expression is provided to show the relations between the action of the solid-state imaging device 10 , the action of the processing unit for picture signal 24 , and the horizontal blanking period.
- the zoom magnification by the processing unit for picture signal 24 is A/B, it is possible to supply periodicity to the output picture signal through multiplying the output cycle of the output picture signal by B/A.
- the output cycle of the output picture signal becomes adjustable based on changes in the horizontal blanking period of the output picture signal.
- the zoom magnification is changed to be C/D.
- the intermittence cycle of the lines outputted from the solid-state imaging device 10 is set as (C/D) ⁇ (A/B), while keeping the output cycle of the output picture signal of B/A times.
Abstract
Description
- 1. Field of the Invention
- The present invention relates to a signal processing circuit for a solid-state imaging device of a portable telephone with a built-in camera, a digital still camera, etc., and to a solid-state imaging device.
- 2. Description of the Related Art
- Imaging devices such as a portable telephone, digital still camera and the like have an enlargement zoom mechanism mounted thereon as an essential function of the camera. As the enlargement zoom functions, there are an optical enlargement zoom function that zooms in and out by controlling a lens, and an electronic enlargement zoom mechanism that zooms by interpolation of digital data. The optical enlargement zoom mechanism tends to be large-scaled since it requires mechanisms such as a zoom lens and a motor to drive the zoom lens. Therefore, an electronic enlargement zoom mechanism of a smaller-scale is frequently used for a small-size imaging device such as a portable camera.
- A picture image captured by the electronic enlargement mechanism will be described by referring to
FIG. 9 andFIG. 10 . First, there will be described the case where electronic enlargement zoom is performed without using a frame memory. As shown inFIG. 9A , let us look into the case where anoutput picture area 82 is smaller than a picked-uparea 81 captured by the solid-state imaging device. For example, when an image of QVGA (320 pixels×240 lines) output image size is outputted by the solid-state imaging device having the picked-up picture area of 1,280 pixels×960 lines, the picked-up picture is reduced by one fourth to obtain the one-times (unmagnified) output picture (¼×4=1). Accordingly, an output picture of four third magnification can be obtained with a reduction rate of one third, and the output picture of twice the size can be obtained with the reduction rate of one half. Enlargement zoom can be achieved in this way. As shown inFIG. 9B , the maximum enlargement rate is the four times (1/1 reduction rate) which corresponds to the case where asubject area 83 picked up by the solid-state imaging device is cut out in an output picture size of QVGA (picked-upoutput area 84 of the output picture). - However, it is not possible with this configuration to perform enlargement zoom when the size of the picked-up
area 91 and that of the picked-uppicture output area 92 are equal as shown inFIG. 10A . In such a case, as shown inFIG. 10B , enlargement zoom can be achieved by storing the picked-up data of a part of asubject area 93 in one scene to a frame memory and carrying out electronic interpolation (output picture area 94). However, the frame memory is required additionally in such a case. - As described above, there is additionally required the frame memory for performing the electronic enlargement zoom when the ratio between the picked-up size and the output size (output size/picked-up size) is 1 or more. Particularly in the case of a small-size portable apparatus, it is essential to downsize the camera module and keep the low-cost. Thus, it is not practical to mount the frame memory.
- In addition to a CCD sensor, there is also an MOS-type sensor as the imaging sensor. The MOS-type sensor is characterized by a low power consumption, a single power drive, etc., and used frequently for a small-size portable apparatus such as a portable telephone with a built-in camera. However, like the CCD, the MOS-type sensor faces the above-described problems.
- The main object of the present invention therefore is to provide an imaging sensor capable of the electronic enlargement zoom without a frame memory even under a condition where the ratio between the picked-up size and the output size (output size/picked-up size) is 1 or more, and to provide a driving method thereof.
- In order to achieve the aforementioned object, a signal processing circuit of the present invention is consisted of signal-processing an analog picture signal outputted from a solid-state imaging device that comprises: a pixel part arranged two-dimensionally; an electronic shutter shift register that supplies an electronic shutter shift pulse to a pixel part for resetting an electric charge of the pixel part; and a readout shift register that supplies a vertical readout shift pulse to the pixel part for reading out the electric charge of the pixel part in order, wherein the signal processing circuit comprises a drive unit, an A/D converter, a processing unit for picture signal, and a control unit, wherein:
- the drive unit supplies each of the shift pulses separately to the electronic shutter shift register and the readout shift register; the A/D converter converts the analog picture signal outputted from the solid-state imaging device to a digital picture signal; the processing unit for picture signal designates a control start position of the digital picture signal outputted from the A/D converter and performs interpolation processing thereon along a horizontal direction and a vertical direction; the control unit controls the drive unit and the processing unit for picture signal; the drive unit adjusts cycles of each of the shift pulses to control a vertical-line readout rate of the solid-state imaging device, and then intermittently reads out the analog picture signal from the solid-state imaging device; and the processing unit for picture signal performs vertical-line interpolation processing in accordance with the vertical-line readout rate to extend a part of picture area of the digital picture signal.
- With this configuration, it is possible to achieve the electronic enlargement zoom even without a frame memory under a condition where the output size to the picked-up size is one or more times.
- Further, a signal processing circuit of the present invention is the one to do signal-processing of an analog picture signal outputted from a solid-state imaging device that comprises: a pixel part arranged two-dimensionally; an electronic shutter shift register that supplies an electronic shutter shift pulse to a pixel part in order to reset an electric charge of the pixel part; and a readout shift register that supplies a vertical readout shift pulse to the pixel part to read out the electric charge of the pixel part in order. The signal processing unit comprises a drive unit, an A/D converter, a processing unit for picture signal, and a control unit, wherein: the drive unit supplies each of the shift pulses separately to the shift register for the electronic shutter and the read shift register; the A/D converter converts the analog picture signal outputted from the solid-state imaging device to a digital picture signal; the processing unit for picture signal designates a control start position of the digital picture signal outputted from the A/D converter, and performs interpolation processing thereon along a horizontal direction and a vertical direction; the control unit controls the drive unit and the processing unit for picture signal; the drive unit extends a horizontal blanking period of the solid-state imaging device to be longer than a valid period in one line of the analog picture signal; and the processing unit for picture signal performs vertical-line interpolation processing to extend a part of picture area of the digital picture signal.
- According to this construction, it is possible to achieve the electronic enlargement zoom even without a frame memory and, moreover, without performing high-rate transfer and intermittent readout by the solid-state imaging device under a condition where the output size to the picked-up size is one or more times.
- In the above-described construction, it is preferable that the drive unit controls the vertical-line readout rate of the solid-state imaging device in accordance with a zoom magnification, and the processing unit for picture signal adjusts the horizontal blanking period of the digital picture signal outputted from the processing unit for picture signal such that periodicity of a synchronizing signal of the digital picture signal outputted from the processing unit for picture signal becomes constant regardless of the zoom magnification.
- According to this, the synchronizing signal of the digital picture signal outputted from the processing unit for picture signal can be provided with a uniform periodicity regardless of the zoom magnifications and without intermittence. Therefore, the interface between the digital picture signal and the circuit or the device to be connected thereto can be simplified.
- The construction of the above signal processing circuit can be applied to a solid-state imaging device. In the above construction, the pixel part is preferable to be constituted with a MOS-type sensor consisted of a focal plane shutter system.
- The present invention enables the electronic enlargement zoom even without a frame memory under a condition where the output size to the picked-up size is one or more times.
- The present invention can be utilized in the solid-state imaging devices such as digital still cameras. Particularly, it can be applied to a portable telephone with a built-in camera, on which an optical zoom is hard to mount.
- Other objects of the present invention will become clear from the following description of the preferred embodiments and the appended claims. Those skilled in the art will appreciate that there are many other advantages of the present invention that have been mentioned in the specification by carrying out the present invention.
-
FIG. 1 is a block diagram for showing the structure of a solid-state imaging device according to the first to third embodiments of the present invention; -
FIG. 2 is a timing chart for showing action of the solid-state imaging device according to the first embodiment of the present invention; -
FIG. 3 is an illustration for describing the electronic enlargement zoom action of the solid-state imaging device according to the first embodiment of the present invention; -
FIG. 4 is a vertical timing chart for showing the action of the solid-state imaging device according to the first embodiment of the present invention; -
FIG. 5 is a horizontal timing chart for showing the action of the solid-state imaging device according to the first embodiment of the present invention; -
FIG. 6A is a illustration for describing the first action of interpolation performed by a processing unit for picture signal according to the first embodiment of the present invention; -
FIG. 6B is a illustration for describing the second action of interpolation performed by the processing unit for picture signal according to the first embodiment of the present invention; -
FIG. 7A is an illustration of a pixel structure in the state where a blanking period is extended in the solid-state imaging device according to the second embodiment of the present invention; -
FIG. 7B is an illustration for describing a synchronizing signal of the solid-state imaging device according to the second embodiment of the present invention; -
FIG. 8 is a timing chart where the external synchronizing signals are made constant in the solid-state imaging device according to the third embodiment of the present invention; -
FIG. 9A is an illustration of a first picture image of the electronic enlargement zoom of a conventional case where a frame memory is not used; -
FIG. 9B is an illustration of a second picture image of the electronic enlargement zoom of a conventional case where a frame memory is not used; -
FIG. 10A is an illustration of a first picture image of the electronic enlargement zoom of a conventional case where a frame memory is used; and -
FIG. 10B is an illustration of a second picture image of the electronic enlargement zoom of a conventional case where a frame memory is used. - In the followings, description is given to the embodiments of a solid-state imaging device and a signal processing circuit for a solid-state imaging device according to the present invention by referring to the accompanying drawings.
-
FIG. 1 is a block diagram for showing the structure of a solid-state imaging device according to a first embodiment of the present invention. The solid-state imaging device comprises a solid-state imaging device 10 and asignal processing circuit 20. Thesignal processing circuit 20 comprises acontrol unit 21, adrive unit 22, an A/D converter 23, and a processing unit forpicture signal 24. The solid-state imaging device 10 comprises: apixel part 11 arranged: two-dimensionally; an electronicshutter shift register 12 for transferring electronic shutter shift pulse Pd in order; a verticalreadout shift register 13 to transfer vertical readout shift pulse Pr for reading out an electric charge to thepixel part 11 in order; a horizontalreadout shift register 14 to transfer the electric charge read out from thepixel part 11 in order to the horizontal direction; and anoutput amplifier 15. - The
pixel part 11 is consisted of a random-accessible MOS-type sensor with a focal-plane shutter system. As shown inFIG. 2 , bothregisters - The solid-state imaging device takes a frame period consisted of successive electronic-shutter frame period F1 and readout frame period F2 as one cycle. In the electronic shutter frame period F1, the electronic shutter shift pulse Pd is supplied from the
drive unit 22 to theelectronic shutter register 12 and, in the readout frame period F2, the vertical readout shift register Pr is supplied from thedrive unit 22 to the verticalreadout shift register 13. Hereby, the processing unit forpicture signal 24 achieves the electronic enlargement zoom mechanism in the same frame period. - Next, there will be described the action of the solid-state imaging device according to the embodiment, which is constituted as described above. The
control unit 21 controls thedrive unit 22 and the processing unit forpicture signal 24 while synchronizing one another. Thedrive unit 22 generates the electronic shutter shift pulse Pd and supplies it to the electronicshutter shift register 12 in the electronic shutter frame period F1. A high-rate transfer pulse is contained in a part of the electronic-shutter shift pulse Pd. The electronicshutter shift register 12 resets the electric charge by supplying the electronic shutter shift pulse Pd to thepixel part 11. Thereby, the electric charges of the optical image of the subject are accumulated from immediately after the reset. - Then, the
drive unit 22 generates the readout shift pulse Pr and supplies it to the verticalreadout shift register 13 in the readout frame F2. As described above, a high-rate transfer pulse is contained in a part of the readout shift pulse Pr. Thereadout shift register 13 reads out the accumulated electric charge by supplying the readout shift pulse Pr to thepixel part 11. The electric charge read out from thepixel part 11 in the vertical direction is transferred in the horizontal direction by the horizontalreadout shift register 14, which is converted into a voltage signal by theoutput amplifier 15 and outputted to the A/D converter unit 23 of thesignal processing circuit 20 as an analog picture signal. The A/D converter unit 23 converts the inputted analog picture signal to a digital picture signal and outputs it to the processing unit forpicture signal 24. The processing unit forpicture signal 24 performs format conversion of the inputted digital picture signal as well as processing such as interpolation, and outputs the signal-processed digital picture signal and the synchronizing signal. The synchronizing signal is corresponded to the signal-processed digital picture signal. - In the solid-
state imaging device 10 having the structure described above, reading-out rate of the lines is controlled in the vertical direction. The processing unit forpicture signal 24 performs line interpolation in the vertical direction in accordance with the line reading-out rate in order to achieve the electronic enlargement zoom mechanism. -
FIG. 2 is a timing chart for showing the action of the solid-state imaging device having the structure described above. A period of “L” level in a vertical synchronizing signal VD is a period when picture-signal is valid, and that of an “H” level is a period when picture-signal is invalid (vertical blanking period). - The electric charge is reset as a unit of each line according to an electronic shutter start pulse Pds and the electronic shutter shift pulse Pd. The electronic shutter shift pulse Pd has a high-rate electronic shutter period T1 and an intermittent electronic shutter period T2 in the electronic shutter frame period F1. An electronic shutter period T3 may be under a high rate like the period T1 or may be under a normal rate. “Q” is an electric charge accumulation period.
- The electric charge is read out as a unit of each line according to a readout start pulse Prs and the vertical readout shift pulse Pr. The readout shift pulse Pr has a high-rate readout period T4 and an intermittent readout period T5 in the readout frame period F2. “R” is a readout period.
- In the followings, a method to achieve the electronic enlargement zoom in the embodiment will be described specifically by referring to
FIG. 3 -FIG. 6 .FIG. 3 shows image illustrations of picture configurations from inputting of the digital picture signal from the A/D converter 23 to the processing unit forpicture signal 24 until outputting. Reference numeral g1 is an image illustration of the picture configuration in the solid-state imaging device 10, g2 is an image illustration of the picture configuration when reading out is carried out intermittently in the vertical direction, and g3 is an image illustration of the picture configuration when pixel-interpolation is performed in the horizontal direction. - In the picture configuration g1 (j×k) containing a desired picture of m×n pixels in the solid-state imaging device 10 (m<j, n<k), the electric charge is transferred at a high rate until the readout start position a in the vertical direction of the j×n pixels in the high-rate readout period T4, while the electric charge is transferred at a slower rate than a normal rate between the start position a of the prescribed picture and the end position b. Then, the A/D-converted picture signal (referred to as a digital picture signal hereinafter) is sent out to the processing unit for
picture signal 24. After the end position b in the vertical direction, the electric charge is transferred again at a high rate or at a normal rate. - The processing unit for
picture signal 24 performs signal interpolation between the lines to the digital picture signal supplied from the solid-state imaging device 10 (it is read out intermittently in the vertical direction). The picture configuration g2 shows the picture image of the digital signal to which the signal interpolation is performed. Further, the processing unit forpicture signal 24 performs the other signal interpolation processing simultaneously with the above-described interpolation signal processing. In this other signal interpolation processing, a start position c of a desired picture is designated in the horizontal direction. Then, the area of m-pixels is extended in a region until reaching the area of j-pixels in the horizontal direction. The picture configuration g3 shows the picture image of the digital picture signal where interpolation processing are performed to both signals. By performing interpolation processing to both signals, the picture region of m×n is zoomed by electronic enlargement to the picture region of j×k. - The action mentioned above will be described in more detail by referring to
FIG. 4 andFIG. 5 . InFIG. 4 , the digital picture signal inputted to thesignal processing circuit 20 and the digital picture signal outputted from thesignal processing circuit 20 are shown by the vertical rate as a standard. In a period of one cycle of the input vertical synchronizing signal VD1, the digital picture signal S1 including in the n-lines from H1 to Hn being read out intermittently is inputted to the processing unit forpicture signal 24 under synchronizing with the input horizontal synchronizing signal HD1. The processing unit forpicture signal 24 performs interpolation processing on the inputted digital picture signal S1 including in the n-lines to generate and output a digital picture signal S2 including in the k-lines from h1 to hk. Reference numeral T7 is a delay amount in the vertical direction from the input of the picture signal S1 until the output of the picture signal S2. - In
FIG. 5 , the digital picture signal inputted to thesignal processing circuit 20 and the digital picture signal outputted from thesignal processing circuit 20 are shown by the horizontal rate as a standard. The digital picture signal S1 is inputted to the processing unit forpicture signal 24 under synchronizing with the input horizontal synchronizing signal HD1. The processing unit forpicture signal 24 performs signal interpolation to the region including m-pixels within the range between c and d to the area of j-pixels (m<j) to generate the digital signal S2. Reference numeral T8 is a delay amount in the horizontal direction. -
FIG. 6A andFIG. 6B show the interpolation processing performed in the processing unit forpicture signal 24. The interpolation processing is described herein by a cubic interpolation method that uses a cubic function.FIG. 6A shows one-dimensional image i1 in the horizontal direction or vertical direction. - Based on an interpolation expression (1),
Y′=F(Y2,Y3,Y4,Y5,K) (1)
data of one pixel is interpolated from four pixels. - In the expression, Y′ is the pixel data of the interpolation pixel, F is the interpolation function, Y2 is the pixel data of the interpolation start pixel, Y2-Y5 are pixel data of respective pixels, and K is the interpolation coefficient, respectively.
-
FIG. 6B shows two-dimensional image i2 of 4×4 pixels. First, the interpolation pixel data Y1′ can be obtained by substituting pixel data of four pixels in the vertical direction, Y11, Y21, Y31, Y41 to the interpolation expression (1). In the same manner, the interpolation pixel data Y2′, Y3′, and Y4′ can be obtained. Then, by substituting the generated interpolation pixel data Y1′, Y2′, Y3′, and Y4′ to the interpolation expression (1), the final picture data Y can be obtained. By performing such interpolation processing, the interpolation pixel data of one pixel is generated from the pixel data of 4×4 pixels. - In the followings, the interpolation processing according to the embodiment will be described specifically. For example, it is tried to achieve an electronic enlargement zoom of twice the size under the assumption that the pick-up size of the solid-
state imaging device 10 is 1,280 pixels×960 lines and the output picture size is 1,280 pixels×960 lines. In this case, the picture configuration g1 ofFIG. 3 has j=1,280 pixels, and k=960 lines. The desired picture composes of a=240th line, b=720th line, n=480 lines, c=320th pixel, d=960th pixel, and m=640 pixels. - The
control unit 21 sets thedrive unit 22 in the electronic shutter frame period F1 such that the electronic shutter shift pulses Pd of the high-rate electronic shutter period T1=240 lines and of the intermittent electronic shutter period T2=480 lines operate by the intermittent cycles of two lines. In general, intermittent cycle of N-lines means the blank of (1−(1/N))×100 lines in the digital picture signal including one-hundred lines. When N=2, there is a blank of 50 lines out of 100 lines. - Then, the
control unit 21 sets thedrive unit 22 in the readout frame period F2 such that the vertical readout shift pulses Pr of the high-rate readout period T4=240 lines and of the intermittent readout period T5=480 lines operate by the intermittent cycles of two lines. In the readout frame F2, the digital picture signal of 480 lines is inputted to the processing unit forpicture signal 24 from the solid-state imaging device 10. At this time, the digital picture signal is inputted under intermittent state of two lines to the processing unit forpicture signal 24. - The processing unit for
picture signal 24 generates twice the lines by interpolating between the lines of 480 lines one by one line under two-line intermittent cycle according to the control of thecontrol unit 21. Therefore, the processing unit forpicture signal 24 outputs the digital picture signal of k=960 lines in the vertical direction. - Furthermore, the processing unit for
picture signal 24 perform interpolation processing according to the control of thecontrol unit 21 in such a manner that the picture size along the horizontal direction is changed from an input size of m=640 to the output size of j=1,280. - According to the above, the electronic enlargement zoom of twice the size can be achieved. The interpolation processing has been described by referring to the cubic interpolation method using a cubic function, however, other interpolation processing such as a linear or quadratic interpolation method may be used as well.
- By the embodiment of the invention, it is possible to achieve the electronic enlargement zoom without using a frame memory even under the condition where the output ratio (output size/picked-up size) is 1 or more, by performing at a combination of the accumulation/readout control of the electric charge by the solid-
state imaging device 10 through thedrive unit 22 and the interpolation processing by the processing unit forpicture signal 24. - A second embodiment of the present invention achieves electronic enlargement zoom without performing the high-rate transfer and intermittent readout in the solid-
state imaging device 10. The embodiment therefore is characterized by that the blanking period of the horizontal synchronizing signal (referred to as a horizontal blanking period hereinafter) is extended to be more than the valid period of the picture signal by thedrive unit 22. The fundamental structure of the solid-state imaging device according to this embodiment is the same as that of the first embodiment shown inFIG. 1 . - In the embodiment, as shown in the picture configuration of
FIG. 7A , horizontal blanking period τ2 corresponding to “H” level of the horizontal synchronizing signal HD is extended to be more than picture signal valid period τ1. As a result, there appears an invalid signal area A2 in the periphery of the picture signal area A1. The horizontal line continues to the horizontal line of the next line, so that the horizontal blanking period becomes the period ˜2 of the invalid signal area A2, i.e. a period τ3+a period τ4. -
FIG. 7B is a horizontal timing chart of this embodiment. The horizontal synchronizing signal HD repeats the same cycle at all times. That is, the high-rate transfer and the intermittent readout like the case of the first embodiment become unnecessary. In a picture signal S3 of this embodiment, the horizontal blanking period ˜2 is more than the picture signal valid period τ1 (τ1<τ2). When collating the picture signal S3 of the embodiment with the picture signal S1 of the first embodiment, it can be seen that the second embodiment enables the same effect as that of performing intermittent readout by two-line cycle even though there is no high-rate transfer and intermittent readout performed by the solid-state imaging device 10. Therefore, the electronic enlargement zoom can be achieved without a frame memory. - In the embodiment, when the horizontal blanking period τ2 is extended to M-times or more (M≧1) of the picture signal valid period τ1, it gives the same effect as that of performing the intermittent readout by the cycle of (M+1) lines. In other words, it is possible to achieve the electronic enlargement zoom of M-times at the maximum.
- Furthermore, it is possible to achieve the electronic enlargement zoom of N×(M+1) times at the maximum by combining the configuration to intermittently read out the picture signal by N-line (the constitution of the first embodiment) and the configuration of the second embodiment. In that case, the N-line intermittent readout is performed on the picture signal inputted from the solid-
state imaging device 10, and the horizontal blanking period τ2 is extended to the length that is M-times the picture signal valid period τ1. Thereby, the signal output time becomes N×(M+1) times comparing to the signal input time. By utilizing this margin of time, it becomes possible to perform line interpolation without a memory frame. - For example, let us suppose the case where the solid-
state imaging device 10 is of 1,280 pixels×960 lines and the output picture size is 1,280 pixels and 960 lines. In the picture configuration g1 shown inFIG. 3 , it means to be j=1,280 pixels and k=960 lines. The desired picture size as a result of the zoom is set as one half in size of the desired picture of the first embodiment in the vertical and lateral sizes, respectively, i.e. in the size of n=240 lines and m=320 pixels. By performing the above-described electronic enlargement zoom of four-times to such desired picture, the picture enlarged to 1,280 pixels×960 lines can be obtained. - Considering the combination of the high-rate transfer and the intermittent readout, like the first embodiment, the
control unit 21 sets thedrive unit 22 such that the electronic shutter shift pulse Pd operates by the intermittent cycle of two-lines in the electronic shutter frame period F1. Then, thecontrol unit 21 sets thedrive unit 22 such that the vertical readout shift pulse Pr operates by the intermittent cycle of two-lines in the readout frame period F2. Furthermore, thecontrol unit 21 sets thedrive unit 22 such that the horizontal blanking period τ2 extends to one or more times the picture signal period τ1 which corresponds to 1,280 pixels. - In the readout frame period F2, the analog picture signal of 240 pixels is inputted under two-line intermittent state to the processing unit for
picture signal 24 from the solid-state imaging device 10. In this state, the horizontal blanking period τ2 is extended to the length of M=1 times the picture signal valid period τ1. Thus, there is delay period of 2×(1+1)=4 times in the signal output time compared to the signal input time. Therefore, interpolation of every three lines can be performed between the lines. Thecontrol unit 21 controls the processing unit forpicture signal 24 to perform interpolation every three-line between the 240 lines in four-line intermittent cycle to have the lines of four times finally, and the output in the vertical direction becomes k=960 lines. - In the meantime, the
control unit 21 controls the processing unit forpicture signal 24 to perform interpolation such that the output pixel interval in the horizontal direction becomes one fourth to give the output of 1,280 pixels. - As descried, the embodiment achieves the electronic enlargement zoom of four times by combining the two-line intermittent drive control and control of making the horizontal blanking period to one or more times the picture signal period.
- As described above, the embodiment enables the signal output time to have a margin of time compared to the signal input time by extending the horizontal blanking period τ2 to the length that is one or more times the picture signal valid period τ1. By performing the line interpolation within the margin of time, it is possible to achieve the electronic enlargement zoom without using a frame memory even under a condition where the output size to the picked-up size is one or more times. Moreover, it is not necessary to perform the high-rate transfer control and the intermittent readout control in the solid-state imaging device to achieve the electronic enlargement zoom. It is possible, however, to achieve the electronic enlargement zoom at much larger magnification in the embodiment by combining the high-rate transfer control and the intermittent readout control.
- A third embodiment of the present invention allows the synchronizing signal to have the constant cycle regardless of the magnifications (zoom magnifications) in the electronic enlargement zoom. The fundamental structure of the solid-state imaging device according to this embodiment is the same as that of the first embodiment shown in
FIG. 1 . - When the electronic enlargement zoom is achieved by the constitutions of the first and second embodiments without using a frame memory, the occurrence cycle of the line intermittence (referred to as a line intermittence cycle hereinafter) varies in accordance with the zoom magnification. In
FIG. 8 , reference numeral HD3 is a horizontal synchronizing signal of the picture signal inputted from the solid-state imaging device 10. A horizontal synchronizing signal H4 at the magnification of ¾ times has a periodicity of one valid line, one invalid line, and two valid lines as a unit, however, it becomes in “H”, “L”, “H”, and “H”, which has no uniform periodicity when it is seen as the line unit. As a result, there occurs a period where the picture signal is not outputted, thereby it gives difficulty to the interface between the output signal of the solid-state imaging device and the circuit or the device to which the output signal is inputted. - On the contrary, the third embodiment performs the vertical-line readout control of the solid-
state imaging device 10 and the interpolation processing of the processing unit forpicture signal 24 simultaneously in accordance with the enlargement magnification, and adjusts the length of the horizontal blanking period. Hereby, the synchronizing signal outputted from the processing unit forpicture signal 24 can be made constant without having intermittence, regardless of the zoom magnification of the electronic enlargement zoom. - For example, when reduction of ¾ magnification is carried out in the solid-
state imaging device 10 with the horizontal cycle of 1,000 pixels, the electric charge having no periodicity in terms of the pixel unit is read out under a intermittent state from thepixel part 11. Specifically, the electric charge is read out from thepixel part 11 by repeating the order of 1,000 valid pixels, 1,000 invalid pixels, and 1,000×2 valid pixels. - As shown in
FIG. 8 , the horizontal blanking period of the horizontal synchronizing signal HD4 outputted from the processing unit forpicture signal 24 at this time is separated into τ4 and (τ4×2+1,000 pixels), thus becoming unstable. This instability, i.e. the fluctuation of the horizontal blanking period, differs in accordance with the zoom magnifications. In the embodiment, the output cycle of the digital picture signal (referred to as an output picture signal) outputted from the processing unit forpicture signal 24 is set as 4/3 times of the initial output cycle, i.e. 1,000× 4/3=1,333 pixels, thereby, 1,333 valid pixels are continued three times equally. As a result, the horizontal synchronizing signal HD5 becomes to have a uniform periodicity without having the intermittence as shown inFIG. 8 . - When the zoom magnification is changed, the intermittence cycle of the lines in the solid-state image senor 10 is altered. In the followings, explanation is given, as an example, to the case where the zoom magnification is changed from 4/3 to ⅘ reduction. In this case, the line intermittence cycle becomes (⅘)×( 4/3)≈1.06. As clear from the result of calculation, 1−( 1/1.06)≈0.06, the line intermittence cycle of 1.06 line means that about six lines among one-hundred lines becomes invalid lines. That is, when the zoom magnification is set as 4/3, after fixing the output cycle of the output picture signal (specifically, its horizontal synchronizing signal); calculating the relative magnification for changing the zoom magnification from 4/3 to ⅘; and setting the calculated relative magnification as the line intermittence cycle of the solid-
state imaging device 10, it becomes possible to make the output cycle of the output picture signal always constant regardless of the magnification. - In the followings, an expression is provided to show the relations between the action of the solid-
state imaging device 10, the action of the processing unit forpicture signal 24, and the horizontal blanking period. When the zoom magnification by the processing unit forpicture signal 24 is A/B, it is possible to supply periodicity to the output picture signal through multiplying the output cycle of the output picture signal by B/A. By setting the zoom magnification that can be processed to be 1 or less, the output cycle of the output picture signal becomes adjustable based on changes in the horizontal blanking period of the output picture signal. - Next, the zoom magnification is changed to be C/D. For making the output cycle of the output picture signal to be fixed in this case, the intermittence cycle of the lines outputted from the solid-
state imaging device 10 is set as (C/D)×(A/B), while keeping the output cycle of the output picture signal of B/A times. - According to the embodiment as described above, it is possible to supply a uniform periodicity without intermittence to the synchronizing signal of the output picture signal regardless of the zoom magnifications, through simultaneously performing the vertical-line readout control of the solid-state imaging device and the interpolation control of the processing unit for picture signal, and adjusting the length of the horizontal blanking period of the output picture signal. As a result, interface between the output picture signal and the circuit or the device to be connected thereto becomes easy, thereby allowing simplification of the interface structure.
- The present invention has been described in detail by referring to the most preferred embodiments. However, various combinations and modifications of the components are possible without departing from the sprit and the broad scope of the appended claims.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/468,387 US7812875B2 (en) | 2005-04-27 | 2009-05-19 | Solid-state imaging device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005129405A JP2006311051A (en) | 2005-04-27 | 2005-04-27 | Signal processing circuit for solid-state imaging element, and solid-state imaging device |
JP2005-129405 | 2005-04-27 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/468,387 Division US7812875B2 (en) | 2005-04-27 | 2009-05-19 | Solid-state imaging device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060244853A1 true US20060244853A1 (en) | 2006-11-02 |
Family
ID=37195804
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/409,209 Abandoned US20060244853A1 (en) | 2005-04-27 | 2006-04-24 | Solid-state imaging device |
US12/468,387 Active US7812875B2 (en) | 2005-04-27 | 2009-05-19 | Solid-state imaging device |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/468,387 Active US7812875B2 (en) | 2005-04-27 | 2009-05-19 | Solid-state imaging device |
Country Status (3)
Country | Link |
---|---|
US (2) | US20060244853A1 (en) |
JP (1) | JP2006311051A (en) |
CN (1) | CN100534127C (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090016634A1 (en) * | 2007-07-09 | 2009-01-15 | Analog Devices, Inc. | Half pixel interpolator for video motion estimation accelerator |
US20160021324A1 (en) * | 2013-04-26 | 2016-01-21 | Fujifilm Corporation | Imaging device |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5063372B2 (en) * | 2008-01-07 | 2012-10-31 | キヤノン株式会社 | Image processing apparatus, control method, and program |
JP5111140B2 (en) * | 2008-02-06 | 2012-12-26 | キヤノン株式会社 | Solid-state imaging device driving method, solid-state imaging device, and imaging system |
KR101608347B1 (en) | 2009-11-02 | 2016-04-01 | 삼성전자주식회사 | Apparatus and method for processing digital image signal |
US9257467B2 (en) | 2009-12-16 | 2016-02-09 | Samsung Electronics Co., Ltd. | Image sensor modules, methods of manufacturing the same, and image processing systems including the image sensor modules |
JP2012049597A (en) * | 2010-08-24 | 2012-03-08 | Nikon Corp | Imaging apparatus |
JP6034703B2 (en) * | 2013-01-21 | 2016-11-30 | サターン ライセンシング エルエルシーSaturn Licensing LLC | Conversion circuit, image processing apparatus, and conversion method |
JP6515455B2 (en) * | 2014-07-22 | 2019-05-22 | セイコーエプソン株式会社 | Imaging device and imaging display device |
CN108111727A (en) * | 2017-12-25 | 2018-06-01 | 信利光电股份有限公司 | A kind of imaging sensor and camera module |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6507365B1 (en) * | 1998-11-30 | 2003-01-14 | Kabushiki Kaisha Toshiba | Solid-state imaging device |
US6999120B1 (en) * | 1999-10-07 | 2006-02-14 | Kabushiki Kaisha Toshiba | CMOS imaging device for amplifying and fetching signal charge |
US20070098386A1 (en) * | 2004-10-29 | 2007-05-03 | Sony Corporation | Imaging method and imaging apparatus |
US7355643B2 (en) * | 2003-09-12 | 2008-04-08 | Renesas Technology Corp. | Image pickup device |
US7388607B2 (en) * | 2003-03-18 | 2008-06-17 | Ricoh Company, Ltd. | Digital still camera |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS63245073A (en) * | 1987-03-31 | 1988-10-12 | Canon Inc | Image pickup device |
JPS63268378A (en) * | 1987-04-27 | 1988-11-07 | Hitachi Ltd | Solid-state image pickup device |
JPH0946600A (en) * | 1995-08-02 | 1997-02-14 | Canon Inc | Image pickup device |
JP4378804B2 (en) * | 1999-09-10 | 2009-12-09 | ソニー株式会社 | Imaging device |
JP2004064334A (en) * | 2002-07-26 | 2004-02-26 | Mitsubishi Electric Corp | Image pick-up apparatus |
JP2004072278A (en) * | 2002-08-02 | 2004-03-04 | Canon Inc | Imaging apparatus and control method therefor |
US7773129B2 (en) | 2002-08-02 | 2010-08-10 | Canon Kabushiki Kaisha | Image pickup device, imaging apparatus containing the same, and control method thereof |
JP4208904B2 (en) * | 2006-07-03 | 2009-01-14 | キヤノン株式会社 | Imaging apparatus, control method therefor, and imaging system |
-
2005
- 2005-04-27 JP JP2005129405A patent/JP2006311051A/en active Pending
-
2006
- 2006-04-24 US US11/409,209 patent/US20060244853A1/en not_active Abandoned
- 2006-04-27 CN CNB2006100760984A patent/CN100534127C/en not_active Expired - Fee Related
-
2009
- 2009-05-19 US US12/468,387 patent/US7812875B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6507365B1 (en) * | 1998-11-30 | 2003-01-14 | Kabushiki Kaisha Toshiba | Solid-state imaging device |
US6999120B1 (en) * | 1999-10-07 | 2006-02-14 | Kabushiki Kaisha Toshiba | CMOS imaging device for amplifying and fetching signal charge |
US7388607B2 (en) * | 2003-03-18 | 2008-06-17 | Ricoh Company, Ltd. | Digital still camera |
US7355643B2 (en) * | 2003-09-12 | 2008-04-08 | Renesas Technology Corp. | Image pickup device |
US20070098386A1 (en) * | 2004-10-29 | 2007-05-03 | Sony Corporation | Imaging method and imaging apparatus |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090016634A1 (en) * | 2007-07-09 | 2009-01-15 | Analog Devices, Inc. | Half pixel interpolator for video motion estimation accelerator |
US8509567B2 (en) * | 2007-07-09 | 2013-08-13 | Analog Devices, Inc. | Half pixel interpolator for video motion estimation accelerator |
US20160021324A1 (en) * | 2013-04-26 | 2016-01-21 | Fujifilm Corporation | Imaging device |
US9635295B2 (en) * | 2013-04-26 | 2017-04-25 | Fujifilm Corporation | Imaging device |
Also Published As
Publication number | Publication date |
---|---|
US7812875B2 (en) | 2010-10-12 |
CN100534127C (en) | 2009-08-26 |
JP2006311051A (en) | 2006-11-09 |
US20090225197A1 (en) | 2009-09-10 |
CN1856002A (en) | 2006-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7812875B2 (en) | Solid-state imaging device | |
US6947082B2 (en) | Image-taking apparatus and image-taking method | |
US20080043123A1 (en) | Imaging device | |
JP4789767B2 (en) | Imaging apparatus and control method thereof | |
JP5314736B2 (en) | Display device | |
JPH01280977A (en) | Method and apparatus for displaying slave picture of television system | |
US8964068B2 (en) | Image sensing apparatus, control method thereof, and storage medium | |
US6473120B2 (en) | Image pickup apparatus for applying predetermined signal processing in conjunction with an image shifting mechanism | |
EP1460837B1 (en) | Digital still camera | |
JP2001045364A (en) | Digital camera and operation control method therefor | |
JPH10276361A (en) | Image pickup device and method, image pickup system, image information service device and method, image data processing unit and method, and transmission medium | |
US7839435B2 (en) | Image sensing apparatus and image sensing method | |
JP4933205B2 (en) | Imaging device, solid-state imaging device used therefor, and image generation method | |
JPH06292052A (en) | Still picture image pickup device | |
JP2005217955A (en) | Imaging device, its control method, program, and storage medium | |
JP2006325276A (en) | Imaging apparatus | |
JP2006129193A (en) | Image pickup device | |
JP2008028608A (en) | Solid-state imaging device | |
JP4569342B2 (en) | Imaging device | |
JP2006074440A (en) | Imaging apparatus | |
JP2001136436A (en) | Image pickup device and its control method | |
JP5147416B2 (en) | Imaging device | |
JPH11187306A (en) | Image pickup device | |
JPH04358480A (en) | Drive method for solid-state image pickup element | |
JP2005051373A (en) | Imaging apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAHASHI, KENJI;SASAKI, YOSHIMITSU;NAKASHIMA, TOSHIYUKI;REEL/FRAME:018086/0952 Effective date: 20060330 |
|
AS | Assignment |
Owner name: PANASONIC CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021897/0671 Effective date: 20081001 Owner name: PANASONIC CORPORATION,JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021897/0671 Effective date: 20081001 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |