CA2153149A1 - Video imaging system and method using a single interline progressive scanning sensor and sequential color object illumination - Google Patents
Video imaging system and method using a single interline progressive scanning sensor and sequential color object illuminationInfo
- Publication number
- CA2153149A1 CA2153149A1 CA002153149A CA2153149A CA2153149A1 CA 2153149 A1 CA2153149 A1 CA 2153149A1 CA 002153149 A CA002153149 A CA 002153149A CA 2153149 A CA2153149 A CA 2153149A CA 2153149 A1 CA2153149 A1 CA 2153149A1
- Authority
- CA
- Canada
- Prior art keywords
- video data
- signal
- video
- red
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/211—Image signal generators using stereoscopic image cameras using a single 2D image sensor using temporal multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/257—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/218—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
Abstract
A sequential video imaging system uses a video sensor (15) having interline architecture whereby image data is moved from sensor elements to adjacent interlined storage elements. The object being viewed is sequentially illuminated with colored light sources (11-13) to produce luminance and chrominance video signals. Binning of image data corresponding to low level color signals is carried out in the sensor (15). A digital signal processor (35) includes data buffering and averaging circuits whereby the camera head and base unit can be operated asynchronously.
Description
WO 95/15061 ~ 1 ~ 3 1 4 9 PCr/US94/13475 -- DESCRIPTION
VIDEO IMAGING SYSTEM AND ME~HOD USING A SINGLE
INTERLINE PROGRESSIVE SCANNING
SENSOR AND SEQlJENrlAL COLOR OBJECI ILLUMINATION
TECHNICAL FIELD
The present invention relates to an improved system and method used for processing color images from a sequentially illllmin~tPd object to form high resolution color video signals suitable for use in viewing the object on a video monitor.
BACKGROUND ART
It will be appl~iated by those skilled in the art that the use of charge coupleddevices (CCD) as sensors in video im~ing systems has become quite popular, as, for e-~mple, where small size and low power consumption is desired. In the processing of color video images, it is p-GfG.led for a number of reasons that a single CCD sensor be used.
There are three basic types of solid state devices that are usable as sequentialvideo sensors. Full frame CCD sensors employ an array of integrating CCD deviceswhich act as photo sensitive capacitors. The images are projected onto the parallel array which acts as the image plane. The device partitions the scene information into discrete sensor elements defined by the number of pixels. The charge that accumulates in each pixel during the integration period, .~pl~senting rows of scene information, is shifted in parallel fashion along rows and columns (parallel register) of the photo sensitive CCD's to an output serial register. The image data is then shifted in serial fashion ~o a signal sensing output amplifier during the data readout cycle. This process repeats until all rows are transferred off of the device. The output from the amplifier can then be used to re-construct the image. Because the parallel register of full frame CCD's is used both for scene detection and data readout, either a shutter or synchronized strobe illumination must be used to preserve integrity of the image.
Some full frame CCD sensors have, adjacent to the array of sensor elements, a separate but identical parallel array of non-photosensitive CCD elements for storage of image data during odd or even fields. Thus, readout of the storage CCD array can take place while the image CCD array is integrating the next image frarne. These SUBSTITUTE SHEET ~RHL ' 2~) wo gs~l506l ~ 1 5 3 1 g 11 PCI/US94/13475 "frame transfer" detectors do not require shutters or strobed illumin~tion However, pelrol-l-ance is co,l,plomised by the fact that frame transfer CCD sensors have half the number of vertical lines of resolution as the equivalent full frame device. Also, because integration is still occurring during the transfer of image data from the image array to the storage array, ''smP~ring~ of the re-constructed image can occur.
Tnt~rline CCD sensors use an array of photodiodes as integr~ting sensor ~l~m~ntc. Each sensor element is electrically connected to an ~ cent non-photosensitive or light-shielded CCD storage element, which are arranged in a line between each line of image sensor elements. After integration of a scene, the signal or charge collected in each sensor element or pixel is shifted all at once into the light chi~lrled parallel CCD array. Readout from this storage CCD array then can occurduring the next integration period, thus yielding continuous operation. Tnt~rline CCD
sensors are m~nl~f~ctllred in both interl~ced and l~roglessive scan formats. Tnt~rl~l e l sensor devices are used in conjunction with NTSC or PAL video formats. There is much more flexibility in the progressive scan devices as to integration and read out timing. Other advantages of the interline devices are that the photodiodes used as image sensor elem~ntC have a much higher sensitivity in the blue spectrum where illumin~tion LED's are less effici~-nt The advantage of a full frame or interline progressive scan CCD sensor is that they contain the complete complement of vertical lines. Therefore, higher resolution images with less "smear" can be obtained. The frame transfer and interline interl~ed sensors are sometimes called video devices because they are compatible with conventional NTSC or PAL video field timing and produce interlaced output of 4~0pseudo lines of resolution (every other line is te",pol~lly displaced by a field period).
The advantage of the frame transfer type is that integration can proceed as read out occurs. Full frarne devices give 480 total lines of true resolution but they must be shuttered or the light source strobed off during readout. Both interlaced and progressive scan interline devices, however, can be read during inlegl~lion since the storage CCD arrays are not photosensitive.
Prior art sequential illumination and processing methods are d~-ficient in either the level of resolution obtainable, in their need for a higher rate of sampling of data 2 1 ~ 3 1 4 9 ~ PCI-/US94/13475 from the sensor, or in their relative sensitivity. For example, in U.S Patent No.
4,253,447 is disclosed a sequential illumin~ti~n process which requires reading out of only half the field lines (collesl~onding to either the even or the odd fields), resulting in a 50% reduction in vertical resolution. The '447 patent also discloses a second method whereby the object is sequentially illumin~ted by all three primar,v colors during each of the odd and even field periods. Unfortunately, this method requires that the CCD data be read at three times the standard speed which is not always possible. In ~ition, this technique requires six field memories and for a given signal-to-noise ratio, it is less sensitive than the current invention by a factor of three.
Prior art light sources used in conjunction with a sequential color video camerainclude: sequentially lighting the object field with each primary color by rotating a three-color segmPnted filter in the path of a white light source; sequentially illllmin~ting the object with a plurality of solid state light emitting chips mounted in a single transparent package, as disclosed in U.S. Patent No. 4,074,306; or sequentially illllmin~ting the object with three white strobe lights with a different primary color filter in each of the strobe light paths, as shown in U.S. Patent No. 4,253,447. All of these methods are troublesome.
Applicant's co-pending U.S. Patent application serial number 905,278, filed June 26, 1992, the drawings and specification of which, as amended, are incorporated by this reference, describes a novel method of producing video images using a single sensor, sequential primary color illumination, and non-color specific RGB video data memories.
Two major problems are manifested in this prior art. The efficiencies of green and blue LED's are lower than the red LED's. The efficiency of red LED's are typically 4%, greens 0.4%, and blues 0.04%. The efficiency differences, green to red, can be solved by using multiple green LED's. However, the very low efficiency of the blue LED's make the use of an adequate number of blue LED's impractical. The prior art required that a high gain video amplifier be switched into the video signal during the blue portion of the illumin~tinn sequence to insure proper white balance. The high blue signal gain requirement causes circuit instability and limits the dynamic range of the camera.
WO 95/15061 2 1 ~ 3 1 4 9 PCI~/US94/13475 Traditional methods of col.lpæ.~c~ting for the low signal strengths have resulted in a reduced tell~ l or spatial resolution to the point where image quality is lm~ticf~,ctory. In addition, still images obtained from prior art video im~ging systems are blurred, owing to telll~l~l differences between the two field images and to color edge effects on moving objects.
DISCLOSURE OF THE INVENTION
The human eye perceives spatial and lel..poldl resolution, primarily through lllmin~nce rather than chro~ nce. The system of the present invention teaches a method of increasing the signal level and signal-to-noise ratio of, for example, the blue signal in a color sequential camera, by creating luminance and chlolllil-~nce signals from image data accumulated in a CCD sensor. The chroll inance signals are spatially and te~ lly col..plc~sed to yield higher signal and signal-to-noise ratios with very little res--lting loss in perceived resolution, either spatial or te~ olal. This is accompli ched by using an interline pr~gressi~e scan video detector device. A
l~...;n~llce signal is created by simultaneously illl-min~ting the object with red and green LED's for a half frame period which is alternated between full frame illl-l--;nAI;on periods of red and blue LED's. The red and blue signals strengths are increased by adding charge from adjacent pixels together within the sensor. This method results in lowering the gain requirement for the blue signal with little loss in perceived ~elllpol~l or spatial resolution since the luminance signal contains full temporal and spatial resolution. The number of pixels added together can be varied, according to one embodiment of the present invention, depen~ine on the blue signal strength. Still images extracted from the improved camera are also sharper. Additionally, the resulting output signal can be converted to either NTSC or PAL formats without the need for çh~nging sensors.
An object of the present invention, then, is to çlimin~te flicker in a simplified sequential color video system while maintaining good spatial and temporal resolution.
A further object of the present invention is to provide a simplified sequential color video im~ing system having improved signal strengths and signal-to-noise ratios while compen~ting for the lower efficiency of green and blue LED illu-llin~ion 21531~
sources.
Fig. 1 is a block diagram rel)r~senl~tion of the video camera head portion of the improved system of present invention.
Fig. 2 is a block diagram ~epl~se~lt~tion of the base unit of the improved system of the present invention.
Fig. 3 is timing diagram showing the timing relationship between and among activation of the red, green, and blue LED illulllinalion sources and readout of the video data integrated in the CCD detector.
Fig. 4 is a block diagram of one embodiment the base unit of one embodiment of the system Fig. 2 which uses synchronous field timing.
Fig. S is a table showing the timing relationship among the signals appearing at the various signal nodes of the embodiment of Fig. 4.
Fig. 6 is an block diagram illustration of a typical CCD sensor with inttqrlin~
arC~ cture.
BEST MODE FOR CARRYING OUT THE INVENTION
Referring now to Fig.'s 1 and 2, the general arrangement of the functional blocks of the improved sequential video camera system is shown. The camera head portion of Fig. 1 would, in the plefelIed emb~imPnt be part of an endoscopic camera used for viewing objects located within a body cavity. Accordingly, the ill~ in~tion source of the system, including red, green, and blue LED's 11, 12, and 13, wouldpreferably be located at or near the distal end of the endoscope, for purposes of directing colored light at the object to be viewed, in a sequential manner described below. LED driver 14 is operably connected to each LED 11, 12, 13, providing a controllable activation voltage and current in response to master timing signals generated by timer 31.
Light reflected from the object is focused on CCD sensor 15 having an interline frame transfer ar~ ecl~re as in Fig. 6, such as the Model CCB/M27 from Sony Co~ldLion of ~m~riÇ~. Sensor driver/timer 32 provides horizontal and vertical timing signals to sensor 15, also in response to timing signals from master timer 31. Serial video image data from sensor 15 is transferred to video amplifier 16 which has aswitchable gain feature, coupled with automatic gain control, to allow ~mplifier 16 to apply a different level of gain to each different color. Amplifier 16 also has a dark clamping feature and can also be provided with an analog-to-digital convertor when tr~ncmiccion of di~iti7~d rather than analog video data from the camera head is desired.
Re~lse the system and method of the present invention relies on the generation and use of chro."il-~nce ("C") and luminAnce ("Y") video signals, a ll-min~nce ID
circuit 23, also synchronized with master timer 31, is used to add an idçntifier signal to communicate to the camera base unit (Fig. 2) which signals in the sequence ofdigiti7P~ data received by the base unit is a Y signal. The video data, with lllmin~nce id~ontifier added, and further including synchronization and vertical drive timing signals, is then trAncmitt~l from the camera head of Fig. 1 to the base unit of Fig. 2 bytr~ncmitter 24. Preferably, wireless radio communications are used as the link between the camera head and base unit but any conventional hardwired or wireless remote link can be employed.
Looking at Fig. 2, the transmitted analog (or digital) video data is accepted at , 21531~
receiver 25 where it is then sent con~;ullenlly to sync sep~r~tor 26 and digital signal processor (DSP) 35. Sync se~al~tor 26 strips the sync, vertical drive, and lllmin~nce ID signals from the video signal in a conventional manner well known to those skilled in the art. DSP 35 is a microprocessor having the further capability of p~lrol~ g analog to digital conversion, as well as burrelii~g (storing), averaging and filtering of digital data in real time, at video rates.
After and during proces~ing of the video image data, l--min~n~e ID signals, and vertical drive signals by DSP 35 as described below, a ligiti7P~d lu~in~nr,e (Y) signal is genP~t~ and provided to digital to analog convertor (DAC) 32. First and second chrominance (Cl and C2) signals are also generated and directed to DAC's 33 and 34.
The resulting analog outputs of DAC's 32, 33, and 34 are then usable in a conventional manner by a YC video monitor which, in conjunction with a sync signal from DAC 31, reconstructs and displays the image of the object being viewed.
The proce~ing method used in the present system builds on and is an improvement over the method described in U.S. Patent application serial number 905,278 which uses sequential illumination of the object by sep~ t~ly activated red, green, and blue LED's and non-color specific memories. The improved method uses sequential illumin~tion by Y (lumin~nce, red and green together), red, and blue light, with storage and averaging of the sensed and video data.
Conventionally, lulllinance is defined as:
Y = 0.3R + 0.6G + O.lB (1) where R,G, and B are the red, green, and blue light (RGB) video signal levels. For purposes of ma~imi7ing the blue signal strength in accordance with one objective of the system, Y herein is defined as:
Y = aR + bG (2) where a and b are somewhat arbitrary constants such that a + b = l. Rer~Use of spatial resolution considerations, the value of b should preferably be between 0.3 and wo 95/15061 2 1 a 3 1 ~ 9 PCT/US94/~3475 0.7. The choice of values within this range is based somewhat on subjective pelcel~ions of the colles~onding image quality. Otherwise the values of b (and hence a) are sPlP~ted based on thermal considerations. The lack of effi~iency of green LED's would suggest lower values for b provided the resl~lting image quality is adequate.
With a = b = 0.5 a high quality image is readily obtainable, for example.
The first and second chrominance signals are defined by:
Cl = Y - R (3) C2 = Y - B (4) Referring to the timing diagram in Fig. 3, the sequence of illumin~tion and readout events in the system are illustrated. The sequence begins when LED driver 14, responding to signals from master timer 31, activates red and green LED's 11 and 12 together, in accGl~lance with equation (2), for one-half frame period (first and second lines of Fig. 3). Thus, in accor~al-ce with equation (2), red LED's 11 and greenLED's 12 will be activated for equal periods, with the drive signals applied by driver 14 controlled such that the total light output from red LED's 11 and green LED's 12 will be equal during the illumination period. Of course, if constants a and b ofe~uation (2) are chosen to have different values, the drive signals from driver 14 applied to red and green LED's 11 and 12 will have to be adjusted so that the e~ ive light outputs during the illumination period reflect the ratio of the a and b constants.
Preferably, one full frame period has a duration of 1/30 second. During this first one-half frame illnmin~tion period, the combined red and green light reflected from the object being viewed is focused on CCD sensor 15 where it is integrated by the photosensitive CCD image array. Then red LED's 11 are turned on alone for a fullfrarne period and, in response to master timer 31 and CCD driver 32, the integrated lu~h~nce Y data integ-~ted during the first Y illumination period is shifted to the light ~hiPl~d (or non-photosensitive) parallel CCD readout array. Thus, during this red illu~ ation period, the luminance signal Y is read out from sensor 15 and provided wo 95115061 2 1 5 ~ 1 4 9 PCI`/US94/13475 to video amplifier 16.
A second Y (red plus green) illumination period follows. At the beginning of this second Y illumin~ion period, the red reflected light data which was inlegldted in the photosensitive CCD image array of sensor 15 is shifted to the CCD readout array and provided to video amplifier 16. Next, blue LED's 12 are activated by master timer 31 and driver 14 for a full frame period while the second Y signal is shifted to the CCD
readout array and read out to amplifier 16. Next, Y is again illumin~t~A for one-half frame period while the blue signal is shifted and read out. During the blue signal readout, a timing signal from master timer 31 and CCD driver 32 causes video amplifier 16 to increase its gain by a pre-programmed amount to compensate for the lower blue signal level.
The ratio of the duration of the Y luminance signal illumination periods to the duration the red and blue (chl~ linance) signal illumin~tion periods can be varied, depen-iing on the readout time required or prefell~d for the red and blue signals.
During the periods of red and blue signal readout, modified timing signals are sent by master timer 31 to CCD driver 32 so that at least two vertical lines of data from the image array of sensor 15 are s~mmed into the sensor's parallel (horizontal) register while at least two horizontal sensor elements (pixels) are s~mmed onto the output. This "binning" technique has the effect of summing at least a 2 x 2 matrix of pixels (image sensor elements), resulting in an average signal skength increase of a factor of four for both the red and blue signals. The red and blue signal levels can, if needed, beincreased by a factor of nine by binning 3 x 3 pixel matrices, or by a factor of n2, for a matrix of n x n. The signal-to-noise ratio will increase by a factor of two for 2 x 2 binning and by a factor of three for 3 x 3 binning.
As shown on Fig. 1, blue signal strength data can be fed to CCD driver 32 to select a 2 x 2, 3 x 3 (or higher) binning matrix to increase the blue signal level.
The sequential Y, red, and blue signals are then tr~n~mitted to the base unit as shown in Fig. 2, either by wire or wireless means, in either digital or analog format. The sync, vertical drive, and the Y ID signals are stripped and the signals are supplied to DSP 35. DSP 35 includes conventional processing means for averaging the Y signalover the chosen n x n pixel matrix so that the Y signal temporally matches the binned red and blue signals. DSP 35 further produces the first and second chrominance signals as per equations (3) and (4) above and outputs these lligiti7~d signals to DAC's 32, 33, and 34, to form analog YC signals which can be displayed on a YC monitor. DSP 35can also produce RGB, NTSC, or PAL format outputs.
It should be noted that it is not n~cess~ry for the frame rate of the camera head to match the timing of NTSC or PAL formats. DSP 35 cont~in~ sufficiçnt data buffersand timing circuits, well known to those skilled in the art, such that slower frame rates can be used in the camera head to further increase the signal strengths by using longer integration times. For example, if the camera head frame rate needed to be lowered by ten percent to synchroniæ it to either NTSC or PAL timing, DSP 35 would be programmed to insert a repeat frame in the video data stream every tenth frame.
Looking now at Fig. 4, further det ul of a pr~felled embodiment of the system, along with signal nodes D0, Dl, D2, and D3 corresponding to Fig. 5, is shown. The embodiment of Fig.'s 4 and 5, while implemPnting the basic method of the improved lS camera system, also uses features of the novel method of applicant's co-pending U.S.
Patent Application Serial No. 905,278. In this embodiment of the improved camerasystem, the camera head (Fig. 2) and base units must be operated synchronously.
T umin~nce ID and vertical drive signals, stripped from the video data received from the camera head, are sent from sync separator 36 to switch driver 41. The output of switch driver 41 is used to control the operation of data storage switch 45, which in accordance with the timing scheme of Fig. 5, alternately connects the video data input node D0 from receiver 25 to either Y signal memory 42, first chrominance signal (Cl) memory 43, or to second chrominance signal (C2) memory 44. Y memory 42 is a storage device or shift register capable of storing a full frame of data. First and second ch,o,l~ ance memories 43 and 44 should have a one-quarter frame capacity for 2 x 2 binning. The 2 x 2 averaging functions are carried out in averaging circuit 46, with subtraction as needed for equations (3) and (4) above implemented in s~-mming circuits 47 and 48.
The table of Fig. 5 illustrates the sequence of illumination periods, readout periods, and delays of the chrominance and luminance signals, at each of a sequence one-half frame times, T.
wo 95115061 2 1 5 3 1 lj 9 PCIIUS94/13475 Images with depth perception can be produced by the improved camera system by s~itchillg a synchronized shutter from a left optical zone in the endoscope to the right zone in each complete sequence Y-Red-Y-Blue.
Thus, although there have been described particular embotlim~o,nt~ of the present S invention of an improved sequential LED video camera system, it is not intP,nde~ that such references be construed as limitations upon the scope of this invention except as set forth in the following claims.
VIDEO IMAGING SYSTEM AND ME~HOD USING A SINGLE
INTERLINE PROGRESSIVE SCANNING
SENSOR AND SEQlJENrlAL COLOR OBJECI ILLUMINATION
TECHNICAL FIELD
The present invention relates to an improved system and method used for processing color images from a sequentially illllmin~tPd object to form high resolution color video signals suitable for use in viewing the object on a video monitor.
BACKGROUND ART
It will be appl~iated by those skilled in the art that the use of charge coupleddevices (CCD) as sensors in video im~ing systems has become quite popular, as, for e-~mple, where small size and low power consumption is desired. In the processing of color video images, it is p-GfG.led for a number of reasons that a single CCD sensor be used.
There are three basic types of solid state devices that are usable as sequentialvideo sensors. Full frame CCD sensors employ an array of integrating CCD deviceswhich act as photo sensitive capacitors. The images are projected onto the parallel array which acts as the image plane. The device partitions the scene information into discrete sensor elements defined by the number of pixels. The charge that accumulates in each pixel during the integration period, .~pl~senting rows of scene information, is shifted in parallel fashion along rows and columns (parallel register) of the photo sensitive CCD's to an output serial register. The image data is then shifted in serial fashion ~o a signal sensing output amplifier during the data readout cycle. This process repeats until all rows are transferred off of the device. The output from the amplifier can then be used to re-construct the image. Because the parallel register of full frame CCD's is used both for scene detection and data readout, either a shutter or synchronized strobe illumination must be used to preserve integrity of the image.
Some full frame CCD sensors have, adjacent to the array of sensor elements, a separate but identical parallel array of non-photosensitive CCD elements for storage of image data during odd or even fields. Thus, readout of the storage CCD array can take place while the image CCD array is integrating the next image frarne. These SUBSTITUTE SHEET ~RHL ' 2~) wo gs~l506l ~ 1 5 3 1 g 11 PCI/US94/13475 "frame transfer" detectors do not require shutters or strobed illumin~tion However, pelrol-l-ance is co,l,plomised by the fact that frame transfer CCD sensors have half the number of vertical lines of resolution as the equivalent full frame device. Also, because integration is still occurring during the transfer of image data from the image array to the storage array, ''smP~ring~ of the re-constructed image can occur.
Tnt~rline CCD sensors use an array of photodiodes as integr~ting sensor ~l~m~ntc. Each sensor element is electrically connected to an ~ cent non-photosensitive or light-shielded CCD storage element, which are arranged in a line between each line of image sensor elements. After integration of a scene, the signal or charge collected in each sensor element or pixel is shifted all at once into the light chi~lrled parallel CCD array. Readout from this storage CCD array then can occurduring the next integration period, thus yielding continuous operation. Tnt~rline CCD
sensors are m~nl~f~ctllred in both interl~ced and l~roglessive scan formats. Tnt~rl~l e l sensor devices are used in conjunction with NTSC or PAL video formats. There is much more flexibility in the progressive scan devices as to integration and read out timing. Other advantages of the interline devices are that the photodiodes used as image sensor elem~ntC have a much higher sensitivity in the blue spectrum where illumin~tion LED's are less effici~-nt The advantage of a full frame or interline progressive scan CCD sensor is that they contain the complete complement of vertical lines. Therefore, higher resolution images with less "smear" can be obtained. The frame transfer and interline interl~ed sensors are sometimes called video devices because they are compatible with conventional NTSC or PAL video field timing and produce interlaced output of 4~0pseudo lines of resolution (every other line is te",pol~lly displaced by a field period).
The advantage of the frame transfer type is that integration can proceed as read out occurs. Full frarne devices give 480 total lines of true resolution but they must be shuttered or the light source strobed off during readout. Both interlaced and progressive scan interline devices, however, can be read during inlegl~lion since the storage CCD arrays are not photosensitive.
Prior art sequential illumination and processing methods are d~-ficient in either the level of resolution obtainable, in their need for a higher rate of sampling of data 2 1 ~ 3 1 4 9 ~ PCI-/US94/13475 from the sensor, or in their relative sensitivity. For example, in U.S Patent No.
4,253,447 is disclosed a sequential illumin~ti~n process which requires reading out of only half the field lines (collesl~onding to either the even or the odd fields), resulting in a 50% reduction in vertical resolution. The '447 patent also discloses a second method whereby the object is sequentially illumin~ted by all three primar,v colors during each of the odd and even field periods. Unfortunately, this method requires that the CCD data be read at three times the standard speed which is not always possible. In ~ition, this technique requires six field memories and for a given signal-to-noise ratio, it is less sensitive than the current invention by a factor of three.
Prior art light sources used in conjunction with a sequential color video camerainclude: sequentially lighting the object field with each primary color by rotating a three-color segmPnted filter in the path of a white light source; sequentially illllmin~ting the object with a plurality of solid state light emitting chips mounted in a single transparent package, as disclosed in U.S. Patent No. 4,074,306; or sequentially illllmin~ting the object with three white strobe lights with a different primary color filter in each of the strobe light paths, as shown in U.S. Patent No. 4,253,447. All of these methods are troublesome.
Applicant's co-pending U.S. Patent application serial number 905,278, filed June 26, 1992, the drawings and specification of which, as amended, are incorporated by this reference, describes a novel method of producing video images using a single sensor, sequential primary color illumination, and non-color specific RGB video data memories.
Two major problems are manifested in this prior art. The efficiencies of green and blue LED's are lower than the red LED's. The efficiency of red LED's are typically 4%, greens 0.4%, and blues 0.04%. The efficiency differences, green to red, can be solved by using multiple green LED's. However, the very low efficiency of the blue LED's make the use of an adequate number of blue LED's impractical. The prior art required that a high gain video amplifier be switched into the video signal during the blue portion of the illumin~tinn sequence to insure proper white balance. The high blue signal gain requirement causes circuit instability and limits the dynamic range of the camera.
WO 95/15061 2 1 ~ 3 1 4 9 PCI~/US94/13475 Traditional methods of col.lpæ.~c~ting for the low signal strengths have resulted in a reduced tell~ l or spatial resolution to the point where image quality is lm~ticf~,ctory. In addition, still images obtained from prior art video im~ging systems are blurred, owing to telll~l~l differences between the two field images and to color edge effects on moving objects.
DISCLOSURE OF THE INVENTION
The human eye perceives spatial and lel..poldl resolution, primarily through lllmin~nce rather than chro~ nce. The system of the present invention teaches a method of increasing the signal level and signal-to-noise ratio of, for example, the blue signal in a color sequential camera, by creating luminance and chlolllil-~nce signals from image data accumulated in a CCD sensor. The chroll inance signals are spatially and te~ lly col..plc~sed to yield higher signal and signal-to-noise ratios with very little res--lting loss in perceived resolution, either spatial or te~ olal. This is accompli ched by using an interline pr~gressi~e scan video detector device. A
l~...;n~llce signal is created by simultaneously illl-min~ting the object with red and green LED's for a half frame period which is alternated between full frame illl-l--;nAI;on periods of red and blue LED's. The red and blue signals strengths are increased by adding charge from adjacent pixels together within the sensor. This method results in lowering the gain requirement for the blue signal with little loss in perceived ~elllpol~l or spatial resolution since the luminance signal contains full temporal and spatial resolution. The number of pixels added together can be varied, according to one embodiment of the present invention, depen~ine on the blue signal strength. Still images extracted from the improved camera are also sharper. Additionally, the resulting output signal can be converted to either NTSC or PAL formats without the need for çh~nging sensors.
An object of the present invention, then, is to çlimin~te flicker in a simplified sequential color video system while maintaining good spatial and temporal resolution.
A further object of the present invention is to provide a simplified sequential color video im~ing system having improved signal strengths and signal-to-noise ratios while compen~ting for the lower efficiency of green and blue LED illu-llin~ion 21531~
sources.
Fig. 1 is a block diagram rel)r~senl~tion of the video camera head portion of the improved system of present invention.
Fig. 2 is a block diagram ~epl~se~lt~tion of the base unit of the improved system of the present invention.
Fig. 3 is timing diagram showing the timing relationship between and among activation of the red, green, and blue LED illulllinalion sources and readout of the video data integrated in the CCD detector.
Fig. 4 is a block diagram of one embodiment the base unit of one embodiment of the system Fig. 2 which uses synchronous field timing.
Fig. S is a table showing the timing relationship among the signals appearing at the various signal nodes of the embodiment of Fig. 4.
Fig. 6 is an block diagram illustration of a typical CCD sensor with inttqrlin~
arC~ cture.
BEST MODE FOR CARRYING OUT THE INVENTION
Referring now to Fig.'s 1 and 2, the general arrangement of the functional blocks of the improved sequential video camera system is shown. The camera head portion of Fig. 1 would, in the plefelIed emb~imPnt be part of an endoscopic camera used for viewing objects located within a body cavity. Accordingly, the ill~ in~tion source of the system, including red, green, and blue LED's 11, 12, and 13, wouldpreferably be located at or near the distal end of the endoscope, for purposes of directing colored light at the object to be viewed, in a sequential manner described below. LED driver 14 is operably connected to each LED 11, 12, 13, providing a controllable activation voltage and current in response to master timing signals generated by timer 31.
Light reflected from the object is focused on CCD sensor 15 having an interline frame transfer ar~ ecl~re as in Fig. 6, such as the Model CCB/M27 from Sony Co~ldLion of ~m~riÇ~. Sensor driver/timer 32 provides horizontal and vertical timing signals to sensor 15, also in response to timing signals from master timer 31. Serial video image data from sensor 15 is transferred to video amplifier 16 which has aswitchable gain feature, coupled with automatic gain control, to allow ~mplifier 16 to apply a different level of gain to each different color. Amplifier 16 also has a dark clamping feature and can also be provided with an analog-to-digital convertor when tr~ncmiccion of di~iti7~d rather than analog video data from the camera head is desired.
Re~lse the system and method of the present invention relies on the generation and use of chro."il-~nce ("C") and luminAnce ("Y") video signals, a ll-min~nce ID
circuit 23, also synchronized with master timer 31, is used to add an idçntifier signal to communicate to the camera base unit (Fig. 2) which signals in the sequence ofdigiti7P~ data received by the base unit is a Y signal. The video data, with lllmin~nce id~ontifier added, and further including synchronization and vertical drive timing signals, is then trAncmitt~l from the camera head of Fig. 1 to the base unit of Fig. 2 bytr~ncmitter 24. Preferably, wireless radio communications are used as the link between the camera head and base unit but any conventional hardwired or wireless remote link can be employed.
Looking at Fig. 2, the transmitted analog (or digital) video data is accepted at , 21531~
receiver 25 where it is then sent con~;ullenlly to sync sep~r~tor 26 and digital signal processor (DSP) 35. Sync se~al~tor 26 strips the sync, vertical drive, and lllmin~nce ID signals from the video signal in a conventional manner well known to those skilled in the art. DSP 35 is a microprocessor having the further capability of p~lrol~ g analog to digital conversion, as well as burrelii~g (storing), averaging and filtering of digital data in real time, at video rates.
After and during proces~ing of the video image data, l--min~n~e ID signals, and vertical drive signals by DSP 35 as described below, a ligiti7P~d lu~in~nr,e (Y) signal is genP~t~ and provided to digital to analog convertor (DAC) 32. First and second chrominance (Cl and C2) signals are also generated and directed to DAC's 33 and 34.
The resulting analog outputs of DAC's 32, 33, and 34 are then usable in a conventional manner by a YC video monitor which, in conjunction with a sync signal from DAC 31, reconstructs and displays the image of the object being viewed.
The proce~ing method used in the present system builds on and is an improvement over the method described in U.S. Patent application serial number 905,278 which uses sequential illumination of the object by sep~ t~ly activated red, green, and blue LED's and non-color specific memories. The improved method uses sequential illumin~tion by Y (lumin~nce, red and green together), red, and blue light, with storage and averaging of the sensed and video data.
Conventionally, lulllinance is defined as:
Y = 0.3R + 0.6G + O.lB (1) where R,G, and B are the red, green, and blue light (RGB) video signal levels. For purposes of ma~imi7ing the blue signal strength in accordance with one objective of the system, Y herein is defined as:
Y = aR + bG (2) where a and b are somewhat arbitrary constants such that a + b = l. Rer~Use of spatial resolution considerations, the value of b should preferably be between 0.3 and wo 95/15061 2 1 a 3 1 ~ 9 PCT/US94/~3475 0.7. The choice of values within this range is based somewhat on subjective pelcel~ions of the colles~onding image quality. Otherwise the values of b (and hence a) are sPlP~ted based on thermal considerations. The lack of effi~iency of green LED's would suggest lower values for b provided the resl~lting image quality is adequate.
With a = b = 0.5 a high quality image is readily obtainable, for example.
The first and second chrominance signals are defined by:
Cl = Y - R (3) C2 = Y - B (4) Referring to the timing diagram in Fig. 3, the sequence of illumin~tion and readout events in the system are illustrated. The sequence begins when LED driver 14, responding to signals from master timer 31, activates red and green LED's 11 and 12 together, in accGl~lance with equation (2), for one-half frame period (first and second lines of Fig. 3). Thus, in accor~al-ce with equation (2), red LED's 11 and greenLED's 12 will be activated for equal periods, with the drive signals applied by driver 14 controlled such that the total light output from red LED's 11 and green LED's 12 will be equal during the illumination period. Of course, if constants a and b ofe~uation (2) are chosen to have different values, the drive signals from driver 14 applied to red and green LED's 11 and 12 will have to be adjusted so that the e~ ive light outputs during the illumination period reflect the ratio of the a and b constants.
Preferably, one full frame period has a duration of 1/30 second. During this first one-half frame illnmin~tion period, the combined red and green light reflected from the object being viewed is focused on CCD sensor 15 where it is integrated by the photosensitive CCD image array. Then red LED's 11 are turned on alone for a fullfrarne period and, in response to master timer 31 and CCD driver 32, the integrated lu~h~nce Y data integ-~ted during the first Y illumination period is shifted to the light ~hiPl~d (or non-photosensitive) parallel CCD readout array. Thus, during this red illu~ ation period, the luminance signal Y is read out from sensor 15 and provided wo 95115061 2 1 5 ~ 1 4 9 PCI`/US94/13475 to video amplifier 16.
A second Y (red plus green) illumination period follows. At the beginning of this second Y illumin~ion period, the red reflected light data which was inlegldted in the photosensitive CCD image array of sensor 15 is shifted to the CCD readout array and provided to video amplifier 16. Next, blue LED's 12 are activated by master timer 31 and driver 14 for a full frame period while the second Y signal is shifted to the CCD
readout array and read out to amplifier 16. Next, Y is again illumin~t~A for one-half frame period while the blue signal is shifted and read out. During the blue signal readout, a timing signal from master timer 31 and CCD driver 32 causes video amplifier 16 to increase its gain by a pre-programmed amount to compensate for the lower blue signal level.
The ratio of the duration of the Y luminance signal illumination periods to the duration the red and blue (chl~ linance) signal illumin~tion periods can be varied, depen-iing on the readout time required or prefell~d for the red and blue signals.
During the periods of red and blue signal readout, modified timing signals are sent by master timer 31 to CCD driver 32 so that at least two vertical lines of data from the image array of sensor 15 are s~mmed into the sensor's parallel (horizontal) register while at least two horizontal sensor elements (pixels) are s~mmed onto the output. This "binning" technique has the effect of summing at least a 2 x 2 matrix of pixels (image sensor elements), resulting in an average signal skength increase of a factor of four for both the red and blue signals. The red and blue signal levels can, if needed, beincreased by a factor of nine by binning 3 x 3 pixel matrices, or by a factor of n2, for a matrix of n x n. The signal-to-noise ratio will increase by a factor of two for 2 x 2 binning and by a factor of three for 3 x 3 binning.
As shown on Fig. 1, blue signal strength data can be fed to CCD driver 32 to select a 2 x 2, 3 x 3 (or higher) binning matrix to increase the blue signal level.
The sequential Y, red, and blue signals are then tr~n~mitted to the base unit as shown in Fig. 2, either by wire or wireless means, in either digital or analog format. The sync, vertical drive, and the Y ID signals are stripped and the signals are supplied to DSP 35. DSP 35 includes conventional processing means for averaging the Y signalover the chosen n x n pixel matrix so that the Y signal temporally matches the binned red and blue signals. DSP 35 further produces the first and second chrominance signals as per equations (3) and (4) above and outputs these lligiti7~d signals to DAC's 32, 33, and 34, to form analog YC signals which can be displayed on a YC monitor. DSP 35can also produce RGB, NTSC, or PAL format outputs.
It should be noted that it is not n~cess~ry for the frame rate of the camera head to match the timing of NTSC or PAL formats. DSP 35 cont~in~ sufficiçnt data buffersand timing circuits, well known to those skilled in the art, such that slower frame rates can be used in the camera head to further increase the signal strengths by using longer integration times. For example, if the camera head frame rate needed to be lowered by ten percent to synchroniæ it to either NTSC or PAL timing, DSP 35 would be programmed to insert a repeat frame in the video data stream every tenth frame.
Looking now at Fig. 4, further det ul of a pr~felled embodiment of the system, along with signal nodes D0, Dl, D2, and D3 corresponding to Fig. 5, is shown. The embodiment of Fig.'s 4 and 5, while implemPnting the basic method of the improved lS camera system, also uses features of the novel method of applicant's co-pending U.S.
Patent Application Serial No. 905,278. In this embodiment of the improved camerasystem, the camera head (Fig. 2) and base units must be operated synchronously.
T umin~nce ID and vertical drive signals, stripped from the video data received from the camera head, are sent from sync separator 36 to switch driver 41. The output of switch driver 41 is used to control the operation of data storage switch 45, which in accordance with the timing scheme of Fig. 5, alternately connects the video data input node D0 from receiver 25 to either Y signal memory 42, first chrominance signal (Cl) memory 43, or to second chrominance signal (C2) memory 44. Y memory 42 is a storage device or shift register capable of storing a full frame of data. First and second ch,o,l~ ance memories 43 and 44 should have a one-quarter frame capacity for 2 x 2 binning. The 2 x 2 averaging functions are carried out in averaging circuit 46, with subtraction as needed for equations (3) and (4) above implemented in s~-mming circuits 47 and 48.
The table of Fig. 5 illustrates the sequence of illumination periods, readout periods, and delays of the chrominance and luminance signals, at each of a sequence one-half frame times, T.
wo 95115061 2 1 5 3 1 lj 9 PCIIUS94/13475 Images with depth perception can be produced by the improved camera system by s~itchillg a synchronized shutter from a left optical zone in the endoscope to the right zone in each complete sequence Y-Red-Y-Blue.
Thus, although there have been described particular embotlim~o,nt~ of the present S invention of an improved sequential LED video camera system, it is not intP,nde~ that such references be construed as limitations upon the scope of this invention except as set forth in the following claims.
Claims (10)
1. A sequential color video imaging system comprising:
a. an interline video sensor having an image array of horizontal and vertical photosensitive elements and a corresponding storage array of video data storage elements;
b. object illumination means including separately operable red, green, and blue light sources;
c. timing and driver means to activate said red, green, and blue light sources in a pre-determined repeating sequence of red and green, red, and blue light illumination periods;
d. sensor driver means to shift video data responsive to the level of light reflected from the object during each of said illumination periods from said image array to said storage array; and e. processor means to read and transform video data shifted to said storage array into a corresponding sequence of chrominance and luminance video signals representing the object viewed by said camera system.
a. an interline video sensor having an image array of horizontal and vertical photosensitive elements and a corresponding storage array of video data storage elements;
b. object illumination means including separately operable red, green, and blue light sources;
c. timing and driver means to activate said red, green, and blue light sources in a pre-determined repeating sequence of red and green, red, and blue light illumination periods;
d. sensor driver means to shift video data responsive to the level of light reflected from the object during each of said illumination periods from said image array to said storage array; and e. processor means to read and transform video data shifted to said storage array into a corresponding sequence of chrominance and luminance video signals representing the object viewed by said camera system.
2. The system of Claim 1 further comprising video amplifier means to amplify said video data from said storage array before processing in said processor, said amplifier means having a signal gain which is switchable in response to an external signal whereby differing amplifier gains can be applied to video data corresponding to different illumination colors.
3. The system of Claim 2, said video sensor further comprising a parallel video data shift register, a serial video data shift register, and means responsive to binning signals from said sensor driver means whereby at least two vertical lines of video data corresponding to a single illumination color from said storage array are summed in said parallel shift register, and whereby at least two horizontal lines of video data are summed from said parallel shift register into said serial shift register, and said sensor driver means including means to generate said binning signals whereby a matrix of at least a 2 x 2 array of said photosensitive sensor elements having red or blue video data are summed in said sensor before further processing.
4. The system of either of Claims 2 or 3, said processor means comprising video data averaging and video data subtraction circuits.
5. The system of either of Claims 2, 3, or 4 further comprising means for wireless transmission of said video data to a remote location.
6. An improved method of processing video data in a sequential color video camera comprising the steps of:
a. illuminating an object to be viewed with repeating sequences of red and green, red, red and green, and blue light during corresponding luminance signal, first chrominance signal, luminance signal, and second chrominance signal illuminationperiods;
b. sensing and integrating in a video data sensor array the level of light reflected by the object during each of said luminance and chrominance signal illumination periods;
c. shifting at the end of each of said luminance and first and second chrominance signal illumination periods, video data from said sensor array into a video data storage array;
d. reading said video data stored in said data storage sensor array into a videoamplifier;
e. processing said video data stored in said storage array corresponding to saidluminance signal illumination periods to produce a luminance video signal; and f. processing said video data stored in said storage array corresponding to saidfirst and second chrominance illumination periods to produce first and second chrominance video signals.
a. illuminating an object to be viewed with repeating sequences of red and green, red, red and green, and blue light during corresponding luminance signal, first chrominance signal, luminance signal, and second chrominance signal illuminationperiods;
b. sensing and integrating in a video data sensor array the level of light reflected by the object during each of said luminance and chrominance signal illumination periods;
c. shifting at the end of each of said luminance and first and second chrominance signal illumination periods, video data from said sensor array into a video data storage array;
d. reading said video data stored in said data storage sensor array into a videoamplifier;
e. processing said video data stored in said storage array corresponding to saidluminance signal illumination periods to produce a luminance video signal; and f. processing said video data stored in said storage array corresponding to saidfirst and second chrominance illumination periods to produce first and second chrominance video signals.
7. The method of Claim 6 further wherein said luminance signal illumination periods have a duration of a fraction of the duration of said first and second chrominance signal illumination periods, said fraction determined by the readout time of said first and second chrominance signals.
8. The method of Claim 7 further comprising the step of binning in said sensor at least two vertical lines of video data integrated in said image array during said first and second chrominance signal illumination periods, producing binned red and blue video signals whereby video image signal strengths corresponding to red and blue light illumination of the object are increased.
9. The method of Claim 8 wherein said processing of said video data from said storage array includes averaging of said luminance signals whereby said averagedluminance signal temporally matches said binned red and blue video signals, and wherein said first chrominance video signal is obtained by subtracting said binned red signal from said averaged luminance signal and said second chrominance signal isobtained by subtracting said binned blue signal from said averaged luminance signal.
10. The method of Claim 6 further comprising the step of switching in a predetermined sequential manner said video data stored in said storage array among Y
storage and first and second chrominance memory units.
storage and first and second chrominance memory units.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/156,377 US5394187A (en) | 1992-06-26 | 1993-11-22 | Video imaging systems and method using a single interline progressive scanning sensor and sequential color object illumination |
US08/156,377 | 1993-11-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2153149A1 true CA2153149A1 (en) | 1995-06-01 |
Family
ID=22559318
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002153149A Abandoned CA2153149A1 (en) | 1993-11-22 | 1994-11-21 | Video imaging system and method using a single interline progressive scanning sensor and sequential color object illumination |
Country Status (8)
Country | Link |
---|---|
US (1) | US5394187A (en) |
EP (1) | EP0682844B1 (en) |
JP (1) | JPH08506233A (en) |
AU (1) | AU691227B2 (en) |
CA (1) | CA2153149A1 (en) |
DE (1) | DE69419006T2 (en) |
ES (1) | ES2133713T3 (en) |
WO (1) | WO1995015061A1 (en) |
Families Citing this family (156)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5523786A (en) * | 1993-12-22 | 1996-06-04 | Eastman Kodak Company | Color sequential camera in which chrominance components are captured at a lower temporal rate than luminance components |
TW387560U (en) * | 1994-05-13 | 2000-04-11 | Prec Optics Coroporation | Viewing scope with image intensification |
US5668597A (en) * | 1994-12-30 | 1997-09-16 | Eastman Kodak Company | Electronic camera with rapid automatic focus of an image upon a progressive scan image sensor |
JPH09116818A (en) * | 1995-10-17 | 1997-05-02 | Purotetsuku Japan Kk | Image pickup circuit |
US6589162B2 (en) * | 2000-02-21 | 2003-07-08 | Pentax Corporation | Endoscope system and video camera for endoscope |
DE10056438A1 (en) * | 2000-11-14 | 2002-05-23 | Forschungszentrum Fuer Medizin | Endoscopic device system for medical applications, has supply unit integrated into probe, and has transmission unit for wireless transmission of image data to reception unit |
US10835307B2 (en) | 2001-06-12 | 2020-11-17 | Ethicon Llc | Modular battery powered handheld surgical instrument containing elongated multi-layered shaft |
JP4316170B2 (en) * | 2001-09-05 | 2009-08-19 | 富士フイルム株式会社 | Image data creation method and apparatus |
IL153510A0 (en) * | 2001-12-18 | 2003-07-06 | Given Imaging Ltd | Device, system and method for capturing in-vivo images with three-dimensional aspects |
DE10245715A1 (en) * | 2002-10-01 | 2004-04-15 | Philips Intellectual Property & Standards Gmbh | Method and device for generating partial images |
US20040210107A1 (en) * | 2003-03-31 | 2004-10-21 | Pentax Corporation | Endoscope system for fluorescent observation |
DE10336736B4 (en) * | 2003-08-11 | 2005-07-21 | Siemens Ag | Apparatus and method for capturing image information for creating a three-dimensional image |
US8182501B2 (en) | 2004-02-27 | 2012-05-22 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical shears and method for sealing a blood vessel using same |
MX2007004151A (en) | 2004-10-08 | 2007-09-11 | Johnson & Johnson | Ultrasonic surgical instrument. |
JP4273420B2 (en) * | 2004-12-06 | 2009-06-03 | ソニー株式会社 | Video signal processing apparatus and video signal transmission method |
US20070191713A1 (en) | 2005-10-14 | 2007-08-16 | Eichmann Stephen E | Ultrasonic device for cutting and coagulating |
US7621930B2 (en) | 2006-01-20 | 2009-11-24 | Ethicon Endo-Surgery, Inc. | Ultrasound medical instrument having a medical ultrasonic blade |
US20080161647A1 (en) * | 2006-12-27 | 2008-07-03 | Amit Pascal | Device and method for multiple illumination fields of an in-vivo imaging device |
US8142461B2 (en) | 2007-03-22 | 2012-03-27 | Ethicon Endo-Surgery, Inc. | Surgical instruments |
US8057498B2 (en) | 2007-11-30 | 2011-11-15 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instrument blades |
US8226675B2 (en) | 2007-03-22 | 2012-07-24 | Ethicon Endo-Surgery, Inc. | Surgical instruments |
US8911460B2 (en) | 2007-03-22 | 2014-12-16 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instruments |
US8882791B2 (en) | 2007-07-27 | 2014-11-11 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instruments |
US8523889B2 (en) | 2007-07-27 | 2013-09-03 | Ethicon Endo-Surgery, Inc. | Ultrasonic end effectors with increased active length |
US8808319B2 (en) | 2007-07-27 | 2014-08-19 | Ethicon Endo-Surgery, Inc. | Surgical instruments |
US8430898B2 (en) | 2007-07-31 | 2013-04-30 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instruments |
US9044261B2 (en) | 2007-07-31 | 2015-06-02 | Ethicon Endo-Surgery, Inc. | Temperature controlled ultrasonic surgical instruments |
US8512365B2 (en) | 2007-07-31 | 2013-08-20 | Ethicon Endo-Surgery, Inc. | Surgical instruments |
AU2008308606B2 (en) | 2007-10-05 | 2014-12-18 | Ethicon Endo-Surgery, Inc. | Ergonomic surgical instruments |
US10010339B2 (en) | 2007-11-30 | 2018-07-03 | Ethicon Llc | Ultrasonic surgical blades |
US8061014B2 (en) | 2007-12-03 | 2011-11-22 | Covidien Ag | Method of assembling a cordless hand-held ultrasonic cautery cutting device |
US8338726B2 (en) | 2009-08-26 | 2012-12-25 | Covidien Ag | Two-stage switch for cordless hand-held ultrasonic cautery cutting device |
US20090143800A1 (en) * | 2007-12-03 | 2009-06-04 | Derek Dee Deville | Cordless Hand-Held Ultrasonic Cautery Cutting Device |
US9107690B2 (en) | 2007-12-03 | 2015-08-18 | Covidien Ag | Battery-powered hand-held ultrasonic surgical cautery cutting device |
US8663262B2 (en) | 2007-12-03 | 2014-03-04 | Covidien Ag | Battery assembly for battery-powered surgical instruments |
US9017355B2 (en) | 2007-12-03 | 2015-04-28 | Covidien Ag | Battery-powered hand-held ultrasonic surgical cautery cutting device |
US9314261B2 (en) | 2007-12-03 | 2016-04-19 | Covidien Ag | Battery-powered hand-held ultrasonic surgical cautery cutting device |
US8425545B2 (en) | 2007-12-03 | 2013-04-23 | Covidien Ag | Cordless hand-held ultrasonic cautery cutting device and method |
US9089360B2 (en) | 2008-08-06 | 2015-07-28 | Ethicon Endo-Surgery, Inc. | Devices and techniques for cutting and coagulating tissue |
US9700339B2 (en) | 2009-05-20 | 2017-07-11 | Ethicon Endo-Surgery, Inc. | Coupling arrangements and methods for attaching tools to ultrasonic surgical instruments |
US8334635B2 (en) | 2009-06-24 | 2012-12-18 | Ethicon Endo-Surgery, Inc. | Transducer arrangements for ultrasonic surgical instruments |
US8663220B2 (en) | 2009-07-15 | 2014-03-04 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instruments |
USRE47996E1 (en) | 2009-10-09 | 2020-05-19 | Ethicon Llc | Surgical generator for ultrasonic and electrosurgical devices |
US8951248B2 (en) | 2009-10-09 | 2015-02-10 | Ethicon Endo-Surgery, Inc. | Surgical generator for ultrasonic and electrosurgical devices |
US10441345B2 (en) | 2009-10-09 | 2019-10-15 | Ethicon Llc | Surgical generator for ultrasonic and electrosurgical devices |
US9168054B2 (en) | 2009-10-09 | 2015-10-27 | Ethicon Endo-Surgery, Inc. | Surgical generator for ultrasonic and electrosurgical devices |
US11090104B2 (en) | 2009-10-09 | 2021-08-17 | Cilag Gmbh International | Surgical generator for ultrasonic and electrosurgical devices |
US8579928B2 (en) | 2010-02-11 | 2013-11-12 | Ethicon Endo-Surgery, Inc. | Outer sheath and blade arrangements for ultrasonic surgical instruments |
US8486096B2 (en) | 2010-02-11 | 2013-07-16 | Ethicon Endo-Surgery, Inc. | Dual purpose surgical instrument for cutting and coagulating tissue |
US8951272B2 (en) | 2010-02-11 | 2015-02-10 | Ethicon Endo-Surgery, Inc. | Seal arrangements for ultrasonically powered surgical instruments |
US8961547B2 (en) | 2010-02-11 | 2015-02-24 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instruments with moving cutting implement |
US8469981B2 (en) | 2010-02-11 | 2013-06-25 | Ethicon Endo-Surgery, Inc. | Rotatable cutting implement arrangements for ultrasonic surgical instruments |
US20110218400A1 (en) * | 2010-03-05 | 2011-09-08 | Tyco Healthcare Group Lp | Surgical instrument with integrated wireless camera |
GB2480498A (en) | 2010-05-21 | 2011-11-23 | Ethicon Endo Surgery Inc | Medical device comprising RF circuitry |
JP5283667B2 (en) * | 2010-07-07 | 2013-09-04 | パナソニック株式会社 | Image processing apparatus, image processing method, and program |
US8795327B2 (en) | 2010-07-22 | 2014-08-05 | Ethicon Endo-Surgery, Inc. | Electrosurgical instrument with separate closure and cutting members |
US9192431B2 (en) | 2010-07-23 | 2015-11-24 | Ethicon Endo-Surgery, Inc. | Electrosurgical cutting and sealing instrument |
US9259265B2 (en) | 2011-07-22 | 2016-02-16 | Ethicon Endo-Surgery, Llc | Surgical instruments for tensioning tissue |
EP2811932B1 (en) | 2012-02-10 | 2019-06-26 | Ethicon LLC | Robotically controlled surgical instrument |
US9724118B2 (en) | 2012-04-09 | 2017-08-08 | Ethicon Endo-Surgery, Llc | Techniques for cutting and coagulating tissue for ultrasonic surgical instruments |
US9439668B2 (en) | 2012-04-09 | 2016-09-13 | Ethicon Endo-Surgery, Llc | Switch arrangements for ultrasonic surgical instruments |
US9237921B2 (en) | 2012-04-09 | 2016-01-19 | Ethicon Endo-Surgery, Inc. | Devices and techniques for cutting and coagulating tissue |
US9241731B2 (en) | 2012-04-09 | 2016-01-26 | Ethicon Endo-Surgery, Inc. | Rotatable electrical connection for ultrasonic surgical instruments |
US9226766B2 (en) | 2012-04-09 | 2016-01-05 | Ethicon Endo-Surgery, Inc. | Serial communication protocol for medical device |
US20140005705A1 (en) | 2012-06-29 | 2014-01-02 | Ethicon Endo-Surgery, Inc. | Surgical instruments with articulating shafts |
US9226767B2 (en) | 2012-06-29 | 2016-01-05 | Ethicon Endo-Surgery, Inc. | Closed feedback control for electrosurgical device |
US9351754B2 (en) | 2012-06-29 | 2016-05-31 | Ethicon Endo-Surgery, Llc | Ultrasonic surgical instruments with distally positioned jaw assemblies |
US9326788B2 (en) | 2012-06-29 | 2016-05-03 | Ethicon Endo-Surgery, Llc | Lockout mechanism for use with robotic electrosurgical device |
US20140005702A1 (en) | 2012-06-29 | 2014-01-02 | Ethicon Endo-Surgery, Inc. | Ultrasonic surgical instruments with distally positioned transducers |
US9198714B2 (en) | 2012-06-29 | 2015-12-01 | Ethicon Endo-Surgery, Inc. | Haptic feedback devices for surgical robot |
US9408622B2 (en) | 2012-06-29 | 2016-08-09 | Ethicon Endo-Surgery, Llc | Surgical instruments with articulating shafts |
US9283045B2 (en) | 2012-06-29 | 2016-03-15 | Ethicon Endo-Surgery, Llc | Surgical instruments with fluid management system |
US9393037B2 (en) | 2012-06-29 | 2016-07-19 | Ethicon Endo-Surgery, Llc | Surgical instruments with articulating shafts |
US9820768B2 (en) | 2012-06-29 | 2017-11-21 | Ethicon Llc | Ultrasonic surgical instruments with control mechanisms |
US9492224B2 (en) | 2012-09-28 | 2016-11-15 | EthiconEndo-Surgery, LLC | Multi-function bi-polar forceps |
US10201365B2 (en) | 2012-10-22 | 2019-02-12 | Ethicon Llc | Surgeon feedback sensing and display methods |
US9095367B2 (en) | 2012-10-22 | 2015-08-04 | Ethicon Endo-Surgery, Inc. | Flexible harmonic waveguides/blades for surgical instruments |
US20140135804A1 (en) | 2012-11-15 | 2014-05-15 | Ethicon Endo-Surgery, Inc. | Ultrasonic and electrosurgical devices |
US10226273B2 (en) | 2013-03-14 | 2019-03-12 | Ethicon Llc | Mechanical fasteners for use with surgical energy devices |
US9241728B2 (en) | 2013-03-15 | 2016-01-26 | Ethicon Endo-Surgery, Inc. | Surgical instrument with multiple clamping mechanisms |
US9814514B2 (en) | 2013-09-13 | 2017-11-14 | Ethicon Llc | Electrosurgical (RF) medical instruments for cutting and coagulating tissue |
US9265926B2 (en) | 2013-11-08 | 2016-02-23 | Ethicon Endo-Surgery, Llc | Electrosurgical devices |
GB2521228A (en) | 2013-12-16 | 2015-06-17 | Ethicon Endo Surgery Inc | Medical device |
GB2521229A (en) | 2013-12-16 | 2015-06-17 | Ethicon Endo Surgery Inc | Medical device |
US9795436B2 (en) | 2014-01-07 | 2017-10-24 | Ethicon Llc | Harvesting energy from a surgical generator |
US9554854B2 (en) | 2014-03-18 | 2017-01-31 | Ethicon Endo-Surgery, Llc | Detecting short circuits in electrosurgical medical devices |
US10092310B2 (en) | 2014-03-27 | 2018-10-09 | Ethicon Llc | Electrosurgical devices |
US10463421B2 (en) | 2014-03-27 | 2019-11-05 | Ethicon Llc | Two stage trigger, clamp and cut bipolar vessel sealer |
US9737355B2 (en) | 2014-03-31 | 2017-08-22 | Ethicon Llc | Controlling impedance rise in electrosurgical medical devices |
US9913680B2 (en) | 2014-04-15 | 2018-03-13 | Ethicon Llc | Software algorithms for electrosurgical instruments |
US10285724B2 (en) | 2014-07-31 | 2019-05-14 | Ethicon Llc | Actuation mechanisms and load adjustment assemblies for surgical instruments |
US10639092B2 (en) | 2014-12-08 | 2020-05-05 | Ethicon Llc | Electrode configurations for surgical instruments |
US10245095B2 (en) | 2015-02-06 | 2019-04-02 | Ethicon Llc | Electrosurgical instrument with rotation and articulation mechanisms |
US10342602B2 (en) | 2015-03-17 | 2019-07-09 | Ethicon Llc | Managing tissue treatment |
US10321950B2 (en) | 2015-03-17 | 2019-06-18 | Ethicon Llc | Managing tissue treatment |
US10595929B2 (en) | 2015-03-24 | 2020-03-24 | Ethicon Llc | Surgical instruments with firing system overload protection mechanisms |
US10034684B2 (en) | 2015-06-15 | 2018-07-31 | Ethicon Llc | Apparatus and method for dissecting and coagulating tissue |
US11020140B2 (en) | 2015-06-17 | 2021-06-01 | Cilag Gmbh International | Ultrasonic surgical blade for use with ultrasonic surgical instruments |
US10034704B2 (en) | 2015-06-30 | 2018-07-31 | Ethicon Llc | Surgical instrument with user adaptable algorithms |
US11051873B2 (en) | 2015-06-30 | 2021-07-06 | Cilag Gmbh International | Surgical system with user adaptable techniques employing multiple energy modalities based on tissue parameters |
US10898256B2 (en) | 2015-06-30 | 2021-01-26 | Ethicon Llc | Surgical system with user adaptable techniques based on tissue impedance |
US10357303B2 (en) | 2015-06-30 | 2019-07-23 | Ethicon Llc | Translatable outer tube for sealing using shielded lap chole dissector |
US10765470B2 (en) | 2015-06-30 | 2020-09-08 | Ethicon Llc | Surgical system with user adaptable techniques employing simultaneous energy modalities based on tissue parameters |
US11129669B2 (en) | 2015-06-30 | 2021-09-28 | Cilag Gmbh International | Surgical system with user adaptable techniques based on tissue type |
US10154852B2 (en) | 2015-07-01 | 2018-12-18 | Ethicon Llc | Ultrasonic surgical blade with improved cutting and coagulation features |
US10687884B2 (en) | 2015-09-30 | 2020-06-23 | Ethicon Llc | Circuits for supplying isolated direct current (DC) voltage to surgical instruments |
US10595930B2 (en) | 2015-10-16 | 2020-03-24 | Ethicon Llc | Electrode wiping surgical device |
US10179022B2 (en) | 2015-12-30 | 2019-01-15 | Ethicon Llc | Jaw position impedance limiter for electrosurgical instrument |
US10575892B2 (en) | 2015-12-31 | 2020-03-03 | Ethicon Llc | Adapter for electrical surgical instruments |
US11129670B2 (en) | 2016-01-15 | 2021-09-28 | Cilag Gmbh International | Modular battery powered handheld surgical instrument with selective application of energy based on button displacement, intensity, or local tissue characterization |
US10716615B2 (en) | 2016-01-15 | 2020-07-21 | Ethicon Llc | Modular battery powered handheld surgical instrument with curved end effectors having asymmetric engagement between jaw and blade |
US11229471B2 (en) | 2016-01-15 | 2022-01-25 | Cilag Gmbh International | Modular battery powered handheld surgical instrument with selective application of energy based on tissue characterization |
US10251664B2 (en) | 2016-01-15 | 2019-04-09 | Ethicon Llc | Modular battery powered handheld surgical instrument with multi-function motor via shifting gear assembly |
US10555769B2 (en) | 2016-02-22 | 2020-02-11 | Ethicon Llc | Flexible circuits for electrosurgical instrument |
US10702329B2 (en) | 2016-04-29 | 2020-07-07 | Ethicon Llc | Jaw structure with distal post for electrosurgical instruments |
US10646269B2 (en) | 2016-04-29 | 2020-05-12 | Ethicon Llc | Non-linear jaw gap for electrosurgical instruments |
US10485607B2 (en) | 2016-04-29 | 2019-11-26 | Ethicon Llc | Jaw structure with distal closure for electrosurgical instruments |
US10456193B2 (en) | 2016-05-03 | 2019-10-29 | Ethicon Llc | Medical device with a bilateral jaw configuration for nerve stimulation |
US10368898B2 (en) | 2016-05-05 | 2019-08-06 | Covidien Lp | Ultrasonic surgical instrument |
US10245064B2 (en) | 2016-07-12 | 2019-04-02 | Ethicon Llc | Ultrasonic surgical instrument with piezoelectric central lumen transducer |
US10893883B2 (en) | 2016-07-13 | 2021-01-19 | Ethicon Llc | Ultrasonic assembly for use with ultrasonic surgical instruments |
US10842522B2 (en) | 2016-07-15 | 2020-11-24 | Ethicon Llc | Ultrasonic surgical instruments having offset blades |
US10376305B2 (en) | 2016-08-05 | 2019-08-13 | Ethicon Llc | Methods and systems for advanced harmonic energy |
US10285723B2 (en) | 2016-08-09 | 2019-05-14 | Ethicon Llc | Ultrasonic surgical blade with improved heel portion |
USD847990S1 (en) | 2016-08-16 | 2019-05-07 | Ethicon Llc | Surgical instrument |
US10779847B2 (en) | 2016-08-25 | 2020-09-22 | Ethicon Llc | Ultrasonic transducer to waveguide joining |
US10952759B2 (en) | 2016-08-25 | 2021-03-23 | Ethicon Llc | Tissue loading of a surgical instrument |
US10603064B2 (en) | 2016-11-28 | 2020-03-31 | Ethicon Llc | Ultrasonic transducer |
US11266430B2 (en) | 2016-11-29 | 2022-03-08 | Cilag Gmbh International | End effector control and calibration |
US10571435B2 (en) | 2017-06-08 | 2020-02-25 | Covidien Lp | Systems and methods for digital control of ultrasonic devices |
US10820920B2 (en) | 2017-07-05 | 2020-11-03 | Ethicon Llc | Reusable ultrasonic medical devices and methods of their use |
US11246617B2 (en) | 2018-01-29 | 2022-02-15 | Covidien Lp | Compact ultrasonic transducer and ultrasonic surgical instrument including the same |
US11246621B2 (en) | 2018-01-29 | 2022-02-15 | Covidien Lp | Ultrasonic transducers and ultrasonic surgical instruments including the same |
US11259832B2 (en) | 2018-01-29 | 2022-03-01 | Covidien Lp | Ultrasonic horn for an ultrasonic surgical instrument, ultrasonic surgical instrument including the same, and method of manufacturing an ultrasonic horn |
US11229449B2 (en) | 2018-02-05 | 2022-01-25 | Covidien Lp | Ultrasonic horn, ultrasonic transducer assembly, and ultrasonic surgical instrument including the same |
US10582944B2 (en) | 2018-02-23 | 2020-03-10 | Covidien Lp | Ultrasonic surgical instrument with torque assist feature |
US11478268B2 (en) | 2019-08-16 | 2022-10-25 | Covidien Lp | Jaw members for surgical instruments and surgical instruments incorporating the same |
US11666357B2 (en) | 2019-09-16 | 2023-06-06 | Covidien Lp | Enclosure for electronics of a surgical instrument |
US11911063B2 (en) | 2019-12-30 | 2024-02-27 | Cilag Gmbh International | Techniques for detecting ultrasonic blade to electrode contact and reducing power to ultrasonic blade |
US11779387B2 (en) | 2019-12-30 | 2023-10-10 | Cilag Gmbh International | Clamp arm jaw to minimize tissue sticking and improve tissue control |
US11944366B2 (en) | 2019-12-30 | 2024-04-02 | Cilag Gmbh International | Asymmetric segmented ultrasonic support pad for cooperative engagement with a movable RF electrode |
US11786294B2 (en) | 2019-12-30 | 2023-10-17 | Cilag Gmbh International | Control program for modular combination energy device |
US11779329B2 (en) | 2019-12-30 | 2023-10-10 | Cilag Gmbh International | Surgical instrument comprising a flex circuit including a sensor system |
US20210196349A1 (en) | 2019-12-30 | 2021-07-01 | Ethicon Llc | Electrosurgical instrument with flexible wiring assemblies |
US11937863B2 (en) | 2019-12-30 | 2024-03-26 | Cilag Gmbh International | Deflectable electrode with variable compression bias along the length of the deflectable electrode |
US11812957B2 (en) | 2019-12-30 | 2023-11-14 | Cilag Gmbh International | Surgical instrument comprising a signal interference resolution system |
US11950797B2 (en) | 2019-12-30 | 2024-04-09 | Cilag Gmbh International | Deflectable electrode with higher distal bias relative to proximal bias |
US11660089B2 (en) | 2019-12-30 | 2023-05-30 | Cilag Gmbh International | Surgical instrument comprising a sensing system |
US11937866B2 (en) | 2019-12-30 | 2024-03-26 | Cilag Gmbh International | Method for an electrosurgical procedure |
US11786291B2 (en) | 2019-12-30 | 2023-10-17 | Cilag Gmbh International | Deflectable support of RF energy electrode with respect to opposing ultrasonic blade |
US11452525B2 (en) | 2019-12-30 | 2022-09-27 | Cilag Gmbh International | Surgical instrument comprising an adjustment system |
US11684412B2 (en) | 2019-12-30 | 2023-06-27 | Cilag Gmbh International | Surgical instrument with rotatable and articulatable surgical end effector |
US20210196361A1 (en) | 2019-12-30 | 2021-07-01 | Ethicon Llc | Electrosurgical instrument with monopolar and bipolar energy capabilities |
US11696776B2 (en) | 2019-12-30 | 2023-07-11 | Cilag Gmbh International | Articulatable surgical instrument |
US20220117623A1 (en) | 2020-10-15 | 2022-04-21 | Covidien Lp | Ultrasonic surgical instrument |
US11717312B2 (en) | 2021-10-01 | 2023-08-08 | Covidien Lp | Surgical system including blade visualization markings |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4074306A (en) * | 1975-07-28 | 1978-02-14 | Olympus Optical Co., Ltd. | Endoscope utilizing color television and fiber optics techniques |
US4253447A (en) * | 1978-10-16 | 1981-03-03 | Welch Allyn, Inc. | Color endoscope with charge coupled device and television viewing |
US4261344A (en) * | 1979-09-24 | 1981-04-14 | Welch Allyn, Inc. | Color endoscope |
JPS63227293A (en) * | 1987-03-17 | 1988-09-21 | Olympus Optical Co Ltd | Face sequential color image pickup device |
US4862275A (en) * | 1988-10-27 | 1989-08-29 | Eastman Kodak Company | Readout of charge packets from area imager CCD using an inverter-chain shift register |
US4967264A (en) * | 1989-05-30 | 1990-10-30 | Eastman Kodak Company | Color sequential optical offset image sampling system |
US5258834A (en) * | 1991-02-13 | 1993-11-02 | Olympus Optical Co., Ltd. | Electronic endoscope for producing a color image by extracting a plurality of field picture images in one field period without changing a horizontal clock rate |
US5264925A (en) * | 1992-06-26 | 1993-11-23 | Life Surgery, Inc. | Single sensor video imaging system and method using sequential color object illumination |
-
1993
- 1993-11-22 US US08/156,377 patent/US5394187A/en not_active Expired - Lifetime
-
1994
- 1994-11-21 DE DE69419006T patent/DE69419006T2/en not_active Expired - Fee Related
- 1994-11-21 JP JP7515186A patent/JPH08506233A/en not_active Abandoned
- 1994-11-21 EP EP95902664A patent/EP0682844B1/en not_active Expired - Lifetime
- 1994-11-21 ES ES95902664T patent/ES2133713T3/en not_active Expired - Lifetime
- 1994-11-21 CA CA002153149A patent/CA2153149A1/en not_active Abandoned
- 1994-11-21 AU AU11850/95A patent/AU691227B2/en not_active Ceased
- 1994-11-21 WO PCT/US1994/013475 patent/WO1995015061A1/en active IP Right Grant
Also Published As
Publication number | Publication date |
---|---|
AU691227B2 (en) | 1998-05-14 |
US5394187A (en) | 1995-02-28 |
JPH08506233A (en) | 1996-07-02 |
ES2133713T3 (en) | 1999-09-16 |
WO1995015061A1 (en) | 1995-06-01 |
AU1185095A (en) | 1995-06-13 |
EP0682844B1 (en) | 1999-06-09 |
DE69419006D1 (en) | 1999-07-15 |
DE69419006T2 (en) | 2000-03-23 |
EP0682844A4 (en) | 1996-04-24 |
EP0682844A1 (en) | 1995-11-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2153149A1 (en) | Video imaging system and method using a single interline progressive scanning sensor and sequential color object illumination | |
US5408268A (en) | Video imaging system and method using a single full frame sensor and sequential color object illumination | |
EP0660616B1 (en) | Color sequential electronic camera | |
US4652909A (en) | Television camera and recording system for high definition television having imagers of different frame rate | |
US4989075A (en) | Solid-state image sensor device | |
US4670777A (en) | Color filter having cyan, yellow, green and magenta filter elements providing increased dynamic range for use with field integration mode solid state imaging device | |
US2724737A (en) | Electric color image formation and control | |
US4404585A (en) | Video sequential color system | |
US5654756A (en) | Image pick-up apparatus having color space converter and/or shield disc with slit | |
US6035077A (en) | Single-chip color CMOS image sensor with two or more line reading structure and high-sensitivity interlace color structure | |
CA1215169A (en) | Color television camera with two or more solid-state imaging devices arranged in phase difference fashion | |
US6809764B1 (en) | Solid-state electronic image sensing device with high subsampling efficiency and method of reading a video signal out of the same | |
US4860092A (en) | Color image signal processing circuit with white balance control and gain control | |
EP0792072B1 (en) | Method and apparatus for transmitting digital color signals | |
US6289139B1 (en) | Single chip color CMOS image sensor with two or more line reading structure | |
JP2000308076A (en) | Image pickup device | |
US5982850A (en) | Camera apparatus with detail enhancement processing | |
JP2000308075A (en) | Image pickup element and driving method of the same | |
JPH05504873A (en) | Videophone camera throughput compression method and videophone camera | |
Nishimura et al. | A RGB-gamma CCD camera with a novel color matrix | |
JP4133455B2 (en) | Television camera and pixel signal readout method | |
SU1149435A1 (en) | Light-to-signal converter for colour television camera | |
JPS6120192B2 (en) | ||
JPH1198515A (en) | Image pickup signal processing unit and image pickup device | |
JPH09327025A (en) | Image pickup device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
FZDE | Discontinued | ||
FZDE | Discontinued |
Effective date: 20041122 |