CA2206450A1 - Method and apparatus for image overlap processing - Google Patents
Method and apparatus for image overlap processingInfo
- Publication number
- CA2206450A1 CA2206450A1 CA002206450A CA2206450A CA2206450A1 CA 2206450 A1 CA2206450 A1 CA 2206450A1 CA 002206450 A CA002206450 A CA 002206450A CA 2206450 A CA2206450 A CA 2206450A CA 2206450 A1 CA2206450 A1 CA 2206450A1
- Authority
- CA
- Canada
- Prior art keywords
- fifo
- line
- processor
- pixels
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
- H04N1/19—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
- H04N1/191—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a one-dimensional array, or a combination of one-dimensional arrays, or a substantially one-dimensional array, e.g. an array of staggered elements
- H04N1/192—Simultaneously or substantially simultaneously scanning picture elements on one main scanning line
- H04N1/193—Simultaneously or substantially simultaneously scanning picture elements on one main scanning line using electrically scanned linear arrays, e.g. linear CCD arrays
Abstract
An overlap processor receives and temporarily stores a plurality of aligned scan lines. Each scan line is representative of a lane or zone of an image.
The processor sequentially reads the plurality of scan lines and then synchronously and selectively outputs the scan lines producing an output comprising one scan line representative of one lane or zone plus a predetermined amount of scan line data from an adjacent lane or zone or both adjacent lanes or zones.
The processor sequentially reads the plurality of scan lines and then synchronously and selectively outputs the scan lines producing an output comprising one scan line representative of one lane or zone plus a predetermined amount of scan line data from an adjacent lane or zone or both adjacent lanes or zones.
Description
WO 96/17'168 PCTICA9S/00671 MEIEIOD AND APPARATUS FOR IMAGE OVERL~P PROCESSING
Field of Invention This invention relates to a method and apparatus for image ~)vtilla~
processing. In particular, this invention relates to a novel method for proce~ine multiple ~ allls of data for spatial im~ging at the boundaries of the data without il~lru~lucing spatial errors.
~ach~ uL~d of In~ention Conlilluou~ high resolution surface inspection is one of the most demanding industrial vision applic~tion~. A typical high speed web inspection 10 applisation inspects a web which is 24 inches wide, with a web velocity of 400 inches per second (2000 feet/minute), pelroill,s 100% surface inspection and detects defects as small as 0.020 inches. A vision system that ;l,s~ecLs such a web requires a cross-web resolution of at least 2048 pixels and needs to continuously scan and process over 70 million pixels per second.
Line scan cameras used for surface inspection are based on a one rlimencional image sensor. In order to achieve su~icient image resolution, many applications require more than one line scan camera to be used .~imlllt~neously to inspect the same object.
In the early stages of processing the pixels, spatial image proces~ing 20 operations, such as morphology or convolution analysis, are widely undertaken.
Typically, one image is taken as input and one resultant image is produced as output.
There are three growing classes of image processing applications for which CO~ ional spatial image operations are inadequate. These applications are CA 022064~0 1997-0~-29 WO 96/17468 PCT/C~9S/00671 ones that use multiple line scan cameras, multiple output line scan cameras, and multiple output area scan cameras. Each lane or image will produce a separate but concurrent stream of video data. A problem exists when pelrollllin~ a spatial image processing operation on image data that has been divided into lanes or multiple 5 images.
The model which is used in spatial image processing is to consider an image which is com~lised of a two dimensional matrix of picture elements or pixels.
Each row of pixels in an image is called a scan line. For every input image pixel, a corlcs~onding output image pixel is produced by a computation that takes as its 10 input values, the input image pixel values from a predetermined region having a predetermined hol.~o-llal and vertical extent. The region that encloses the input image pixels for the spatial operation is called a "kernel".
When the center pixel of the spatial operator's kernel is well within the boundaries of a video lane, overlap proceccinE is not a concern. When the center 15 pixel is near an image boundary, pixel data from outside of the image boundary is not available for full spatial operation. In prior art systems, pixel data is either assumed or arbitrarily injected. If the image boundary is an edge of the field of view, the overlap processor must inject a fixed value (i.e. O's or 1's) into the portion of the kernel that is beyond the image boundary. The end result is that the output image 20 near a boundary is unreliable as a result of the introduced spatial errors at the boundaries.
For instance, if a blob is located near an edge of a video lane, the scan line camera will produce an image responsive to the blob. If a spatial image operation is applied to the ~lob using a series of 0's injected at the image boundary, the output image of the blob is reduced in size which may result in the blob being undetected. On the other hand, if a series of l's are injected at the image boundary and the spatial operation is applied, the blob is expanded which may result in an S unimportant blob being detected unnecess~rily. ~ither result is undesirable.
The same problem exists for cameras that deliver their video on multiple o~ uLs, such as multiple output line scan cameras and area cameras. If the image boundary is between adjacent fields of view, the overlap processor will still inject a fixed value into the portion of the kernel that is beyond the image boundary.
10 Since the pixel values for the portion beyond the image boundary is continuously ~~h~n~ein~ and unknown, injection of a fixed value introduces considerable error.
Srmn-nly of the Invention The disadvantages of the prior art may be o~ lcoll~e by providin~ an overlap processor which enables spatial operations to be yelrollned seamlessly across 15 adjacent images.
It is desirable to provide an overlap processor which borrows a~ o~liate pixel video data from adjacent images to produce regions of artificial overlap so that spatial operations can be ~t;lrorllled at the image boundaries without errors or discontinuilics.
It is desirable to provide an overlap ~loc~;,,or which receives and temporarily stores a plurality of aligned scan lines. Each scan line is ~ cscntative of a lane or zone of an image. The processor sequentially reads the plurality of scan lines and then synchronously and selectively oul~uls the scan lines producing an CA 022064~0 1997-0~-29 wo 96/17468 PCT/CA9S/00671 output CO~ g one scan line rc~lcsel~tative of one lane or zone plus a predetermine~ amount of data from a scan line of an adjacent lane or zone or both adjacent lanes or zones.
According to one aspect of the invention, there is provided an overlap 5 ~ocessor for generating an output stream of pixel data from a plurality of aligned input streams of pixel data le~lcsentative of a lane of an image of an object. The overlap processor co~ rises a plurality of FIFO line buffers, a multiplexer and a controller. Each FIFO line buffer receives, stores and reads out, respectively, one of the plurali~ of aligned input slleallls. The multiplexer is connected to each of the 10 plurality of ~IFO line buffers. The multiplexer has an output for out~ Lil-g the output stream. The controller is connected to each of the plurality of FIFO line buffers for sequentially reading out the plurality of aligned input streams. The controller is also connected to the multiplexer for switching the multiplexer between the plurality of FIFO line buffers. The controller switches the multiplexer for 15 oul~utling tlle output stream of pixel data re~.eselltative of one lane together with pixel data l~lcsentative of a boundary region of an adjacent lane nearest the lane.
Accol.lh~g to another aspect of the invention, there is provided a method of generating an output stream of pixel data from a plurality of aligned input streams of pixel data representative of a lane of an image of an object. The method 20 coln~lises the steps of sequentially reading the plurality of aiigned input streams of pixel data, and selectively switching between the plurality of input streams producing an output s~ream of pixel data which is le~lesentative of one lane together with pixel data le~lcsentative of a boundary region of an adjacent lane nearest the lane.
CA 022064~0 1997-0~-29 , Description of the Drawings In drawings which illustrate embodiments of the invention, Figure 1 is a schematic of the overlap processor of the present invention;
S Figure 2 is a schematic of a typical camera arrangement generating outputs for the overlap processor of Figure 1;
Figure 3 is a schematic of an input scan line image with an output following spatial image processing;
~ Figure 4 is a schematic of an input scan line image illustrating the edges of the image relative to a kernel;
Figure S is a schematic of three input scaIi line images in a side by side relation; and Figure 6 is a time phase diagram of the scan line pixel data through the overlap processor of Figure 1.
15 Description of the Invention The overlap processor 10 of the present invention is generally illustrated in Figure 1.
Overlap processor 10 generally comprises lead ~l~O line buffer 12, center FIFO line buffer 14 and trail FIFO line buffer 16. Each of the output side of the FIFO
20 line buffers, 12, 14 and 16, is electrically connPcte~l to zone multiplexer 18. Each of the FIFO line buffers 12, 14 and 16, respectively, has input taps 22, 24 and 26. Each FIFO
line buffers 12, 14 and 16 receives, temporarily stores and is responsive to an external signal and will read out stored data in a first in first out (FIFO) pattern.
N~)E~ S~FET
CA 022064~0 1997-0~-29 -Overlap p~occssor 10 also includes an overlap processor controller 28.
Controller 2~ has a line valid signal input 30 and a FIFO control output 32 which is electrically connected to each of the FIF() line buffers 12, 14 and 16. ~ -Overlap ~lc,cessor controller 28 has a multiplex control output 34 5 which is electrically connected to zone multiplexer 18 for effecting control of the output thereof.
Overlap processor 28 generally COlllpl ises a pixel counter 36, a detector 38, a detector 40 and a control logic 42. Pixel counter 36 is electrically connected to line valid signal input 30. Extending in parallel between pixel counter 36 and 10 control logic 42 are detectors 38 and 40.
The output side of control logic 42 is electrically connected to FIFO
control output 32 and multiplexer control output 34.
Zone multiplexer 18 also has a lead inject register 44 and a trail inject register 46. The output of zone multiplexer 18 is connected to the stitched video 15 output 48 which is in communication with a spacial co,~ ul~tional processor 50.
Referring to Figure 2, a typical web h,~e~Lion system is schematically illustrated. A continuous web 52 which is being inspected, travels in the direction of the arrow. Line scan cameras 54, 55 and 56 are mounted relative to the web 52 to inspect lanes 58, 59 and 60 respectively. Line scan camera 54 will generate a video 20 output 62, while line scan camera 55 will generate video output 63, while line scan camera 56 will generate video output 64. Although 3 line scan cameras have been illustrated, it is a~alent that the present invention may be used with any number of cameras or with a camera having any number of internal lanes or zones.
WO 96/17468 PCT/CA!~5/00671 Video oull,uls 62, 63 and 64 are electrically connected to lead input 22, center input 24 and trail input 26, respectively.
Referring now to Figure 3, spatial image proce~inE is schematically illustrated. The left hand side of Figure 3, illustrates an input image defined by 5 pixels (n,m). For every input image pixel (n,m) a co~ onding output pixel (n ~ ,m ~ ), is produced by a computation that takes as its input values, the input image pixel values from the region enclosed by n~a, m~b, where 2a~1 and 2b~1 are the llu~i~onLal and vertical extent o~ the region of spacial operation. The region that encloses the input image pixels for spatial operatiûn is called a "kernel". The kernel 10 66 can be arbitrarily shapecl and does not necec~rily have to be symmetrical,rectangular or filled. Examples of typical spatial processing include morphology and convolution analysis.
When the center pixel (n,m) of the spatial operator's kernel 66 is well within the boundaries of a video lane, UVella~ OCe ~ , iS not a concern. When the 15 center pixel (n,m) is near an image boundary as illustrated in Figure 4, pixel data from outside the image is not available.
Referring to Figure 5, an image of a web being inspected is divided into three lanes. When a boundary is between two adjacent images from two adjacent camera ou~ s or two adjacent cameras, video information must be 20 acquired from the right side or lead zone of the adjacent image and from the left side or lag zone and "stitched" onto the video being presented to the computational 0 processor.
CA 022064~0 1997-0~-29 Before the video information from adjacent images can be stitched, the adjacent video ~ allls of video data must be precisely aligned with each other. In the case of a multitap camera the o~ Lt;d video streams are fully synchrolli~ed and precisely aligned. Precisely aligned means that all streams are receiving pixels for the S same hori~olltal scan line at the same time.
Referring now to Figure 6, the stitching process is ~ccomplished on a per-scan line basis. The overlap ~loccssor 10 has three video inputs: the center input 24 whieh is the main input being processed from line scan camera 55, the lead input 22, which is the input from line scan camera 54 which is adjacent scan line to 10 the left in Figure 2 and the trail input 26 which is the input from line scan camera 56 which is adjacent scan to the right in Figure 2.
Each scan line is a series of digital video signals. Each digital video signal col~ es a line valid signal (LVAL) and pixel data. For example, a sensor that produces an 8 bit video output would be represented by a 9-bit digital video 15 signal col-~ ing the 8 bit video data plus one line valid bit. The LVAL signal indicates the period during which the video data bits CO~ ;., valid pixel data. The LVAL signal precedes the start of the video data by one clock cycle and ends at the start of the last pixel in the line of video data. The number of pixels per line is determined by the video sensor format, up to 16,384.
The output of the overlap processor 10 is a "stitched" video scan line including overlap zones that is presented to the input of the spatial co~ ul~tional processor 50.
WO 96/17-i68 PCT/CA95/00671 At start up, a reset signal is generated by the control logie 42 which is delivered to each of the FIFO line buffers 12, 14 and 16. Following receipt of the reset signal all FIFO line buffers 12, 14 and 16 are empty. Since all three video streams are preciseb aligned, the valid video pixels of the three video ~lrcallJ,s arrive S simultaneously and are captured into the rc~c~ e FIFO line buf:~ers 12, 14 and 16.
The previous tap from camera 54 is captured in the lead FIFO 12, the primary tap from camera 55 is capluled in the center FIFO 14, and the trailing tap from camera 56 is captured in the trail FIFO 16.
PLxel counter 36 is a standard circuit which counts the number of pi~cels 10 of each scan line which is entering each of the FIFO buffers 12, 14 and 16 following receipt of either a rising or falling edge of a LVAL signal. Detectors 38 and 40 are simple comparator circuits each of which receives an input from pixel counter 36 rcllrGselltative of the number of pixels counted and coll.~arcs the number with a preset value. In the case of detector 38, the value is set to a predetermined value 1~ of half the kernel width (W/2). Detector 40 is set to a predetellnilled value of the kernel width (W). Once each of the detectors 38 and 40 receives the colles~onding value, a respective signal is delivered to the control logic 42.
Pixel counter 36 also includes a 2-bit counter for counting the number of scan lines passing through the overlap processor 10. Pixel counter 36 sends a 20 signal to logic controller le~lescntative of the number of scan lines counted.
Control logic 42 is a standard circuit which will generate a signal responsive to the signals received from the pLxel counter 36 and detectors 38 and 40.
CA 022064~0 1997-0~-29 The signals generated by control logic 42 are delivered to the FIFO buffers 12, 14 and 16 for reading out the scan lines of pixel data stored therein and to the multiplexer 18 for switching between inputs for reading out a stitched video signal.
The individual read video sl~ s show when the read operation is 5 pelrolllled on each of the three FIFO line buffers 12, 14 and 16 and which scan line of pixels are present on each stream. Preferably, the stitched video stream is wider by an amount equal to the width of kernel 66. This length extension is typically removed as the video is processed by the colll~ul~tional processor 50.
There is a unique startup sequence immediately after reset, followed 10 by a repeating FIFO access sequence for all subsequent lines. Following receipt of a rising LV~L signal, pixel counter 36 begins to count the number of pixels of a first scan line entering the FIFO buffers. Once the pixel counter 36 reaches the first predetermi~ed value (W/2), detector 38 generates a signal for logic controller 42.
Logic controller 42 then generates a lead read command signal for lead FIFO 12 to 15 commence the read of video (LN) stored therein. The lead FIFO 12 read is initially delayed by width of kernel 66 dhided by two (W/2) pixels from the first line valid (LVAL) rising edge and terminates coincident with LVAL. All of the rem~inin~
pixel data stored in FIFO line buffer 12 is held until a subsequent LVAL of a subsequent video line (N+1).
Once a subsequent LVAL of a subsequent scan line (N+1) is l~ ceived, logic controller 42 sends a first switching signal to multiplexer 18 to begin receiving the scan line (LN) from FIFO 12 and to pass the scan line (LN) to the stitched video output 48.
Once the pixel counter 36 counts one video signal (N) and the first predetermined value (W/2), a signal is sent to logic controller 42 which issues a L center.read command signal to center FIFO 14. The center FIFO 14 read is thus initially delayed one entire scan line (N) from LVAL rising edge plus the width of 5 kernel 66 divided by two (W/2) and is of length LVAL. All subsequent center zone reads are delayed by (W/2) and are of length equal to LVAL.
At the same time, logic controller 42 issues a second switching signal to multiplexer 18 to accept the scan line (CN) being read from center FIFO line buffer 12.
10 Once the pixel counter 36 counts two scan lines (N and N+ 1) and the first predetermined value (W/2) from the falling edge of LVAL, a signal is sent to logic controller 42 which issues a trail read co,l~ a~ld signal to trail FIFO 16 and a third switching signal is sent to multiplexer 18. Resl)oll~ive to the third ~wilchi-lg signal, the multiplexer 18 switches from rcceivi-~g scan line (CN) from center FIFO
15 14 to scan line (TN) from trail FIFO 16.
The trail zone FIFO 16 read is initially delayed by two entire scan line trail edges plus the width of kernel 66 divided by two (W/2) and termin~tes a width (W) o~ kernel 66 pixels after the same scan line trail edge. All subsequent trail zone reads are delayed by W pixels from LVAL rising edge and are of length LVAL.
20 Once the pixel counter 36 counts two video signals (N and N+1) and the second predetermined value W, detector 40 sends a signal to logic controller 42 which issues a fourth switching signal to multiplexer 18. Responsive to the fourth WO 96/17468 PCTtCA9S/00671 switching signal, multiplexer 18 disables the output to output 48 or ~l~f~ t~ to a disabled condition.
A single stitched video signal is thus generated at output 48. The stitched vid~eo stream is wider by an amount equal to the width of kernel 66.
S The lead zone 58 and trail zone 60 being inspected by the cameras 54 and 56 are relative to the direction of the shift register of each of the calllelas. All cameras 54, 55 and 56 must shift in the same dileclioll. In Figure 2, a holi;6Onlally extending arrow in~ljc~tes the direction of shift of the shift regi;,lel~ in the example described herein.
To accomplish left and right edge zone injection, the zone multiplexer 18 is forced to select the inject register values from inject registers 44 and 46 instead of the lead FIFO line buffer 12 or the trail FIFO line buffer 16. Multiplexer 18 will read data streams from inject registers 44 and 46 which store values which are typically selectable to either all 1's or all O's or a value between 0 to 256 for grey 15 scale analysis.
For right edge zone, output 64 is connected to input 24 of center FIFO
14 and output 63 is connected to input 22 of lead FIFO 12. No input is connected to trail FIFO 16. In this case, logic controller will serid a signal to multiplexer 18 to turn off the input from FIFO 16 and open receipt of trail edge register 46 to receive 20 the data stored therein in replacement of FIFO 16. The overlap processor 10 operates in an identical manner producing a stitched video stream with edge data added for the spatial im~ging processing.
W O 96/17468 PCT/Cf~9S/00671 Similarly for the left edge zone, output 62 is conn~cte~l to input 24 of center FIFO 14 and output 63 is connected to input 26 of trail FIFO 16. No input - is connected to lead FIFO 12. In this case, logic controller will send a signal to multiplexer 18 to turn off the input from lead FIFO 12 and open receipt of lead 5 edge le~ er 44 to receive the data stored therein in repl~cement of lead FIFO 12.
The overlap processor 10 operates in an identical manner producing a stitched video stream with edge data added for the spatial im~ging procec~ing Spatial image processing undertaken by processor 50, will reduce the line video back to its original size.
It is possible to have left only, right only or left and right injection OC~ur~ g.
It is apparent that the o~cll~ processor 10 of the present invention has applications outside of web i~ c~lioll. Although the u~. lla~ processor 10 is suited for use with visions systems such as the system described in commonly 15 ~csigne~l application no. 08/169,665, filed December 20, 1993, it is apparent that the overlap processor 10 has applications with a CCD camera which internally divides up the video image into lanes or zones.
It is now apparent to a person skilled in the art that there are llullJeluus other modifications and yulyOSC5 of this i~lv~ ioll. It is to be understood 20 that certain changes in design, size and components may be effective without a departure from the spirit of the invention and within the scope of the appended claims.
Field of Invention This invention relates to a method and apparatus for image ~)vtilla~
processing. In particular, this invention relates to a novel method for proce~ine multiple ~ allls of data for spatial im~ging at the boundaries of the data without il~lru~lucing spatial errors.
~ach~ uL~d of In~ention Conlilluou~ high resolution surface inspection is one of the most demanding industrial vision applic~tion~. A typical high speed web inspection 10 applisation inspects a web which is 24 inches wide, with a web velocity of 400 inches per second (2000 feet/minute), pelroill,s 100% surface inspection and detects defects as small as 0.020 inches. A vision system that ;l,s~ecLs such a web requires a cross-web resolution of at least 2048 pixels and needs to continuously scan and process over 70 million pixels per second.
Line scan cameras used for surface inspection are based on a one rlimencional image sensor. In order to achieve su~icient image resolution, many applications require more than one line scan camera to be used .~imlllt~neously to inspect the same object.
In the early stages of processing the pixels, spatial image proces~ing 20 operations, such as morphology or convolution analysis, are widely undertaken.
Typically, one image is taken as input and one resultant image is produced as output.
There are three growing classes of image processing applications for which CO~ ional spatial image operations are inadequate. These applications are CA 022064~0 1997-0~-29 WO 96/17468 PCT/C~9S/00671 ones that use multiple line scan cameras, multiple output line scan cameras, and multiple output area scan cameras. Each lane or image will produce a separate but concurrent stream of video data. A problem exists when pelrollllin~ a spatial image processing operation on image data that has been divided into lanes or multiple 5 images.
The model which is used in spatial image processing is to consider an image which is com~lised of a two dimensional matrix of picture elements or pixels.
Each row of pixels in an image is called a scan line. For every input image pixel, a corlcs~onding output image pixel is produced by a computation that takes as its 10 input values, the input image pixel values from a predetermined region having a predetermined hol.~o-llal and vertical extent. The region that encloses the input image pixels for the spatial operation is called a "kernel".
When the center pixel of the spatial operator's kernel is well within the boundaries of a video lane, overlap proceccinE is not a concern. When the center 15 pixel is near an image boundary, pixel data from outside of the image boundary is not available for full spatial operation. In prior art systems, pixel data is either assumed or arbitrarily injected. If the image boundary is an edge of the field of view, the overlap processor must inject a fixed value (i.e. O's or 1's) into the portion of the kernel that is beyond the image boundary. The end result is that the output image 20 near a boundary is unreliable as a result of the introduced spatial errors at the boundaries.
For instance, if a blob is located near an edge of a video lane, the scan line camera will produce an image responsive to the blob. If a spatial image operation is applied to the ~lob using a series of 0's injected at the image boundary, the output image of the blob is reduced in size which may result in the blob being undetected. On the other hand, if a series of l's are injected at the image boundary and the spatial operation is applied, the blob is expanded which may result in an S unimportant blob being detected unnecess~rily. ~ither result is undesirable.
The same problem exists for cameras that deliver their video on multiple o~ uLs, such as multiple output line scan cameras and area cameras. If the image boundary is between adjacent fields of view, the overlap processor will still inject a fixed value into the portion of the kernel that is beyond the image boundary.
10 Since the pixel values for the portion beyond the image boundary is continuously ~~h~n~ein~ and unknown, injection of a fixed value introduces considerable error.
Srmn-nly of the Invention The disadvantages of the prior art may be o~ lcoll~e by providin~ an overlap processor which enables spatial operations to be yelrollned seamlessly across 15 adjacent images.
It is desirable to provide an overlap processor which borrows a~ o~liate pixel video data from adjacent images to produce regions of artificial overlap so that spatial operations can be ~t;lrorllled at the image boundaries without errors or discontinuilics.
It is desirable to provide an overlap ~loc~;,,or which receives and temporarily stores a plurality of aligned scan lines. Each scan line is ~ cscntative of a lane or zone of an image. The processor sequentially reads the plurality of scan lines and then synchronously and selectively oul~uls the scan lines producing an CA 022064~0 1997-0~-29 wo 96/17468 PCT/CA9S/00671 output CO~ g one scan line rc~lcsel~tative of one lane or zone plus a predetermine~ amount of data from a scan line of an adjacent lane or zone or both adjacent lanes or zones.
According to one aspect of the invention, there is provided an overlap 5 ~ocessor for generating an output stream of pixel data from a plurality of aligned input streams of pixel data le~lcsentative of a lane of an image of an object. The overlap processor co~ rises a plurality of FIFO line buffers, a multiplexer and a controller. Each FIFO line buffer receives, stores and reads out, respectively, one of the plurali~ of aligned input slleallls. The multiplexer is connected to each of the 10 plurality of ~IFO line buffers. The multiplexer has an output for out~ Lil-g the output stream. The controller is connected to each of the plurality of FIFO line buffers for sequentially reading out the plurality of aligned input streams. The controller is also connected to the multiplexer for switching the multiplexer between the plurality of FIFO line buffers. The controller switches the multiplexer for 15 oul~utling tlle output stream of pixel data re~.eselltative of one lane together with pixel data l~lcsentative of a boundary region of an adjacent lane nearest the lane.
Accol.lh~g to another aspect of the invention, there is provided a method of generating an output stream of pixel data from a plurality of aligned input streams of pixel data representative of a lane of an image of an object. The method 20 coln~lises the steps of sequentially reading the plurality of aiigned input streams of pixel data, and selectively switching between the plurality of input streams producing an output s~ream of pixel data which is le~lesentative of one lane together with pixel data le~lcsentative of a boundary region of an adjacent lane nearest the lane.
CA 022064~0 1997-0~-29 , Description of the Drawings In drawings which illustrate embodiments of the invention, Figure 1 is a schematic of the overlap processor of the present invention;
S Figure 2 is a schematic of a typical camera arrangement generating outputs for the overlap processor of Figure 1;
Figure 3 is a schematic of an input scan line image with an output following spatial image processing;
~ Figure 4 is a schematic of an input scan line image illustrating the edges of the image relative to a kernel;
Figure S is a schematic of three input scaIi line images in a side by side relation; and Figure 6 is a time phase diagram of the scan line pixel data through the overlap processor of Figure 1.
15 Description of the Invention The overlap processor 10 of the present invention is generally illustrated in Figure 1.
Overlap processor 10 generally comprises lead ~l~O line buffer 12, center FIFO line buffer 14 and trail FIFO line buffer 16. Each of the output side of the FIFO
20 line buffers, 12, 14 and 16, is electrically connPcte~l to zone multiplexer 18. Each of the FIFO line buffers 12, 14 and 16, respectively, has input taps 22, 24 and 26. Each FIFO
line buffers 12, 14 and 16 receives, temporarily stores and is responsive to an external signal and will read out stored data in a first in first out (FIFO) pattern.
N~)E~ S~FET
CA 022064~0 1997-0~-29 -Overlap p~occssor 10 also includes an overlap processor controller 28.
Controller 2~ has a line valid signal input 30 and a FIFO control output 32 which is electrically connected to each of the FIF() line buffers 12, 14 and 16. ~ -Overlap ~lc,cessor controller 28 has a multiplex control output 34 5 which is electrically connected to zone multiplexer 18 for effecting control of the output thereof.
Overlap processor 28 generally COlllpl ises a pixel counter 36, a detector 38, a detector 40 and a control logic 42. Pixel counter 36 is electrically connected to line valid signal input 30. Extending in parallel between pixel counter 36 and 10 control logic 42 are detectors 38 and 40.
The output side of control logic 42 is electrically connected to FIFO
control output 32 and multiplexer control output 34.
Zone multiplexer 18 also has a lead inject register 44 and a trail inject register 46. The output of zone multiplexer 18 is connected to the stitched video 15 output 48 which is in communication with a spacial co,~ ul~tional processor 50.
Referring to Figure 2, a typical web h,~e~Lion system is schematically illustrated. A continuous web 52 which is being inspected, travels in the direction of the arrow. Line scan cameras 54, 55 and 56 are mounted relative to the web 52 to inspect lanes 58, 59 and 60 respectively. Line scan camera 54 will generate a video 20 output 62, while line scan camera 55 will generate video output 63, while line scan camera 56 will generate video output 64. Although 3 line scan cameras have been illustrated, it is a~alent that the present invention may be used with any number of cameras or with a camera having any number of internal lanes or zones.
WO 96/17468 PCT/CA!~5/00671 Video oull,uls 62, 63 and 64 are electrically connected to lead input 22, center input 24 and trail input 26, respectively.
Referring now to Figure 3, spatial image proce~inE is schematically illustrated. The left hand side of Figure 3, illustrates an input image defined by 5 pixels (n,m). For every input image pixel (n,m) a co~ onding output pixel (n ~ ,m ~ ), is produced by a computation that takes as its input values, the input image pixel values from the region enclosed by n~a, m~b, where 2a~1 and 2b~1 are the llu~i~onLal and vertical extent o~ the region of spacial operation. The region that encloses the input image pixels for spatial operatiûn is called a "kernel". The kernel 10 66 can be arbitrarily shapecl and does not necec~rily have to be symmetrical,rectangular or filled. Examples of typical spatial processing include morphology and convolution analysis.
When the center pixel (n,m) of the spatial operator's kernel 66 is well within the boundaries of a video lane, UVella~ OCe ~ , iS not a concern. When the 15 center pixel (n,m) is near an image boundary as illustrated in Figure 4, pixel data from outside the image is not available.
Referring to Figure 5, an image of a web being inspected is divided into three lanes. When a boundary is between two adjacent images from two adjacent camera ou~ s or two adjacent cameras, video information must be 20 acquired from the right side or lead zone of the adjacent image and from the left side or lag zone and "stitched" onto the video being presented to the computational 0 processor.
CA 022064~0 1997-0~-29 Before the video information from adjacent images can be stitched, the adjacent video ~ allls of video data must be precisely aligned with each other. In the case of a multitap camera the o~ Lt;d video streams are fully synchrolli~ed and precisely aligned. Precisely aligned means that all streams are receiving pixels for the S same hori~olltal scan line at the same time.
Referring now to Figure 6, the stitching process is ~ccomplished on a per-scan line basis. The overlap ~loccssor 10 has three video inputs: the center input 24 whieh is the main input being processed from line scan camera 55, the lead input 22, which is the input from line scan camera 54 which is adjacent scan line to 10 the left in Figure 2 and the trail input 26 which is the input from line scan camera 56 which is adjacent scan to the right in Figure 2.
Each scan line is a series of digital video signals. Each digital video signal col~ es a line valid signal (LVAL) and pixel data. For example, a sensor that produces an 8 bit video output would be represented by a 9-bit digital video 15 signal col-~ ing the 8 bit video data plus one line valid bit. The LVAL signal indicates the period during which the video data bits CO~ ;., valid pixel data. The LVAL signal precedes the start of the video data by one clock cycle and ends at the start of the last pixel in the line of video data. The number of pixels per line is determined by the video sensor format, up to 16,384.
The output of the overlap processor 10 is a "stitched" video scan line including overlap zones that is presented to the input of the spatial co~ ul~tional processor 50.
WO 96/17-i68 PCT/CA95/00671 At start up, a reset signal is generated by the control logie 42 which is delivered to each of the FIFO line buffers 12, 14 and 16. Following receipt of the reset signal all FIFO line buffers 12, 14 and 16 are empty. Since all three video streams are preciseb aligned, the valid video pixels of the three video ~lrcallJ,s arrive S simultaneously and are captured into the rc~c~ e FIFO line buf:~ers 12, 14 and 16.
The previous tap from camera 54 is captured in the lead FIFO 12, the primary tap from camera 55 is capluled in the center FIFO 14, and the trailing tap from camera 56 is captured in the trail FIFO 16.
PLxel counter 36 is a standard circuit which counts the number of pi~cels 10 of each scan line which is entering each of the FIFO buffers 12, 14 and 16 following receipt of either a rising or falling edge of a LVAL signal. Detectors 38 and 40 are simple comparator circuits each of which receives an input from pixel counter 36 rcllrGselltative of the number of pixels counted and coll.~arcs the number with a preset value. In the case of detector 38, the value is set to a predetermined value 1~ of half the kernel width (W/2). Detector 40 is set to a predetellnilled value of the kernel width (W). Once each of the detectors 38 and 40 receives the colles~onding value, a respective signal is delivered to the control logic 42.
Pixel counter 36 also includes a 2-bit counter for counting the number of scan lines passing through the overlap processor 10. Pixel counter 36 sends a 20 signal to logic controller le~lescntative of the number of scan lines counted.
Control logic 42 is a standard circuit which will generate a signal responsive to the signals received from the pLxel counter 36 and detectors 38 and 40.
CA 022064~0 1997-0~-29 The signals generated by control logic 42 are delivered to the FIFO buffers 12, 14 and 16 for reading out the scan lines of pixel data stored therein and to the multiplexer 18 for switching between inputs for reading out a stitched video signal.
The individual read video sl~ s show when the read operation is 5 pelrolllled on each of the three FIFO line buffers 12, 14 and 16 and which scan line of pixels are present on each stream. Preferably, the stitched video stream is wider by an amount equal to the width of kernel 66. This length extension is typically removed as the video is processed by the colll~ul~tional processor 50.
There is a unique startup sequence immediately after reset, followed 10 by a repeating FIFO access sequence for all subsequent lines. Following receipt of a rising LV~L signal, pixel counter 36 begins to count the number of pixels of a first scan line entering the FIFO buffers. Once the pixel counter 36 reaches the first predetermi~ed value (W/2), detector 38 generates a signal for logic controller 42.
Logic controller 42 then generates a lead read command signal for lead FIFO 12 to 15 commence the read of video (LN) stored therein. The lead FIFO 12 read is initially delayed by width of kernel 66 dhided by two (W/2) pixels from the first line valid (LVAL) rising edge and terminates coincident with LVAL. All of the rem~inin~
pixel data stored in FIFO line buffer 12 is held until a subsequent LVAL of a subsequent video line (N+1).
Once a subsequent LVAL of a subsequent scan line (N+1) is l~ ceived, logic controller 42 sends a first switching signal to multiplexer 18 to begin receiving the scan line (LN) from FIFO 12 and to pass the scan line (LN) to the stitched video output 48.
Once the pixel counter 36 counts one video signal (N) and the first predetermined value (W/2), a signal is sent to logic controller 42 which issues a L center.read command signal to center FIFO 14. The center FIFO 14 read is thus initially delayed one entire scan line (N) from LVAL rising edge plus the width of 5 kernel 66 divided by two (W/2) and is of length LVAL. All subsequent center zone reads are delayed by (W/2) and are of length equal to LVAL.
At the same time, logic controller 42 issues a second switching signal to multiplexer 18 to accept the scan line (CN) being read from center FIFO line buffer 12.
10 Once the pixel counter 36 counts two scan lines (N and N+ 1) and the first predetermined value (W/2) from the falling edge of LVAL, a signal is sent to logic controller 42 which issues a trail read co,l~ a~ld signal to trail FIFO 16 and a third switching signal is sent to multiplexer 18. Resl)oll~ive to the third ~wilchi-lg signal, the multiplexer 18 switches from rcceivi-~g scan line (CN) from center FIFO
15 14 to scan line (TN) from trail FIFO 16.
The trail zone FIFO 16 read is initially delayed by two entire scan line trail edges plus the width of kernel 66 divided by two (W/2) and termin~tes a width (W) o~ kernel 66 pixels after the same scan line trail edge. All subsequent trail zone reads are delayed by W pixels from LVAL rising edge and are of length LVAL.
20 Once the pixel counter 36 counts two video signals (N and N+1) and the second predetermined value W, detector 40 sends a signal to logic controller 42 which issues a fourth switching signal to multiplexer 18. Responsive to the fourth WO 96/17468 PCTtCA9S/00671 switching signal, multiplexer 18 disables the output to output 48 or ~l~f~ t~ to a disabled condition.
A single stitched video signal is thus generated at output 48. The stitched vid~eo stream is wider by an amount equal to the width of kernel 66.
S The lead zone 58 and trail zone 60 being inspected by the cameras 54 and 56 are relative to the direction of the shift register of each of the calllelas. All cameras 54, 55 and 56 must shift in the same dileclioll. In Figure 2, a holi;6Onlally extending arrow in~ljc~tes the direction of shift of the shift regi;,lel~ in the example described herein.
To accomplish left and right edge zone injection, the zone multiplexer 18 is forced to select the inject register values from inject registers 44 and 46 instead of the lead FIFO line buffer 12 or the trail FIFO line buffer 16. Multiplexer 18 will read data streams from inject registers 44 and 46 which store values which are typically selectable to either all 1's or all O's or a value between 0 to 256 for grey 15 scale analysis.
For right edge zone, output 64 is connected to input 24 of center FIFO
14 and output 63 is connected to input 22 of lead FIFO 12. No input is connected to trail FIFO 16. In this case, logic controller will serid a signal to multiplexer 18 to turn off the input from FIFO 16 and open receipt of trail edge register 46 to receive 20 the data stored therein in replacement of FIFO 16. The overlap processor 10 operates in an identical manner producing a stitched video stream with edge data added for the spatial im~ging processing.
W O 96/17468 PCT/Cf~9S/00671 Similarly for the left edge zone, output 62 is conn~cte~l to input 24 of center FIFO 14 and output 63 is connected to input 26 of trail FIFO 16. No input - is connected to lead FIFO 12. In this case, logic controller will send a signal to multiplexer 18 to turn off the input from lead FIFO 12 and open receipt of lead 5 edge le~ er 44 to receive the data stored therein in repl~cement of lead FIFO 12.
The overlap processor 10 operates in an identical manner producing a stitched video stream with edge data added for the spatial im~ging procec~ing Spatial image processing undertaken by processor 50, will reduce the line video back to its original size.
It is possible to have left only, right only or left and right injection OC~ur~ g.
It is apparent that the o~cll~ processor 10 of the present invention has applications outside of web i~ c~lioll. Although the u~. lla~ processor 10 is suited for use with visions systems such as the system described in commonly 15 ~csigne~l application no. 08/169,665, filed December 20, 1993, it is apparent that the overlap processor 10 has applications with a CCD camera which internally divides up the video image into lanes or zones.
It is now apparent to a person skilled in the art that there are llullJeluus other modifications and yulyOSC5 of this i~lv~ ioll. It is to be understood 20 that certain changes in design, size and components may be effective without a departure from the spirit of the invention and within the scope of the appended claims.
Claims (20)
1. A processor for generating an output stream of overlapping scan line data from a plurality of aligned input streams of scan line data, each of said input streams representative of adjacent lanes of an image, said processor comprising:
a plurality of FIFO line buffers, each of said FIFO line buffers for receiving, storing and reading out, a respective one of said input streams, a multiplexer connected to each of said plurality of FIFO line buffers for outputting said output stream, a controller operably connected to said plurality of FIFO line buffers and said multiplexer, said controller having an input for receiving a line valid signal, said controller responsive to said line valid signal effects said plurality of FIFO line buffers to sequentially read out each respective one of said input streams and effects said multiplexer to switch between said plurality of FIFO line buffers selectively outputting said output stream comprising scan line data of one of said lanes together with a predetermined amount of scan line data of an adjacent one of said lanes.
a plurality of FIFO line buffers, each of said FIFO line buffers for receiving, storing and reading out, a respective one of said input streams, a multiplexer connected to each of said plurality of FIFO line buffers for outputting said output stream, a controller operably connected to said plurality of FIFO line buffers and said multiplexer, said controller having an input for receiving a line valid signal, said controller responsive to said line valid signal effects said plurality of FIFO line buffers to sequentially read out each respective one of said input streams and effects said multiplexer to switch between said plurality of FIFO line buffers selectively outputting said output stream comprising scan line data of one of said lanes together with a predetermined amount of scan line data of an adjacent one of said lanes.
2. A processor as claimed in claim 1 wherein said output stream further comprises scan line data of a lane on a side opposite from said adjacent one of said lanes.
3. A processor as claimed in claim 2 wherein said input streams comprises a lead input stream, a centre input stream and a trail input stream, and said plurality of FIFO
line buffers includes a lead FIFO line buffer for receiving said lead input stream, a centre FIFO line buffer for receiving said centre input stream and trail FIFO line buffer for receiving said trail input stream.
line buffers includes a lead FIFO line buffer for receiving said lead input stream, a centre FIFO line buffer for receiving said centre input stream and trail FIFO line buffer for receiving said trail input stream.
4. A processor as claimed in claim 3 wherein said FIFO line buffers read out in an order of lead input stream, centre input stream and trail input stream.
5. A processor as claimed in claim 4 wherein said order is relative to a direction of shifting of a register of a camera scanning said image.
6. A processor as claimed in claim 1 wherein said controller includes a pixel counter for counting pixels of scan line data and for counting a line valid signal and said controller effects said sequentially read out and said switching responsive to a predetermined number of pixels and line valid signals.
7. A processor as claimed in claim 6 wherein initially said controller effects a lead FIFO to read out after said predetermined number of pixels, effects a centre FIFO to read out after one line valid signal plus said predetermined number of pixels and effects a trail FIFO to read out after two line valid signals plus said predetermined number of pixels and thereafter effects said sequential read out.
8. A processor as claimed in claim 7 wherein initially said controller effects said switching to said lead FIFO after one line valid signal and switches to said centre FIFO
after one valid signal plus said predetermined number of pixels and switches to said trail FIFO after two line valid plus said predetermined number of pixels and disables said output stream after two scan lines plus twice said predetermined number of pixels and thereafter enables said output stream at a start of each scan line and disables said output stream after an end of each scan line plus twice said predetermined number of pixels.
after one valid signal plus said predetermined number of pixels and switches to said trail FIFO after two line valid plus said predetermined number of pixels and disables said output stream after two scan lines plus twice said predetermined number of pixels and thereafter enables said output stream at a start of each scan line and disables said output stream after an end of each scan line plus twice said predetermined number of pixels.
9. A processor as claimed in claim 1 wherein said overlap processor further includes an edge register for injecting a predetermined stream of data when said one of said lanes is adjacent an edge of said image.
10. A processor as claimed in claim 9 wherein said overlap processor further includes another edge register for injecting a predetermined stream of data when said one of said lanes is adjacent an opposite edge of said image.
11. A processor as claimed in claim 10 wherein said predetermined steam of data comprises a value between 0 and 256.
12. A processor for generating an output stream of overlapping scan line data from a plurality of aligned input streams of scan line data, each of said input streams representative of adjacent lanes of an image, said processor comprising:
a lead FIFO line buffer for receiving, storing and reading out a lead input stream, a center FIFO line buffer for receiving, storing and reading out a center input stream and trail FIFO line buffer for receiving, storing and reading out a trail input stream, said lead, center and trail input streams representative of adjacent lanes of said image, a multiplexer connected to each of said FIFO line buffers for outputting said output stream, a controller operably connected to said lead FIFO line buffer, said center FIFO line buffer, said trail FIFO line buffer and said multiplexer, said controller having an input for receiving a line valid signal of said scan line data, said controller comprising a pixel counter for counting said line valid signal and responsively said controller effects a lead FIFO to read out after a predetermined number of pixels, effects a center FIFO to read out after one line valid signal plus said predetermined number of pixels and effects a trail FIFO to read out after two line valid signals plus said predetermined number of pixels and thereafter effects sequential read out and said controller effects said multiplexer to enable said output from said lead FIFO after one line valid signal and to switch to said center FIFO after one line valid signal plus said predetermined number of pixels and to switch to said trail FIFO after two line valid signals plus said predetermined number of pixels and to disable said output stream after two line valid signals plus twice said predetermined number of pixels and thereafter enables said output stream at a start of each line valid signal and disables said output stream after an end of each line valid signal plus twice said predetermined number of pixels.
a lead FIFO line buffer for receiving, storing and reading out a lead input stream, a center FIFO line buffer for receiving, storing and reading out a center input stream and trail FIFO line buffer for receiving, storing and reading out a trail input stream, said lead, center and trail input streams representative of adjacent lanes of said image, a multiplexer connected to each of said FIFO line buffers for outputting said output stream, a controller operably connected to said lead FIFO line buffer, said center FIFO line buffer, said trail FIFO line buffer and said multiplexer, said controller having an input for receiving a line valid signal of said scan line data, said controller comprising a pixel counter for counting said line valid signal and responsively said controller effects a lead FIFO to read out after a predetermined number of pixels, effects a center FIFO to read out after one line valid signal plus said predetermined number of pixels and effects a trail FIFO to read out after two line valid signals plus said predetermined number of pixels and thereafter effects sequential read out and said controller effects said multiplexer to enable said output from said lead FIFO after one line valid signal and to switch to said center FIFO after one line valid signal plus said predetermined number of pixels and to switch to said trail FIFO after two line valid signals plus said predetermined number of pixels and to disable said output stream after two line valid signals plus twice said predetermined number of pixels and thereafter enables said output stream at a start of each line valid signal and disables said output stream after an end of each line valid signal plus twice said predetermined number of pixels.
13. A processor as claimed in claim 12 wherein said overlap processor further includes an edge register for injecting a predetermined stream of data when said one of said lanes is adjacent an edge of said image.
14. A processor as claimed in claim 13 wherein said overlap processor further includes another edge register for injecting a predetermined stream of data when said one of said lanes is adjacent an opposite edge of said image.
15. A processor as claimed in claim 14 wherein said predetermined steam of data comprises a value between 0 and 256.
16. A method of generating an output stream of overlapping scan line data from a plurality of aligned input streams of scan line data, each of said input streams representative of adjacent lanes of an image, the steps comprising:
sequentially reading said input streams, receiving a line valid signal of said scan line data, responsive to said line valid signal, selectively switching between said input streams outputting said output stream comprising one of said input streams together with a predetermined amount of scan line data from another one of said input streams representative of an adjacent one of said lanes.
sequentially reading said input streams, receiving a line valid signal of said scan line data, responsive to said line valid signal, selectively switching between said input streams outputting said output stream comprising one of said input streams together with a predetermined amount of scan line data from another one of said input streams representative of an adjacent one of said lanes.
17. A method as claimed in claim 16 wherein said output stream further comprises scan line data from an opposite one of said input streams, said opposite one being representative of an opposite one of said lanes.
18. A method as claimed in claim 17 wherein said method further comprises the steps of counting pixels of scan line data and counting scan lines and said steps of sequentially reading and switching are responsive to counting a predetermined number of pixels and scan lines.
19. A method as claimed in claim 18 wherein step of sequentially reading is relative to a direction of shifting of each register outputting said input streams.
20. A method as claimed in claim 19 wherein said method includes the step of storing said input streams in a plurality of FIFO line buffers before said step of sequentially reading.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/350,017 US5812704A (en) | 1994-11-29 | 1994-11-29 | Method and apparatus for image overlap processing |
| US08/350,017 | 1994-11-29 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2206450A1 true CA2206450A1 (en) | 1996-06-06 |
Family
ID=23374910
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002206450A Abandoned CA2206450A1 (en) | 1994-11-29 | 1995-11-28 | Method and apparatus for image overlap processing |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US5812704A (en) |
| JP (1) | JPH11500546A (en) |
| AU (1) | AU3920795A (en) |
| CA (1) | CA2206450A1 (en) |
| WO (1) | WO1996017468A1 (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SE509327C2 (en) * | 1996-11-01 | 1999-01-11 | C Technologies Ab | Method and device for registering characters using a pen |
| SE513059C2 (en) * | 1997-12-30 | 2000-06-26 | C Technologies Ab | Methods and apparatus for matching images |
| US6195471B1 (en) * | 1998-03-24 | 2001-02-27 | Agfa Corporation | Method and apparatus for combining a plurality of images at random stitch points without incurring a visible seam |
| US6373995B1 (en) * | 1998-11-05 | 2002-04-16 | Agilent Technologies, Inc. | Method and apparatus for processing image data acquired by an optical scanning device |
| US7015954B1 (en) * | 1999-08-09 | 2006-03-21 | Fuji Xerox Co., Ltd. | Automatic video system using multiple cameras |
| US6625309B1 (en) | 1999-09-29 | 2003-09-23 | Seiko Epson Corporation | Image partitioning to avoid overlap transmission |
| FI110908B (en) * | 2001-01-31 | 2003-04-15 | Procemex Oy | Process for mapping manufacturing processes |
| US6747647B2 (en) * | 2001-05-02 | 2004-06-08 | Enroute, Inc. | System and method for displaying immersive video |
| US7009163B2 (en) * | 2001-06-22 | 2006-03-07 | Orbotech Ltd. | High-sensitivity optical scanning using memory integration |
| EP1573426A4 (en) * | 2001-07-12 | 2009-11-25 | Atrua Technologies Inc | Method and system for biometric image assembly from multiple partial biometric frame scans |
| US7423280B2 (en) | 2004-08-09 | 2008-09-09 | Quad/Tech, Inc. | Web inspection module including contact image sensors |
| KR100973561B1 (en) * | 2008-06-25 | 2010-08-03 | 삼성전자주식회사 | Display appartus |
| US9202208B1 (en) | 2009-05-15 | 2015-12-01 | Michael Redman | Music integration for use with video editing systems and method for automatically licensing the same |
| US20110141269A1 (en) * | 2009-12-16 | 2011-06-16 | Stephen Michael Varga | Systems And Methods For Monitoring On-Line Webs Using Line Scan Cameras |
| KR101903748B1 (en) | 2011-10-07 | 2018-10-04 | 삼성디스플레이 주식회사 | Display device |
| US9491495B2 (en) * | 2015-01-16 | 2016-11-08 | Analog Devices Global | Method and apparatus for providing input to a camera serial interface transmitter |
| US10534080B2 (en) | 2016-03-28 | 2020-01-14 | The Boeing Company | Radar image formation within a distributed network |
| WO2019007508A1 (en) * | 2017-07-06 | 2019-01-10 | Huawei Technologies Co., Ltd. | Advanced driver assistance system and method |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4566038A (en) * | 1981-10-26 | 1986-01-21 | Excellon Industries | Scan line generator |
| US5018078A (en) * | 1987-12-09 | 1991-05-21 | Fuji Photo Film Co., Ltd. | Apparatus and method for processing huge image information at high speed |
| EP0326137A3 (en) * | 1988-01-27 | 1991-10-02 | Fuji Photo Film Co., Ltd. | Image processing system |
| EP0348628A3 (en) * | 1988-06-28 | 1991-01-02 | International Business Machines Corporation | Cache storage system |
| US4916551A (en) * | 1989-02-02 | 1990-04-10 | Xerox Corporation | Multi-channel image processing with cross channel context |
| US5313620A (en) * | 1989-04-06 | 1994-05-17 | Bell Communications Research, Inc. | Selective receiver for each processor in a multiple processor system |
| US5367678A (en) * | 1990-12-06 | 1994-11-22 | The Regents Of The University Of California | Multiprocessor system having statically determining resource allocation schedule at compile time and the using of static schedule with processor signals to control the execution time dynamically |
| US5264945A (en) * | 1991-10-16 | 1993-11-23 | Eastman Kodak Company | Contact array scanners with circulating memory |
| JPH05199199A (en) * | 1992-01-20 | 1993-08-06 | Fujitsu Ltd | Stuff synchronization control system |
-
1994
- 1994-11-29 US US08/350,017 patent/US5812704A/en not_active Expired - Lifetime
-
1995
- 1995-11-28 WO PCT/CA1995/000671 patent/WO1996017468A1/en active Application Filing
- 1995-11-28 CA CA002206450A patent/CA2206450A1/en not_active Abandoned
- 1995-11-28 JP JP8517978A patent/JPH11500546A/en active Pending
- 1995-11-28 AU AU39207/95A patent/AU3920795A/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| JPH11500546A (en) | 1999-01-12 |
| US5812704A (en) | 1998-09-22 |
| WO1996017468A1 (en) | 1996-06-06 |
| AU3920795A (en) | 1996-06-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2206450A1 (en) | Method and apparatus for image overlap processing | |
| US20060103745A1 (en) | Image sensor and image sensor system | |
| CA1128195A (en) | Moving object inspection system | |
| WO1995017736A1 (en) | Real-time line scan processor | |
| CA1191249A (en) | Ccd camera | |
| EP0577310B1 (en) | Image processing device | |
| EP0273638B1 (en) | Image scanner systems | |
| US3987244A (en) | Programmable image processor | |
| US20070030371A1 (en) | Frame shuttering scheme for increased frame rate | |
| JP2744363B2 (en) | Image data processing method | |
| KR102521516B1 (en) | Apparatus and method for image processing of inspection machine that enables wide angle detection and record media recorded program for realizing the same | |
| US5177607A (en) | Method and apparatus for measuring velocity of fluid | |
| SU1206708A1 (en) | Apparatus for measuring speed of television image elements | |
| JP3661375B2 (en) | Image processing device | |
| US20070153116A1 (en) | Photographic device | |
| WO2021210968A1 (en) | Image processing apparatus and image processing method | |
| DE10315515B4 (en) | System and method for controlling photosensitive charge transfer | |
| JP3315865B2 (en) | Aligner equipment | |
| US4577223A (en) | Synthetic d.c. restoration of a.c. coupled signals | |
| JPS6314391B2 (en) | ||
| JPH0456461A (en) | Image reader | |
| JPH0787404A (en) | Solid-state image pickup device | |
| JP3641994B2 (en) | Moving object image processing apparatus | |
| SU151497A1 (en) | Device for visual inspection of the workpiece surface with deep bore | |
| Simmons | Digitizing Standard & High Resolution High Frame Rate Video Camera Signals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued |