WO1993014594A1 - Image input device having optical deflection elements for capturing multiple sub-images - Google Patents

Image input device having optical deflection elements for capturing multiple sub-images Download PDF

Info

Publication number
WO1993014594A1
WO1993014594A1 PCT/US1993/000294 US9300294W WO9314594A1 WO 1993014594 A1 WO1993014594 A1 WO 1993014594A1 US 9300294 W US9300294 W US 9300294W WO 9314594 A1 WO9314594 A1 WO 9314594A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
sub
images
lens
image sensor
Prior art date
Application number
PCT/US1993/000294
Other languages
French (fr)
Inventor
Michael Sussman
Robert H. Webb
Original Assignee
Michael Sussman
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Michael Sussman filed Critical Michael Sussman
Priority to JP5512639A priority Critical patent/JPH07503113A/en
Priority to AU34714/93A priority patent/AU663760B2/en
Priority to EP93903458A priority patent/EP0622001A1/en
Publication of WO1993014594A1 publication Critical patent/WO1993014594A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4038Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10Scanning systems
    • G02B26/106Scanning systems having diffraction gratings as scanning elements, e.g. holographic scanners
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/19Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
    • H04N1/195Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/19Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
    • H04N1/195Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
    • H04N1/19589Optical means, e.g. an optical fibre bundle, for mapping the whole or a part of a scanned image onto the array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387Composing, repositioning or otherwise geometrically modifying originals
    • H04N1/3876Recombination of partial images to recreate the original image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/58Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N3/00Scanning details of television systems; Combination thereof with generation of supply voltages
    • H04N3/02Scanning details of television systems; Combination thereof with generation of supply voltages by optical-mechanical means only
    • H04N3/08Scanning details of television systems; Combination thereof with generation of supply voltages by optical-mechanical means only having a moving reflector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/0402Arrangements not specific to a particular one of the scanning methods covered by groups H04N1/04 - H04N1/207
    • H04N2201/0426Scanning an image in a series of contiguous zones

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Facsimile Scanning Arrangements (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Facsimile Heads (AREA)
  • Image Input (AREA)

Abstract

An image input device (10) is provided in which an optical deflector (32) is positioned to divide the image of an object into a plurality of sub-images and to deflect the sub-images to an image sensor via an imaging lens (20). The images sensed by the image sensor are stored in a memory (90) and combined by an image processor (70) to form a composite image of the object. The optical deflector may have a plurality of optical elements (35), the number of which may be the same as the number of sub-images.

Description

IMAGE INPUT DEVICE HAVING OPTICAL DEFLECTION ELEMENTS FOR CAPTURING MULTIPLE SUB-IMAGES Background of the Invention
The present invention relates to an imaging system for selectively providing either a low resolution real-time image or a high resolution scanned image. More particularly, the invention relates to a camera-like imaging system in which high resolution digital capture of an image is provided by combining a series of sequentially obtained sub-images.
It is known to increase the resolution of a video camera either by increasing the number of pixels in the image sensor or by increasing the number of image sensors. Either approach typically increases the cost of the camera.
An alternative method of increasing resolution uses just one image sensor, but uses that image sensor to capture only a portion (sub-image) of the desired image. A series of sub-images called "tiles" are sequentially captured and stored in the memory of an image processor. The image processor combines ("stitches") the tiles together to form a composite ("mosaic") image. Tiling systems, however, present a number of problems involving the capture of the sub-images. The sub-images should fit together tightly, avoiding both overlap of tiles or gaps between tiles. A high degree of repeatability in the tile capture process is desirable, because repeatable (characterizable) errors can be corrected. Because of the complexity involved in acquiring the tiles, known tiling systems have been limited to highly sophisticated and costly applications, such as satellite imaging of the earth. The present invention uses tiling to provide a low cost scanner for commercial applications. A low cost tiling system, incorporated as part of a scanning camera, could find application, for example, as an aid to the visually impaired, as the imaging component of a face-up copying system for books, as an x-ray film scanner, as a variable resolution desktop scanner, as a microfilm copying system or as a video teleconferencing input device.
It would be desirable to provide a scanning camera with both a real-time mode and a high resolution mode.
It would also be desirable to provide a scanning camera with a highly repeatable, low cost tiling system.
It would further be desirable to provide a tiling mechanism with minimal settling time.
It would still further be desirable to provide a scanning camera with zoom and prescan capabilities.
Summary of the Invention
It is an object of the present invention to provide a scanning camera with both a real-time mode and a high resolution mode.
It is also an object of the present invention to provide a highly repeatable, low cost tiling system. It is further an object of the present invention to provide a tiling mechanism with minimal settling time.
It is still further an object of the present invention to provide a scanning camera with zoom and prescan capabilities.
This invention provides an image input device for providing a composite image of an object composed of a plurality of sub-images of the object. The system comprises an image sensor for receiving a sub-image, a lens for focusing the sub-image on the image sensor, an optical deflecting means positioned between the lens and the object, the deflecting means having a plurality of optical elements, each such element for deflecting one of a plurality of sub-images to the lens, and control means for causing the optical deflection means to sequence through the sub-images comprising the composite image to form a composite image.
Brief Description Of The Drawings The above and other objects and advantages of this invention will be apparent on consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout, and in which:
FIG. 1 is a schematic illustration of a first embodiment of the invention;
FIG. 2A is a bottom view of the disk of holographic optical elements of the first embodiment of the invention;
FIG. 2B is a bottom view of an alternate embodiment of the disk of FIG. 2A;
FIG. 3A is an illustration of a tiling pattern used in the first embodiment of the invention; FIG. 3B is an illustration of an embodiment of the invention including a focal correction lens;
FIG. 3C is an illustration of an embodiment of the invention including a motor-driven focus adjustment;
FIG. 4 is a schematic illustration of a second embodiment of the invention;
FIG. 5 is a schematic illustration of a third embodiment of the invention; FIG. 6 is a schematic illustration of a fourth embodiment of the invention;
FIG. 7 is a schematic illustration of a fifth embodiment of the invention; and
FIG. 8 is a schematic embodiment of a linear slide of optical deflectors.
Detailed Description of the Invention
The imaging system of the present invention provides both a real-time (television-frame rate) camera and a high resolution scanning camera. The camera uses an area array charge coupled device ("CCD") sensor to provide the real-time imaging capability. The high resolution scanning mode of the camera is implemented by stepping the point of gaze of the CCD sensor over an object image, such as an 8.5 by 12.5 inch document, so that the document image is acquired as a series of tiles. In a first embodiment, a 32-element disk functions as an optical deflector. Step-wise rotation of the optical deflection disk steps the point of gaze of the CCD array over an object plane so that 32 image "tiles" are acquired. The tiles are "stitched" together in the scanner's memory to form a complete composite image. In a preferred embodiment discussed below, a sampling resolution of 300 dots per inch can be achieved over an 8.5 by 12.5 inch area, with a time to scan from 2 to 4 seconds, based on photometric calculations for the optics and CCD, and including the predicted settling time for disk motion. A first preferred embodiment of the imaging system of the present invention, as shown in FIG. 1, comprises an image sensor 10, a lens 20, an optical deflection means 30, a positioning means 50 having a shaft 52, and an image processor 70. Object plane 25, which is not a part of the invention, indicates the location of the image to be scanned.
Image sensor 10 receives an optical image and provides an electrical representation of the image as an output. Image sensors are well known in the art. An illuminator or monochromatic light source 15 may be used to improve the signal-to-noise ratio of image sensor 10. Image sensor 10 is preferably an area array CCD, such as the TC245 available from Texas Instruments Incorporated, Dallas, Texas. The TC245 has 365,420 pixels arranged as 484 lines of 755 pixels. The TC245 generates an NTSC interlaced video format; therefore, two fields, one comprising odd-numbered scan lines and one comprising even-numbered scan lines, comprise a frame. Each of the two fields is transferred at a 60 Hz rate; therefore, the frame transfer rate is 30 Hz. The output frames from image sensor 10 are coupled to sensor interface 72, which is shown in FIG. 1 as part of image processor 70. Sensor interface 72 is preferably a TCK 244/245 CCD image sensor evaluation kit available from Texas Instruments, or an integrated circuit chip set, also available from Texas Instruments, for driving the TC245. Sensor interface 72 receives frame information from image sensor 10 and passes it to frame grabber 74. Frame grabber 74 is preferably model number SVM-BW-1MB-20-14.3 available from EPIX, Inc., Northbrook, Illinois. Frame grabber 74 stores and formats the frame information from sensor interface 72, and provides the frame information to personal computer 76. Although it is shown outside personal computer 76, frame grabber 74 is available as a circuit card which plugs into personal computer 76. Personal computer 76, which is an IBM PC in the first preferred embodiment, executes known software algorithms to combine the frames into a composite image stored in memory 90, which is shown as part of personal computer 76 in the first preferred embodiment. One skilled in the art will appreciate that a wide variety of commercially available products may be substituted for image sensor 10, sensor interface 72, frame grabber 74 and personal computer 76 without departing from the scope of the present invention.
Deflection means 30 comprises a moveable array of fixed optical deflection elements 35 for dividing the object image into a plurality of image tiles. One embodiment of deflection means 30 comprises a disk 32, rotatable about its central axis, having 32 holographic optical elements 201-232 disposed about its circumference as shown in FIG. 2A. For clarity, only one of the 32 holographic optical elements is shown in FIG. 1; however, it is to be understood that element 35 represents one of a plurality of elements. It is further to be understood that the deflection means of the present invention is not limited to 32 elements. More or fewer elements may be selected depending on the application. Disk 32 serves as an optical deflector, with each element 201-232 along its circumference corresponding to a tile position. Positioning means 50 causes disk 32 to rotate, thereby bringing each of the holographic optical elements 201-232 sequentially into the optical path to deflect its corresponding sub-image to image sensor 10. Holographic optical elements 201- 232 are manufactured, according to known methods, to incorporate microscopic ridges to serve as a diffraction grating on a portion of disk 32, which is preferably a molded plastic material.
Imaging lens 20 is provided in the optical path between deflection element 35 and image sensor 10 to project the object onto image sensor 10. Deflection element 35 is positioned in front of lens 20 (between lens 20 and the object to be imaged on object plane 25) to avoid off-axis image distortion. The angle subtended by the image from deflection element 35 is much smaller than the angle subtended by the image on object plane 25. Positioning lens 20 in front of deflection element 35 is undesirable, because lens 20 would then have to subtend a much larger angle. A larger angle would require lens 20 to be a much more costly wide-angle lens, and such a lens would be more prone to aberrations. In the first embodiment, disk 32 is mounted on shaft 52 of a stepping motor, which serves as positioning means 50. After moving to a new position, a stepping mechanical scanning mechanism requires a settling time in which to stop vibrating, in order to capture a sub-image. The settling time of the tiling scanning mechanism determines, in part, the rate at which images may be captured. If the image capture rate does not allow the tiling scanning mechanism to settle, the captured images will be distorted; allowing too great a time between capturing images unduly slows the image acquisition process. Accordingly, it is preferable to provide a scanning mechanism with minimal settling time. Disk 32 should preferably be constructed of a thin, lightweight material such as plastic in order to minimize its settling time. For each tile to be acquired, the disk is positioned and allowed to settle. Alignment of disk 32 is not critical on any axis. Moreover, disk 32 has a low mass. From these considerations it follows that positioning will be possible within one frame time of image sensor 10 per tile, and that disk 32 may be supported by shaft 52 alone.
Positioning means 50 is electrically coupled to control means 80. In response to signals from control means 80, positioning means 50 positions disk 32 in one of the 32 angular positions occupied by holographic optical elements 201-232 shown in FIG. 2. Each position corresponds to one setting of deflection means 30. Because alignment of holographic element 35 is not critical, positioning means 50 may comprise an open-loop positioning mechanism. An open-loop system is inherently faster than a closed-loop system, because the closed-loop system operates by making a series of adjustments to achieve precise positioning, whereas the open-loop system seeks its desired position in just one step.
Disk 37, shown in FIG. 2B, comprises a disk encircled by a band of holographic elements 251-282 disposed along its circumference. Because elements
251-282 provide a continuum of deflectors, positioning means 50 can comprise a continually rotating motor instead of a stepping motor. A further benefit of the deflection continuum provided by elements 251-282 is that minor defects in the holographic material average out. An image is acquired when the boundaries of an element, such as element 251, are in alignment with a desired tile. Each element 251-282 corresponds to a frame transfer from image sensor 10. Accordingly, disk 37 should rotate at a speed that allows image sensor 10 to transfer both fields comprising a frame at a single deflection setting.
Control means 80 may be a conventional stand¬ alone computer or microprocessor, or may be part of image processor 70 as shown in FIG. 1. Control means 80 causes positioning means 50 to stop deflection means 30 at known positions or settings. Control means 80 further directs memory 90 to store the images received from image sensor 10 at appropriate times, allowing for the settling time of deflection means 30.
In an exemplary embodiment of the system of the present invention lens 20 would be 15 inches (26.67 cm.) from an object on object plane 25, and would have a minimum depth of focus of 10 mm. Based on the pixel dimensions of the TC245 image sensor and the desired
300 dot per inch resolution, a demagnification of 8.41X is required from object plane 25 to sensor 10. Using these parameters and basic lens equations, expected working values for the optical path are that lens 20 have a 40 mm focal length and f#10, 4.5 mm aperture, working distance of 380 mm, and depth of field of 14 mm. Assuming 800 lux room level illumination and 50% page reflectivity yields sensor illumination of 1.0 lux. This corresponds to 4 times the dark current of the TC245 sensor when operated at television frame rates (16.6 ms integration time per frame). An illuminator 15 can improve the signal-to-noise ratio for sensor 10. A near-IR filter may be included in the optical path to compensate for the chromaticity of holographic elements 201-232. Scanning time is expected to be limited by the sum of the tile stepping time (assumed to be 33.3 ms per tile) and frame acquisition time; therefore, the minimum time to acquire all 32 tiles is expected to be 2.13 seconds. FIG. 3A illustrates the tiling scheme adopted in the first preferred embodiment of the invention. Tiles 301-332 correspond to the 32 tiling elements 201- 232 shown in FIG. 2A. Tiles 301-332 comprise the object, for example a page of printed text, located on object plane 25. A 4X8 array of tiles is shown, based on the layout of the TC245 sensor, with the horizontal scanning axis of the sensor aligned with the short dimension of the page. This alignment is preferred for a page of printed text, because page images can be properly displayed without image rotation. FIG. 3A shows the optical path of tile 312 from object plane 25, through holographic optical element 35 and lens 20, to image sensor 10. Line 350 indicates the uncorrected focal surface and its relation to object plane 25. It is to be understood that line 350 is a cross-section of the focal surface, which is spherical.
As shown in FIG. 3A, uncorrected focal surface 350 curves through object plan 25. If optimum focus is obtained at a point falling on tile 310, then tile 301 will be out of focus. Lens 22, shown in FIG. 3B, corrects the disparity between object plane 25 and uncorrected focal surface 350. Lens 22 is mounted on the upper surface of disk 32, above representative holographic optical element 35. It is to be understood that a lens corresponding to lens 22 would be provided, as needed, for each optical element 201-232, and each such lens 22 would correct for the particular focal length disparity of each corresponding optical element 201-232. Some tiles intersect the focal surface and therefore, require no correction. Lens 22 will slightly alter the size of its corresponding tile as seen by image sensor 10. Correction for this scaling, as well as distortion imposed by the angle of view, may take place in software. Because holographic optical elements 201-232 are diffractive optics, the diffraction rulings can be arranged to include both a lens and a prism by appropriate micromachining or molding operations. Therefore, holographic optical elements 201-232 can incorporate lens 22, instead of adding a plano-convex lens to the upper surface of disk 32.
The 32 tiles acquired must adjoin each other perfectly in order to assemble a single composite image from the 32 acquired sub-images. Although disk 32 may not yield perfect alignment accuracy, it will provide highly repeatable alignment for any disk, and from disk to disk. Errors in the master disk may be characterized and modeled in software. The magnification changes created by focal length correction, the angle of view distortion and errors in deflection angle produced by individual deflection elements also can be modeled. It thus follows that known post-scan electronic correction may be applied using known image warping methods to correct for the aggregate error. (See, Wolberg, Digital Image Warping) . It is only necessary to insure that HOE deflection errors create an overlap of tiles, rather than gaps between tile regions. Element 233, shown in FIG. 2A, provides for a real-time zoom function. Element 233 is an optically neutral element (such as a hole) that allows light to pass through undeflected. One skilled in the art will recognize that additional known optical elements can be inserted into the optical path between disk 32 and lens 20 to implement fully a zoom function and also to provide an extra motor-driven focus adjustment 24, shown in FIG. 3C. Focus adjustment 24 brings into optimum focus objects on object plane 25 that stand higher than the depth of field or which are not flat, such as books or household objects. Both focus adjustment 24 and optical zoom may be implemented using standard optical techniques.
A second preferred embodiment of the system of the present invention is shown in FIG. 4. In the second embodiment, mirror 36 serves as the optical deflection element. Wedge support 34 is used to affix mirror 36 to disk 32. Only one mirror 36 is depicted in FIG. 4; however, it is to be understood that a plurality of mirrors are disposed around the circumference of disk 32, similar to the holographic optical elements encircling disk 32 in FIG. 2. Each mirror 36 is affixed to disk 32 at a different angle, so that a two dimensional tiling pattern is obtained as in the first embodiment.
Mirrors, in contrast to transmissive deflection elements such as prisms and holographic optical elements, tend to provide blurred images if the settling time of disk 32 is inadequate. Moreover, even with adequate settling time, mirrors require absolute positional accuracy. Accordingly, positioning means 50 preferably uses a closed-loop system to avoid the image distortion problem with mirrors. The closed-loop system is slower, but more precise, than an open-loop system, because the closed-loop positioning means hunts for the proper position until it is successful.
A third preferred embodiment of the system of the present invention is shown in FIG. 5. In the third embodiment, a plurality of offset plano-convex lens pairs 44, 45 are disposed around the circumference of transparent disk 42. Lens 20 is not required in this embodiment, because the offset lens pair 44, 45 can adequately focus the sub-image onto image sensor 10. A fourth preferred embodiment is shown in FIG. 6, wherein wedge prisms 47 act as optical deflection means, disposed around the circumference of transparent disk 42. As in the previous figures, prism 47 represents one of a plurality of optical deflectors. A correction lens, such as lens 22 shown in FIG. 3B, may also be used in conjunction with prism 47.
In a fifth embodiment of the invention, shown in FIG. 7, deflection means 30 comprises a pair of mirror galvanometers 53, 55. Mirror galvanometers are available from General Scanning, Inc., Watertown, Massachusetts. Mirror galvanometer 55 comprises mirror 38, shaft 56 and motor 58. Mirror 38 rotates on shaft 56 of motor 58, in response to signals from control 80. Mirror 37 rotates on axis 54, which is the shaft of the motor (not shown) of mirror galvanometer 53. Mirrors 38 and 37 have mutually perpendicular axes of rotation, an X-axis and a Y-axis, thereby allowing scanning of object plane 25 in two directions. Each tile setting for mirror galvanometers 53, 55, comprises an X- coordinate, corresponding to rotation about axis 56 and a Y-coordinate corresponding to rotation about axis 54. One skilled in the art will appreciate that circular, cylindrical or spherical coordinates could be substituted for the X-Y coordinate system, and that a single gimbel-mounted mirror could provide a scanning means as well. Other mirror arrangements can also be employed, provided that a suitable drive motor is used that can position the mirrors with a high degree of repeatabi1ity.
In contrast to previous embodiments comprising a plurality of fixed optical deflectors, mirror galvanometers 53, 55 provide a variable number of scanning settings. Therefore, mirror galvanometers 53, 55 provide a variable scanning means, capable of scanning either a discrete series or a continuum of sub-images. Prisms are a preferred deflection element, because they are inexpensive, relatively position insensitive and easily manufactured in arrays, with each array in a manufacturing run exhibiting the same characteristics as the other arrays in the batch.
Thus, if several deflector arrays are manufactured from the same mold, element 231 in each array will exhibit the same characteristics. Therefore, any minor optical deviation in element 231 can be corrected either in software or by additional optical elements.
Holographic optical elements also provide highly consistent characteristics within a manufacturing batch; however, holographic optical elements are more highly chromatic than prisms. Prisms have far less chromaticity than holographic optical elements for a given amount of deflection. Accordingly, prisms are preferred deflection elements in applications where chromaticity is a problem. As an alternative, a monochromatic light source 15, shown in FIG. 1A, can be used with holographic optical elements.
Other embodiments of the invention will be apparent to those skilled in the art. For example, disk 32 could easily be replaced by an array of image deflectors disposed on linear slide 33 as shown in FIG. 8, or on a loop or a cylinder. Similarly, image deflectors other than mirrors, prisms, offset lens pairs, mirror galvanometers and holographic optical elements can be used without departing from the spirit of the invention. The scanning camera of the present invention can obtain a pre-scan image in the time required by one extra step of the deflection means, by adding an additional optical focusing element that, in conjunction with motor-driven focus adjustment 24, focuses the entire object image onto image sensor 10. The low resolution grey-scale image so obtained can be analyzed in software by an area-histogram to produce a thresholding map. This map may then be used dynamically to vary the binarizing threshold applied to incoming pixels during high resolution scanning. This permits the acquisition of accurate text images over tinted backgrounds, even on the multicolor pages commonly found in periodicals.
Thus, it may be seen that the real-time imaging capacity inherent in the scanning camera of the present invention permits the simplified provision of essential features in image scanning applications which do not need real-time display capability.
It will be understood that the particular embodiments described above are only illustrative of the principles of the present invention, and that various modifications could be made by those skilled in the art without departing from the scope and spirit of the present invention, which is limited only by the claims that follow.

Claims

WHAT IS CLAIMED IS:
1. An image input device for providing a composite image of an object, the composite image comprising a plurality of sub-images, the system comprising: an image sensor for receiving one of the plurality of sub-images and for providing electrical signals representative of the sub-image; a lens for focusing the sub-image onto the image sensor; a variable optical deflection means having a plurality of optical settings, each corresponding to one of the plurality of sub-images, for deflecting one of the plurality of sub-images onto the lens, the variable optical deflection means being disposed between the object and the lens; and control means for moving the optical deflection means so that each of the sub-images that comprise the composite image is sequentially deflected onto the image sensor via the lens, such that when each sub-image is deflected onto the lens, that sub-image fills the lens completely.
2. The apparatus of claim 1, further comprising memory means coupled to the image sensor for storing the electrical signals representative of the sub-images.
3. The apparatus of claim 2, further comprising processing means for combining the electrical signals representative of the sub-images stored in memory to provide an electrical representation of the composite image.
4. The apparatus of claim 1 wherein the variable optical deflection means comprises a mirror galvanometer.
5. The apparatus in claim 1 wherein the variable optical deflection means has a further optical setting in which an additional image is deflected onto the image sensor, the image sensor providing a real¬ time imaging capability.
6. An optical imaging system, comprising: an image sensor having a fixed number of pixels for receiving an optical sub-image and for providing an electrical representation of the received sub-image; moveable tiling means having a plurality of image deflectors for optically dividing the image of an object into a plurality of sub-images and for deflecting each sub-image to the image sensor; positioning means coupled to the tiling means, for sequentially positioning each image deflector to deflect its corresponding sub-image to the image sensor in a predetermined sequence; image processing means, coupled to the image sensor and the tiling means, for receiving the electrical representation of each sub-image from the image sensor and combining the sub-images to form a composite image comprising a number of pixels greater than the fixed number of pixels in the image sensor, the image processing means correcting for image distortion produced by individual image deflectors.
7. The apparatus of claim 6, further comprising an imaging lens positioned between the image sensor and the tiling means for focusing the sub-image from the tiling means onto the image sensor.
8. The apparatus of claim 7 wherein the tiling means comprises a disk of mirrors.
9. The apparatus of claim 7, wherein the tiling means comprises a disk of prisms.
10. The apparatus of claim 7, wherein the tiling means comprises a linear array of mirrors.
11. The apparatus of claim 7, wherein the tiling means comprises a linear array of prisms.
12. The apparatus of claim 7, wherein the tiling means further comprises a focusing means and a motor-driven lens between the focusing means and the imaging lens for deflecting an image of the entire object to the image sensor, so that a prescan function may be performed.
13. The apparatus of claim 6, wherein the image processing means comprises a memory means for storing an electrical representation of each sub-image and a processor for combining the sub-images to form the composite image.
14. The apparatus of claim 13, further comprising frame grabber means coupled to the image sensor and the processor, for buffering frames between the image sensor and the processor.
15. The apparatus of claim 6, wherein the tiling means further comprises a focus correction means for each of the image deflectors.
16. The apparatus of claim 6, wherein the positioning means comprises a stepping motor.
17. The apparatus of claim 6, wherein the image sensor comprises a charge-coupled device.
18. An image input device for providing a composite image of an object, the composite image comprising a plurality of sub-images, the system comprising: an image sensor for receiving one of the plurality of sub-images and for providing electrical signals representative of the sub-image; a lens for focusing the sub-image onto the image sensor; a rotatable disk having a plurality of optical elements each of which may be rotated to come between the object and the lens, each optical element corresponding to one of the plurality of sub-images, for deflecting one of the plurality of sub-images onto the lens, such that when each sub-image is deflected onto the lens, that sub-image fills the lens completely; and control means for rotating the rotatable disk so that each of the sub-images that comprise the composite image is sequentially deflected onto the image sensor via the lens.
19. The apparatus of claim 18, further comprising memory means coupled to the image sensor for storing the electrical signals representative of the sub-images.
20. The apparatus of claim 19, further comprising processing means for combining the electrical signals representative of the sub-images stored in memory to provide an electrical representation of the composite image.
21. The apparatus of claim 18, wherein the image sensor comprises a charge coupled device.
22. The apparatus of claim 18, further comprising means for illuminating the object.
23. The apparatus of claim 18, further comprising optical zoom means located in the optical path between the lens and the.rotatable disk.
24. A scanning video camera comprising: a base for supporting an object to be imaged; a monochromatic illuminating means for illuminating the object; means for optically dividing an image of the object into a plurality of image tiles; an optical imaging means for providing an electrical output representative of a received image; an optical deflection means for deflecting the image of one of the plurality of tiles comprising the object image onto the imaging means; control means for causing the optical deflection means to scan sequentially the plurality of tiles; and processing means coupled to the optical imaging means and the control means for combining a plurality of images received by the imaging means into a composite image, the processing means correcting for image distortion.
25. The apparatus in claim 24 wherein the optical deflection means further comprises means for deflecting an additional image onto the optical imaging means, the optical imaging means providing a real-time imaging capability.
26. The apparatus of claim 24 wherein the processing means performs electronic image warping to correct for angle-of-view distortion.
27. An image input device for providing a composite image of an object, the composite image comprising a plurality of sub-images, the system comprising: an image sensor for receiving one of the plurality of sub-images and for providing electrical signals representative of the sub-image; a lens for focusing the sub-image onto the image sensor; a movable linear array of optical elements each of which may be positioned to come between the object and the lens, each optical element corresponding to one of the plurality of sub-images, for deflecting one of the plurality of sub-images onto the lens, such that when each sub-image is deflected onto the lens, that sub-image fills the lens completely; and control means for positioning the optical deflection means so that each of the sub-images that comprise the composite image is sequentially deflected onto the image sensor via the lens.
28. The apparatus of claim 27, wherein the linear array comprises an array of prisms.
29. The apparatus of claim 27, wherein the linear array comprises an array of mirrors.
30. An image input device for providing a composite image of an object, the composite image comprising a plurality of sub-images, the system comprising: an image sensor for receiving one of the plurality of sub-images and for providing electrical signals representative of the sub-image; a lens for focusing the sub-image onto the image sensor; a moveable optical deflection means having a plurality of optical elements, each corresponding to one of the plurality of sub-images, for deflecting one of the plurality of sub-images onto the lens; control means for moving the optical deflection means so that each of the sub-images that comprise the composite image is sequentially deflected onto the image sensor via the lens; and a plurality of focus correction means located in the optical path between the lens and the optical deflection means, wherein each focus correction means is associated with one of the optical elements for correcting for the variations in the distance between the object and the lens.
31. The apparatus of claim 30 wherein each of the optical elements comprises a holographic deflecting element that incorporates a corrective lens.
32. A scanning digital video camera for providing a video representation of an object image, the camera comprising: an array of photosensitive elements, for providing an electrical representation of a received image; a lens for focusing an image onto the photosensitive array; tiling means for dividing the image of an object into a plurality of image tiles, the tiling means comprising a moveable set of fixed optical deflection elements, each element corresponding to an image tile; means for positioning the tiling means so that each of the plurality of image tiles is sequentially deflected to the lens, such that the tiles overlap; a memory coupled to the photosensitive array for storing the electrical representation of each received image; control means coupled to the positioning means and the memory means, for causing the positioning means to step sequentially through each of the plurality of image tiles and for causing the memory means to store the electrical representation of each image tile; and processing means for combining the image tile representations stored in memory to produce an electrical representation of the object image.
33. An optical imaging system, comprising: an image sensor having a fixed number of pixels for receiving an optical sub-image and for providing an electrical representation of the received sub-image; moveable tiling means having a plurality of image deflectors for optically dividing the image of an object into a plurality of sub-images and for deflecting each sub-image to the image sensor; positioning means coupled to the tiling means, for sequentially positioning each image deflector to deflect its corresponding sub-image to the image sensor in a predetermined sequence; image processing means, coupled to the image sensor and the tiling means, for receiving the electrical representation of each sub-image from the image sensor and combining the sub-images to form a composite image comprising a number of pixels greater than the fixed number of pixels in the image sensor, wherein the tiling means comprises a disk of offset plano-convex lens pairs.
34. An optical imaging system, comprising: an image sensor having a fixed number of pixels for receiving an optical sub-image and for providing an electrical representation of the received sub-image; moveable tiling means having a plurality of image deflectors for optically dividing the image of an object into a plurality of sub-images and for deflecting each sub-image to the image sensor; positioning means coupled to the tiling means, for sequentially positioning each image deflector to deflect its corresponding sub-image to the image sensor in a predetermined sequence; image processing means, coupled to the image sensor and the tiling means, for receiving the electrical representation of each sub-image from the image sensor and combining the sub-images to form a composite image comprising a number of pixels greater than the fixed number of pixels in the image sensor, wherein the tiling means comprises a linear array of offset plano-convex lens pairs.
35. An image input device for providing a composite image of an object, the composite image comprising a plurality of image tiles, the system comprising: an image sensor for receiving one of the plurality of image tiles and for providing electrical signals representative of the image tiles, the image sensor having a fixed number of pixels; a lens for focusing the image tiles onto the image sensor; a variable optical deflection means having a plurality of optical settings, each corresponding to one of the plurality of image tiles, for deflecting one of the plurality of image tiles onto the lens, the variable optical deflection means deflecting the image tiles so that the image tiles overlap; control means for moving the optical deflection means so that each of the image tiles is sequentially deflected onto the image sensor via the lens; and means for combining the image tiles to form a composite image comprising a number of pixels greater than the fixed number of pixels in the image sensor, wherein the overlap of the image tiles allows the means for combining to form the composite image without gaps.
36. An image input device for providing a composite image of an object, the composite image comprising a plurality of sub-images, the system comprising: an image sensor for receiving one of the plurality of sub-images and for providing electrical signals representative of the sub-image; a lens for focusing the sub-image onto the image sensor; a moveable optical deflection means having a plurality of optical elements, each corresponding to one of the plurality of sub-images, for deflecting one of the plurality of sub-images onto the lens; and control means for moving the optical deflection means so that each of the sub-images that comprise the composite image is sequentially deflected onto the image sensor via the lens, wherein the optical deflection means comprises a holographic optical disk, such that the plurality of optical elements comprise holographic elements.
PCT/US1993/000294 1992-01-14 1993-01-12 Image input device having optical deflection elements for capturing multiple sub-images WO1993014594A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP5512639A JPH07503113A (en) 1992-01-14 1993-01-12 Image input device with optical deflection elements for capturing multiple sub-images
AU34714/93A AU663760B2 (en) 1992-01-14 1993-01-12 Image input device having optical deflection elements for capturing multiple sub-images
EP93903458A EP0622001A1 (en) 1992-01-14 1993-01-12 Image input device having optical deflection elements for capturing multiple sub-images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US82056892A 1992-01-14 1992-01-14
US820,568 1992-01-14

Publications (1)

Publication Number Publication Date
WO1993014594A1 true WO1993014594A1 (en) 1993-07-22

Family

ID=25231168

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1993/000294 WO1993014594A1 (en) 1992-01-14 1993-01-12 Image input device having optical deflection elements for capturing multiple sub-images

Country Status (4)

Country Link
EP (1) EP0622001A1 (en)
JP (1) JPH07503113A (en)
AU (1) AU663760B2 (en)
WO (1) WO1993014594A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0676890A2 (en) * 1994-03-28 1995-10-11 SUSSMAN, Michael Image input device having optical deflection elements for capturing multiple sub-images
EP0748108A2 (en) * 1995-06-07 1996-12-11 Xerox Corporation Method of electronic scanning
FR2740930A1 (en) * 1995-11-08 1997-05-09 Telecommunications Sa Acquisition of two electronic matrix images from different directions e.g. for output to video monitor
WO1998005990A1 (en) * 1996-08-03 1998-02-12 The Secretary Of State For Defence Optical detection system
WO2003012518A2 (en) * 2001-07-31 2003-02-13 Interscope Technologies, Inc. A system for creating microscopic digital montage images
US7212660B2 (en) 2001-01-11 2007-05-01 Clarient, Inc. System and method for finding regions of interest for microscopic digital montage imaging
CN103776232A (en) * 2013-11-05 2014-05-07 四川长虹电器股份有限公司 Photosynthetic fresh-keeping refrigerator based on image recognition and implementation method thereof
TWI510052B (en) * 2013-12-13 2015-11-21 Xyzprinting Inc Scanner

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3614190A (en) * 1969-03-28 1971-10-19 Holotron Corp Undistorted image demagnification by holographic information sampling
US3669812A (en) * 1970-10-16 1972-06-13 Bendix Corp Substrate support module
US4004086A (en) * 1974-07-06 1977-01-18 Grundig E.M.V. Elektro-Mechanische Versuchsanstalt Max Grundig Apparatus for the television reconnoitering of terrain from the air
US4323925A (en) * 1980-07-07 1982-04-06 Avco Everett Research Laboratory, Inc. Method and apparatus for arraying image sensor modules
US4383170A (en) * 1979-11-19 1983-05-10 Tokyo Shibaura Denki Kabushiki Kaisha Image input device
US4516032A (en) * 1980-12-22 1985-05-07 Burroughs Corporation Electro-optical imaging system
US4589030A (en) * 1983-07-25 1986-05-13 Kley Victor B Solid state camera
US5064258A (en) * 1988-12-09 1991-11-12 Ricoh Company, Ltd. Information reading device
US5182659A (en) * 1991-02-20 1993-01-26 Holographix, Inc. Holographic recording and scanning system and method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS599623A (en) * 1982-07-08 1984-01-19 Ricoh Co Ltd Hologram scanner
FR2627042B1 (en) * 1988-02-05 1990-07-06 Eduvision Sa DEVICE FOR TAKING PICTURES OF HIGH DEFINITION STILL IMAGES
US4967264A (en) * 1989-05-30 1990-10-30 Eastman Kodak Company Color sequential optical offset image sampling system
EP0462748A3 (en) * 1990-06-20 1992-04-22 Thorn Emi Plc Imaging arrangement

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3614190A (en) * 1969-03-28 1971-10-19 Holotron Corp Undistorted image demagnification by holographic information sampling
US3669812A (en) * 1970-10-16 1972-06-13 Bendix Corp Substrate support module
US4004086A (en) * 1974-07-06 1977-01-18 Grundig E.M.V. Elektro-Mechanische Versuchsanstalt Max Grundig Apparatus for the television reconnoitering of terrain from the air
US4383170A (en) * 1979-11-19 1983-05-10 Tokyo Shibaura Denki Kabushiki Kaisha Image input device
US4323925A (en) * 1980-07-07 1982-04-06 Avco Everett Research Laboratory, Inc. Method and apparatus for arraying image sensor modules
US4516032A (en) * 1980-12-22 1985-05-07 Burroughs Corporation Electro-optical imaging system
US4589030A (en) * 1983-07-25 1986-05-13 Kley Victor B Solid state camera
US5064258A (en) * 1988-12-09 1991-11-12 Ricoh Company, Ltd. Information reading device
US5182659A (en) * 1991-02-20 1993-01-26 Holographix, Inc. Holographic recording and scanning system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP0622001A4 *

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5686960A (en) * 1992-01-14 1997-11-11 Michael Sussman Image input device having optical deflection elements for capturing multiple sub-images
EP0676890A3 (en) * 1994-03-28 1996-05-15 Michael Sussman Image input device having optical deflection elements for capturing multiple sub-images.
EP0676890A2 (en) * 1994-03-28 1995-10-11 SUSSMAN, Michael Image input device having optical deflection elements for capturing multiple sub-images
EP0748108A3 (en) * 1995-06-07 1999-05-06 Xerox Corporation Method of electronic scanning
EP0748108A2 (en) * 1995-06-07 1996-12-11 Xerox Corporation Method of electronic scanning
FR2740930A1 (en) * 1995-11-08 1997-05-09 Telecommunications Sa Acquisition of two electronic matrix images from different directions e.g. for output to video monitor
GB2330976B (en) * 1996-08-03 2000-05-31 Secr Defence Optical detection system
GB2330976A (en) * 1996-08-03 1999-05-05 Secr Defence Optical detection system
WO1998005990A1 (en) * 1996-08-03 1998-02-12 The Secretary Of State For Defence Optical detection system
US6630952B1 (en) 1996-08-03 2003-10-07 Qinetiq Limited Optical detection system
US7212660B2 (en) 2001-01-11 2007-05-01 Clarient, Inc. System and method for finding regions of interest for microscopic digital montage imaging
US7421102B2 (en) 2001-01-11 2008-09-02 Carl Zeiss Microimaging Ais, Inc. System and method for finding regions of interest for microscopic digital montage imaging
US7869641B2 (en) 2001-01-11 2011-01-11 Carl Zeiss Microimaging Gmbh System and method for finding regions of interest for microscopic digital montage imaging
US7876948B2 (en) 2001-01-11 2011-01-25 Carl Zeiss Microimaging Gmbh System for creating microscopic digital montage images
WO2003012518A2 (en) * 2001-07-31 2003-02-13 Interscope Technologies, Inc. A system for creating microscopic digital montage images
WO2003012518A3 (en) * 2001-07-31 2003-07-03 Interscope Technologies Inc A system for creating microscopic digital montage images
CN103776232A (en) * 2013-11-05 2014-05-07 四川长虹电器股份有限公司 Photosynthetic fresh-keeping refrigerator based on image recognition and implementation method thereof
TWI510052B (en) * 2013-12-13 2015-11-21 Xyzprinting Inc Scanner

Also Published As

Publication number Publication date
JPH07503113A (en) 1995-03-30
AU663760B2 (en) 1995-10-19
AU3471493A (en) 1993-08-03
EP0622001A4 (en) 1994-09-08
EP0622001A1 (en) 1994-11-02

Similar Documents

Publication Publication Date Title
US5686960A (en) Image input device having optical deflection elements for capturing multiple sub-images
WO2003083805A1 (en) Low vision video magnifier
EP0120911A1 (en) Film video player.
EP0748108A3 (en) Method of electronic scanning
US5025313A (en) System for minimizing optical distortions and chromatic aberrations in a linear color scanner
JPH0813088B2 (en) Image reader
AU663760B2 (en) Image input device having optical deflection elements for capturing multiple sub-images
US5067020A (en) Dual sensor film scanner having coupled optics and a video viewfinder
US7586662B2 (en) Three-dimensional light ray input apparatus
US20040012705A1 (en) Distortion-free imaging device having curved photosensor
US6686956B1 (en) Increased resolution digital capture device
JP2003101733A (en) Image-reading apparatus
EP0866353A2 (en) Document reader and method for adjusting its focus
US6771310B1 (en) Image pickup apparatus with optical beam shifting with independently controlled optical elements
US5703729A (en) Image inputting apparatus
US6434274B1 (en) Image capturing device provided with focusing system
JP3027915B2 (en) Image scanner and its image reading method
US6891643B1 (en) Imaging device and imaging method
JPH11127375A (en) Panoramic image pickup device
CN1134976C (en) Apparatus for conversion of picture of map into electronic signal
JPH0815598A (en) Focusing method for rear focus type zoom lens
JPH11220664A (en) Method for inputting image and device therefor and electronic camera
JPH09102914A (en) Optical system
JPH07236095A (en) Image pickup device
JPH06105940B2 (en) Image reader

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AT AU CA CH DE DK ES FI GB JP LU NL NO SE

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 1993903458

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1993903458

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: CA

WWW Wipo information: withdrawn in national office

Ref document number: 1993903458

Country of ref document: EP