WO2011028620A1

WO2011028620A1 - Multiplexed biometric imaging and dual-imager biometric sensor

Info

Publication number: WO2011028620A1
Application number: PCT/US2010/046852
Authority: WO
Inventors: Ryan Martin; Robert K. Rowe; Steve P. Corcoran; Gary Rogers
Original assignee: Lumidigm, Inc.
Priority date: 2009-08-26
Filing date: 2010-08-26
Publication date: 2011-03-10
Also published as: US20110211055A1; BR122013021647A2; CN102576408A; US20110085708A1; US8731250B2; US8872908B2; IL218238A0; EP2471023A1; DE112010003414T5; BR112012004177A2

Abstract

Some embodiments disclose systems and methods for a multiplexed multispectral imaging, object discrimination, background discrimination, and/or object identification. In some embodiments, a multispectral sensor is provided that includes at least two illumination sources and an imager with a color filter array. The two illumination sources can illuminate a platen with light having distinct illumination angles and distinct characteristics. The color filter array, which may be integral with the imager or separate therefrom, can filter light based on specific distinctions between the two illumination sources. A single image of an object at the platen can be acquired. Individual pixels of the image will then be highly associated with one or the other illumination source. Because of the filtering by the color filter array, this image will include information about the illumination angle. Some embodiments disclose a dual-imager biometric sensor. The two imagers may include a direct imager and a TIR imager.

Description

MULTIPLEXED BIOMETRIC IMAGING AND DUAL-IMAGER

BIOMETRIC SENSOR

CROSS-REFERENCES TO RELATED APPLICATIONS

[0001] This application is a non-provisional, and claims the benefit, of commonly assigned U.S. Provisional Application No. 61/237,189, filed August 26, 2009, entitled "Multiplexed Biometric Imaging and Dual-Imager Biometric Sensor," the entirety of which is herein incorporated by reference for all purposes.

BACKGROUND

[0002] Multispectral sensors can acquire images of an object under a plurality of distinct illumination and/or imaging conditions. Images from multispectral sensors can be used for various purposes such as for biometric imaging, bar code reading and authentication, documentation authentication, and quality assurance, to name a few.

[0003] Conventional optical fingerprint sensors typically incorporate a single total internal reflectance (TIR) imager, which can require that a number of conditions be met to provide a good fingerprint image. These conditions can include the requirement that the fingerprint ridges are intact, clean, in optical contact with the sensor surface, and that the skin is of proper moisture content, i.e., neither too dry nor too wet. If any of these conditions aren't met, the resulting fingerprint image can be degraded or even missing entirely. However, when these conditions are met, the resulting image is generally of high quality and useful for both automated analysis and analysis by a human observer.

[0004] Multispectral sensors and others based on direct imaging can acquire images under a much broader range of conditions of the skin, the local environment, and the nature of the interface between the skin and sensor. However, such images are generally of lower contrast than the corresponding TIR image, if the TIR image is of high quality.

[0005] It can be a time consuming process for a sensor to illuminate and acquire images from the plurality of distinct optical and/or imaging conditions. Multispectral sensors often have difficulty determining when an object is properly placed at the sensor for imaging, determining whether an object is a proper object for imaging, and/or distinguishing between an object for imaging and background objects.

SUMMARY

[0006] Various embodiments of the invention are described herein for use with multispectral imaging. Implementation of these embodiments, for example, can be used to improve biometric imaging. According to some embodiments of the invention, systems and methods are disclosed for multiplexing multispectral imaging. This multiplexing can occur, for example, using a color filter array with pixels (or mosaics) that are substantially color matched with illumination sources that are distinct in another multispectral dimension. Such multispectral systems can be used for quick multispectral imaging.

[0007] According to various embodiments of the invention, a relatively steep-angled illumination source can be used for object identification, location detection, and/or background filtering. According to some embodiments, object identification can be performed by identifying and/or comparing the illumination pattern of an image with the expected illumination pattern for such an object. This comparison can compare geometric, spectral and/or intensity patterns between the purported object and the pattern of a known object. In some embodiments, location detection can be made by comprising the relative position of an illumination pattern within an image with a known or expected location pattern within an image. In some embodiments, an imaged object can be distinguished from background objects by comparing the strength or weakness of color filter pixels (or mosaics) associated with the illumination wavelength with color filter pixels not associated with the illumination wavelength.

[0008] For example, according to some embodiments of the invention a multispectral sensor is provided that includes at least two illumination sources and an imager with a color filter array. The two illumination sources can illuminate a platen with light having distinct illumination angles as well as distinct characteristics, such as distinct wavelengths or wavelength bands and/or distinct polarization conditions. The color filter array, which may be integral with the imager or separate therefrom, can filter light based on the specific distinctions between the two illumination sources. For example, the color filter array can include a pixels that filter based on color and the color of these pixels can be matched with the color of the illumination sources. A single image of an object at the platen can be acquired. Individual pixels of the image will then be highly associated with one or the other illumination source. Because of the filtering by the color filter array, this image will include information about illumination angle. Other color filter arrays can filter based on polarization to achieve a similar effect.

[0009] As another example, a single illumination source can be used to illuminate a platen with a relatively steep exit angle. Where the exit angle is the angle the light leaves the platen. Sequential imaging of the platen can occur using an imager. Each frame can be analyzed to determine whether an object is in contact with the platen, if the object is an expected object, and/or for background discrimination purposes. In some embodiments, an illumination pattern can be collected and the pattern on each frame can be analyzed. The position of the object relative to the platen can be a function of the relative location of the illumination pattern within an image, the width of the illumination pattern, the intensity profile of the illumination pattern, and/or the spectral content of the illumination pattern. Based on calibration of a sensor with expected object types, a computer can analyze each illumination pattern to determine whether the object is placed on the platen or to determine if the object is the expected object.

[0010] In other embodiments, the illumination source can include a single wavelength or wavelength band and the imager can include a color filter array with some pixels or mosaics associated with the wavelength of the illumination source. Images can be analyzed to determine if an imaged feature is the object to be imaged or background noise by analyzing the differences in the number of pixels within an illumination pattern associated with the illumination source wavelength and other pixels.

[0011] Various embodiments of the invention are also described herein involving

multispectral dual imaging. [0012] In various embodiments of the invention, a multispectral dual imaging system is disclosed. Two imagers can be used to simultaneously collect two images of a skin site under different imaging conditions. For example, one imager can directly image the skin site, while another images the skin site under TIR conditions. Various illuminators can be included to illuminate the skin site. In some embodiments, a prism can be used that allows the two imagers to image the skin site under both direct and TIR conditions. [0013] Various configuration can be used. For instance, a first illumination source (e.g. an LED) can be used to illuminating a finger through a first facet of a multifaceted prism. Light from the first illumination source can undergo total internal reflectance at a second facet of the multifaceted prism prior to illuminating the object. A first imager can image light scattered from the finger and passing through the first facet at an angle less than the critical angle and undergoing total internal reflectance at the second facet. A second imager can image light scattered from the finger and passing though the first facet at an angle less than the critical angle. In some embodiments, the second imager can be located in a position such that it does not image light from the second illumination source that is totally internally reflected at the first facet.

[0014] In some embodiments, the second imager can be located out of phase from the second illumination source. That is light from the second illumination source can only image light from the second imager after it is absorbed and/or scattered by the object. And, in this embodiment, light totally internally reflected at the first facet is not imaged by the second imager. For example, the second imager can be located at an azimuthal angle out of line with the second illumination source; such as an angle less than 170°. In some embodiments, this angle is 90°. The second imager can also be located to image light at greater or less than the critical angle.

[0015] In another embodiment, a first illumination source can illuminate an object located at a first facet of a multifaceted prism. The system can include a second illumination source that can illuminate the object through a second facet and through the first facet at an angle greater than the critical angle of the first facet. A first imager can image light scattered by the object that passes through the first facet at an angle less than the critical angle and undergoes total internal reflectance at the second facet. A second imager can be used to image light totally internally reflected from the first facet.

[0016] In some embodiments, the fingerprint sensor of the present invention may be used to collect non- fingerprint images; for example, money, documents, bar codes, manufactured parts, etc. In some of these images optical security markings such as holograms, color-changing ink and other such markings may be present and used to confirm that the documents or barcodes by assessing the images that correspond to different illumination conditions. [0017] In some embodiments, the dual imager of the present invention may be used to collect finger or hand print images as well as iris images, facial images, surveillance images, detect motion, detect ambient lighting conditions, barcode images, security document images, and perform a variety of other such functions. In some embodiments the direct imager may include an automatic, variable focus ("autofocus") mechanism to facilitate additional imaging functionality.

BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.

[0019] The present disclosure is described in conjunction with the appended figures.

[0020] Figure 1 A shows a top view block diagram of a multiplexed biometric imaging system according to some embodiments of the invention.

[0021] Figure IB shows a top view block diagram of a multiplexed biometric imaging system according to some embodiments of the invention.

[0022] Figure 2 is an example of a sensor with multiplexed image data using a color filter array according to some embodiments of the invention.

[0023] Figure 3 is an example of a sensor with multiplexed image data using a color filter array according to some embodiments of the invention. [0024] Figure 4A shows an example of a color filter array according to some embodiments of the invention.

[0025] Figure 4B shows the color response curve from a typical Bayer filter array.

[0026] Figure 5 shows a flow chart for creating a multiplexed image according to some embodiments of the invention. [0027] Figure 6 illustrates an optical system that can be used to detect the presence of an object at a platen according to some embodiments of the invention. [0028] Figure 7 shows an optical system and optical paths according to some embodiments of the invention.

[0029] Figures 8 A- 1 IB illustrate how the height of an object above the platen can be determined according to some embodiments of the invention.

[0030] Figure 12 shows an actual image that results when the finger or other object surface is located about 5 mm above the surface of a platen using embodiments of the invention.

[0031] Figure 13 shows an actual image that results when the finger or other object surface is located at the surface of a platen using embodiments of the invention

[0032] Figure 14 shows a flowchart for determining whether to image an object present at or near the platen according to some embodiments of the invention.

[0033] Figure 15 shows a block diagram of a computational system that can be used in conjunction with various other embodiments of the invention.

[0034] Figure 16 provides an isometric view of a dual-imager biometric sensor, in accordance with various embodiments.

[0035] Figure 17 provides a top view of a dual-imager biometric sensor, in accordance with various embodiments.

[0036] Figure 18 provides a front view of a dual-imager biometric sensor, in accordance with various embodiments.

[0037] Figure 19 depicts the simultaneous illumination of an image region of a dual-imager biometric sensor, in accordance with various embodiments.

[0038] Figure 20 depicts a total-internal-reflectance imaging path within a dual-imager biometric sensor, in accordance with various embodiments.

[0039] Figure 21 depicts a direct imaging ray bundle within a dual-imager biometric sensor, in accordance with various embodiments.

[0040] Figure 22 provides a schematic diagram of a dual-imager biometric system, in accordance with various embodiments. [0041] Figure 23 provides a flow diagram of a method for creating composite biometric images from a two imager biometric system, in accordance with various embodiments.

[0042] Figure 24A shows an example of a TIR-imaging biometric sensor according to some embodiments of the invention. [0043] Figure 24B shows an example of a direct-imaging biometric sensor according to some embodiments of the invention.

[0044] Figure 25 A shows an example of a TIR-illumination biometric sensor according to some embodiments of the invention.

[0045] Figure 25B shows an example of a direct-illumination biometric sensor according to some embodiments of the invention.

DETAILED DESCRIPTION

[0046] The ensuing description provides preferred exemplary embodiment(s) only, and is not intended to limit the scope, applicability or configuration of the disclosure. Rather, the ensuing description of the preferred exemplary embodiment(s) will provide those skilled in the art with an enabling description for implementing a preferred exemplary embodiment. It being understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope as set forth in the appended claims.

[0047] Embodiments of the present invention provide improvements to biometric imaging and multispectral imaging systems, process, and/or techniques. These improvements can extend to other realms of endeavor.

[0048] Conventional optical fingerprint sensors acquire a single image of the fingerprint (or a set of images taken under substantially similar optical conditions) during a single measurement session. On the other hand, multispectral imagers acquire multiple images during a single measurement session under different optical conditions. Collecting such a set of images can require more acquisition time than collecting a single image. Embodiments of the invention provide methods and systems capable of solving this problem by acquiring multispectral images in a more efficient manner than with traditional serial acquisition; for example, by using multiplexed techniques. [0049] In some cases, it is also desirable to initiate a fingerprint acquisition sequence automatically. Conventional optical sensors based on TIR imaging are often able to perform such a function by analyzing an image sequence and initiating an acquisition when a significant change in the image is detected. Such a method works because TIR imagers are substantially unable to view objects that are not in direct contact with the optical sensor and have certain other required characteristics. In contrast, direct imaging sensors such as multispectral fingerprint sensors are able to view the external environment and any nearby objects directly through the sensor surface. As such, direct imaging sensors see a finger that is in contact with the sensor as well as a finger that is nearby but not in contact with the sensor. The resulting image may be in focus or out of focus depending on the distance and the depth of field of the imaging system as well as the motion of the finger. In an effort to achieve maximum image quality, it is therefore often preferable to initiate a fingerprint image acquisition only after the finger is in firm contact with the sensor. Embodiments of the invention to solve this problem by providing a reliable means of making such determination using direct imaging are desirable. [0050] Conventional optical fingerprint sensors typically incorporate a single TIR imager, which can require that a number of conditions be met to provide a good fingerprint image. These conditions can include the requirement that the fingerprint ridges are intact, clean, in optical contact with the sensor surface, and that the skin is of proper moisture content, i.e., neither too dry nor too wet. If any of these conditions aren't met, the resulting fingerprint image can be degraded or even missing entirely. However, when these conditions are met, the resulting image is generally of high quality and useful for both automated analysis and analysis by a human observer.

[0051] Multispectral fingerprint sensors and others based on direct imaging are able to acquire images under a much broader range of conditions of the skin, the local environment, and the nature of the interface between the skin and sensor. However, such images are generally of lower contrast than the corresponding TIR image, if the TIR image is of high quality. Some embodiments of the invention solve this problem by providing a fingerprint sensor that is able to collect both TIR and direct images during the same measurement session to ensure that biometric images are always collected regardless of the conditions of the finger, sensor surface and/or the local environment. [0052] For purposes of this disclosure, the terms "finger," "fingerprint," and "fingerprint image" are meant to include sites and images collected from a single finger, multiple fingers, intermediate finger joints, the palm, the entire palmar surface of the hand, and/or any other skin site on the body, as well as other animate or inanimate objects such as documents, barcodes, credentials, and the like.

[0053] The terms "multispectral imaging," "MSI," and "multi-imaging" refer to methods and systems for acquiring multiple images of a finger during a single measurement session, wherein at least two of the multiple images are collected under different optical conditions. Different optical conditions may include, but not limited to, different illumination wavelengths, different illumination angles (both in azimuth and elevation and may include elevations on either side of the optical critical angle defined by the sensor imaging surface and the air or other surrounding medium), different illumination polarization conditions, different imaging angles (both in azimuth and elevation and may include elevations on either side of the optical critical angle defined by the sensor imaging surface and the air or other surrounding medium), different imaging focal planes, different imaging spatial resolutions, different imaging temporal resolutions, different imaging polarization conditions, and other such conditions that substantially alter the resulting images. Also, unless otherwise specified, the angle of incidence, angle of illumination, angle of imaging, etc. is measured relative to the normal of the incident surface. [0054] The terms "total internal reflectance imaging" and "TIR imaging" refer to a method of imaging known in the art wherein the optical axis of the imaging system lies at an angle relative to the normal of the sensor imaging surface and that is greater than the optical critical angle of that surface. A block diagram showing TIR imaging is shown in Figure 24A. In this diagram, imager 150 images light from platen 105 at angle 9i_masing that is greater than the critical angle, Q_crtecai, as measured from normal 116 of facet 105. This is TIR imaging.

Illumination sources 122 can be positioned at various elevation and azimuth angles and. Figure 24B shows imager 150 that images light from platen 105 at angle 0_imaging that is less than the critical angle, 9_criticai.

[0055] Figure 25 A illustrates TIR illumination. In this example, illumination source 120 illuminates platen 105 at an angle, (¾7/_Μ«/«_α¾₀«, that is greater than the critical angle, 6_Criticai- Figure 25B shows a non-TIR illumination system, with the illumination source 120 illuminating platen 105 at an angle, #//«_Wm<_½ow_> that is less than the critical angle, e_criiicai.

[0056] Various configurations of illumination and imaging are shown in Figures 24A-25B. Embodiments of the invention can incorporate any combination of TIR imaging, direct imaging, TIR illumination, and direct illumination. Moreover, multiple illumination sources and/or imagers can be at multiple angles of elevation and/or aziumuth.

[0057] The critical angle is a function of the index of refraction of the two media on either side of an interface and is approximately 42 degrees for a glass-air interface. Because the optical axis of the TIR imaging system lies beyond the critical angle of the sensor surface, the surface acts as a mirror (as seen by the imager) when untouched, and can cease to act as a mirror in those locations in which a material with suitable optical characteristics comes into direct contact with the sensor surface.

[0058] In locations where a finger or other material contacts a sensor surface, a new critical angle is established. However, for purposes of the present disclosure, the term "critical angle" will refer to the angle established by the sensor (i.e., the platen surface) and the surrounding environment, which is assumed to be air for most purposes. Also, as known in the art, light will change angles at boundaries between media due to phenomena such as refraction, reflection, diffraction and other such effects. When a ray angle is referred to in the present application as being greater than or less than the critical angle, for example, the statement refers to the angle of the ray at the operative boundary such as the sensor imaging surface rather than the angle of the same ray at any other boundary or media, unless explicitly stated as such.

[0059] The term "direct imaging" refers to a method of imaging wherein the optical axis of the imaging system lies at an angle relative to the sensor imaging surface that is less than the optical critical angle of that surface. For example, the system shown in Figure 24B is one sample of a direct imaging system.

[0060] Figures 1A and IB are block diagrams of an imaging system according to some embodiments of the invention. Figure 1A shows a side view of such a system with a direct imaging imager 150. That is, it images the platen at an angle less than the critical angle, #_mw_ca/, as measured from the normal. Multiple illumination sources 120, 121, and 122 are shown illuminating the platen at various angles θηο, Θΐ2ΐ, and #/22· Note that angle θ₁₂2 is greater than the critical angle e_criticai- Figure IB shows a top view of the imaging system shown in FIG. 1 A; the finger is not shown for clarity purposes. Each illumination source 120, 121, and 122, illuminates the platen from different azimuth angles φηο, φηι, and φ ι, relative to a portion of the platen.

[0061] Multiplexed Biometric Imaging

[0062] Multiplexed biometric imaging systems and methods are provided according to some embodiments of the invention. Multiplexed imaging systems can acquire images under different illumination conditions more efficiently than simply acquiring a sequence of image frames under each of the desired conditions. Such image data may be collected in a multiplexed manner. In some embodiments, the wavelength or spectral characteristics of an imaged object can be used to multiplex information from different illumination angles and/or optical polarizations together into a single image.

[0063] Figure 1 A shows a side view, block diagram of system that can be used for multiplexed biometric imaging according to some embodiments of the invention. Figure IB shows a side view. The system can include platen 103 that can be any number of shapes.

Various polygonal-shaped platens are described later. The platen can include imaging surface

105, for example, where a purported skin site can be placed for imaging during a biometric acquisition. At imaging surface 105 finger 110 can be placed for imaging. While a finger is shown, any type of object can be imaged. These objects can include objects for biometric purposes such as hands, multiple fingers, faces, eyes, etc. And the objects can include money, documents, objects with codes or barcodes, etc.

[0064] Finger 110 can be illuminated using a plurality of illumination sources. Three illumination sources 120, 121, and 122 are shown in this embodiment. In some embodiments, only two illumination sources may be used. In others as many as four or five can be used. There is no limit on the number of sources that can be used. Each illumination source can illuminate imaging surface 105 at a different illumination angle relative to the normal of imaging surface 105. For instance, illumination source 120 illuminates imaging surface 105 at angle έ½_¼ illumination source 121 illuminates imaging surface 105 at angle έ½>, and illumination source 122 illuminates imaging surface 105 at angle 0i₂₂- Where Quo≠9m≠θη2· These angles can be greater than or less than the critical angle at the interface near the platen as measured relative to the normal to the platen. And these angles can be called "elevation angles". [0065] Furthermore, each of illumination sources 120, 121, and 122 are also placed at different azimuth angels φ uo, φ ni, and ηι around a central portion of the platen. An azimuth angle can be measured from any arbitrary point. As shown in Figure IB, the azimuth angles are measured relative to a reference line perpendicular to the standard approach of a finger. In a system with four illumination sources, for example, a first illumination source can have an elevation angle of about 43° and an azimuth angle of about 12°. A second illumination source can have an elevation angle of about 46° and an azimuth angle of about 78°. A third illumination source can have an elevation angle of about 43° and an azimuth angle of about 168°. A fourth illumination source can have an elevation angle of about 46° and an azimuth angle of about 102°. In some embodiments, the azimuth angles relative to various illumination sources and/or imagers can be more important than the angle between the illumination sources and a reference line. The wavelength of the light provided y the illumination sources can vary tremendously.

[0066] Furthermore, illumination sources 120, 121, and 122 can each provide unique monochromatic light. For example, illumination source 120 can illuminate imaging surface 105 with blue light (e.g., 440 - 490 nm), illumination source can illuminate imaging surface 105 with green light (e.g., 520 - 570 nm), and illumination source 122 can illuminate imaging surface 105 with red light (e.g., 630 - 740 nm). Monochromatic light sources can provide light of single wavelength (e.g., a laser) or light within a narrow light band surrounding a single wavelength (e.g. LED or filtered broad-band source). In some embodiments, the light sources can provide light outside the visible spectrum in spectral regions that may include ultraviolet and/or infrared wavelengths. The main wavelength or wavelength band of light from each illumination source, in some embodiments, is different from the other sources. In the preceding example, each light source provides red, blue, or green light. [0067] Illumination sources 120, 121, and 122 can include a quasimonochromatic light sources having a narrow band of primary-color wavelengths. Illumination sources 120, 121, and 122 can also include LEDs, laser diodes, or lasers.

[0068] Imager 150 is used to image the light scattered and/or reflected from any object placed at imaging surface 105, such as finger 110. Imager 150 can be a color or black and white imager. Imager 150 can image an object through various optical elements 140 and 145, as well as through color filter array 130. Color filter array 130 can be integrated within imager 150 or be a stand alone element. Color filter array 130 is a mosaic of tiny color filters that separates the color response based on the arrangement of the mosaic. Various types of color filter arrays can be used such as, for example, a Bayer filter, a RGBE filter, a CYYM filter, a CYGM filter, or any type of RGB W filter.

[0069] An example of a Bayer color filter array is shown in Figure 4A. This arrangement uses red 404, green 412, and blue 408 color filter elements. As seen from the color response curve for a typical Bayer filter array shown in Figure 4B, there is generally some overlap in the spectral ranges of the red 424, green 432, and blue 428 transmission characteristics of the filter elements. As evident particularly in the curves for the green 432 and blue 428 transmission characteristics, the filter array may allow the transmission of infrared light. This can be avoided with the inclusion of an infrared filter as part of the imager. In other embodiments, an infrared filter may be omitted and one or more illumination sources that emit infrared light may be incorporated. In this way, all color filter elements 404, 408, and 412 may allow the light to substantially pass through, resulting in an infrared image at imager 150.

[0070] As an alternative to a color filter the imager or other optics may incorporate chromatic and/or polarizing beam splitters to separate the multiplexed light from the finger. The separated light may then be directed to individual monochromatic imagers where the number of imagers corresponds to the number of illumination conditions so separated.

[0071] Regardless of the type of color filter array that is used, in some embodiments, the wavelength of light provided by illumination sources 120, 121, and 122 should be aligned or closely aligned with the elements of the filter array. And, in some embodiments, the number of illumination sources can be, but not necessarily, aligned with the number of different filter elements in the array. For example, for a Bayer array, there are three filter colors. Hence, three illumination sources can be used. Each illumination source can then provide light in a red, blue, or green wavelength band to be consistent with the array.

[0072] Thus, imager 150 can create a multiplexed image of an object illuminated by multiple illumination sources arranged to illuminate light of different wavelengths at different illumination angles. This can be done during a single illumination session and, in some embodiments, a single image can be created. This single image can be considered a multiplexed image that can later be demultiplexed by color to provide information regarding the object that depends on the illumination angle of the illumination source. Furthermore, the multiplexed image can be considered a multispectral image because it contains information not only about the illumination wavelength but also the illumination angle.

[0073] In some embodiments, the illumination sources can include different polarization effects instead of or in addition to the differences in illumination angle. The resulting multiplexed image can then be a multispectral image that includes polarization information as well. [0074] An example of a sensor with multiplexed image data using a color filter array is shown in Figure 2. Platen 103 is provided and through which imaging optics 205 can image a finger (or an object) onto the imager 207. In some embodiments, imager 207 can be a silicon CMOS imager with an integrated Bayer filter. Other color filter arrays and/or other mean of separating the light (such as polarizing beam splitters or polarizing filter arrays), and/or other image array materials may be used alternatively or in conjunction with this arrangement.

Moreover, various imagers can be used as well such as silicon CCD imagers or imagers made from other photoactive material such as InGaAs, InSb, MCT and others known in the art.

[0075] Figure 3 shows another view of the sensor shown in Figure 2 with two of the multiplexed illumination sources illustrated. In this embodiment, blue light source 203 (e.g., a blue LED, which may be combined with lenses, mirrors, optical diffusers and other components of the sort), and green light source 205 (e.g., a green LED, which may be combined with lenses, mirrors, optical diffusers and other components of the sort), are turned on simultaneously. The light traverses a path that illuminates platen 103 at two different angles. The light from light sources 203 and 205 are shown as being reflected from internal mirrored surfaces 211 and 213, respectively. The reflecting surfaces 211, 213 are used to increase the illumination angle (with respect to the platen surface normal) while maintaining a small sensor footprint. Once the light from light sources 203 and 205 illuminate and pass through platen 103, the light may illuminate a finger or another object from two angles simultaneously. An imaging system with a color filter array, like the one shown in Figure 1 A can then used to acquire a multiplexed image.

[0076] In addition to the two illuminators 203, 205, other illuminators 207, 209 could be used to provide for similar multiplexed illumination during earlier or later image frames. In addition, illuminators of colors other than the blue and green can be incorporated into other embodiments of the present invention. For example, a red illuminator in a different spatial and angular position from illuminators 203, 205 could be used.

[0077] Figure 5 shows a flow chart of process 500 for creating a multiplexed image according to some embodiments of the invention. Process 500 starts at block 500. At block 510 a skin site is illuminated with at least two illumination sources having different wavelengths and illumination angles at block 510. The two illumination sources can illuminate the skin site at the same time or sequentially. In other embodiments, more than two illumination sources with different illumination wavelengths and different illumination angles can be used. At block 515, light from the skin site can be filtered using a color filter array of any type and then imaged at block 520. In some embodiments, a single multiplexed image can be acquired. Process 520 can end at block 525. Various post processing techniques can be used to pull out multispectral information from the multiplexed image. For example, the pixels corresponding to specific color filter mosaics may be separately extracted from the multiplexed image. Each of these images will then represent images collected under different illumination conditions (as well as different spectral conditions). These images may then be interpolated using linear or nonlinear techniques to produce a uniform sampling of the object over the same grid.

[0078] Process 500, for example, can be executed by the computational device shown in Figure 15.

[0079] Presence and Object Detection [0080] Some embodiments of the invention can be used to detect the presence and/or location of an object prior to imaging. Figure 6 illustrates an optical system that can be used to detect the presence of an object at a platen. Illumination system 600 can include an illumination source (e.g., LED, laser, etc.) and illumination optics (e.g., cylindrical lens, spherical lens, mirrors, and/or other such optical components). The illumination source can be a

monochromatic source. For example, a red, blue or green monochromatic source can be used. In some embodiments, illumination assembly 603 can direct light into a beam steering component 605, which directs the light toward mirrored surface 607 and then on and through platen 603. Imager 615 can be used to take video or sequential images of an area on or above platen 603. Imager 615 can include a color filter array. And, in some embodiments, a pixel (or mosaic) of the color filter array can be substantially the same as or consistent with the wavelength of one or more of illumination source (e.g., illumination system 600). The path of the illumination light 703 is illustrated in Figure 7.

[0081] In Figure 7, illumination light 703 illuminates a distinct region of platen 603. In some embodiments and as shown in the figure, illumination light 703 illuminates platen 103 with a steep illumination exit angle relative to the normal of the platen surface. In so doing, the distinct pattern can appear at different locations in the image based on the height of the finger or other object above the platen. Mirrored surface 607 can be used to provide this steep illumination exit angle relative to the air above the platen without sacrificing a compact design. For example, the exit angle of illumination (above the platen as the light exits the platen) can be any exit angle that is not perpendicular to the surface of the platen. For example, the exit angle (Θ) can be about 51° (±10°) from the normal of the platen. In other embodiments, the exit angle can be any angle from 40° to as close to parallel to the platen as practical (i.e. 90°).⁰ For example, the angle of illumination can be 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°. [0082] Figures 8A-1 IB illustrate how the height of an object above the platen can be determined according to some embodiments of the invention. For simplicity refraction effects as light enters and exits the platen are ignored. If the refraction effects were shown, the light exiting the platen would have a larger exit angle, Θ, than shown. This exit angle, Θ, can be any angle described in the preceding paragraph. In figure 8A finger 805-is positioned well above platen 803. Imager 815 is used to image the finger. Imager 815 can include a color filter array. Illumination source 800 illuminates the platen surface and the area near the platen surface. Light rays from illumination source 800 can be confined within strip 820. The illumination exit angle of illumination source 800 can be steep relative to the normal of the platen surface. As finger 805 approaches platen 803, a portion of the finger is illuminated as shown in Figure 8A. Figure 8B shows a block illustration of image 830 produced by imager 815. Illumination pattern 835 is formed from the light scattered from finger 805. The position of illumination pattern 805 can indicate the position of the finger relative to the platen. In Figure 8B illumination pattern is located at the far right of the image indicating a position of finger 805 well above platen 803. [0083] Figure 9A shows finger 805 positioned closer to platen 803 a moment after the finger's position in Figure 8A. And Figure 9B shows image 830 of finger 805 with

illumination pattern 835 moved toward the left to coincide with the movement of the finger. Figure 10A shows finger 805 positioned even closer to platen 803 a moment after the finger's position in Figure 9 A. And Figure 10B shows image 830 of finger 805 with illumination pattern 835 moved toward the left to coincide with the location of the finger. Finally, Figure 11 A shows finger 805 in contact with platen 803 a moment after the finger's position in Figure 10A. And Figure 1 IB shows image 830 of finger 805 with illumination pattern 835 moved toward the left. Thus, by monitoring the position of illumination pattern 835 in sequential images the position of finger 805 can be determined relative to platen 803. As can be seen from these figures, the steepness of the illumination exit angle in the air above the platen determines the relationship between the height of the finger 805 relative to the platen 803 and the position of the illumination pattern 835 in the image 830. If the illumination exit angle is steeper (closer to 90 degrees) the position of the illumination pattern 835 will change faster as a function of the finger 805 height above the platen 803. [0084] Figure 12 shows an actual image that results when the finger or other object surface is located about 5 mm above the surface of a platen. As can be seen from the image, the illuminated pattern 1235 is located toward the left side of the image. Figure 13 shows another actual image that results when a finger or other object surface is located on the platen. With the finger on the platen, illumination pattern 1335 is centrally located on the image, while illumination pattern 1235 is located on the side of the image. The horizontal shift between illumination patterns is due to the steep exit angle of the illumination beam.

[0085] In some embodiments, the intensity profile of the illumination pattern changes as the finger approaches the platen. Because of the exit angle of illumination and the rounded cross- sectional shape of a finger, while the finger is above the platen the intensity profile will be sharper on one side of the finger and more gradual on the other. As the finger moves closer the intensity profile becomes more and more symmetric. In some embodiments, this intensity profile can be used as further evidence of the position of the finger. Other information such as the spectral content, the shape, and the position can be used to determine the location and the object type. For example, the width of the illumination pattern may widen as the finger approaches the platen.

[0086] A video sequence of images can be acquired and analyzed to determine the location of the illumination pattern. If the illumination pattern is not located in the proper location then another image can be collected and/or analyzed until the illumination pattern is in the proper location. Once in the proper location, biometric imaging or other processes may begin that require the object to be in a certain location.

[0087] In some embodiments, the shape of illumination pattern can indicate the type of object being imaged. For example, in Figures 12 and 13, a finger was imaged resulting in an illumination pattern resembling a slightly bowed rectangle. And the center of the platen image is brightly illuminated (shown by the red color) while the light intensity falls off on either side (blue). Thus, both the geometrical shape and the intensity of the illumination can be indicative of the object under illumination. This illumination pattern may depend on the illumination angle and/or the type of object being imaged. By fixing the illumination angle and calibrating the system with the illumination angle fixed, the illumination pattern may then depend on the object type. Images can be acquired in sequential order and the illumination pattern can be analyzed.

[0088] In biometric imaging of fingerprints, for example, if the illumination pattern is inconsistent with the known illumination pattern of a finger, then it can be determined that a foreign object is being placed on the platen and biometric imaging should not start. If the illumination pattern is consistent with the known illumination pattern of a finger, then it can be determined that a finger is being placed on the platen and biometric imaging can begin. This technique can be used in conjunction with the presence detection techniques to determine when the finger is in contact with the platen prior to triggering the start of biometric imaging.

[0089] Various other objects can have correspondingly unique illumination patterns that can be used. The particular illumination pattern is not critical, as long as it is easily recognized and distinct from objects in the background. In order to achieve this, the shape of the illumination pattern may be altered using appropriate optics in the illumination assembly as well as elsewhere along the optical path.

[0090] In addition, the spectral properties of the illumination pattern may be distinguished from background materials and/or ambient lighting conditions ("background noise"). For example, the illumination source can be a blue LED that emits light strongly detected by the blue pixels of a color filter array and weakly detected by the other pixels of the color filter array used in the imager. The illumination pattern can then be analyzed. And if it is determined that there illumination pattern provides a strong signal in the blue pixels and a weak signal in the other pixels, then the illumination pattern can safely be determined to not be background noise. If, however, the blue pixels do not register a strong signal relative to the other pixels, then the illumination pattern is likely a background and can be ignored. While this example uses a blue LED relative to blue pixels, other wavelengths can be used.

[0091] Using various embodiments described herein sequential images of the skin site can be acquired while being illuminated with a single illumination source having a steep illumination angle. Prior to operating a function that requires the presence of a specific type of object at a platen for imaging, such as in biometric imaging or multispectral imaging, the following can occur in any order and with or without any one step:

1. Analyzing the illumination pattern to ensure that the shape of the illumination pattern is consistent with the shape of the expected object.

2. Analyzing the location of the illumination pattern to determine if it's location is consistent with the expected object being in contact with the platen. The illumination pattern can include the geometric pattern and/or the intensity profile. 3. Analyzing the illumination pattern to determine if it has a strong signal for the pixels that are consistent with the wavelength of the illumination source and/or determine if the illumination pattern has a weak signal for pixels not consistent with the wavelength of the illumination source. [0092] Figure 14 shows a flowchart outlining process 1400 for determining whether to image an object present at or near the platen according to some embodiments of the invention.

Process 1400 starts at block 1405. At block 1410 the imaging surface and/or the area nearby the imaging surface is illuminated. In some embodiments, this illumination can occur at a steep angle relative to the normal. In some embodiments, this illumination can occur using a monochromatic light source. The wavelength of this monochromatic light source, for example, can be matched with one of the pixels and/or mosaics of a color filter array of the imager.

[0093] At block 1415 the area near the imaging surface is imaged. At block 1420 the image is analyzed to determine if the shape of the illumination pattern is consistent with the expected object. This illumination pattern may be a geometric illumination pattern and/or an intensity pattern. If the illumination patter is inconsistent with the expected pattern, then process 600 returns to block 1415 and another image is acquired. In some embodiments, process 600 pauses a short time period prior to returning to block 1410. If the pattern is consistent with the expected object, then process 1400 proceeds to block 1425.

[0094] At block 1425 process 1400 determines whether the illumination pattern is formed in a location consistent with the expect object being placed on the platen. If the location is inconsistent, then process 1400 returns to block 1415 and another image is acquired. If it is consistent, then process 1400 proceeds to block 1430. At block 1430 process 1400 determines whether the illumination pattern is consistent with background noise. This can be done by analyzing the pixels of the image in conjunction with the color filter array. If the pixels within the illumination pattern are strongly associated with light illumination wavelength and/or weakly associated with light associated with other pixels, then the object is not a background object and process 1400 proceeds to 1435. Otherwise process 1400 returns back to block 1415. At block 1435 imaging or other tests or measurements can occur once it is determined that the proper object is placed in the proper location and is not background noise. Process 1400 ends at block 1440.

[0095] Process 1400, for example, can be executed by the computational device shown in Figure 15. [0096] Computational Device

[0097] Figure 15 shows a block diagram of computational unit 1500 that can be used inc conjunction or as part of a biometric sensor system. The figure broadly illustrates how individual system elements may be implemented in a separated or more integrated manner. Moreover, the drawing also illustrates how each of the four imagers 1510 may include a dedicated processor 1515 and/or dedicated memory 1520. Each dedicated memory 1520 may include operational programs, data processing programs, instructions for carrying out methods described herein, and/or image processing programs operable on the dedicated processors 1515. For example, the dedicated memory 1 20 may include programs that can be executed by CPU 1502 and/or provide image processing. The computational device is shown comprised of hardware elements that are electrically coupled via bus 1530. The bus 1530, depending on the configuration, may also be coupled with the one or more LED(s) 1505, a proximity sensor (or presence sensor) 1512 and four imaging subsystems 1504 according to various embodiments. In another embodiment, imager memory 1520 may be shared amongst imagers 1515 and/or with the computational device 1502. [0098] In such embodiments, an imaging subsystem may include an imager 1510, a processor 1515, and memory 1520. In other embodiments, an imaging subsystem 1504 may also include light sources and/or optical elements. Imaging subsystems 1504 may be modular and additional imaging subsystems may be easily added to the system Thus, biometric sensor subsystems may include any number of imaging subsystems 1504. The various imaging subsystems, in one embodiment, may be spatially modular in that each imaging subsystem is used to image a different spatial location. The various imaging subsystems, in another embodiment, may be multispectrally modular in that each imaging subsystem is used to image a different multispectral condition. Accordingly, in such an embodiment, an imaging subsystem 1504 may also include various optical elements such as, for example, color filter arrays, color filters, polarizers, etc and/or the imager 1510 may be placed at various angles relative to the imaging location. The various imaging subsystems, in another embodiment, may provide focus modularity in that each imaging subsystem is used to image a different focal point or focal plane. [0099] The hardware elements may include a central processing unit (CPU) 1550, an input/output device(s) 1535, a storage device 1555, a computer-readable storage 1540, a network interface card (NIC) 1545, a processing acceleration unit 1548 such as a DSP or special-purpose processor, and a memory 1560. The computer-readable storage 1540 may include a computer-readable storage medium and a computer readable medium reader, the combination comprehensively representing remote, local, fixed, and/or removable storage devices plus storage media for temporarily and/or more permanently containing computer- readable information. The NIC 1545 may comprise a wired, wireless, modem, and/or other type of interfacing connection and permits data to be exchanged with external devices.

[0100] Moreover, computational unit can include illumination source interface 1557 and/or imager interface 1556. These interfaces can be standard input/output interfaces such USB, firewire, UART, RS232 or a proprietary interface. Regardless of the communication protocols, imager interface 1556 can be used to instruct the imager (e.g., any of the imagers or sensors described herein) to acquire an image and/or export an image. Illumination source interface 1557 can be use to activate and/or deactivate any of a plurality of illumination sources singularly, as a group, or sequentially. [0101] The computational unit 1500 may also comprises software elements, shown as being currently located within working memory 1560, including an operating system 1565 and other programs and/or code 1570, such as a program or programs designed to implement methods described herein. It will be apparent to those skilled in the art that substantial variations may be used in accordance with specific requirements. For example, customized hardware might also be used and/or particular elements might be implemented in hardware, software (including portable software, such as applets), or both. Further, connection to other computing devices such as network input/output devices may be employed.

[0102] Computational unit 1500 can be used to carry out processes shown in any of the figures and described in the specification. Specific instructions and/or program code can also be stored in memory 1518 or 1512 and executed by CPU 1502.

[0103] Dual-Imager Biometric Sensor

[0104] Embodiments of the invention may include systems, methods, and devices that may collect images of the finger using two different types of imagers that acquire images of the finger during the same measurement session. In some cases, the imagers may acquire images simultaneously. In some cases the imagers may acquire two video sequences wherein the frames of the video sequences are synchronized such that the two sequences are substantially temporally aligned to aid processing in the presence of motion of the finger or other object being imaged. In some embodiments, the two imagers may comprise a TIR imaging system and/or a direct imaging system. In some embodiments either or both the imaging systems may be multispectral imaging systems.

[0105] In some embodiments of the invention a prism with multiple facets can be used with facets arranged for simultaneous direct and TIR imaging of a skin site. The prism can be used in conjunction with one or more illumination sources and/or one or more imagers. A first facet of the prism may be adapted for placement of a purported skin site by an individual. The first facet may include an imaging surface for placement of the purported skin site. The first facet or just the imaging surface of the first facet may alternatively be referred to as a "platen". A second facet may be oriented with respect to the first facet such that a portion of light totally internally reflected at the first facet substantially passes through the second facet. The sensor may include one or more illumination sources disposed to illuminate the imaging surface of the prism and/or the purported skin site through the first facet of the prism. The sensor may include a direct imaging assembly disposed to receive light scattered from the purported skin site and reflected from the second facet of the prism. The sensor may include a total-internal- reflectance imaging assembly disposed to receive light scattered beneath a surface of the purported skin site at the first facet and substantially passes through a third facet of the prism.

[0106] Figure 16 shows an isometric view of dual-imager biometric sensor 1601 according to some embodiments of the invention. Sensor 1601 includes prism 1610 and further designates a region of the platen that is the active image surface 1615 used to image the finger or other obj ect; active image surface 1615 may be referred to as a platen or as a facet of prism 1610. In some embodiments, prism 1610 may include multiple facets. A dual-imager biometric sensor may include one or more illumination sources. For example, dual imager sensor 1601 includes two illumination sources 1631 and 1632. A dual imager sensor may include other components, such as reflective surface like mirrors 1621, 1622, 1623, 1624, and/or 1625, which may be used to facilitate directing light to different imaging components. A dual imaging sensor may also include one or more total-internal-reflectance imaging assemblies. Figure 21 for example shows TIR imaging assembly 1641. A dual imaging biometric sensor may also include a direct imaging assembly 1642.

[0107] Figure 17 shows the top view of dual-imager biometric sensor 1601 and Figure 18 shows a front view of sensor 1601. Two illumination assemblies 1631 and 1632 are shown in Figure 17. And Figure 18 shows a third illumination assembly 1633 along with illumination assembly 1631. Each illumination assembly may comprise an illumination source as well as lenses, mirrors and/or other optics as necessary to shape and direct the illumination light. In some instances, more or less illuminators may be present. The illuminators 1631, 1632, and/or 1633 may come on simultaneously during an acquisition sequence, or sequentially, or pulsed or encoded in some manner.

[0108] In some embodiments the illuminators 1631, 1632, and/or 1633 may be of

substantially different wavelengths in accordance with other aspects of various embodiments. Some embodiments may utilize illumination assemblies that may include illumination sources without other optics to shape and direct the illumination source. Some embodiments of a dual imaging sensor may also include other illumination assemblies or illumination sources as will be discussed below. For example, some embodiments may include an illuminator such as a flat light guide illuminated with LEDs, or a cold cathode fluorescent lamp (CCFL), or other illuminators known in the art that may be used as part of a TTR imaging.

[0109] Illumination light from any or all sources, such as 1631, 1632, and/or 1633, may illuminate the image region 1615. Light from a finger touching the sensor may then be imaged by the TIR image assembly 1641 after being reflected from mirrored surfaces 1621 and 1624. In some embodiments, a TIR image assembly, such as 1641, may not need reflecting surfaces such as 1621 and 1624 to make an image. Other embodiments may include more or less imaging surfaces that may be in different configurations. The finger touching the active image region 1615 may also be imaged by direct image assembly 1642 after reflections from surfaces 1622, 1623, and/or 1625. In some embodiments, a direct image assembly, such as 1642, may not need reflection surfaces such as 1622, 1623, and/or 1625. Other embodiments may use more or less reflecting surfaces, which also may be position and/or oriented in different configurations. [0110] In one embodiment, direct image assembly 1642 may contain a color imager, as well as lenses, mirrors, optical filters, grating and other such optical elements as may be necessary to form an image as known in the art. TIR image assembly 1641 may contain a color imager or a monochromatic imager, as well as lenses, mirrors, optical filters, grating and other such optical elements as may be necessary to form an image as known in the art. In some embodiments that incorporate a monochromatic TIR imager, there may be a optical band pass filter in TIR image assembly 1641 that substantially passes the light from some number of the illuminators, such as 1631, 1632, and/or 1633, while blocking the light from others. In some embodiments, an optical filter that blocks out-of-band light ambient light may be included in either or both imaging paths. [0111] Figure 19 shows a three-dimensional view of sensor 1601. This illustration shows the simultaneous illumination of the image region 1615 of prism 1610 by illuminators 1631, 1632, and/or 1633. In some embodiments, illuminators 1631, 1632, and/or 1633 may be different colors (such as green, red and blue, respectively, merely by way of example; ultraviolet and/or infrared light may be used instead of or in addition to various visible wavelengths), in accordance with another aspect of various embodiments. The central wavelengths of the illuminators such as 1631, 1632, and/or 1633 as well as the spectral width and selection of which illuminator emits which color can all vary and such choices are within the scope of various embodiments. In some embodiments, as shown in Figure 4 for example, an

illuminator, such as 1631 and/or 1632, may be positioned such that light transmitted from the illuminator is totally internally reflected at a facet, such as facet 1611, of prism 1610 and then illuminates image region 1615. Some illuminators, such as 1633, may be positioned and/or oriented such that light passes through a facet, such as facet 1611 and then illuminates image region 1615.

[0112] Figure 20 depicts a TIR imaging path 1651. The TIR imaging assembly 1641 , which may be referred to as a TIR imager in some embodiments, can view the active region 1615 of prisml610 through prism facet 1612 and reflective surfaces 1621 and 1624. The angle between the TIR image bundle 1651 and the platen facet 1612 is such that the bundle 1651 can pass through the facet 1612. In some embodiments, the image bundle 1651 is substantially perpendicular to facet 1612. In some embodiments, facet 1612 may be oriented approximately perpendicular to an angle equal to or greater than the a critical angle with respect to facet 1615

[0113] In some embodiments, image bundle 1651 is oriented at an angle greater than the critical angle defined by the surface 1615 and the surrounding media, which is usually air. Because of this, it may be desirable to provide a black background for the TIR imager 1641 to view in cases where the TIR imager 1641 is operating in a dark-field illumination mode. In order to accomplish this, facet 1611 of prism 1610 may be oriented such that rays in the TIR bundle 1615 reflected through TIR at surface 1615 may be substantially able to pass out of prism 1610 through facet 1611. In some embodiments, a light trap (e.g., optical absorber) 1660, which may comprise a material with a matte black surface finish, may be positioned such that substantially all of the TIR bundle 1651 lands on the trap 1660. [0114] In an alternative embodiment, the light trap 1660 may be replaced by an illuminator, such as a flat light guide illuminated with LEDs, or a cold cathode fluorescent lamp (CCFL), or other illuminators known in the art. In this alternate embodiment, the TIR imaging system operates in a bright-field illumination mode.

[0115] Figure 21 depicts direct imaging ray bundle 1652 seen by direct imaging assembly 1642 in accordance with various embodiments. Direct image bundle 1652 may pass through facet 1613. In some embodiment, direct image bundle 1652 is approximately normal to facet 1613. In some embodiments, direct image bundle 1652 is oriented such that it is reflected due to TIR at facet 1611 and passes through image region 1615.

[0116] In some embodiments, facet 1611 may serve a dual role of being highly reflective for the direct imaging bundle 1652 and also being transmissive for TIR imaging bundle 1651 as illustrated in Figure 22. In some embodiments, facet 1611 may serve a dual role of being highly reflective for light emanating from illuminators 1631 and/or 1632 and also being transmissive for light emanating from illuminator 1633. In some embodiments, facet 1611 may be variously reflective and transmissive for some combination of illumination and imaging bundles.

[0117] Figure 22 provides a diagram of a dual imager sensor or system 1607 in accordance with various embodiments. System 1607 includes prism 1610 with multiple facets 1611, 1612, 1613, and 1615. System 1607 includes a direct imager 1644 and a TIR imager 1643. Direct imaging assembly 1642 of Figure 21, for example, may be an example of direct imager 1644. Some embodiments may include direct imager 1644 that may include other optical components as described herein, such as mirrors, 1622, 1623, and 1625. TIR imaging assembly 1641 of Figure 20, for example, may be an example of TIR imager 1643. Some embodiments may include TIR imager 1643 that may include other optical components as described herein, such as mirrors 1621 and/or 1624. Direct imager 1644 and TIR imager 1643 may be oriented and/or positioned in different configurations in different embodiments.

[0118] As described above, different facets of prism 1610 may provide different functions. For example, facet 1611 may serve a dual role of being highly reflective for direct imaging and also being transmissive for TIR imaging. As can be seen, a TIR bundle 1653 directed towards facet 1611 will transmit through facet 1611. A direct imaging bundle 1654 may reflect at facet 1611. In some embodiments, direct imaging bundle 1653 totally internally reflects at facet 1611. In addition, system 1607 shows an example of a facet 1613 that direct imaging bundle 1654 may pass through and then reach a direct imager 1644. Furthermore, a TIR bundle 1655 may pass through facet 1612 and then reach a TIR imager 1643.

[0119] Facets as seen in Figure 22 may have different relationships with each other in order to affect the functions described for different embodiments. For example, facet 1615 and 1611 may be configured such that facet 1611 is oriented approximately perpendicular to an angle equal to or greater than the critical angle of facet 1615 such that light that undergoes TIR at facet 1615 may pass through facet 1611 before or after such TIR interaction. Similarly facet 1612 may be oriented approximately perpendicular to an angle equal to or greater than the critical angle of facet 1615 such that light totally internally reflect at facet 1615 may pass through facet 1612.

[0120] Prism 1610 may include facets such as 1613 that are oriented in different ways. For example, facet 1613 may be oriented relatively perpendicular to light that passed through facet 1615 and reflected from facet 1611 such that the light substantially passes through facet 1613 . [0121] System 1607 may also include different illumination sources. Figures 1 to 6, 16 to 21, and 24 to 25 show different examples with illumination sources. These figures also show different examples of orientations with respect to imagers. Illumination sources may be position and/or oriented in different ways to illuminate a finger, for example, place on prism 1610 along facet 1615, for example. Some embodiments may also include a controller, which may control imagers such as 1643 and 1643 along with illumination sources.

[0122] In some embodiments, sensors and systems may each collect images simultaneously using direct imagers such as 1642 or 1644 and TIR imager 1641 or 1643. If either of the images is multiplexed in the manner of the different embodiments, the image may be decomposed into the images corresponding to the different illumination conditions followed by interpolation and/or other processing of the resulting images. The resulting collection of images (both TIR and direct) may then be processed further in such a manner that a single, composite image of the fingerprint is generated. This composite image may then be reported to a host computer or other connected device.

[0123] In some embodiments, the TIR imager and direct imagers of sensors and systems may acquire synchronized video streams of images. These video streams may be acquired while the finger is rolled in the manner known in the art. The rolled image sequences may then be combined to produce a composite rolled print image.

[0124] In some embodiments, the fingerprint sensor of different embodiments may be used to collect non-fingerprint images. In particular, the direct imager may be used to acquire such images. Other image data so collected may include barcodes and documents. Optical security markings such as holograms, color-changing ink and other such markings may be present and used to confirm that the documents or barcodes by assessing the images that correspond to different illumination conditions. [0125] In some embodiments, the direct imager of the different embodiments may be used to collect iris images, facial images, surveillance images, detect motion, detect ambient lighting conditions, and perform a variety of other such functions. In some embodiments the direct imager may include an automatic, variable focus ("autofocus") mechanism to facilitate additional imaging functionality. [0126] Figure 23 shows a flow diagram for process 2300 for creating composite biometric images from a two imager biometric system. Process 2300 may be implemented, for example, using sensors and systems as seen in Figures 15 to 22. Process 2300 can start at block 2305. At block 2310, a purported skin site is illuminated through a first facet of a platen using one or more illumination sources. At block 2315, light from the purported skin site is received. At block 2320, a direct image of the purported skin site is generated from a first portion of the received light that is reflected at a second facet of the platen. At block 2320, a total-internal- reflectance image of the purported skin site is generated from a second portion of the received light that passes through a third facet of the platen oriented. Process 2300 can end at block 2330. Any of these blocks can occur simultaneously. For instance, blocks 2310 and 2315 may occur at the same time as well as blocks 2320 and 2325.

[0127] In some embodiments of process 2300, a third portion of light is totally internally reflected at the first facet of the platen and then passes through the second facet of the platen. Some embodiments may further comprise absorbing the third portion of the light at a light trap located proximate to the second facet such that totally internally reflected light at the first facet that passes through the second facet is substantially absorbed by the light trap.

[0128] In some embodiments of process 2300, the light received by the direct imaging assembly that is reflected from the second facet of the platen is totally internally reflected at the second facet. In some embodiments, the second and third facets are oriented at substantially critical angles with respect to the first facet. [0129] Some embodiments of process 2300 may include generating a composite image of the purported skin site using the total-internal-reflectance image and the direct image of the purported skin site. Some embodiments may include receiving light from the purported skin site that includes receiving the first portion of the received light at a total-internal-reflectance imaging assembly and receiving the second portion of the received light at a direct imaging assembly. Some embodiments may further comprise decomposing at least one of the images into multiple images corresponding to different illumination conditions.

[0130] Some embodiments of process 2300 may further comprise illuminating a non-skin site through the platen using one or more illumination sources. Light from the non-skin site is received and then a direct image of the non-skin site from a second portion of the received light may be generated. The non-skin site may include barcodes, documents, or optical security markings, for example. In some embodiments, the non-skin site may includes an iris, a portion of a face, a surveillance location, a moving object, or a lighting condition, for example.

[0131] Process 900, for example, can be executed by the computational device shown in Figure 15.

[0132] In some embodiments of the invention, the TIR imager and direct imager may each collect images simultaneously. If either of the images is multiplexed in the manner described in some of the embodiments described herein, the image may be decomposed into the images corresponding to the different illumination conditions followed by interpolation and/or other processing of the resulting images. The resulting collection of images (both TIR and direct) may then be processed to create a single, composite image of the fingerprint. This composite image may then be reported to a host computer or other connected device.

[0133] In some embodiments, the TIR imager and direct imager may acquire synchronized video streams of images. These video streams may be acquired while the finger is rolled in the manner known in the art. The rolled image sequences may then be combined to produce a composite rolled print image.

[0134] Various other configuration can be used. For instance, a first illumination source (e.g. an LED) can be used to illuminating a finger through a first facet (e.g., facet 1615) of a multifaceted prism (e.g., prism 1610). Light from the first illumination source can undergo total internal reflectance at a second facet (e.g., 1611) of the multifaceted prism prior to illuminating the object. A first imager (e.g., 1644) can image light scattered from the finger and passing though the first facet at an angle less than the critical angle and undergoing total internal reflectance at the second facet. A second imager can image light scattered from the finger and passing through the first facet at an angle less than the critical angle. In some embodiments, the second imager can be located in a position such that it does not image light from the second illumination source that is totally internally reflected at the first facet.

[0135] In some embodiments, the second imager can be located out of phase from the second illumination source. That is light from the second illumination source can only image light from the second imager after it is absorbed and/or scattered by the object. And, in this embodiment, light totally internally reflected at the first facet is not imaged by the second imager. For example, the second imager can be located at an azimuthal angle out of line with the second illumination source; such as an angle less than 170°. In some embodiments, this angle is 90°. The second imager can also be located to image light at greater or less than the critical angle.

[0136] In another embodiment, a first illumination source can illuminate an object located at a first facet (e.g., 1615) of a multifaceted prism (e.g., 1610). The system can include a second illumination source that can illuminate the object through a second facet (e.g., 1611) and through the first facet at an angle greater than the critical angle of the first facet. A first imager (e.g., 1644) can image light scattered by the object that passes through the first facet at an angle less than the critical angle and undergoes total internal reflectance at the second facet. A second imager (1643) can be used to image light totally internally reflected from the first facet.

[0137] In some embodiments, the fingerprint sensor of the present invention may be used to collect non-fingerprint images; for example, money, documents, bar codes, manufactured parts, etc. In some of these images optical security markings such as holograms, color-changing ink and other such markings may be present and used to confirm that the documents or barcodes by assessing the images that correspond to different illumination conditions.

[0138] In some embodiments, the dual imager of the present invention may be used to collect finger or hand print images as well as iris images, facial images, surveillance images, detect motion, detect ambient lighting conditions, barcode images, security document images, and perform a variety of other such functions. In some embodiments the direct imager may include an automatic, variable focus ("autofocus") mechanism to facilitate additional imaging functionality.

Claims

WHAT IS CLAIMED IS:

1. A biometric method comprising:

illuminating a purported skin site under two unique illumination conditions during the same illumination session, the first illumination condition comprising light with a first wavelength illuminating the purported skin site at a first angle, and the second illumination condition comprising light with a second wavelength illuminating the purported skin site at a second angle, wherein the first wavelength and the second wavelength are distinct and the first angle and second angle are distinct;

filtering light from the purported skin site using a color filter array that distinguishes between light of the first wavelength and light of the second wavelength; and imaging the filtered light with a single imager.

2. The method according to claim 1, wherein the imaging produces a single multiplexed image of the skin site.

3. The method according to claim 1, wherein the imaging creates a single image of the purported skin site.

4. The method according to claim 1 further comprising extracting a first image of the purported skin site imaged with light of the first wavelength, and extracting a second image of the purported skin site imaged with light of the second wavelength.

5. The method according to claim 1 wherein the first light source is monochromatic, and the second light source is monochromatic.

6. The method according to claim 1, wherein the filtering filters the light using a color filter array.

7. The method according to claim 6, wherein the color filter array comprises a Bayer filter.

8. The method according to claim 1, wherein the first wavelength is between 440 nm and 490 nm.

9. The method according to claim 1, wherein the first wavelength is between 520 nm and 570 nm.

10. The method according to claim 1 further comprising illuminating the purported skin site with light of a third wavelength illuminating the purported skin site at a third angle, wherein the third wavelength is distinct from both the first and the second wavelengths and the third angle is distinct from the second and third angles, wherein the filter distinguishes between light of the third, second and first wavelengths.

11. A system comprising:

a platen having an imaging site;

a first illumination source configured to illuminate the imaging site with light having a first wavelength and at a first angle;

a second illumination source configured to illuminate the imaging site with light having a second wavelength and at a second angle, wherein the first wavelength and the second wavelength are distinct, and the first angle and the second angle are distinct;

a color filter array configured to filter light having the first wavelength from light having the second wavelength; and

an imager configured to acquire an image the skin site through the filter array.

12. The system according to claim 11, wherein either or both the first angle and the second angle are greater than the critical angle defined by the interface at the imaging site and measured relative to the normal.

13. The system according to claim 11 , wherein the color filter array is part of the imager.

14. The system according to claim 11, wherein the image acquired through the color filter array is a multiplexed image.

15. system according to claim 11, wherein the color filter array comprises a Bayer filter.

16. An object location method comprising: illuminating an area near a platen at an exit angle relative to the normal of the platen;

acquiring an image of an object at or near the platen;

identifying a location of an illumination pattern within the image, wherein the illumination pattern is an imaged response of the object being illuminated; and

determining the location of the object relative to the platen from the location of the illumination pattern within the image.

17. The method according to claim 16, wherein the determining determines whether the object is in contact with the platen.

18. The method according to claim 16 further comprising determining a shape of the illumination pattern and determining whether the shape of the illumination pattern is consistent with an expected object.

19. The method according to claim 18, wherein the shape of the illumination pattern includes a geometric shape and/or an illumination pattern.

20. The method according to claim 18, wherein the acquiring, identifying, and determining steps are repeated until the illumination pattern is consistent with the expected object.

21. An object discrimination method comprising:

illuminating a purported skin site of a platen at an exit angle relative to the normal of the platen;

acquiring an image of an object at or near the platen;

identifying the shape of an illumination pattern within the image that is associated with an object; and

determining whether the shape of the illumination pattern is consistent with the shape of an illumination pattern of an expected object.

22. The method according to claim 21 , wherein the illumination pattern includes geometric pattern.

23. The method according to claim 21 , wherein the illumination pattern includes an intensity pattern.

24. The method according to claim 21 , wherein the determining step comprises determining whether the illumination pattern is consistent with an imaged finger.

25. A background discrimination method comprising:

illuminating a purported skin site of a platen with an illumination source having a first wavelength;

acquiring an image of an object at or near the platen, wherein the image is acquired with an imaging system that includes a color filter array that includes a plurality of first pixels associated with the first wavelength and a plurality of second pixels associated with a second wavelength;

identifying an illumination pattern of the obj ect; and

determining whether a higher concentration of first pixels within the illumination pattern are activated than the second pixels within the illumination pattern.

26. The method according to claim 25, wherein the first wavelength is between 440 nm and 490 nm.

27. A system comprising:

a platen having an imaging site;

an illumination source configured to illuminate the imaging site at an exit angle relative to the normal of the imaging site and with light having a first wavelength;

an imager configured to acquire an image of the skin site using a color filter array, wherein the color filter array filters colors according to a plurality of wavelengths and wherein one of the plurality of wavelengths includes the first wavelength; and

a computational unit communicatively coupled with the imager..

28. The system according to claim 27, wherein the computational unit is configured to determine whether an object is in contact with the imaging site from an image of the obj ect provided by the imager.

29. The system according to claim 28, wherein the computational unit is configured to identify an illumination pattern of the object within an image and determine whether the illumination pattern is consistent with an object in contact with the skin site.

30. The system according to claim 27, wherein the computational unit is configured to determine whether an object is consistent with an expected object.

31. The system according to claim 30, wherein the computational unit is configured to identify an illumination pattern of the object within an image and determine whether the illumination pattern is consistent with an expected object.

32. The system according to claim 31 , wherein the illumination pattern includes either or both a geometric pattern and an intensity pattern.

33. The system according to claim 27, wherein

the color filter array includes first pixels associated with the first wavelength; and

the computational unit is configured to whether an object within an image is consistent with a background object.

34. The system according to claim 33, wherein the computational unit is configured to identify an illumination pattern within the image and determine whether the concentration of first pixels activated within the illumination pattern is greater than the concentration of first pixels without the illumination pattern.

35. A biometric system comprising:

first illumination means for illuminating a finger through a first facet of a multifaceted prism, wherein light from the first illumination means undergoes total internal reflectance at a second surface of the multifaceted prism prior to illuminating the object; and first imaging means for imaging light scattered from the finger and passing though the first facet at an angle less than the critical angle and undergoing total internal reflectance at the second facet, wherein the critical angle is defined by an interface of the first facet with an external environment and is measured relative to the normal of the first facet.

36. The system of claim 35, further comprising second imaging means for imaging light scattered from the finger and passing though the first facet at an angle greater than the critical angle.

37. The system claim 35, further comprising a light trap located proximate to the second facet such that light undergoing total internal reflectance at the first facet that passes through the second facet is substantially absorbed by the light trap.

38. The system of claim 36, further comprising a controller interfaced with the first illumination means, the first imaging means, and the second imaging means, the controller including:

instructions to illuminate the finger with the first illumination means during a single illumination session;

instructions to generate a total-internal reflectance image of the finger from light received by the second imaging means; and

instructions to generate a direct image of the finger from light received by the second imaging means.

39. The system of claim 38, wherein the controller interface further includes instructions to generate composite image of the finger using the first imaging means image and the second imaging means image of the finger.

40. The system of claim 36, wherein the first imaging means and the second imaging means are configured to receive light simultaneously.

41. The system of claim 36, wherein the first imaging means and the second imaging means are configured to acquire synchronized video streams.

42. The system of claim 36, wherein at least one of first imaging means or the second imaging means comprises a multispectral imaging means

43. The system of claim 35, further comprising a second illumination means for illuminating the finger through the first facet of a multifaceted prism, wherein light from the second illumination means passes through the second surface of the multifaceted prism prior to illuminating the finger.

44. The system of claim 43, wherein the first illumination means and the second illumination means comprise different wavelengths.

45. A method comprising:

illuminating an object positioned at a first facet with light that undergoes total internal reflectance at a second facet;

imaging light scattered by the object that passes through the first facet at an angle less than the critical angle and undergoes total internal reflectance at the second facet; and

imaging light scattered by the object that passes through the first facet at an angle greater than the critical angle,

wherein the critical angle is defined by an interface of the first facet with an external environment and is measured relative to the normal of the first facet.

46. The method of claim 45, further comprising absorbing light at a light trap located proximate to the second facet, wherein the light undergoes total-internal- reflectance at the first facet and then passes through the second facet.

47. The method of claim 45, further comprising generating a composite image of the object using the image from light scattered by the object that passes through the first facet at the angle less than the critical angle and undergoes total internal reflectance at the second facet and the image from light scattered by the object that passes through the first facet at the angle greater than the critical angle.

48. The method of claim 45, further comprising decomposing at least one of the images into a plurality of images corresponding to different illumination conditions.

49. The method of claim 45, wherein the object comprise a barcode, a document, or money.

50. A multifaceted prism comprising:

a first facet; and

a second facet, wherein the first facet and the second facet are oriented relative to each other such that:

an object positioned at the first facet can be illuminated with light that undergoes total internal reflectance at the second facet,

a portion of light scattered by the object that passes through the first facet at an angle less than the critical angle can be imaged after undergoing total internal reflectance at the second facet, and

a portion of light scattered by the object positioned at the first facet that passes through the first facet at an angle greater than the critical angle can be imaged without interacting with the second facet,

51. The multifaceted prism of claim 50, further comprising: a third facet oriented with respect to the first and second facets such the portion of light scattered by the object that passes through the first facet at an angle less than the critical angle and undergoing total internal reflectance at the second facet then passes through the third facet.

52. The multifaceted prism of claim 51 ,wherein the third facet is oriented substantially perpendicular to the first facet.

53. The multifaceted prism of claim 50, further comprising: a forth facet oriented with respect to the first and second facets such that the portion of light scattered by the object positioned at the first facet that passes through the first facet at an angle greater than the critical angle passes through the fourth facet.

54. The multifaceted prism of claim 53,wherein the fourth facet is oriented at an angle greater than or equal the critical angle with respect to the first facet.

55. A system comprising:

first illumination means for illuminating an object located at a first facet of a multifaceted prism;

second illumination means for illuminating the object through a second facet and through the first facet at an angle greater than the critical angle of the first facet;

first imaging means for imaging light scattered by the object, passes through the first facet at an angle less than the critical angle, and undergoes total internal reflectance at the second facet; and

second imaging means for imaging light totally internally reflected from the first facet,

56. The system according to claim 55, wherein the first illumination means and the second illumination means have distinct wavelengths.

57. The system according to claim 55, wherein the second imaging means is oriented to image light totally internally reflected from the interface of the object and the first facet.

58. The system according to claim 57, wherein the first illumination means illuminates the object at an angle less than the critical angle of the first facet.

59. The system according to claim 55, wherein the first imaging means and the second imaging means are configured to acquire synchronized video streams.

60. A system comprising:

first illumination means for illuminating an object located at a first facet of a multifaceted prism; second illumination means for illuminating the object through a second facet and through the first facet at an angle greater than the critical angle of the first facet;

second imaging means for imaging light scattered from the object at points where the object is in contact with the platen,

61. The system according to claim 60, wherein the second imaging means images the platen at an angle less than the critical angle.

62. The system according to claim 60, wherein the second imaging means images the platen at an elevation angle greater than the critical angle.

63. The system according to claim 60, wherein the second imaging means images the platen at an azimuth angle less than 170° relative to the second illumination means.

64. The system according to claim 60, wherein the first illumination means and the second illumination means have distinct wavelengths.

65. A method comprising:

illuminating an object located at a first facet of a prism at an angle less than the critical angle;

illuminating the object at the first facet at an angle greater than the critical angle, wherein the light enters the prism through a second facet of the prism;

imaging light that is scattered by the object at an angle less than the critical angle relative to the first facet and totally internally reflected at the second facet using a first imaging system; and

imaging light from the first facet using a second imaging system, wherein the critical angle is defined by an interface of the first facet with an external environment and is measured relative to the normal of the first facet.

66. The method of claim 65, wherein imaging light from the first facet using a second imaging system further comprises imaging light totally internally reflected from the first facet using the second imaging system.

67. The method of claim 65, wherein imaging light from the first facet using a second imaging system further comprises imaging light scattered by the object at object- facet interface using the second imaging system.

68. The method of claim 65, wherein illuminating the object located at the first facet of the prism at an angle less than the critical angle and illuminating the object at the first facet at the angle greater than the critical angle with light having distinct wavelengths.

69. The method of claim 65 further comprising generating a composite image of the object using the images created by a first imaging system and the second imaging system.

70. A system comprising:

a multifaceted prism having a first and second facet;

a first illumination source configured to illuminate the first facet at an angle less than the critical angle;

a second illumination source configured to illuminate the first facet at an angle greater than the critical angle, wherein light from the second illumination source enters the prism through the second facet;

a first imager configured to image light from the first facet that is totally internally reflected by the second facet; and

a second imager configured to image light from the first illumination source that is totally internally reflected from the first facet,

71. A system comprising:

a multifaceted prism having a first and second facet; a first illumination source configured to illuminate the first facet at an angle less than the critical angle;

a second imager configured to image light scattered from the interface of the object and the first facet,

72. The system according to claim 71, wherein the second imager images light at an elevation angle less than the critical angle.

73. The system according to claim 71, wherein the second imager images light at an elevation angle greater than the critical angle.

74. The system according to claim 71, wherein the second imager images light at an azimuth angle out of phase with the second illumination source.