US20160335514A1 - Mapping of Blood Vessels for Biometric Authentication - Google Patents

Mapping of Blood Vessels for Biometric Authentication Download PDF

Info

Publication number
US20160335514A1
US20160335514A1 US15/224,198 US201615224198A US2016335514A1 US 20160335514 A1 US20160335514 A1 US 20160335514A1 US 201615224198 A US201615224198 A US 201615224198A US 2016335514 A1 US2016335514 A1 US 2016335514A1
Authority
US
United States
Prior art keywords
microwave
excitation
target
optical
acoustic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US15/224,198
Other versions
US9959477B2 (en
Inventor
Mohammad Amin Arbabian
Seyed Miaad Seyed Aliroteh
Hao Nan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leland Stanford Junior University
Original Assignee
Leland Stanford Junior University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leland Stanford Junior University filed Critical Leland Stanford Junior University
Priority to US15/224,198 priority Critical patent/US9959477B2/en
Assigned to THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY reassignment THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ARBABIAN, MOHAMMAD AMIN, NAN, Hao, SEYED ALIROTEH, SEYED MIAAD
Publication of US20160335514A1 publication Critical patent/US20160335514A1/en
Application granted granted Critical
Publication of US9959477B2 publication Critical patent/US9959477B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G06K9/209
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0093Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/117Identification of persons
    • A61B5/1171Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4887Locating particular structures in or on the body
    • A61B5/489Blood vessels
    • G06K9/00885
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143Sensing or illuminating at different wavelengths
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147Details of sensors, e.g. sensor lenses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06K2009/00932
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/14Vascular patterns

Definitions

  • This invention relates to thermoacoustic imaging.
  • Thermoacoustic imaging involves illuminating a target with microwaves and performing acoustic imaging of sound generated in the target by the thermoacoustic effect.
  • Photoacoustic imaging is a similar physical effect using an optical excitation as opposed to a microwave excitation.
  • thermoacoustic imaging Although these effects have been used in imaging for some time now, it remains desirable to improve their performance to enable new and challenging applications. Accordingly, it would be an advance in the art to provide improved thermoacoustic imaging.
  • thermoacoustic imaging is biometric authentication based on the pattern of blood vessels in a user's finger. This is a challenging application for thermoacoustic imaging, since the relevant size scale is much less than in conventional applications such as whole-body or organ-scale imaging.
  • FIG. 5B is a thermoacoustic image of the phantom of FIG. 5A , and illustrates this problem.
  • FIG. 5C shows a corresponding thermoacoustic image of the phantom of FIG. 5A according to principles of the invention.
  • Linear polarization of the microwaves is avoided, and the resulting image is much more accurate than the image of FIG. 5B .
  • Polarization can be quantified by referring to the eccentricity e of the polarization ellipse.
  • Embodiments of the invention have e ⁇ 0.87.
  • Preferred embodiments have e ⁇ 0.71.
  • Particularly preferred embodiments have e 0.32.
  • thermoacoustic imaging is acoustic imaging based on microwave or microwave+optical excitation.
  • FIG. 1 shows a first embodiment of the invention.
  • FIG. 2 shows a second embodiment of the invention.
  • FIG. 3 shows a preferred microwave excitation array for use in embodiments of the invention.
  • FIG. 4A shows an exemplary unit cell of the microwave excitation array that includes several near-field excitation elements.
  • FIG. 4B shows notation for describing elliptical polarization.
  • FIG. 5A is an image of a phantom that simulates blood vessels in tissue.
  • FIG. 5B is a thermoacoustic image of the phantom of
  • FIG. 5A making use of linearly polarized microwaves from 2-element emitters.
  • FIG. 5C is a thermoacoustic image of the phantom of FIG. 5A making use of circularly polarized microwaves from 4-element emitters, in accordance with principles of the present invention.
  • FIG. 6 shows an exemplary excitation and sensor array featuring integration of optical sources, microwave excitation and an acoustic sensor array.
  • FIG. 7 schematically shows how improved depth uniformity can be provided by using optical excitation and microwave excitation at several different microwave frequencies.
  • FIG. 8 shows a first exemplary alternating arrangement of optical sources and microwave emitter array unit cells.
  • FIG. 9 shows a second exemplary alternating arrangement of optical sources and microwave emitter array unit cells.
  • FIG. 10 shows an embodiment of the invention that is flexible in order to conform to the shape of the target being imaged.
  • FIG. 1 shows a first embodiment of the invention.
  • a microwave source 102 is configured to provide a microwave output.
  • a microwave emitter array 104 includes two or more unit cells 110 , which can be identical or dissimilar. As described in greater detail below, the unit cells each include three or more near-field excitation elements.
  • Microwave emitter array 104 is configured to receive the microwave output from microwave source 102 , and to provide microwave excitation 112 to a target 114 via the near-field excitation elements of the unit cells 110 .
  • the spacing between the microwave emitter and a typical position within the target is referenced as h.
  • We define “near-field” to be within 10 wavelengths of the emitter within the target. For example, at 9 GHz the near-field region is within about 3 mm of the emitter in tissue.
  • An acoustic sensor array 106 includes one or more sensor elements 118 that are configured to receive acoustic signals 116 from target 114 responsive to microwave excitation 112 .
  • a processor 108 is configured to receive signals from acoustic sensor array 106 and to provide an acoustic image of target 114 .
  • the microwave emitter array can be periodic or aperiodic. As described in greater detail below, the microwave emitter array can be integrated with other sensors and/or excitation sources, such as optical excitation sources and/or acoustic sensors.
  • the acoustic sensor array and the microwave emitter array are disposed on opposite sides of the target. It is also possible for the acoustic sensor array and the microwave emitter array to be disposed on the same side of the target, e.g. as in the example of FIG. 6 below.
  • Preferred pulsed embodiments provide microwave pulses having a duration of 1 ⁇ s or less, a peak power of 0.1 W or more, and a repetition rate of 1 Hz or more.
  • the microwave source can be configured to provide a continuous amplitude-modulated microwave output, such as Frequency-Modulated Continuous Wave (FMCW) or Stepped-Frequency Continuous Wave (SFCW).
  • FMCW Frequency-Modulated Continuous Wave
  • SFCW Stepped-Frequency Continuous Wave
  • the frequency is preferably between 0.1 GHz and 20 GHz.
  • crosstalk is mitigated using various strategies.
  • non-adjacent unit cells of the microwave emitter array can be activated in sequence in order to reduce cross-talk between different unit cells.
  • Another mitigation strategy is to activate non-adjacent sensor elements of the acoustic sensor array in sequence in order to reduce cross-talk between different sensor elements.
  • This pattern of activation can be a simple interleaved pattern or a pseudo-random activation of elements.
  • the sensor array elements can be individually tuned to different acoustic frequencies. These acoustic frequencies are preferably in a range from 1 MHz to 30 MHz to provide high sensitivity and high resolution simultaneously.
  • FIG. 2 shows a second embodiment of the invention. This embodiment is similar to the embodiment of FIG. 1 , except that one or more auxiliary sensors 202 are added.
  • sensors can be microwave sensors, optical sensors or acoustic sensors.
  • auxiliary sensors including but not limited to: 1) monitoring and calibrating the microwave excitation, 2) monitoring and calibrating the optical radiation, 3) obtaining course-grain information about the target geometry and its motion, 4) providing signals for cancellation of microwave to acoustic leakage directly with analog electronics, 5) providing signals for cancellation of microwave to acoustic leakage computationally in post-processing, 6) providing signals for cancellation of optical to acoustic leakage directly with analog electronics, and 7) providing signals for cancellation of optical to acoustic leakage computationally in post-processing.
  • Functions 2, 6 and 7 in this list relate to below-described embodiments that include optical excitation of the target in addition to microwave excitation of the target.
  • FIG. 3 schematically shows a preferred microwave excitation array for use in embodiments of the invention.
  • each element emits with circular polarization (as shown), and there is also an alternating pattern of clockwise and counterclockwise rotation in the polarizations.
  • the alternating pattern of clockwise and counterclockwise rotation in the polarization is a consequence of the sharing of excitation elements between adjacent excitation cells, to create a more economical design.
  • such an emitter array can have N rows and M columns, although either M or N can be 1 to provide a 1-D array.
  • FIG. 4A shows an exemplary unit cell of the microwave excitation array that includes several near-field excitation elements.
  • four T-shaped near field excitation elements 402 , 404 , 406 , and 408 ) are disposed in an aperture 410 .
  • We can create a directionally uniform excitation by generating a rotating electric field using three or more near field excitation elements fed with RF phases that are equally spaced in the 0 to 360 degree range.
  • 4 near field excitation elements are shown that are fed with 0, 90, 180, and 270 degree phases.
  • the geometrical parameters a and s on FIG. 4A are preferably related to other design parameters as follows: a ⁇ 2h, a ⁇ /2, s ⁇ a.
  • FIG. 4B shows notation for describing elliptical polarization.
  • the time evolution of the electric field of an electromagnetic excitation in a reference plane describes an ellipse, which we refer to as the polarization ellipse.
  • E u be the electric field magnitude of the major axis of the polarization ellipse (as shown).
  • E v be the electric field magnitude of the minor axis of the polarization ellipse (as shown).
  • the eccentricity e of the polarization ellipse is defined by
  • thermoacoustic signal a linear target (such as a blood vessel) that is aligned with E u .
  • TA ⁇ thermoacoustic signal obtained from a linear target that is aligned with E v . Then the directional uniformity U is given by
  • Relative phases of excitation elements of the unit cells of the emitter array are preferably selected to provide sufficiently low eccentricity in a reference plane within the target and parallel to the emitter array. It is convenient to refer to this arrangement of the reference plane as being “within the target”.
  • FIG. 5A is an image of a phantom that simulates blood vessels in tissue. It includes long thin structures at various directions as can be expected of blood vessels in tissue.
  • FIG. 5B is a thermoacoustic image of the phantom of FIG. 5A making use of linearly polarized microwaves from 2-element emitters. Here it is apparent that the image is seriously distorted. Investigation has confirmed that these poor imaging results are a result of unfavorable alignment between features being imaged and the linear polarization of the microwave excitation.
  • FIG. 5C is a thermoacoustic image of the phantom of FIG. 5A making use of circularly polarized microwaves from 4-element emitters, in accordance with principles of the present invention. Here it is seen that much better imaging results are obtained.
  • Some embodiments of the invention further include providing optical radiation to the target to improve thermoacoustic imaging.
  • the main idea is to make the overall energy deposition provided by the system more uniform by appropriately combining microwave excitation and optical radiation.
  • FIG. 6 shows an example of this approach.
  • Here 600 is the integrated device, shown in a view looking down on the device from where the target would be in operation.
  • 602 a and 602 b are optical sources configured to provide optical radiation to the target, and in this design are intended to provide 0 to 2 mm penetration depth in tissue.
  • Preferred optical wavelength(s) for this excitation are between 750 nm and 1500 nm.
  • Microwave emitters 604 a , 604 b , 604 c , and 604 d provide an outer microwave excitation 604 e , intended to provide excitation from 5 mm to 15 mm depth in tissue.
  • Inputs 606 a , 606 b , 606 c , 606 d to emitters 604 a , 604 b , 604 c , 604 d have equally spaced relative phases as described above to provide sufficient directional uniformity.
  • Inner microwave excitation 610 e is provided by emitters 610 a , 610 b , 610 c , 610 d .
  • Inner microwave excitation 612 e is provided by emitters 612 a , 612 b , 612 c , 612 d .
  • Inner microwave excitation 614 e is provided by emitters 614 a , 614 b , 614 c , 614 d . These emitters are driven by inputs 608 a , 608 b , 608 c , 608 d having equally spaced phases as described above to provide sufficient directional uniformity.
  • the pattern of connections between inputs 608 a , 608 b , 608 c , 608 d and the emitters for the array lead to opposite polarization rotation for excitation 612 e compared to excitations 610 e and 614 e.
  • the acoustic sensor array is the acoustic sensor array.
  • the acoustic sensor array and the microwave emitter array are disposed on the same side of the target.
  • the microwave excitation and the optical radiation can be provided to the target synchronously using a single trigger signal.
  • the microwave excitation and the optical radiation can be provided sequentially in alternation.
  • the spacing and geometry of the excitation cells can be optimized for different frequencies.
  • FIG. 7 schematically shows how improved depth uniformity can be provided by using optical excitation and microwave excitation at two or more different microwave frequencies.
  • 702 is the optical excitation
  • 704 is microwave excitation at a first RF frequency f 1
  • 706 is microwave excitation at a second RF frequency f 2
  • 708 is microwave excitation at a third RF frequency f 3 .
  • Microwaves at lower frequencies have greater penetration depth in tissue, so we have f 1 >f 2 >f 3 for biometric applications.
  • the overall energy deposition is schematically shown as 710 , and is significantly more uniform than the deposition from any one of the sources.
  • the microwave signals at the two or more frequencies are configured to enhance depth uniformity of thermoacoustic imaging.
  • Depth uniformity is defined with respect to energy deposition in a homogeneous target.
  • a deposition pattern is considered to have depth uniformity if the energy deposition at a depth of minimum energy absorption within a predetermined depth range is 25% or more of the energy deposition at a depth of maximum energy absorption within the predetermined depth range.
  • this predetermined depth range can be 0-10 wavelengths of the microwave excitation being used.
  • the target has a first region closer to a surface of the target than a second region, and the optical radiation is mainly provided to the first region, while the microwave excitation is mainly provided to the second region.
  • the optical source can be configured to provide optical radiation at two or more optical wavelengths, and the optical radiation at the two or more optical wavelengths can be configured to enhance depth uniformity of thermoacoustic imaging.
  • FIG. 8 shows a checkerboard pattern of alternating microwave unit cells 802 and optical emitters 804 .
  • FIG. 9 shows row by row alternation of microwave unit cells 802 and optical emitters 804 .
  • the apparatus is rigid and planar. In other cases, the apparatus is flexible in order to conform to a shape of the target.
  • FIG. 10 shows an example along these lines.
  • microwave emitter array 1002 is flexible and can conform to the shape of target 114 in operation.
  • the apparatus can also be rigid and have a non-planar geometry, such as cylindrical and hemispherical geometries. These geometries are expected to be useful for the application of biometric authentication using finger blood vessels. For example, a cylindrical excitation/sensor array can surround the finger.

Abstract

Improved thermoacoustic imaging is provided by ensuring directional uniformity of the microwave excitation provided to the target being imaged. This directional uniformity can be quantified in terms of the eccentricity e of the polarization ellipse of the microwave excitation. We have e≦0.87, preferably e≦0.71, and more preferably e≦0.32. Optical excitation can be provided in addition to the microwave excitation. Excitation can be performed at multiple optical wavelengths and/or microwave frequencies to improve depth uniformity. In addition, the employment of excitation cells with optimized spacing and geometry provides the uniformity in another two degrees of freedom. One potential application is to detect blood vessel in user's finger for biometric authentication.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation in part of U.S. Pat. No. 14/636,537, filed on Mar. 3, 2015, and hereby incorporated by reference in its entirety.
  • Application Ser. No. 14/636,537 claims the benefit of U.S. provisional patent application 61/947,241, filed on Mar. 3, 2014, and hereby incorporated by reference in its entirety.
  • Application Ser. No. 14/636,537 claims the benefit of U.S. provisional patent application 62/127,101, filed on Mar. 2, 2015, and hereby incorporated by reference in its entirety.
  • FIELD OF THE INVENTION
  • This invention relates to thermoacoustic imaging.
  • BACKGROUND
  • Thermoacoustic imaging involves illuminating a target with microwaves and performing acoustic imaging of sound generated in the target by the thermoacoustic effect. Photoacoustic imaging is a similar physical effect using an optical excitation as opposed to a microwave excitation.
  • Although these effects have been used in imaging for some time now, it remains desirable to improve their performance to enable new and challenging applications. Accordingly, it would be an advance in the art to provide improved thermoacoustic imaging.
  • SUMMARY
  • One potential application for thermacoustic imaging is biometric authentication based on the pattern of blood vessels in a user's finger. This is a challenging application for thermoacoustic imaging, since the relevant size scale is much less than in conventional applications such as whole-body or organ-scale imaging.
  • In addition to various challenges related to this change of scale, we have unexpectedly found that the polarization of the microwave excitation is critical for getting good thermoacoustic images of vessel-like structures. FIG. 5B is a thermoacoustic image of the phantom of FIG. 5A, and illustrates this problem.
  • Structures in the phantom that are unfavorably aligned with the linear microwave polarization used for this image are not seen in the image, which is a catastrophic lack of image quality. FIG. 5C shows a corresponding thermoacoustic image of the phantom of FIG. 5A according to principles of the invention. Linear polarization of the microwaves is avoided, and the resulting image is much more accurate than the image of FIG. 5B. Polarization can be quantified by referring to the eccentricity e of the polarization ellipse. Embodiments of the invention have e≦0.87. Preferred embodiments have e≦0.71. Particularly preferred embodiments have e 0.32.
  • In some embodiments, optical excitation is combined with microwave excitation. It is convenient to regard these embodiments as also relating to thermoacoustic imaging, so we define thermoacoustic imaging as acoustic imaging based on microwave or microwave+optical excitation.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a first embodiment of the invention.
  • FIG. 2 shows a second embodiment of the invention.
  • FIG. 3 shows a preferred microwave excitation array for use in embodiments of the invention.
  • FIG. 4A shows an exemplary unit cell of the microwave excitation array that includes several near-field excitation elements.
  • FIG. 4B shows notation for describing elliptical polarization.
  • FIG. 5A is an image of a phantom that simulates blood vessels in tissue.
  • FIG. 5B is a thermoacoustic image of the phantom of
  • FIG. 5A making use of linearly polarized microwaves from 2-element emitters.
  • FIG. 5C is a thermoacoustic image of the phantom of FIG. 5A making use of circularly polarized microwaves from 4-element emitters, in accordance with principles of the present invention.
  • FIG. 6 shows an exemplary excitation and sensor array featuring integration of optical sources, microwave excitation and an acoustic sensor array.
  • FIG. 7 schematically shows how improved depth uniformity can be provided by using optical excitation and microwave excitation at several different microwave frequencies.
  • FIG. 8 shows a first exemplary alternating arrangement of optical sources and microwave emitter array unit cells.
  • FIG. 9 shows a second exemplary alternating arrangement of optical sources and microwave emitter array unit cells.
  • FIG. 10 shows an embodiment of the invention that is flexible in order to conform to the shape of the target being imaged.
  • DETAILED DESCRIPTION
  • FIG. 1 shows a first embodiment of the invention. In this example, a microwave source 102 is configured to provide a microwave output. A microwave emitter array 104 includes two or more unit cells 110, which can be identical or dissimilar. As described in greater detail below, the unit cells each include three or more near-field excitation elements. Microwave emitter array 104 is configured to receive the microwave output from microwave source 102, and to provide microwave excitation 112 to a target 114 via the near-field excitation elements of the unit cells 110. The spacing between the microwave emitter and a typical position within the target is referenced as h. We define “near-field” to be within 10 wavelengths of the emitter within the target. For example, at 9 GHz the near-field region is within about 3 mm of the emitter in tissue.
  • An acoustic sensor array 106 includes one or more sensor elements 118 that are configured to receive acoustic signals 116 from target 114 responsive to microwave excitation 112. A processor 108 is configured to receive signals from acoustic sensor array 106 and to provide an acoustic image of target 114. The microwave emitter array can be periodic or aperiodic. As described in greater detail below, the microwave emitter array can be integrated with other sensors and/or excitation sources, such as optical excitation sources and/or acoustic sensors.
  • In this example, the acoustic sensor array and the microwave emitter array are disposed on opposite sides of the target. It is also possible for the acoustic sensor array and the microwave emitter array to be disposed on the same side of the target, e.g. as in the example of FIG. 6 below.
  • Various possibilities exist for the microwave source. Preferred pulsed embodiments provide microwave pulses having a duration of 1 μs or less, a peak power of 0.1 W or more, and a repetition rate of 1 Hz or more. Alternatively, the microwave source can be configured to provide a continuous amplitude-modulated microwave output, such as Frequency-Modulated Continuous Wave (FMCW) or Stepped-Frequency Continuous Wave (SFCW). The frequency (or frequencies for multi-frequency excitation) is preferably between 0.1 GHz and 20 GHz.
  • In preferred embodiments, crosstalk is mitigated using various strategies. For example non-adjacent unit cells of the microwave emitter array can be activated in sequence in order to reduce cross-talk between different unit cells. Another mitigation strategy is to activate non-adjacent sensor elements of the acoustic sensor array in sequence in order to reduce cross-talk between different sensor elements. This pattern of activation can be a simple interleaved pattern or a pseudo-random activation of elements.
  • The sensor array elements can be individually tuned to different acoustic frequencies. These acoustic frequencies are preferably in a range from 1 MHz to 30 MHz to provide high sensitivity and high resolution simultaneously.
  • FIG. 2 shows a second embodiment of the invention. This embodiment is similar to the embodiment of FIG. 1, except that one or more auxiliary sensors 202 are added. Such sensors can be microwave sensors, optical sensors or acoustic sensors. Various functions can be provided by such auxiliary sensors, including but not limited to: 1) monitoring and calibrating the microwave excitation, 2) monitoring and calibrating the optical radiation, 3) obtaining course-grain information about the target geometry and its motion, 4) providing signals for cancellation of microwave to acoustic leakage directly with analog electronics, 5) providing signals for cancellation of microwave to acoustic leakage computationally in post-processing, 6) providing signals for cancellation of optical to acoustic leakage directly with analog electronics, and 7) providing signals for cancellation of optical to acoustic leakage computationally in post-processing.
  • Functions 2, 6 and 7 in this list relate to below-described embodiments that include optical excitation of the target in addition to microwave excitation of the target.
  • As indicated above, it is important to avoid the use of a linearly polarized microwave excitation. Circular polarization is most preferred, although some deviation from circular polarization is permissible. FIG. 3 schematically shows a preferred microwave excitation array for use in embodiments of the invention. Here each element emits with circular polarization (as shown), and there is also an alternating pattern of clockwise and counterclockwise rotation in the polarizations. The alternating pattern of clockwise and counterclockwise rotation in the polarization is a consequence of the sharing of excitation elements between adjacent excitation cells, to create a more economical design. However, this is not a strict requirement for proper device operation and thus it is possible to employ a single clockwise or counterclockwise polarization in all excitation cells by not sharing any excitation elements between cells. In general, such an emitter array can have N rows and M columns, although either M or N can be 1 to provide a 1-D array.
  • FIG. 4A shows an exemplary unit cell of the microwave excitation array that includes several near-field excitation elements. In this example, four T-shaped near field excitation elements (402, 404, 406, and 408) are disposed in an aperture 410. We can create a directionally uniform excitation by generating a rotating electric field using three or more near field excitation elements fed with RF phases that are equally spaced in the 0 to 360 degree range. In this example, 4 near field excitation elements are shown that are fed with 0, 90, 180, and 270 degree phases. The geometrical parameters a and s on FIG. 4A are preferably related to other design parameters as follows: a≈√2h, a≈λ/2, s≈a. Microwave frequency f and wavelength λ are related by fλ=c/√ε, where ε is the effective dielectric constant of the target material at frequency f, and c is the speed of light.
  • Here it is helpful to consider the polarization of the microwaves in more detail. FIG. 4B shows notation for describing elliptical polarization. In general, the time evolution of the electric field of an electromagnetic excitation in a reference plane describes an ellipse, which we refer to as the polarization ellipse. Let Eu be the electric field magnitude of the major axis of the polarization ellipse (as shown). Let Ev be the electric field magnitude of the minor axis of the polarization ellipse (as shown). The eccentricity e of the polarization ellipse is defined by
  • e = 1 - ( E v E u ) 2 .
  • We define directional uniformity of the thermoacoustic signal as follows. Let TA+ be the thermoacoustic signal obtained from a linear target (such as a blood vessel) that is aligned with Eu. Let TA be the thermoacoustic signal obtained from a linear target that is aligned with Ev. Then the directional uniformity U is given by
  • U = TA + - TA - TA + .
  • We have U≦0.75, more preferably U≦0.5 and most preferably U≦0.1. Since
  • TA - TA + = ( E v E u ) 2
  • we have so we see that e≦0.87, more preferably e≦0.71, and most preferably e≦0.32. Relative phases of excitation elements of the unit cells of the emitter array are preferably selected to provide sufficiently low eccentricity in a reference plane within the target and parallel to the emitter array. It is convenient to refer to this arrangement of the reference plane as being “within the target”.
  • The significance of providing directional uniformity as described above is clearly shown on FIGS. 5A-C. Here FIG. 5A is an image of a phantom that simulates blood vessels in tissue. It includes long thin structures at various directions as can be expected of blood vessels in tissue. FIG. 5B is a thermoacoustic image of the phantom of FIG. 5A making use of linearly polarized microwaves from 2-element emitters. Here it is apparent that the image is seriously distorted. Investigation has confirmed that these poor imaging results are a result of unfavorable alignment between features being imaged and the linear polarization of the microwave excitation.
  • FIG. 5C is a thermoacoustic image of the phantom of FIG. 5A making use of circularly polarized microwaves from 4-element emitters, in accordance with principles of the present invention. Here it is seen that much better imaging results are obtained.
  • Some embodiments of the invention further include providing optical radiation to the target to improve thermoacoustic imaging. The main idea is to make the overall energy deposition provided by the system more uniform by appropriately combining microwave excitation and optical radiation. In such embodiments, it is preferred to integrate optical sources, microwave emitters and the acoustic sensor array on the same surface. FIG. 6 shows an example of this approach.
  • Here 600 is the integrated device, shown in a view looking down on the device from where the target would be in operation. Here 602 a and 602 b are optical sources configured to provide optical radiation to the target, and in this design are intended to provide 0 to 2 mm penetration depth in tissue. Preferred optical wavelength(s) for this excitation are between 750 nm and 1500 nm. Microwave emitters 604 a, 604 b, 604 c, and 604 d provide an outer microwave excitation 604 e, intended to provide excitation from 5 mm to 15 mm depth in tissue. Inputs 606 a, 606 b, 606 c, 606 d to emitters 604 a, 604 b, 604 c, 604 d have equally spaced relative phases as described above to provide sufficient directional uniformity.
  • The 2 mm to 5 mm depth range in tissue is covered by an array of three unit cells. Inner microwave excitation 610 e is provided by emitters 610 a, 610 b, 610 c, 610 d. Inner microwave excitation 612 e is provided by emitters 612 a, 612 b, 612 c, 612 d. Inner microwave excitation 614 e is provided by emitters 614 a, 614 b, 614 c, 614 d. These emitters are driven by inputs 608 a, 608 b, 608 c, 608 d having equally spaced phases as described above to provide sufficient directional uniformity. The pattern of connections between inputs 608 a, 608 b, 608 c, 608 d and the emitters for the array lead to opposite polarization rotation for excitation 612 e compared to excitations 610 e and 614 e.
  • Here 616 is the acoustic sensor array. In this example, the acoustic sensor array and the microwave emitter array are disposed on the same side of the target.
  • The microwave excitation and the optical radiation can be provided to the target synchronously using a single trigger signal. Alternatively, the microwave excitation and the optical radiation can be provided sequentially in alternation.
  • This is an example of combining one large, low-frequency microwave excitation cell with several smaller high-frequency microwave excitation cells and optical cells to create a more uniform excitation along the depth. Uniform field distribution in depth is improved by using a combination of optical excitation together with multiple-frequency microwave excitation. Optical excitation is optimized in the closest region, high frequency microwave is optimized in the mid region, and low frequency microwave is optimized in the far region. A combination of frequency selection together with selection of the excitation cell geometries and locations can provide a uniform excitation.
  • The spacing and geometry of the excitation cells can be optimized for different frequencies.
  • FIG. 7 schematically shows how improved depth uniformity can be provided by using optical excitation and microwave excitation at two or more different microwave frequencies. Here 702 is the optical excitation, 704 is microwave excitation at a first RF frequency f1, 706 is microwave excitation at a second RF frequency f2, and 708 is microwave excitation at a third RF frequency f3. Microwaves at lower frequencies have greater penetration depth in tissue, so we have f1>f2>f3 for biometric applications. The overall energy deposition is schematically shown as 710, and is significantly more uniform than the deposition from any one of the sources. Thus the microwave signals at the two or more frequencies are configured to enhance depth uniformity of thermoacoustic imaging.
  • Depth uniformity is defined with respect to energy deposition in a homogeneous target. A deposition pattern is considered to have depth uniformity if the energy deposition at a depth of minimum energy absorption within a predetermined depth range is 25% or more of the energy deposition at a depth of maximum energy absorption within the predetermined depth range. For example, this predetermined depth range can be 0-10 wavelengths of the microwave excitation being used.
  • In the example of FIG. 7, the target has a first region closer to a surface of the target than a second region, and the optical radiation is mainly provided to the first region, while the microwave excitation is mainly provided to the second region.
  • Although the example of FIG. 7 shows use of only a single optical wavelength, two or more optical wavelengths can be employed to improve depth uniformity. In such cases, the optical source can be configured to provide optical radiation at two or more optical wavelengths, and the optical radiation at the two or more optical wavelengths can be configured to enhance depth uniformity of thermoacoustic imaging.
  • Optical emitters and the unit cells of the microwave emitter array can alternate. FIG. 8 shows a checkerboard pattern of alternating microwave unit cells 802 and optical emitters 804. FIG. 9 shows row by row alternation of microwave unit cells 802 and optical emitters 804.
  • Practice of the invention does not depend critically on the overall mechanical configuration. In some cases, the apparatus is rigid and planar. In other cases, the apparatus is flexible in order to conform to a shape of the target. FIG. 10 shows an example along these lines. Here microwave emitter array 1002 is flexible and can conform to the shape of target 114 in operation. The apparatus can also be rigid and have a non-planar geometry, such as cylindrical and hemispherical geometries. These geometries are expected to be useful for the application of biometric authentication using finger blood vessels. For example, a cylindrical excitation/sensor array can surround the finger.

Claims (25)

1. Apparatus for thermoacoustic imaging, the apparatus comprising:
a microwave source configured to provide a microwave output;
an microwave emitter array including two or more unit cells, wherein the unit cells each comprise two or more near-field excitation elements;
wherein the microwave emitter array is configured to receive the microwave output from the microwave source, and wherein the microwave emitter array is configured to provide microwave excitation to a target via the near-field excitation elements of the unit cells;
wherein the microwave output is provided to the near-field excitation elements of the unit cells with relative phases selected to provide polarization eccentricity of 0.87 or less within the target;
an acoustic sensor array having one or more sensor elements configured to receive acoustic signals from the target responsive to the microwave excitation;
a processor configured to receive signals from the acoustic sensor array and to provide an acoustic image of the target.
2. The apparatus of claim 1, wherein the relative phases within each unit cell are substantially equally spaced apart.
3. The apparatus of claim 1, further comprising an optical source configured to provide optical radiation to the target.
4. The apparatus of claim 3, wherein the target comprises a first region closer to a surface of the target than a second region, wherein the optical radiation is mainly provided to the first region, wherein the microwave excitation is mainly provided to the second region, whereby depth uniformity of thermoacoustic imaging is improved.
5. The apparatus of claim 3, wherein the optical source is configured to provide optical radiation at two or more optical wavelengths, and wherein the optical radiation at the two or more optical wavelengths is configured to enhance depth uniformity of thermoacoustic imaging.
6. The apparatus of claim 3, wherein the microwave excitation and the optical radiation are provided synchronously using a single trigger signal.
7. The apparatus of claim 3 wherein the microwave excitation and the optical radiation are provided sequentially in alternation.
8. The apparatus of claim 3, further comprising one or more auxiliary sensors;
wherein the auxiliary sensors are selected from the group consisting of microwave sensors, optical sensors and acoustic sensors;
wherein the auxiliary sensors are configured to provide one or more functions selected from the group consisting of: monitoring and calibrating the microwave excitation, monitoring and calibrating the optical radiation, obtaining course-grain information about the target geometry and its motion, providing signals for cancellation of microwave to acoustic leakage directly with analog electronics, providing signals for cancellation of microwave to acoustic leakage computationally in post-processing, providing signals for cancellation of optical to acoustic leakage directly with analog electronics, providing signals for cancellation of optical to acoustic leakage computationally in post-processing.
9. The apparatus of claim 3, wherein optical emitters and the unit cells of the microwave emitter array alternate.
10. The apparatus of claim 1, wherein the microwave emitter array is periodic.
11. The apparatus of claim 1, wherein the microwave emitter array is aperiodic.
12. The apparatus of claim 1, wherein the microwave output comprises microwave signals at two or more frequencies.
13. The apparatus of claim 12, wherein the microwave signals at the two or more frequencies are configured to enhance depth uniformity of thermoacoustic imaging.
14. The apparatus of claim 1, wherein the acoustic sensor array and the microwave emitter array are disposed on the same side of the target.
15. The apparatus of claim 1, wherein the acoustic sensor array and the microwave emitter array are disposed on opposite sides of the target.
16. The apparatus of claim 1, wherein the microwave source is configured to provide microwave pulses having a duration of 1 μs or less, a peak power of 0.1 W or more, and a repetition rate of 1 Hz or more.
17. The apparatus of claim 1, wherein the microwave source is configured to provide a continuous amplitude-modulated microwave output.
18. The apparatus of claim 1, wherein non-adjacent unit cells are activated in sequence in order to reduce cross-talk between different unit cells.
19. The apparatus of claim 1, wherein non-adjacent sensor elements are activated in sequence in order to reduce cross-talk between different sensor elements.
20. The apparatus of claim 1, wherein the sensor array elements are individually tuned to different acoustic frequencies.
21. The apparatus of claim 1, wherein the apparatus is flexible in order to conform to a shape of the target.
22. The apparatus of claim 1, wherein the apparatus is rigid and has a non-planar geometry.
23. The apparatus of claim 1, wherein the apparatus is rigid and planar.
24. The apparatus of claim 1, wherein the microwave output is provided to the near-field excitation elements of the unit cells with relative phases selected to provide polarization eccentricity of 0.71 or less within the target.
25. The apparatus of claim 24, wherein the microwave output is provided to the near-field excitation elements of the unit cells with relative phases selected to provide polarization eccentricity of 0.32 or less within the target.
US15/224,198 2014-03-03 2016-07-29 Mapping of blood vessels for biometric authentication Expired - Fee Related US9959477B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/224,198 US9959477B2 (en) 2014-03-03 2016-07-29 Mapping of blood vessels for biometric authentication

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201461947241P 2014-03-03 2014-03-03
US201562127101P 2015-03-02 2015-03-02
US201514636537A 2015-03-03 2015-03-03
US15/224,198 US9959477B2 (en) 2014-03-03 2016-07-29 Mapping of blood vessels for biometric authentication

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US201514636537A Continuation-In-Part 2014-03-03 2015-03-03

Publications (2)

Publication Number Publication Date
US20160335514A1 true US20160335514A1 (en) 2016-11-17
US9959477B2 US9959477B2 (en) 2018-05-01

Family

ID=57277500

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/224,198 Expired - Fee Related US9959477B2 (en) 2014-03-03 2016-07-29 Mapping of blood vessels for biometric authentication

Country Status (1)

Country Link
US (1) US9959477B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180055369A1 (en) * 2016-08-31 2018-03-01 Qualcomm Incorporated Layered sensing including rf-acoustic imaging
CN111227832A (en) * 2020-02-13 2020-06-05 重庆邮电大学 Thermoacoustic tomography system and method for finger joint disease diagnosis
CN112782280A (en) * 2019-11-07 2021-05-11 华南师范大学 Linear polarization microwave thermoacoustic imaging method and device

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4255971A (en) * 1978-11-01 1981-03-17 Allan Rosencwaig Thermoacoustic microscopy
US5052638A (en) * 1989-03-30 1991-10-01 Minovitch Michael Andrew Electromagnetic ramjet
US6006175A (en) * 1996-02-06 1999-12-21 The Regents Of The University Of California Methods and apparatus for non-acoustic speech characterization and recognition
US6078253A (en) * 1997-02-04 2000-06-20 Mytech Corporation Occupancy sensor and method of operating same
US6182499B1 (en) * 1996-10-09 2001-02-06 Symyx Technologies Systems and methods for characterization of materials and combinatorial libraries with mechanical oscillators
US6212421B1 (en) * 1999-09-03 2001-04-03 Lockheed Martin Energy Research Corp. Method and apparatus of spectro-acoustically enhanced ultrasonic detection for diagnostics
US6216025B1 (en) * 1999-02-02 2001-04-10 Optosonics, Inc. Thermoacoustic computed tomography scanner
US20040052328A1 (en) * 2002-09-13 2004-03-18 Sabol John M. Computer assisted analysis of tomographic mammography data
US20060028962A1 (en) * 2004-08-05 2006-02-09 Oron Zachar Method and system for encoding and detecting optical information
US20070064572A1 (en) * 2005-07-27 2007-03-22 Polarizonics Corporation Optical data encoding and detection
US20080114274A1 (en) * 2004-04-29 2008-05-15 Moonen Chretien Theophilus Wil Assembly for Heat Treating Biological Tissue
US20100187224A1 (en) * 2008-06-30 2010-07-29 Hyde Roderick A Microwave processing systems and methods
US7990336B2 (en) * 2007-06-19 2011-08-02 Virgin Islands Microsystems, Inc. Microwave coupled excitation of solid state resonant arrays
US20120309636A1 (en) * 2011-01-21 2012-12-06 Ian Gibbons Systems and methods for sample use maximization
US20130184555A1 (en) * 2012-01-12 2013-07-18 Nellcor Puritan Bennett Llc Oral cavity mounted photoacoustic sensing unit
US20150020034A1 (en) * 2011-12-02 2015-01-15 James M. Okuley Techniques for notebook hinge sensors
US20150316511A1 (en) * 2014-05-02 2015-11-05 The Regents Of The University Of Michigan Real-time detection and imaging of terahertz pulse radiation by using photoacoustic conversion

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2342000A (en) 1998-09-11 2000-04-17 Loquitor Technologies Llc Generation and detection of induced current using acoustic energy
US7266407B2 (en) 2003-11-17 2007-09-04 University Of Florida Research Foundation, Inc. Multi-frequency microwave-induced thermoacoustic imaging of biological tissue
US7728902B2 (en) 2006-08-04 2010-06-01 Hitachi Maxell, Ltd. Imaging device and biometrics authentication apparatus
EP2110076A1 (en) 2008-02-19 2009-10-21 Helmholtz Zentrum München Deutsches Forschungszentrum für Gesundheit und Umwelt (GmbH) Method and device for near-field dual-wave modality imaging
WO2009104437A1 (en) 2008-02-22 2009-08-27 日本電気株式会社 Biometric authentication device, biometric authentication method and biometric authentication program
WO2010009747A1 (en) 2008-07-25 2010-01-28 Helmholtz Zentrum München Deutsches Forschungszentrum Für Gesundheit Und Umwelt (Gmbh) Quantitative multi-spectral opto-acoustic tomography (msot) of tissue biomarkers
JP4748199B2 (en) 2008-09-30 2011-08-17 ソニー株式会社 Vein imaging apparatus and vein imaging method
JP5144461B2 (en) 2008-10-17 2013-02-13 株式会社日立製作所 Finger vein authentication device and personal authentication device
JP5566456B2 (en) 2009-06-29 2014-08-06 ヘルムホルツ・ツェントルム・ミュンヒェン・ドイチェス・フォルシュンクスツェントルム・フューア・ゲズントハイト・ウント・ウムベルト(ゲーエムベーハー) Imaging apparatus and imaging method, computer program, and computer readable storage medium for thermoacoustic imaging of a subject
CN102269717B (en) 2011-04-27 2012-12-26 华南师范大学 Ultrashort pulse microwave thermoacoustic imaging method and device

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4255971A (en) * 1978-11-01 1981-03-17 Allan Rosencwaig Thermoacoustic microscopy
US5052638A (en) * 1989-03-30 1991-10-01 Minovitch Michael Andrew Electromagnetic ramjet
US6006175A (en) * 1996-02-06 1999-12-21 The Regents Of The University Of California Methods and apparatus for non-acoustic speech characterization and recognition
US6182499B1 (en) * 1996-10-09 2001-02-06 Symyx Technologies Systems and methods for characterization of materials and combinatorial libraries with mechanical oscillators
US6078253A (en) * 1997-02-04 2000-06-20 Mytech Corporation Occupancy sensor and method of operating same
US6216025B1 (en) * 1999-02-02 2001-04-10 Optosonics, Inc. Thermoacoustic computed tomography scanner
US6212421B1 (en) * 1999-09-03 2001-04-03 Lockheed Martin Energy Research Corp. Method and apparatus of spectro-acoustically enhanced ultrasonic detection for diagnostics
US20040052328A1 (en) * 2002-09-13 2004-03-18 Sabol John M. Computer assisted analysis of tomographic mammography data
US20080114274A1 (en) * 2004-04-29 2008-05-15 Moonen Chretien Theophilus Wil Assembly for Heat Treating Biological Tissue
US20060028962A1 (en) * 2004-08-05 2006-02-09 Oron Zachar Method and system for encoding and detecting optical information
US20070064572A1 (en) * 2005-07-27 2007-03-22 Polarizonics Corporation Optical data encoding and detection
US7990336B2 (en) * 2007-06-19 2011-08-02 Virgin Islands Microsystems, Inc. Microwave coupled excitation of solid state resonant arrays
US20100187224A1 (en) * 2008-06-30 2010-07-29 Hyde Roderick A Microwave processing systems and methods
US20120309636A1 (en) * 2011-01-21 2012-12-06 Ian Gibbons Systems and methods for sample use maximization
US20150020034A1 (en) * 2011-12-02 2015-01-15 James M. Okuley Techniques for notebook hinge sensors
US20130184555A1 (en) * 2012-01-12 2013-07-18 Nellcor Puritan Bennett Llc Oral cavity mounted photoacoustic sensing unit
US20150316511A1 (en) * 2014-05-02 2015-11-05 The Regents Of The University Of Michigan Real-time detection and imaging of terahertz pulse radiation by using photoacoustic conversion

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180055369A1 (en) * 2016-08-31 2018-03-01 Qualcomm Incorporated Layered sensing including rf-acoustic imaging
CN112782280A (en) * 2019-11-07 2021-05-11 华南师范大学 Linear polarization microwave thermoacoustic imaging method and device
CN111227832A (en) * 2020-02-13 2020-06-05 重庆邮电大学 Thermoacoustic tomography system and method for finger joint disease diagnosis

Also Published As

Publication number Publication date
US9959477B2 (en) 2018-05-01

Similar Documents

Publication Publication Date Title
US11596388B2 (en) Spread spectrum coded waveforms in ultrasound diagnostics
EP2758800B1 (en) Acousto-electromagnetic investigation of physical properties of an object
US9959477B2 (en) Mapping of blood vessels for biometric authentication
US8485974B2 (en) Multiple-frequency ultrasonic phased array driving system
US10863968B2 (en) Ultrasonic imaging system with angularly compounded acoustic radiation force excitation
US11304661B2 (en) Enhanced imaging devices, and image construction methods and processes employing hermetic transforms
US20150250388A1 (en) Remote sensing, imaging, or screening of embedded or concealed objects
US20120289827A1 (en) Multi-Modality Ultrasound and Radio Frequency Methodology for Imaging Tissue
US11717254B2 (en) Single piezoelectric transmitter and receiver to detect blood velocities
US20120296204A1 (en) Multi-Modality Ultrasound and Radio Frequency System for Imaging Tissue
CA2927867C (en) Investigation of physical properties of an object
KR20170090304A (en) Ultrasonic transducer and ultrasonic probe including the same
US20180092622A1 (en) Phased Array for Detecting Artery Location to Measure Blood Velocity
CN109789445B (en) System and method for detecting blood flow velocity
CN115867393A (en) Hybrid ultrasonic transducer array
JP2023505381A (en) Systems and methods for reducing interference between MRI machines and ultrasound systems
EP2692289A1 (en) Multi-modality ultrasound and radio frequency system for imaging tissue
US20200375531A1 (en) Thermoacoustic imaging methods and systems utilizing parallel phased array transmission elements
Ngo et al. An experimental analysis of a sector-vortex phased array prototype
CN109788938B (en) Micromechanical control system for a piezoelectric transducer
V’yugin et al. Experimental study of the formation of nonlinear acoustic waves in focused beams
US20150101390A1 (en) Method of calibrating ultrasound velocity

Legal Events

Date Code Title Description
AS Assignment

Owner name: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ARBABIAN, MOHAMMAD AMIN;SEYED ALIROTEH, SEYED MIAAD;NAN, HAO;REEL/FRAME:039295/0608

Effective date: 20140303

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20220501