WO2004074767A1 - Method and apparatus for spectral analysis of images - Google Patents

Method and apparatus for spectral analysis of images Download PDF

Info

Publication number
WO2004074767A1
WO2004074767A1 PCT/US1992/001171 US9201171W WO2004074767A1 WO 2004074767 A1 WO2004074767 A1 WO 2004074767A1 US 9201171 W US9201171 W US 9201171W WO 2004074767 A1 WO2004074767 A1 WO 2004074767A1
Authority
WO
WIPO (PCT)
Prior art keywords
interferometer
light
scene
pixel
scanned
Prior art date
Application number
PCT/US1992/001171
Other languages
French (fr)
Inventor
Dario Cabib
Zvi Friedman
Stephen G. Lipson
Robert A. Buckwald
Original Assignee
Dario Cabib
Zvi Friedman
Lipson Stephen G
Buckwald Robert A
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dario Cabib, Zvi Friedman, Lipson Stephen G, Buckwald Robert A filed Critical Dario Cabib
Priority to US08/575,191 priority Critical patent/US5936731A/en
Priority to US08/886,293 priority patent/US6018587A/en
Priority to US08/942,122 priority patent/US6198532B1/en
Priority to US09/752,833 priority patent/US6419361B2/en
Publication of WO2004074767A1 publication Critical patent/WO2004074767A1/en

Links

Classifications

    • CCHEMISTRY; METALLURGY
    • C12BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12QMEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
    • C12Q1/00Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
    • C12Q1/68Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving nucleic acids
    • C12Q1/6813Hybridisation assays
    • C12Q1/6816Hybridisation assays characterised by the detection means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/44Raman spectrometry; Scattering spectrometry ; Fluorescence spectrometry
    • G01J3/4406Fluorescence spectrometry
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/88Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J2003/2866Markers; Calibrating of scan

Definitions

  • the total time spent summed over all the detectors on a particular pixel is the same, nT/m2.
  • the energy seen by every detector at any time is of the order of 1 /n of the total because the wavelength resolution is 1 /n of the range
  • the energy is of the order of unity because the modulating fuction is a sinusoidal (Michelson) or similar periodic function (low finesse Airy function with Fabry-Perot) whose average over many periods is 50%. This results in an improved signal to noise ratio, of the order of n/2.
  • optical path differences between the two arms which vary linearly with the incident angle.
  • the differences are proportional to the angular deviation from the optical axis.
  • the scanner 73 scans the field of view.
  • Reflector 75 with the microscope system, move together along the optical axis to provide scanning of the OPD in synchronization with the scanner 73, as described above with respect to Fig. 5.

Abstract

A method and apparatus for analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof, by: collecting incident light from the scene (20); scanning the incident light (22); passing the scanned light through an interferometer (24) which outputs modulated light corresponding to a predetermined set of linear combinations of the spectral intensity of the light emitted from each pixel; focussing the light outputted from the interferometer on a detector array (26), and processing the output of the detector array (28) to determine the spectral intensity of each pixel thereof.

Description

METHOD AND APPARATUS FOR SPECTRAL ANALYSIS OF IMAGES
The present invention relates to a method and apparatus for spectral analysis of images, and particularly for analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof.
A spectrometer is an apparatus designed to accept light, to separate (disperse) it into its component wavelengths, and detect the spectrum. An imaging spectrometer is one which collects incident light from a scene and analyzes it to determine the spectral intensity of each pixel thereof.
The conventional image spectrometer includes a slit in the image plane for scanning the scene to be analyzed and focussing the scanned light on an array of detectors. If a two-dimensional detector array is used, one of the dimensions of the array is used to sample the different wavelengths of a single pixel; the field of view is covered by a one-dimensional scanner, and the other dimension of the array. If a one-dimensional detector array is used, the field of view is scanned mechanically in two directions, and all the detectors are used at any given time only to sample the different wavelengths of one pixel. In both cases, the slit in the image plane ensures that each detector sees only the contribution of one pixel at a single wavelength at any time; otherwise, it would be impossible to separate the spectra of each pixel .
However, the conventional slit-type imaging spectrometer suffers from the disadvantage that most of the pixels of one frame are not measured at any given time, even though the fore optics of the spectrometer actually collects incident light from all of them simultaneously. Thus, the conventional slit-type technique is wasteful of the available information since, except for one wavelength, the technique rejects most of the radiation emitted by the measured pixel at any given time and reaching a particular detector. The result is that either a relatively large frame time is required to obtain the necessary information, or the signal-to-noise ratio (sensitivity) is substantially reduced.
An object of the present invention is to provide a novel method and apparatus for spectral analysis of images which have advantages in the above respects.
More particularly, an object of the invention is to provide a method and apparatus for spectral analysis of images which better utilizes all the information available from the collected incident light of the image to substantially decrease the required frame time and/or to substantially increase the signal-to-noise ratio, as compared to the conventional "slit" type of imaging spectrometer.
According to the present invention, there is provided a method of analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof, comprising: collecting incident light from the scene; scanning the incident light along at least one dimension; passing the scanned light through an interferometer which outputs modulated light corresponding to a predetermined set of linear combinations of the spectral intensity of the light emitted from each pixel; focussing the light outputted from the interferometer on a detector array; and processing the output of the detector array to determine the spectral intensity of each pixel thereof.
The method may be practised by utilizing various types of interferometers, both of the moving type wherein the OPD (optical path difference) is varied to modulate the light by moving an element in the interferometer, and of the non-moving type wherein the OPD is varied with the angle of incidence of the incoming radiation. Thus, in the moving type of interferometer, at each instant each detector sees the same linear combination of the spectral content of the scene even though each detector looks at a different point of the scene; when the scanner completes scanning one frame, the complete frame will have been scanned at all relevant linear combinations of the spectral content. In the non-moving type interferometer, wherein the OPD varies with the angle of incidence of the incoming light, at each instant each detector sees a different point of the scene at a different linear combination of the spectral content; when the scanner completes scanning one frame, the complete frame will have been scanned at all relevant linear combinations of the spectral content.
For purposes of illustration, the invention is described below as implemented by use of the Fabry-Perot and Michelson interferometers as examples of the moving-type interferometers, and as implemented by use of the Michelson and Sagnac interferometers as examples of the non-moving type interferometers .
The invention also provides apparatus for spectral analysis of images in accordance with the above method.
The methods and apparatus in accordance with the above features differ from the conventional slit-type imaging spectrometer by utilizing an interferometer as described above, instead of a grating or a prism, without limiting the collected energy with an aperture or slit, thereby substantially increasing the total throughput of the system. Such methods and apparatus thus better utilize all the information available from the incident light of the scene to be analyzed, thereby substantially decreasing the measuring time and/or substantially increasing the signal-to-noise ratio (sensitivity) .
Consider, for example, the "whisk broom" design as described in John B. Wellman, Imaging Spectrometers for Terrestrial and Planetary Remote Sensing, SPIE Proceedings, Vol.750, p.140 (1987).
Let n be the number of detectors in the linear array, m x m the number of pixels in a frame and T the frame time.
The total time spent on each pixel in one frame summed over all the detectors of the array is: m
By using the same size array and the same frame rate in a method according to the present invention, the total time spent summed over all the detectors on a particular pixel is the same, nT/m2. However, whereas in the conventional grating or prism method the energy seen by every detector at any time is of the order of 1 /n of the total because the wavelength resolution is 1 /n of the range, in a method according to the present invention the energy is of the order of unity because the modulating fuction is a sinusoidal (Michelson) or similar periodic function (low finesse Airy function with Fabry-Perot) whose average over many periods is 50%. This results in an improved signal to noise ratio, of the order of n/2. For a mathematical treatment and definition of the Fabry-Perot interferometer and a definition of the Airy Function, see Max Born and Emil
Wolf, Principles of Optics, Pergamon Press, 1980, p.329.
In all the embodiments of the ivention described below, all the required optical phase differences are scanned simultaneously with the spatial scanning of the field of view in order to obtain all the information required to reconstrct the spectrum, so that the spectral information is collected simultaneously with the imaging information.
The invention can be used with many different optical configurations, such as a telescope for remote sensing, a microscope for laboratory analysis, fiber optics for industrial monitoring, and others. In addition, any wavelength range can be selected with appropriate filters and optics .
Further features and advantages of the invention will be apparent from the description below.
The invention is herein described, by way of example only, with reference to the accompanying drawings, wherein: Fig. 1 illustrates a conventional (prior art) slit-type imaging spectrometer;
Fig. 2 is a block diagram illustrating the main components of an imaging spectrometer constructed in accordance with the present invention;
Fig. 3 is a diagram illustrating an imaging spectrometer constructed in accordance with the present invention based on the use of a moving-type interferometer, namely a Fabry-Perot interferometer with scanned thickness;
Fig. 4 illustrates a Michelson interferometer with retroreflectors used as a non-moving type interferometer in the imaging spectrometer of Fig. 2;
Fig. 5 is a diagram illustrating another moving-type interferometer, namely a Michelson type interferometer, which may be used as the interferometer in the imaging spectrometer of Fig. 4;
Fig. 6 illustrates another non-moving type interferometer, namely a modified Sagnac interferometer, as used in an imaging spectrometer in accordance with the invention; and
Fig. 7 illustrates the invention as embodied in a modified Michelson imaging spectrometer, as an example of another non-moving type interferometer, with focussing on the mirrors through microscope objectives.
For purposes of better understanding the present invention, as illustrated in Figs. 2-7 of the drawings, reference is first made to the construction and operation of a conventional (i.e., prior art) slit-type imaging spectrometer utilizing a two-dimensional array of detectors as illustrated in Fig. 1.
Thus, the prior art slit-type imaging spectrometer as illustrated in Fig. 1 comprises a collection optical system, such as a telescope as indicated at 2, for collecting the incident light from the scene, schematically indicated at 4 and outputting substantially parallel light onto a first focal plane occupied by a slit 6 to define the field of view. The light exiting from slit 6 is collimated in a collimator lens 8 and is passed through a transmission grating 10 to separate the various wavelengths . The output from grating 10 is focussed by a focussing lens 12 onto a two-dimensional detector array 14 in a second focal plane.
The output of detector array 14 is fed to a signal processor
16.
In the two-dimensional array of detectors 14 illustrated in the prior art imaging spectrometer of Fig. 1, the movement of the system (e.g., when embodied in an aircraft) effects the scanning along one dimension. The scanning along the second dimension is effected by the slit 6 which is oriented perpendicularly to the direction of movement of the system. The slit 6 thus assures that each detector within the array 14 sees only the contribution of one pixel at a single wavelength at any time; this is necessary to separate the spectra of each pixel.
As described earlier, the disadvantage of this prior art method illustrated in Fig. 1 is that most of the pixels of one frame are not measured at any given time even though the telescope (2 or other collecting optics) actually collects energy from all of them simultaneously. As a result, the required frame time is significantly increased, and/or the signal-to-noise ratio (sensitivity) is substantially decreased.
Fig. 2 is a block diagram illustrating the main components of an imaging spectrometer constructed in accordance with the present invention.
Thus, the imaging spectrometer of Fig. 2 includes: a collection optical system, generally designated 20; a one- dimensional or two-dimensional scanner, as indicated by blocks 22; an optical path difference (OPD) generator or interferometer, as indicated by block 24; a one-dimensional or two-dimensional detector array, as indicated by block 26; and a signal processor and display, as indicated by block 28.
A critical element in the novel system is the optical path difference generator or interferometer 24, which outputs modulated light corresponding to a predetermined set of linear combinations of the spectral intensity of the light emitted from each pixel of the scene to be analyzed. The output of the interferometer is focussed onto the detector array 26. Thus, all the required optical phase differences are scanned simultaneously with the spatial scanning of the field of view in order to obtain all the information required to reconstruct the spectrum. The spectral information is thus collected simultaneously with the imaging information, thereby permitting analysis of the image in a real-time manner.
Fig. 3 illustrates one form of imaging spectrometer constructed in accordance with the present invention. This spectrometer is based on the use of a moving type interferometer in which the OPD is varied to modulate the light, namely a Fabry-Perot interferometer 33 with scanned thickness .
Thus, the imaging spectrometer illustrated in Fig. 3 comprises a source or scene, generally designated 30, to be analyzed to determine the spectral intensity of each pixel of the scene. The scene 30 may be a source of incoherent non-monochromatic radiation. It may be at a distance for remote-sensing applications, in which case the collection optical system, schematically indicated at' 31 , would be a telescope; alternatively, the scene 30 may be close for microscopic analysis, in which case the collection optical system 31 would be a microscope.
Optical system 31 provides an output to a two-dimensional mechanical scanner, e.g., a mirror scanner as indicated at 32, to scan the scene. The output from scanner 32 is fed to a Fabry-Perot interferometer 33 having an etalon made of two plane, parallel reflectors spaced at a distance "d" from each other. In this example, the spacing distance "d" is variable by using a mechanical scanner, in this case a piezo-electric scanner 34.
The output from the Fabry-Perot interferometer 33 is fed through a refocussing optical system 35 onto a two-dimensional array of detectors 36 whose outputs are fed to a signal processor 37.
Optical system 31, e.g., an afocal telescope or microscope, produces a substantially parallel beam (i.e., exactly parallel or having a very large F/No) at its output, because in this way every detector within the array 36 corresponds to a single optical phase difference through the etalon 34 of the Fabry-Perot interferometer 33. The optical system 31 can be either refractive or reflective. The etalon 33 of the interferometer is at 90° to the optical axis of the system. It will be noted that no use is made of a field-of-view limiting aperture or slit.
The imaging spectrometer illustrated in Fig. 3 operates as follows :
A detector element i of the array 35 receives radiation from a beam which traverses the etalon 33 at a fixed angle (φ.) between its line of sight and the normal to the etalon, and therefore it sees this radiation always through an optical phase difference δ., given by
Figure imgf000009_0001
where /\ is the wavelength of the radiation considered, and n is the index of refraction of the air between the plates.
The total radiation reaching detector i, at any given time from a specific pixel k of the radiation input 30 of that pixel's spectrum with the Airy function, as follows (Max Born and Emil Wolf, Principles of Optics, Pergamon Press, 1980, page 327):
Figure imgf000009_0002
where 1' ^2 = ϋro^ts of the spectral range
I (Λ) = spectral intensity of the source at pixel k
F = coefficient of finesse, is related to the reflectivity of the etalon R, by 4R
F = 2
( 1 -R ) 2 i, = that particular detector which images pixel k through an optical phase difference δ.(/\)
Following is one of many ways of scanning the field of view and the thickness of the etalon 33.
Suppose the array 36 is composed of a linear set of N detectors, whose signals can be monitored simultaneously and independently. Suppose M performs a raster type scan of m lines (larger than N) and that the plane of the paper in Fig. 3 is the vertical direction. Every time M has scanned one horizontal line, the thickness "d" of the etalon 33 is incremented by the piezo-electric scanner 37 one step in synchronization with the vertical scanner 32 starting from d=0, until N lines are scanned, and N thickness steps are made. At this moment the etalon thickness is returned to the original value, and the thickness scanned again. The process is repeated until the scanner has scanned one complete frame.
Except for a marginal region of N pixels at the top and at the bottom of the field of view, all the pixels of the field of view are measured with N optical phase differences by different detectors. All the detector signals are sampled and recorded at a high rate, such that all the needed information is collected and fed to the signal processor 37 to reconstruct both the image and the spectra of all the pixels.
Another possible configuration is one which includes a two-dimensional array of detectors: in this case the same idea applies, but one spatial scan is saved.
For example, if the array is an N x m matrix in a "push broom" approach similar to that described on Page 142 of John B. Wellman, Imaging Spectrometers for Terrestrial and Planetary Remote Sensing, SPIE Proceedings, Vol.750, p.140 (1987), the N lines and m columns correspond to the same matrix in object space. In this configuration, the Fabry-Perot thickness or optical phase difference is kept fixed for the time of integration of one line. Then the scanner performs a step vertically, and the Fabry-Perot thickness d is stepped in synchronization by one step, starting from zero, until N steps are performed. At this point the scanner continues scanning vertically, the thickness starts from zero again, and the steps are repeated until the complete field of view is scanned.
In this way all the pixels are measured through all the optical phase differences, and the recorded information is processed to yield the spectra of every pixel .
It should be noted that the readout architecture of the array must be the same as that of Page 142 of the above-cited John B. Wellman publication for "push broom" : the charge pattern of N lines of the scene from one Fabry-Perot thickness is integrated in the array simultaneously during the time of one line of a video frame. This charge pattern is read out while integrating the next Fabry-Perot thickness.
The reconstruction of the spectrum of every pixel may be done by suitable mathematical processing, as follows :
We divide the spectral range of interest . to ?, into N intervals. If we approximate the integral of
Eq. (2) as a sum over N wavelength intervals, Eq. (2) is the product of an N x N dimensional matrix given by:
1
A.. = --.. (3)
13 1 + F sin^±i
and an N dimensional vector I,k( j. ) ,' where j J scans the N wavelength intervals, and k is a specific pixel in the field of view. If we invert the matrix A.. and multiply it by the vector I., (i,=1,...to n), we obtain the vector I, ( / . ) which is the spectrum of pixel k. With respect to spectral resolution, consider two quasi monochromatic sources placed at the same pixel.
Preferably, the finesse F of the Fabry-Perot interferometer 33 is in the region around F=10, because (from Fig. 7.58 of the above-cited Born and Wolf publication) we see that in this case there is enough modulation in the Airy function, and that at the same time it does not yield very narrow lines; in fact this configuration does not correspond to a very high wavelength resolution but it is necessary in order not to lose a significant amount of radiation between the narrow peaks of the Airy function. This is a desirable situation, since in any case, because of the imaging, a high resolution may yield too much information to handle.
The treatment of the resolution on Page 334 of the
Born and Wolf publication still holds, because if we set ε ε 1 1 sin - = = " 0.3 (4)
4 4 VF 0.3
we see that we make an error of about 10% in approximating sin ε/4 with ε/4.
So we have in this case
J = - ^F = 5 (5)
and the resolving power is - 2 d (6) Δλ Λ
In order to get an idea of the order of magnitude, and check consistency, let us assume
N = 50 detectors in the array (7)
Δλ = 3μ
— = 0.06μ and (8)
50
= 2 to 5μ. (9)
Therefore d is the range
Figure imgf000013_0001
Taking n=1 for air, (10) gives
10 d = = 16μ . (11)
0.06*10
The range of d is such that it scans the same range of optical phase differences as the wavelength range; therefore d - d1 = d - d
— — — — (12)
Figure imgf000013_0002
Therefore the thickness steps are of the order of
— = 0.1μ (14)
50
In the 8 to 14μ spectral range we have
Δλ = — = 0.12μ , (15)
50
112 d = = 100μ (16)
0.12*10 and
d2-d1 = 100 /ll 8 J = 43μ (17)
Therefore, the steps of thickness are of the order of 1μ.
In the visible range 0.4 to 0.8μ, Δλ =0.008μ, and therefore
0.62 d = = 4.5μ . (18)
0.008*10
From (18) 2-d1 = 4 . 5 M — ) = 2 . 25μ ( 1 9 )
and therefore the steps in d are
2
- = 0.04μ . (20)
50
In summary, the significant features in the system illustrated in Fig. 3 include: i) the special matching of the interferometer thickness range and finesse, with the detector array size and number of detectors and the spectral resolution; and ii) the synchronization between the thickness scanning and the spatial scanning, to obtain the spectral and the spatial information simultaneously in the time one frame is built.
It will be seen when using the moving type interferometer as illustrated in Fig. 3, a beam entering the interferometer at a small angle (φ=0) to the optical axis
2 undergoes an optical path difference which varies as φ or higher power of φ. All the spectral information in all the pixels may be collected by scanning the optical path difference in synchronization with it. At the end of one frame, every pixel has been measured through all the optical path differences by different detectors. By careful bookkeeping and by applying the appropriate matrix inversion
(like Fourier transformation), the spectrum of every pixel may be calculated. The bookkeeping is needed because different detectors gather the information of different OPDs of one pixel at different times. Thus, in the time of 30 msec (the usual frame time of a standard video), a spectrum may be measured for every pixel of a standard video frame.
This is of the order of 100 resolution points per pixel, with a typical matrix of 500x500 pixels per frame.
The Construction of Fig. 4
Instead of using a moving-type interferometer wherein the OPD (optical path difference) varies by moving an element in the interferometer (namely changing the spacing d between the plate mirrors in the Fabry-Perot interferometer illustrated in Fig. 3), the invention may also be implemented by using a non-moving type interferometer, in which case the OPD varies with the angle of incidence of the incoming radiation. Fig. 4 illustrates the invention implemented by using the latter type interferometer, namely by using a Michelson type interferometer.
Thus, the interferometer illustrated in Fig. 4 includes a beam splitter 40 receiving the beam from the optical collection system and scanner (31 and 32, respectively, Fig. 3), and splitting the beam into two paths. One path includes a compensator 41 and a retroreflector 42; and the second path includes a compensator 43 and a retroreflector 44. The two compensators 41 , 43 are identical blocks of the same material and of the same thickness, and are positioned antisymmetrically in the two arms so that only beams that are parallel to the optical axis are compensated. The two retroreflectors 42, 44 are positioned at equal distances f om the beam splitter 40. The beam splitter 40 has a half reflecting coating only on a portion of its surface on each side so that the translation of the beam through the corner cube is exploited to obtain a completely compensated system for rays parallel to the optical axis.
Thus, in the Michelson type interferometer as illustrated in Fig. 4, the beam that is parallel to the optical axis of the system is compensated between the two arms of the interferometer, whereas the beams in directions that are off the optical axis of the system undergo OPDs
(optical path differences) between the two arms which vary linearly with the incident angle. The differences are proportional to the angular deviation from the optical axis.
Therefore, when the collimated beams at the exit of the interferometer are focussed on a detector array, such as array 36 in Fig. 3, each element of the array will receive light that underwent different OPDs between the two arms. Thus, with compensator 41 parallel to the beam splitter 40, and compensator 42 perpendicular to it, the optical path difference between the two arms can be shown to satisfy, for small φ's, the following relation:
Figure imgf000016_0001
with φ = angle between the beamsplitter 40 and the optical axis. For simplicity φ can be taken as 45°, but this is not necessary, n is the index of refraction of the two compensators 41, 43; d is the compensator thickness; and φ is the angular deviation from the optical axis.
For example, if the required change in OPD between two adjacent detectors is ?*1μ, and the change in directions between the fields of view_of two neighboring detectors is ~ 1 mrad, d turns out to be of the order of 1 mm. In fact
Figure imgf000016_0002
Note that if compensator 41 is removed and beamsplitter 40 is half reflecting on the whole surface on the side of the incoming beam, then we obtain another viable configuration with a compensated optical axis.
With respect to the spectral resolution of the Fig. 4 configuration, assume that the spectral range is limited to
by using a suitable filter.
Because of the Nyquist theorem, at least two samples must be measured. Since one period is an OPD change of one wavelength, the minimum difference in OPD seen by two adjacent detector elements must be
>1 Since the period increases with Aii it is obvious that this corresponds to more than two samples per period for all the other wavelengths.
Assume now that the incident radiation consists of two lines at wave numbers v and v+Δv with an intensity of
I o. The resultant intensity for an OPD of x is:
I ( x) =0 . 5I ( 1 +2cos2πvx) +0 .5 I ( 1 +2cos2τt (v+ Δv) ) x) ( 23 ) If we subtract the constant term, we obtain I ( x)
Figure imgf000017_0001
Similar to the Rayleigh criterion, we define the two line "resolved" if the ratio
I(x)
Figure imgf000017_0002
is lower than a predetermined amount, say 0.9. This gives a ccoonnddiittiioonn ffoorr tthhee mmaaxxiimm-um value of x, xma„x, needed to get the defined resolution.
T Thhee value of xmax that satisfies the above condition is: cosπΔvxmax < 0.9 (25) or
0.143
Figure imgf000017_0003
Now let Nα, be the total number of the detectors in the array. Then:
x > N * — ( 27 ) max d 2
and
Figure imgf000017_0004
or Δ v _ 0 . 286
( 29 )
Λι ' a
1 or v, = — λ 2
Δ A 0.286
— i—Λ V - = . λ 2
V2 Nd Λ
As a numerical example: if Λ -1 = 2μm, Λo = ^μm and N, = 100
= 0.7%
V2
In summary, the uniqueness of the system illustrated in Fig. 4 is represented by: i) the OPD is a linear function of the angle of incidence of the incoming radiation on the interferometer, so that different detectors of the array see it at different OPDs. This fact, combined with the spatial scanning and proper bookkeeping, allows the spectrum to be built by inverse transformation simultaneously with the picture, similarly to the Fabry-Perot case described above. The Construction of Fig. 5
Fig. 5 illustrates an imaging spectrometer including a Michelson interferometer but of the moving type, similar to that of Fig. 3, namely wherein the OPD varies with moving an element of the interferometer. In the spectrometer of Fig. 5, the light from source 50 is collected by the optical collection system 51 and is collimated onto a scanning mirror 52 before being passed through the beam splitter 53 which splits the beam into the two arms. One arm includes a comparator 54 and a mirror 55, and the second arm includes merely a mirror 56. The light from the two mirrors are passed via beam splitter 53 and a focussing lens 57 onto an array of detectors 58. In the spectrometer illustrated in Fig. 5, the scanning mirror is controlled by a synchronization circuit
59. This circuit also controls, via a scanner 59a, the distance between mirror 56 and beam splitter 53 with respect to mirror 55 and beam splitter 53, to thereby vary the OPD of the two arms. The compensator 54 ensures that the central beam has an OPD equal to zero, so that the OPD, as seen by the different detectors of the array 58, is varied with the variation in the movement of mirror 56.
The Construction of Fig. 6
Fig. 6 illustrates an imaging spectrometer constructed in accordance with the invention but utilizing another type interferometer, namely a modified Sagnac, of the non-moving type in that the OPD varies with the angle of incidence of the incoming radiation. As described above with respect to the imaging spectrometer illustrated in Fig. 4, a beam entering the interferometer at a small angle to the optical axis undergoes an OPD which varies linearly with this angle.
The modified Sagnac interferometer illustrated in the spectrometer of Fig. 6 is that described in E. Hecht, Optics, Addison-Wesley Publishing Company, p.359 (1987). In this interferometer, all the spectral information from source 60 in all the pixels, after being collimated by the optical collection system 61 , is scanned by a mechanical scanner 62. The light is then passed through a beam splitter 63 to a first reflector 64 and then to a second reflector 65, which reflects the light back through the beam splitter 63 and then through a focussing lens 66 to an array of detectors 67. This beam interferes with the one which is not reflected by 63, then by 65, and finally by reflector 64. With a one-dimensional array, a two-dimensional scan is required; and with a two-dimensional array, only a one- dimensional scan is required.
At the end of one scan, every pixel has been measured through all the OPDs by different detectors at different times. Thus, a beam parallel to the optical axis is compensated, and a beam at an angle (φ) to the optical axis undergoes an OPD which is a function of the thickness of the beam splitter 63, its index of refraction, and the angle φ. The OPD is proportional to φ for small angles. By applying the appropriate inversion, and by careful bookkeeping, the spectrum of every pixel is calculated.
It will thus be seen that in this type of imaging spectrometer: i) the interferometer is in the region of the collimated beam, so the resolution is only limited by the number of detectors and not by the divergence of the radiation; ii) the beam splitter thickness and index of refraction are matched to the required resolution. The Construction of Fig. 7
Fig. 7 illustrates a further imaging spectrometer including a Michelson interferometer of the moving type, similar to that illustrated in Fig. 5, but used for focussing on the reflectors through microscope objectives. Thus, the spectrometer illustrated in Fig. 7 includes a light source 71 and a microscope optical system 72 including a condenser lens 72a, for focussing on the object 72b. Optical system 72 further includes a collimator lens 72c for directing the light through a scanner 73, through a beam splitter 74 to the two reflectors 75, 76, and then through a focussing lens 77 onto a detector array 78. The detector array 78 in the Fig. 7 configuration, as well as in the previously-described configurations, may be a CCD (charge coupled device) .
The scanner 73 scans the field of view. Reflector 75, with the microscope system, move together along the optical axis to provide scanning of the OPD in synchronization with the scanner 73, as described above with respect to Fig. 5.
It will thus be seen that imaging spectrometers constructed in accordance with the present invention do not merely measure the intensity of light coming from every pixel in the field of view, but also measure the spectrum of each pixel in a predefined wavelength range. They thus better utilize all the radiation emitted by each pixel in the field of view at any given time, and therefore permit a significant decrease in the frame time and/or a significant increase in the sensitivity of the spectrometer. Such imaging spectrometers may include other types of interferometers and optical collection and focussing systems, and may be used in a wide variety of applications, including medical diagnostic applications, remote sensing for geological and agricultural investigations, and the like.

Claims

WHAT IS CLAIMED IS:
1. A method of analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof, comprising: collecting incident light from the scene; scanning the incident light along at least one dimension; passing the scanned light through an interferometer which outputs modulated light corresponding to a predetermined set of linear combinations of the spectral intensity of the light emitted from each pixel; focussing the light outputted from said interferometer on a detector array; and processing the output of the detector array to determine the spectral intensity of each pixel thereof.
2. The method according to Claim 1 , wherein the scanned light is passed through a moving type interferometer in which the optical path difference is varied to modulate the light by moving an element of the interferometer, such that at each instant each detector sees the same linear combination of the spectral content of the light emitted from each pixel even though each detector looks at a different point of the scene, and that when the scanner completes scanning one frame, the complete frame will have been scanned at all relevant linear combinations of the spectral content.
3. The method according to Claim 2, wherein said "interferometer is of the Fabry-Perot type.
4. The method according to Claim 2, wherein said interferometer is of the Michelson type.
5. The method according to Claim 1 , wherein the scanned light is passed through a non-moving type interferometer in which the optical path difference varies with the angle of incidence of the incoming light to modulate the light, such that at each instant each detector sees a different point of the scene and a different linear combination of the spectral content of the different points of the scene, and that when the scanner completes scanning one frame, the complete frame will have been scanned at all relevant linear combinations of the spectral content of the scene.
6. The method according to Claim 5 , wherein said interferometer is of the Michelson type.
7. The method according to Claim 5, wherein said interferometer is of the Sagnac type.
8. The method according to any one of Claims 1-7, wherein the incident light collected from the scene is scanned along two dimensions.
9. Apparatus for analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof, comprising: means for collecting incident light from the scene; means for scanning the incident light along at least one dimension; an interferometer; means for passing the scanned light through said interferometer such that it outputs modulated light corresponding to a predetermined set of linear combinations of the spectral intensity of the light emitted from each pixel; a detector array; means for focussing the light outputted from said interferometer on said detector array; and means for processing the output of the detector array to determine the spectral intensity of each pixel thereof.
10. Apparatus according to Claim 9 , wherein the scanned light is passed through a moving type interferometer in which the optical path difference is varied to modulate the light by moving an element of the interferometer, such that at each instant each detector sees the same linear combination of the spectral content of the light emitted from each pixel even though each detector looks at a different point of the scene, and that when the scanner completes scanning one frame, the complete frame will have been scanned at all relevant linear combinations of the spectral content.
11. The apparatus according to Claim 10 , wherein the interferometer is of the Fabry-Perot type.
12. The apparatus according to Claim 10, wherein said interferometer is of the Michelson type.
13. The apparatus according to Claim 9, wherein the scanned light is passed through a non-moving type interferometer in which the optical path difference varies with the angle of incidence of the incoming light to modulate the light, such that at each instant each detector sees a different point of the scene and a different linear combination of the spectral content of the different points of the scene, and that when the scanner completes scanning one frame, the complete frame will have been scanned at all relevant linear combinations of the spectral content of the scene.
14. The apparatus according to Claim 13, wherein said interferometer is of the Michelson type.
15. The apparatus according to Claim 13, wherein said interferometer is of the Sagnac type.
16. The apparatus according to any one of Claims 9-15, wherein the incident light collected from the scene is scanned along two dimensions .
17. A method of analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof, substantially as described with reference to and as illustrated in the accompanying drawings.
18. Apparatus for analyzing an optical image of a scene to determine the spectral intensity of each pixel thereof, substantially as described with reference to and as illustrated in the accompanying drawings.
PCT/US1992/001171 1991-02-21 1992-02-19 Method and apparatus for spectral analysis of images WO2004074767A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US08/575,191 US5936731A (en) 1991-02-22 1995-12-20 Method for simultaneous detection of multiple fluorophores for in situ hybridization and chromosome painting
US08/886,293 US6018587A (en) 1991-02-21 1997-07-01 Method for remote sensing analysis be decorrelation statistical analysis and hardware therefor
US08/942,122 US6198532B1 (en) 1991-02-22 1997-10-01 Spectral bio-imaging of the eye
US09/752,833 US6419361B2 (en) 1991-02-22 2001-01-03 Spectral bio-imaging of the eye

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IL9732891A IL97328A (en) 1991-02-22 1991-02-22 Method and apparatus for spectral analysis of images
IL97328 1991-02-22

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US08/392,019 Continuation-In-Part US5539517A (en) 1991-02-21 1995-02-21 Method for simultaneously measuring the spectral intensity as a function of wavelength of all the pixels of a two dimensional scene

Publications (1)

Publication Number Publication Date
WO2004074767A1 true WO2004074767A1 (en) 2004-09-02

Family

ID=11062134

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1992/001171 WO2004074767A1 (en) 1991-02-21 1992-02-19 Method and apparatus for spectral analysis of images

Country Status (2)

Country Link
IL (1) IL97328A (en)
WO (1) WO2004074767A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9418414B2 (en) 2012-05-30 2016-08-16 Panasonic Intellectual Property Management Co., Ltd. Image measurement apparatus, image measurement method and image measurement system
US9430846B2 (en) 2013-04-19 2016-08-30 Ge Aviation Systems Llc Method of tracking objects using hyperspectral imagery
WO2022126198A1 (en) * 2020-12-18 2022-06-23 Rapid Phenotyping Pty Limited Method of processing interferometry signal, and associated interferometer
CN116774222A (en) * 2023-08-23 2023-09-19 中国电子科技集团公司第十四研究所 Multi-mode mosaic imaging method combining machine and electricity

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3684379A (en) * 1968-10-09 1972-08-15 Nationale D Etudes De Rech Aer Interferometric device
US4523846A (en) * 1982-09-10 1985-06-18 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Integrated optics in an electrically scanned imaging Fourier transform spectrometer
US4976542A (en) * 1988-07-25 1990-12-11 Washington University Digital array scanned interferometer
US5059027A (en) * 1989-04-11 1991-10-22 Wisconsin Alumni Research Foundation Spatial heterodyne spectrometer and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3684379A (en) * 1968-10-09 1972-08-15 Nationale D Etudes De Rech Aer Interferometric device
US4523846A (en) * 1982-09-10 1985-06-18 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Integrated optics in an electrically scanned imaging Fourier transform spectrometer
US4976542A (en) * 1988-07-25 1990-12-11 Washington University Digital array scanned interferometer
US5059027A (en) * 1989-04-11 1991-10-22 Wisconsin Alumni Research Foundation Spatial heterodyne spectrometer and method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9418414B2 (en) 2012-05-30 2016-08-16 Panasonic Intellectual Property Management Co., Ltd. Image measurement apparatus, image measurement method and image measurement system
US9430846B2 (en) 2013-04-19 2016-08-30 Ge Aviation Systems Llc Method of tracking objects using hyperspectral imagery
WO2022126198A1 (en) * 2020-12-18 2022-06-23 Rapid Phenotyping Pty Limited Method of processing interferometry signal, and associated interferometer
CN116774222A (en) * 2023-08-23 2023-09-19 中国电子科技集团公司第十四研究所 Multi-mode mosaic imaging method combining machine and electricity
CN116774222B (en) * 2023-08-23 2023-11-14 中国电子科技集团公司第十四研究所 Multi-mode mosaic imaging method combining machine and electricity

Also Published As

Publication number Publication date
IL97328A0 (en) 1992-05-25
IL97328A (en) 1996-07-23

Similar Documents

Publication Publication Date Title
US5835214A (en) Method and apparatus for spectral analysis of images
US5539517A (en) Method for simultaneously measuring the spectral intensity as a function of wavelength of all the pixels of a two dimensional scene
US11415460B2 (en) Fabry-Perot Fourier transform spectrometer
US5777736A (en) High etendue imaging fourier transform spectrometer
EP2526392B1 (en) Compact interferometer spectrometer
US5781293A (en) Fourier transform spectrometer utilizing a birefringent optical component
US5059027A (en) Spatial heterodyne spectrometer and method
AU2023204214A1 (en) Fabry-Perot Fourier transform spectrometer
EP1518095A1 (en) Imaging apparatus
EP0957345B1 (en) Methods and apparati for spectral imaging using interferometers of the Fabry-Perot type
US7167249B1 (en) High efficiency spectral imager
US7023546B1 (en) Real-time imaging spectropolarimeter based on an optical modulator
Barducci et al. ALISEO: a new stationary imaging interferometer
WO2004074767A1 (en) Method and apparatus for spectral analysis of images
Barducci et al. Simulation of the performance of a stationary imaging interferometer for high-resolution monitoring of the Earth
JP3294918B2 (en) Method and apparatus for spectral analysis of images
Barducci et al. Performance assessment of a stationary imaging interferometer for high-resolution remote sensing
US11733094B2 (en) Compact computational spectrometer using solid wedged low finesse etalon
Marcoionni Early results from an imaging interferometer prototype operating in the sagnac configuration
Fletcher-Holmes et al. Birefringent Fourier-transform imaging spectrometer
Rafert et al. A spatially modulated imaging fourier transform spectrometer (SMIFTS) for astronomical and booster plume observations
JP2001147158A (en) Spectral image capturing device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): SE US