EP1334338A4 - Imaging and analyzing parameters of small moving objects such as cells - Google Patents

Imaging and analyzing parameters of small moving objects such as cells

Info

Publication number
EP1334338A4
EP1334338A4 EP01274071A EP01274071A EP1334338A4 EP 1334338 A4 EP1334338 A4 EP 1334338A4 EP 01274071 A EP01274071 A EP 01274071A EP 01274071 A EP01274071 A EP 01274071A EP 1334338 A4 EP1334338 A4 EP 1334338A4
Authority
EP
European Patent Office
Prior art keywords
light
imaging system
image
detector
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP01274071A
Other languages
German (de)
French (fr)
Other versions
EP1334338A2 (en
Inventor
William Ortyn
David Basiji
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amnis LLC
Original Assignee
Amnis LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/820,434 external-priority patent/US6473176B2/en
Application filed by Amnis LLC filed Critical Amnis LLC
Publication of EP1334338A2 publication Critical patent/EP1334338A2/en
Publication of EP1334338A4 publication Critical patent/EP1334338A4/en
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/14Beam splitting or combining systems operating by reflection only
    • G02B27/148Beam splitting or combining systems operating by reflection only including stacked surfaces having at least one double-pass partially reflecting surface
    • CCHEMISTRY; METALLURGY
    • C07ORGANIC CHEMISTRY
    • C07KPEPTIDES
    • C07K1/00General methods for the preparation of peptides, i.e. processes for the organic chemical preparation of peptides or proteins of any length
    • C07K1/04General methods for the preparation of peptides, i.e. processes for the organic chemical preparation of peptides or proteins of any length on carriers
    • C07K1/047Simultaneous synthesis of different peptide species; Peptide libraries
    • CCHEMISTRY; METALLURGY
    • C12BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12QMEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
    • C12Q1/00Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
    • C12Q1/68Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving nucleic acids
    • C12Q1/6813Hybridisation assays
    • C12Q1/6816Hybridisation assays characterised by the detection means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0205Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G01J3/0208Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0205Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G01J3/021Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using plane or convex mirrors, parallel phase plates, or particular reflectors
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/2803Investigating the spectrum using photoelectric array detector
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/30Measuring the intensity of spectral lines directly on the spectrum itself
    • G01J3/36Investigating two or more bands of a spectrum by separate detectors
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/44Raman spectrometry; Scattering spectrometry ; Fluorescence spectrometry
    • G01J3/4406Fluorescence spectrometry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1468Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle
    • G01N15/147Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle the analysis being performed on a sample stream
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0012Optical design, e.g. procedures, algorithms, optimisation routines
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/1006Beam splitting or combining systems for splitting or combining different wavelengths
    • G02B27/1013Beam splitting or combining systems for splitting or combining different wavelengths for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/12Beam splitting or combining systems operating by refraction only
    • G02B27/126The splitting element being a prism or prismatic array, including systems based on total internal reflection
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/14Beam splitting or combining systems operating by reflection only
    • G02B27/144Beam splitting or combining systems operating by reflection only using partially transparent surfaces without spectral selectivity
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/14Beam splitting or combining systems operating by reflection only
    • G02B27/145Beam splitting or combining systems operating by reflection only having sequential partially reflecting surfaces
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B01PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
    • B01JCHEMICAL OR PHYSICAL PROCESSES, e.g. CATALYSIS OR COLLOID CHEMISTRY; THEIR RELEVANT APPARATUS
    • B01J2219/00Chemical, physical or physico-chemical processes in general; Their relevant apparatus
    • B01J2219/00274Sequential or parallel reactions; Apparatus and devices for combinatorial chemistry or for making arrays; Chemical library technology
    • CCHEMISTRY; METALLURGY
    • C07ORGANIC CHEMISTRY
    • C07BGENERAL METHODS OF ORGANIC CHEMISTRY; APPARATUS THEREFOR
    • C07B2200/00Indexing scheme relating to specific properties of organic compounds
    • C07B2200/11Compounds covalently bound to a solid support
    • G01N15/1433
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1434Electro-optical investigation, e.g. flow cytometers using an analyser being characterised by its optical arrangement
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/02Investigating particle size or size distribution
    • G01N2015/0294Particle shape
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1434Electro-optical investigation, e.g. flow cytometers using an analyser being characterised by its optical arrangement
    • G01N2015/144Imaging characterised by its optical setup
    • G01N2015/1443Auxiliary imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1468Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle
    • G01N2015/1472Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle with colour
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N2015/1477Multiparameters
    • G01N2015/1479Using diffuse illumination or excitation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • G01N21/03Cuvette constructions
    • G01N21/05Flow-through cuvettes
    • G01N2021/058Flat flow cell

Definitions

  • This invention generally relates to imaging moving objects or particles for purposes of analysis and detection, and more specifically, to a system and method for determining and analyzing the morphology of moving objects, such as cells, and for detecting the presence and composition of Fluorescence In-Situ Hybridization (FISH) probes within cells.
  • FISH Fluorescence In-Situ Hybridization
  • the target cells are fetal cells that cross the placental barrier into the mother's bloodstream.
  • the target cells are sloughed into the bloodstream from nascent cancerous tumors.
  • the target cells may be present in the blood at concentrations of one to five cells per billion. This concentration yields approximately 20-100 target cells in a typical 20 ml blood sample.
  • any detection and analysis system employed in these applications be capable of processing an enriched sample of approximately 100 million cells within a few hours, corresponding to a minimum throughput of 10,000 cells per second.
  • Cell processing includes the determination of cellular morphology parameters such as overall size, nuclear size, nuclear shape, and optical density, the detection and characterization of numerous fluorescent markers and FISH probes, the quantification of the total amount of DNA in the nucleus, and the detection of other cellular components such as fetal hemoglobin.
  • the system must be able to collect cell images with a spatial resolution of approximately 1 micron.
  • the system must have high spectral resolution and bandwidth to differentiate four or more fluorescent colors. Since some probes may label important cellular features with only a few thousand fluorescent molecules, the system must have high sensitivity and good measurement consistency to differentiate very weak signals.
  • the predominant research laboratory protocols for non-invasive prenatal diagnosis employ a complex series of process steps that include gradient centrifugation to remove unnucleated cells, high speed cell sorting for fetal cell enrichment, and fluorescence microscopy for fetal cell identification and genetic analysis. These protocols often yield little or no fetal cells for analysis, because a fraction of the fetal cells are lost at each step of the protocol. Nevertheless, the protocols cannot be simplified because of limitations in existing analysis technology. Ideally, fetal cell identification and analysis would be performed in a few hours by a high speed cell sorter having the necessary speed and sample handling capacity.
  • a paper published by Ong et al. [Anal. Quant. Cytol. Histol., 9(5):375-82] describes the use of a time delay and integration (TDI) detector in an imaging flow cytometer.
  • TDI detector is any pixilated device in which the signal produced in response to radiation directed at the device can be caused to move in a controlled fashion.
  • the pixels of a TDI detector are arranged in rows and columns, and the signal is moved from row to row in synchrony with a moving image projected onto the device, allowing an extended integration time without blurring.
  • the approach disclosed by Ong et al. advanced the art by addressing the need for spatial resolution and high sensitivity for cells in flow. However, this approach does not address the remaining principal characteristics.
  • U.S. Patent No. 5,644,388 discloses an alternative approach to an imaging flow cytometer.
  • the patent discloses the use of a frame-based image collection approach in which a video camera views cells in flow, in a freeze frame fashion.
  • This method requires the image collection system to be synchronized with the presence of cells in the imaging area, unlike the case of TDI, wherein the detector readout rate is synchronized with the velocity of the cells.
  • the integration period must be very short to prevent blurring.
  • a short integration time is achieved either with a strobed light source, or a continuous light source combined with a shuttered detector.
  • the image represents the spatial distribution of light in object space.
  • the spatial distribution is blurred as the light propagates past the image plane, through the spectral dispersing element and onto the image intensifier. Because there is no provision for re-imaging the intermediate aperture at the intensifier, the resulting signal distribution at the intensifier represents only the spectral distribution of the light and does not preserve the spatial distribution of the light from the object.
  • the loss of spatial information limits the utility of the invention for applications such as fetal cell analysis. If multiple identical FISH spots are present in a cell, their spectra can be ascertained using this approach, but the number of spots cannot be determined. In addition, this approach disperses the wavelength spectrum parallel to the axis of flow.
  • the patent discloses that a very short illumination height in the flow axis is used.
  • the short illumination height decreases integration time, which necessitates the use of the image intensifier. Further, the short illumination height limits throughput by preventing the simultaneous imaging of multiple cells in the flow axis.
  • the present invention is directed to an imaging system that is adapted to determine one or more characteristics of an object from an image of the object. There is relative movement between the object and the imaging system, and although it is contemplated that either (or both) may be in motion, the object will preferably move while the imaging system will be fixed.
  • the present invention is preferably intended to be used with a plurality of objects and is particularly useful in connection with imaging a stream of objects.
  • the present invention provides a method and apparatus utilizing multiple detectors to determine at least one characteristic of an object moving through a field a view, relative to the detectors.
  • the detectors are stationary, although it should be understood that a critical aspect is that there be relative motion between the object and the detectors, thus the present invention anticipates embodiments in which the object is stationary and the detectors are in motion.
  • the data provided by the present invention include simultaneous spatial and spectral images covering a large bandwidth at high resolution, and further that the present invention preserves the spatial origin of the spectral information gathered from the object.
  • the use of multiple detectors ensures no distortion or convolution of the image occurs due to the emission bandwidth, and as a result, a deconvolution is not needed to correct the image.
  • Sufficient detectors are employed to provide separate detectors for each spectrally decomposed image.
  • a first series of embodiments are directed toward systems that include an imaging lens associated with each individual detector, and a second series of embodiments are directed towards systems that include a single imaging lens for the system.
  • the system includes a collection lens disposed so that light traveling from the object is collimated by passing through the collection lens and travels along a collection path. At least one lens is disposed to receive light that has passed through the collection lens, and to generate an image.
  • the disposition of such image lens, or lenses is a function of whether one image lens is employed for the system, or whether a separate lens is associated with each detector noted above. The relative dispositions will be discussed more in detail below.
  • a plurality of light reflecting elements receive light that has passed through the collection lens, and reflecting having a predefined characteristic, while enabling light that does not have the predefined characteristic to pass.
  • the light passing through the collection lens is in a plane substantially orthogonal to a direction of relative movement between the object and the imaging system.
  • the object or the imaging system or both can be in motion relative to the other and for the sake of simplicity, this relative movement is hereinafter referred to simply as "the movement.”
  • Each light reflecting element reflects light in a different direction, and for each light reflecting element there is a detector disposed to receive reflected light. Each detector is capable of producing a signal indicative of at least one characteristic of the object.
  • each detector is a TDI detector, disposed to receive the image produced by the at least one imaging lens. As the movement occurs, the image of the object produced by the imaging lens moves from row to row across the TDI detector.
  • Each TDI detector produces an output signal that is indicative of at least one characteristic of the object, by integrating light from at least a portion of the object over time.
  • the collection lens in this embodiment, all light emitted from a first point in the object travels in parallel rays. Light emitted from a second point in the object will also travel in parallel rays, but at a different angle relative to light from the first point.
  • spatial information in the object is transformed by the collection lens into angular information in the collection path.
  • the plurality of different reflecting elements each reflect different characteristics of light, thereby acting on the collimated light such that different spectral components leave the plurality of different reflecting elements in different directions, preferably in a plane substantially orthogonal to the direction of the movement between the object and the imaging system. In this manner, both spatial and spectral information in the object are transformed into angular information.
  • the at least one imaging lens acts on the collimated light to transform different light angles into different positions on each detector. Spatial information is preserved by the system since light from the different positions in the object is projected to different positions on the detector, for both axes. In addition, preferably light of different spectral composition that originates from the object is projected onto different detectors, in an axis substantially orthogonal to the movement. In this manner, the spatial information from the object is preserved, while spectral information covering a large bandwidth is simultaneously collected at high resolution.
  • the use of a single detector for each different spectral component means that each detector can be focused independently for each color, thereby simplifying the optical design by eliminating the constraint of longitudinal color correction required for single detector systems.
  • a still further advantage is that the quantum efficiency of each detector can be individually optimized for its particular color band, thereby increasing the overall sensitivity of the system.
  • each light reflecting element is a dichroic filter, or dichroic mirror, which are arranged to reflect light within predefined bandwidths at predefined angles.
  • dichroic filter or dichroic mirror, which are arranged to reflect light within predefined bandwidths at predefined angles.
  • all light within a predefined bandwidth incident on the dichroic element at a common angle leaves a given dichroic element at the same angle. Therefore, there is no convolution between the emission spectrum of the light leaving the object and the image of that object.
  • light of a first spectral bandwidth reflects off the first dichroic element at a predefined nominal angle.
  • Light of a second spectral bandwidth is passed through the first dichroic element to the next dichroic element and is reflected therefrom at a different predefined nominal angle.
  • Light of a third spectral bandwidth is passed through the first and second dichroic elements to a third dichroic element and reflected therefrom at a third predefined nominal angle.
  • the dichroic elements are selected to cover the desired light spectrum with the appropriate spectral passbands.
  • the angle of each dichroic element is set such that light reflected from it within the corresponding spectral bandwidth for the dichroic element is focused onto a different detector.
  • a single image lens is disposed in the collection path.
  • the positions of the detectors are manipulated such that the distance from each detector to the single image lens is substantially equivalent.
  • Each reflective element is disposed in between the image lens and the corresponding detector.
  • each dichroic reflecting element is a cube substrate.
  • each dichroic reflecting is a pellical, while in other embodiments each dichroic reflecting element is a plate substrate. Note that for most embodiments, light from the object passes through each light reflecting element only once. Particularly in embodiments employing a single lens, optical distortions are increased after light passes through each dichroic reflecting element.
  • such distortions are reduced by employing cube substrates wherein a numerical aperture associated with each cube substrate is sufficiently small so as to substantially eliminate coma and astigmatism.
  • a correction plate is disposed between each successive light reflecting element, each correction plate being oriented relative to an immediately preceding light reflective element such that any astigmatism imparted by the immediately preceding light reflective element is substantially eliminated.
  • the orientation of the correction plate is substantially orthogonal relative to an axis about which the immediately preceding light reflective element is rotated to direct reflected light toward one of the plurality of detectors.
  • the predefined characteristic which the reflecting elements employ to reflect or pass light is color
  • each individual TDI detector is separately focused for a specific color of light, so that each individual TDI detector is properly focused for a specific color of light directed toward that TDI detector by a corresponding reflecting element.
  • each individual TDI detector is independently optimized for the specific color to be directed toward that TDI detector.
  • One embodiment includes an aperture stop disposed adjacent to and preceding the at least one image lens, the aperture stop enabling control of a numerical aperture associated with the at least one image lens.
  • Other embodiments include an objective lens and an imaging slit disposed along the light collection path, in between the object and the collection lens.
  • a light source can be disposed to provide an incident light that illuminates the object. It should be noted that the use of a TDI detector in the present invention results in an extended imaging region along the axis of motion and a correspondingly long integration time. Several light sources can be simultaneously projected into the imaging region, increasing the amount of light incident upon objects therein.
  • the combination of an extended imaging region and the orthogonal orientation of the spectral dispersion axis relative to the axis of the motion allows multiple objects to be imaged simultaneously.
  • the long integration time and parallel image acquisition of this embodiment allows sensitive and consistent imaging performance to be combined with high throughput.
  • the light from the object comprises an unstimulated emission from the object, i.e., the object emits light without requiring a light source to stimulate the emission.
  • a light source is disposed to provide an incident light that illuminates the object.
  • the object may scatter the incident light so that the light scattered from the object at least in part passes through the collection lens, or the incident light illuminating the object may stimulate the object to emit the light that passes through the collection lens.
  • the incident light may at least be partially absorbed by the object, so that the light passing through the collection lens does not include a portion of the light absorbed by the object.
  • the incident light from the light source may be reflected from the object toward the collection lens.
  • the light source or sources that are used preferably comprise at least one of a coherent light source, a non-coherent light source, a pulsed light source, and a continuous light source.
  • the object may be entrained within a fluid stream that moves the object past the collection lens, or alternatively, can be carried on a support, or simply move without the benefit of a support or flowing medium.
  • the present invention is not limited to the imaging of microscopic or small objects.
  • the TDI detector preferably responds to the image of the object by producing a signal that propagates across the TDI detector. Pixels of a typical TDI detector are arranged in rows and columns, and the signal propagates from row to row. However, the present invention is not limited to TDI detectors employing a rectilinear arrangement of pixels (e.g., a microchannel plate-based TDI detector). A propagation rate of the signal across the TDI detector can either be synchronized with a motion of the image of the object on the TDI detector as a result of the movement, or can be non-synchronized with the movement. Other aspects of the present invention are directed to methods for imaging an object. These methods implement steps that are generally consistent with the imaging system discussed above.
  • FIGURE 1 is a plan view of a first embodiment of the present invention in which particles conveyed by a fluid stream depicted as flowing into the sheet;
  • FIGURE 2 is a side elevational view of the first embodiment shown in
  • FIGURE 1
  • FIGURE 3 is an isometric view of the first embodiment of FIGURE 1;
  • FIGURE 4 is an isometric view of a confocal embodiment that includes a slit that is used for spatial filtering of extraneous light;
  • FIGURE 5 is an isometric view showing different locations for a light source in connection with the first embodiment;
  • FIGURE 6 is an alternative to the first embodiment in which a second set of imaging components and TDI detector is included for monitoring light from a particle, to avoid interference between FISH probes, and showing alternative locations for light sources;
  • FIGURE 7 is an isometric view of an embodiment in which an object is supported by or comprises a slide that moves past a collection lens, showing different locations for a light source;
  • FIGURES 8 A and 8B are respectively a plan view and a side elevational view of an alternative to the embodiment of FIGURE 7 that is used to produce a scattered pattern on the TDI detector;
  • FIGURE 9 is a plan view of yet a further embodiment in which light forming a scatter patterned image and spectrally dispersed light from the object are imaged on separate portions of a TDI detector;
  • FIGURE 10 is a plan view of a still further embodiment in which light forming a scatter patterned image and spectrally dispersed light from the object are imaged by two different TDI detectors;
  • FIGURE 11 is a schematic diagram illustrating the optical convolution of a narrow FISH emission spectrum by the present invention, to resolve two FISH probes in a cell;
  • FIGURE 12 is a schematic diagram showing the optical convolution of two different colors of narrow FISH emission spectra, to resolve the image of the FISH probes on the TDI detector;
  • FIGURE 13 is a schematic diagram illustrating how for a wider FISH emission spectrum, a deconvolution is provided by the present invention to resolve the image of two FISH probes of a single color;
  • FIGURE 14 is a schematic diagram showing the deconvolution of two color FISH spectra that are relatively wide, to resolve the image of the FISH probes;
  • FIGURE 15 is a schematic block diagram of the system used to process the signal produced by a TDI detector in the present invention.
  • FIGURE 16 is a schematic diagram illustrating how the present invention is used to determine whether a cell is from a male or female;
  • FIGURE 17 is a plan view of an alternate embodiment that employs a spectral dispersion component comprising a plurality of stacked dichroic filters employed to spectrally separate the light;
  • FIGURE 18 is an X-Y plot of several typical passbands for the dichroic filters employed in the embodiment shown in FIGURE 17;
  • FIGURE 19 is a schematic illustration of a detection filter assembly that may optionally be placed in front of the TDI detector in the embodiment of FIGURE 17 to further suppress out-of-band light;
  • FIGURES 20A-20E are X-Y plots of transmission vs. wavelength for corresponding passbands of the filter segments of the detection filter assembly that may optionally be placed in front of the TDI detector;
  • FIGURE 21 is a plan view of another embodiment of the configuration of FIGURE 17, wherein the spectral dispersion filter system comprises a plurality of dichroic cube filters orientated at various angles to create the spectral dispersing effect;
  • FIGURE 22 illustrates an exemplary set of images projected onto the TDI detector when using the spectral dispersing filter system of the FIGURE 17
  • FIGURE 23 is a schematic isometric view of yet another embodiment, in which spectral decomposition occurs in an axis that is generally parallel to a direction of motion of a substrate carrying an object;
  • FIGURE 24 is a schematic plan view of a spectrally segmented detector for use in detecting and imaging light of several different spectral compositions
  • FIGURE 25 is an isometric view of an alternate embodiment, employing separate TDI detectors and separate imaging lenses for each spectrally decomposed image;
  • FIGURE 26 is an isometric view of an alternate embodiment employing separate TDI detectors, with a common imaging lens placed prior to the spectral decomposition elements;
  • FIGURE 27 is an isometric illustration of correction plates added to correct for astigmatism induced by a plate beam splitter placed in convergent space;
  • FIGURE 28 is an isometric view of an alternate embodiment employing separate TDI detectors receiving both light transmitted through and reflected by spectral decomposition elements.
  • the present invention offers considerable advantages over systems employed for cell and particle analysis in the prior art. These advantages arise from the use in the present invention of an optical dispersion system in combination with a TDI detector that produces an output signal in response to the images of cells and other objects that are directed on the TDI detector. Multiple objects can be imaged on the
  • the image of each object can be spectrally decomposed to discriminate object features by absorption, scatter, reflection or probe emissions using a common TDI detector for analysis.
  • the present invention can be employed to determine morphological, photometric, and spectral characteristics of cells and other objects by measuring optical signals including light scatter, reflection, absorption, fluorescence, phosphorescence, luminescence, etc.
  • Morphological parameters include nuclear area, perimeter, texture or spatial frequency content, centroid position, shape (i.e., round, elliptical, barbell-shaped, etc.), volume, and ratios of any of these parameters. Similar parameters can also be determined for the cytoplasm of cells with the present invention.
  • Photometric measurements with the invention enable the determination of nuclear optical density, cytoplasm optical density, background optical density, and the ratios of any of these values.
  • An object being imaged with the present invention can either be stimulated into fluorescence or phosphorescence to emit light, or may be luminescent, producing light without stimulation.
  • the light from the object is imaged on the TDI detector of the present invention to determine the presence and amplitude of the emitted light, the number of discrete positions in a cell or other object from which the light signal(s) originate(s), the relative placement of the signal sources, and the color (wavelength or waveband) of the light emitted at each position in the object.
  • FIGURES 1, 2, and 3 A first preferred embodiment of an imaging system 20 in accord with the present invention is schematically illustrated in FIGURES 1, 2, and 3, in connection with producing images of moving objects such as cells that are conveyed by a fluid flow 22 through the imaging system.
  • fluid flow 22 entrains an object 24 (such as a cell, but alternatively, a small particle) and carries the object through the imaging system.
  • object 24 such as a cell, but alternatively, a small particle
  • the direction of the fluid flow in FIGURE 1 is into (or out of) the sheet, while in FIGURES 2 and 3, the direction of flow is from top to bottom, as indicated by the arrow to the left of the Figures.
  • Light 30 from object 24 passes through collection lenses 32a and 32b that collect the light, producing collected light 34, which is approximately focussed at infinity, i.e.
  • the rays of collected light from collection lens 32b are generally parallel. Collected light 34 enters a prism 36, which disperses the light, producing dispersed light 38. The dispersed light then enters imaging lenses 40a and 40b, which focuses light 42 onto a TDI detector 44.
  • positions 26 and 28 can represent the location of two separate objects, which are simultaneously imaged on the detector at positions 26' and 28'.
  • imaging system 20 and all other imaging systems illustrated herein, it will be understood that the lenses and other optical elements illustrated are shown only in a relatively simple form.
  • the collection lens is illustrated as a compound lens comprising only collection lenses 32a and 32b.
  • Lens elements of different designs, either simpler or more complex, could be used in constructing the imaging system to provide the desired optical performance, as will be understood by those of ordinary skill in the art.
  • the actual lenses or optical elements used in the imaging system will depend upon the particular type of imaging application for which the imaging system will be employed.
  • the TDI detector that is used in the various embodiments of the present invention preferably comprises a rectangular charge-coupled device (CCD) that employs a specialized pixel read out algorithm, as explained below.
  • CCD charge-coupled device
  • Non-TDI CCD arrays are commonly used for 2-dimensional imaging in cameras.
  • TDI detector 44 which comprises a CCD array
  • the CCD array remains exposed to the light as the pixels are read out.
  • the readout occurs one row at a time from the top toward the bottom of the array. Once a first row is read out, the remaining rows are shifted by one pixel in the direction of the row that has just been read. If the object being imaged onto the array moves in synchrony with the motion of the pixels, light from the object is integrated for the duration of the TDI detector's total readout period without image blurring.
  • the signal strength produced by a TDI detector will increase linearly with the integration period, which is proportional to the number of TDI rows, but the noise will increase only as the square root of the integration period, resulting in an overall increase in the signal-to-noise ratio by the square root of the number of rows.
  • One TDI detector suitable for use in the present invention is a Dalsa Corp., Type IL-E2 image sensor, although other equivalent or better image sensors can alternatively be used.
  • the Dalsa image sensor has 96 stages or rows, each comprising 512 pixels; other types of image sensors useable in the present invention may have different configurations of rows and columns or a non-rectilinear arrangement of pixels.
  • the Dalsa sensor has approximately 96 times the sensitivity and nearly 10 times the signal-to-noise ratio of a standard CCD array.
  • the extended integration time associated with TDI detection also serves to average out temporal and spatial illumination variations, increasing measurement consistency.
  • a flow-through cuvette or a jet (not shown) contains the cells or other objects being analyzed.
  • the velocity and cellular concentration of the fluid may be controlled using syringe pumps, gas pressure, or other pumping methods (not shown) to drive a sample solution through the system to match the pixel readout rate of the TDI detector.
  • the readout rate of the TDI detector can be selectively controlled, as required, to match the motion of the sample solution.
  • optical magnifications can be used to achieve a desired resolution of the object that is being imaged on the light sensitive regions (pixels) of the TDI detector. It is contemplated that in most embodiments, the optical magnification will fall within a range of 1:1 to 50:1, providing a substantial range in the number of light sensitive regions on the TDI detector on which images of the object are formed, also depending of course, on the actual size of the object being imaged and its distance from the imaging system. It is envisioned that the present invention can have applications ranging from the analysis of cells and other microscopic objects to the imaging of stellar objects.
  • TDI detectors are CCD types of TDI detectors.
  • Other types of TDI detectors such as complementary metal oxide semiconductor (CMOS) and multi-channel plate imaging devices might also be used for the TDI detector in the present invention.
  • CMOS complementary metal oxide semiconductor
  • CMOS complementary metal oxide semiconductor
  • the signal will move in synchrony with a moving image projected onto the device, thereby increasing the integration time for the image, without causing blurring.
  • the motion of the signal can be selectively desynchronized from the motion of the radiation image, as required to achieve a desired affect.
  • FIGURE 4 illustrates an imaging system 45, which is a second preferred embodiment of the present invention and which is similar in many ways to imaging system 20.
  • imaging system 45 is a confocal embodiment that includes a slit 52 that substantially prevents extraneous light from reaching TDI detector 44.
  • light 46 from object 24 is focussed by an objective lens 48 onto a slit 52.
  • Slit 52 is sufficiently narrow to block light, which is not focussed onto the slit by objective lens 48 from passing through the slit.
  • Light 30' passes through the slit and is collected by collection lens 32 as discussed above, in regard to imaging system 20.
  • Collected light 34 is spectrally dispersed by prism 36, and is imaged by imaging lens 40 onto TDI detector 44, also as discussed above.
  • the TDI detector produces an output signal that corresponds only to the actual images of the object, and the signal is not affected by the extraneous light, which has been excluded. If not excluded in this manner, the ambient light reaching TDI detector 44 might otherwise produce "noise" in the output signal from the TDI detector.
  • each of imaging systems 20 and 45 a light source has not been shown. These first two embodiments have been illustrated in their most general form to make clear that a separate light source is not required to produce an image of the object, if the object is luminescent, i.e., if the object produces hght.
  • many of the applications of the present invention will require that one or more light sources be used to provide light that is incident on the object being imaged. The location of the light sources substantially affects the interaction of the incident light with the object and the kind of information that can be obtained from the images on the TDI detector.
  • FIGURE 5 several different locations of light sources usable to provide light incident on object 24 are illustrated. It should be understood, however, that light sources can be located at many other positions besides those shown in FIGURE 5.
  • the location of each one or more light source employed will be dependent upon the kind of imaging of the object, and the kind of data for the object, to be derived from the signal produced by the TDI detector.
  • employing a light source 60a or a light source 60b, as shown in the Figure will provide light 58 that is incident on object 24 and which is scattered from the object into the optical axis of collection lens 32.
  • the optical axis of collection lens 32 is at about a 90° angle relative to the directions of the light incident upon object 24 from either light source 60a or 60b.
  • a light source 62 is disposed so that light 58 emitted from the source travels toward the object in a direction that is generally aligned with the optical axis of collection lens 32, so that the image formed on TDI detector 44 will not include light absorbed by object 24. Light absorption characteristics of the object can thus be determined by illuminating the object using a light source 62.
  • a light source 64 is disposed to illuminate object 24 with hght directed toward the object along a path that is approximately 30-45° off the optical axis of collection lens 32. This light 58, when incident on object 24 will be reflected (scattered) from object 24, and the reflected or scattered light will be imaged on TDI detector 44.
  • a more directly reflected light is provided by an epi light source 66, disposed so as to direct its light 58 toward a partially reflective surface 68 that is disposed so that a portion of the hght is reflected through collection lens 32 and onto object 24. The light reaching the object will be reflected from it back along the axis of collection lens 32 and will at least in part pass through partially reflective surface 68 to form an image of the object on TDI detector 44.
  • a dichroic mirror may be employed instead of, and in the position of, partially reflective surface 68 to direct light from epi light source 66 to excite fluorescence or other stimulated emission from object 24. Emission from object 24 is then at least partially collected by collection lens 32 and passes through the dichroic mirror for spectral dispersion and detection by the TDI detector.
  • a light source can also be used to stimulate emission of hght from the object.
  • FISH probes that have been inserted into cells will fluoresce when excited by hght, producing a corresponding characteristic emission spectra from any excited FISH probe that can be imaged on TDI detector 44.
  • light sources 60a, 60b, 64, or 66 could alternatively be used for causing the excitation of FISH probes on object 24, enabling TDI detector 44 to image FISH spots produced by the FISH probes on the TDI detector at different locations as a result of the spectral dispersion of the hght from the object that is provided by prism 36.
  • Each of the light sources illustrated in FIGURE 5 produces hght 58, which can either be coherent, non-coherent, broadband or narrowband light, depending upon the application of the imaging system desired.
  • hght 58 can either be coherent, non-coherent, broadband or narrowband light, depending upon the application of the imaging system desired.
  • a tungsten filament hght source can be used for applications in which a narrowband light source is not required.
  • narrowband laser light is preferred, since it also enables a spectrally-decomposed, non-distorted image of the object to be produced from light scattered by the object.
  • This scattered light image will be separately resolved from the FISH spots produced on TDI detector 44, so long as the emission spectra of any FISH spots are at different wavelengths than the wavelength of the laser light.
  • the light source can be either of the continuous wave (CW) or pulsed type. If a pulsed type illumination source is employed, the extended integration period associated with TDI detection can allow the integration of signal from multiple pulses. Furthermore, it is not necessary for the light to be pulsed in synchronization with the TDI detector.
  • Pulsed lasers offer several advantages over CW lasers as a hght source in the present invention, including smaller size, higher efficiency, higher reliability, and the ability to deliver numerous wavelengths simultaneously.
  • Another advantage of pulsed lasers is their ability to achieve saturating levels of fluorescence excitation of fluorescent probes used in cells. Fluorescence saturation occurs when the number of photons encountering a fluorescent molecule exceeds its absorption capacity. Saturating excitation produced by a pulsed laser is inherently less noisy than unsaturafing CW laser excitation because variations in pulse-to-pulse excitation intensity have little effect on the fluorescence emission intensity.
  • Prism 36 in the imaging systems discussed above can be replaced with a diffraction grating, since either is capable of spectrally dispersing the optical signals from the cells over the pixels of the TDI detector.
  • spectral dispersion can be used to reduce measurement noise.
  • the light source wavelength differs from the emission spectra of the fluorescent probes
  • the light from the source that is scattered into the collection system is spatially isolated from the fluorescence signals. If the light source wavelength overlaps the emission spectra of the fluorescent probes, the pixels of the TDI detector in which light of the wavelength of the source falls can be isolated from those pixels on which the remaining fluorescence signals fall. Further, by dispersing the fluorescence signals over multiple pixels, the overall dynamic range of the imaging system is increased.
  • a third preferred embodiment is a stereoscopic arrangement 70 of the first preferred embodiment, as illustrated in FIGURE 6.
  • This arrangement allows the imaging of the object from two different directions in order to distinguish features that would otherwise overlap when viewed from a single direction.
  • the third preferred embodiment can be employed for objects on moving substrates such as microscope slides, it is particularly useful for analyzing multi-component objects in solution, such as cells containing FISH probes.
  • Such probes appear as point sources of hght anywhere within the cell's three-dimensional nucleus.
  • two or more FISH probes may appear in an overlapping relationship along the optical axis of the imaging system. In such cases, one of the FISH probes may obscure the others, making it difficult to determine the number of probes present in the cell.
  • the stereoscopic imaging system 70 in FIGURE 6 includes two TDI detectors 44a and 44b, and their associated optical components, as discussed above in connection with imaging system 20.
  • the optical axes of collection lenses 32 for the two TDI detectors so that they are spaced apart, for example, by 90°, it is possible to separately resolve the FISH spots imaged from two or more FISH probes on at least one of TDI detectors 44a or 44b. If two or more FISH probes overlap in regard to the image produced on one of the detectors, they will be separately resolved in the spectrally dispersed images produced on the other TDI detector.
  • the use of two TDI detectors in imaging system 70 in what might be referred to as a "stereo or three-dimensional configuration" allows flexibility in the configuration of each leg of the system, including parameters such as the relative TDI readout rates, axial orientations, inclinations, focal plane positions and magnification. Multiple cells or other objects may be imaged onto each detector simultaneously in the vertical direction. Since the objects may move in synchronicity with the signal on the TDI, no gate or shutter is required to prevent blurring of the image.
  • the present invention can use a pulsed or CW light source without need for a trigger mechanism to time a pulse coincident with particle arrival in the field of view.
  • a pulsed hght source the extended field of view in the axis of motion associated with TDI detection allows the cell or object in motion to be illuminated by multiple pulses during its traversal.
  • a TDI system can produce a single unblurred image of the object that integrates the signal from multiple pulses.
  • the signal generated by the object will be collected throughout the entire traversal of the object through the field of view, as opposed to only a small segment in time when a shutter is open. Therefore, the amount of signal collected and imaged on the detector in the present invention is substantially greater than that of the prior art frame-based imaging systems.
  • FIGURE 6 Also illustrated in FIGURE 6 are several exemplary positions for hght sources, which are useful for different purposes in connection with the imaging system illustrated therein.
  • light source 62 provides illumination of object 24 from a direction so that absorption characteristics of the object can be determined from the image produced on the TDI detector.
  • hght provided by light source 62 that is scattered from object 24 can be used to produce a scatter image and spectrally dispersed images on TDI detector 44b.
  • Light source 74 can be employed to produce spectrally dispersed and scattered images on both TDI detectors 44a and 44b.
  • light sources 62 and 72 are of different wavelengths and an appropriate filter is provided to block the wavelength from the light source aligned with the optical axis of the respective collections lenses 32, these two light sources can be used for producing scattered light from the object. For example, suppose light source 72 produces light of a wavelength A that scatters from object 24 and is directed toward TDI detector 44a. By including a filter (not shown) that blocks wavelength B produced by light source 62, the hght at wavelength B will not directly affect the images produced on TDI detector 44a. Similarly, the light from light source 72 would be blocked with an appropriate filter (not shown) so that it does not interfere with the imaging of light produced by light source 62 that is scattered from object 24 onto TDI detector 44b.
  • Epi light source 66 is also illustrated for use in producing images on TDI detector 44a in conjunction with partial reflector 68.
  • Light source 64 can be used to generate reflected light to produce images on TDI detector 44a, while scattered light from this source is directed toward TDI detector 44b.
  • FIGURE 7 an imaging system 80 is illustrated that is similar to imaging system 20, except that it is used for imaging object 24 on a slide 82.
  • Object 24 is supported by shde 82 and the slide moves relative to the imaging system as shown in FIGURE 7.
  • shde 82 may be the object that is imaged.
  • the object may be a semiconductor wafer, paper, or other object of interest since the object may be imaged using reflected incident light.
  • a light source placed at one of several different locations can be employed.
  • Exemplary light sources 62, 64, and 66 illustrate some of the locations at which light sources useful in this embodiment may be disposed.
  • Light 58 emitted by any of the light sources can be either coherent or non-coherent light, pulsed or CW, and can be directed through slide 82 (if it is transparent) from light source 62 or can be reflected from the object or slide, if light sources 64 or 66 are employed.
  • epi light source 66 illuminates the object in connection with a partially reflective surface 68.
  • FIGURES 8 A and 8B show two different views of a fourth preferred embodiment, which is an imaging system 90 that produces a scattered pattern image of object 24 on TDI detector 44.
  • Light 30 from object 24 passes through collection lenses 32a and 32b, and collected light 34 is directed onto a cylindrical lens 92, as in the previous embodiments.
  • Cylindrical lens 92 focuses light 94 on TDI detector 44, generally along a line that is aligned with a central axis 96 of cylindrical lens 92.
  • Central axis 96 is shown in FIGURE 8B, and it will be apparent that it is orthogonal to the direction in which object 24 moves through the imaging system.
  • an illustration of a fifth preferred embodiment is provided of an imaging system 100 that produces both a . scattered pattern image and a spectrally dispersed image of object 24 on TDI detector 44.
  • hi imaging system 100 light 30 from object 24 passes through collections lenses 32a and 32b, which produce infinitely focussed light 34 directed toward a dichroic filter 102.
  • Dichroic filter 102 reflects hght of a specific wavelength, e.g., the wavelength of a hght source (not shown) that is incident upon object 24. Light of any other wavelength is transmitted through dichroic filter 102 toward a diffraction grating 112.
  • Diffraction grating 112 spectrally disperses the hght transmitted through dichroic filter 102, which typically would be hght produced by the fluorescence of FISH probes on object 24, so that a plurality of FISH spots corresponding to the number of different FISH probes and objects being imaged are produced on TDI detector 44.
  • Light 104 which is reflected from dichroic filter 102 is transmitted into cylindrical lens 106 and is focussed along a line as a scattered pattern image in a region 110 on the TDI detector.
  • the spectrally dispersed images of FISH spots or other aspects of object 24 having wavelengths different than that reflected by dichroic filter 102 are imaged as light 116 by imaging lenses 114a and 114b onto a region 118 of the TDI detector.
  • signals corresponding to the scattered pattern image and the spectrally dispersed images are both produced by TDI detector 44.
  • a sixth preferred embodiment, as illustrated in FIGURE 10, is an imaging system 120 that is slightly different than the preceding fifth embodiment, since a dichroic filter 102' is employed that is angled in a different direction, toward a second TDI detector 44b.
  • a dispersed pattern image represented by light 108' is produced by a cylindrical lens 106' in this embodiment.
  • hght transmitted through dichroic filter 102' is focussed onto TDI detector 44a.
  • imaging system 120 is substantially identical in operation to imaging system 100.
  • imaging system 100 could be constructed to include two separate TDI detectors instead of a single TDI detector, if desired.
  • the present invention provides substantial utility in resolving FISH spots on the TDI detector, even when the FISH probes are disposed in spatially close relationship within the cell.
  • spectral imaging occurs in the present invention, the spatial distribution of light in the object is convolved with the spectral distribution of that light to produce the image of the object at the TDI detector. This convolution can result in blurring in the dispersion axis, depending on the spectral bandwidth of the hght.
  • Narrow spectral bandwidths will result in little or no blurring depending on the spectral resolution of the system, i the present invention, it is contemplated that the spectral resolution will be approximately 3 nm per pixel, with a spatial resolution in object space of approximately 1 micron. However, the spatial and spectral resolution can be adjusted to match the requirements of the particular application.
  • FIGURE 11 illustrates the present invention with a spectral resolution of approximately 10 nm per pixel and a spatial resolution of approximately 0.5 microns.
  • This Figure further illustrates how the present invention is used to image a cell 140 having a nucleus 142 in which are disposed two FISH probes 144a and 144b having the same emission spectrum, hi FIGURE 11, the emission spectrum 146 of the FISH probes 144a and 144b is approximately 10 nm in width, such as would be produced by "quantum dots" or a narrow-band fluorescent dye.
  • the optical convolution of the narrow bandwidth spectrum results in minimal blurring of FISH spots 148a and 148b, enabling them to be readily resolved on TDI detector 44.
  • a cell 150 is illustrated having a nucleus 152 in which are disposed FISH probes 154 and 156 having different emission spectra.
  • FISH probes are designed so that different emission spectra correspond to different DNA sequences.
  • Each of the emission spectra of FISH probes 154 and 156 are relatively narrow, as indicated by wavebands 158 and 160, and therefore, as in FIGURE 11, minimal blurring occurs in FISH spots 162 and 164.
  • the spectral dispersion of the present invention which maps wavelength into lateral position on TDI detector 44, produces a relatively wide physical displacement of FISH spots 162 and 164, despite the close proximity of FISH probes 154 and 156 in the cell.
  • FIGURES 11 and 12 illustrate how the present invention discriminates FISH probes of the same or different color, thereby enabling the simultaneous enumeration of numerous genetic traits.
  • the present invention is well suited to the requirements of fetal cell analysis, where there may be ten or more probes of different colors present in the cell at one time. Further, those skilled in the art will appreciate that the present invention is not limited to the analysis of fetal cells using FISH probes.
  • FIGURES 13 and 14 illustrate that the present invention can also be used with light of wide spectral bandwidth. In this case an additional signal processing step is performed to correct for lateral blurring due to the wide emission spectra.
  • a cell 140 having a nucleus 142 is shown, and FISH probes 170a and 170b having a common emission spectram are disposed in the nucleus.
  • FISH probes 170a and 170b are characterized by producing a relatively wide emission spectrum 172.
  • FISH spots 174a and 174b are produced on TDI detector 44, but their images are laterally blurred across TDI detector 44, as a result of their relatively wide emission spectrum.
  • a deconvolution is carried out on the signal produced by TDI detector 44, with the known FISH emission spectrum, thereby producing accurate FISH spot representations 178a and 178b on a display 176.
  • the deconvolution step enhances the ability to enumerate the number of FISH spots.
  • FIGURE 14 illustrates a corresponding relationship between FISH probes 180 and 182, which are disposed within a nucleus 152 of a cell 150.
  • FISH probes 180 and 182 are characterized by each producing relatively wide band emission spectra 184 and 186, as shown in the Figure.
  • the corresponding images shown on display 176 of FISH spots 192 and 194 are recovered.
  • the spectral dispersion of the present invention which maps wavelength into lateral position on TDI detector 44, produces a relatively wide physical displacement of FISH spots 192 and 194, despite the close proximity of FISH probes 180 and 182 in the cell, hi this manner, it is possible to resolve these images of FISH spots produced by FISH probes having different and relatively wide emission spectra.
  • FIGURE 15 A system 230 for analyzing the signal produced by TDI detector 44 and performing the deconvolution steps described above is illustrated in FIGURE 15.
  • the signal from TDI detector 44 is apphed to an amplifier 232, which buffers the signal and amplifies it to achieve a level required by an analog to digital (A-D) converter 234.
  • A-D converter converts the analog signal from amplifier 232 into a digital signal that is input into a TDI line buffer 236.
  • TDI line buffer 236 temporarily stores the digital signal until it can be processed by a CPU 238.
  • a spectral buffer 240 is loaded with the known emission spectrum for each of the FISH probes being used so that their emission spectra can be deconvolved with the signal stored in TDI line buffer 236.
  • CPU 238 is a high speed processor programmed to carry out the deconvolution and other analysis procedures, enabhng the identification of desired characteristics or parameters of the object being imaged.
  • the output from CPU 238 is temporarily stored in an image line buffer 242 that enables the image to be displayed or otherwise recorded for later analysis.
  • FIGURE 16 illustrates a practical application of the present invention for identifying a male cell 200 and a female cell 208 and for producing their corresponding scatter images 212 and 220.
  • Male cell 200 includes a nucleus 202 that has been stained with a yellow fluorescent dye.
  • a FISH probe 204 produces a fluorescent orange emission, indicating the presence of an X-chromosome in the nucleus
  • a FISH probe 206 produces red fluorescence emission, indicating the presence of a Y-chromosome.
  • Spectral decomposition of the fluorescence emissions from male cell 200 when the cell is illuminated with light from a green laser, results in a series of images on TDI detector 44, separated as a function of the wavelength of the light that is imaged.
  • the FISH probes responsive to X and Y chromosomes are detected, enabling the user to determine that ceU 200 is a male ceU, since it includes both the X and Y chromosome.
  • female cell 208 when spectrally decomposed, also includes the characteristic yellow fluorescence of nucleus 210, but unlike the male cell, includes two FISH spots 216 corresponding to FISH probes 204, which indicates the presence of two X-chromosomes.
  • TDI detector 44 also distinguishes the spatial position of male cell 200 and female cell 208, the corresponding spectral decompositions for these cells are readily separately resolved as both cells pass through the imaging system in the direction indicated by the arrow to the lower left of FIGURE 16. Again, it should be noted that a deconvolution can be apphed to the signal produced by TDI detector 44 to provide better resolution of the corresponding FISH spots that are illustrated.
  • FIGURE 17 illustrates a seventh preferred embodiment of the invention corresponding to such a non-distorting spectral dispersion system 250 that employs a five color stacked wedge spectral dispersing filter assembly 252.
  • This seventh embodiment is substantially similar to the embodiment shown in FIGURES 1, 2, and 3, except that spectral dispersing prism element 36 (of FIGURES 1, 2 and 3) is replaced by spectral dispersing filter assembly 252.
  • the spectral dispersing filter assembly splits the light into a plurality of hght beams having different bandwidths. Each light beam thus produced is directed at a different nominal angle so as to fall upon a different region of TDI detector 44.
  • the nominal angular separation between each bandwidth produced by the spectral dispersing filter assembly 252 exceeds the field angle of the imaging system in object space thereby preventing overlap of the field images of various bandwidths on the detector.
  • Spectral dispersing filter assembly 252 comprises a plurality of stacked dichroic wedge filters, including a red dichroic filter R, an orange dichroic filter O, a yellow dichroic filter Y, a green dichroic filter G, and a blue dichroic filter B.
  • Red dichroic filter R is placed in the path of collected light 34, oriented at an angle of approximately 44.0° relative to an optic axis 253 of collection lenses 32a and 32b.
  • Light of red wavelengths and above, i.e., > 640 nm, is reflected from the surface of red dichroic filter R at a nominal angle of 1°, measured counter-clockwise from a vertical optic axis 257.
  • Example spectral reflectance characteristics R' of red dichroic filter R are plotted in FIGURE 18, along with example spectral reflectance characteristics corresponding to the other dichroic filters used in spectral dispersing filter assembly 252.
  • O' indicates the spectral reflectance characteristics of orange dichroic filter O
  • Y' indicates the spectral reflectance characteristics of yellow dichroic filter Y, etc.
  • the hght reflected by red dichroic filter R leaves spectral dispersing filter assembly 252 and passes through imaging lenses 40a and 40b, which cause the hght to be imaged onto a red light receiving region of TDI detector 44, which is disposed toward the right end of the TDI detector, as shown in FIGURE 17.
  • Orange dichroic filter O is disposed a short distance behind red dichroic filter R and is oriented at an angle of 44.5 degrees with respect to optic axis 253. Light of orange wavelengths and greater, i.e., > 610 nm, is reflected by orange dichroic filter O at a nominal angle of 0.5° with respect to vertical optic axis 257. Because the portion of collected hght 34 comprising wavelengths longer than 640 nm was already reflected by red dichroic filter R, the light reflected from the surface of orange dichroic filter O is effectively bandpassed in the orange colored region between 610 nm and 640 nm.
  • This light travels at a nominal angle of 0.5° from vertical optic axis 257, and is imaged by imaging lenses 40a and 40b so as to fall onto an orange light receiving region disposed toward the right hand side of TDI detector 44 between a center region of the TDI detector and the red light receiving region, again as shown in FIGURE 17.
  • Yellow dichroic filter Y is disposed a short distance behind orange dichroic filter O and is oriented at an angle of 45° with respect to optic axis 253.
  • Light of yellow wavelengths i.e., 560 nm and longer, is reflected from yellow dichroic filter Y at a nominal angle of 0.0° with respect to vertical optic axis 257.
  • Wavelengths of hght reflected by yellow dichroic filter Y are effectively bandpassed in the yellow region between 560 nm and 610 nm and are imaged by imaging lenses 40a and 40b near vertical optic axis 257 so as to fall on a yellow light receiving region toward the center of TDI detector 44.
  • dichroic filters G and B are configured and oriented so as to image green and blue light wavebands onto respective green and blue light receiving regions of TDI detector 44, which are disposed toward the left-hand side of the TDI detector.
  • spectral dispersing filter assembly 252 collectively works to focus light within predefined wavebands of the light spectrum onto predefined regions of TDI detector 44.
  • the filters used in the spectral dispersing filter assembly 252 may have spectral characteristics that differ from those described above and in FIGURE 18. Further, the spectral characteristics may be arbitrary and not limited to dichroic in order to achieve the desired dispersion characteristics.
  • the wedge shape of the dichroic filters in the preceding discussion allows the filters to be placed in near contact, in contact or possibly cemented together to form the spectral dispersing filter assembly 252.
  • the angle of the wedge shape fabricated into the substrate for the dichroic filter allows easy assembly of the spectral dispersing filter assembly 252, forming a monolithic structure in which the wedge-shaped substrate is sandwiched between adjacent dichroic filters. If the filters are in contact with each other or cemented together, the composition of the materials that determine the spectral performance of the filter may be different from those which are not in contact.
  • flat, non wedge-shaped substrates could be used to fabricate the spectral dispersing filter assembly 252.
  • non-distorting spectral dispersion system 250 may optionally include a detector filter assembly 254 to further attenuate undesired signals in each of the light beams, depending upon the amount of rejection required for out-of-band signals.
  • FIGURE 19 illustrates the constraction of an exemplary detector filter 254 corresponding to the five color bands discussed above and includes a blue spectral region 256, a green spectral region 258, a yellow spectral region 260, an orange spectral region 262, and a red spectral region 264, all of which are disposed side-by-side, as shown in the Figure.
  • FIGURES 20A-20E The corresponding spectral characteristics of the blue, green, yellow, orange, and red spectral regions or wavebands are respectively shown in FIGURES 20A-20E.
  • the detection filter assembly shown in FIGURE 19 may be constructed by cementing separate filters in side-by-side arrangement on a common substrate or by other means well known to those or ordinary skill in the art. Additionally, the ordinary practitioner in the art will understand that the filter may alternatively be placed at an intermediate image plane, instead of directly in front of TDI detector 44. In the embodiment shown in FIGURE 17, light may pass through each dichroic filter in the spectral dispersing filter assembly 252 twice before exiting spectral dispersing filter assembly 252. This condition will further attenuate out-of-band signals, but will also attenuate in-band signals.
  • FIGURE 21 illustrates an eighth embodiment of the present invention in which the light does not pass through another dichroic filter after reflection.
  • a plurality of cube dichroic filters including a red cube filter 266, a yellow cube filter 268, a green cube filter 270, and a blue cube filter 272 are spaced apart sufficiently to ensure that light does not pass through any of the cube filters more than once.
  • the cube dichroic filters are oriented at appropriate angles to image light within a predefined bandwidth to distinct regions on a TDI detector 274.
  • hght is reflected from each of cube dichroic filters 266, 268, 270 and 272, it is directed toward imaging lenses 40a and 40b, and different bandpass portions of the light are focussed upon corresponding red, yellow, green, and blue hght receiving segments or regions defined on a hght receiving surface of TDI detector 274.
  • an optional detector filter assembly 276 of similar construction to detector filter assembly 254 may be used to increase the rejection of out-of-band signals. It should be apparent to those skilled in the art that separate spaced apart plate, or pelhcal elements could also be used in this application instead of the cube filters.
  • the image lenses 40a and 40b must be placed a sufficient distance away from the plurality of cube filters to minimize the clear aperture requirement for lenses 40a and 40b.
  • the clear aperture in the plane orthogonal to the page can increase as the distance between the lenses and plurality cube filters increases. Therefore, the placement of lenses 40a and 40b must be chosen to appropriately accommodate the clear aperture in both planes.
  • spectral dispersing component with more or fewer filters may be used in these configurations in order to construct a system covering a wider or a narrower spectral region, or different passbands within a given spectral region.
  • spectral resolution of the present invention may be increased or decreased by appropriately choosing the number and spectral characteristics of the dichroic and or bandpass filters that are used.
  • angles or orientation of the filters may be adjusted to direct light of a given bandwidth onto any desired point on the TDI detector.
  • FIGURE 22 illustrates the distribution of images on TDI detector 44 corresponding to imaging a plurality of cells 200 when using non-distorting spectral dispersion system 250.
  • the resultant images on the TDI detector are similar in many ways.
  • all wavelengths within the predefined bandwidth of each dichroic filter are reflected from the filter at the same nominal angle, so image components that fall within that passband suffer no positional distortion on the detector.
  • the field angle orthogonal to flow in object space is also indicated on FIGURE 22.
  • the field angle in object space is less than +/- 0.25°.
  • the field angle can be made larger or smaller. To the extent that the field angle is made larger, for example, to image cells over a wider region on a shde or in a broad flat flow, the field angle at the detector will increase in proportion to the number of colors used.
  • broad flat flow can easily be created using commercially available flow cells as shown in FIGURE 25, which incorporates containing flow cell 306.
  • Flow cell 306 has a cross section that is elongated in an axis perpendicular to both the flow and optical axes. The generation of a broad flat flow is discussed in many references, including U.S. Patent No. 5,422,712.
  • flow cell 306 enables a broad flat flow to be achieved, hi embodiments incorporating flow cell 306, or other means to provide a broad flat flow, preferably the field angle in increased by an amount that is sufficient to enable any objects entrained in such a broad flat flow to be imaged and that image captured by a detector.
  • the field angle also must increase in a proportional fashion, to ensure all objects in that flow volume can be imaged as they pass through the field of view.
  • FIGURE 22 illustrates the image projected onto the detector when three cells 280, 282 and 284 are flowing through the field of view. Light scatter images of cells 280, 282, and 284 are seen on the left hand side of the detector denoted as the BLUE area.
  • Probe 204 stains the X chromosome with an orange fluorescing dye
  • probe 205 stains the Y chromosome with yellow fluorescing dye
  • probe 206 stains the inactive X chromosome in female cells with a red fluorescing dye.
  • Cell 282 is imaged onto the detector as shown in FIGURE 22. An image 286 of probe 204 from cell 282 is seen in the ORANGE area of the detector.
  • cells 280 and 284 contain probes 204 and 206, which create images 290 and 292 in the ORANGE area of the detector, and images 294 and 296 in the RED area of the detector, indicating that these cells are female, respectively.
  • FIGURES 25, 26 and 28 Alternate embodiments of the present invention utilizing multiple detectors for spectral dispersing and imaging are illustrated in FIGURES 25, 26 and 28.
  • Spectral decomposition is implemented using dichroic filters, generally as described above. However, as illustrated in FIGURE 25, separate imaging lenses and detectors are used for each spectral region. Dichroic filters 301- 305 are disposed in infinite space with respect to the object from which light is being spectrally decomposed to minimize optical aberrations. After each dichroic filter, separate imaging lenses 311- 315 are used to form an image of the object onto corresponding detectors 321- 325. In this configuration, each detector has fewer pixels than in the embodiments described above, enabling the present embodiments to operate at high pixel line rates.
  • the images projected on each detector appear as shown on one zone of the detector illustrated in FIGURE 17. The images on the detector configured to receive hght in the red portion of the spectrum appear like those in the right-most zone of FIGURE 17.
  • FIGURES 25, 26 and 28 have an advantage in optical efficiency over other embodiments, because the light from the object only passes through each dichroic filter once.
  • a further advantage of the multiple detector embodiments is that each detector can be focused independently for each color, thereby simplifying the optical design by removing constraints on longitudinal color correction.
  • a still further advantage is that the quantum efficiency of each detector can be individually optimized for its particular color band. Those of ordinary skill in the art will readily recognize that such optimization can be accomplished through doping of the semiconductor materials utilized in the detector.
  • one or more lenses as exemplified by lens 311), may have a different focal length, thereby enabling simultaneous image collection with differential magnifications.
  • the clock rate on detector 321 will be proportionally higher to maintain synchronization, which is expected to be useful when one channel is used with a higher magnification for brightfield image collection, to more accurately analyze morphological detail.
  • the configuration shown in FIGURE 25 also allows channel independent control of numerical aperture, as illustrated by the disposition of optional aperture stop 330. It should be noted that an object plane 348a as shown in FIGURE 25 is larger than object planes 348 illustrated in other Figures, due to the characteristics of flow cell 306. As noted above, flow cell 306 enables a broad flat flow to be achieved, such that multiple objects passing through object plane 348a simultaneously can be imaged simultaneously, as long as each image covers a sufficiently large field angle.
  • the field angle needs to be matched to the size of the object plane (such as object plane 348a) so that the images produced encompasses substantially all of the object plane.
  • the object plane is defined by the perimeter of the fluid channel employed.
  • FIGURE 26 illustrates another embodiment of the multiple detector approach. While similar to the embodiment illustrated in FIGURE 25, the embodiment of FIGURE 26 has the advantage of reducing the number of imaging lenses required to project an image upon the detectors, hi the embodiment of FIGURE 26, an image lens 340 is placed before dichroic filters 345- 347. Those skilled in the art will appreciate that the functions of collection lens 32 and image lens 340 can be carried out by a single element. Detectors 341- 344 are placed at the appropriate positions along the optical path to image an object plane 348 on the surface of each detector.
  • Detectors 341 - 343 are placed in a path of light from the object that is reflected off dichroic filters 345, 346 and 347, while detector 344 is placed in a path of hght from the object transmitted through dichroic filter 347.
  • the filters are disposed in convergent space with respect to the image of the object and therefore each filter, depending upon its design, may impart astigmatism, coma, spherical, and chromatic aberration into the imagery at each downstream detector. Progressively, more of each of these aberrations are added by each subsequent filter.
  • the numerical aperture (i.e., the product of the index of refraction and the sine of the half cone angle of iUumination) in the filter space is approximately 0.03. Therefore, if cube substrates are employed for the dichroic filters, coma and astigmatism are neghgible, while spherical aberration is substantially eliminated, being less than 0.15 waves peak. Longitudinal chromatic aberration is effectively canceled by moving the detectors to the plane of best focus for their respective color band. Pellicles can also be used in place of the cubes for the substrates of the dichroic filters, with excellent theoretical optical performance.
  • correction plate 360 As shown in FIGURE 27, of approximately the same thickness, incident angle, and glass type.
  • correction plate 360 must be rotated 90 degrees about axis Z with respect to dichroic filter 361.
  • Correction plate 360, and dichroic filter 361 impart an equal but opposite amount of astigmatism in the transmitted wavefront, thereby canceling each other. Therefore, light striking detector 342 is free of astigmatism. This configuration leaves a small amount of residual coma. Yet, the optical performance is very close to the diffraction limit.
  • the correction plate can be placed in many alternative positions, with adjustments in its thickness, material, and/or angle, relative to the propagation of the hght.
  • Any of the non-distorting spectral dispersing embodiments can be constructed using an additional objective lens 48 and sht 52, to form a confocal stop arrangement as shown in FIGURE 26.
  • FIGURE 28 illustrates an embodiment similar to FIGURE 25 using multiple imaging lenses, however, the majority of detectors are place in the transmission path of dichroic filters. Either of the multiple detector embodiments may constructed such that the detectors receive hght transmitted through the dichroic filters, reflected by the dichroic filters or in a combination of transmission and reflection as illustrated in both FIGURES 26 and 28.
  • ceUs or other objects may be oriented side-by-side such as may be found in broad flat flow, or on microscope slides and microtiter plates. This configuration enables more objects to be imaged simultaneously than could otherwise be possible if objects were aligned in a single file orientation.
  • FIGURE 23 illustrates an embodiment of the present invention that facilitates imaging of a wide field.
  • motion of a substrate 73 is generally parallel or aligned with an axis of spectral decomposition provided by dichroic element 252.
  • Optional epi illuminator 60a which may comprise a laser or other type of illumination source, can be used to illuminate objects carried on substrate 73, while there is relative movement between the substrate and the imaging system in the direction of the double-headed arrow.
  • another illuminator 60b is provided to provide bright field illumination of the objects on the substrate with hght reflected from a reflective surface 77.
  • Collection lens 32 collimates the light from the slit and directs the light onto dichroic element 252, which spectrally disperses the light passing through lens 40 and onto different regions of detector 44.
  • Segmented detector 300 (FIGURE 24) is used for detector 44 in FIGURE 23, and spectral dispersing filter assembly 252 is oriented to decompose light in an axis parallel to the movement of the image across detector 44.
  • the field of view of substrate 73 in FIGURE 23 may be illuminated in bright field with bright field illuminator 60b or with epi-illumination by illuminator 60a. In either case the iUuminated field of view, when imaged by the optical system, is equivalent in size to one segment of detector 300.
  • spectral dispersing filter assembly 252 when spectral dispersing filter assembly 252 is employed, light is split into a plurality of light beams each having a different bandwidth. Each hght beam thus produced is directed at a different nominal angle so as to fall upon a different segment of detector 300.
  • the nominal angular separation between each bandwidth produced by spectral dispersing filter assembly 252 exceeds the field angle of the imaging system in object space, thereby preventing overlap of the field images of various bandwidths on the detector. Therefore, each detector segment sees the same field of view, however, each segment sees hght composed of a different spectral bandwidth.
  • Slit 55 may be provided to eliminate any stray hght from outside the intended field of view from passing through the system and landing on an inappropriate zone of detector 300.
  • segmented detector 300 comprises four segments or zones 302a-302d, each zone receiving light of a different characteristic.
  • the detector is segmented into these zones such that the charge corresponding to an incident image flows across a segment in concert with the image movement across that segment The charge is then read out of the segment and not permitted to enter an adjacent segment or zone where hght of a different characteristic is imaged.
  • the charge corresponding to an image received by each zone is integrated over a length of the zone and readout from the tap provided for the zone.
  • the rate at which the charge is readout from each zone is independently controllable.

Abstract

Light from an object such as a cell moving through an imaging system is collected and dispersed so that it is imaged onto a plurality of separate detectors (321-325). The light is spectrally dispersed by a plurality of spaced-apart dichroic reflectors (301-304), each detector (321-325) receiving light from a different one of the dichroic reflectors (301-304). Each dichroic filter (301-304) reflects light of a different predefined color, passing light of other colors. The output signal from each detector (321-325) is indicative of a different characteristic of the object. In one configuration, each detector (321-325) is provided with a separate imaging lens (311-315). In another configuration, the detectors (321-325) are spaced at varying distances from the corresponding dichroic reflectors (301-304), so that separate imaging lenses are not required.

Description

IMAGING AND ANALYZING PARAMETERS OF SMALL
MOVING OBJECTS SUCH AS CELLS
Field of the Invention
This invention generally relates to imaging moving objects or particles for purposes of analysis and detection, and more specifically, to a system and method for determining and analyzing the morphology of moving objects, such as cells, and for detecting the presence and composition of Fluorescence In-Situ Hybridization (FISH) probes within cells.
Background of the Invention There are a number of biological and medical applications that are currently impractical due to limitations in cell and particle analysis technology. Examples of such biological applications include battlefield monitoring of known airborne toxins, as well as the monitoring of cultured cells to detect the presence of both known and unknown toxins. Medical applications include non-invasive prenatal genetic testing and routine cancer screening via the detection and analysis of rare cells (i.e., low rate of occurrence) in peripheral blood. All of these applications require an analysis system with the following principal characteristics: 1. high speed measurement;
2. the ability to process very large or continuous samples; 3 high spectral resolution and bandwidth; 4, good spatial resolution; 5 high sensitivity; and 6 low measurement variation. In prenatal testing, the target cells are fetal cells that cross the placental barrier into the mother's bloodstream. In cancer screening, the target cells are sloughed into the bloodstream from nascent cancerous tumors. In both of these applications of this technology, the target cells may be present in the blood at concentrations of one to five cells per billion. This concentration yields approximately 20-100 target cells in a typical 20 ml blood sample. The extreme rarity of the targeted cells demands that any detection and analysis system employed in these applications be capable of processing an enriched sample of approximately 100 million cells within a few hours, corresponding to a minimum throughput of 10,000 cells per second. Cell processing includes the determination of cellular morphology parameters such as overall size, nuclear size, nuclear shape, and optical density, the detection and characterization of numerous fluorescent markers and FISH probes, the quantification of the total amount of DNA in the nucleus, and the detection of other cellular components such as fetal hemoglobin. To accomplish these processing tasks, the system must be able to collect cell images with a spatial resolution of approximately 1 micron. Likewise, the system must have high spectral resolution and bandwidth to differentiate four or more fluorescent colors. Since some probes may label important cellular features with only a few thousand fluorescent molecules, the system must have high sensitivity and good measurement consistency to differentiate very weak signals.
The predominant research laboratory protocols for non-invasive prenatal diagnosis employ a complex series of process steps that include gradient centrifugation to remove unnucleated cells, high speed cell sorting for fetal cell enrichment, and fluorescence microscopy for fetal cell identification and genetic analysis. These protocols often yield little or no fetal cells for analysis, because a fraction of the fetal cells are lost at each step of the protocol. Nevertheless, the protocols cannot be simplified because of limitations in existing analysis technology. Ideally, fetal cell identification and analysis would be performed in a few hours by a high speed cell sorter having the necessary speed and sample handling capacity. This ideal is not possible with conventional systems, because conventional cell sorters lack the necessary imaging abilities, sensitivity, and repeatability to reliably identify fetal cells and enumerate the number and color of FISH probes used to make the diagnosis. Therefore, under current protocols, cells must be sorted onto slides and examined using fluorescence microscopy to establish their fetal origin and make a genetic diagnosis. The combination of low fetal cell yields and lengthy processing times precludes the clinical application of non-invasive fetal testing with existing technology.
No technology prior to the present invention incorporates all six of the principal characteristics of a viable fetal cell or cancer analysis system. In the prior art, there have been advances that might be applied to these applications, but significant limitations still remain.
A paper published by Ong et al. [Anal. Quant. Cytol. Histol., 9(5):375-82] describes the use of a time delay and integration (TDI) detector in an imaging flow cytometer. A TDI detector is any pixilated device in which the signal produced in response to radiation directed at the device can be caused to move in a controlled fashion. Typically, the pixels of a TDI detector are arranged in rows and columns, and the signal is moved from row to row in synchrony with a moving image projected onto the device, allowing an extended integration time without blurring. The approach disclosed by Ong et al. advanced the art by addressing the need for spatial resolution and high sensitivity for cells in flow. However, this approach does not address the remaining principal characteristics. The authors of this paper cite an operating speed of 10 cells per second and a theoretical speed limitation of 500 cells per second, which is at least an order of magnitude slower than is required for non-invasive fetal testing. In addition, the system has no spectral resolution; laser scatter and fluorescent light are collected by the imaging system indiscriminately.
In more recent developments, U.S. Patent No. 5,644,388 discloses an alternative approach to an imaging flow cytometer. The patent discloses the use of a frame-based image collection approach in which a video camera views cells in flow, in a freeze frame fashion. This method requires the image collection system to be synchronized with the presence of cells in the imaging area, unlike the case of TDI, wherein the detector readout rate is synchronized with the velocity of the cells. When a cell is imaged with the frame-based method, the integration period must be very short to prevent blurring. A short integration time is achieved either with a strobed light source, or a continuous light source combined with a shuttered detector. In either case, the short integration time reduces the signal-to-noise ratio and the ultimate sensitivity of the approach. Further, frame-based cameras require time to transfer data out of the camera, during which no images are acquired, and cells of interest can escape detection. Finally, like the work of Ong et al., this patent makes no provisions for acquiring data over a large spectral bandwidth and with sufficient spectral resolution to simultaneously resolve numerous and differently colored fluorescent probes and FISH spots.
Spectral discrimination is addressed in U.S. Patent No. 5,422,712, in which the spectra of particles suspended in a fluid are collected as the particles flow through a detection region. However, there is no spatial representation of the object in the system disclosed in this patent, because the object is defocussed at the detector. In this system, light is collected from the object and an image is created at an intermediate aperture. The light continues through the aperture to a spectral dispersing element, which disperses the light spectrally along the axis of flow. The dispersed light is applied to an image intensifier in which it is amplified, and the light signal output from the image intensifier is finally directed to a frame-based detector. At the intermediate aperture, prior to spectral dispersion, the image represents the spatial distribution of light in object space. The spatial distribution is blurred as the light propagates past the image plane, through the spectral dispersing element and onto the image intensifier. Because there is no provision for re-imaging the intermediate aperture at the intensifier, the resulting signal distribution at the intensifier represents only the spectral distribution of the light and does not preserve the spatial distribution of the light from the object. The loss of spatial information limits the utility of the invention for applications such as fetal cell analysis. If multiple identical FISH spots are present in a cell, their spectra can be ascertained using this approach, but the number of spots cannot be determined. In addition, this approach disperses the wavelength spectrum parallel to the axis of flow. If two particles are illuminated in the flow axis, their spectra can overlap on the detector. To prevent this problem, the patent discloses that a very short illumination height in the flow axis is used. The short illumination height decreases integration time, which necessitates the use of the image intensifier. Further, the short illumination height limits throughput by preventing the simultaneous imaging of multiple cells in the flow axis.
Accordingly, it will be apparent that an improved technique is desired that resolves the limitations of the conventional approaches discussed above. It is expected that the new approach developed to address these problems in the prior art will also have application to the analysis of other types of moving objects besides cells and may be implemented in different configurations to meet the specific requirements of disparate applications of the technology.
Summary of the Invention The present invention is directed to an imaging system that is adapted to determine one or more characteristics of an object from an image of the object. There is relative movement between the object and the imaging system, and although it is contemplated that either (or both) may be in motion, the object will preferably move while the imaging system will be fixed. In addition, it should also be understood that while much of the following summary and the corresponding claims recite "an object," it is clearly contemplated that the present invention is preferably intended to be used with a plurality of objects and is particularly useful in connection with imaging a stream of objects.
The present invention provides a method and apparatus utilizing multiple detectors to determine at least one characteristic of an object moving through a field a view, relative to the detectors. Preferably the detectors are stationary, although it should be understood that a critical aspect is that there be relative motion between the object and the detectors, thus the present invention anticipates embodiments in which the object is stationary and the detectors are in motion. It should be noted that the data provided by the present invention include simultaneous spatial and spectral images covering a large bandwidth at high resolution, and further that the present invention preserves the spatial origin of the spectral information gathered from the object. In particular, the use of multiple detectors ensures no distortion or convolution of the image occurs due to the emission bandwidth, and as a result, a deconvolution is not needed to correct the image. Sufficient detectors are employed to provide separate detectors for each spectrally decomposed image.
Several different embodiments of the multi-detector imaging system are provided. A first series of embodiments are directed toward systems that include an imaging lens associated with each individual detector, and a second series of embodiments are directed towards systems that include a single imaging lens for the system. In general, the system includes a collection lens disposed so that light traveling from the object is collimated by passing through the collection lens and travels along a collection path. At least one lens is disposed to receive light that has passed through the collection lens, and to generate an image. The disposition of such image lens, or lenses, is a function of whether one image lens is employed for the system, or whether a separate lens is associated with each detector noted above. The relative dispositions will be discussed more in detail below. A plurality of light reflecting elements receive light that has passed through the collection lens, and reflecting having a predefined characteristic, while enabling light that does not have the predefined characteristic to pass. Preferably, the light passing through the collection lens is in a plane substantially orthogonal to a direction of relative movement between the object and the imaging system. As noted above, the object or the imaging system or both can be in motion relative to the other and for the sake of simplicity, this relative movement is hereinafter referred to simply as "the movement." Each light reflecting element reflects light in a different direction, and for each light reflecting element there is a detector disposed to receive reflected light. Each detector is capable of producing a signal indicative of at least one characteristic of the object. Preferably, each detector is a TDI detector, disposed to receive the image produced by the at least one imaging lens. As the movement occurs, the image of the object produced by the imaging lens moves from row to row across the TDI detector. Each TDI detector produces an output signal that is indicative of at least one characteristic of the object, by integrating light from at least a portion of the object over time.
As a result of light collimation by the collection lens in this embodiment, all light emitted from a first point in the object travels in parallel rays. Light emitted from a second point in the object will also travel in parallel rays, but at a different angle relative to light from the first point. In this manner, spatial information in the object is transformed by the collection lens into angular information in the collection path. The plurality of different reflecting elements each reflect different characteristics of light, thereby acting on the collimated light such that different spectral components leave the plurality of different reflecting elements in different directions, preferably in a plane substantially orthogonal to the direction of the movement between the object and the imaging system. In this manner, both spatial and spectral information in the object are transformed into angular information. The at least one imaging lens acts on the collimated light to transform different light angles into different positions on each detector. Spatial information is preserved by the system since light from the different positions in the object is projected to different positions on the detector, for both axes. In addition, preferably light of different spectral composition that originates from the object is projected onto different detectors, in an axis substantially orthogonal to the movement. In this manner, the spatial information from the object is preserved, while spectral information covering a large bandwidth is simultaneously collected at high resolution. The use of a single detector for each different spectral component means that each detector can be focused independently for each color, thereby simplifying the optical design by eliminating the constraint of longitudinal color correction required for single detector systems. A still further advantage is that the quantum efficiency of each detector can be individually optimized for its particular color band, thereby increasing the overall sensitivity of the system.
Preferably, each light reflecting element is a dichroic filter, or dichroic mirror, which are arranged to reflect light within predefined bandwidths at predefined angles. Unlike a prism, where every wavelength leaves the prism at a different angle, all light within a predefined bandwidth incident on the dichroic element at a common angle leaves a given dichroic element at the same angle. Therefore, there is no convolution between the emission spectrum of the light leaving the object and the image of that object. When using such a reflecting element, light of a first spectral bandwidth reflects off the first dichroic element at a predefined nominal angle. Light of a second spectral bandwidth is passed through the first dichroic element to the next dichroic element and is reflected therefrom at a different predefined nominal angle. Light of a third spectral bandwidth is passed through the first and second dichroic elements to a third dichroic element and reflected therefrom at a third predefined nominal angle. The dichroic elements are selected to cover the desired light spectrum with the appropriate spectral passbands. The angle of each dichroic element is set such that light reflected from it within the corresponding spectral bandwidth for the dichroic element is focused onto a different detector.
In at least one embodiment, a single image lens is disposed in the collection path. The positions of the detectors are manipulated such that the distance from each detector to the single image lens is substantially equivalent. Each reflective element is disposed in between the image lens and the corresponding detector.
In another embodiment, there is one image lens for each detector, disposed in between a reflective element and its corresponding detector, such that light reflected from a reflective element passes through an image lens prior to reaching a detector. In yet another embodiment, each dichroic reflecting element is a cube substrate. In another embodiment, each dichroic reflecting is a pellical, while in other embodiments each dichroic reflecting element is a plate substrate. Note that for most embodiments, light from the object passes through each light reflecting element only once. Particularly in embodiments employing a single lens, optical distortions are increased after light passes through each dichroic reflecting element. In one embodiment, such distortions are reduced by employing cube substrates wherein a numerical aperture associated with each cube substrate is sufficiently small so as to substantially eliminate coma and astigmatism. In other embodiments, a correction plate is disposed between each successive light reflecting element, each correction plate being oriented relative to an immediately preceding light reflective element such that any astigmatism imparted by the immediately preceding light reflective element is substantially eliminated. Preferably the orientation of the correction plate is substantially orthogonal relative to an axis about which the immediately preceding light reflective element is rotated to direct reflected light toward one of the plurality of detectors.
Preferably, the predefined characteristic which the reflecting elements employ to reflect or pass light is color, and each individual TDI detector is separately focused for a specific color of light, so that each individual TDI detector is properly focused for a specific color of light directed toward that TDI detector by a corresponding reflecting element. Most preferably, each individual TDI detector is independently optimized for the specific color to be directed toward that TDI detector.
It should be understood that additional optical elements can be incorporated into the present invention. One embodiment includes an aperture stop disposed adjacent to and preceding the at least one image lens, the aperture stop enabling control of a numerical aperture associated with the at least one image lens. Other embodiments include an objective lens and an imaging slit disposed along the light collection path, in between the object and the collection lens. A light source can be disposed to provide an incident light that illuminates the object. It should be noted that the use of a TDI detector in the present invention results in an extended imaging region along the axis of motion and a correspondingly long integration time. Several light sources can be simultaneously projected into the imaging region, increasing the amount of light incident upon objects therein. In addition, the combination of an extended imaging region and the orthogonal orientation of the spectral dispersion axis relative to the axis of the motion allows multiple objects to be imaged simultaneously. The long integration time and parallel image acquisition of this embodiment allows sensitive and consistent imaging performance to be combined with high throughput.
There are several alternative ways to provide light from the object, hi one case, the light from the object comprises an unstimulated emission from the object, i.e., the object emits light without requiring a light source to stimulate the emission. In another embodiment, a light source is disposed to provide an incident light that illuminates the object. In this case, the object may scatter the incident light so that the light scattered from the object at least in part passes through the collection lens, or the incident light illuminating the object may stimulate the object to emit the light that passes through the collection lens. Further, the incident light may at least be partially absorbed by the object, so that the light passing through the collection lens does not include a portion of the light absorbed by the object. Finally, the incident light from the light source may be reflected from the object toward the collection lens. The light source or sources that are used preferably comprise at least one of a coherent light source, a non-coherent light source, a pulsed light source, and a continuous light source.
The object may be entrained within a fluid stream that moves the object past the collection lens, or alternatively, can be carried on a support, or simply move without the benefit of a support or flowing medium. Moreover, the present invention is not limited to the imaging of microscopic or small objects.
The TDI detector preferably responds to the image of the object by producing a signal that propagates across the TDI detector. Pixels of a typical TDI detector are arranged in rows and columns, and the signal propagates from row to row. However, the present invention is not limited to TDI detectors employing a rectilinear arrangement of pixels (e.g., a microchannel plate-based TDI detector). A propagation rate of the signal across the TDI detector can either be synchronized with a motion of the image of the object on the TDI detector as a result of the movement, or can be non-synchronized with the movement. Other aspects of the present invention are directed to methods for imaging an object. These methods implement steps that are generally consistent with the imaging system discussed above.
Brief Description of the Drawing Figures The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same becomes better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:
FIGURE 1 is a plan view of a first embodiment of the present invention in which particles conveyed by a fluid stream depicted as flowing into the sheet; FIGURE 2 is a side elevational view of the first embodiment shown in
FIGURE 1;
FIGURE 3 is an isometric view of the first embodiment of FIGURE 1; FIGURE 4 is an isometric view of a confocal embodiment that includes a slit that is used for spatial filtering of extraneous light; FIGURE 5 is an isometric view showing different locations for a light source in connection with the first embodiment;
FIGURE 6 is an alternative to the first embodiment in which a second set of imaging components and TDI detector is included for monitoring light from a particle, to avoid interference between FISH probes, and showing alternative locations for light sources;
FIGURE 7 is an isometric view of an embodiment in which an object is supported by or comprises a slide that moves past a collection lens, showing different locations for a light source; FIGURES 8 A and 8B are respectively a plan view and a side elevational view of an alternative to the embodiment of FIGURE 7 that is used to produce a scattered pattern on the TDI detector;
FIGURE 9 is a plan view of yet a further embodiment in which light forming a scatter patterned image and spectrally dispersed light from the object are imaged on separate portions of a TDI detector;
FIGURE 10 is a plan view of a still further embodiment in which light forming a scatter patterned image and spectrally dispersed light from the object are imaged by two different TDI detectors; FIGURE 11 is a schematic diagram illustrating the optical convolution of a narrow FISH emission spectrum by the present invention, to resolve two FISH probes in a cell;
FIGURE 12 is a schematic diagram showing the optical convolution of two different colors of narrow FISH emission spectra, to resolve the image of the FISH probes on the TDI detector;
FIGURE 13 is a schematic diagram illustrating how for a wider FISH emission spectrum, a deconvolution is provided by the present invention to resolve the image of two FISH probes of a single color;
FIGURE 14 is a schematic diagram showing the deconvolution of two color FISH spectra that are relatively wide, to resolve the image of the FISH probes;
FIGURE 15 is a schematic block diagram of the system used to process the signal produced by a TDI detector in the present invention;
FIGURE 16 is a schematic diagram illustrating how the present invention is used to determine whether a cell is from a male or female; FIGURE 17 is a plan view of an alternate embodiment that employs a spectral dispersion component comprising a plurality of stacked dichroic filters employed to spectrally separate the light;
FIGURE 18 is an X-Y plot of several typical passbands for the dichroic filters employed in the embodiment shown in FIGURE 17; FIGURE 19 is a schematic illustration of a detection filter assembly that may optionally be placed in front of the TDI detector in the embodiment of FIGURE 17 to further suppress out-of-band light;
FIGURES 20A-20E are X-Y plots of transmission vs. wavelength for corresponding passbands of the filter segments of the detection filter assembly that may optionally be placed in front of the TDI detector;
FIGURE 21 is a plan view of another embodiment of the configuration of FIGURE 17, wherein the spectral dispersion filter system comprises a plurality of dichroic cube filters orientated at various angles to create the spectral dispersing effect;
FIGURE 22 illustrates an exemplary set of images projected onto the TDI detector when using the spectral dispersing filter system of the FIGURE 17; FIGURE 23 is a schematic isometric view of yet another embodiment, in which spectral decomposition occurs in an axis that is generally parallel to a direction of motion of a substrate carrying an object;
FIGURE 24 is a schematic plan view of a spectrally segmented detector for use in detecting and imaging light of several different spectral compositions;
FIGURE 25 is an isometric view of an alternate embodiment, employing separate TDI detectors and separate imaging lenses for each spectrally decomposed image;
FIGURE 26 is an isometric view of an alternate embodiment employing separate TDI detectors, with a common imaging lens placed prior to the spectral decomposition elements;
FIGURE 27 is an isometric illustration of correction plates added to correct for astigmatism induced by a plate beam splitter placed in convergent space; and
FIGURE 28 is an isometric view of an alternate embodiment employing separate TDI detectors receiving both light transmitted through and reflected by spectral decomposition elements.
Description of the Preferred Embodiment
The present invention offers considerable advantages over systems employed for cell and particle analysis in the prior art. These advantages arise from the use in the present invention of an optical dispersion system in combination with a TDI detector that produces an output signal in response to the images of cells and other objects that are directed on the TDI detector. Multiple objects can be imaged on the
TDI detector at the same time. In addition, the image of each object can be spectrally decomposed to discriminate object features by absorption, scatter, reflection or probe emissions using a common TDI detector for analysis.
The present invention can be employed to determine morphological, photometric, and spectral characteristics of cells and other objects by measuring optical signals including light scatter, reflection, absorption, fluorescence, phosphorescence, luminescence, etc. Morphological parameters include nuclear area, perimeter, texture or spatial frequency content, centroid position, shape (i.e., round, elliptical, barbell-shaped, etc.), volume, and ratios of any of these parameters. Similar parameters can also be determined for the cytoplasm of cells with the present invention. Photometric measurements with the invention enable the determination of nuclear optical density, cytoplasm optical density, background optical density, and the ratios of any of these values. An object being imaged with the present invention can either be stimulated into fluorescence or phosphorescence to emit light, or may be luminescent, producing light without stimulation. In each case, the light from the object is imaged on the TDI detector of the present invention to determine the presence and amplitude of the emitted light, the number of discrete positions in a cell or other object from which the light signal(s) originate(s), the relative placement of the signal sources, and the color (wavelength or waveband) of the light emitted at each position in the object.
An initial application of the imaging system comprising the present invention will likely be employed as a cell analyzer to determine one or more of the parameters listed above, for cells entrained in a fluid flowing through the imaging system. However, it should also be understood that this invention can be used for imaging other moving objects. First Preferred Embodiment
A first preferred embodiment of an imaging system 20 in accord with the present invention is schematically illustrated in FIGURES 1, 2, and 3, in connection with producing images of moving objects such as cells that are conveyed by a fluid flow 22 through the imaging system. In FIGURE 1, fluid flow 22 entrains an object 24 (such as a cell, but alternatively, a small particle) and carries the object through the imaging system. The direction of the fluid flow in FIGURE 1 is into (or out of) the sheet, while in FIGURES 2 and 3, the direction of flow is from top to bottom, as indicated by the arrow to the left of the Figures. Light 30 from object 24 passes through collection lenses 32a and 32b that collect the light, producing collected light 34, which is approximately focussed at infinity, i.e. the rays of collected light from collection lens 32b are generally parallel. Collected light 34 enters a prism 36, which disperses the light, producing dispersed light 38. The dispersed light then enters imaging lenses 40a and 40b, which focuses light 42 onto a TDI detector 44.
As will be evident in FIGURE 2, if the Figure depicts the imaging of object 24 over time, the object is shown at both a position 26 and a position 28 as it moves with fluid flow 22. As a consequence, images of object 24 will be produced on the detector at two discrete spatial positions 26' and 28', as indicated on the right side of FIGURE 2. Alternatively, if FIGURE 2 is depicting a single instant in time, positions 26 and 28 can represent the location of two separate objects, which are simultaneously imaged on the detector at positions 26' and 28'.
In regard to imaging system 20 and all other imaging systems illustrated herein, it will be understood that the lenses and other optical elements illustrated are shown only in a relatively simple form. Thus, the collection lens is illustrated as a compound lens comprising only collection lenses 32a and 32b. Lens elements of different designs, either simpler or more complex, could be used in constructing the imaging system to provide the desired optical performance, as will be understood by those of ordinary skill in the art. The actual lenses or optical elements used in the imaging system will depend upon the particular type of imaging application for which the imaging system will be employed.
In each of the embodiments of the present invention, it will be understood that relative movement exists between the object being imaged and the imaging system. In most cases, it will be more convenient to move the object than to move the imaging system. However, it is also contemplated that in some cases, the object may remain stationary and the imaging system move relative to it. As a further alternative, both the imaging system and the object may be in motion but either in different directions or at different rates. The TDI detector that is used in the various embodiments of the present invention preferably comprises a rectangular charge-coupled device (CCD) that employs a specialized pixel read out algorithm, as explained below. Non-TDI CCD arrays are commonly used for 2-dimensional imaging in cameras. In a standard CCD array, photons that are incident on a pixel produce charges that are trapped in the pixel. The photon charges from each pixel are read out of the detector array by shifting the charges from one pixel to the next, and then onto an output capacitor, producing a voltage proportional to the charge. Between pixel readings, the capacitor is discharged and the process is repeated for every pixel on the chip. During the readout, the array must be shielded from any light exposure to prevent charge generation in the pixels that have not yet been read.
In one type of TDI detector 44, which comprises a CCD array, the CCD array remains exposed to the light as the pixels are read out. The readout occurs one row at a time from the top toward the bottom of the array. Once a first row is read out, the remaining rows are shifted by one pixel in the direction of the row that has just been read. If the object being imaged onto the array moves in synchrony with the motion of the pixels, light from the object is integrated for the duration of the TDI detector's total readout period without image blurring. The signal strength produced by a TDI detector will increase linearly with the integration period, which is proportional to the number of TDI rows, but the noise will increase only as the square root of the integration period, resulting in an overall increase in the signal-to-noise ratio by the square root of the number of rows. One TDI detector suitable for use in the present invention is a Dalsa Corp., Type IL-E2 image sensor, although other equivalent or better image sensors can alternatively be used. The Dalsa image sensor has 96 stages or rows, each comprising 512 pixels; other types of image sensors useable in the present invention may have different configurations of rows and columns or a non-rectilinear arrangement of pixels. The Dalsa sensor has approximately 96 times the sensitivity and nearly 10 times the signal-to-noise ratio of a standard CCD array. The extended integration time associated with TDI detection also serves to average out temporal and spatial illumination variations, increasing measurement consistency. In imaging system 20 and in other embodiments of the present invention that employ a fluid flow to carry objects through the imaging system, a flow-through cuvette or a jet (not shown) contains the cells or other objects being analyzed. The velocity and cellular concentration of the fluid may be controlled using syringe pumps, gas pressure, or other pumping methods (not shown) to drive a sample solution through the system to match the pixel readout rate of the TDI detector. However, it should be understood that the readout rate of the TDI detector can be selectively controlled, as required, to match the motion of the sample solution.
Various optical magnifications can be used to achieve a desired resolution of the object that is being imaged on the light sensitive regions (pixels) of the TDI detector. It is contemplated that in most embodiments, the optical magnification will fall within a range of 1:1 to 50:1, providing a substantial range in the number of light sensitive regions on the TDI detector on which images of the object are formed, also depending of course, on the actual size of the object being imaged and its distance from the imaging system. It is envisioned that the present invention can have applications ranging from the analysis of cells and other microscopic objects to the imaging of stellar objects.
It should be emphasized that the present invention is not limited to CCD types of TDI detectors. Other types of TDI detectors, such as complementary metal oxide semiconductor (CMOS) and multi-channel plate imaging devices might also be used for the TDI detector in the present invention. It is important to understand that any pixelated device (i.e., having a multitude of light sensitive regions) in which a signal produced in response to radiation directed at the device can be caused to move through the device in a controlled fashion is suitable for use as the TDI detector in the present invention. Typically, the signal will move in synchrony with a moving image projected onto the device, thereby increasing the integration time for the image, without causing blurring. However, the motion of the signal can be selectively desynchronized from the motion of the radiation image, as required to achieve a desired affect. Second Preferred Embodiment
FIGURE 4 illustrates an imaging system 45, which is a second preferred embodiment of the present invention and which is similar in many ways to imaging system 20. However, imaging system 45 is a confocal embodiment that includes a slit 52 that substantially prevents extraneous light from reaching TDI detector 44. In imaging system 45, light 46 from object 24 is focussed by an objective lens 48 onto a slit 52. Slit 52, as shown in FIGURE 4, is sufficiently narrow to block light, which is not focussed onto the slit by objective lens 48 from passing through the slit. Light 30' passes through the slit and is collected by collection lens 32 as discussed above, in regard to imaging system 20. Collected light 34 is spectrally dispersed by prism 36, and is imaged by imaging lens 40 onto TDI detector 44, also as discussed above. By excluding light other than that from object 24 from reaching TDI detector 44, the TDI detector produces an output signal that corresponds only to the actual images of the object, and the signal is not affected by the extraneous light, which has been excluded. If not excluded in this manner, the ambient light reaching TDI detector 44 might otherwise produce "noise" in the output signal from the TDI detector.
It should be noted that in the illustration of each of imaging systems 20 and 45, a light source has not been shown. These first two embodiments have been illustrated in their most general form to make clear that a separate light source is not required to produce an image of the object, if the object is luminescent, i.e., if the object produces hght. However, many of the applications of the present invention will require that one or more light sources be used to provide light that is incident on the object being imaged. The location of the light sources substantially affects the interaction of the incident light with the object and the kind of information that can be obtained from the images on the TDI detector.
In FIGURE 5, several different locations of light sources usable to provide light incident on object 24 are illustrated. It should be understood, however, that light sources can be located at many other positions besides those shown in FIGURE 5. The location of each one or more light source employed will be dependent upon the kind of imaging of the object, and the kind of data for the object, to be derived from the signal produced by the TDI detector. For example, employing a light source 60a or a light source 60b, as shown in the Figure, will provide light 58 that is incident on object 24 and which is scattered from the object into the optical axis of collection lens 32. The optical axis of collection lens 32 is at about a 90° angle relative to the directions of the light incident upon object 24 from either light source 60a or 60b.
In contrast, a light source 62 is disposed so that light 58 emitted from the source travels toward the object in a direction that is generally aligned with the optical axis of collection lens 32, so that the image formed on TDI detector 44 will not include light absorbed by object 24. Light absorption characteristics of the object can thus be determined by illuminating the object using a light source 62.
A light source 64 is disposed to illuminate object 24 with hght directed toward the object along a path that is approximately 30-45° off the optical axis of collection lens 32. This light 58, when incident on object 24 will be reflected (scattered) from object 24, and the reflected or scattered light will be imaged on TDI detector 44. A more directly reflected light is provided by an epi light source 66, disposed so as to direct its light 58 toward a partially reflective surface 68 that is disposed so that a portion of the hght is reflected through collection lens 32 and onto object 24. The light reaching the object will be reflected from it back along the axis of collection lens 32 and will at least in part pass through partially reflective surface 68 to form an image of the object on TDI detector 44. Alternatively, a dichroic mirror may be employed instead of, and in the position of, partially reflective surface 68 to direct light from epi light source 66 to excite fluorescence or other stimulated emission from object 24. Emission from object 24 is then at least partially collected by collection lens 32 and passes through the dichroic mirror for spectral dispersion and detection by the TDI detector.
In addition to imaging an object with the hght that is incident on it, a light source can also be used to stimulate emission of hght from the object. For example, FISH probes that have been inserted into cells will fluoresce when excited by hght, producing a corresponding characteristic emission spectra from any excited FISH probe that can be imaged on TDI detector 44. In FIGURE 5, light sources 60a, 60b, 64, or 66 could alternatively be used for causing the excitation of FISH probes on object 24, enabling TDI detector 44 to image FISH spots produced by the FISH probes on the TDI detector at different locations as a result of the spectral dispersion of the hght from the object that is provided by prism 36. The disposition of these FISH spots on the TDI detector surface will depend upon their emission spectra and their location in the object. Use of FISH probes in connection with producing images of FISH spots on the TDI detector with the present invention is discussed in greater detail below. Each of the light sources illustrated in FIGURE 5 produces hght 58, which can either be coherent, non-coherent, broadband or narrowband light, depending upon the application of the imaging system desired. Thus, a tungsten filament hght source can be used for applications in which a narrowband light source is not required. For applications such as stimulating the emission of fluorescence from FISH probes, narrowband laser light is preferred, since it also enables a spectrally-decomposed, non-distorted image of the object to be produced from light scattered by the object. This scattered light image will be separately resolved from the FISH spots produced on TDI detector 44, so long as the emission spectra of any FISH spots are at different wavelengths than the wavelength of the laser light. The light source can be either of the continuous wave (CW) or pulsed type. If a pulsed type illumination source is employed, the extended integration period associated with TDI detection can allow the integration of signal from multiple pulses. Furthermore, it is not necessary for the light to be pulsed in synchronization with the TDI detector.
Pulsed lasers offer several advantages over CW lasers as a hght source in the present invention, including smaller size, higher efficiency, higher reliability, and the ability to deliver numerous wavelengths simultaneously. Another advantage of pulsed lasers is their ability to achieve saturating levels of fluorescence excitation of fluorescent probes used in cells. Fluorescence saturation occurs when the number of photons encountering a fluorescent molecule exceeds its absorption capacity. Saturating excitation produced by a pulsed laser is inherently less noisy than unsaturafing CW laser excitation because variations in pulse-to-pulse excitation intensity have little effect on the fluorescence emission intensity.
Prism 36 in the imaging systems discussed above can be replaced with a diffraction grating, since either is capable of spectrally dispersing the optical signals from the cells over the pixels of the TDI detector. In addition to providing useful data from a cell or other object, spectral dispersion can be used to reduce measurement noise. In cases where the light source wavelength differs from the emission spectra of the fluorescent probes, the light from the source that is scattered into the collection system is spatially isolated from the fluorescence signals. If the light source wavelength overlaps the emission spectra of the fluorescent probes, the pixels of the TDI detector in which light of the wavelength of the source falls can be isolated from those pixels on which the remaining fluorescence signals fall. Further, by dispersing the fluorescence signals over multiple pixels, the overall dynamic range of the imaging system is increased. Third Preferred Embodiment
A third preferred embodiment is a stereoscopic arrangement 70 of the first preferred embodiment, as illustrated in FIGURE 6. This arrangement allows the imaging of the object from two different directions in order to distinguish features that would otherwise overlap when viewed from a single direction. While the third preferred embodiment can be employed for objects on moving substrates such as microscope slides, it is particularly useful for analyzing multi-component objects in solution, such as cells containing FISH probes. Such probes appear as point sources of hght anywhere within the cell's three-dimensional nucleus. In some cases, two or more FISH probes may appear in an overlapping relationship along the optical axis of the imaging system. In such cases, one of the FISH probes may obscure the others, making it difficult to determine the number of probes present in the cell. This is a key factor in the determination of genetic abnormalities such as trisomy21, otherwise known as Down syndrome. Single-perspective systems may address this problem by "panning through" the object along the optical axis to acquire multiple image planes in the object. While this method may be effective, it requires a significant amount of time to collect multiple images and cannot be readily applied to a cell in flow. The stereoscopic imaging system 70 in FIGURE 6 includes two TDI detectors 44a and 44b, and their associated optical components, as discussed above in connection with imaging system 20. By positioning the optical axes of collection lenses 32 for the two TDI detectors so that they are spaced apart, for example, by 90°, it is possible to separately resolve the FISH spots imaged from two or more FISH probes on at least one of TDI detectors 44a or 44b. If two or more FISH probes overlap in regard to the image produced on one of the detectors, they will be separately resolved in the spectrally dispersed images produced on the other TDI detector. Further, the use of two TDI detectors in imaging system 70 in what might be referred to as a "stereo or three-dimensional configuration" allows flexibility in the configuration of each leg of the system, including parameters such as the relative TDI readout rates, axial orientations, inclinations, focal plane positions and magnification. Multiple cells or other objects may be imaged onto each detector simultaneously in the vertical direction. Since the objects may move in synchronicity with the signal on the TDI, no gate or shutter is required to prevent blurring of the image. As previously noted, the present invention can use a pulsed or CW light source without need for a trigger mechanism to time a pulse coincident with particle arrival in the field of view. If a pulsed hght source is used, the extended field of view in the axis of motion associated with TDI detection allows the cell or object in motion to be illuminated by multiple pulses during its traversal. In contrast to a frame-based imaging apparatus, a TDI system can produce a single unblurred image of the object that integrates the signal from multiple pulses. When a CW light source is used, the signal generated by the object will be collected throughout the entire traversal of the object through the field of view, as opposed to only a small segment in time when a shutter is open. Therefore, the amount of signal collected and imaged on the detector in the present invention is substantially greater than that of the prior art frame-based imaging systems. Consequently, the present invention can operate at very high throughput rates with excellent signal-to-noise ratio. Also illustrated in FIGURE 6 are several exemplary positions for hght sources, which are useful for different purposes in connection with the imaging system illustrated therein. In connection with TDI detector 44a, light source 62 provides illumination of object 24 from a direction so that absorption characteristics of the object can be determined from the image produced on the TDI detector. At the same time, hght provided by light source 62 that is scattered from object 24 can be used to produce a scatter image and spectrally dispersed images on TDI detector 44b. Light source 74 can be employed to produce spectrally dispersed and scattered images on both TDI detectors 44a and 44b. If light sources 62 and 72 are of different wavelengths and an appropriate filter is provided to block the wavelength from the light source aligned with the optical axis of the respective collections lenses 32, these two light sources can be used for producing scattered light from the object. For example, suppose light source 72 produces light of a wavelength A that scatters from object 24 and is directed toward TDI detector 44a. By including a filter (not shown) that blocks wavelength B produced by light source 62, the hght at wavelength B will not directly affect the images produced on TDI detector 44a. Similarly, the light from light source 72 would be blocked with an appropriate filter (not shown) so that it does not interfere with the imaging of light produced by light source 62 that is scattered from object 24 onto TDI detector 44b.
Epi light source 66 is also illustrated for use in producing images on TDI detector 44a in conjunction with partial reflector 68. Light source 64 can be used to generate reflected light to produce images on TDI detector 44a, while scattered light from this source is directed toward TDI detector 44b. These and other possible locations of light sources will be apparent to those of ordinary skill in the art, as appropriate for providing the incident light on the object needed to achieve imaging, depending upon the particular application and information about the object that is desired. Imaging Shde or Object Carried by Slide
Turning now to FIGURE 7, an imaging system 80 is illustrated that is similar to imaging system 20, except that it is used for imaging object 24 on a slide 82. Object 24 is supported by shde 82 and the slide moves relative to the imaging system as shown in FIGURE 7. Alternatively, shde 82 may be the object that is imaged. The object may be a semiconductor wafer, paper, or other object of interest since the object may be imaged using reflected incident light.
To provide light incident on either slide 82 or object 24 that is supported thereby, a light source placed at one of several different locations can be employed. Exemplary light sources 62, 64, and 66 illustrate some of the locations at which light sources useful in this embodiment may be disposed. Light 58 emitted by any of the light sources can be either coherent or non-coherent light, pulsed or CW, and can be directed through slide 82 (if it is transparent) from light source 62 or can be reflected from the object or slide, if light sources 64 or 66 are employed. As noted previously, epi light source 66 illuminates the object in connection with a partially reflective surface 68. Fourth Preferred Embodiment
FIGURES 8 A and 8B show two different views of a fourth preferred embodiment, which is an imaging system 90 that produces a scattered pattern image of object 24 on TDI detector 44. Light 30 from object 24 passes through collection lenses 32a and 32b, and collected light 34 is directed onto a cylindrical lens 92, as in the previous embodiments. Cylindrical lens 92 focuses light 94 on TDI detector 44, generally along a line that is aligned with a central axis 96 of cylindrical lens 92. Central axis 96 is shown in FIGURE 8B, and it will be apparent that it is orthogonal to the direction in which object 24 moves through the imaging system. As object 24 moves downwardly, relative to its disposition as shown in FIGURE 8A, the focus of cylindrical lens 92 on TDI detector 44 moves upwardly. Cylindrical lens 92 thus distributes an image of the object along a row or rows of the hght sensitive regions or pixels of TDI detector 44. Fifth Preferred Embodiment
Referring now to FIGURE 9, an illustration of a fifth preferred embodiment is provided of an imaging system 100 that produces both a.scattered pattern image and a spectrally dispersed image of object 24 on TDI detector 44. hi imaging system 100, light 30 from object 24 passes through collections lenses 32a and 32b, which produce infinitely focussed light 34 directed toward a dichroic filter 102. Dichroic filter 102 reflects hght of a specific wavelength, e.g., the wavelength of a hght source (not shown) that is incident upon object 24. Light of any other wavelength is transmitted through dichroic filter 102 toward a diffraction grating 112. Diffraction grating 112 spectrally disperses the hght transmitted through dichroic filter 102, which typically would be hght produced by the fluorescence of FISH probes on object 24, so that a plurality of FISH spots corresponding to the number of different FISH probes and objects being imaged are produced on TDI detector 44.
Light 104, which is reflected from dichroic filter 102 is transmitted into cylindrical lens 106 and is focussed along a line as a scattered pattern image in a region 110 on the TDI detector. The spectrally dispersed images of FISH spots or other aspects of object 24 having wavelengths different than that reflected by dichroic filter 102 are imaged as light 116 by imaging lenses 114a and 114b onto a region 118 of the TDI detector. Thus, signals corresponding to the scattered pattern image and the spectrally dispersed images are both produced by TDI detector 44. Sixth Preferred Embodiment
A sixth preferred embodiment, as illustrated in FIGURE 10, is an imaging system 120 that is slightly different than the preceding fifth embodiment, since a dichroic filter 102' is employed that is angled in a different direction, toward a second TDI detector 44b. A dispersed pattern image represented by light 108' is produced by a cylindrical lens 106' in this embodiment. Just as in imaging system 100, hght transmitted through dichroic filter 102' is focussed onto TDI detector 44a. Aside from using two separate TDI detectors that are disposed at different sides of the imaging system, imaging system 120 is substantially identical in operation to imaging system 100. However, just as in the third preferred embodiment, the use of two separate TDI detectors allows flexibility in the configuration of each leg of the system, including parameters such as the relative TDI readout rates, axial orientations, inclinations, focal plane positions, and magnification. It should also be noted that imaging system 100 could be constructed to include two separate TDI detectors instead of a single TDI detector, if desired.
Processing of Spectrally Dispersed Images on TDI Detector
When used for cell analysis, the present invention provides substantial utility in resolving FISH spots on the TDI detector, even when the FISH probes are disposed in spatially close relationship within the cell. When spectral imaging occurs in the present invention, the spatial distribution of light in the object is convolved with the spectral distribution of that light to produce the image of the object at the TDI detector. This convolution can result in blurring in the dispersion axis, depending on the spectral bandwidth of the hght. Narrow spectral bandwidths will result in little or no blurring depending on the spectral resolution of the system, i the present invention, it is contemplated that the spectral resolution will be approximately 3 nm per pixel, with a spatial resolution in object space of approximately 1 micron. However, the spatial and spectral resolution can be adjusted to match the requirements of the particular application.
FIGURE 11 illustrates the present invention with a spectral resolution of approximately 10 nm per pixel and a spatial resolution of approximately 0.5 microns. This Figure further illustrates how the present invention is used to image a cell 140 having a nucleus 142 in which are disposed two FISH probes 144a and 144b having the same emission spectrum, hi FIGURE 11, the emission spectrum 146 of the FISH probes 144a and 144b is approximately 10 nm in width, such as would be produced by "quantum dots" or a narrow-band fluorescent dye. The optical convolution of the narrow bandwidth spectrum results in minimal blurring of FISH spots 148a and 148b, enabling them to be readily resolved on TDI detector 44. hi FIGURE 12, a cell 150 is illustrated having a nucleus 152 in which are disposed FISH probes 154 and 156 having different emission spectra. FISH probes are designed so that different emission spectra correspond to different DNA sequences. Each of the emission spectra of FISH probes 154 and 156 are relatively narrow, as indicated by wavebands 158 and 160, and therefore, as in FIGURE 11, minimal blurring occurs in FISH spots 162 and 164. Furthermore, the spectral dispersion of the present invention, which maps wavelength into lateral position on TDI detector 44, produces a relatively wide physical displacement of FISH spots 162 and 164, despite the close proximity of FISH probes 154 and 156 in the cell. Taken together, FIGURES 11 and 12 illustrate how the present invention discriminates FISH probes of the same or different color, thereby enabling the simultaneous enumeration of numerous genetic traits. Those skilled in the art can appreciate that the present invention is well suited to the requirements of fetal cell analysis, where there may be ten or more probes of different colors present in the cell at one time. Further, those skilled in the art will appreciate that the present invention is not limited to the analysis of fetal cells using FISH probes.
FIGURES 13 and 14 illustrate that the present invention can also be used with light of wide spectral bandwidth. In this case an additional signal processing step is performed to correct for lateral blurring due to the wide emission spectra. In FIGURE 13, a cell 140 having a nucleus 142 is shown, and FISH probes 170a and 170b having a common emission spectram are disposed in the nucleus. FISH probes 170a and 170b are characterized by producing a relatively wide emission spectrum 172. When optically convolved by the spectral dispersion provided by the present invention, FISH spots 174a and 174b are produced on TDI detector 44, but their images are laterally blurred across TDI detector 44, as a result of their relatively wide emission spectrum. To more clearly resolve the separation of FISH spots 174a and 174b, a deconvolution is carried out on the signal produced by TDI detector 44, with the known FISH emission spectrum, thereby producing accurate FISH spot representations 178a and 178b on a display 176. The deconvolution step enhances the ability to enumerate the number of FISH spots.
FIGURE 14 illustrates a corresponding relationship between FISH probes 180 and 182, which are disposed within a nucleus 152 of a cell 150. FISH probes 180 and 182 are characterized by each producing relatively wide band emission spectra 184 and 186, as shown in the Figure. Optical convolution of the fluorescence emitted by the FISH probes, which are spectrally dispersed, produces FISH spots 188 and 190 on TDI detector 44. Again, by deconvolving the known FISH emission spectra with the signal produced by TDI detector 44, the corresponding images shown on display 176 of FISH spots 192 and 194 are recovered. Again, the spectral dispersion of the present invention, which maps wavelength into lateral position on TDI detector 44, produces a relatively wide physical displacement of FISH spots 192 and 194, despite the close proximity of FISH probes 180 and 182 in the cell, hi this manner, it is possible to resolve these images of FISH spots produced by FISH probes having different and relatively wide emission spectra.
A system 230 for analyzing the signal produced by TDI detector 44 and performing the deconvolution steps described above is illustrated in FIGURE 15. hi this Figure, the signal from TDI detector 44 is apphed to an amplifier 232, which buffers the signal and amplifies it to achieve a level required by an analog to digital (A-D) converter 234. This A-D converter converts the analog signal from amplifier 232 into a digital signal that is input into a TDI line buffer 236. TDI line buffer 236 temporarily stores the digital signal until it can be processed by a CPU 238. To carry out the deconvolution noted above, a spectral buffer 240 is loaded with the known emission spectrum for each of the FISH probes being used so that their emission spectra can be deconvolved with the signal stored in TDI line buffer 236. CPU 238 is a high speed processor programmed to carry out the deconvolution and other analysis procedures, enabhng the identification of desired characteristics or parameters of the object being imaged. The output from CPU 238 is temporarily stored in an image line buffer 242 that enables the image to be displayed or otherwise recorded for later analysis.
FIGURE 16 illustrates a practical application of the present invention for identifying a male cell 200 and a female cell 208 and for producing their corresponding scatter images 212 and 220. Male cell 200 includes a nucleus 202 that has been stained with a yellow fluorescent dye. In addition, a FISH probe 204 produces a fluorescent orange emission, indicating the presence of an X-chromosome in the nucleus, while a FISH probe 206 produces red fluorescence emission, indicating the presence of a Y-chromosome. Spectral decomposition of the fluorescence emissions from male cell 200, when the cell is illuminated with light from a green laser, results in a series of images on TDI detector 44, separated as a function of the wavelength of the light that is imaged. Laser light that is incident on the cells has an extremely narrow waveband, and image 212 of male cell 200 produced by laser scatter is only slightly convoluted by the spectral decomposition process. Green laser scatter image 212 of cell 200 and its nucleus 202 appear on the left side of the TDI detector, while a fluorescent spot 214 corresponding to the yellow fluorescence emitted by nucleus 202 appears in the next few columns on the TDI detector. Furthermore, as a function of the different wavelengths of the fluorescence emitted by FISH probes 204 and 206, FISH spots 216 and 218 appear at locations spaced apart on the detector, but slightly blurred across the columns of TDI detector 44 due to the widths of their respective emission spectra. By analyzing the signals produced by the TDI detector, the FISH probes responsive to X and Y chromosomes are detected, enabling the user to determine that ceU 200 is a male ceU, since it includes both the X and Y chromosome. Similarly, female cell 208, when spectrally decomposed, also includes the characteristic yellow fluorescence of nucleus 210, but unlike the male cell, includes two FISH spots 216 corresponding to FISH probes 204, which indicates the presence of two X-chromosomes. Because TDI detector 44 also distinguishes the spatial position of male cell 200 and female cell 208, the corresponding spectral decompositions for these cells are readily separately resolved as both cells pass through the imaging system in the direction indicated by the arrow to the lower left of FIGURE 16. Again, it should be noted that a deconvolution can be apphed to the signal produced by TDI detector 44 to provide better resolution of the corresponding FISH spots that are illustrated. Non-Distorting Spectral Dispersion Systems
The present invention can be provided with a spectral dispersion filter assembly that does not convolve the image with the emission spectra of the light forming the image, thereby eliminating the need for deconvolution of the emission spectra from the image. FIGURE 17 illustrates a seventh preferred embodiment of the invention corresponding to such a non-distorting spectral dispersion system 250 that employs a five color stacked wedge spectral dispersing filter assembly 252. This seventh embodiment is substantially similar to the embodiment shown in FIGURES 1, 2, and 3, except that spectral dispersing prism element 36 (of FIGURES 1, 2 and 3) is replaced by spectral dispersing filter assembly 252. The spectral dispersing filter assembly splits the light into a plurality of hght beams having different bandwidths. Each light beam thus produced is directed at a different nominal angle so as to fall upon a different region of TDI detector 44. The nominal angular separation between each bandwidth produced by the spectral dispersing filter assembly 252 exceeds the field angle of the imaging system in object space thereby preventing overlap of the field images of various bandwidths on the detector.
Spectral dispersing filter assembly 252 comprises a plurality of stacked dichroic wedge filters, including a red dichroic filter R, an orange dichroic filter O, a yellow dichroic filter Y, a green dichroic filter G, and a blue dichroic filter B. Red dichroic filter R is placed in the path of collected light 34, oriented at an angle of approximately 44.0° relative to an optic axis 253 of collection lenses 32a and 32b. Light of red wavelengths and above, i.e., > 640 nm, is reflected from the surface of red dichroic filter R at a nominal angle of 1°, measured counter-clockwise from a vertical optic axis 257. Example spectral reflectance characteristics R' of red dichroic filter R are plotted in FIGURE 18, along with example spectral reflectance characteristics corresponding to the other dichroic filters used in spectral dispersing filter assembly 252. In FIGURE 18, O' indicates the spectral reflectance characteristics of orange dichroic filter O, Y' indicates the spectral reflectance characteristics of yellow dichroic filter Y, etc. The hght reflected by red dichroic filter R leaves spectral dispersing filter assembly 252 and passes through imaging lenses 40a and 40b, which cause the hght to be imaged onto a red light receiving region of TDI detector 44, which is disposed toward the right end of the TDI detector, as shown in FIGURE 17.
Orange dichroic filter O is disposed a short distance behind red dichroic filter R and is oriented at an angle of 44.5 degrees with respect to optic axis 253. Light of orange wavelengths and greater, i.e., > 610 nm, is reflected by orange dichroic filter O at a nominal angle of 0.5° with respect to vertical optic axis 257. Because the portion of collected hght 34 comprising wavelengths longer than 640 nm was already reflected by red dichroic filter R, the light reflected from the surface of orange dichroic filter O is effectively bandpassed in the orange colored region between 610 nm and 640 nm. This light travels at a nominal angle of 0.5° from vertical optic axis 257, and is imaged by imaging lenses 40a and 40b so as to fall onto an orange light receiving region disposed toward the right hand side of TDI detector 44 between a center region of the TDI detector and the red light receiving region, again as shown in FIGURE 17.
Yellow dichroic filter Y is disposed a short distance behind orange dichroic filter O and is oriented at an angle of 45° with respect to optic axis 253. Light of yellow wavelengths, i.e., 560 nm and longer, is reflected from yellow dichroic filter Y at a nominal angle of 0.0° with respect to vertical optic axis 257. Wavelengths of hght reflected by yellow dichroic filter Y are effectively bandpassed in the yellow region between 560 nm and 610 nm and are imaged by imaging lenses 40a and 40b near vertical optic axis 257 so as to fall on a yellow light receiving region toward the center of TDI detector 44.
In a manner similar to dichroic filters R, O, and Y, dichroic filters G and B are configured and oriented so as to image green and blue light wavebands onto respective green and blue light receiving regions of TDI detector 44, which are disposed toward the left-hand side of the TDI detector. By stacking the dichroic filters at different predefined angles, spectral dispersing filter assembly 252 collectively works to focus light within predefined wavebands of the light spectrum onto predefined regions of TDI detector 44. Those of ordinary skill in the art will appreciate that the filters used in the spectral dispersing filter assembly 252 may have spectral characteristics that differ from those described above and in FIGURE 18. Further, the spectral characteristics may be arbitrary and not limited to dichroic in order to achieve the desired dispersion characteristics.
The wedge shape of the dichroic filters in the preceding discussion allows the filters to be placed in near contact, in contact or possibly cemented together to form the spectral dispersing filter assembly 252. The angle of the wedge shape fabricated into the substrate for the dichroic filter allows easy assembly of the spectral dispersing filter assembly 252, forming a monolithic structure in which the wedge-shaped substrate is sandwiched between adjacent dichroic filters. If the filters are in contact with each other or cemented together, the composition of the materials that determine the spectral performance of the filter may be different from those which are not in contact. Those of ordinary skill in the ait will appreciate that flat, non wedge-shaped substrates could be used to fabricate the spectral dispersing filter assembly 252. In this case another means such as mechanically mounting the filters could be used to maintain the angular relationships between the filters. In addition to the foregoing configuration, non-distorting spectral dispersion system 250 may optionally include a detector filter assembly 254 to further attenuate undesired signals in each of the light beams, depending upon the amount of rejection required for out-of-band signals. FIGURE 19 illustrates the constraction of an exemplary detector filter 254 corresponding to the five color bands discussed above and includes a blue spectral region 256, a green spectral region 258, a yellow spectral region 260, an orange spectral region 262, and a red spectral region 264, all of which are disposed side-by-side, as shown in the Figure. The corresponding spectral characteristics of the blue, green, yellow, orange, and red spectral regions or wavebands are respectively shown in FIGURES 20A-20E. The detection filter assembly shown in FIGURE 19 may be constructed by cementing separate filters in side-by-side arrangement on a common substrate or by other means well known to those or ordinary skill in the art. Additionally, the ordinary practitioner in the art will understand that the filter may alternatively be placed at an intermediate image plane, instead of directly in front of TDI detector 44. In the embodiment shown in FIGURE 17, light may pass through each dichroic filter in the spectral dispersing filter assembly 252 twice before exiting spectral dispersing filter assembly 252. This condition will further attenuate out-of-band signals, but will also attenuate in-band signals. FIGURE 21 illustrates an eighth embodiment of the present invention in which the light does not pass through another dichroic filter after reflection. In this embodiment, a plurality of cube dichroic filters, including a red cube filter 266, a yellow cube filter 268, a green cube filter 270, and a blue cube filter 272 are spaced apart sufficiently to ensure that light does not pass through any of the cube filters more than once. As with the embodiment of FIGURE 17, the cube dichroic filters are oriented at appropriate angles to image light within a predefined bandwidth to distinct regions on a TDI detector 274. As the hght is reflected from each of cube dichroic filters 266, 268, 270 and 272, it is directed toward imaging lenses 40a and 40b, and different bandpass portions of the light are focussed upon corresponding red, yellow, green, and blue hght receiving segments or regions defined on a hght receiving surface of TDI detector 274. If desired, an optional detector filter assembly 276 of similar construction to detector filter assembly 254 (but without the orange spectral region) may be used to increase the rejection of out-of-band signals. It should be apparent to those skilled in the art that separate spaced apart plate, or pelhcal elements could also be used in this application instead of the cube filters. In the eight embodiment illustrated in FIGURE 21, the image lenses 40a and 40b must be placed a sufficient distance away from the plurality of cube filters to minimize the clear aperture requirement for lenses 40a and 40b. Those skilled in the art will appreciate the clear aperture in the plane orthogonal to the page can increase as the distance between the lenses and plurality cube filters increases. Therefore, the placement of lenses 40a and 40b must be chosen to appropriately accommodate the clear aperture in both planes.
The foregoing descriptions of the seventh and eighth preferred embodiments illustrate the use of four and five color systems. Those skilled in the art will appreciate that a spectral dispersing component with more or fewer filters may be used in these configurations in order to construct a system covering a wider or a narrower spectral region, or different passbands within a given spectral region. Likewise, those skilled in the art will appreciate that the spectral resolution of the present invention may be increased or decreased by appropriately choosing the number and spectral characteristics of the dichroic and or bandpass filters that are used. Furthermore, those skilled in the art will appreciate that the angles or orientation of the filters may be adjusted to direct light of a given bandwidth onto any desired point on the TDI detector. In addition, there is no need to focus the hght in increasing or decreasing order by wavelength. For example, in fluorescence imaging applications, one may wish to create more spatial separation on the TDI detector between the excitation and emission wavelengths by changing the angles at which the filters corresponding to those wavelengths are oriented with respect to the optic axes of the system. Finally, it will be clear to those skilled in the art that dispersion of the collected hght may be performed on the basis of non-spectral characteristics, including angle, position, polarization, phase, or other optical properties.
As with the earlier embodiments discussed above, many applications of the seventh and eighth preferred embodiments will require that one or more light sources be used to provide light that is incident on the object being imaged. Accordingly, various light sources disposed at different positions, such as those shown in FIGURES 5-7 and discussed above, may be used to enhance the image quality produced by each of these embodiments. For clarity and to simplify the explanation of these embodiments, the light sources have been omitted in FIGURES 17 and 21; however, it will be recognized by those skilled in the art how such hght sources may be employed in these embodiments, based on the previous discussion of the use of the hght sources with respect to the earlier embodiments.
FIGURE 22 illustrates the distribution of images on TDI detector 44 corresponding to imaging a plurality of cells 200 when using non-distorting spectral dispersion system 250. As will be evident by comparing FIGURE 22 to FIGURE 16, the resultant images on the TDI detector are similar in many ways. However, when using the non-distorting spectral dispersion system, there is no image broadening as is seen in FIGURE 22, which would otherwise result due to the convolution of the emission spectram and the object. Instead, all wavelengths within the predefined bandwidth of each dichroic filter are reflected from the filter at the same nominal angle, so image components that fall within that passband suffer no positional distortion on the detector. The field angle orthogonal to flow in object space is also indicated on FIGURE 22. In this particular configuration, the field angle in object space is less than +/- 0.25°. Those skilled in the art will appreciate that the field angle can be made larger or smaller. To the extent that the field angle is made larger, for example, to image cells over a wider region on a shde or in a broad flat flow, the field angle at the detector will increase in proportion to the number of colors used. Those skilled in the art will appreciate that broad flat flow can easily be created using commercially available flow cells as shown in FIGURE 25, which incorporates containing flow cell 306. Flow cell 306 has a cross section that is elongated in an axis perpendicular to both the flow and optical axes. The generation of a broad flat flow is discussed in many references, including U.S. Patent No. 5,422,712. Use of flow cell 306 enables a broad flat flow to be achieved, hi embodiments incorporating flow cell 306, or other means to provide a broad flat flow, preferably the field angle in increased by an amount that is sufficient to enable any objects entrained in such a broad flat flow to be imaged and that image captured by a detector. Thus as a width of a flow volume increases, the field angle also must increase in a proportional fashion, to ensure all objects in that flow volume can be imaged as they pass through the field of view. FIGURE 22 illustrates the image projected onto the detector when three cells 280, 282 and 284 are flowing through the field of view. Light scatter images of cells 280, 282, and 284 are seen on the left hand side of the detector denoted as the BLUE area. Images of cell nuclei 202 stained with a green fluorescent dye are seen in the GREEN area of the detector. Three differently-colored genetic probes 204, 205, and 206 are also employed for the analysis of the sex chromosomes within the cells. Probe 204 stains the X chromosome with an orange fluorescing dye, probe 205 stains the Y chromosome with yellow fluorescing dye, and probe 206 stains the inactive X chromosome in female cells with a red fluorescing dye. Cell 282 is imaged onto the detector as shown in FIGURE 22. An image 286 of probe 204 from cell 282 is seen in the ORANGE area of the detector. Likewise an image 288 of probe 205 is seen in the YELLOW area of the detector. The signal on the detector is processed to determine the existence and position of these images on the detector to determine that cell 282 is a male cell, h a similar manner, cells 280 and 284 contain probes 204 and 206, which create images 290 and 292 in the ORANGE area of the detector, and images 294 and 296 in the RED area of the detector, indicating that these cells are female, respectively.
Multiple TDI Detector Embodiments of Non-Distorting Spectral Dispersing Systems
Alternate embodiments of the present invention utilizing multiple detectors for spectral dispersing and imaging are illustrated in FIGURES 25, 26 and 28. Spectral decomposition is implemented using dichroic filters, generally as described above. However, as illustrated in FIGURE 25, separate imaging lenses and detectors are used for each spectral region. Dichroic filters 301- 305 are disposed in infinite space with respect to the object from which light is being spectrally decomposed to minimize optical aberrations. After each dichroic filter, separate imaging lenses 311- 315 are used to form an image of the object onto corresponding detectors 321- 325. In this configuration, each detector has fewer pixels than in the embodiments described above, enabling the present embodiments to operate at high pixel line rates. The images projected on each detector appear as shown on one zone of the detector illustrated in FIGURE 17. The images on the detector configured to receive hght in the red portion of the spectrum appear like those in the right-most zone of FIGURE 17.
The embodiments shown in FIGURES 25, 26 and 28 have an advantage in optical efficiency over other embodiments, because the light from the object only passes through each dichroic filter once. A further advantage of the multiple detector embodiments is that each detector can be focused independently for each color, thereby simplifying the optical design by removing constraints on longitudinal color correction. A still further advantage is that the quantum efficiency of each detector can be individually optimized for its particular color band. Those of ordinary skill in the art will readily recognize that such optimization can be accomplished through doping of the semiconductor materials utilized in the detector. When multiple imaging lenses are employed, as shown in FIGURE 25, one or more lenses (as exemplified by lens 311), may have a different focal length, thereby enabling simultaneous image collection with differential magnifications. In this case, the clock rate on detector 321 will be proportionally higher to maintain synchronization, which is expected to be useful when one channel is used with a higher magnification for brightfield image collection, to more accurately analyze morphological detail. The configuration shown in FIGURE 25 also allows channel independent control of numerical aperture, as illustrated by the disposition of optional aperture stop 330. It should be noted that an object plane 348a as shown in FIGURE 25 is larger than object planes 348 illustrated in other Figures, due to the characteristics of flow cell 306. As noted above, flow cell 306 enables a broad flat flow to be achieved, such that multiple objects passing through object plane 348a simultaneously can be imaged simultaneously, as long as each image covers a sufficiently large field angle. When systems of the present invention are used in conjunction with such a broad flat flow, the field angle needs to be matched to the size of the object plane (such as object plane 348a) so that the images produced encompasses substantially all of the object plane. Note that the object plane is defined by the perimeter of the fluid channel employed.
FIGURE 26 illustrates another embodiment of the multiple detector approach. While similar to the embodiment illustrated in FIGURE 25, the embodiment of FIGURE 26 has the advantage of reducing the number of imaging lenses required to project an image upon the detectors, hi the embodiment of FIGURE 26, an image lens 340 is placed before dichroic filters 345- 347. Those skilled in the art will appreciate that the functions of collection lens 32 and image lens 340 can be carried out by a single element. Detectors 341- 344 are placed at the appropriate positions along the optical path to image an object plane 348 on the surface of each detector. Detectors 341 - 343 are placed in a path of light from the object that is reflected off dichroic filters 345, 346 and 347, while detector 344 is placed in a path of hght from the object transmitted through dichroic filter 347. The filters are disposed in convergent space with respect to the image of the object and therefore each filter, depending upon its design, may impart astigmatism, coma, spherical, and chromatic aberration into the imagery at each downstream detector. Progressively, more of each of these aberrations are added by each subsequent filter. In a typical implementation of the present invention, the numerical aperture (i.e., the product of the index of refraction and the sine of the half cone angle of iUumination) in the filter space is approximately 0.03. Therefore, if cube substrates are employed for the dichroic filters, coma and astigmatism are neghgible, while spherical aberration is substantially eliminated, being less than 0.15 waves peak. Longitudinal chromatic aberration is effectively canceled by moving the detectors to the plane of best focus for their respective color band. Pellicles can also be used in place of the cubes for the substrates of the dichroic filters, with excellent theoretical optical performance.
If plate substrates are employed for dichroic filters 345-347, then astigmatism dominates the aberrations. Astigmatism is imparted in the transmitted wavefront through a plate dichroic filter, but can effectively be cancelled by inserting a clear correction plate 360, as shown in FIGURE 27, of approximately the same thickness, incident angle, and glass type. However, correction plate 360 must be rotated 90 degrees about axis Z with respect to dichroic filter 361. Correction plate 360, and dichroic filter 361 impart an equal but opposite amount of astigmatism in the transmitted wavefront, thereby canceling each other. Therefore, light striking detector 342 is free of astigmatism. This configuration leaves a small amount of residual coma. Yet, the optical performance is very close to the diffraction limit. Those of ordinary skill in the art will appreciate that the correction plate can be placed in many alternative positions, with adjustments in its thickness, material, and/or angle, relative to the propagation of the hght. Any of the non-distorting spectral dispersing embodiments can be constructed using an additional objective lens 48 and sht 52, to form a confocal stop arrangement as shown in FIGURE 26. FIGURE 28 illustrates an embodiment similar to FIGURE 25 using multiple imaging lenses, however, the majority of detectors are place in the transmission path of dichroic filters. Either of the multiple detector embodiments may constructed such that the detectors receive hght transmitted through the dichroic filters, reflected by the dichroic filters or in a combination of transmission and reflection as illustrated in both FIGURES 26 and 28. Wide-Field Decomposition Imaging
By using a segmented TDI detector 300, as shown in FIGURE 24, the present invention can be used to image wide fields of view to increase throughput. In this manner, ceUs or other objects may be oriented side-by-side such as may be found in broad flat flow, or on microscope slides and microtiter plates. This configuration enables more objects to be imaged simultaneously than could otherwise be possible if objects were aligned in a single file orientation.
FIGURE 23 illustrates an embodiment of the present invention that facilitates imaging of a wide field. In FIGURE 23, motion of a substrate 73 is generally parallel or aligned with an axis of spectral decomposition provided by dichroic element 252. Optional epi illuminator 60a, which may comprise a laser or other type of illumination source, can be used to illuminate objects carried on substrate 73, while there is relative movement between the substrate and the imaging system in the direction of the double-headed arrow. Optionally, another illuminator 60b is provided to provide bright field illumination of the objects on the substrate with hght reflected from a reflective surface 77. Light from the objects on substrate 73 passes through a lens 71, is reflected from a reflective surface 69, passes through a dichroic (or partially reflective) mirror 67 and is focussed on a slit 55 by a lens 57. Collection lens 32 collimates the light from the slit and directs the light onto dichroic element 252, which spectrally disperses the light passing through lens 40 and onto different regions of detector 44.
Segmented detector 300 (FIGURE 24) is used for detector 44 in FIGURE 23, and spectral dispersing filter assembly 252 is oriented to decompose light in an axis parallel to the movement of the image across detector 44. As noted above, the field of view of substrate 73 in FIGURE 23 may be illuminated in bright field with bright field illuminator 60b or with epi-illumination by illuminator 60a. In either case the iUuminated field of view, when imaged by the optical system, is equivalent in size to one segment of detector 300.
As discussed previously, when spectral dispersing filter assembly 252 is employed, light is split into a plurality of light beams each having a different bandwidth. Each hght beam thus produced is directed at a different nominal angle so as to fall upon a different segment of detector 300. The nominal angular separation between each bandwidth produced by spectral dispersing filter assembly 252 exceeds the field angle of the imaging system in object space, thereby preventing overlap of the field images of various bandwidths on the detector. Therefore, each detector segment sees the same field of view, however, each segment sees hght composed of a different spectral bandwidth. Slit 55 may be provided to eliminate any stray hght from outside the intended field of view from passing through the system and landing on an inappropriate zone of detector 300.
In the illustrated embodiment, segmented detector 300 comprises four segments or zones 302a-302d, each zone receiving light of a different characteristic. The detector is segmented into these zones such that the charge corresponding to an incident image flows across a segment in concert with the image movement across that segment The charge is then read out of the segment and not permitted to enter an adjacent segment or zone where hght of a different characteristic is imaged. Optionally, the charge corresponding to an image received by each zone is integrated over a length of the zone and readout from the tap provided for the zone. Also, optionally, the rate at which the charge is readout from each zone is independently controllable. In summary, this last embodiment of the present invention enables a wide field of view to be imaged and decomposed onto the detector such that light of multiple characteristics can be simultaneously collected and analyzed.
Although the present invention has been described in connection with the preferred form of practicing it, those of ordinary skill in the art will understand that many modifications can be made thereto within the scope of the claims that follow. Accordingly, it is not intended that the scope of the invention in any way be limited by the above description, but instead be determined entirely by reference to the claims that follow.

Claims

The invention in which an exclusive right is claimed is defined by the foUowing:
1. An imaging system adapted to determine one or more characteristics of an object from an image of the object while there is relative movement between the object and the imaging system, comprising:
(a) a collection lens disposed so that light from the object passes through the collection lens and travels along a collection path;
(b) at least one image lens disposed to receive light that has passed through the collection lens, thereby producing an image that is directed toward a predetermined location;
(c) a plurality of hght reflecting elements disposed to receive light that has passed through the collection lens, each light reflecting element reflecting light of a predefined characteristic along a different reflected light path, and passing light that does not have that characteristic, such that light from the object passes through each light reflecting only once; and
(d) a plurality of time delay integration (TDI) detectors, disposed such that for each light reflecting element, a TDI detector is positioned to receive an image of the object from one of reflected and transmitted light from that light reflecting element, each TDI detector producing an output signal that is indicative of at least one characteristic of the object, each TDI detector producing the output signal by integrating light from at least a portion of the object over time, while the relative movement between the object and the imaging system occurs.
2. The imaging system of Claim 1, wherein said at least one image lens is disposed in said collection path, between said collection lens and said plurality of light reflecting elements, and wherein lengths of an optical path between each of said plurality of detectors and said imaging lens are substantially equal.
3. The imaging system of Claim 2, wherein said at least one image lens and said collection lens are the same optical element.
4. The imaging system of Claim 1, wherein said at least one image lens comprises a separate image lens for each one of said plurality of hght reflecting elements, each separate image lens being disposed between one of said plurality of light reflecting elements and a corresponding one of said plurality of detectors.
5. The imaging system of Claim 1, wherein each of the plurality of light reflecting elements comprises a dichroic filter.
6. The imaging system of Claim 1, wherein each dichroic filter comprises a cube substrate.
7. The imaging system of Claim 6, wherein a numerical aperture associated with each cube substrate is sufficiently small so as to substantially eliminate spherical aberration.
8. The imaging system of Claim 1, wherein each dichroic filter comprises a pellical.
9. The imaging system of Claim 1, wherein each dichroic filter comprises a plate substrate.
10. The imaging system of Claim 9, further comprising a plurality of correction plates, each correction plate being disposed between a preceding light reflecting element and a TDI detector and oriented relative to an immediately preceding light reflective element such that any astigmatism imparted by said immediately preceding light reflective element is substantially eliminated.
11. The imaging system of Claim 10, wherein the correction plates are each rotated about an axis substantially orthogonal to an axis about which said immediately preceding light reflective element is rotated, both of said axes orthogonal to an axis defining the collection path.
12. The imaging system of Claim 1, wherein said predefined characteristic comprises a specific waveband of light received from the object, and each separate TDI detector is focused for a specific different waveband of light, such that each separate TDI detector is properly focused for a specific waveband of light directed toward that TDI detector by a corresponding reflecting element, by one of transmission and reflection.
13. The imaging system of Claim 1, wherein a quantum efficiency of each separate TDI detector is independently optimized for said predefined characteristic associated with a specific reflecting element directing light toward that TDI detector.
14. The imaging system of Claim 1, further comprising an aperture stop disposed between a light reflecting element and a corresponding TDI detector, said aperture stop enabling control of a numerical aperture associated with said image projected upon the corresponding TDI detector.
15. The imaging system of Claim 1, further comprising an objective lens and an imaging slit disposed along said light collection path, between said object and said collection lens.
16. The imaging system of Claim 1, further comprising a light source that is disposed to provide an incident light that illuminates the object.
17. The imaging system of Claim 16, wherein the light source illuminates the object with a bright field.
18. The imaging system of Claim 1, further comprising a substrate on which the object is disposed.
19. An imaging system for determining one or more characteristics of an object from an image of the object while there is relative movement between the object and the imaging system, comprising: (a) a collection lens disposed so that light from the object passes through the collection lens and travels along a collection path;
(b) a plurality of light reflecting elements disposed in the collection path to receive light that has passed through the collection lens, each hght reflecting element reflecting light of a different predefined characteristic along a different reflected light path, and passing light that does not have said different predefined characteristic, such that light from the object passes through each light reflecting only once;
(c) a plurality of imaging lenses disposed such that for each light reflecting element, at least one imaging lens is positioned to receive one of reflected and transmitted light from that light reflecting element, thereby producing an image, each image projected by each of the plurality of imaging lens being directed toward a different predetermined location; and
(d) a plurality of time delay integration (TDI) detectors disposed such that for each imaging lens, a TDI detector is positioned to receive an image of the object from, each detector producing an output that is indicative of a different characteristic of the object, each TDI detector producing the output signal by integrating light from at least a portion of the object over time, while the relative movement between the object and the imaging system occurs.
20. The imaging system of Claim 19, wherein each of the plurality of light reflecting elements comprises a dichroic filter.
21. The imaging system of Claim 19, wherein said predefined characteristic comprises a specific waveband of light, and each TDI detector is separately focused for a specific waveband of light, such that each TDI detector is properly focused for a specific waveband of light directed toward said TDI detector by a corresponding reflecting element.
22. The imaging system of Claim 19, wherein a quantum efficiency of each TDI detector is independently optimized for said predefined characteristic associated with a specific reflecting element directing light toward said TDI detector.
23. The imaging system of Claim 19, wherein at least one of said plurality of imaging lenses has a focal length differing from another of said plurality of imaging lenses, such that at least one of said plurality of imaging lenses generates a first image having a magnification that is different than a second image generated by another of said plurality of imaging lenses.
24. The imaging system of Claim 23, wherein each detector of said plurality of detectors receiving an image having a different magnification than images received by other TDI detectors of said plurality of detectors is clocked at a rate that maintains synchronization with the movement of the image projected upon said other TDI detector.
25. The imaging system of Claim 19, further "comprising an aperture stop disposed between a light reflecting element and a corresponding TDI detector, said aperture stop enabling control of a numerical aperture associated with said image projected upon corresponding TDI detector.
26. The imaging system of Claim 19, further comprising an objective lens and an imaging slit disposed along said light collection path between said object and said collection lens.
27. The imaging system of Claim 19, wherein the plurality of light reflecting elements each reflect light in a direction substantially orthogonal to a direction of the relative movement between the object and the imaging system.
28. The imaging system of Claim 19, wherein the plurality of light reflecting elements each reflect light in a direction substantially aligned with a direction of the relative movement between the object and the imaging system.
29. The imaging system of Claim 19, wherein the light from the object comprises at least one of an unstimulated emission from the object, light reflected by the object, scattered light from the object, and a stimulated emission from the object.
30. The imaging system of Claim 19, further comprising a hght source that is disposed to provide an incident light that illuminates the object.
31. An imaging system for determining one or more characteristics of an object from an image of the object while there is relative movement between the object and the imaging system, comprising:
(a) at least one optical element disposed to receive light from the object, producing an image that is directed along a predetermined path;
(b) a plurality of spaced-apart light reflecting elements disposed along said predetermined path, each light reflecting element reflecting light of a different predefined characteristic along a different reflected light path and passing light that does not have said predefined characteristic, such that light from the object passes through each light reflecting only once; and
(c) a plurality of detectors disposed such that for each light reflecting element, a different one of the plurality of detectors receives said image via one of reflected and transmitted light from said light reflecting element, each detector producing an output that is indicative of at least one characteristic of the object, a length of an optical path between each of said plurality of detectors and the at least one optical element producing and image being substantially equal.
32. The imaging system of Claim 31, wherein each of the plurality of light reflecting elements comprises a dichroic filter.
33. The imaging system of Claim 32, wherein each dichroic filter comprises one of a cube substrate, a pellical, and a plate substrate.
34. The imaging system of Claim 33, wherein a numerical aperture associated with each cube substrate is sufficiently small so as to substantially ehminate spherical aberration.
35. The imaging system of Claim 31, further comprising a plurality of correction plates, each correction plate being disposed between a light reflecting element and a corresponding detector, and oriented relative to an immediately preceding light reflective element, such that any astigmatism imparted by said immediately preceding light reflective element is substantially eliminated.
36. The imaging system of Claim 35, wherein the plurality of correction plates are each rotated about an axis substantially orthogonal to an axis about which said immediately preceding light reflective element is rotated, both of said axes being orthogonal to an axis defining the collection path.
37. The imaging system of Claim 31, wherein each of the plurality of detectors comprises a time delay and integration (TDI) detector.
38. The imaging system of Claim 37, wherein said predefined characteristics comprise a specific waveband of light, and each TDI detector is separately focused for a specific waveband of light directed toward said TDI detector by a corresponding reflecting element, through one of transmission and reflection.
39. The imaging system of Claim 31 , further comprising an objective lens and an imaging slit disposed along said light collection path between said object and said collection lens.
40. The imaging system of Claim 31, further comprising a light source that is disposed to provide an incident light that illuminates the object.
41. An imaging system for determining one or more characteristics of an object from an image of the object while there is relative movement between the object and the imaging system, comprising:
(a) a collection lens disposed so that light from the object passes through the collection lens and travels along a collection path;
(b) a plurality of light reflecting elements disposed in the collection path, each light reflecting element reflecting light of a different predefined characteristic along a different reflected light path, and passing light that does not have said different predefined characteristic, such that light from the object passes through each light reflecting only once;
(c) a plurality of imaging lenses disposed such that for each light reflecting element, at least one imaging lens is positioned to receive one of reflected and transmitted hght from that light reflecting element, thereby producing an image, each image projected by each of the plurality of imaging lens being directed toward a different predetermined location; wherein at least one of said plurality of imaging lenses has a focal length differing from another of said plurality of imaging lenses, such that at least one of said plurality of imaging lenses generates a first image having a magnification that is different than a second image generated by another of said plurality of imaging lenses; and (d) a plurality of detectors disposed such that for each imaging lens, a detector is positioned to receive an image projected by a different imaging lens, each detector producing an output that is indicative of a different characteristic of the object, while the relative movement between the object and the imaging system occurs.
42. A method for determining one or more characteristics of a moving object from a plurality of images of the object, while there is relative movement between the object and the imaging system, based upon hght from the object, comprising the steps of:
(a) focussing the hght from the object along a collection path that is in a different direction than the relative movement between the object and the imaging system;
(b) imaging the object using the focussed hght;
(c) at each of a plurality of successive points disposed along the collection path, reflecting light of a predefined characteristic, and passing light that does not have said predefined characteristic, a different predefined characteristic being associated with each of the plurality of points so that light of the different predefined characteristic is reflected from each successive point in a direction different from that at other points;
(d) receiving one of the light that was reflected and the light that was transmitted at each successive point with a separate one of a plurality of time delay integration (TDI) detectors, each TDI detector producing an output signal in response thereto; and
(e) analyzing the output signal from each TDI detector to determine at least one characteristic of the object.
43. The method of Claim 42, further comprising the step of controlling distances between each of the plurality of (TDI) detectors and a corresponding lens used to produce said image, such that the distances are substantially equal.
44. The method of Claim 42, further comprising the step of optically correcting light reflected at each of said plurality of successive points, before such reflected light is received at a detector.
45. The method of Claim 44, wherein the step of optically correcting light reflected at each of said plurality of successive points comprises the step of substantially eliminating astigmatism and coma.
46. The method of Claim 44, wherein the step of optically correcting light reflected at each of said plurality of successive points comprises the step of imparting an equal but opposite level of astigmatism after each successive point, to cancel out a level of astigmatism introduced at that successive point.
47. The method of Claim 46, wherein the step of imparting an equal but opposite level of astigmatism after each successive point comprises the steps of utilizing a correction plate disposed after each successive point, each correction plate being oriented substantially orthogonal to an element disposed at each success point that reflects light of the predefined characteristic.
48. The method of Claim 42, wherein the step of reflecting light in different directions comprises the step of reflecting the light in a specific direction based on a spectral content of the light that is thus reflected.
49. The method of Claim 42, further comprising the step of attenuating light reflected from each successive point that does not have the predefined characteristic associated with the successive point in the optical path from which the light was reflected.
50. The method of Claim 49, wherein the step of attenuating comprises the step of filtering so that only light having the predefined characteristic associated with the successive point from which the light was reflected is allowed to pass to the detector.
51. The method of Claim 42, wherein the step of focussing comprises the step of collimating the light traveling along the optical path prior to producing the image of the object from the focussed light.
52. The method of Claim 42, wherein the step of imaging the object using the focused light comprises the step of employing an image lens to produce an image of the object using focused light, and directing that image to each successive point.
53. The method of Claim 42, wherein the step of imaging the object using the focused light comprises the steps of employing an image lens for each successive point, such that at each successive point, an image is produced from focused light that is reflected at that successive point, that image being directed one of the plurality of detectors that is associated with that successive point.
54. A method for determining one or more characteristics of a moving object from a plurality of images of the object, while there is relative movement between the object and the imaging system, comprising the steps of:
(a) focussing the light from the object along a collection path that is in a different direction than the relative movement between the object and the imaging system;
(b) at each of a plurality of successive points disposed along the collection path, reflecting light of a predefined characteristic, and passing light that does not have the predefined characteristic, a different predefined characteristic being associated with each of the plurality of successive points so that light of a different one of the predefined characteristics is at least one of reflected from each successive point in a direction different from that at other points and transmitted from each successive point in a direction different from that at other points; (c) producing an image of the object from light that is one of reflected and transmitted at each successive point, and directing said image toward a different one of a plurality of separate time delay integration (TDI) detectors;
(d) receiving the image from light that was reflected at each successive point with one of the plurality of TDI detectors, each TDI detector producing an output signal in response thereto; and
(e) analyzing the output signal from each detector to determine at least one characteristic of the object.
55. The method of Claim 54, further comprising the step of selecting at least one successive point, and producing an image from light that was one of reflected and transmitted at the successive point selected, using a magnification that is different than a magnification used to produce an image from light that was one of reflected and transmitted at other successive points.
56. The method of Claim 55, further comprising the step of controlling a clock rate associated with detectors receiving images having different magnifications, so that the plurality of detectors are synchronized to the images projected thereupon, regardless of a magnification of the image that is received.
57. The method of Claim 54, further comprising the step of controlling a numerical aperture associated with a lens employed to produce the image from light reflected from at least one successive point.
58. The method of Claim 57, wherein the step of controlling a numerical aperture comprises the step of disposing an aperture stop of an appropriate size between one of said successive points and a corresponding TDI detector.
59. The method of Claim 54, wherein the step of reflecting light in different directions comprises the step of reflecting the light in a specific direction based on a spectral content of the light that is thus reflected.
60. An imaging system adapted to determine one or more characteristics of an object entrained in a flow of fluid, from an image of the object while there is relative movement between the object and the imaging system, comprising:
(a) a fluid channel having a generally elongate cross section, such that said fluid channel directs said flow of fluid into a generally broad flat flow;
(b) a collection lens disposed so that light from the object entrained in fluid passes through the collection lens and travels along a collection path;
(c) at least one image lens disposed to receive light that has passed through the collection lens, thereby producing an image that is directed toward a predetermined location;
(d) a plurality of hght reflecting elements disposed to receive light that has passed through the collection lens, each hght reflecting element reflecting light of a predefined characteristic along a different reflected light path, and passing light that does not have that characteristic, such that light from the object passes through each light reflecting only once; and (e) a plurality of time delay integration (TDI) detectors, disposed such that for each light reflecting element, a TDI detector is positioned to receive an image of the object from one of reflected and transmitted light from that light reflecting element, each detector producing an output signal that is indicative of at least one characteristic of the object, said TDI detector producing the output signal by integrating light from at least a portion of the object over time, while the relative movement between the object and the imaging system occurs.
61. An imaging system for determining one or more characteristics of at least one object entrained in a flow of fluid, from an image of the at least one object, while there is relative movement between the at least one object and the imaging system, comprising:
(a) a fluid channel having a generally elongate cross section, such that said fluid channel directs said flow of fluid into a generally broad flat flow;
(b) a collection lens disposed so that light from the at least one object entrained in fluid passes through the collection lens and travels along a collection path;
(c) a plurality of light reflecting elements disposed in the collection path to receive light that has passed through the collection lens, each light reflecting element reflecting light of a different predefined characteristic along a different reflected light path, and passing light that does not have said different predefined characteristic, such that light from the object passes through each light reflecting only once;
(d) a plurality of imaging lenses disposed such that for each light reflecting element, at least one imaging lens is positioned to receive one of reflected and transmitted light from that light reflecting element, thereby producing an image, each image projected by each of the plurality of imaging lens being directed toward a different predetermined location; and
(e) a plurality of time delay integration (TDI) detectors disposed such that for each imaging lens, a TDI detector is positioned to receive an image of the at least one object, each detector producing an output that is indicative of a different characteristic of the at least one object, each TDI detector producing the output signal by integrating light from at least a portion of the at least one object over time, while the relative movement between the at least one object and the imaging system occurs.
62. An imaging system for determining one or more characteristics of at least one object entrained in a flow of fluid, from an image of the at least one object while there is relative movement between the at least one object and the imaging system, comprising:
(a) a fluid channel having a generally elongate cross section, such that said fluid channel directs said flow of fluid into a generally broad flat flow;
(b) at least one optical element disposed to receive light from the at least one object, producing an image that is directed along a predetermined path; (c) a plurality of spaced-apart light reflecting elements disposed along said predetermined path, each light reflecting element reflecting light of a different predefined characteristic along a different reflected light path and passing light that does not have said predefined characteristic, such that light from the object passes through each light reflecting only once; and
(d) a plurality of detectors disposed such that for each light reflecting element, a different one of the plurality of detectors receives said image via one of reflected and transmitted light from said light reflecting element, each detector producing an output that is indicative of at least one characteristic of the at least one object, a length of an optical path between each of said plurality of detectors and the east one optical element producing and image being substantially equal.
63. An imaging system adapted to determine one or more characteristics of an object entrained in a flow of fluid from an image of the object while there is relative movement between the object and the imaging system comprising:
(a) a fluid channel having a generally elongate cross section, such that said fluid channel directs said flow of fluid into a generally broad flat flow;
(b) a collection lens disposed so that light traveling from the object passes through the collection lens and travels along a collection path;
(c) a dispersing component disposed in the collection path so as to receive the light that has passed through the collection lens, dispersing the light into a plurality of separate light beams, each light beam being directed away from the dispersing component in a different predetermined direction;
(d) an imaging lens disposed to receive the light beams from the dispersing component, producing a plurality of images corresponding to each of the light beams, each image being projected by the imaging lens toward a different predetermined location; and
(e) a time delay integration (TDI) detector disposed to receive the plurality of images produced by the imaging lens, producing an output signal that is indicative of at least one characteristic of the object, said TDI detector producing the output signal by integrating hght from at least a portion of the object over time, while the relative movement between the object and the imaging system occurs.
EP01274071A 2000-10-12 2001-10-12 Imaging and analyzing parameters of small moving objects such as cells Ceased EP1334338A4 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US24012500P 2000-10-12 2000-10-12
US240125P 2000-10-12
US09/820,434 US6473176B2 (en) 1999-01-25 2001-03-29 Imaging and analyzing parameters of small moving objects such as cells
US820434 2001-03-29
PCT/US2001/042706 WO2002101339A2 (en) 2000-10-12 2001-10-12 Imaging and analyzing parameters of small moving objects such as cells

Publications (2)

Publication Number Publication Date
EP1334338A2 EP1334338A2 (en) 2003-08-13
EP1334338A4 true EP1334338A4 (en) 2008-03-19

Family

ID=26933159

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01274071A Ceased EP1334338A4 (en) 2000-10-12 2001-10-12 Imaging and analyzing parameters of small moving objects such as cells

Country Status (3)

Country Link
EP (1) EP1334338A4 (en)
JP (2) JP4018063B2 (en)
WO (1) WO2002101339A2 (en)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8406498B2 (en) 1999-01-25 2013-03-26 Amnis Corporation Blood and cell analysis using an imaging flow cytometer
US8131053B2 (en) 1999-01-25 2012-03-06 Amnis Corporation Detection of circulating tumor cells using imaging flow cytometry
US8885913B2 (en) 1999-01-25 2014-11-11 Amnis Corporation Detection of circulating tumor cells using imaging flow cytometry
JP2008524633A (en) * 2004-12-21 2008-07-10 セダーズ−シナイ メディカル センター Methods for drug screening and characterization by ion flux analysis
JP4982385B2 (en) * 2005-02-01 2012-07-25 アムニス コーポレイション Analysis of blood and cells using an imaging flow cytometer
US7528951B2 (en) * 2006-03-23 2009-05-05 Hach Company Optical design of a measurement system having multiple sensor or multiple light source paths
US7805020B2 (en) * 2006-07-25 2010-09-28 Itt Manufacturing Enterprises, Inc. Motion compensated image registration for overlaid/fused video
EP2201352B2 (en) 2007-09-28 2018-08-29 Illumina, Inc. Fluorescence excitation and detection system and method
DE202008003977U1 (en) * 2008-02-26 2009-07-02 Bürkert Werke GmbH & Co. KG microspectrometer
CN101650313B (en) * 2009-09-25 2011-08-17 开物科技股份有限公司 Optical fast detection reagent analyzer
JP5869347B2 (en) * 2011-02-03 2016-02-24 Hoya株式会社 Transmittance measuring apparatus and transmittance measuring method
WO2012135201A1 (en) * 2011-03-31 2012-10-04 Gnubio, Inc. Scalable spectroscopic detection and measurement
US8859990B2 (en) * 2011-04-21 2014-10-14 Massachusetts Institute Of Technology Highly compact multi-optical-junction optical flowcell and flexibly deployable optical sensing assemblies and systems for in-situ real-time spectroscopic measurements
US8772731B2 (en) * 2012-04-15 2014-07-08 Kla-Tencor Corporation Apparatus and method for synchronizing sample stage motion with a time delay integration charge-couple device in a semiconductor inspection tool
CN105008895B (en) * 2012-10-15 2019-02-15 纳诺赛莱克特生物医药股份有限公司 The system, apparatus and method of grain sorting
US9513206B2 (en) 2013-03-29 2016-12-06 Sysmex Corporation Particle measuring apparatus
CA2988263C (en) * 2014-06-03 2022-11-29 The Regents Of The University Of California Nanoparticle analyzer
JP6104475B2 (en) 2014-08-28 2017-04-05 シスメックス株式会社 Particle imaging apparatus and particle imaging method
KR102258807B1 (en) * 2015-02-24 2021-06-09 (주)미디어에버 Detection apparatus for micro dust and organism
WO2017066487A1 (en) * 2015-10-14 2017-04-20 Manta Instructions, Inc. Apparatus and method for measurements of growth or dissolution kinetics of colloidal particles
WO2017129390A1 (en) * 2016-01-25 2017-08-03 Plair Sa Method and device for detection and/or morphologic analysis of individual fluid-borne particles
US10585031B2 (en) * 2017-02-27 2020-03-10 Becton, Dickinson And Company Light detection systems and methods for using thereof
DE102017119284B4 (en) * 2017-08-23 2023-03-30 Markus Klotz particle sensor
CN110927126A (en) * 2018-09-20 2020-03-27 牛尾电机(苏州)有限公司 Fluorescence measurement container and fluorescence measurement device
WO2020083500A1 (en) * 2018-10-25 2020-04-30 Plair Sa Method and device for detection and/or measurement of impurities in droplets
US11281902B1 (en) 2019-06-19 2022-03-22 Imaging Business Machines Llc Document scanning system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4777525A (en) * 1985-12-23 1988-10-11 Preston Jr Kendall Apparatus and method for a multi-resolution electro-optical imaging, display and storage/retrieval system
USRE35868E (en) * 1991-11-20 1998-08-11 Toa Medical Electronics Co., Ltd. Apparatus for imaging particles in a liquid flow
US5900942A (en) * 1997-09-26 1999-05-04 The United States Of America As Represented By Administrator Of National Aeronautics And Space Administration Multi spectral imaging system
WO2000042412A1 (en) * 1999-01-11 2000-07-20 Softray, Inc. Improved flow cytometry apparatus and method

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02181632A (en) * 1989-01-06 1990-07-16 Hitachi Ltd Sheath flow cell
WO1992018850A1 (en) * 1991-04-10 1992-10-29 Mayo Foundation For Medical Education And Research Confocal imaging system for visible and ultraviolet light
EP0842412A1 (en) * 1995-08-01 1998-05-20 Medispectra Inc. Optical microprobes and methods for spectral analysis of materials
JP3808169B2 (en) * 1997-05-23 2006-08-09 株式会社ルネサステクノロジ Inspection method and apparatus, and semiconductor substrate manufacturing method
US6007775A (en) * 1997-09-26 1999-12-28 University Of Washington Multiple analyte diffusion based chemical sensor
JP4215397B2 (en) * 1998-05-14 2009-01-28 ルミネックス コーポレイション Multiple analyte diagnostic system
FR2784189B3 (en) * 1998-10-05 2000-11-03 Commissariat Energie Atomique BIOCHIP AND DEVICE FOR READING A BIOCHIP COMPRISING A PLURALITY OF MOLECULAR RECOGNITION AREAS
US6249341B1 (en) * 1999-01-25 2001-06-19 Amnis Corporation Imaging and analyzing parameters of small moving objects such as cells

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4777525A (en) * 1985-12-23 1988-10-11 Preston Jr Kendall Apparatus and method for a multi-resolution electro-optical imaging, display and storage/retrieval system
USRE35868E (en) * 1991-11-20 1998-08-11 Toa Medical Electronics Co., Ltd. Apparatus for imaging particles in a liquid flow
US5900942A (en) * 1997-09-26 1999-05-04 The United States Of America As Represented By Administrator Of National Aeronautics And Space Administration Multi spectral imaging system
WO2000042412A1 (en) * 1999-01-11 2000-07-20 Softray, Inc. Improved flow cytometry apparatus and method

Also Published As

Publication number Publication date
JP2004522163A (en) 2004-07-22
WO2002101339A2 (en) 2002-12-19
JP5160158B2 (en) 2013-03-13
WO2002101339A3 (en) 2003-05-01
JP4018063B2 (en) 2007-12-05
EP1334338A2 (en) 2003-08-13
JP2007263983A (en) 2007-10-11

Similar Documents

Publication Publication Date Title
US6608682B2 (en) Imaging and analyzing parameters of small moving objects such as cells
US6473176B2 (en) Imaging and analyzing parameters of small moving objects such as cells
US6211955B1 (en) Imaging and analyzing parameters of small moving objects such as cells
US6671044B2 (en) Imaging and analyzing parameters of small moving objects such as cells in broad flat flow
US6975400B2 (en) Imaging and analyzing parameters of small moving objects such as cells
JP5160158B2 (en) Imaging system and method
EP2024893B1 (en) A laser illumination system in fluorescent microscopy
CN105203507B (en) Telecentric wide-field fluorescence scanning imaging system and method
EP2637015A1 (en) Cell analyzer
US20030016882A1 (en) Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging
US11041756B2 (en) Method and apparatus of filtering light using a spectrometer enhanced with additional spectral filters with optical analysis of fluorescence and scattered light from particles suspended in a liquid medium using confocal and non confocal illumination and imaging
US20190353577A1 (en) Fast recompensation of flow cytometery data for spillover readjustments
CA2401614C (en) Imaging and analyzing parameters of small moving objects such as cells
US20230221178A1 (en) Apparatus and a method for fluorescence imaging
Basiji Multispectral imaging in flow: a technique for advanced cellular studies

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20030512

AK Designated contracting states

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: AMNIS CORPORATION

RBV Designated contracting states (corrected)

Designated state(s): CH DE FR GB LI NL SE

A4 Supplementary search report drawn up and despatched

Effective date: 20080220

RIC1 Information provided on ipc code assigned before grant

Ipc: G01N 21/64 20060101ALI20080214BHEP

Ipc: G01N 15/14 20060101AFI20080214BHEP

Ipc: G01J 3/51 20060101ALI20080214BHEP

17Q First examination report despatched

Effective date: 20080912

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20110630