WO2011023593A1 - Method of and apparatus for imaging a cellular sample - Google Patents

Method of and apparatus for imaging a cellular sample Download PDF

Info

Publication number
WO2011023593A1
WO2011023593A1 PCT/EP2010/061961 EP2010061961W WO2011023593A1 WO 2011023593 A1 WO2011023593 A1 WO 2011023593A1 EP 2010061961 W EP2010061961 W EP 2010061961W WO 2011023593 A1 WO2011023593 A1 WO 2011023593A1
Authority
WO
WIPO (PCT)
Prior art keywords
sub
beams
focal points
frequency
fluorescent signals
Prior art date
Application number
PCT/EP2010/061961
Other languages
French (fr)
Inventor
Mathieu Ducros
Serge Charpak
Valentina Emiliani
Laurent Moreaux
Original Assignee
INSERM (Institut National de la Santé et de la Recherche Médicale)
Centre National De La Recherche Scientifique - Cnrs -
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by INSERM (Institut National de la Santé et de la Recherche Médicale), Centre National De La Recherche Scientifique - Cnrs - filed Critical INSERM (Institut National de la Santé et de la Recherche Médicale)
Publication of WO2011023593A1 publication Critical patent/WO2011023593A1/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0032Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/008Details of detection or image processing, including general computer control
    • G02B21/0084Details of detection or image processing, including general computer control time-scale detection, e.g. strobed, ultra-fast, heterodyne detection

Definitions

  • the present invention relates in general to a method and apparatus for imaging a cellular sample. Particularly, but not exclusively, the invention relates to a method of imaging a cellular sample by means of photonic excitation, for example by two-photon microscopy.
  • Photonic excitation is often used in the investigation of small target objects, such as biological tissues and chemical molecules which are too small to be seen by the unaided eye.
  • incident photons interact with the target object to emit a corresponding photon which is detected and used to generate an image of the target object.
  • the target object may be a cellular sample made up oi single or multiple biological cells, clusters populations or networks of such cells.
  • the cells may be in a living or non-living state and be from a plant, animal, bacterial source, or the like.
  • the investigation of such cellular samples may have applications such as screening of drug activity, diagnosis of disease state, research into cellular functions and transport properties including inter-cellular signalling in cell populations.
  • Fluorescence microscopy is a type of microscopy in which a fluorescent material is used to mark a specimen or objects of interest in the specimen. The fluorescent material is then illuminated with a wavelength of light providing an energy level sufficient to excite the fluorescent material to emit emission light. The image of the specimen is detected by collecting the emission light. Multi-photon imaging techniques such as two-photon microscopy are becoming increasingly used in neurophysiology studies. In two-photon microscopy an intrinsic fluorophore or a fluorescent dye attached to the target object is excited by a pair of incident photons causing the emission of a single fluorescence photon which can then be used to generate an image of the target object.
  • Microsc 200(Pt 2): 83-104 Garaschuk et al. (2006). "Optical monitoring of brain function in vivo: from neurons to networks.” Pflugers Arch 453(3): 385-96 and Wilt et al. (2009). “Advances in light microscopy for neuroscience.” Annu Rev Neurosci 32: 435-506.
  • Multi-photon microscopy has several advantages over other fluorescence microscopy techniques. Near infra red wavelengths allow deeper imaging in biological tissues than UV or blue light that are strongly attenuated. Furthermore the fluorescence excitation is restricted to very small volumes near the microscope objective focal spot making multi-photon microscopy intrinsically optically resolved. Thus, wide field fluorescence collection is possible.
  • a challenging task in neurophysiology consists in recording activity simultaneously in a number of cells labelled with ion or voltage sensitive reporters.
  • the simultaneous recording of electrical activity in a population of neurones in vivo is an essential step in the study of cerebral function.
  • Two photon microscopy coupled with the use of fluorescent molecules provides micrometre spatial resolution enabling individual cells to be observed and identified, is non-invasive and enables neuronal activity to be visualised in vivo up to a depth of 500 ⁇ m.
  • a drawback of conventional two-photon microscopes is the use of scanning mechanisms employing optical-mechanical devices such as mirrors mounted on galvanometers leading to a limited acquisition speed which does not allow electrical signals on a number of cells to be recorded simultaneously, and a limited imaging depth.
  • optical-mechanical devices such as mirrors mounted on galvanometers leading to a limited acquisition speed which does not allow electrical signals on a number of cells to be recorded simultaneously, and a limited imaging depth.
  • Various attempts have been made to overcome these drawbacks. For example, Lillis, et al. (2008). "Two-photon imaging of spatially extended neuronal network dynamics with high temporal resolution.” J Neurosci Methods 172(2): 178-84, describes a two-photon fluorescence mirror-based scanning imaging system, for monitoring the dynamics of spatially extended neuronal networks.
  • a first aspect of the invention provides a method of imaging a cellular sample in multi-photon imaging, the method comprising: providing a multi-photonic excitation beam; splitting the multi- photonic excitation beam into a plurality of N sub-beams;
  • each sub beam for example by modulating the amplitude of the plurality of N sub-beams to N respective frequencies fi...f N ) or with N different binary temporal patterns; focusing the plurality of N modulated sub-beams to N respective spatially separated focal points P 1 ... P N within the cellular sample; simultaneously detecting fluorescent signals emitted from the N focal points P I ...P N ; and demultiplexing the detected fluorescent signals so that fluorescence data relating to the respective focal points PI ...PN may be obtained.
  • a second aspect of the invention provides an apparatus for imaging a cellular sample in multi-photon imaging, the apparatus comprising: a light source for providing a multi-photonic excitation beam; a beam divider for splitting the photon excitation beam into a plurality of N sub-beams; a modulator to apply a different amplitude modulation pattern to the plurality of N sub-beams (for example with N respective frequencies fi...fN or with N different binary temporal patterns); an objective for focusing the plurality of N modulated sub-beams to N respective spatially separated focal points Pi... P N within the cellular sample; a photodetector for simultaneously detecting fluorescent signals emitted from the N focal points Pi ... P N ; and a demultiplexer for demultiplexing the detected
  • the position of the recorded fluorescence signal is thus coded by a specific modulation pattern. This in turn reduces the need to move the laser beam by optomechanical techniques between the points of interest within the cellular sample since the fluorescence signals from a number of points within the sample can be measured simultaneously. Consequently since the laser beam does not need to be scanned along the cellular sample to image a number of points of interest the imaging acquisition speed may be increased and the time resolution improved.
  • the step of simultaneously detecting fluorescent signals may include collecting a combined fluorescence signal composed of fluorescent signals emitted from the N spatially separated focal points PI ... PN; and wherein
  • fluorescence data relating to the respective focal points Pi ... P N is obtained by extracting the signal components of the combined fluorescence signals .
  • the temporal patterns applied to the N sub-beams can be any set of signals that permit de-multiplexing of signals that are summed onto the
  • the temporal patterns could be sinusoidal
  • modulations at frequencies U to fN that may be separated in the frequency domain. They could also be binary patterns such as complementary Golay sequences: the particular correlation properties of the Golay complementary sequences allow demultiplexing in the temporal domain. (See Golay (1949). “Multi-Slit Spectrometry.” Journal of the Optical Society of America 39(6): 437-444)
  • the N temporal patterns may be applied to each of the N focal points using the technique called focal modulation microscopy (Chen, N., C. H. Wong, et al. (2008). "Focal modulation microscopy.” Opt Express 16(23): 18764-9), i.e.
  • the amplitude of the power spectrum may be measured at each frequency fi to fN N fluorescent signals corresponding to the N focal points P 1 ...P N may be displayed
  • Parts of the methods according to embodiments of the invention may be computer implemented. Parts of the methods of embodiments may be implemented in software on a programmable apparatus. Methods may be implemented in a combination of software and hardware.
  • a tangible carrier medium may comprise a storage medium such as a floppy disk, a CD-ROM, a hard disk drive, a magnetic tape device or a solid state memory device and the like.
  • a transient carrier medium may include a signal such as an electrical signal, an electronic signal, an optical signal, an acoustic signal, a magnetic signal or an electromagnetic signal, e.g. a microwave or RF signal.
  • Figure 1 is a schematic diagram of an apparatus for imaging a cellular sample according to a general embodiment of the invention
  • Figure 2 is a schematic diagram of an apparatus for imaging a cellular sample according to a particular embodiment of the invention
  • Figure 3 schematically illustrates a method and graphically illustrates results obtained according to the particular embodiment of the invention.
  • Figure 4 schematically illustrates an apparatus for imaging cellular sample according to a particular embodiment of the invention
  • FIG. 5 graphically illustrates results obtained using the apparatus described in Figure 4.
  • a two-photon microscopy apparatus comprises a pulsed laser excitation source L providing a laser beam 11 , and a laser beam divider BD for dividing the laser beam 11 , into a plurality of N sub beams 11 -1... 11 -N.
  • the laser beam is divided into 3 sub-beams 11 -1 , 11 -2 and 11 -3.
  • a modulating device M is provided for modulating each sub-beam 11-1 , 11 -2 and 11-3 with a different modulation pattern ml , m2, m3 (e.g. to a respective frequency f1 , f2 and f3).
  • the apparatus further includes a first objective lens Obj-1 for focusing each sub-beam 11 -1 , 11-2 and 11 -3 to a respective distinct position Pi , P 2 and P 3 within the cellular sample S.
  • a second objective lens Obj-2 which may be identical to Obj-1 in epifluorescence mode, is provided for collecting and focussing fluorescence signals emitted from the cellular sample onto a photo-detector D such that the photodetector simultaneously detects a sum of the signals s(P,) emitted by each point P,.
  • Photodetector D provides an electrical signal in response to the collected fluorescent signal.
  • Modulation patterns ml , m2 and m3 differ to one another.
  • the position of the recorded fluorescence signal is coded by its temporal modulation pattern.
  • sinusoidal modulations at frequencies f 1 , f2 and f3 are employed the position of the recorded fluorescence is coded in frequency.
  • frequencies of all modulation patterns are in the order of 10-100 times greater than the highest frequency of the fluorescence signals collected by the photodetector reporting physiological activity of the cellular sample.
  • FIG. 2 illustrates in more detail a two-photon microscopy apparatus according to a particular embodiment of the invention.
  • the apparatus comprises a femtosecond pulsed laser FL as a two-photon fluorescence excitation source.
  • the femtosecond pulsed laser provides a pulsed excitation beam 11.
  • the excitation laser beam 11 is divided into 5 sub-beams 11 -1 , 11-2, 11 -3, 11 -4 and 11-5 by a diffractive optical element DOE.
  • GS for example, General scanning GS120
  • the sub-beams 11-1 , 11 -2, 11 -3, 11-4 and 11 -5 are focused by objective OB to 5 respective positions within the cellular sample S.
  • the fluorescent signals emitted by the excitations spots are collected by the objective OB and projected onto a photomultiplier tube PMT by a dichroic element DIC and a lens L5.
  • the fluorescent signals collected by the photomultiplier tube are converted into a corresponding electrical current. This photocurrent is then amplified and discriminated by a photon counter Amp+PhC.
  • the signal is then analysed by a computer in order to measure the amplitude of the power spectrum at frequencies f1 to f5 and the fluorescence signals at all 5 spots are displayed.
  • a conventional 2-photon image may also be obtained.
  • the laser excitation source may be a femtosecond laser for example a Coherent Mira laser.
  • any known laser or light source for providing an excitation source for multi-photon excitation may be used such as a Ti:Sapphire femtosecond laser.
  • Multi-photon microscopy requires very high focal intensities around 1GW/cm 2 in the near infra red spectral region to efficiently excite biocompatible fluorescent molecules.
  • Ti.Sapphire femtosecond laser are commonly employed in two-photon microscopy because this type of laser provides an average power of >1W with ⁇ 100fs pulses and a repetition rate of ⁇ 80MHz in the near infra red region from 700 to 1000nm. The number of points that can be observed simultaneously will depend on the power of the laser used.
  • the photo detector in this embodiment may be provided by a photomultiplier tube (PMT) for example a Hamamatsu H7422p. It will be appreciated that any suitable photo detection device for detecting a fluorescence signal may be used.
  • the objective OB in this embodiment may for example be a Leica 63x NA0.9 or any objective device suitable for focussing laser sub-beams into different points of a cellular sample.
  • the dichroic may be for example a Chroma dcxr695.
  • a test sample S consists of 2 fluorescent beads B1 and B2 (6 ⁇ m in diameter) spaced apart by a distance of 25 ⁇ m as illustrated in part A of Figure 3 using the apparatus described in Figure 2.
  • the sample S is moved at a speed of 25 ⁇ m/s so that each bead intercepts successively the five two-photon excitation focii (a,b,c,d and e).
  • the five focii are also spaced by 25 ⁇ m as shown in B presenting an image of two grey beads (small white arrows) that are aligned with the 5 focii.
  • the first bead is about to reach the first sub-beam focus point a.
  • Part C of Figure 3 presents a graphical illustration of signal intensity versus time. Fluorescence signals are recorded simultaneously at point a, b, c, d and e as the two beads cross through the five focii. As each bead crosses a focus point a, b, c, d or e it creates a peak signal at the frequency corresponding to the particular location. When the two beads coincide with two foci (at time 2, 3, 4 and 5s) they create a signal with 2 frequency components that can be separated.
  • the diffractive optical element in alternative embodiment of the invention, the diffractive optical element
  • DOE can be replaced by a spatial light modulator (SLM), such as a liquid crystal SLM that generates multiple sub beams targeted to specific sample locations.
  • SLM spatial light modulator
  • the chopper may be replaced by a digital micro-mirror device (DMD), a matrix of -1000x700 micro-electromechanical system (MEMS) micro-mirrors (each ⁇ 10x10 ⁇ m 2 ), or any like device suitable for modulating the sub-beams at frequencies in the order of 10-10OkHz.
  • DMDs each micro mirror is typically 10x10 ⁇ m 2 and can be flipped between two stable angular positions.
  • the fastest switching rate of the entire micro- mirror matrix is around 2OkHz.
  • Faster DMD could be engineered in the future. Therefore a DMD can generate fast binary (ON-OFF) modulations of each sub- beam at frequencies in the order of 10-3OkHz.
  • temporal binary patterns such as complementary Golay sequences
  • Golay sequences are orthogonal binary functions, originally developed for the optical problem of dynamic multi slit spectroscopy (Golay
  • Golay temporal sequences permit separation of the signals originating from different locations. For example if points
  • M 2 (t) [0,0,1 ,1 ,0,0,1 ,1]
  • M 3 (t) [0,1 ,1 ,0,0,1 ,1 ,0]
  • the illumination state is determined by the angular position of the DMD micro-mirrors for the sub beams corresponding to points Pi, P 2 and P 3 .
  • Each ON or OFF state can last as little as 50 ⁇ s with the current commercial DMD technology.
  • the photon emission at each point has a constant amplitude equal to Si, S 2 and S 3 .
  • the photodetector we record the sum of all signals
  • M 1 ⁇ t) [-1 ,0,-1 ,0,0,1 ,0,1]
  • Figure 4 illustrates in more detail a two-photon microscopy apparatus according to a particular embodiment of the invention that uses an SLM to target specific sites inside the sample and a DMD to create binary sequences on each sub beams.
  • the apparatus comprises a femtosecond pulsed laser femtosecond laser FL1 (Tsunami Spectra Physics) for the acquisition of a conventional laser scanning microscopy image.
  • FL1 excitation wavelength is set to 925 nm.
  • GS galvanometric scanner
  • PMT photomultiplier tube
  • Raster scanning of GS allows acquisition of a conventional 2D two-photon image.
  • the user manually places the excitation points with a mouse click onto the image using a computer interface (e.g. P1 , P2 and P3 in inset I.) These points are located in cells or sites where the user wants to measure the fast neuronal activity simultaneously.
  • a secondary femtosecond laser FL2 (Tsunami Spectra Physics) laser provides a pulsed excitation beam at 800nm sent to a spatial light modulator SLM (Hamamatsu LCOS X10468-02).
  • a computer sends an holographic pattern to the SLM to generate the user specified illumination pattern (i.e. points P1 , P2 and P3) at the microscope objective focal plane (see Lutz et al. (2008). "Holographic photolysis of caged neurotransmitters.” Nat Methods 5(9): 821 -7 and Papagiakoumou et al. (2008).
  • Lens L1 images the SLM Fourier plane onto the DMD mirror matrix creating a set of points PV PZ and P3' that are conjugate points of P1 , P2 and P3.
  • the DMD pixels corresponding PV, P2' and P3' are modulated according to temporal binary sequence M1 , M2 and M3 as illustrated in the inset II. The sequences are repeated in a loop for the duration of the user-specified acquisition. All other pixels in the DMD are turned OFF.
  • the DMD surface is imaged into the sample by a telescope composed of lens L4 and the microscope objective OB.
  • Modulated fluorescence signals emitted at points P1 , P2 and P3 are collected in epifluorescence mode and imaged onto the PMT where they add up.
  • the sum of all signals is processed as explained above (multiplication by the demodulating sequences M1 * , M2 * or M3 * ) to extract the signals originating from P1 , P2 and P3 (S(P1 ,t), S(P2,t) and S(P3,t)) as illustrated by inset III.
  • the beam from laser FL2 is blocked by a shutter (not shown in Figure 4))
  • the beam from laser FL1 is blocked by another shutter.
  • Figure 4 The application of the apparatus and method according to embodiment of the invention described in Figure 4 may be demonstrated by recording fast activity in a neuron labeled with a fluorescent calcium indicator in an acute mouse brain slice.
  • Figure 5 presents such a method and the results obtained.
  • a mitral cell in the mouse olfactory bulb was patched with a borosilicate patch pipette (indiacted by white arrow in Figure 5A) filled with a solution containing Oregon Green Bapta 2. This calcium sensitive dye diffused inside the cell in a few minutes. The cell depth is around 60 ⁇ m.
  • a 2D image Figure 5A, scale bar 20 ⁇ m
  • the computer calculated and sent the phase hologram to the SLM in order to diffract the laser beam from FL2 into the three points P1 , P2 and P3.
  • the DMD pixels corresponding to P1 , P2 and P3 where modulated according to the binary Golay sequences described above and illustrated in Figure 4, inset II.
  • the Golay sequence lasted 2ms, which is the recording time resolution. With the current commercially available DMD and using the shortest Golay sequence, a time resolution down to 0.5ms is achievable for up to 6 points. It goes up to 1 ms for 14 points.
  • the invention may be applied in any biological or pharmacological domain which would benefit from high speed image acquisition, a resolution of the order of micrometres and an image depth to the order of 500 microns in scattering media.
  • Such areas include pharmacology, development biology, cardiovascular imaging, dermatology, ophthalmology etc.
  • the targeted temporal resolution in the context of an application in neurophysiology corresponds to the dynamics of the electrical-physiological signals studies is in the order to 1 ms.
  • the temporal resolution ⁇ t is not limited to 1 ms.
  • the temporal resolution will depend on factors such as the element used to modulate the sub-beams, the frequency response of the photo-detectors and the power of the laser. It should be noted that the temporal resolution ⁇ t is inversely proportional to the frequency resolution ⁇ f .
  • the separation of the N sub-beams should thus be increased.
  • the frequency of the N sub beams should be separated by at least a frequency of 2OkHz (2 * ⁇ t).
  • the frequencies should be separated by 2kHz.
  • the number of points N in the sample that may be simultaneously imaged is limited by the power of the laser and the photo-toxicity.
  • the limit is around 500 points (1 OmW per sub-beam).
  • imaging systems capable of imaging 100-1000 points may be provided.
  • the approach adopted by the embodiments of the present invention enables the fluorescence signature of a multi-cellular sample to be obtained from a number of points simultaneously, thereby allowing wide field imaging to be obtained at increased imaging acquisition speed.
  • a spatial resolution of the order of 1 ⁇ m and a temporal resolution of the order of 1 ms can be obtained.
  • the imaging depth is greater than 350 ⁇ m in brain tissue.

Abstract

A method of imaging a cellular sample by multi-photon imaging, the method comprising: providing a multi-photonic excitation beam; splitting the multi-photonic excitation beam into a plurality of N sub-beams; modulating the amplitude of the plurality of N sub-beams to create N respective temporal modulation pattern; focusing the plurality of N modulated sub-beams to N respective spatially separated focal points P1... PN within the cellular sample; simultaneously detecting fluorescent signals emitted from the N focal points P1... PN; and demodulating the detected fluorescent signals so that fluorescence data relating to the respective focal points P1...PN may be obtained. An apparatus for imaging a cellular sample is also described.

Description

METHOD OF AND APPARATUS FOR IMAGING A CELLULAR SAMPLE
Field of the Invention
The present invention relates in general to a method and apparatus for imaging a cellular sample. Particularly, but not exclusively, the invention relates to a method of imaging a cellular sample by means of photonic excitation, for example by two-photon microscopy.
Background of the Invention
Photonic excitation is often used in the investigation of small target objects, such as biological tissues and chemical molecules which are too small to be seen by the unaided eye. In photonic excitation incident photons interact with the target object to emit a corresponding photon which is detected and used to generate an image of the target object.
The target object may be a cellular sample made up oi single or multiple biological cells, clusters populations or networks of such cells. The cells may be in a living or non-living state and be from a plant, animal, bacterial source, or the like. The investigation of such cellular samples may have applications such as screening of drug activity, diagnosis of disease state, research into cellular functions and transport properties including inter-cellular signalling in cell populations.
Fluorescence microscopy is a type of microscopy in which a fluorescent material is used to mark a specimen or objects of interest in the specimen. The fluorescent material is then illuminated with a wavelength of light providing an energy level sufficient to excite the fluorescent material to emit emission light. The image of the specimen is detected by collecting the emission light. Multi-photon imaging techniques such as two-photon microscopy are becoming increasingly used in neurophysiology studies. In two-photon microscopy an intrinsic fluorophore or a fluorescent dye attached to the target object is excited by a pair of incident photons causing the emission of a single fluorescence photon which can then be used to generate an image of the target object. Two-photon laser scanning microscopy was first described by Denk et al (Denk et al. (1990). "Two-photon laser scanning fluorescence microscopy." Science 248(4951): 73-6) and was rapidly applied in biology and mainly the field of neuroscience (See reviews such as Konig (2000). "Multiphoton microscopy in life sciences." J
Microsc 200(Pt 2): 83-104 , Garaschuk et al. (2006). "Optical monitoring of brain function in vivo: from neurons to networks." Pflugers Arch 453(3): 385-96 and Wilt et al. (2009). "Advances in light microscopy for neuroscience." Annu Rev Neurosci 32: 435-506. Multi-photon microscopy has several advantages over other fluorescence microscopy techniques. Near infra red wavelengths allow deeper imaging in biological tissues than UV or blue light that are strongly attenuated. Furthermore the fluorescence excitation is restricted to very small volumes near the microscope objective focal spot making multi-photon microscopy intrinsically optically resolved. Thus, wide field fluorescence collection is possible.
A challenging task in neurophysiology consists in recording activity simultaneously in a number of cells labelled with ion or voltage sensitive reporters. The simultaneous recording of electrical activity in a population of neurones in vivo is an essential step in the study of cerebral function. Two photon microscopy coupled with the use of fluorescent molecules provides micrometre spatial resolution enabling individual cells to be observed and identified, is non-invasive and enables neuronal activity to be visualised in vivo up to a depth of 500μm.
A drawback of conventional two-photon microscopes is the use of scanning mechanisms employing optical-mechanical devices such as mirrors mounted on galvanometers leading to a limited acquisition speed which does not allow electrical signals on a number of cells to be recorded simultaneously, and a limited imaging depth. Various attempts have been made to overcome these drawbacks. For example, Lillis, et al. (2008). "Two-photon imaging of spatially extended neuronal network dynamics with high temporal resolution." J Neurosci Methods 172(2): 178-84, describes a two-photon fluorescence mirror-based scanning imaging system, for monitoring the dynamics of spatially extended neuronal networks. Another approach consist in using acousto-optic deflectors to steer the laser beam very fast (less than 10 μs) between cells or cellular regions (See for example Otsu et al. (2008). Optical monitoring of neuronal activity at high frame rate with a digital random-access multiphoton (RAMP) microscope." J Neurosci Methods 173(2): 259-70 and Grewe et al. "High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision." Nat Methods 7(5): 399-405. Other techniques, such as for example that described in Nikolenko et al. (2008). "SLM Microscopy: Scanless Two-Photon Imaging and Photostimulation with Spatial Light Modulators." Front Neural Circuits 2: 5.
involve the use of array detectors such as CCD cameras. However the resulting increase in acquisition speed achieved by such techniques is detrimental to the image quality in terms of signal noise ratio, point spread function (PSF) or imaging depth.
Summary of the Invention
To better address one or more of the foregoing concerns, a first aspect of the invention provides a method of imaging a cellular sample in multi-photon imaging, the method comprising: providing a multi-photonic excitation beam; splitting the multi- photonic excitation beam into a plurality of N sub-beams;
applying a different amplitude modulation pattern on each sub beam (for example by modulating the amplitude of the plurality of N sub-beams to N respective frequencies fi...fN) or with N different binary temporal patterns; focusing the plurality of N modulated sub-beams to N respective spatially separated focal points P1... PN within the cellular sample; simultaneously detecting fluorescent signals emitted from the N focal points PI ...PN; and demultiplexing the detected fluorescent signals so that fluorescence data relating to the respective focal points PI ...PN may be obtained. A second aspect of the invention provides an apparatus for imaging a cellular sample in multi-photon imaging, the apparatus comprising: a light source for providing a multi-photonic excitation beam; a beam divider for splitting the photon excitation beam into a plurality of N sub-beams; a modulator to apply a different amplitude modulation pattern to the plurality of N sub-beams (for example with N respective frequencies fi...fN or with N different binary temporal patterns); an objective for focusing the plurality of N modulated sub-beams to N respective spatially separated focal points Pi... PN within the cellular sample; a photodetector for simultaneously detecting fluorescent signals emitted from the N focal points Pi ... PN; and a demultiplexer for demultiplexing the detected
fluorescent signals; and a processor for processing the demodulated fluorescent signals to obtain fluorescence data relating to the respective focal points P1 ^ - PN-
The position of the recorded fluorescence signal is thus coded by a specific modulation pattern. This in turn reduces the need to move the laser beam by optomechanical techniques between the points of interest within the cellular sample since the fluorescence signals from a number of points within the sample can be measured simultaneously. Consequently since the laser beam does not need to be scanned along the cellular sample to image a number of points of interest the imaging acquisition speed may be increased and the time resolution improved.
In embodiments of the invention:
the step of simultaneously detecting fluorescent signals may include collecting a combined fluorescence signal composed of fluorescent signals emitted from the N spatially separated focal points PI ... PN; and wherein
fluorescence data relating to the respective focal points Pi ... PN is obtained by extracting the signal components of the combined fluorescence signals .
The temporal patterns applied to the N sub-beams can be any set of signals that permit de-multiplexing of signals that are summed onto the
photodetector. For example, the temporal patterns could be sinusoidal
modulations at frequencies U to fN that may be separated in the frequency domain. They could also be binary patterns such as complementary Golay sequences: the particular correlation properties of the Golay complementary sequences allow demultiplexing in the temporal domain. (See Golay (1949). "Multi-Slit Spectrometry." Journal of the Optical Society of America 39(6): 437-444)
The N temporal patterns may be applied to each of the N focal points using the technique called focal modulation microscopy (Chen, N., C. H. Wong, et al. (2008). "Focal modulation microscopy." Opt Express 16(23): 18764-9), i.e.
applying a rapid spatial phase modulation to one half of each sub beam. In the implementation where sub beams are modulated at frequencies U to ffM, the amplitude of the power spectrum may be measured at each frequency fi to fN N fluorescent signals corresponding to the N focal points P1...PN may be displayed
Parts of the methods according to embodiments of the invention may be computer implemented. Parts of the methods of embodiments may be implemented in software on a programmable apparatus. Methods may be implemented in a combination of software and hardware.
Since parts of embodiments of the present invention can be implemented in software, the parts of embodiments of the present invention can be embodied as computer readable code for provision to a programmable apparatus on any suitable carrier medium. A tangible carrier medium may comprise a storage medium such as a floppy disk, a CD-ROM, a hard disk drive, a magnetic tape device or a solid state memory device and the like. A transient carrier medium may include a signal such as an electrical signal, an electronic signal, an optical signal, an acoustic signal, a magnetic signal or an electromagnetic signal, e.g. a microwave or RF signal.
Brief Description of the Drawings Embodiments of the invention will now be described, by way of example only, and with reference to the following drawings in which:-
Figure 1 is a schematic diagram of an apparatus for imaging a cellular sample according to a general embodiment of the invention;
Figure 2 is a schematic diagram of an apparatus for imaging a cellular sample according to a particular embodiment of the invention; and Figure 3 schematically illustrates a method and graphically illustrates results obtained according to the particular embodiment of the invention.
Figure 4 schematically illustrates an apparatus for imaging cellular sample according to a particular embodiment of the invention
Figure 5 graphically illustrates results obtained using the apparatus described in Figure 4
Detailed description
An apparatus in a general form for imaging a cellular sample according to at least one embodiment of the invention will be described with reference to Figure 1. A two-photon microscopy apparatus comprises a pulsed laser excitation source L providing a laser beam 11 , and a laser beam divider BD for dividing the laser beam 11 , into a plurality of N sub beams 11 -1... 11 -N. In the illustrated example the laser beam is divided into 3 sub-beams 11 -1 , 11 -2 and 11 -3. A modulating device M is provided for modulating each sub-beam 11-1 , 11 -2 and 11-3 with a different modulation pattern ml , m2, m3 (e.g. to a respective frequency f1 , f2 and f3). The apparatus further includes a first objective lens Obj-1 for focusing each sub-beam 11 -1 , 11-2 and 11 -3 to a respective distinct position Pi , P2 and P3 within the cellular sample S. A second objective lens Obj-2, which may be identical to Obj-1 in epifluorescence mode, is provided for collecting and focussing fluorescence signals emitted from the cellular sample onto a photo-detector D such that the photodetector simultaneously detects a sum of the signals s(P,) emitted by each point P,. Photodetector D provides an electrical signal in response to the collected fluorescent signal. A de-modulator device driven by the modulation patterns ml , m2, m3 from modulator M is used to de-modulate and separate the signal S(P1) =s(rτij) and detect the envelope of each fluorescence originating in positions Pi, P2, and P3 of the cellular sample, representing the physiological fluorescence variation.
Modulation patterns ml , m2 and m3 differ to one another. In this way the position of the recorded fluorescence signal is coded by its temporal modulation pattern. For example, if sinusoidal modulations at frequencies f 1 , f2 and f3 are employed the position of the recorded fluorescence is coded in frequency. In general, frequencies of all modulation patterns are in the order of 10-100 times greater than the highest frequency of the fluorescence signals collected by the photodetector reporting physiological activity of the cellular sample.
Figure 2 illustrates in more detail a two-photon microscopy apparatus according to a particular embodiment of the invention. In this embodiment the apparatus comprises a femtosecond pulsed laser FL as a two-photon fluorescence excitation source. The femtosecond pulsed laser provides a pulsed excitation beam 11. The excitation laser beam 11 is divided into 5 sub-beams 11 -1 , 11-2, 11 -3, 11 -4 and 11-5 by a diffractive optical element DOE. The 5 sub-beams 11 -1 , 11 -2, 11-3, 11-4 and 11-5 are relayed by two lenses L1 (for example a Thorlabs, LA1509B, focal length f=100mm) and L2 (for example Thorlabs LA1608- B, f=75mm) onto an arrangement of XY galvanometric mirrors GS (for example, General scanning GS120). A 5-channel chopper C rotated at a speed of approximately 5700rpm by a DC motor M, and positioned between lens L1 and lens L2 modulates each sub-beam 11-1 , 11-2, 11 -3, 11-4 and 11-5 at frequencies f 1=3.08, f2= 3.27, f3=3.47 , f4=3.66, f5=3.85kHz, respectively. The galvanometric mirrors arrangement GS deflects the sub-beams relayed by lens L1 and l_2 onto lenses L3 (f=80mm) and L4 (f=250mm) which magnify the combined beam diameter to fill the back aperture of an objective OB. The sub-beams 11-1 , 11 -2, 11 -3, 11-4 and 11 -5 are focused by objective OB to 5 respective positions within the cellular sample S. A row of five excitation spots Pi (i=1-5) are thus created inside the sample (S). The fluorescent signals emitted by the excitations spots are collected by the objective OB and projected onto a photomultiplier tube PMT by a dichroic element DIC and a lens L5. The fluorescent signals collected by the photomultiplier tube are converted into a corresponding electrical current. This photocurrent is then amplified and discriminated by a photon counter Amp+PhC. The signal is then analysed by a computer in order to measure the amplitude of the power spectrum at frequencies f1 to f5 and the fluorescence signals at all 5 spots are displayed. By closing diaphragm D positioned between the chopper C and lens L2, and leaving the chopper C in a position that transmits light for the central sub-beam, a conventional 2-photon image may also be obtained.
By virtue of the process of frequency multiplexing and demultiplexing the spatial resolution is conserved despite the scattering in the biological material of sample S. This is not the case for systems using a camera simultaneously recording fluorescence from a number of points because scattering leads to a widening of the point spread function (PSF).
While the first embodiment of the invention relates to a two-photon microscopy apparatus, it will be appreciated that the invention relates to multi- photon imaging apparatus. In the described embodiment the laser excitation source may be a femtosecond laser for example a Coherent Mira laser. However it will be appreciated that any known laser or light source for providing an excitation source for multi-photon excitation may be used such as a Ti:Sapphire femtosecond laser. Multi-photon microscopy requires very high focal intensities around 1GW/cm2 in the near infra red spectral region to efficiently excite biocompatible fluorescent molecules. For example Ti.Sapphire femtosecond laser are commonly employed in two-photon microscopy because this type of laser provides an average power of >1W with ~100fs pulses and a repetition rate of ~80MHz in the near infra red region from 700 to 1000nm. The number of points that can be observed simultaneously will depend on the power of the laser used.
The photo detector in this embodiment may be provided by a photomultiplier tube (PMT) for example a Hamamatsu H7422p. It will be appreciated that any suitable photo detection device for detecting a fluorescence signal may be used. The objective OB in this embodiment may for example be a Leica 63x NA0.9 or any objective device suitable for focussing laser sub-beams into different points of a cellular sample. The dichroic may be for example a Chroma dcxr695.
It will also be appreciated that the types of lens used and the corresponding focal lengths have been given as suitable examples only. The application of the apparatus and method according to embodiment of the invention described in Figure 2 may be demonstrated by imaging a sample containing two fluorescent beads. Figure 3 presents such a method and the results obtained.
In this illustrative example, we imaged a test sample S consists of 2 fluorescent beads B1 and B2 (6μm in diameter) spaced apart by a distance of 25μm as illustrated in part A of Figure 3 using the apparatus described in Figure 2. The sample S is moved at a speed of 25μm/s so that each bead intercepts successively the five two-photon excitation focii (a,b,c,d and e). The five focii are also spaced by 25μm as shown in B presenting an image of two grey beads (small white arrows) that are aligned with the 5 focii. In Fig 3B the first bead is about to reach the first sub-beam focus point a. Part C of Figure 3 presents a graphical illustration of signal intensity versus time. Fluorescence signals are recorded simultaneously at point a, b, c, d and e as the two beads cross through the five focii. As each bead crosses a focus point a, b, c, d or e it creates a peak signal at the frequency corresponding to the particular location. When the two beads coincide with two foci (at time 2, 3, 4 and 5s) they create a signal with 2 frequency components that can be separated.
The same experiment is repeated with a scattering media (for example, 0.5μm diameter latex particles in water, concentration 0.02% weight, thickness 970μm, 2.7 OD at 800nm, or 6.7 OD at 515nm) placed between the objective OB and the fluorescent beads B1 and B2, as illustrated in part D, E and F of Figure 3. It will be noted that even through a scattering layer the signals from different locations can be de-multiplexed in the frequency domain.
In alternative embodiment of the invention, the diffractive optical element
(DOE) can be replaced by a spatial light modulator (SLM), such as a liquid crystal SLM that generates multiple sub beams targeted to specific sample locations.
(see Papagiakoumou et al. (2008). "Patterned two-photon illumination by spatiotemporal shaping of ultrashort pulses." Opt Express 16(26): 22039-47) This helps to efficiently redirect the light power to a few targeted spots or to any user defined patterns within the sample Since light is not directed to regions in the sample of low interest, for example regions devoid of cells, the technique is more light efficient.
In alternative embodiments of the invention, the chopper may be replaced by a digital micro-mirror device (DMD), a matrix of -1000x700 micro-electromechanical system (MEMS) micro-mirrors (each ~10x10μm2), or any like device suitable for modulating the sub-beams at frequencies in the order of 10-10OkHz. In DMDs each micro mirror is typically 10x10μm2 and can be flipped between two stable angular positions. Currently the fastest switching rate of the entire micro- mirror matrix is around 2OkHz. Faster DMD could be engineered in the future. Therefore a DMD can generate fast binary (ON-OFF) modulations of each sub- beam at frequencies in the order of 10-3OkHz.
Instead of modulating the sub-beams at different frequencies, temporal binary patterns, such as complementary Golay sequences, can also be applied to each sub-beam. Golay sequences are orthogonal binary functions, originally developed for the optical problem of dynamic multi slit spectroscopy (Golay
(1949). "Multi-Slit Spectrometry." Journal of the Optical Society of America 39(6):
437-444). In the context of our invention Golay temporal sequences permit separation of the signals originating from different locations. For example if points
Pi, P2 and P3 are excited with modulating sequences M-i, M2, M3 where
M1(I) = [OJ 1O1I 1O1I 1O1I]
M2(t) = [0,0,1 ,1 ,0,0,1 ,1]
M3(t) = [0,1 ,1 ,0,0,1 ,1 ,0]
"0" and "1" corresponding to ON and OFF illumination state. In the case of spatial modulation with a DMD, the illumination state is determined by the angular position of the DMD micro-mirrors for the sub beams corresponding to points Pi, P2 and P3. Each ON or OFF state can last as little as 50μs with the current commercial DMD technology. During the short time interval of a sequence M, the photon emission at each point has a constant amplitude equal to Si, S2 and S3. At the photodetector we record the sum of all signals
S(t) = SiM1 (t) + S2M2W + S3M3(Q For each M, sequence there is a complementary "orthogonal" sequence M1 * such that
∑M,(t)xM,*(t) = 0 if i≠j and∑M,(t)xM,*(t) = N/4 where "Σ" is the sum over all elements of the sequence and "x" is the element-to- element vector multiplication, and N is the number of elements in a sequence.
M1^t) = [-1 ,0,-1 ,0,0,1 ,0,1]
M2 *(t) = [-1 ,-1 ,0,0,0,0,1 ,1]
M3 * (t) = [-1 ,0,0,-1 ,0,1 ,1 ,0]
For example ∑Mi(t)xM2 *(t) = (0x-1 )+(1x-1 )+(0x0)+(1x0)+(0x0)+(1x0)+(0x1)+(1x1 ) = 0 and
Figure imgf000012_0001
= 2 As a consequence
Figure imgf000012_0002
ΣS(t)xM2 *(t) = 2s2
ΣS(t)xM3 *(t) = 2s3
We see that by multiplying the photodetector signal by the M* sequences we can compute the amplitude of the signal at each point Pi, P2 and P3. This could be done online by electronic circuits operating on the photodetector output voltage, or in a post processing step using a fast algorithm on digitally recorded data. To separate the signal from 6 points maximum a sequence with 8 binary states is required. For 14 points a sequence of 16 states is necessary. Techniques to extract longer Golay sequences have also been devised (Golay, M. J. E. (1961 ). "Complementary Series." IRE Transactions on InformationTheory: 82-87)
Figure 4 illustrates in more detail a two-photon microscopy apparatus according to a particular embodiment of the invention that uses an SLM to target specific sites inside the sample and a DMD to create binary sequences on each sub beams. In this embodiment the apparatus comprises a femtosecond pulsed laser femtosecond laser FL1 (Tsunami Spectra Physics) for the acquisition of a conventional laser scanning microscopy image. FL1 excitation wavelength is set to 925 nm. The femtosecond laser beam is sent to a galvanometric scanner (GS, General Scanning GS 120), magnified by the telescope composed of lenses L2 (f=100mm) and L4 (f=300mm), transmitted through both dichroic mirrors DIC1 (900DCXRU Chroma) and DIC2 (695DCXRU Chroma), and focalized into the sample (S) by a microscope objective (OB 63x NA 0.9 Leica). Fluorescence emitted at the focal spot is collected in epifluorescence mode by the same objective, reflected by a dichroic mirror DIC2 and imaged onto a photomultiplier tube (PMT, R6357 Hamamatsu) by lens L5. Raster scanning of GS allows acquisition of a conventional 2D two-photon image. The user manually places the excitation points with a mouse click onto the image using a computer interface (e.g. P1 , P2 and P3 in inset I.) These points are located in cells or sites where the user wants to measure the fast neuronal activity simultaneously.
A secondary femtosecond laser FL2 (Tsunami Spectra Physics) laser provides a pulsed excitation beam at 800nm sent to a spatial light modulator SLM (Hamamatsu LCOS X10468-02). A computer sends an holographic pattern to the SLM to generate the user specified illumination pattern (i.e. points P1 , P2 and P3) at the microscope objective focal plane (see Lutz et al. (2008). "Holographic photolysis of caged neurotransmitters." Nat Methods 5(9): 821 -7 and Papagiakoumou et al. (2008). "Patterned two-photon illumination by spatiotemporal shaping of ultrashort pulses." Opt Express 16(26): 22039-47) for more detail on this technique). Lens L1 (f=500mm) images the SLM Fourier plane onto the DMD mirror matrix creating a set of points PV PZ and P3' that are conjugate points of P1 , P2 and P3. The DMD pixels corresponding PV, P2' and P3' are modulated according to temporal binary sequence M1 , M2 and M3 as illustrated in the inset II. The sequences are repeated in a loop for the duration of the user-specified acquisition. All other pixels in the DMD are turned OFF. The DMD surface is imaged into the sample by a telescope composed of lens L4 and the microscope objective OB. Modulated fluorescence signals emitted at points P1 , P2 and P3 are collected in epifluorescence mode and imaged onto the PMT where they add up. The sum of all signals is processed as explained above (multiplication by the demodulating sequences M1 *, M2* or M3*) to extract the signals originating from P1 , P2 and P3 (S(P1 ,t), S(P2,t) and S(P3,t)) as illustrated by inset III. Note that when the conventional 2D image is acquired, the beam from laser FL2 is blocked by a shutter (not shown in Figure 4)), and when acquisition of signals at points P1 , P2 and P3 take place, the beam from laser FL1 is blocked by another shutter.
The application of the apparatus and method according to embodiment of the invention described in Figure 4 may be demonstrated by recording fast activity in a neuron labeled with a fluorescent calcium indicator in an acute mouse brain slice. Figure 5 presents such a method and the results obtained.
A mitral cell in the mouse olfactory bulb was patched with a borosilicate patch pipette (indiacted by white arrow in Figure 5A) filled with a solution containing Oregon Green Bapta 2. This calcium sensitive dye diffused inside the cell in a few minutes. The cell depth is around 60μm. We acquired a 2D image (Figure 5A, scale bar 20μm) using laser FL1 and galvanometric scanner GS. Then we placed three target points onto the cell in the apical dendrite (P1), at the base of the apical dendrite (P2) and in the soma (P3). The computer calculated and sent the phase hologram to the SLM in order to diffract the laser beam from FL2 into the three points P1 , P2 and P3. The DMD pixels corresponding to P1 , P2 and P3 where modulated according to the binary Golay sequences described above and illustrated in Figure 4, inset II. The Golay sequence lasted 2ms, which is the recording time resolution. With the current commercially available DMD and using the shortest Golay sequence, a time resolution down to 0.5ms is achievable for up to 6 points. It goes up to 1 ms for 14 points. We applied a 2OmV voltage step (ΔV) for 10ms to trigger 1-3 action potentials that created a very fast calcium influx inside the cell. The fluorescence signals where demodulated using the method described above. A trace for a single stimulation is sow in Figure 5B, while an average of 10 traces is displayed in Figure 5C. Traces are displayed as ΔF/F, i.e. the relative fluorescence variation with respect to the control signal measured over the first 150ms. This result demonstrates that our method allows to measure fluorescence variations elicited by electrical stimulation simultaneously in a number of points of a labelled sample at the millisecond temporal resolution. The method according to the embodiments of the invention can find applications in areas such as neurophysiology and in particular in imaging activity in cellular networks. It will be appreciated, however, that the invention may be applied in any biological or pharmacological domain which would benefit from high speed image acquisition, a resolution of the order of micrometres and an image depth to the order of 500 microns in scattering media. Such areas include pharmacology, development biology, cardiovascular imaging, dermatology, ophthalmology etc. The targeted temporal resolution in the context of an application in neurophysiology corresponds to the dynamics of the electrical-physiological signals studies is in the order to 1 ms. In the present invention the temporal resolution δt is not limited to 1 ms. The temporal resolution will depend on factors such as the element used to modulate the sub-beams, the frequency response of the photo-detectors and the power of the laser. It should be noted that the temporal resolution δt is inversely proportional to the frequency resolution δf .
Accordingly, in order to reduce the temporal resolution δt, the frequency
separation of the N sub-beams should thus be increased. For example, in order to obtain a temporal resolution of 0.1 ms the frequency of the N sub beams should be separated by at least a frequency of 2OkHz (2*δt). To obtain a temporal resolution of 1 ms the frequencies should be separated by 2kHz.
The number of points N in the sample that may be simultaneously imaged is limited by the power of the laser and the photo-toxicity. With existing
commercial lasers with a maximum power in the order of 5W the limit is around 500 points (1 OmW per sub-beam). However with the development of more powerful femtosecond lasers imaging systems capable of imaging 100-1000 points may be provided. The approach adopted by the embodiments of the present invention enables the fluorescence signature of a multi-cellular sample to be obtained from a number of points simultaneously, thereby allowing wide field imaging to be obtained at increased imaging acquisition speed. A spatial resolution of the order of 1 μm and a temporal resolution of the order of 1 ms can be obtained. The imaging depth is greater than 350μm in brain tissue.
Although the present invention has been described hereinabove with reference to specific embodiments, the present invention is not limited to the specific embodiments, and modifications will be apparent to a skilled person in the art which lie within the scope of the present invention.
In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. The mere fact that different features are recited in mutually different dependent claims does not indicate that a combination of these features cannot be advantageously used. Any reference signs in the claims should not be construed as limiting the scope of the invention.

Claims

1. A method of imaging a cellular sample by multi-photon imaging, the method comprising:
providing a multi-photonic excitation beam;
splitting the multi-photonic excitation beam into a plurality of N sub- beams;
modulating the amplitude of the plurality of N sub-beams to create N respective temporal modulation patterns;
focusing the plurality of N modulated sub-beams to N respective spatially separated focal points Pi... PN within the cellular sample;
simultaneously detecting fluorescent signals emitted from the N focal points PI ...PN", and
demodulating the detected fluorescent signals so that fluorescence data relating to the respective focal points PI ...PN may be obtained.
2. A method according to claim 1 , wherein the step of simultaneously detecting fluorescent signals comprises collecting a combined fluorescence signal composed of fluorescent signals emitted from the N focal points Pi...PN; and wherein fluorescence data relating to the respective focal points P-I ...PN is obtained by extracting the signal components of the combined modulated fluorescence signals .
3. A method according to claim 1 or 2 wherein modulating the amplitude of the plurality of N sub-beams creates N respective temporal modulation patterns with N different binary temporal patterns.
4. A method according to claim 3 wherein the N different binary temporal patterns are Golay sequences.
5. A method according to claim 1 or 2, wherein modulating the amplitude of the plurality of N sub-beams creates N respective temporal modulation patterns with N different frequencies fi ...fN
6. A method according to any one of the preceding claims, further comprising measuring the amplitude of the power spectrum at each frequency Mo fN or demultiplexing the signals from the mixed temporal modulations sequences.
7. A method according to any one of the preceding claims wherein the frequency of each of the N frequencies is over 100 times greater than the highest frequency of the fluorescence signal
8. A method according to any one of the preceding claims wherein the frequencies fi to fN of the N sub beams are separated by at least a frequency of 2kHz
9. A method according to any one of the preceding claims wherein splitting the multi-photonic excitation beams includes directing each of the plurality of sub- beams to a predetermined location within the sample.
10. An apparatus for imaging a cellular sample, the apparatus comprising:
a light source for providing a multi-photon excitation beam a beam divider for splitting the multi-photon excitation beam into a plurality of N sub-beams;
a modulator for modulating the amplitude of the plurality of N sub- beams with N respective temporal modulation patterns;
an objective for focusing the plurality of N modulated sub-beams to N respective spatially separated focal points P1... PN within the cellular sample;
a photodetector for simultaneously detecting fluorescent signals emitted from the N focal points P1 ^ PN; and
a demodulator for demodulating the detected fluorescent signals; and
a processor for processing the demodulated fluorescent signals to obtain fluorescence data relating to the respective focal points P1 1 - PN.
1 1. An apparatus according to claim 10, wherein the photodetector is arranged to collect a combined fluorescence signal composed of fluorescent signals emitted from the N focal points P1 ^ PN; and wherein the processor is configured to extract the signal components of the combined fluorescence signal modulated according to each temporal pattern.
12. An apparatus according to claim 10 or 11 , wherein the modulator comprises a digital mirror device for creating N respective temporal modulation patterns with
N different binary temporal patterns.
13. An apparatus according to claim 12, wherein the digital mirror device is operable to create N different Golay sequences.
14. An apparatus according to claim 10 or 11 , wherein the modulator is operable to modulate the amplitude of the plurality of N sub-beams to create N respective temporal modulation patterns with frequencies fi...fN.
15. An apparatus according to any one of claims 10 to 14 wherein the beam divider comprises a spatial light modulator for directing each sub-beam to a predetermined location within the sample.
16. An apparatus according to any one of claims 10 to 15, wherein the processor is configured to measure the amplitude of the power spectrum at each frequency f i to fN
17. An apparatus according to any one of claims 10 to 16 further comprising a display for displaying N fluorescent signals corresponding to the N focal points
18. An apparatus according to any one of claims 10 to 17 wherein the modulator is configured to modulate the frequency of each of the N frequencies to be over 100 times greater than the highest frequency of the fluorescence signal
19. An apparatus according to any one of claims 10 to 18 wherein the modulator is configured to modulate the frequency frequencies U to fN of the N sub beams are separated by at least a frequency of 2kHz .
PCT/EP2010/061961 2009-08-24 2010-08-17 Method of and apparatus for imaging a cellular sample WO2011023593A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP09305784.2 2009-08-24
EP09305784 2009-08-24

Publications (1)

Publication Number Publication Date
WO2011023593A1 true WO2011023593A1 (en) 2011-03-03

Family

ID=41467333

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2010/061961 WO2011023593A1 (en) 2009-08-24 2010-08-17 Method of and apparatus for imaging a cellular sample

Country Status (1)

Country Link
WO (1) WO2011023593A1 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ITMO20130078A1 (en) * 2013-03-25 2014-09-26 Angelo Egidio D IMAGE GENERATION METHOD OF A FLUORESCENT SAMPLE
WO2014155262A1 (en) * 2013-03-25 2014-10-02 Gandolfi Daniela An image forming method of a fluorescent sample
WO2015156780A1 (en) * 2014-04-08 2015-10-15 Pandata Research Llc Optical detection system including at least one of a modulated source or modulated detector
WO2015156783A1 (en) * 2014-04-08 2015-10-15 Pandata Research Llc Optical detection system including a micromirror array
JP2016504598A (en) * 2013-01-09 2016-02-12 ザ リージェンツ オブ ザ ユニバーシティ オブ カリフォルニアThe Regents Of The University Of California Apparatus and method for fluorescence imaging using radio frequency multiplex excitation
JP2017049447A (en) * 2015-09-02 2017-03-09 オリンパス株式会社 Laser microscope and microscope observation method
US9846313B2 (en) 2008-09-25 2017-12-19 The Trustees Of Columbia University In The City Of New York Devices, apparatus and method for providing photostimulation and imaging of structures
US20180073976A1 (en) * 2015-06-23 2018-03-15 Olympus Corporation Image-obtaining device and image-obtaining method
US10006852B2 (en) 2016-09-13 2018-06-26 Becton, Dickinson And Company Flow cytometer with optical equalization
US10036699B2 (en) 2014-03-18 2018-07-31 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US10078045B2 (en) 2015-10-13 2018-09-18 Omega Biosystems Incorporated Multi-modal fluorescence imaging flow cytometry system
US10209502B2 (en) 2014-04-24 2019-02-19 Olympus Corporation Microscope and microscopy method
US10324019B2 (en) 2016-03-17 2019-06-18 Becton, Dickinson And Company Cell sorting using a high throughput fluorescence flow cytometer
US10401293B2 (en) 2015-09-15 2019-09-03 Olympus Corporation Microscope and microscope observation method
US10935485B2 (en) 2016-05-12 2021-03-02 Bd Biosciences Fluorescence imaging flow cytometry with enhanced image resolution
US11513058B2 (en) 2020-05-19 2022-11-29 Becton, Dickinson And Company Methods for modulating an intensity profile of a laser beam and systems for same
US11680889B2 (en) 2020-06-26 2023-06-20 Becton, Dickinson And Company Dual excitation beams for irradiating a sample in a flow stream and methods for using same
WO2023109603A1 (en) * 2021-12-16 2023-06-22 赛默飞世尔(上海)仪器有限公司 Method and system for spectroscopic determination of sample, and flow cytometer
US11703800B2 (en) 2018-03-21 2023-07-18 The Board Of Trustees Of The Leland Stanford Junior University Methods for temporal and spatial multiplexing of spatial light modulators and systems for same
US11971343B2 (en) 2023-05-02 2024-04-30 Becton, Dickinson And Company Dual excitation beams for irradiating a sample in a flow stream and methods for using same

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5745437A (en) * 1996-08-05 1998-04-28 Wachter; Eric A. Method and apparatus for coherent burst ranging
WO2001066030A1 (en) * 2000-03-09 2001-09-13 Photogen, Inc. Methods and apparatus for optical imaging
US20020134921A1 (en) * 2001-03-21 2002-09-26 Cathey, Wade Thomas High speed confocal microscope
JP2004191251A (en) * 2002-12-12 2004-07-08 Olympus Corp Fluorescence spectroscopic analyzer
EP1548481A1 (en) * 2002-09-30 2005-06-29 Japan Science and Technology Agency Cofocal microscope, fluorescence measuring method and polarized light measuring metod using cofocal microscope
US20060209399A1 (en) * 2005-02-28 2006-09-21 Yokogawa Electric Corporation Confocal microscope
WO2007115357A1 (en) * 2006-04-10 2007-10-18 Mycrolab Pty Ltd Imaging apparatus with a plurality of shutter elements
EP2053442A1 (en) * 2007-10-24 2009-04-29 Olympus Corporation Scanning laser microscope

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5745437A (en) * 1996-08-05 1998-04-28 Wachter; Eric A. Method and apparatus for coherent burst ranging
WO2001066030A1 (en) * 2000-03-09 2001-09-13 Photogen, Inc. Methods and apparatus for optical imaging
US20020134921A1 (en) * 2001-03-21 2002-09-26 Cathey, Wade Thomas High speed confocal microscope
EP1548481A1 (en) * 2002-09-30 2005-06-29 Japan Science and Technology Agency Cofocal microscope, fluorescence measuring method and polarized light measuring metod using cofocal microscope
JP2004191251A (en) * 2002-12-12 2004-07-08 Olympus Corp Fluorescence spectroscopic analyzer
US20060209399A1 (en) * 2005-02-28 2006-09-21 Yokogawa Electric Corporation Confocal microscope
WO2007115357A1 (en) * 2006-04-10 2007-10-18 Mycrolab Pty Ltd Imaging apparatus with a plurality of shutter elements
EP2053442A1 (en) * 2007-10-24 2009-04-29 Olympus Corporation Scanning laser microscope

Non-Patent Citations (16)

* Cited by examiner, † Cited by third party
Title
CENTONZE V E ET AL: "Multiphoton excitation provides optical sections from deeper within scattering specimens than confocal imaging", BIOPHYSICAL JOURNAL BIOPHYS. SOC USA, vol. 75, no. 4, October 1998 (1998-10-01), pages 2015 - 2024, XP002600914, ISSN: 0006-3495 *
CHEN, N.; C. H. WONG ET AL.: "Focal modulation microscopy", OPT EXPRESS, vol. 16, no. 23, 2008, pages 18764 - 9
DENK ET AL.: "Two-photon laser scanning fluorescence microscopy", SCIENCE, vol. 248, no. 4951, 1990, pages 73 - 6
GARASCHUK ET AL.: "Optical monitoring of brain function in vivo: from neurons to networks", PFLUQERS ARCH, vol. 453, no. 3, 2006, pages 385 - 96
GOLAY M J E: "Multi-slit spectrometry", JOURNAL OF THE OPTICAL SOCIETY OF AMERICA USA, vol. 39, June 1949 (1949-06-01), pages 437 - 444, XP002600915 *
GOLAY, M. J. E.: "Complementary Series", IRE TRANSACTIONS ON INFORMATIONTHEORV, 1961, pages 82 - 87
GOLAY: "Multi-Slit Spectrometry", JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, vol. 39, no. 6, 1949, pages 437 - 444
GREWE ET AL.: "High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision", NAT METHODS, vol. 7, no. 5, pages 399 - 405
JAMES B. PAWLEY: "Handbook of Biological Confocal Microscopy", 2006, SPRINGER SCIENCE+BUSINESS MEDIA, LLC, Singapore, article WINFRIED DENK ET AL.: "Multi-Photon Molecular Excitation in Laser-Scanning Microscopy", pages: 535 - 542, XP002600916 *
KONIG: "Multiphoton microscopy in life sciences", J MICROSC, vol. 200, 2000, pages 83 - 104
LILLIS ET AL.: "Two-photon imaging of spatially extended neuronal network dynamics with high temporal resolution", J NEUROSCI METHODS, vol. 172, no. 2, 2008, pages 178 - 84
LUTZ ET AL.: "Holographic photolysis of caged neurotransmitters", NAT METHODS, vol. 5, no. 9, 2008, pages 821 - 7
NIKOLENKO ET AL.: "SLM Microscopy: Scanless Two-Photon Imaging and Photostimulation with Spatial Light Modulators", FRONT NEURAL CIRCUITS, vol. 2, 2008, pages 5
OTSU ET AL.: "Optical monitoring of neuronal activity at high frame rate with a digital random-access multiphoton (RAMP) microscope", J NEUROSCI METHODS, vol. 173, no. 2, 2008, pages 259 - 70
PAPAGIAKOUMOU ET AL.: "Patterned two-photon illumination by spatiotemporal shaping of ultrashort pulses", OPT EXPRESS, vol. 16, no. 26, 2008, pages 22039 - 47
WILT ET AL.: "Advances in light microscopy for neuroscience", ANNU REV NEUROSCI, vol. 32, 2009, pages 435 - 506

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11531207B2 (en) 2008-09-25 2022-12-20 The Trustees Of Columbia University In The City Of New York Devices, apparatus and method for providing photostimulation and imaging of structures
US9846313B2 (en) 2008-09-25 2017-12-19 The Trustees Of Columbia University In The City Of New York Devices, apparatus and method for providing photostimulation and imaging of structures
US9983132B2 (en) 2013-01-09 2018-05-29 The Regents Of The University Of California Apparatus and methods for fluorescence imaging using radiofrequency-multiplexed excitation
US11327016B2 (en) 2013-01-09 2022-05-10 The Regents Of The University Of California Apparatus and methods for fluorescence imaging using radiofrequency-multiplexed excitation
JP2016504598A (en) * 2013-01-09 2016-02-12 ザ リージェンツ オブ ザ ユニバーシティ オブ カリフォルニアThe Regents Of The University Of California Apparatus and method for fluorescence imaging using radio frequency multiplex excitation
US10408758B2 (en) 2013-01-09 2019-09-10 The Regents Of The University Of California Apparatus and methods for fluorescence imaging using radiofrequency-multiplexed excitation
US11371937B2 (en) 2013-01-09 2022-06-28 The Regents Of The University Of California Apparatus and methods for fluorescence imaging using radiofrequency-multiplexed excitation
WO2014155262A1 (en) * 2013-03-25 2014-10-02 Gandolfi Daniela An image forming method of a fluorescent sample
ITMO20130078A1 (en) * 2013-03-25 2014-09-26 Angelo Egidio D IMAGE GENERATION METHOD OF A FLUORESCENT SAMPLE
US10222316B2 (en) 2014-03-18 2019-03-05 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US10451538B2 (en) 2014-03-18 2019-10-22 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US10036699B2 (en) 2014-03-18 2018-07-31 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US11630053B2 (en) 2014-03-18 2023-04-18 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US10845295B2 (en) 2014-03-18 2020-11-24 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US11280718B2 (en) 2014-03-18 2022-03-22 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
US11946851B2 (en) 2014-03-18 2024-04-02 The Regents Of The University Of California Parallel flow cytometer using radiofrequency multiplexing
WO2015156783A1 (en) * 2014-04-08 2015-10-15 Pandata Research Llc Optical detection system including a micromirror array
WO2015156780A1 (en) * 2014-04-08 2015-10-15 Pandata Research Llc Optical detection system including at least one of a modulated source or modulated detector
US10209502B2 (en) 2014-04-24 2019-02-19 Olympus Corporation Microscope and microscopy method
US20180073976A1 (en) * 2015-06-23 2018-03-15 Olympus Corporation Image-obtaining device and image-obtaining method
EP3141942A1 (en) * 2015-09-02 2017-03-15 Olympus Corporation Laser microscope and microscopy method
JP2017049447A (en) * 2015-09-02 2017-03-09 オリンパス株式会社 Laser microscope and microscope observation method
US10401293B2 (en) 2015-09-15 2019-09-03 Olympus Corporation Microscope and microscope observation method
US10288546B2 (en) 2015-10-13 2019-05-14 Omega Biosystems Incorporated Multi-modal fluorescence imaging flow cytometry system
US11692926B2 (en) 2015-10-13 2023-07-04 Becton, Dickinson And Company Multi-modal fluorescence imaging flow cytometry system
US10935482B2 (en) 2015-10-13 2021-03-02 Becton, Dickinson And Company Multi-modal fluorescence imaging flow cytometry system
US10684211B2 (en) 2015-10-13 2020-06-16 Omega Biosystems Incorporated Multi-modal fluorescence imaging flow cytometry system
US11940369B2 (en) 2015-10-13 2024-03-26 Becton, Dickinson And Company Multi-modal fluorescence imaging flow cytometry system
US10078045B2 (en) 2015-10-13 2018-09-18 Omega Biosystems Incorporated Multi-modal fluorescence imaging flow cytometry system
US11366052B2 (en) 2015-10-13 2022-06-21 Becton, Dickinson And Company Multi-modal fluorescence imaging flow cytometry system
US10620111B2 (en) 2016-03-17 2020-04-14 Becton, Dickinson And Company Cell sorting using a high throughput fluorescence flow cytometer
US11105728B2 (en) 2016-03-17 2021-08-31 Becton, Dickinson And Company Cell sorting using a high throughput fluorescence flow cytometer
US11774343B2 (en) 2016-03-17 2023-10-03 Becton, Dickinson And Company Cell sorting using a high throughput fluorescence flow cytometer
US10324019B2 (en) 2016-03-17 2019-06-18 Becton, Dickinson And Company Cell sorting using a high throughput fluorescence flow cytometer
US10935485B2 (en) 2016-05-12 2021-03-02 Bd Biosciences Fluorescence imaging flow cytometry with enhanced image resolution
US10823658B2 (en) 2016-09-13 2020-11-03 Becton, Dickinson And Company Flow cytometer with optical equalization
US11698334B2 (en) 2016-09-13 2023-07-11 Becton, Dickinson And Company Flow cytometer with optical equalization
US10006852B2 (en) 2016-09-13 2018-06-26 Becton, Dickinson And Company Flow cytometer with optical equalization
US11703800B2 (en) 2018-03-21 2023-07-18 The Board Of Trustees Of The Leland Stanford Junior University Methods for temporal and spatial multiplexing of spatial light modulators and systems for same
US11513058B2 (en) 2020-05-19 2022-11-29 Becton, Dickinson And Company Methods for modulating an intensity profile of a laser beam and systems for same
US11680889B2 (en) 2020-06-26 2023-06-20 Becton, Dickinson And Company Dual excitation beams for irradiating a sample in a flow stream and methods for using same
WO2023109603A1 (en) * 2021-12-16 2023-06-22 赛默飞世尔(上海)仪器有限公司 Method and system for spectroscopic determination of sample, and flow cytometer
US11971343B2 (en) 2023-05-02 2024-04-30 Becton, Dickinson And Company Dual excitation beams for irradiating a sample in a flow stream and methods for using same

Similar Documents

Publication Publication Date Title
WO2011023593A1 (en) Method of and apparatus for imaging a cellular sample
JP7050983B2 (en) Multimode fluorescence imaging flow cytometry system
JP5894180B2 (en) Microscope inspection with improved depth resolution
JP3731073B2 (en) Microscope equipment
Nikolenko et al. SLM microscopy: scanless two-photon imaging and photostimulation using spatial light modulators
US10024793B2 (en) Method for three-dimensional high resolution localization microscopy
JP5687201B2 (en) Combined microscopy
JP2019521316A (en) Fluorescence imaging flow cytometry with improved image resolution
JP2016526185A5 (en)
WO2016054118A1 (en) Non-linear structured illumination microscopy
EP2721442B1 (en) Method and apparatus for imaging a structure marked with a fluorescent dye
US20220205919A1 (en) Widefield, high-speed optical sectioning
JP2010505094A (en) Luminescence microscopy with increased resolution
US20220043246A1 (en) Microscope and method for microscopic image recording with variable illumination
US20130126756A1 (en) Fluorescence imaging apparatus and method
Pozzi et al. High-throughput spatial light modulation two-photon microscopy for fast functional imaging
US20240035950A1 (en) Method and microscope for recording trajectories of individual particles in a sample
CN110114709A (en) Determine the method and microscope of fluorescence intensity
EP1318389A2 (en) Method of and system for analyzing a sample containing a plurality of fluorescent substances
EP3520074B1 (en) Method for the analysis of spatial and temporal information of samples by means of optical microscopy
CN109900671B (en) Full-automatic TCSPC-FLIM system based on DMD (digital micromirror device) calculation holographic scanning and time detection method
US20220057329A1 (en) Method and apparatus for detecting fluorescence signals in a three-dimensional region of a sample
CN113056696A (en) Microscope and method of microscopy
US20070035734A1 (en) Device and method for measuring the optical properties of an object
CN111103678B (en) Lattice light sheet microscope and method for tiling lattice light sheets in a lattice light sheet microscope

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10742845

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10742845

Country of ref document: EP

Kind code of ref document: A1