US20140320601A1 - Apparatus and method for an inclined single plane imaging microscope box (ispim box) - Google Patents

Apparatus and method for an inclined single plane imaging microscope box (ispim box) Download PDF

Info

Publication number
US20140320601A1
US20140320601A1 US13/873,159 US201313873159A US2014320601A1 US 20140320601 A1 US20140320601 A1 US 20140320601A1 US 201313873159 A US201313873159 A US 201313873159A US 2014320601 A1 US2014320601 A1 US 2014320601A1
Authority
US
United States
Prior art keywords
sample
objective
microscope
light beams
excitation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/873,159
Other versions
US9874736B2 (en
Inventor
Francesco Cutrale
Enrico Gratton
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of California
Original Assignee
University of California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of California filed Critical University of California
Priority to US13/873,159 priority Critical patent/US9874736B2/en
Assigned to THE REGENTS OF THE UNIVERSITY OF CALIFORNIA reassignment THE REGENTS OF THE UNIVERSITY OF CALIFORNIA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CUTRALE, FRANCESCO, DR., GRATTON, ENRICO, DR.
Publication of US20140320601A1 publication Critical patent/US20140320601A1/en
Application granted granted Critical
Publication of US9874736B2 publication Critical patent/US9874736B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H04N13/02
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B2207/00Coding scheme for general features or characteristics of optical elements and systems of subclass G02B, but not including elements and systems which would be classified in G02B6/00 and subgroups
    • G02B2207/113Fluorescence

Definitions

  • the disclosure relates to the field of single plane Illumination microscopy (SPIM).
  • SPIM single plane Illumination microscopy
  • SPIM selective plane illumination microscopy
  • HILO highly Inclined and laminated optical sheet microscopy
  • SPIM Single plane Illumination microscopy
  • SPIM single plane illumination microscopy
  • the fluorescence is detected with a second objective at 90 degrees with respect to the objective used for excitation.
  • SPIM systems lead to high throughput since data are easily shifted from the acquisition of the single plane to volumetric display.
  • SPIM SPIM with respect to the confocal arrangement
  • SPIM is currently not widespread due to the lack of commercial systems.
  • samples need to be prepared within a narrow capillary which prevents the applicability of SPIM to dish based cell cultures (the most used sample preparation modality in cell microscopy).
  • OPM oblique plane microscope
  • the problem of fast volumetric acquisition was solved using spinning disc confocal microscopy (or Nipkow disc).
  • the main disadvantages to overcome are the following. Spinning disc technology is based on confocal microscopy therefore the entire sample is illuminated and through a pinhole array only the section of interest is imaged. This causes high photo-bleaching, energy load and phototoxicity with a low efficiency of the system. Rotation of the disc causes gyroscopic effect which affects images when acquired at high speed Nipkow disc pinhole size is fixed. As a consequence the signal to noise ratio decreases notably with the increase of the z-position. Excitation field is not uniform due to construction. The problem is overcome using SPIM or OPM, but with the aforementioned disadvantages, in particular both systems need to be home built, thus microscopy development knowledge is necessary.
  • the illustrated embodiments of the invention are directed to a variant of SPIM that has all the advantages of the SPIM technology including that it can operate on samples prepared with standard protocols including dish cell cultures.
  • a SPIM system in which the light sheet is produced at an angle.
  • Our setup can be installed as an add-on into any standard commercial microscope. It uses only one objective lens in proximity of the sample and a second objective along the emission path.
  • These embodiments allow us to use standard modalities for sample preparation and insertion while the SPIM effect is done elsewhere in the microscope, far from the sample. Since the light goes through the sample at an angle, we called these embodiments the iSPIM (inclined SPIM).
  • the main use of the iSPM Box of the illustrated embodiments is microscopy imaging, in particular for three dimensional volumetric acquisition. It is also possible to perform fluorescence correlation spectroscopy (FCS) on the images acquired.
  • the inclined single plane illumination microscopy (iSPIM) box is a single-sided add-on module that allows user to perform iSPIM on virtually any microscope body.
  • the system is intended for imaging biological samples with a fast volumetric acquisition to produce three dimensional images. It finds application in any bioimaging related field that makes use of fluorescence for imaging.
  • iSPIM is based on the single plane illumination microscopy principle. It uses a cylindrical lens to create a thin laser sheet which optically sections the sample with high efficiency of light illumination and detection. As a consequence of this high efficiency the sample undergoes a consistently reduced photo-bleach and energy load.
  • the acquisition speed of the system is the highest among microscopy systems.
  • the limitation of OPM which requires the construction of a new microscope body is lacking in the iSPIM box construction.
  • the iSPIM box makes the SPIM principle available to a large community of microscopists.
  • the components necessary for performing OPM are contained in a small size box and prealigned.
  • the box can be plugged in any commercial body microscope. Therefore construction of the system is simplified and the iSPIM box can be used in all research fields which make use of commercial microscopes.
  • the stage is not only motorized but also programmable.
  • the stage commonly found in commercial microscopes is the only moving component and is used for moving the sample over the sectioning laser sheet.
  • An array of positions can be easily programmed on the stage thus upon reaching desired position an electronic trigger is sent from the stage controller unit to the camera device for synchronizing acquisition.
  • a microscope software suite has been programmed to simplify this process. The easily obtained sequence of sections is then assembled into a volumetric dataset.
  • iSPIM Box over Nipkow disc based microscopy systems include: only the section of interest is illuminated, consequently efficiency of the system increases and photo-bleaching, photo-toxicity, energy load decrease consistently; two-photon excitation can be used to exploit modern large frame-fast cameras (scMOS); no gyroscopic noise is present no pinhole is used, thus signal to noise ratio is constant along z-position excitation field is uniform; and no calculation is necessary to obtain a sectioned image.
  • iSPIM Box over single plane imaging microscopy (SPIM) system include: construction complexity is reduced; only one objective close to the sample is necessary, thus higher numerical aperture can be used which increases light collection efficiency; no particular sample preparation is necessary, thus standard cell imaging is possible; and there is no necessity to home build the microscope system.
  • iSPIM Box over oblique plane microscopy (OPM) system include: construction is simplified; no microscopy development knowledge is necessary for setting up the microscope; components are pre-aligned in the box; box can be connected to commercial body microscopes with universal optical adaptor; system automation, acquisition is simplified and optimized in speed through use of programmable stage and camera; triggered acquisition mosaic (tiled) acquisition is implemented; and software with intuitive graphical user interface (GUI) simplifies microscope control.
  • OPM oblique plane microscopy
  • the illustrated embodiments of the invention include an apparatus for inclined single plane Illumination microscopy of a sample.
  • the apparatus includes a laser for launching excitation light beams at a plurality of wavelengths.
  • the laser could be separately supplied by the user and combined with the following elements.
  • a laser beam expander is provided for expanding the excitation light beams optically.
  • An injection arm is optically coupled to the laser beam expander.
  • a conventional back-to-back microscope system having an first excitation objective and a second collection objective is provided.
  • a universal dichroic mirror is optically coupled to the injection arm to direct the excitation light beams into the conventional back-to-back microscope's first excitation objective onto a sample plane in an imaging plane, and to receive fluorescence light from the sample through the conventional back-to-back microscope objective.
  • a universal optical adaptor has a second collection objective and a third collection objective optically coupled to the universal dichroic mirror.
  • a re-imaging component optically is coupled to the universal optical adaptor.
  • a camera is optically coupled to the re-imaging component.
  • the laser beam expander, injection arm, universal optical adapter, re-imaging component, and camera are combined in a modular unit which is arranged and configured to be coupled to the conventional back-to-back microscope and without perpendicularity between the second and third objectives.
  • the camera could be supplied separately by the user and the above combination of elements could be provided with a camera connector in place of the camera.
  • the excitation light is provided by a laser with output beams with a wavelength of 488 nm and 436 nm.
  • the laser beam is expanded using a beam expander comprised of matching achromatic doublet lenses.
  • the beam expander comprises two mirrors and is connected to a metal base mounted on a manual stage providing vertical translation.
  • the injection arm comprises a metal base, a cylindrical lens and a focusing achromatic lens mounted on to the metal base to ensure pre-aligned optics to maintain a precise distance determined by the foci of the cylindrical lens and focusing achromatic lens for inserting a light sheet into the conventional back-to-back microscope.
  • the dichroic mirror comprises a beam splitter.
  • the injection arm and the beam expander are mounted together on a linear manual stage base that allows the horizontal movement of the injection arm and the beam expander.
  • fluorescent emission light from the sample is refocused using the first excitation objective and a second collection objective of the back-to-back microscope and third collection objective chosen according to an aberration-free rule so that the chosen magnification equals the ratio of n 1 /n 2 , where n 1 is the refraction index of an immersion medium used with the sample and n 2 is the refraction index of the second collection objective.
  • the a re-imaging component comprises a tilted component including a lens turret with a plurality of selectable objectives optically coupled to an achromatic doublet lens which focuses an image on the camera to allow a user to choose among a corresponding plurality of magnifications, depending on typology of the sample.
  • the conventional back-to-back microscope system comprises a microscope stage which is programmable, where a light sheet position and angle coupled by the excitation objective onto the sample are fixed and the only moving component is the microscope stage used for scanning the sample.
  • the microscope stage is programmed to perform an array scan with size, distance and array cell dwell time being customizable.
  • the illustrated embodiments of the invention include a method of operation of the above apparatus.
  • FIG. 1 a is a top plan view of the layout of the illustrated embodiment of the invention.
  • FIG. 1 b is a side plan view of the layout of the illustrated embodiment of the invention.
  • FIG. 1 c is a perspective view of the layout of the illustrated embodiment of the invention.
  • FIG. 1 d is a diagrammatic view of the illustrated embodiment of the invention.
  • FIG. 2 is a diagram depicting a geometrical model for the excitation angle.
  • FIGS. 3 a - 3 d are images of live MMT cell line acquired with iSPIM. Scale bars are 10 ⁇ m in FIGS. 3 a and 3 b , which is a which is a 98 frame stack; FIG. 3 c is a 280 frame stack; and FIG. 3 d a 361 frame stack.
  • FIGS. 4 a - 4 d are a comparison with confocal images of the same sample collected with Olympus FV1000 using comparable optical settings to iSPIM.
  • FIG. 4 a , 4 c show the comparison of images of live MMT cell line acquired with confocal and
  • FIG. 4 b , 4 d show the iSPIM image.
  • FIGS. 4 a and 4 b represent the x-z view.
  • FIGS. 4 c and 4 d show the view of x-y plane.
  • FIGS. 5 a and 5 b show the mosaic capability of the system a tiled acquisition of 9012 frames full frame resolution (512 by 512 pixels) acquired with iSPIM. Scale bar is 100 ⁇ m.
  • FIG. 6 is an isometric representation of outlining the volumetric acquisition of the specimen through iSPIM.
  • the disclosed system for inclined selective plane illumination microscope with shares the advantages of OPM and that can be used as an add-on to commonly used microscopes, such as a conventional IX-71 Olympus microscope, simplifying the construction of the OPM and increasing performance of a conventional microscope.
  • the primary components include: a laser input connector or laser 10 , a beam expanding component 12 , an universal dichroic component 13 to separate fluorescence from excitation light, an universal optical adaptor 14 , a re-imaging component 15 , and a camera output connector 16 .
  • FIG. 1 d is a typical setup of an iSPIM.
  • Laser beam from laser 10 is inserted into a 10 ⁇ beam expander 12 and reflected by a mirror 14 both mounted on a vertically moving component 17 .
  • Cylindrical lens 18 and achromatic doublet 20 are mounted on the “injection arm” 22 .
  • the dichroic mirror 13 reflects the beam vertically into the back aperture of the objective 24 which is directed in turn onto specimen 46 .
  • the emission light collected through objective 24 is reflected out of the body microscope, redirected by mirror 28 into a tube containing two achromatic doublet lenses 26 .
  • the virtual image is formed after the second objective 30 .
  • Objective 32 is mounted on an objective wheel 33 . Virtual plane light is collected and the resulting image is focused on the camera 34 through tube lens 36 .
  • the excitation light is provided by a laser launcher 10 (ISS, Champaign Ill.) at 488 nm and 436 nm.
  • the laser beam is expanded ( ⁇ 10) using a custom beam expander 12 built with matching achromatic doublet lenses (Achromatic Doublet Lens 5 mm Dia ⁇ 10 mm FL, MgF2 Coating and Achromatic Doublet Lens 25 mm Dia. ⁇ 100 mm FL, MgF2 Coating NT32-327, Edmund Optics, Düsseldorf, Germany).
  • Component 12 with two mirrors, is connected to a metal base mounted on a vertical manual stage 17 .
  • the “injection arm” 22 includes a cylindrical lens 18 and a focusing achromatic lens 20 (Edmund Optics, Lens Cyl 10 ⁇ 20 ⁇ 75 mm FL VIS-NIR, Lens Ach 25 ⁇ 75 mm MgF2 TS) on to the same metal base 22 .
  • This ensures the pre-aligned optics to maintain the precise distance of the 150 mm determined by the lenses focuses.
  • it also serves as optical adaptor for inserting the light sheet in a commercial body microscope, in this case an IX-71 Olympus.
  • the apochromatic lens 20 in fact refocuses the light on to the back aperture of the microscope objective 24 .
  • the dichroic mirror 13 used is a beam splitter 20/80 (21008 20/80 Beam splitter, Chroma).
  • the “injection arm” 22 and the assembly 17 containing the vertically moving beam expander 12 are mounted on a linear manual stage base 38 that allows the horizontal movement and vertical movement of the elements mounted on or coupled to stage base 38 .
  • Mounted on stage base 38 are mirror 14 and assembly 17 .
  • Element 22 is not mounted on stage 38 , since it is a fixed platform that mounts lenses 18 and 20 .
  • the emission light is refocused using a back-to-back microscope system comprised of the first objective 24 (UPlanApo 60 ⁇ /1.35 oil immersion, Olympus) and lens 26 , lens 36 and the second objective 30 (UPlanApo 40 ⁇ /0.85 air objective, Olympus).
  • the objectives 24 and 30 are chosen according to the aberration-free rule from Botcherby (Botcherby et al., 2008), thus the chosen magnification must equal the ratio of n 1 /n 2 , where n 1 is the refraction index of the immersion medium of the specimen and n 2 is the refraction index of the second objective 30 . Since the first objective 24 is an oil objective, the magnification is chosen to be 1.5 ⁇ .
  • the tilted component includes a lens turret (not shown) with a third objective selected from those mounted on the lens turret, such as 40 ⁇ (LucplFln 40 ⁇ /0.60 air objective, Olympus) and a 10 ⁇ (UPlanApo 10/0.40 air objective, collectively denoted by objective 32 , Olympus) followed by an achromatic doublet lens 36 (Edmund Optics, Lens Ach 50 ⁇ 350 MgF2 TS) which focuses the image on the sensor of an EMCCD camera 34 (Evolve 512, Photometrics, Arlington, Ariz.). This allows the user to choose among two magnifications, depending on typology of specimen.
  • a third objective selected from those mounted on the lens turret, such as 40 ⁇ (LucplFln 40 ⁇ /0.60 air objective, Olympus) and a 10 ⁇ (UPlanApo 10/0.40 air objective, collectively denoted by objective 32 , Olympus) followed by an a
  • the microscope stage 14 in use is programmable (Applied Scientific Instruments, MS-2000 Eugene, Oreg.). Since the light sheet position and angle are fixed, the only moving component is the stage 14 . This is used for scanning through the sample.
  • the stage 14 has been programmed to perform an array scan. Size, distance and array cell dwell time are customizable. Upon reaching a new position the stage 14 sends a TTL pulse to the trigger port of the camera 34 , initializing acquisition. The camera 34 , set to image in triggered mode, outputs a TTL pulse when reaching ‘frame readout’. In a feedback loop this pulse is used to activate stage motion to the next position.
  • the acquisition algorithm written in Matlab with C++, optimizes acquisition times considering exposure time, read out, dwell time and time to reach next position on the stage.
  • the acquisition protocol has been simplified by programming a user friendly graphical user interface that guides the user along the acquisition steps. Algorithms for mosaic/tiled acquisition have been implemented. Other acquisition schemes can be readily accommodated in the illustrated embodiments.
  • the full width half maximum (FWHM) of the light sheet on the sample is 2.6 ⁇ m whereas the confocal parameter is 80 ⁇ m.
  • FIG. 1 is a diagram depicting a geometrical model for the excitation angle.
  • a geometrical model for excitation angle, acceptance angle and emission (Dunsby, 2008) is presented in FIG. 2 , where ⁇ is the acceptance angle of the first objective, ⁇ ex the half angle of the excitation sheet, ⁇ em the half angle of the emission.
  • An objective lens is represented with acceptance angle 8 .
  • the light sheet 40 has an half angle of the excitation ⁇ ex .
  • the sample 42 has a half angle of emission ⁇ em . Considering illumination and collection separated by ⁇ /2 it is possible to obtain the equation (Dunsby, 2008):
  • NA numerical aperture
  • the angle subtended by the laser sheet with the first objective, a is set to be 30 degrees whereas the FWHM of the focal spot is 344 nm.
  • samples of MMT cell line (American Type Culture Collection, CCL-51) transfected with H2B-EGFP are prepared on standard culture dishes (MatTek, Ashland, Mass.) coated with fibronectin. Cells are imaged live after overnight seeding and further fixed. Fixation is done with PFA (Paraformaldehyde) and mounting media (polyvinyl alcohol mounting medium with DABCO, antifading-10981) for further sampling. Imaging is performed using 488 nm laser and shifting the sample with the stage movement. The dataset is then corrected for the acquisition geometry, shearing the frames accordingly. Rendering is performed using Amira, (San Diego, Calif.).
  • FIGS. 3 a - 3 d are images of live MMT H2B-EGFP acquired with iSPIM with a step size of 0.5 ⁇ m.
  • the fluorescence signal derives from the nucleus. Renderings are in color, whereas reference section slices are in grayscale. Scale bars are 10 ⁇ m in FIGS. 3 a and 3 b , which is a 98 frames stack; FIG. 3 c is a 280 frames stack; and FIG. 3 d a 361 frames stack.
  • FIGS. 4 a - 4 d A comparison with confocal images of the same sample collected with Olympus FV1000 using comparable optical settings to iSPIM is shown in FIGS. 4 a - 4 d .
  • Scale bars are 20 ⁇ m.
  • FIGS. 4 a and 4 b represent the x-z view. The lateral resolution observed is comparable to confocal.
  • FIGS. 4 c and 4 d show the view of x-y plane. The advantage of gray levels of camera-based acquisition is noticeable.
  • the confocal acquisition is performed using comparable settings to the iSPIM system and considering that the zooming function of a confocal microscope is not applicable to a SPIM system.
  • This section is a 30 degrees angle section of the sample.
  • FIG. 5 is a mosaic of 9012 frames 512 ⁇ 512 pixels acquired with iSPIM. Scale bar is 100 ⁇ m. Due to size issues dataset has been down sampled a factor of 2 to allow visualization.
  • FIG. 5 a is a vertical view; and FIG. 5 b is an inclined view with reference plane resulting from stitched frames.
  • the fluorescence image corresponds to single cell nuclei.
  • the resulting images show appreciable resolution that, in consideration of the acquisition speed, and demonstrate the potential of this imaging method.
  • the mosaic size of 9012 frames results in a manageable raw file of 4.6 GB which after stitching and shifting, considering 30% overlap and conversion to TIFF format, weights 4 GB, yielding 2061 ⁇ 1273 ⁇ 751 volumetric pixel size.
  • iSPIM has the capability of sectioning the sample with a simple linear translation of the specimen over the light sheet.
  • the only moving component in the setup is in fact the stage 14 .
  • This setup still shows extensive optics as in Dunsby's prototype. Nevertheless the system has improved stability and simplified alignment. Once aligned the components do not require any further movement.
  • Critical alignment points are the laser sheet insertion into the microscope and the tilting component between the second and third objective.
  • the block 38 containing vertically moving mirror 14 , beam expander 12 and secondary mirror 28 , together with the block of the “injection arm” 22 have been pre-aligned and mounted on a single axis manual translation stage 38 . It is critical that the light sheet has the correct angle subtended with the first objective lens 24 . This angle depends on the entrance angle of the beam on the back aperture of the objective 24 .
  • the tilting component is another important alignment point of the system.
  • the addition of the objective wheel and thus the possibility to change the final magnification, increases the demand for a simplified and quick repositioning of the third objective 32 .
  • the solution adopted in this setup is to uncouple the block 33 with third objective 32 from the camera arm 34 .
  • the filter wheel is mounted on an x-y-z manual translation stage 33 . As a consequence switching between objectives 32 and adjusting for different working distance is performed with reduced time expense.
  • FIG. 6 outlines the volumetric acquisition through iSPIM.
  • the image represents an objective 24 with inclined light sheet excitation 44 exiting the lens 24 .
  • the specimen 46 placed over the objective 24 is thus sectioned by the excitation light yielding a real volume 48 subtended by the inclined light sheet, that is a three dimensional parallelogram.
  • a relevant point regards the three dimensional data acquired.
  • the camera device 34 continuously acquires data in a single sequenced-not-spaced vector. As a consequence when the raw data is rendered the resulting volume is cubical.
  • the physical volume has a parallelogram shape in cross-section. It is then necessary to post-process the data shifting each frame accordingly to render the correct physical volume ( FIG. 5 ).
  • Mosaic acquisition is achieved through programming of the MS-2000 ASI stage controller so that an array can be acquired with custom chosen overlap.
  • a serpentine mode has been used to optimize acquisition time.
  • the frames collected are then stitched using the fast algorithm developed by Preibisch et al (Preibisch et al., 2009) implemented in FIJI (ImageJ).
  • FIJI ImageJ
  • the final composite image is then processed for volumetric rendering. This process, due to the number of frames collected, consistently increases the size of the final data file.
  • One common problem in the field is related to a huge dataset volumetric representation.
  • a possible solution is the increase of random access memory of the computer in use.
  • a constant increase in datasets can be expected.
  • the illustrated embodiments of the invention show an inclined selective plane illumination device as an adaptor for commercial or conventional body microscopes.
  • the original oblique plane microscope (Dunsby, 2008) it carries the same advantages of SPIM systems, but with simplified mechanical component and through-the-objective TIRF-like operation. It furthermore allows the user to maintain standard sample preparation and standard horizontal positioning of the sample.
  • results presented demonstrate the potential of the system when applied to cellular imaging.
  • the capability to acquire volumetric information by simply translating the sample in a direction and the iteration of this to form of mosaic is shown in the images.
  • the competing limiting factors are camera acquisition speed, camera pixel size and stage movement speed.
  • Using Sci-CMOS cameras could allow higher acquisition speed with reduced pixel dimension, increasing the resolution but with the trade off of a lower sensitivity.
  • Optimization of stage movement, considering still time during exposure and acceleration value during camera readout will also decrease acquisition time.
  • the optomechanical design is enhanced to provide simplified alignment among the critical points of the system, defining an increased stability of the system.
  • the optical components are chosen with the perspective of multicolor imaging, yielding the possibility to image multiple channels.

Abstract

An apparatus for inclined single plane Illumination microscopy of a sample includes a laser for launching excitation light beams at a plurality of wavelengths, a laser beam expander, an injection arm optically coupled to the laser beam expander, a conventional back-to-back microscope system, a universal dichroic mirror optically coupled to the injection arm to direct the excitation light beams into the conventional back-to-back microscope onto a sample plane in an imaging plane, and to receive fluorescence light from the sample, a universal optical adaptor optically coupled to the universal dichroic mirror, a re-imaging component optically coupled to the universal optical adaptor; and a camera output connector optically coupled to the re-imaging component, where the laser beam expander, injection arm, universal optical adapter, re-imaging component, and camera are combined in a modular unit which is arranged and configured to be coupled to the conventional back-to-back microscope.

Description

    GOVERNMENT RIGHTS
  • This invention was made with Government support under grant nos. GM076516 and RR003155 awarded by the Institutes of Health. The Government has certain rights in this invention.
  • BACKGROUND
  • 1. Field of the Technology
  • The disclosure relates to the field of single plane Illumination microscopy (SPIM).
  • 2. Description of the Prior Art
  • The need for fast three dimensional microscopy has increased over the years in bio-imaging facilities around the world. In order to respond to this need, use of the confocal microscope principle has been pushed to faster speed such as the spinning disk technology (Nipkow disk optimizations) and fast laser scanning microscopes.
  • Recently, another technique has been proposed, selective plane illumination microscopy (SPIM), a method based on illumination of the sample from the side with a sheet of light. The original idea was described in 1903 (Siedentopf and Zsigmondy, 1903) and pioneered in 1993 (Voie et al., 1993) with the orthogonal plane fluorescence optical sectioning (OPFOS). It was subsequently re-described in a modern incarnation by Huisken et al (2004) who proposed a practical basic setup for SPIM systems.
  • Techniques like SPIM, generally called light-sheet microscopy techniques, are gaining popularity because of the high efficiency in accessing volumetric information of the specimen while minimizing photo-bleaching and energy load. For this reason multiple labs have focused on the development of light-sheet microscopy with higher efficiency and introducing specific advantages. Working on the OPFOS idea, Buytaert (Buytaert and Dirckx, 2007) developed high-resolution orthogonal-plane fluorescence optical sectioning (HROPFOS) with the main advantage of a translating thinner light-sheet. Holekamp et al (2008) with their Objective Coupled Planar Illumination microscopy (OCPI) develop a single-sided light-sheet illumination mounted on the detection lens. The same principle of lateral sectioning through light-sheet was then optimized for large samples with ultramicroscopy by Dodt et al (Dodt et al., 2007) where dual sided light-sheet illumination is implemented and Multidirectional SPIM (mSPIM) by Huisken (Huisken and Stainier, 2007). These developments separate the use of SPIM for large and small specimens establishing the use of cylindrical lenses-shaped beam for large samples while objective-coupled excitation beam as in digital scanned laser light-sheet fluorescence microscopy (DSLM) by Keller et al (2008) was prevailing for small samples.
  • A further development of the SPIM method was proposed by the application of Bessel beams to light sheet microscopy by Planchon et al (Planchon et al., 2011). Their system was not based on cylindrical lenses but rather on a swept-light-sheet obtained by rapidly shifting the Bessel beam on the plane of interest. Despite the innovations in excitation modality and pattern in these designs, the perpendicularity between excitation and collection objectives is maintained, following the main SPIM original design.
  • A different path was proposed by Tokunaga et al (2008) with the highly Inclined and laminated optical sheet microscopy (HILO). Using the same single objective lens the system excites the sample with an oblique light sheet and collects the emitted fluorescence. The main important differences of this method with respect to the SPIM classical formulation reside in the geometry of illumination/detection on the sample. The 90 degrees angle between excitation and collected beams is substituted by a misalignment of emitting plane and focal plane of the objective. The main drawback of HILO resides in the narrow field of view (FOV) due to severe defocusing affecting the regions of the sample depending on the distance from the central focusing line.
  • Following this idea Dunsby (Dunsby, 2008) developed the oblique plane microscope (OPM) that overcomes the limitation of the narrow FOV of HILO. The inspiration comes from the work of Botcherby et al (Botcherby et al., 2008) that solves the issue of aberration of images collected at positions out of the focal plane using a refocusing method before the detector. The application of this optical arrangement to HILO overcomes the limitation of the defocusing problem related to the inclined illumination.
  • Single plane Illumination microscopy (SPIM) was known since the 1930s. It was recently redescribed in a modern incarnation by J. Colombelli, S. W. Grill, and E. H. K. Stelzer, Rev. Sci. Instrum. 75, 472 (2004) in which two separate objectives were used, one to produce the light sheet and the other to collect the fluorescence at 90 degrees. This method rapidly gained importance in the bioimaging field due to its sensitivity and low photophysical damage. However SPIM as described by Stelzer requires the construction of a nonconventional microscope and a particular preparation of the sample that must be inserted in a rotating capillary in between the two objectives.
  • Fast three dimensional microcopy images can be obtained using a spinning disk technology and some very fast laser scanning microscopes. Both approaches are based on the principle of the confocal microscope. In single plane illumination microscopy (SPIM) the sample is excited with a light sheet obtained with an objective and a cylindrical lens. The fluorescence is detected with a second objective at 90 degrees with respect to the objective used for excitation. The increased efficiency and reduced cost of SPIM is attracting widespread interest from the scientific community. SPIM systems lead to high throughput since data are easily shifted from the acquisition of the single plane to volumetric display.
  • Another major advantage of SPIM with respect to the confocal arrangement is reduced photobleaching. SPIM is currently not widespread due to the lack of commercial systems. In the current SPIM system samples need to be prepared within a narrow capillary which prevents the applicability of SPIM to dish based cell cultures (the most used sample preparation modality in cell microscopy).
  • Based on the light sheet illumination principle, oblique plane microscope (OPM) was described by Dunsby in US Patent Publication 2011/0261446 incorporated herein by reference. In the OPM implementation the sample is illuminated in an oblique manner and fluorescence light is collected through the same microscope objective used for excitation. The image is then subsequently tilted using two objectives external to the microscope body and focused into a camera detector. The OPM design still requires a custom constructed microscope.
  • The problem of fast volumetric acquisition was solved using spinning disc confocal microscopy (or Nipkow disc). The main disadvantages to overcome are the following. Spinning disc technology is based on confocal microscopy therefore the entire sample is illuminated and through a pinhole array only the section of interest is imaged. This causes high photo-bleaching, energy load and phototoxicity with a low efficiency of the system. Rotation of the disc causes gyroscopic effect which affects images when acquired at high speed Nipkow disc pinhole size is fixed. As a consequence the signal to noise ratio decreases notably with the increase of the z-position. Excitation field is not uniform due to construction. The problem is overcome using SPIM or OPM, but with the aforementioned disadvantages, in particular both systems need to be home built, thus microscopy development knowledge is necessary.
  • BRIEF SUMMARY
  • The illustrated embodiments of the invention are directed to a variant of SPIM that has all the advantages of the SPIM technology including that it can operate on samples prepared with standard protocols including dish cell cultures. In illustrated embodiments of the invention we disclose a SPIM system in which the light sheet is produced at an angle. Our setup can be installed as an add-on into any standard commercial microscope. It uses only one objective lens in proximity of the sample and a second objective along the emission path. These embodiments allow us to use standard modalities for sample preparation and insertion while the SPIM effect is done elsewhere in the microscope, far from the sample. Since the light goes through the sample at an angle, we called these embodiments the iSPIM (inclined SPIM).
  • The main use of the iSPM Box of the illustrated embodiments is microscopy imaging, in particular for three dimensional volumetric acquisition. It is also possible to perform fluorescence correlation spectroscopy (FCS) on the images acquired. The inclined single plane illumination microscopy (iSPIM) box is a single-sided add-on module that allows user to perform iSPIM on virtually any microscope body. The system is intended for imaging biological samples with a fast volumetric acquisition to produce three dimensional images. It finds application in any bioimaging related field that makes use of fluorescence for imaging. iSPIM is based on the single plane illumination microscopy principle. It uses a cylindrical lens to create a thin laser sheet which optically sections the sample with high efficiency of light illumination and detection. As a consequence of this high efficiency the sample undergoes a consistently reduced photo-bleach and energy load. The acquisition speed of the system is the highest among microscopy systems.
  • In the illustrated embodiments of the invention we incorporate all the optics necessary for the OPM in a single box that can be used as an add-on to existing commercial microscopes. We named this design the inclined single plane illumination microscopy box (iSPIM box). It maintains the same advantage of OPM over original SPIM which are: conventional sample preparation techniques. e.g. glass microscope slides and cell culture dishes may be used; minimal photobleaching, phototoxicity and energy load of the sample; no moving parts required to obtain a two dimensional image-good for imaging dynamics; no calculation required to get sectioned image; good three dimensional imaging when combined with a motorized xy-stage to position the sample
  • The limitation of OPM which requires the construction of a new microscope body is lacking in the iSPIM box construction. The iSPIM box makes the SPIM principle available to a large community of microscopists. The components necessary for performing OPM are contained in a small size box and prealigned. Using an optical adaptor, the box can be plugged in any commercial body microscope. Therefore construction of the system is simplified and the iSPIM box can be used in all research fields which make use of commercial microscopes.
  • Another advantage of the iSPIM box over OPM is the automation of the system, in particular for acquisition. The stage is not only motorized but also programmable. The stage commonly found in commercial microscopes is the only moving component and is used for moving the sample over the sectioning laser sheet. An array of positions can be easily programmed on the stage thus upon reaching desired position an electronic trigger is sent from the stage controller unit to the camera device for synchronizing acquisition. A microscope software suite has been programmed to simplify this process. The easily obtained sequence of sections is then assembled into a volumetric dataset.
  • Advantages of iSPIM Box over Nipkow disc based microscopy systems include: only the section of interest is illuminated, consequently efficiency of the system increases and photo-bleaching, photo-toxicity, energy load decrease consistently; two-photon excitation can be used to exploit modern large frame-fast cameras (scMOS); no gyroscopic noise is present no pinhole is used, thus signal to noise ratio is constant along z-position excitation field is uniform; and no calculation is necessary to obtain a sectioned image.
  • Advantages of iSPIM Box over single plane imaging microscopy (SPIM) system include: construction complexity is reduced; only one objective close to the sample is necessary, thus higher numerical aperture can be used which increases light collection efficiency; no particular sample preparation is necessary, thus standard cell imaging is possible; and there is no necessity to home build the microscope system.
  • Advantages of iSPIM Box over oblique plane microscopy (OPM) system include: construction is simplified; no microscopy development knowledge is necessary for setting up the microscope; components are pre-aligned in the box; box can be connected to commercial body microscopes with universal optical adaptor; system automation, acquisition is simplified and optimized in speed through use of programmable stage and camera; triggered acquisition mosaic (tiled) acquisition is implemented; and software with intuitive graphical user interface (GUI) simplifies microscope control.
  • More particularly the illustrated embodiments of the invention include an apparatus for inclined single plane Illumination microscopy of a sample. The apparatus includes a laser for launching excitation light beams at a plurality of wavelengths. However, it is to be expressly understood that the laser could be separately supplied by the user and combined with the following elements. A laser beam expander is provided for expanding the excitation light beams optically. An injection arm is optically coupled to the laser beam expander. A conventional back-to-back microscope system having an first excitation objective and a second collection objective is provided. A universal dichroic mirror is optically coupled to the injection arm to direct the excitation light beams into the conventional back-to-back microscope's first excitation objective onto a sample plane in an imaging plane, and to receive fluorescence light from the sample through the conventional back-to-back microscope objective. A universal optical adaptor has a second collection objective and a third collection objective optically coupled to the universal dichroic mirror. A re-imaging component optically is coupled to the universal optical adaptor. A camera is optically coupled to the re-imaging component. The laser beam expander, injection arm, universal optical adapter, re-imaging component, and camera are combined in a modular unit which is arranged and configured to be coupled to the conventional back-to-back microscope and without perpendicularity between the second and third objectives. However, it is to be expressly understood that the camera could be supplied separately by the user and the above combination of elements could be provided with a camera connector in place of the camera.
  • In one of the illustrated embodiments of the invention, the excitation light is provided by a laser with output beams with a wavelength of 488 nm and 436 nm.
  • In another one of the illustrated embodiments of the invention, the laser beam is expanded using a beam expander comprised of matching achromatic doublet lenses. The beam expander comprises two mirrors and is connected to a metal base mounted on a manual stage providing vertical translation.
  • In one of the illustrated embodiments of the invention, the injection arm comprises a metal base, a cylindrical lens and a focusing achromatic lens mounted on to the metal base to ensure pre-aligned optics to maintain a precise distance determined by the foci of the cylindrical lens and focusing achromatic lens for inserting a light sheet into the conventional back-to-back microscope.
  • In another one of the illustrated embodiments of the invention, the dichroic mirror comprises a beam splitter.
  • In one of the illustrated embodiments of the invention, the injection arm and the beam expander are mounted together on a linear manual stage base that allows the horizontal movement of the injection arm and the beam expander.
  • In another one of the illustrated embodiments of the invention, fluorescent emission light from the sample is refocused using the first excitation objective and a second collection objective of the back-to-back microscope and third collection objective chosen according to an aberration-free rule so that the chosen magnification equals the ratio of n1/n2, where n1 is the refraction index of an immersion medium used with the sample and n2 is the refraction index of the second collection objective.
  • In one of the illustrated embodiments of the invention, the a re-imaging component comprises a tilted component including a lens turret with a plurality of selectable objectives optically coupled to an achromatic doublet lens which focuses an image on the camera to allow a user to choose among a corresponding plurality of magnifications, depending on typology of the sample.
  • In another one of the illustrated embodiments of the invention, the conventional back-to-back microscope system comprises a microscope stage which is programmable, where a light sheet position and angle coupled by the excitation objective onto the sample are fixed and the only moving component is the microscope stage used for scanning the sample. The microscope stage is programmed to perform an array scan with size, distance and array cell dwell time being customizable.
  • The illustrated embodiments of the invention include a method of operation of the above apparatus.
  • While the apparatus and method has or will be described for the sake of grammatical fluidity with functional explanations, it is to be expressly understood that the claims, unless expressly formulated under 35 USC 112, are not to be construed as necessarily limited in any way by the construction of “means” or “steps” limitations, but are to be accorded the full scope of the meaning and equivalents of the definition provided by the claims under the judicial doctrine of equivalents, and in the case where the claims are expressly formulated under 35 USC 112 are to be accorded full statutory equivalents under 35 USC 112. The disclosure can be better visualized by turning now to the following drawings wherein like elements are referenced by like numerals.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The specification contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
  • FIG. 1 a is a top plan view of the layout of the illustrated embodiment of the invention.
  • FIG. 1 b is a side plan view of the layout of the illustrated embodiment of the invention.
  • FIG. 1 c is a perspective view of the layout of the illustrated embodiment of the invention.
  • FIG. 1 d is a diagrammatic view of the illustrated embodiment of the invention.
  • FIG. 2 is a diagram depicting a geometrical model for the excitation angle.
  • FIGS. 3 a-3 d are images of live MMT cell line acquired with iSPIM. Scale bars are 10 μm in FIGS. 3 a and 3 b, which is a which is a 98 frame stack; FIG. 3 c is a 280 frame stack; and FIG. 3 d a 361 frame stack.
  • FIGS. 4 a-4 d are a comparison with confocal images of the same sample collected with Olympus FV1000 using comparable optical settings to iSPIM. FIG. 4 a, 4 c show the comparison of images of live MMT cell line acquired with confocal and FIG. 4 b, 4 d show the iSPIM image. FIGS. 4 a and 4 b represent the x-z view. FIGS. 4 c and 4 d show the view of x-y plane.
  • FIGS. 5 a and 5 b show the mosaic capability of the system a tiled acquisition of 9012 frames full frame resolution (512 by 512 pixels) acquired with iSPIM. Scale bar is 100 μm.
  • FIG. 6 is an isometric representation of outlining the volumetric acquisition of the specimen through iSPIM.
  • The disclosure and its various embodiments can now be better understood by turning to the following detailed description of the preferred embodiments which are presented as illustrated examples of the embodiments defined in the claims. It is expressly understood that the embodiments as defined by the claims may be broader than the illustrated embodiments described below.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The disclosed system for inclined selective plane illumination microscope (iSPIM) with shares the advantages of OPM and that can be used as an add-on to commonly used microscopes, such as a conventional IX-71 Olympus microscope, simplifying the construction of the OPM and increasing performance of a conventional microscope. As shown below in the diagrammatic depictions of FIGS. 1 a-1 d the primary components include: a laser input connector or laser 10, a beam expanding component 12, an universal dichroic component 13 to separate fluorescence from excitation light, an universal optical adaptor 14, a re-imaging component 15, and a camera output connector 16.
  • FIG. 1 d is a typical setup of an iSPIM. Laser beam from laser 10 is inserted into a 10× beam expander 12 and reflected by a mirror 14 both mounted on a vertically moving component 17. Cylindrical lens 18 and achromatic doublet 20 are mounted on the “injection arm” 22. The dichroic mirror 13 reflects the beam vertically into the back aperture of the objective 24 which is directed in turn onto specimen 46. The emission light collected through objective 24 is reflected out of the body microscope, redirected by mirror 28 into a tube containing two achromatic doublet lenses 26. The virtual image is formed after the second objective 30. Objective 32 is mounted on an objective wheel 33. Virtual plane light is collected and the resulting image is focused on the camera 34 through tube lens 36.
  • More specifically the excitation light is provided by a laser launcher 10 (ISS, Champaign Ill.) at 488 nm and 436 nm. The laser beam is expanded (×10) using a custom beam expander 12 built with matching achromatic doublet lenses (Achromatic Doublet Lens 5 mm Dia×10 mm FL, MgF2 Coating and Achromatic Doublet Lens 25 mm Dia.×100 mm FL, MgF2 Coating NT32-327, Edmund Optics, Karlsruhe, Germany). Component 12, with two mirrors, is connected to a metal base mounted on a vertical manual stage 17.
  • The “injection arm” 22 includes a cylindrical lens 18 and a focusing achromatic lens 20 (Edmund Optics, Lens Cyl 10×20×75 mm FL VIS-NIR, Lens Ach 25×75 mm MgF2 TS) on to the same metal base 22. This ensures the pre-aligned optics to maintain the precise distance of the 150 mm determined by the lenses focuses. Furthermore it also serves as optical adaptor for inserting the light sheet in a commercial body microscope, in this case an IX-71 Olympus. The apochromatic lens 20 in fact refocuses the light on to the back aperture of the microscope objective 24. The dichroic mirror 13 used is a beam splitter 20/80 (21008 20/80 Beam splitter, Chroma). The “injection arm” 22 and the assembly 17 containing the vertically moving beam expander 12 are mounted on a linear manual stage base 38 that allows the horizontal movement and vertical movement of the elements mounted on or coupled to stage base 38. Mounted on stage base 38 are mirror 14 and assembly 17. Element 22 is not mounted on stage 38, since it is a fixed platform that mounts lenses 18 and 20.
  • The emission light is refocused using a back-to-back microscope system comprised of the first objective 24 (UPlanApo 60×/1.35 oil immersion, Olympus) and lens 26, lens 36 and the second objective 30 (UPlanApo 40×/0.85 air objective, Olympus). The objectives 24 and 30 are chosen according to the aberration-free rule from Botcherby (Botcherby et al., 2008), thus the chosen magnification must equal the ratio of n1/n2, where n1 is the refraction index of the immersion medium of the specimen and n2 is the refraction index of the second objective 30. Since the first objective 24 is an oil objective, the magnification is chosen to be 1.5×.
  • The tilted component includes a lens turret (not shown) with a third objective selected from those mounted on the lens turret, such as 40× (LucplFln 40×/0.60 air objective, Olympus) and a 10× (UPlanApo 10/0.40 air objective, collectively denoted by objective 32, Olympus) followed by an achromatic doublet lens 36 (Edmund Optics, Lens Ach 50×350 MgF2 TS) which focuses the image on the sensor of an EMCCD camera 34 (Evolve 512, Photometrics, Tucson, Ariz.). This allows the user to choose among two magnifications, depending on typology of specimen.
  • The microscope stage 14 in use is programmable (Applied Scientific Instruments, MS-2000 Eugene, Oreg.). Since the light sheet position and angle are fixed, the only moving component is the stage 14. This is used for scanning through the sample.
  • The stage 14 has been programmed to perform an array scan. Size, distance and array cell dwell time are customizable. Upon reaching a new position the stage 14 sends a TTL pulse to the trigger port of the camera 34, initializing acquisition. The camera 34, set to image in triggered mode, outputs a TTL pulse when reaching ‘frame readout’. In a feedback loop this pulse is used to activate stage motion to the next position.
  • The acquisition algorithm, written in Matlab with C++, optimizes acquisition times considering exposure time, read out, dwell time and time to reach next position on the stage. The acquisition protocol has been simplified by programming a user friendly graphical user interface that guides the user along the acquisition steps. Algorithms for mosaic/tiled acquisition have been implemented. Other acquisition schemes can be readily accommodated in the illustrated embodiments.
  • The full width half maximum (FWHM) of the light sheet on the sample is 2.6 μm whereas the confocal parameter is 80 μm.
  • FIG. 1 is a diagram depicting a geometrical model for the excitation angle. A geometrical model for excitation angle, acceptance angle and emission (Dunsby, 2008) is presented in FIG. 2, where θ is the acceptance angle of the first objective, φex the half angle of the excitation sheet, φem the half angle of the emission. An objective lens is represented with acceptance angle 8. The light sheet 40 has an half angle of the excitation φex. The sample 42 has a half angle of emission φem. Considering illumination and collection separated by π/2 it is possible to obtain the equation (Dunsby, 2008):
  • Φ em = 2 θ - Φ ex - π 2
  • From the definition of numerical aperture (NA), with non-fluorescent oil refractive index n=1.479 (Cargille Oil) the value of θobj=73.7 deg. Consequently, being φex=3 deg the equation above gives φem=54.4 deg. The potential NA of the system, considering only the first objective 24 is NApotential=1.20.
  • One issue outlined also by Dunsby is that the limiting factor in the NA of the system is located in the refocusing part with the third objective 32. In this setup the real NA obtained are 0.88 for the objective 32, LucplFln 40×/0.60 and 0.59 for the UPlanApo 10/0.40 as the two options for objective 32. This value considers the fact that the last objective image is the already magnified sample from the second objective 30.
  • The angle subtended by the laser sheet with the first objective, a, is set to be 30 degrees whereas the FWHM of the focal spot is 344 nm.
  • As a proof of operability, samples of MMT cell line (American Type Culture Collection, CCL-51) transfected with H2B-EGFP are prepared on standard culture dishes (MatTek, Ashland, Mass.) coated with fibronectin. Cells are imaged live after overnight seeding and further fixed. Fixation is done with PFA (Paraformaldehyde) and mounting media (polyvinyl alcohol mounting medium with DABCO, antifading-10981) for further sampling. Imaging is performed using 488 nm laser and shifting the sample with the stage movement. The dataset is then corrected for the acquisition geometry, shearing the frames accordingly. Rendering is performed using Amira, (San Diego, Calif.).
  • FIGS. 3 a-3 d are images of live MMT H2B-EGFP acquired with iSPIM with a step size of 0.5 μm. The fluorescence signal derives from the nucleus. Renderings are in color, whereas reference section slices are in grayscale. Scale bars are 10 μm in FIGS. 3 a and 3 b, which is a 98 frames stack; FIG. 3 c is a 280 frames stack; and FIG. 3 d a 361 frames stack.
  • A comparison with confocal images of the same sample collected with Olympus FV1000 using comparable optical settings to iSPIM is shown in FIGS. 4 a-4 d. Comparison of images of live MMT H2B-EGFP acquired with confocal (FIG. 4 a, 4 c) and iSPIM (FIG. 4 b, 4 d). Scale bars are 20 μm. FIGS. 4 a and 4 b represent the x-z view. The lateral resolution observed is comparable to confocal. FIGS. 4 c and 4 d show the view of x-y plane. The advantage of gray levels of camera-based acquisition is noticeable. The confocal acquisition is performed using comparable settings to the iSPIM system and considering that the zooming function of a confocal microscope is not applicable to a SPIM system.
  • It is possible to distinguish structures inside the nucleus on the intensity based volumetric representation. For proper understanding, one of the sections, in gray scale, is shown in the rendering. This section is a 30 degrees angle section of the sample.
  • Furthermore, to show the mosaic capability of the system a tiled acquisition of 9012 frames full frame resolution (512 by 512 pixels) is performed. Images are then stitched, shifted and rendered. The area covered is 842 μm by 442 μm. The resulting image is shown in FIG. 5, which is a mosaic of 9012 frames 512×512 pixels acquired with iSPIM. Scale bar is 100 μm. Due to size issues dataset has been down sampled a factor of 2 to allow visualization. FIG. 5 a is a vertical view; and FIG. 5 b is an inclined view with reference plane resulting from stitched frames. The fluorescence image corresponds to single cell nuclei. The resulting images show appreciable resolution that, in consideration of the acquisition speed, and demonstrate the potential of this imaging method. The mosaic size of 9012 frames results in a manageable raw file of 4.6 GB which after stitching and shifting, considering 30% overlap and conversion to TIFF format, weights 4 GB, yielding 2061×1273×751 volumetric pixel size.
  • As shown by the images in the figures, iSPIM has the capability of sectioning the sample with a simple linear translation of the specimen over the light sheet. The only moving component in the setup is in fact the stage 14. This setup still shows extensive optics as in Dunsby's prototype. Nevertheless the system has improved stability and simplified alignment. Once aligned the components do not require any further movement. Critical alignment points are the laser sheet insertion into the microscope and the tilting component between the second and third objective. To simplify the insertion of the excitation light, the block 38 containing vertically moving mirror 14, beam expander 12 and secondary mirror 28, together with the block of the “injection arm” 22 have been pre-aligned and mounted on a single axis manual translation stage 38. It is critical that the light sheet has the correct angle subtended with the first objective lens 24. This angle depends on the entrance angle of the beam on the back aperture of the objective 24.
  • A simple rule arises from geometrical considerations. Moving the light sheet on the x-y plane of the microscope system will change the exit angle of the beam from the objective 24. Altering the z-position will shift the exit position on the objective lens 24. Therefore moving the single axis manual translation stage 38 will alter the exit angle. The mirror 14, along with beam expander 12 and secondary mirror 28 in this block is installed on a kinematic mirror mount 38, thus it is possible to move the beam along the z-axis and consequently change the exit position.
  • The tilting component, the interface between the re-imaged light sheet and the camera acquisition, is another important alignment point of the system. The addition of the objective wheel and thus the possibility to change the final magnification, increases the demand for a simplified and quick repositioning of the third objective 32. The solution adopted in this setup is to uncouple the block 33 with third objective 32 from the camera arm 34. The filter wheel is mounted on an x-y-z manual translation stage 33. As a consequence switching between objectives 32 and adjusting for different working distance is performed with reduced time expense.
  • FIG. 6 outlines the volumetric acquisition through iSPIM. The image represents an objective 24 with inclined light sheet excitation 44 exiting the lens 24. The specimen 46 placed over the objective 24 is thus sectioned by the excitation light yielding a real volume 48 subtended by the inclined light sheet, that is a three dimensional parallelogram. A relevant point regards the three dimensional data acquired. The camera device 34 continuously acquires data in a single sequenced-not-spaced vector. As a consequence when the raw data is rendered the resulting volume is cubical. Considering the acquisition setup, the physical volume has a parallelogram shape in cross-section. It is then necessary to post-process the data shifting each frame accordingly to render the correct physical volume (FIG. 5).
  • Mosaic acquisition is achieved through programming of the MS-2000 ASI stage controller so that an array can be acquired with custom chosen overlap. A serpentine mode has been used to optimize acquisition time. The frames collected are then stitched using the fast algorithm developed by Preibisch et al (Preibisch et al., 2009) implemented in FIJI (ImageJ). The final composite image is then processed for volumetric rendering. This process, due to the number of frames collected, consistently increases the size of the final data file. One common problem in the field is related to a huge dataset volumetric representation. A possible solution is the increase of random access memory of the computer in use. On the other hand with the increasing size of camera chipsets and the upgraded acquisition speed, a constant increase in datasets can be expected.
  • Even though iSPIM data acquired did not exceed 16 GB, thus was within the RAM limits of the workstation, it is within the scope of the invention to provide an algorithm for subsampling the image resolution to different level of zoom.
  • The illustrated embodiments of the invention show an inclined selective plane illumination device as an adaptor for commercial or conventional body microscopes. As for the original oblique plane microscope (Dunsby, 2008) it carries the same advantages of SPIM systems, but with simplified mechanical component and through-the-objective TIRF-like operation. It furthermore allows the user to maintain standard sample preparation and standard horizontal positioning of the sample.
  • The results presented demonstrate the potential of the system when applied to cellular imaging. The capability to acquire volumetric information by simply translating the sample in a direction and the iteration of this to form of mosaic is shown in the images.
  • The competing limiting factors are camera acquisition speed, camera pixel size and stage movement speed. Using Sci-CMOS cameras could allow higher acquisition speed with reduced pixel dimension, increasing the resolution but with the trade off of a lower sensitivity. Optimization of stage movement, considering still time during exposure and acceleration value during camera readout will also decrease acquisition time.
  • The optomechanical design is enhanced to provide simplified alignment among the critical points of the system, defining an increased stability of the system. The optical components are chosen with the perspective of multicolor imaging, yielding the possibility to image multiple channels.
  • Furthermore our inclined embodiment is fully compatible with 2-photon excitation which could increase the system illumination efficiency with an augmented penetration in the sample.
  • Many alterations and modifications may be made by those having ordinary skill in the art without departing from the spirit and scope of the invention. Therefore, it must be understood that the illustrated embodiment has been set forth only for the purposes of example and that it should not be taken as limiting the invention as defined by the following invention and its various embodiments.
  • The words used in this specification to describe the invention and its, various embodiments are to be understood not only in the sense of their commonly defined meanings, but to include by special definition in this specification structure, material or acts beyond the scope of the commonly defined meanings. Thus if an element can be understood in the context of this specification as including more than one meaning, then its use in must be understood as being generic to all possible meanings supported by the specification and by the word itself.
  • The definitions of the words or elements of the following invention and its various embodiments are, therefore, defined in this specification to include not only the combination of elements which are literally set forth, but all equivalent structure, material or acts for performing substantially the same function in substantially the same way to obtain substantially the same result. In this sense it is therefore contemplated that an equivalent substitution of two or more elements may be made for any one of the elements in the invention and its various embodiments below or that a single element may be substituted for two or more elements in a claim.
  • Insubstantial changes from the claimed subject matter as viewed by a person with ordinary skill in the art, now known or later devised, are expressly contemplated as being equivalently within the scope of the invention and its various embodiments. Therefore, obvious substitutions now or later known to one with ordinary skill in the art are defined to be within the scope of the defined elements.
  • The invention and its various embodiments are thus to be understood to include what is specifically illustrated and described above, what is conceptionally equivalent, what can be obviously substituted and also what essentially incorporates the essential idea of the invention.

Claims (23)

We claim:
1. An apparatus for inclined single plane Illumination microscopy of a sample comprising:
a laser for launching excitation light beams at a plurality of wavelengths;
a laser beam expander for expanding the excitation light beams optically;
an injection arm optically coupled to the laser beam expander;
a conventional back-to-back microscope system having an first excitation objective and a second collection objective;
a universal dichroic mirror optically coupled to the injection arm to direct the excitation light beams into the conventional back-to-back microscope, the first excitation objective onto a sample plane in an imaging plane, and to receive from the conventional back-to-back microscope objective fluorescence light from the sample;
a universal optical adaptor having a second collection objective and a third collection objective optically coupled to the universal dichroic mirror;
a re-imaging component optically coupled to the universal optical adaptor; and
a camera optically coupled to the re-imaging component,
where the laser beam expander, injection arm, universal optical adapter, re-imaging component, and camera are combined in a modular unit which is arranged and configured to be coupled to the conventional back-to-back microscope and without perpendicularity between the second and third objectives.
2. The apparatus of claim 1 where the excitation light is provided by a laser with output beams with a wavelength of 488 nm and 436 nm.
3. The apparatus of claim 1 where the laser beam is expanded using a beam expander comprised of matching achromatic doublet lenses.
4. The apparatus of claim 1 where the beam expander comprises two mirrors and is connected to a metal base mounted on a manual stage providing vertical translation.
5. The apparatus of claim 1 where the injection arm comprises a metal base, a cylindrical lens and a focusing achromatic lens mounted on to the metal base to ensure pre-aligned optics to maintain a precise distance determined by the foci of the cylindrical lens and focusing achromatic lens for inserting a light sheet into the conventional back-to-back microscope.
6. The apparatus of claim 1 where the dichroic mirror comprises a beam splitter.
7. The apparatus of claim 1 where the injection arm and the beam expander are mounted together on a linear manual stage base that allows the horizontal movement of the injection arm and the beam expander.
8. The apparatus of claim 1 where fluorescent emission light from the sample is refocused using the first excitation objective and a second collection objective of the back-to-back microscope and third collection objective chosen according to an aberration-free rule so that the chosen magnification equals the ratio of n1/n2, where n1 is the refraction index of an immersion medium used with the sample and n2 is the refraction index of the second collection objective.
9. The apparatus of claim 1 where the a re-imaging component comprises a tilted component including a lens turret with a plurality of selectable objectives optically coupled to an achromatic doublet lens which focuses an image on the camera to allow a user to choose among a corresponding plurality of magnifications, depending on typology of the sample.
10. The apparatus of claim 1 where the conventional back-to-back microscope system comprises a microscope stage which is programmable, where a light sheet position and angle coupled by the excitation objective onto the sample are fixed and the only moving component is the microscope stage used for scanning the sample.
11. The apparatus of claim 10 where the microscope stage is programmed to perform an array scan with size, distance and array cell dwell time being customizable.
12. A method for inclined single plane Illumination microscopy of a sample comprising:
providing a laser beam expander, injection arm, universal optical adapter, re-imaging component, and camera combined in a modular unit which is arranged and configured to be coupled to a conventional back-to-back microscope;
launching excitation light beams at a plurality of wavelengths;
expanding the excitation light beams optically with the laser beam expander;
optically forming the expanded excitation light beams into focused light beams for injection into a conventional back-to-back microscope system with the injection arm which has an first excitation objective and a second collection objective;
reflecting light beams using a universal dichroic mirror to direct the excitation light beams into the conventional back-to-back microscope, a first excitation objective focusing the light beams onto a sample plane in an imaging plane;
receiving from the conventional back-to-back microscope objective fluorescence light from the sample;
collecting the fluorescence light from the sample with a universal optical adaptor having a second collection objective and a third collection objective optically coupled to the universal dichroic mirror without perpendicularity between the second and third objectives; and
re-imaging the fluorescence light into a camera with the re-imaging component.
13. The method of claim 12 where launching excitation light beams at a plurality of wavelengths comprises providing excitation light by a laser with output beams with a wavelength of 488 nm and 436 nm.
14. The method of claim 12 where expanding the excitation light beams optically with the laser beam expander comprises expanding the light beams with a beam expander having matching achromatic doublet lenses.
15. The method of claim 12 where expanding the excitation light beams optically with the laser beam expander comprises expanding the excitation light beams using a beam expander connected to a metal base mounted on a manual stage providing vertical translation.
16. The method of claim 12 where optically forming the expanded excitation light beams into focused light beams for injection into a conventional back-to-back microscope system comprises maintaining a precise distance determined by the foci of a cylindrical lens and achromatic lens for inserting a light sheet into the conventional back-to-back microscope.
17. The method of claim 12 where reflecting light beams using a universal dichroic mirror to direct the excitation light beams into the conventional back-to-back microscope and receiving fluorescence light from the sample comprises directing the light beams into the conventional back-to-back microscope through a dichroic mirror comprising a beam splitter when receiving fluorescence light from the sample.
18. The method of claim 12 further comprising mounting the injection arm and the beam expander together on a linear manual stage base and moving the injection arm and the beam expander horizontally together.
19. The method of claim 12 where collecting the fluorescence light from the sample with a universal optical adaptor having a second collection objective and a third collection objective optically coupled to the universal dichroic mirror comprises refocusing fluorescent emission light from the sample using the first excitation objective and a second collection objective of the back-to-back microscope and third collection objective chosen according to an aberration-free rule so that the chosen magnification equals the ratio of n1/n2, where n1 is the refraction index of an immersion medium used with the sample and n2 is the refraction index of the second collection objective.
20. The method of claim 12 where re-imaging the fluorescence light into a camera with the re-imaging component comprises re-imaging the fluorescence light through a tilted component including a lens turret with a plurality of selectable objectives optically coupled to an achromatic doublet lens and focusing an image on the camera to allow a user to choose among a corresponding plurality of magnifications, depending on typology of the sample.
21. The method of claim 12 further comprising comprises programming a microscope stage of the conventional back-to-back microscope system, where a light sheet position and angle coupled by the excitation objective onto the sample are fixed and the only moving component is the microscope stage used for scanning the sample.
22. The method of claim 21 where programming the microscope stage comprises programming the microscope stage to perform an array scan with size, distance and array cell dwell time being customizable.
23. An apparatus for use in inclined single plane Illumination microscopy of a sample comprising:
a laser input connector for launching excitation light beams at a plurality of wavelengths;
a laser beam expander for expanding the excitation light beams optically;
an injection arm optically coupled to the laser beam expander;
a conventional back-to-back microscope system having an first excitation objective and a second collection objective;
a universal dichroic mirror optically coupled to the injection arm to direct the excitation light beams into the conventional back-to-back microscope, the first excitation objective onto a sample plane in an imaging plane, and to receive from the conventional back-to-back microscope objective fluorescence light from the sample;
a universal optical adaptor having a second collection objective and a third collection objective optically coupled to the universal dichroic mirror;
a re-imaging component optically coupled to the universal optical adaptor; and
a camera connector optically coupled to the re-imaging component,
where the laser input connector, laser beam expander, injection arm, universal optical adapter, re-imaging component, and camera connector are combined in a modular unit which is arranged and configured to be coupled to the conventional back-to-back microscope and without perpendicularity between the second and third objectives.
US13/873,159 2013-04-29 2013-04-29 Apparatus and method for an inclined single plane imaging microscope box (iSPIM box) Active 2036-03-11 US9874736B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/873,159 US9874736B2 (en) 2013-04-29 2013-04-29 Apparatus and method for an inclined single plane imaging microscope box (iSPIM box)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/873,159 US9874736B2 (en) 2013-04-29 2013-04-29 Apparatus and method for an inclined single plane imaging microscope box (iSPIM box)

Publications (2)

Publication Number Publication Date
US20140320601A1 true US20140320601A1 (en) 2014-10-30
US9874736B2 US9874736B2 (en) 2018-01-23

Family

ID=51788918

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/873,159 Active 2036-03-11 US9874736B2 (en) 2013-04-29 2013-04-29 Apparatus and method for an inclined single plane imaging microscope box (iSPIM box)

Country Status (1)

Country Link
US (1) US9874736B2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170045727A1 (en) * 2014-04-07 2017-02-16 Hee Bong YANG 3d video microscopy system
JP2018506733A (en) * 2014-12-23 2018-03-08 ジーイー・ヘルスケア・バイオサイエンス・コーポレイション Selective plane illumination microscopy equipment
US20180088308A1 (en) * 2016-09-28 2018-03-29 University Of Washington Inverted light-sheet microscope
US10229310B2 (en) * 2013-07-23 2019-03-12 Northwestern University High throughput partial wave spectroscopic microscopy and associated systems and methods
WO2019152670A1 (en) 2018-01-31 2019-08-08 The Regents Of The University Of California High numerical aperture selective plane illumination microscopy
CN111504968A (en) * 2020-04-29 2020-08-07 锘海生物科学仪器(上海)股份有限公司 Four-color laser lighting fluorescent microscope
WO2023221400A1 (en) * 2022-05-16 2023-11-23 中国科学院生物物理研究所 Super-resolution single-objective light-sheet optical microscopy system and imaging system comprising same
US11885946B2 (en) 2018-01-26 2024-01-30 University Of Washington Apparatuses and methods for multi-direction digital scanned light sheet microscopy

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5796112A (en) * 1993-06-03 1998-08-18 Hamamatsu Photonics K.K. Laser scanning optical system and laser scanning optical apparatus
US20030228703A1 (en) * 2002-04-05 2003-12-11 The Regents Of The University Of Michigan Fluorescence resonance energy transfer quantitation and stoichiometry in living cells
US7218393B2 (en) * 2001-05-22 2007-05-15 Medical Research Council Rotary stage for imaging a specimen
US20090237501A1 (en) * 2008-03-19 2009-09-24 Ruprecht-Karis-Universitat Heidelberg Kirchhoff-Institut Fur Physik method and an apparatus for localization of single dye molecules in the fluorescent microscopy
US20090237670A1 (en) * 2002-01-16 2009-09-24 Solexa Limited Prism design for scanning applications and illumination of microscopy sample
US7692879B2 (en) * 2004-07-16 2010-04-06 Carl Zeiss Microimaging Gmbh Correction device for an optical arrangement and confocal microscope with such a device
US20110261446A1 (en) * 2008-07-31 2011-10-27 Imperial Innovations Limited Optical arrangement for oblique plane microscopy
WO2012113752A1 (en) * 2011-02-21 2012-08-30 Leica Microsystems Cms Gmbh Scanning microscope and method for the light-microscopic imaging of an object
US20120229791A1 (en) * 2009-09-24 2012-09-13 Carl Zeiss Microimaging Gmbh Microscope
US20120241596A1 (en) * 2011-03-25 2012-09-27 Savran Cagri A System for and Method of Performing Multi-Technique Imaging
US20140300958A1 (en) * 2011-10-28 2014-10-09 Leica Microsystems Cms Gmbh Arrangement for use in the illumination of a specimen in spim microscopy
US20140356876A1 (en) * 2010-11-15 2014-12-04 Timothy Ragan Systems and methods for imaging and processing tissue
US20150168706A1 (en) * 2013-12-18 2015-06-18 Carl Zeiss Microscopy Gmbh Microscope and Method for SPIM Microscopy
US20150260978A1 (en) * 2012-09-28 2015-09-17 Universität Heidelberg High resolution microscopy by means of structured illumination at large working distances
US9645378B2 (en) * 2012-10-12 2017-05-09 Carl Zeiss Microscopy Gmbh Microscope and method for SPIM microscopy

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5796112A (en) * 1993-06-03 1998-08-18 Hamamatsu Photonics K.K. Laser scanning optical system and laser scanning optical apparatus
US7218393B2 (en) * 2001-05-22 2007-05-15 Medical Research Council Rotary stage for imaging a specimen
US20090237670A1 (en) * 2002-01-16 2009-09-24 Solexa Limited Prism design for scanning applications and illumination of microscopy sample
US20030228703A1 (en) * 2002-04-05 2003-12-11 The Regents Of The University Of Michigan Fluorescence resonance energy transfer quantitation and stoichiometry in living cells
US7692879B2 (en) * 2004-07-16 2010-04-06 Carl Zeiss Microimaging Gmbh Correction device for an optical arrangement and confocal microscope with such a device
US20090237501A1 (en) * 2008-03-19 2009-09-24 Ruprecht-Karis-Universitat Heidelberg Kirchhoff-Institut Fur Physik method and an apparatus for localization of single dye molecules in the fluorescent microscopy
US20110261446A1 (en) * 2008-07-31 2011-10-27 Imperial Innovations Limited Optical arrangement for oblique plane microscopy
US20120229791A1 (en) * 2009-09-24 2012-09-13 Carl Zeiss Microimaging Gmbh Microscope
US20140356876A1 (en) * 2010-11-15 2014-12-04 Timothy Ragan Systems and methods for imaging and processing tissue
WO2012113752A1 (en) * 2011-02-21 2012-08-30 Leica Microsystems Cms Gmbh Scanning microscope and method for the light-microscopic imaging of an object
US20130335818A1 (en) * 2011-02-21 2013-12-19 Leica Microsystems Cms Gmbh Scanning Microscope, and Method for Light Microscopy Imaging of a Specimen
US20120241596A1 (en) * 2011-03-25 2012-09-27 Savran Cagri A System for and Method of Performing Multi-Technique Imaging
US20140300958A1 (en) * 2011-10-28 2014-10-09 Leica Microsystems Cms Gmbh Arrangement for use in the illumination of a specimen in spim microscopy
US20150260978A1 (en) * 2012-09-28 2015-09-17 Universität Heidelberg High resolution microscopy by means of structured illumination at large working distances
US9645378B2 (en) * 2012-10-12 2017-05-09 Carl Zeiss Microscopy Gmbh Microscope and method for SPIM microscopy
US20150168706A1 (en) * 2013-12-18 2015-06-18 Carl Zeiss Microscopy Gmbh Microscope and Method for SPIM Microscopy

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10229310B2 (en) * 2013-07-23 2019-03-12 Northwestern University High throughput partial wave spectroscopic microscopy and associated systems and methods
US9835841B2 (en) * 2014-04-07 2017-12-05 Sometech Co., Ltd 3D video microscopy system
US20170045727A1 (en) * 2014-04-07 2017-02-16 Hee Bong YANG 3d video microscopy system
JP2018506733A (en) * 2014-12-23 2018-03-08 ジーイー・ヘルスケア・バイオサイエンス・コーポレイション Selective plane illumination microscopy equipment
EP3237949A4 (en) * 2014-12-23 2018-08-01 GE Healthcare Bio-Sciences Corp. Selective plane illumination microscopy instruments
US20180088308A1 (en) * 2016-09-28 2018-03-29 University Of Washington Inverted light-sheet microscope
US10409052B2 (en) * 2016-09-28 2019-09-10 University Of Washington Inverted light-sheet microscope
US11885946B2 (en) 2018-01-26 2024-01-30 University Of Washington Apparatuses and methods for multi-direction digital scanned light sheet microscopy
WO2019152670A1 (en) 2018-01-31 2019-08-08 The Regents Of The University Of California High numerical aperture selective plane illumination microscopy
US20210041683A1 (en) * 2018-01-31 2021-02-11 The Regents Of The University Of California High Numerical Aperture Selective Plane Illumination Microscopy
US11874451B2 (en) * 2018-01-31 2024-01-16 The Regents Of The University Of California High numerical aperture selective plane illumination microscopy
CN111504968A (en) * 2020-04-29 2020-08-07 锘海生物科学仪器(上海)股份有限公司 Four-color laser lighting fluorescent microscope
WO2023221400A1 (en) * 2022-05-16 2023-11-23 中国科学院生物物理研究所 Super-resolution single-objective light-sheet optical microscopy system and imaging system comprising same

Also Published As

Publication number Publication date
US9874736B2 (en) 2018-01-23

Similar Documents

Publication Publication Date Title
US9874736B2 (en) Apparatus and method for an inclined single plane imaging microscope box (iSPIM box)
Bayguinov et al. Modern laser scanning confocal microscopy
Jonkman et al. Any way you slice it—a comparison of confocal microscopy techniques
Greger et al. Basic building units and properties of a fluorescence single plane illumination microscope
US9383568B2 (en) Objective-coupled selective plane illumination microscopy
EP2316048B1 (en) Optical arrangement for oblique plane microscopy
Pawley The 39 steps: a cautionary tale of quantitative 3-D fluorescence microscopy
US7170675B2 (en) Method and system for wide-field multi-photon microscopy having a confocal excitation plane
JP6596001B2 (en) Multifocal multiphoton imaging system and method
US20190278073A1 (en) Three-Dimensional Imaging Using Swept, Confocally Aligned Planar Excitation with a Powell Lens and/or Deliberate Misalignment
US9063334B2 (en) Microscope having switchable illumination modes and method of operating the same
US20090174935A1 (en) Scanning microscope having complementary, serial scanners
Cutrale et al. Inclined selective plane illumination microscopy adaptor for conventional microscopes
JP2020536271A (en) Two-dimensional and three-dimensional fixed Z-scan
EP3855234A1 (en) Light-sheet microscope and method for large samples
JP2006275964A (en) Shading correction method for scanning fluorescence microscope
JP2013501951A (en) Microscope for total reflection fluorescence measurement
JP4163301B2 (en) Scanning cytometer
CN116755234A (en) Linear light scanning confocal microscopic imaging system and linear light scanning confocal microscopic imaging method
Temprine et al. Three-dimensional photoactivated localization microscopy with genetically expressed probes
JP2012505431A (en) Beam expander adjustment system and method in imaging system
TWI714378B (en) A large-angle optical raster scanning system for high speed deep tissue imaging
JP5307868B2 (en) Total reflection microscope
Van den Eynde et al. The TriScan: fast and sensitive 3D confocal fluorescence imaging using a simple optical design
CN219810844U (en) Single-objective light sheet microscopic imaging system

Legal Events

Date Code Title Description
AS Assignment

Owner name: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA, CALIF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CUTRALE, FRANCESCO, DR.;GRATTON, ENRICO, DR.;REEL/FRAME:030341/0302

Effective date: 20130429

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4