WO2004046697A1 - Bioassay reading system - Google Patents

Bioassay reading system Download PDF

Info

Publication number
WO2004046697A1
WO2004046697A1 PCT/GB2003/005073 GB0305073W WO2004046697A1 WO 2004046697 A1 WO2004046697 A1 WO 2004046697A1 GB 0305073 W GB0305073 W GB 0305073W WO 2004046697 A1 WO2004046697 A1 WO 2004046697A1
Authority
WO
WIPO (PCT)
Prior art keywords
microlabels
image
illuminating
microlabel
image signals
Prior art date
Application number
PCT/GB2003/005073
Other languages
French (fr)
Inventor
Jodie Hadley
Adam Johansen
David Onley
Original Assignee
Smartbead Technologies Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Smartbead Technologies Limited filed Critical Smartbead Technologies Limited
Priority to AU2003302130A priority Critical patent/AU2003302130A1/en
Publication of WO2004046697A1 publication Critical patent/WO2004046697A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G01N21/643Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" non-biological material
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • G06K19/06018Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking one-dimensional coding
    • G06K19/06028Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking one-dimensional coding using bar codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N2021/6417Spectrofluorimetric devices
    • G01N2021/6421Measuring at two or more wavelengths
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G01N2021/6439Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks
    • G01N2021/6441Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks with two or more labels

Definitions

  • the present invention relates to bioassay reading systems; in particular, the invention concerns a bioassay reading system for reading bioassay micron-scale encoded substrates.
  • the substrates are preferably susceptible to fluorescence when interrogated and comprise identification bar-codes; for example, such substrates are known in the art as "Smart Beads".
  • the present invention also relates to a method of reading such bioassay micron-scale encoded substrates using the aforementioned bioassay reading system.
  • the methods involve imaging or reading freestanding particles comprising a plurality of segments. Moreover, the particles are of length from 10 nm to 50 ⁇ m and of width from 5 nm to 50 ⁇ m.
  • the segments of the particles may be comprised of any material including a metal, allow, a metal allow, a metal nitride, a metal chalcogenide, a metal oxide, a metal sulfide, a metal selenide, a metal telluride, polymeric materials, crystalline and/or non-crystalline materials.
  • microfabricated labels are made to each carry a biochemical test.
  • many different labels are mixed together with an analyte sample.
  • the system additional comprises a device that reads the individual labels are thereby isolates results of individual tests.
  • the microfabricated labels have a surface layer of anodized metal and are produced by utilizing anodizing, lithographic patterning and etching steps. Aluminium is a preferred metal for use in fabricating the labels, although other materials can be employed to fabricate the labels.
  • a biochemical method of detecting one or more protein characteristics utilizes supports, wherein each support has a largest dimension of less than 250 ⁇ m and wherein each support incorporates sequential identifying means.
  • the method is distinguished in that it includes the steps of: (a) attaching an information molecule to a main surface of a support, the information molecule being capable of interacting with at least one of said one or more protein characteristics to be detected;
  • Microparticles each having a uniform population of a single kind of analyte are disposed as a substantially immobilized planar array inside of a flow chamber where steps of an analytical process are carried out by delivering a sequence of processing reagents to the microparticles by a fluidic system under microprocessor control. In response to such process steps, an optical signal is generated at the surface of each microparticle which is characteristic of the interaction between the analyte carried by the microparticle and the delivered processing reagent.
  • the plurality of analytes are simultaneously analyzed by collecting and recording images of the optical signals generated by all the microparticles in the planar array.
  • a key feature of the invention is the correlation of the sequence of optical signals generated by each microparticle in the planar array during the analytical process.
  • microparticles described in the foregoing can be interrogated in a flow apparatus wherein the microparticles are transported serially in a fluid flow relative to visual inspection equipment.
  • the microparticles can be deposited onto a surface and then interrogated by moving the surface relative to a visual inspection system.
  • image data processing problems arise which renders such an approach difficult to implement in practice.
  • the inventors have devised an improved bioassay reading system.
  • a bioassay reading system for interrogating microlabels comprising:
  • imaging means for generating at least one image of the illuminated microlabels and converting said at least one image into corresponding image signals
  • data processing means for receiving the image signals and for processing the signals to determine identities of microlabels present in said at least one image and their associated optical responses, characterised in at the processing means is operable to locate and identify the microlabels by identifying spatially sequential groups of identification codes present on the microlabels depicted in said at least one image.
  • the invention is of advantage in that identifying the microlabels by searching for their corresponding spatially sequential groups of identification codes is capable of providing more reliable reading of the microlabels.
  • the data processing means is arranged to process the image signals to identify spatial regions therein corresponding to groups of identification codes and hence their corresponding microlabel positions, and then to process the image signals corresponding to a substantially central portion of each microlabel to determine its corresponding identification code.
  • the system is capable of being rendered more resilient to misidentification of microlabels with damaged edge regions. This increased reliability allows a greater number of distinct codes to be used.
  • the processing means is operable to subject the image signals to threshold detection to remove background artefacts therein.
  • threshold detection is capable of resulting in simpler and less ambiguous processed image data in which to identify microlabel identification codes.
  • the illuminating means is arranged to output radiation for use in interrogating the microlabels at a plurality of selectable wavelengths for determining identification codes of the microlabels and their corresponding optical responses. Using a plurality of wavelengths enables the microlabels to be interrogated using radiation of wavelengths where their identification codes are most easily distinguished, and their fluorescence determined using radiation of wavelengths where their fluorescence is most easily measured.
  • the illuminating means is operable to output radiation capable of exciting microlabel fluorescence for determining the optical responses. More preferably, the illuminating means includes a filament light source for illuminating the microlabels to determine their identification codes, and at least one ultra-violet light source for illuminating the microlabels to determine their optical responses.
  • the processing means is capable of identifying redundant identification code sequences at elongate ends of the microlabels, said redundant code sequences being included in the microlabels for rendering them less susceptible to being misidentified in the system due to microlabel edge damage.
  • the processing means is operable to compress intensity variations in the image signals for enhancing identification code detection when applying threshold detection to the compressed image signals.
  • Such compression is capable of improving the system's ability to determine microlabel identification codes correctly. More preferably, such compression is applied to favour identification codes corresponding to regions of relatively high light transmission and/or relatively low light reflectivity of each microlabel.
  • the processing means is operable to determine the optical responses of the microlabels based on emission substantially from solid regions of the microlabels only.
  • Such an approach renders the fluorescence response measurement less susceptible to modulation in relation to the microlabels' identification codes and to edge effects resulting from infinite image resolution and variation in the geometry of individual microlabels.
  • a method of interrogating microlabels in a bioassay reading system comprising: (a) a surface for receiving the microlabels;
  • imaging means for generating at least one image of the illuminated microlabels
  • step (h) processing the signals to determine identities of microlabels present in said at least one image and their associated optical responses, characterised in that the method further comprises in step (h) the step of locating and identifying the microlabels by identifying spatially sequential groups of identification codes present on the microlabels depicted in said at least one image.
  • step (h) the steps of:
  • the method further comprising in step (h) the step of subjecting the image signals in the processing means to threshold detection to remove background artefacts therein.
  • the method further comprising in step (h) the step of arranging for the illuminating means to output radiation to interrogating the microlabels at a plurality of selectable wavelengths for determining identification codes of the microlabels and their corresponding optical responses.
  • the illuminating means is operable to output radiation capable of exciting microlabel fluorescence for determining the optical responses.
  • the illuminating means includes a filament light source for illuminating the microlabels to determine their identification codes, and a ultra-violet light source for illuminating the microlabels to determine their optical response.
  • the processing means is capable of identifying redundant identification code sequences at elongate ends of the microlabels, said redundant code sequences being included in the microlabels for rendering them less susceptible to being misidentified in the system due to microlabel edge damage.
  • the processing means is operable to compress intensity variations in the image signals for enhancing identification code detection when applying threshold detection to the compressed image signals.
  • compression is applied to favour identification codes corresponding to regions of relatively high light transmission and/or relatively low light reflectivity of each microlabel.
  • the processing means is operable to determine the optical responses of the microlabels based on emission substantially from solid regions of the microlabels only.
  • Figure 1 is an illustration of a bioassay reading system according to the first embodiment of the invention
  • Figure 2 is an illustration of snake-like motion of a stage of the system of Figure 1 relative to a microscope thereof;
  • Figure 3 is an example of a pixel image depicting a microlabel, the image generated from a camera of the system of Figure 1;
  • Figure 4 is an illustration of an inverse version of the image in Figure 3;
  • Figure 5 is an illustration of threshold detection applied to detect the presence of microlabels in the inverse image of Figure 4;
  • Figure 6 is an illustration of central strip detection to render microlabel barcode detection more reliable
  • Figures 7a to 7d depict a flow chart of steps executed to read microlabels using the system as depicted in Figure 1;
  • Figure 8 is an illustration of a bioassay reading system according to the second embodiment of the invention.
  • the system 10 comprises an optical microscope 20.
  • the microscope 20 is provided with a motorized stage 30 for actuating a platform 40 bearing microlabels 50 relative to the microscope 20 for enabling the microscope 20 to inspect preferred regions of the platform 40.
  • the motorized stage 30 is used for spatially actuating the platform 40 and its microlabels 50 relative to the microscope 20 for selecting preferred areas of the platform 40.
  • the microscope 20 is provided with a monochrome charge-coupled-device (CCD) camera 60 for receiving magnified images of the preferred regions.
  • CCD monochrome charge-coupled-device
  • the camera 60 is coupled in communication with a personal computer (PC) 70 which is arranged to control movement of the platform 40 relative to the microscope 20.
  • the PC 70 is also programmed to perform image analysis on signals generated by the camera 60 when inspecting the platform 40 and thereby recognize and collate data pertaining to inspected microlabels 50 present in the preferred regions.
  • the platform 40 may be in the form of a microtireplate with e.g. 96 or 384 wells, or any other type of suitable surface such as a glass slide, filterplate or microarray for receiving the microlabels 50.
  • the microlabels 50 preferably each comprise a substantially elongate substrate bearing identification features and one or more coatings of active substances susceptible to interacting with biological samples and materials. The coatings are preferably susceptible to exhibiting fluorescent behaviour, either directly and/or after suitable processing using other substances.
  • the microscope 20 incorporates at least one episcopic super high pressure mercury illuminator 80.
  • at least one diascopic filament bulb illuminator 90 is also included within the microscope 20.
  • this identification could also be achieved by making use of an additional episcopic illuminator of suitable wavelength.
  • the filament bulb illuminator 90 may of course alternatively be another light source such as light-emitting diode array or other visible light source.
  • the system 10 is susceptible to being operated in either a manual mode or an automatic mode.
  • a. user 100 inputs instructions into the PC 70.
  • the system 10 prompts the user 100 to actuate the stage 30 until sample microlabels 50 are positioned within a field of view imaged by the microscope 20 onto the camera 60.
  • the sample microlabels 50 are then illuminated in silhouette by energizing the aforesaid diascopic filament .
  • illuminator 90 a corresponding magnified silhouette image is thereby imaged through the microscope 20 to the camera 60.
  • the frequencies used to obtain the identification image of the microlabels 50 should be chosen to have minimal overlap with the excitation spectrum of any fluorophores used to detect reaction on a microlabel 50.
  • the camera 60 generates a digital silhouette image signal corresponding to the magnified silhouette image, the silhouette signal being transmitted to the PC 70.
  • the PC 70 receives the silhouette signal and presents it as an image on its display screen 110 to the user 100.
  • the PC 70 prompts the user 100 to make some adjustments, if required, to the microscope 20, for example a focus adjustment and/or an illumination adjustment. Thereafter, the PC 70 and/or the user make changes to the optical path as necessary to subject the microlabels 50 to ultraviolet radiation by the high pressure mercury illuminator 80 and to detect the resulting image by means of the camera 60.
  • the microlabels 50 are thereby excited into fluorescence resulting in the projection of a corresponding fluorescence magnified image at the camera 60.
  • a corresponding fluorescence image signal is output from the camera 60 to the PC 70 which stores the fluorescence signal together with its corresponding silhouette signal in memory of the PC 70, for example preferably on its volatile solid state memory. It would be less likely that the storage of the fluorescence image and corresponding silhouette is stored on the hard disk or non-volatile solid state memory.
  • the PC 70 is able to recall data from its memory corresponding to the signals and perform data processing thereon to determine identities of the sample microlabels and associate these identities with corresponding degrees of fluorescence. If required, when illuminated by the filament illuminator 90, the microlabels 60 can, either alternatively or additionally, be viewed in reflection mode.
  • the system 10 scans for the microlabels 50 by actuating the platform 40 in a snake-like manner relative to the microscope 20; such a snake-like motion is depicted in Figure 2.
  • a snake-like motion is depicted in Figure 2.
  • other types of motion are also possible, for example a spiral-like motion, which enable the system 10 to inspect the platform 40 in a most efficient manner without unnecessarily presenting the microscope 20 with a same region of the platform 40 multiple times.
  • some overlap in such platform 40 motion is permissible and advantageous to reduce a probability of microlabels 50 being missed from inspection. Setting the overlap of the platform motion to equal or exceed the maximum dimension of any used microlabel would allow all microlabel present to be read.
  • the use of positional coordinates of each microlabel may then be used to verify that each microlabel is only read once.
  • the overlap may of course also be smaller than microlabel size if less accurate reading is performed or image matching is used to verify correct reading.
  • the samples 50 on the platform 40 are illuminated and monitored, via the camera 60 and the microscope 20, at the PC 70.
  • microlabels 50 enter into the magnified field of view of the camera 60 actuation of the stage 30 is halted.
  • the user 100 may then be prompted by the PC 70 to make adjustments from initial settings to the microscope 20, for example to adjust focus adjustment and/or illumination.
  • silhouette and fluorescence images of the microlabels 50 in the field of view are generated using illumination from the filament illuminator 90 and the mercury illuminator 80 respectively.
  • the PC 70 controls the alteration of the optical path of the filament illuminator 90 and the mercury illuminator 80 using automated shutters and flanges arranged to break their optical path onto the microlabels when required.
  • the PC 70 returns adjustment of microscope 20 to aforesaid initial settings and then proceeds to actuate the platform 40 in the aforementioned snake-like manner relative to the microscope 20 until further microlabels 50 are identified and so on until the entire platform 40 has been scanned.
  • SNP Single Nucleotide Polymorphisms
  • cellular staining where a filter wheel is used to generate a plurality of illumination wavelengths from the mercury illuminator 80.
  • This filter wheel may be automated and controlled by the PC 70.
  • adjustment of the microscope 20 can be made automatic under control of the PC 70.
  • focus adjustment can be achieved by employing an algorithm executing on the PC 70 which attempts to maximize the amplitude of spatial components in the image signal corresponding to fine features in the magnified image received at the camera 60; such automatic focus adjustment corresponds to a maximization of 'high frequency spatial image components'.
  • automatic illumination adjustment and/or camera 60 iris adjustment can also be performed by the PC 70. Another likely approach of achieving the automatic focusing would be via direct maximization of the high frequency spatial components via the discrete Fourier transform of the image.
  • the user 100 can terminate scanning of the platform 40 before an entire area of the platform 40 has been scanned when a sufficient number of microlabels 50 have been interrogated to generate sufficiently reliable statistical bioassay results. It is also possible for the user 100 to stipulate the termination conditions of the interrogation process when for example sufficient number of microlabels 50 has been interrogated. Alternatively the reader could be set to only interrogate those microlabels 50 which have reacted in e.g. a multiplexed bioassay reaction where reaction is indicated through the fluorescent signal. This would speed up the reading and would be useful if there was no need to read the identification of the non reacted microlabels 50.
  • the microlabels 50 are preferably of a type as described in the aforementioned international PCT applications nos. PCT/GB02/00628, PCT/GB99/03109 and PCT/GB02/00644 which are hereby incorporated by reference.
  • the microlabels are generally referred to as beads, smart beads, particle, microparticles or supports.
  • the microlabels are preferable manufactured from metal, such as aluminum, copper, silver or gold, using microfabrication methods.
  • alternative types of microlabel fabricated from various diverse materials can be used in conjunction with the system 10; such diverse materials include, but are not limited to metals, plastics materials, ceramic-like materials, biological materials and other organic materials or a combination of any such materials.
  • the shape of the microlabels may also be tailored to different applications. When large number of identification codes are needed while the microlabel surface area is kept low the shape is preferably elongated with its identification code e.g. a tramsmissive barcode arranged along its largest dimension, see figure 4 which shows this example.
  • the microlabels 50 which are substantially planar may be substantially circular, elliptical, squares, rectangles or any polygon in shape.
  • the microlabel has preferably a largest dimension which is less or equal to ca 250 ⁇ m, more preferably less or equal to ca lOO ⁇ m and most preferably less or equal to 50 ⁇ m. It is important to miniaturize the particles to decrease the use of reagents while still maintaining adequate sensitivity.
  • the particles may have dimensions in the range of ca 0.1-10 ⁇ m.
  • the microlabels 50 may be located through their shape, surface area, and/or from recognizable features of their identification code. It is also possible to have more than one type of microlabels 50 in any one experiment analyzed by the system 10. This would for example mean that a look up table (LUT) with multiple alternatives would be used to identify different microlabels 50.
  • LUT look up table
  • microlabel 50 bar-code reading is not performed by edge detection processes executed in the PC 70.
  • the alternative method comprises a first simple imaging processing step followed by a second averaging step.
  • weighted averages of image pixel groups provided from the camera 60 in its output signal are computed, and pixel groups corresponding to individual barcode bits identified.
  • the microlabels 50 are illuminated in transmission mode, namely to generate a magnified silhouette image thereof at the camera 60.
  • the camera 60 transmits the image as a pixel data set to the PC 70; such a pixel image data set is shown in Figure 3, the pixel image including n x m pixels; in the image, the microlabel 50 appears black in contrast to its illuminated background.
  • the PC 70 then proceeds to invert the image data set (STEP B; Figure 7) to generate a corresponding inverse image as illustrated in Figure 4.
  • the PC 70 then applies threshold detection (STEP D; Figure 7) to eliminate spurious artifacts from the inverse image in a process as depicted in Figure 5.
  • Such artifacts can arise from small specks of biological material or even biological coating material which has become detached from the microlabels 50.
  • a graph indicate by 200 corresponds to a line of pixels across the image of Figure 4 intersecting the microlabel 50 along its longitudinal axis.
  • the graph 200 comprises an abscissa axis 210 corresponding to spatial position within the inverse image and an ordinate axis 220.
  • One or more thresholds for example upper and lower thresholds UT, LT respectively, can be applied to generate a corresponding processed inverse image indicated by 250. If required, only a single threshold value can be employed.
  • the threshold can be made spatially variant within the image presented to the camera 60.
  • the inverse image as a pixel data set is subjected to pattern recognition filtering (STEP E; Figure 7), namely groups of pixels having approximately a spatial extent corresponding to an expected size for the microlabels 50 are identified.
  • the PC 70 then proceeds to try to identify barcodes within the groups and thereby determined whether or not the groups actually correspond to microlabels. If the PC 70 is unable to identify a barcode for an identified pixel group, the pixel group is ignored in subsequent data processing. In manual mode it is also possible for the user 100 to obtain fluorescence data even for objects which cannot be decoded. This feature give the advantage of allowing accurate calibration of the reader using standard calibration particles prior to commencing interrogation of microlabels 50.
  • the microlabels 50 are prone to physical damage. Being preferably elongate in nature, ends of the microlabels 50 are especially susceptible to fracture.
  • the microlabels 50 each include at their elongate ends barcode redundancy. Such redundancy is preferably provided by including binary digits of a value 101 in the barcode ends of each microlabel 50.
  • Analysis software executing on the PC 70 is arranged to assume that beginning and end digits of each barcode are of a value binary value 1 adjacent to an associated binary 0; the software uses these end digits to partition microlabels 50 in the processed inverse image into bits of mutually equal width (STEP F; Figure 7).
  • each microlabel 50 in the processed inverse image stored in the PC 70 has been partitioned into its individual digits (STEP G; Figure 7)
  • a central elongate strip of each microlabel 50 image present in the processed inverse image is selected by the software (STEP H; Figure 7) to further eliminate uncertainty arising from lateral edges of each microlabel 50 and from microlabel 50 curvature; such a central strip is illustrated in Figure 6.
  • the software applies averaging (STEP I; Figure 7) over an area corresponding to each binary bit of each barcode of each microlabel 50 within the processed inverse image. Thereafter, averaged values for each bit are compared against a threshold value (STEP J; Figure 7) to determine whether the bits correspond to a binary 0 or a binary 1 value.
  • the software executing on the PC 70 identifies from the processed inverse image those parts of each microlabel 50 which corresponding to solid material, namely not holes therethrough (STEPs N and O; Figure 7).
  • the PC 70 then processes the fluorescent image to determine fluorescence intensity values corresponding to each solid region of each microlabel 50, averages the fluorescence intensity for each microlabel 50 for the solid region (STEP P; Figure 7) and then records decoded barcodes with corresponding averaged fluorescence value (STEP Q; Figure 7).
  • the PC 70 proceeds to repeat (STEP R; Figure 7) the automatic mode of operation until sufficient microlabels 50 have been interrogated to obtain statistically reliable results.
  • Figure 7 provides a schematic illustration of processing steps perforated in software executing in the PC 70 to implement the automatic mode of operation.
  • the system 11 comprises of a laser scanning fluorescent reader 21, such as a microplate reader for analysis of microlabels 50 in wells of a 96- well microtitreplate 41.
  • the laser scanning fluorescent reader 11 is provided with an illuminating means in the form of a laser unit 91, which comprises one or more lasers e.g. blue 488 nm laser or green 543 nm laser depending on the number of fluorescent responses needed.
  • the laser unit 91 scans the microtitre plate well 41 using an actuating means 31, which preferably is in the form of mirrors for rastering the laser beam across the wells 41 of the microtitre plate.
  • the microlabels 50 which are coated in fluorescent reporters and arranged on the bottom of the microtitre plate well 41, emits a fluorescent excitations signal when hit by the laser beam from the laser unit 91.
  • This fluorescent signal is then passed on to the imaging means 21 comprising at least one photo multiplier tube (PMT ) 61, which allows the generation of an image based on the detection and quantification of the fluorescent signal of the microlabels 50 in the well 41.
  • the PMT 61 is coupled in communication with a processing means 71, such as a computer, which controls the agitating means 31 and is programmed to perform image analysis on signals received by the PMT 61.
  • a virtual image is generated from the image analysis allowing recognition and collating of data pertaining to inspection of microlabels 50 present in the preferred region.
  • the location and identification of the microlabels 50 by identifying spatially sequential groups of identification codes present on the microlabels 50 depicted in the image is performed in substantially the same way as for the first embodiment of the invention.
  • the microlabels 50 are preferably coated with a primary fluorescent reporter allowing non- reactive/negative bioassays on microlabels 50 to be detected and decoded when hit by the laser beam of the laser unit 91. Reactive/positive bioassays on the microlabels 50 are decoded and quantified using a secondary fluorescent reporter, which has a different emission than the primary fluorescent reporter but is also activated by the same or another laser beam from the laser unit 91. It will be appreciated that the system 10, 11 can be modified without departing from the scope of the invention. Where for example the fluorescent signal of the microlabels may be replaced of equivalent reporter technology such as radioactivity or enzyme linked systems.
  • the reading system 10, 11 could comprise of a microarray reader system where the illuminating means 80, 90, 91 comprises a laser unit, but the agitating means 30, 31 spatially actuates the surface and its microlabels relative to the imaging means 20, 21 for selecting preferred areas of the surface 40, 41.
  • the illuminating means 80, 90, 91 could comprise of number of super bright light emitting diodes (LEDs) coupled together or a Xenon lamp to allow the excitation of the fluorescent reporters bound to the microlabels 50.
  • LEDs super bright light emitting diodes

Abstract

There is provided a bioassay reading system for interrogating microlabels (50). The system comprises: (a) a platform (40) for receiving the microlabels (50); (b) a filament illuminator (90) and a episonic mercury illuminator (80) for illuminating the microlabels (50); (c) a microscope (20) and a camera (60) for generating at least one image of the illuminated microlabels (50) and converting said at least one image into corresponding image signals; (d) an actuating means (30, 31) for selecting preferred areas of the platform (40) and its microlabels (50); and (e) a personal computer (70) for receiving the image signals and for processing the signals to determine identities of microlabels (50) present in said at least one image and their associated optical responses. The system (10) is distinguished in that the personal computer (70) is operable to locate and identify the microlabels (50) by identifying spatially sequential groups of identification codes present on the microlabels (50) depicted in said at least one image.

Description

BIO ASSAY READING SYSTEM
Field of the invention
The present invention relates to bioassay reading systems; in particular, the invention concerns a bioassay reading system for reading bioassay micron-scale encoded substrates. The substrates are preferably susceptible to fluorescence when interrogated and comprise identification bar-codes; for example, such substrates are known in the art as "Smart Beads". Moreover, the present invention also relates to a method of reading such bioassay micron-scale encoded substrates using the aforementioned bioassay reading system.
Background to the invention
In a published international PCT patent application no. PCT/USOO/27121 (WO 01/26038), there are described methods of imaging colloidal rod particles, such particles functioning as nanobar codes. The methods involve imaging or reading freestanding particles comprising a plurality of segments. Moreover, the particles are of length from 10 nm to 50 μm and of width from 5 nm to 50 μm. The segments of the particles may be comprised of any material including a metal, allow, a metal allow, a metal nitride, a metal chalcogenide, a metal oxide, a metal sulfide, a metal selenide, a metal telluride, polymeric materials, crystalline and/or non-crystalline materials.
Moreover, in a published international PCT patent application no. PCT/GB99/03109 (WO 00/16893), there is described a system for performing parallel bioassays. In the system, microfabricated labels are made to each carry a biochemical test. When the system is in use, many different labels are mixed together with an analyte sample. The system additional comprises a device that reads the individual labels are thereby isolates results of individual tests. The microfabricated labels have a surface layer of anodized metal and are produced by utilizing anodizing, lithographic patterning and etching steps. Aluminium is a preferred metal for use in fabricating the labels, although other materials can be employed to fabricate the labels.
Moreover, in a published international PCT patent application no. PCT/GB02/00628 (WO 02/065123), there is disclosed a biochemical method of detecting one or more protein characteristics. The method utilizes supports, wherein each support has a largest dimension of less than 250 μm and wherein each support incorporates sequential identifying means. The method is distinguished in that it includes the steps of: (a) attaching an information molecule to a main surface of a support, the information molecule being capable of interacting with at least one of said one or more protein characteristics to be detected;
(b) suspending such supports comprising one or more different sequential identification means and one or more different information molecules in a fluid;
(c) adding a biological sample to be analysed to the fluid;
(d) detecting interaction signals from supports in the fluid using signal detecting means; and
(e) reading the sequential identification means of the supports which have an interaction signal using reading means, thereby detecting at least one of said one or more protein characteristics. Furthermore, in the international application, there is also described apparatus susceptible for executing this method. A similar approach for detecting genetic characteristics is described in a related international patent application no. PCT/GB02/00644 (WO 02/064829).
Furthermore, in a published international PCT application no. PCT/US98/11224 (WO 98/53300), there are described an apparatus and a system for simultaneously analyzing a plurality of analytes anchored to microparticles. Microparticles each having a uniform population of a single kind of analyte are disposed as a substantially immobilized planar array inside of a flow chamber where steps of an analytical process are carried out by delivering a sequence of processing reagents to the microparticles by a fluidic system under microprocessor control. In response to such process steps, an optical signal is generated at the surface of each microparticle which is characteristic of the interaction between the analyte carried by the microparticle and the delivered processing reagent. The plurality of analytes are simultaneously analyzed by collecting and recording images of the optical signals generated by all the microparticles in the planar array. A key feature of the invention is the correlation of the sequence of optical signals generated by each microparticle in the planar array during the analytical process.
The inventors have appreciated that, in a first approach, microparticles described in the foregoing can be interrogated in a flow apparatus wherein the microparticles are transported serially in a fluid flow relative to visual inspection equipment. Alternatively, in a second approach, the microparticles can be deposited onto a surface and then interrogated by moving the surface relative to a visual inspection system. In implementing the second approach, the inventors have appreciated that image data processing problems arise which renders such an approach difficult to implement in practice. In order to address these problems, the inventors have devised an improved bioassay reading system.
Summary of the invention
According to a first aspect of the present invention, there is provided a bioassay reading system for interrogating microlabels, the system comprising:
(a) a surface for receiving the microlabels;
(b) illuminating means for illuminating the microlabels;
(c) imaging means for generating at least one image of the illuminated microlabels and converting said at least one image into corresponding image signals;
(d) actuating means for selecting preferred areas of the surface with the microlabels received thereon; and
(e) data processing means for receiving the image signals and for processing the signals to determine identities of microlabels present in said at least one image and their associated optical responses, characterised in at the processing means is operable to locate and identify the microlabels by identifying spatially sequential groups of identification codes present on the microlabels depicted in said at least one image.
The invention is of advantage in that identifying the microlabels by searching for their corresponding spatially sequential groups of identification codes is capable of providing more reliable reading of the microlabels.
Preferably, the data processing means is arranged to process the image signals to identify spatial regions therein corresponding to groups of identification codes and hence their corresponding microlabel positions, and then to process the image signals corresponding to a substantially central portion of each microlabel to determine its corresponding identification code. By utilizing information corresponding to only central portions of microlabels, the system is capable of being rendered more resilient to misidentification of microlabels with damaged edge regions. This increased reliability allows a greater number of distinct codes to be used.
Preferably, the processing means is operable to subject the image signals to threshold detection to remove background artefacts therein. Such threshold detection is capable of resulting in simpler and less ambiguous processed image data in which to identify microlabel identification codes. Preferably, the illuminating means is arranged to output radiation for use in interrogating the microlabels at a plurality of selectable wavelengths for determining identification codes of the microlabels and their corresponding optical responses. Using a plurality of wavelengths enables the microlabels to be interrogated using radiation of wavelengths where their identification codes are most easily distinguished, and their fluorescence determined using radiation of wavelengths where their fluorescence is most easily measured.
Preferably, therefore, the illuminating means is operable to output radiation capable of exciting microlabel fluorescence for determining the optical responses. More preferably, the illuminating means includes a filament light source for illuminating the microlabels to determine their identification codes, and at least one ultra-violet light source for illuminating the microlabels to determine their optical responses.
Preferably, in the system, the processing means is capable of identifying redundant identification code sequences at elongate ends of the microlabels, said redundant code sequences being included in the microlabels for rendering them less susceptible to being misidentified in the system due to microlabel edge damage.
Preferably, the processing means is operable to compress intensity variations in the image signals for enhancing identification code detection when applying threshold detection to the compressed image signals. Such compression is capable of improving the system's ability to determine microlabel identification codes correctly. More preferably, such compression is applied to favour identification codes corresponding to regions of relatively high light transmission and/or relatively low light reflectivity of each microlabel.
Preferably, the processing means is operable to determine the optical responses of the microlabels based on emission substantially from solid regions of the microlabels only. Such an approach renders the fluorescence response measurement less susceptible to modulation in relation to the microlabels' identification codes and to edge effects resulting from infinite image resolution and variation in the geometry of individual microlabels.
According to a second aspect of the present invention, there is provided a method of interrogating microlabels in a bioassay reading system, the system comprising: (a) a surface for receiving the microlabels;
(b) illuminating means for illuminating the microlabels;
(c) imaging means for generating at least one image of the illuminated microlabels;
(d) actuating means for selecting preferred areas of the surface and its microlabels; and
(e) data processing means for receiving the image signals;
the method comprising the steps of:
(f) illuminating the microlabels using the illuminating means to generate said at least one image of the illuminated microlabels;
(g) converting said at least one image into corresponding image signals;
(h) processing the signals to determine identities of microlabels present in said at least one image and their associated optical responses, characterised in that the method further comprises in step (h) the step of locating and identifying the microlabels by identifying spatially sequential groups of identification codes present on the microlabels depicted in said at least one image.
Preferably, the method further comprising in step (h) the steps of:
(a) processing the image signals in the processing means to identify spatial regions therein corresponding to groups of identification codes and hence their corresponding microlabel positions, and then
(b) processing the image signals corresponding to a substantially central portion of each microlabel to determine its corresponding identification code.
Preferably, the method further comprising in step (h) the step of subjecting the image signals in the processing means to threshold detection to remove background artefacts therein.
Preferably, the method further comprising in step (h) the step of arranging for the illuminating means to output radiation to interrogating the microlabels at a plurality of selectable wavelengths for determining identification codes of the microlabels and their corresponding optical responses.
Preferably, the illuminating means is operable to output radiation capable of exciting microlabel fluorescence for determining the optical responses. Preferably, in the method, the illuminating means includes a filament light source for illuminating the microlabels to determine their identification codes, and a ultra-violet light source for illuminating the microlabels to determine their optical response.
Preferably, in the method, the processing means is capable of identifying redundant identification code sequences at elongate ends of the microlabels, said redundant code sequences being included in the microlabels for rendering them less susceptible to being misidentified in the system due to microlabel edge damage.
Preferably, in the method, the processing means is operable to compress intensity variations in the image signals for enhancing identification code detection when applying threshold detection to the compressed image signals.
Preferably, in the method, compression is applied to favour identification codes corresponding to regions of relatively high light transmission and/or relatively low light reflectivity of each microlabel.
Preferably, the processing means is operable to determine the optical responses of the microlabels based on emission substantially from solid regions of the microlabels only.
It will be appreciated that features of the invention can be combined in any combination without departing from the scope of the invention.
Description of the drawings
Embodiments of the invention will now be described, by way of example only, with reference to the following diagrams wherein:
Figure 1 is an illustration of a bioassay reading system according to the first embodiment of the invention;
Figure 2 is an illustration of snake-like motion of a stage of the system of Figure 1 relative to a microscope thereof; Figure 3 is an example of a pixel image depicting a microlabel, the image generated from a camera of the system of Figure 1;
Figure 4 is an illustration of an inverse version of the image in Figure 3;
Figure 5 is an illustration of threshold detection applied to detect the presence of microlabels in the inverse image of Figure 4;
Figure 6 is an illustration of central strip detection to render microlabel barcode detection more reliable;
Figures 7a to 7d depict a flow chart of steps executed to read microlabels using the system as depicted in Figure 1; and
Figure 8 is an illustration of a bioassay reading system according to the second embodiment of the invention;
Description of embodiments of the invention
Referring to Figure 1, a first embodiment of a bioassay reading system according to the invention is shown and indicated generally by 10. In overview, the system 10 comprises an optical microscope 20. The microscope 20 is provided with a motorized stage 30 for actuating a platform 40 bearing microlabels 50 relative to the microscope 20 for enabling the microscope 20 to inspect preferred regions of the platform 40. Hence, the motorized stage 30 is used for spatially actuating the platform 40 and its microlabels 50 relative to the microscope 20 for selecting preferred areas of the platform 40. Moreover, the microscope 20 is provided with a monochrome charge-coupled-device (CCD) camera 60 for receiving magnified images of the preferred regions. It will be apparent to the person skilled in the art that a different type of camera could be used for receiving these images. The camera 60 is coupled in communication with a personal computer (PC) 70 which is arranged to control movement of the platform 40 relative to the microscope 20. The PC 70 is also programmed to perform image analysis on signals generated by the camera 60 when inspecting the platform 40 and thereby recognize and collate data pertaining to inspected microlabels 50 present in the preferred regions. The platform 40 may be in the form of a microtireplate with e.g. 96 or 384 wells, or any other type of suitable surface such as a glass slide, filterplate or microarray for receiving the microlabels 50. The microlabels 50 preferably each comprise a substantially elongate substrate bearing identification features and one or more coatings of active substances susceptible to interacting with biological samples and materials. The coatings are preferably susceptible to exhibiting fluorescent behaviour, either directly and/or after suitable processing using other substances.
In order to stimulate fluorescence, the microscope 20 incorporates at least one episcopic super high pressure mercury illuminator 80. Moreover, for inspecting identification features of the microlabels, at least one diascopic filament bulb illuminator 90 is also included within the microscope 20. Alternatively, this identification could also be achieved by making use of an additional episcopic illuminator of suitable wavelength. The filament bulb illuminator 90 may of course alternatively be another light source such as light-emitting diode array or other visible light source.
The system 10 is susceptible to being operated in either a manual mode or an automatic mode. When functioning in the manual mode, a. user 100 inputs instructions into the PC 70.
The manual mode of operation will now be described in overview.
In the manual mode, the system 10 prompts the user 100 to actuate the stage 30 until sample microlabels 50 are positioned within a field of view imaged by the microscope 20 onto the camera 60. The sample microlabels 50 are then illuminated in silhouette by energizing the aforesaid diascopic filament . illuminator 90; a corresponding magnified silhouette image is thereby imaged through the microscope 20 to the camera 60. The frequencies used to obtain the identification image of the microlabels 50 should be chosen to have minimal overlap with the excitation spectrum of any fluorophores used to detect reaction on a microlabel 50. This has the advantage of maximizing the contrast of the identification image aiding decoding, reducing the rate of photobleaching of the sample, and increasing the accuracy of fluorescence quantification. The camera 60 generates a digital silhouette image signal corresponding to the magnified silhouette image, the silhouette signal being transmitted to the PC 70. The PC 70 receives the silhouette signal and presents it as an image on its display screen 110 to the user 100. The PC 70 prompts the user 100 to make some adjustments, if required, to the microscope 20, for example a focus adjustment and/or an illumination adjustment. Thereafter, the PC 70 and/or the user make changes to the optical path as necessary to subject the microlabels 50 to ultraviolet radiation by the high pressure mercury illuminator 80 and to detect the resulting image by means of the camera 60. The microlabels 50 are thereby excited into fluorescence resulting in the projection of a corresponding fluorescence magnified image at the camera 60. A corresponding fluorescence image signal is output from the camera 60 to the PC 70 which stores the fluorescence signal together with its corresponding silhouette signal in memory of the PC 70, for example preferably on its volatile solid state memory. It would be less likely that the storage of the fluorescence image and corresponding silhouette is stored on the hard disk or non-volatile solid state memory. Subsequently, the PC 70 is able to recall data from its memory corresponding to the signals and perform data processing thereon to determine identities of the sample microlabels and associate these identities with corresponding degrees of fluorescence. If required, when illuminated by the filament illuminator 90, the microlabels 60 can, either alternatively or additionally, be viewed in reflection mode.
In the automatic mode, the system 10 scans for the microlabels 50 by actuating the platform 40 in a snake-like manner relative to the microscope 20; such a snake-like motion is depicted in Figure 2. It will be appreciated that other types of motion are also possible, for example a spiral-like motion, which enable the system 10 to inspect the platform 40 in a most efficient manner without unnecessarily presenting the microscope 20 with a same region of the platform 40 multiple times. However, some overlap in such platform 40 motion is permissible and advantageous to reduce a probability of microlabels 50 being missed from inspection. Setting the overlap of the platform motion to equal or exceed the maximum dimension of any used microlabel would allow all microlabel present to be read. The use of positional coordinates of each microlabel may then be used to verify that each microlabel is only read once. The overlap may of course also be smaller than microlabel size if less accurate reading is performed or image matching is used to verify correct reading.
During such motion, the samples 50 on the platform 40 are illuminated and monitored, via the camera 60 and the microscope 20, at the PC 70. When microlabels 50 enter into the magnified field of view of the camera 60, actuation of the stage 30 is halted. The user 100 may then be prompted by the PC 70 to make adjustments from initial settings to the microscope 20, for example to adjust focus adjustment and/or illumination. Thereafter, silhouette and fluorescence images of the microlabels 50 in the field of view are generated using illumination from the filament illuminator 90 and the mercury illuminator 80 respectively. The PC 70 controls the alteration of the optical path of the filament illuminator 90 and the mercury illuminator 80 using automated shutters and flanges arranged to break their optical path onto the microlabels when required. When corresponding microlabel 50 silhouette image data and fluorescent image data have been recorded in memory of the PC 70, the PC 70 returns adjustment of microscope 20 to aforesaid initial settings and then proceeds to actuate the platform 40 in the aforementioned snake-like manner relative to the microscope 20 until further microlabels 50 are identified and so on until the entire platform 40 has been scanned.
There are also applications such as the analysis of Single Nucleotide Polymorphisms (SNP) or cellular staining where a filter wheel is used to generate a plurality of illumination wavelengths from the mercury illuminator 80. This filter wheel may be automated and controlled by the PC 70.
In the automatic mode, it will further be appreciated that adjustment of the microscope 20 can be made automatic under control of the PC 70. For example, focus adjustment can be achieved by employing an algorithm executing on the PC 70 which attempts to maximize the amplitude of spatial components in the image signal corresponding to fine features in the magnified image received at the camera 60; such automatic focus adjustment corresponds to a maximization of 'high frequency spatial image components'. Alternatively, or additionally, automatic illumination adjustment and/or camera 60 iris adjustment can also be performed by the PC 70. Another likely approach of achieving the automatic focusing would be via direct maximization of the high frequency spatial components via the discrete Fourier transform of the image.
Moreover, in automatic mode, the user 100 can terminate scanning of the platform 40 before an entire area of the platform 40 has been scanned when a sufficient number of microlabels 50 have been interrogated to generate sufficiently reliable statistical bioassay results. It is also possible for the user 100 to stipulate the termination conditions of the interrogation process when for example sufficient number of microlabels 50 has been interrogated. Alternatively the reader could be set to only interrogate those microlabels 50 which have reacted in e.g. a multiplexed bioassay reaction where reaction is indicated through the fluorescent signal. This would speed up the reading and would be useful if there was no need to read the identification of the non reacted microlabels 50.
The microlabels 50 are preferably of a type as described in the aforementioned international PCT applications nos. PCT/GB02/00628, PCT/GB99/03109 and PCT/GB02/00644 which are hereby incorporated by reference. In these patent applications the microlabels are generally referred to as beads, smart beads, particle, microparticles or supports. The microlabels are preferable manufactured from metal, such as aluminum, copper, silver or gold, using microfabrication methods. However, alternative types of microlabel fabricated from various diverse materials can be used in conjunction with the system 10; such diverse materials include, but are not limited to metals, plastics materials, ceramic-like materials, biological materials and other organic materials or a combination of any such materials. The shape of the microlabels may also be tailored to different applications. When large number of identification codes are needed while the microlabel surface area is kept low the shape is preferably elongated with its identification code e.g. a tramsmissive barcode arranged along its largest dimension, see figure 4 which shows this example. For other planar reading applications the microlabels 50; which are substantially planar may be substantially circular, elliptical, squares, rectangles or any polygon in shape. The microlabel has preferably a largest dimension which is less or equal to ca 250μm, more preferably less or equal to ca lOOμm and most preferably less or equal to 50μm. It is important to miniaturize the particles to decrease the use of reagents while still maintaining adequate sensitivity. For applications that require extreme miniaturization the particles may have dimensions in the range of ca 0.1-10μm. During the interrogation the microlabels 50 may be located through their shape, surface area, and/or from recognizable features of their identification code. It is also possible to have more than one type of microlabels 50 in any one experiment analyzed by the system 10. This would for example mean that a look up table (LUT) with multiple alternatives would be used to identify different microlabels 50.
In contradistinction to conventional bar-code reading apparatus, microlabel 50 bar-code reading is not performed by edge detection processes executed in the PC 70. The inventors have found that the system 20 is susceptible to being rendered more fault tolerant by employing an alternative image processing method; the alternative method comprises a first simple imaging processing step followed by a second averaging step. In the second step, weighted averages of image pixel groups provided from the camera 60 in its output signal are computed, and pixel groups corresponding to individual barcode bits identified.
The aforesaid alternative image processing method will now be elucidated in more detail.
In the first imaging step (STEP A; Figure 7), the microlabels 50 are illuminated in transmission mode, namely to generate a magnified silhouette image thereof at the camera 60. The camera 60 transmits the image as a pixel data set to the PC 70; such a pixel image data set is shown in Figure 3, the pixel image including n x m pixels; in the image, the microlabel 50 appears black in contrast to its illuminated background. The PC 70 then proceeds to invert the image data set (STEP B; Figure 7) to generate a corresponding inverse image as illustrated in Figure 4.
The PC 70 then applies threshold detection (STEP D; Figure 7) to eliminate spurious artifacts from the inverse image in a process as depicted in Figure 5. Such artifacts can arise from small specks of biological material or even biological coating material which has become detached from the microlabels 50. In Figure 5, a graph indicate by 200 corresponds to a line of pixels across the image of Figure 4 intersecting the microlabel 50 along its longitudinal axis. The graph 200 comprises an abscissa axis 210 corresponding to spatial position within the inverse image and an ordinate axis 220. One or more thresholds, for example upper and lower thresholds UT, LT respectively, can be applied to generate a corresponding processed inverse image indicated by 250. If required, only a single threshold value can be employed. Moreover, with varying illumination, the threshold can be made spatially variant within the image presented to the camera 60.
In the second averaging step, the inverse image as a pixel data set is subjected to pattern recognition filtering (STEP E; Figure 7), namely groups of pixels having approximately a spatial extent corresponding to an expected size for the microlabels 50 are identified. Subsequently for the groups, the PC 70 then proceeds to try to identify barcodes within the groups and thereby determined whether or not the groups actually correspond to microlabels. If the PC 70 is unable to identify a barcode for an identified pixel group, the pixel group is ignored in subsequent data processing. In manual mode it is also possible for the user 100 to obtain fluorescence data even for objects which cannot be decoded. This feature give the advantage of allowing accurate calibration of the reader using standard calibration particles prior to commencing interrogation of microlabels 50.
In manufacture and subsequent use in bioassays, the microlabels 50 are prone to physical damage. Being preferably elongate in nature, ends of the microlabels 50 are especially susceptible to fracture. In order to render the microlabels 50 more robust when used in the system 10, the microlabels 50 each include at their elongate ends barcode redundancy. Such redundancy is preferably provided by including binary digits of a value 101 in the barcode ends of each microlabel 50. Analysis software executing on the PC 70 is arranged to assume that beginning and end digits of each barcode are of a value binary value 1 adjacent to an associated binary 0; the software uses these end digits to partition microlabels 50 in the processed inverse image into bits of mutually equal width (STEP F; Figure 7).
Once each microlabel 50 in the processed inverse image stored in the PC 70 has been partitioned into its individual digits (STEP G; Figure 7), a central elongate strip of each microlabel 50 image present in the processed inverse image is selected by the software (STEP H; Figure 7) to further eliminate uncertainty arising from lateral edges of each microlabel 50 and from microlabel 50 curvature; such a central strip is illustrated in Figure 6.
Once the aforesaid central strip has been identified for each microlabel 50, the software applies averaging (STEP I; Figure 7) over an area corresponding to each binary bit of each barcode of each microlabel 50 within the processed inverse image. Thereafter, averaged values for each bit are compared against a threshold value (STEP J; Figure 7) to determine whether the bits correspond to a binary 0 or a binary 1 value.
If after averaging each binary bit and subsequent threshold detection a valid barcode is detected by the software, for example by way of parity bit validation, the barcode is assumed by the software to pertain to the microlabel 50. Conversely, if one or more barcodes are found not to be valid, further image signal processing is undertaken. In this further processing, high intensity pixels in the aforesaid central strip have their corresponding intensity values mapped (STEP L; Figure 7) by a mathematical function or look up table (LUT) towards, or to, a particular value in favour of identifying parts of the barcode as a binary 0 value. This further processing is undertaken to improve the decoding rate of microlabels with improperly etched and/or otherwise obscured apertures. Subsequent threshold detection (STEP M; Figure 7) is then performed to determine corresponding barcodes.
After identification of the microlabels 50 and their corresponding barcodes, the software executing on the PC 70 identifies from the processed inverse image those parts of each microlabel 50 which corresponding to solid material, namely not holes therethrough (STEPs N and O; Figure 7). The PC 70 then processes the fluorescent image to determine fluorescence intensity values corresponding to each solid region of each microlabel 50, averages the fluorescence intensity for each microlabel 50 for the solid region (STEP P; Figure 7) and then records decoded barcodes with corresponding averaged fluorescence value (STEP Q; Figure 7). The PC 70 proceeds to repeat (STEP R; Figure 7) the automatic mode of operation until sufficient microlabels 50 have been interrogated to obtain statistically reliable results.
Figure 7 provides a schematic illustration of processing steps perforated in software executing in the PC 70 to implement the automatic mode of operation.
Referring to Figure 8, a second embodiment of a bioassay reader system according to the invention is shown and indicated generally by 11. In overview, the system 11 comprises of a laser scanning fluorescent reader 21, such as a microplate reader for analysis of microlabels 50 in wells of a 96- well microtitreplate 41. The laser scanning fluorescent reader 11 is provided with an illuminating means in the form of a laser unit 91, which comprises one or more lasers e.g. blue 488 nm laser or green 543 nm laser depending on the number of fluorescent responses needed. The laser unit 91 scans the microtitre plate well 41 using an actuating means 31, which preferably is in the form of mirrors for rastering the laser beam across the wells 41 of the microtitre plate. The microlabels 50, which are coated in fluorescent reporters and arranged on the bottom of the microtitre plate well 41, emits a fluorescent excitations signal when hit by the laser beam from the laser unit 91. This fluorescent signal is then passed on to the imaging means 21 comprising at least one photo multiplier tube (PMT ) 61, which allows the generation of an image based on the detection and quantification of the fluorescent signal of the microlabels 50 in the well 41. The PMT 61 is coupled in communication with a processing means 71, such as a computer, which controls the agitating means 31 and is programmed to perform image analysis on signals received by the PMT 61. A virtual image is generated from the image analysis allowing recognition and collating of data pertaining to inspection of microlabels 50 present in the preferred region. The location and identification of the microlabels 50 by identifying spatially sequential groups of identification codes present on the microlabels 50 depicted in the image is performed in substantially the same way as for the first embodiment of the invention.
The microlabels 50 are preferably coated with a primary fluorescent reporter allowing non- reactive/negative bioassays on microlabels 50 to be detected and decoded when hit by the laser beam of the laser unit 91. Reactive/positive bioassays on the microlabels 50 are decoded and quantified using a secondary fluorescent reporter, which has a different emission than the primary fluorescent reporter but is also activated by the same or another laser beam from the laser unit 91. It will be appreciated that the system 10, 11 can be modified without departing from the scope of the invention. Where for example the fluorescent signal of the microlabels may be replaced of equivalent reporter technology such as radioactivity or enzyme linked systems. Further the reading system 10, 11 could comprise of a microarray reader system where the illuminating means 80, 90, 91 comprises a laser unit, but the agitating means 30, 31 spatially actuates the surface and its microlabels relative to the imaging means 20, 21 for selecting preferred areas of the surface 40, 41. Further more the illuminating means 80, 90, 91 could comprise of number of super bright light emitting diodes (LEDs) coupled together or a Xenon lamp to allow the excitation of the fluorescent reporters bound to the microlabels 50.

Claims

1. A bioassay reading system for interrogating microlabels (50), the system comprising:
(a) a surface 40, 41) for receiving the microlabels (50);
(b) illuminating means (80, 90, 91) for illuminating the microlabels (50);
(c) imaging means (20, 21) for generating at least one image of the illuminated microlabels (50) and converting said at least one image into corresponding image signals;
(d) actuating means (30, 31) for selecting preferred areas of the surface (40, 41) and its microlabels (50); and
(e) data processing means (70, 71) for receiving the image signals and for processing the signals to determine identities of microlabels (50) present in said at least one image and their associated optical responses, characterised in that the processing means (70, 71) is operable to locate and identify the microlabels (50) by identifying spatially sequential groups of identification codes present on the microlabels (50) depicted in said at least one image.
2. A system according to Claim 1, wherein the data processing means (70, 71) is arranged to process the image signals to identify spatial regions therein corresponding to groups of identification codes and hence their corresponding microlabel (50) positions, and then to process the image signals corresponding to a substantially central portion of each microlabel (50) to determine its corresponding identification code.
3. A system according to Claim 1 or 2, wherein the processing means (70, 71) is operable to subject the image signals to threshold detection to remove background artefacts therein.
4. A system according to Claim 1, 2 or 3, wherein the illuminating means (80, 90, 91) is arranged to output radiation for use in interrogating the microlabels (50) at a plurality of selectable wavelengths for determining identification codes of the microlabels (50) and their corresponding optical responses.
5. A system according to Claim 4, wherein the illuminating means (80, 90, 91) is operable to output radiation capable of exciting microlabel fluorescence for determining the optical responses.
6. A system according to Claim 4 or 5, wherein the illuminating means (80, 90, 91) includes a filament light source (90) for illuminating the microlabels (50) to determine their identification codes, and a ultra-violet light source (80) for illuminating the microlabels (50) to determine their optical response.
7. A system according to Claim 4 or 5, wherein the illuminating means (80, 90, 91) includes a laser unit with at least one laser source for illuminating the microlabels (50) to determine their identification codes and/or their optical response.
8. A system according to any one of the preceding claims, wherein the processing means (70, 71) is capable of identifying redundant identification code sequences at elongate ends of the microlabels (50), said redundant code sequences being included in the microlabels (50) for rendering them less susceptible to being misidentified in the system (10, 11) due to microlabel (50) edge damage.
9. A system according to any one of the preceding claims, wherein the processing means (70, 71) is operable to compress intensity variations in the image signals for enhancing identification code detection when applying threshold detection to the compressed image signals.
10. A system according to Claim 9, wherein compression is applied to favour identification codes corresponding to regions of relatively high light transmission and/or relatively low light reflectivity of each microlabel (50).
11. A system according to any one of the preceding claims, wherein the processing means (70, 71) is operable to determine the optical responses of the microlabels (50) based on emission substantially from solid regions of the microlabels (50) only.
12. A system substantially as hereinbefore described with reference to one or more of Figures 1 to 8.
13. A method of interrogating microlabels (50) in a bioassay reading system, the system comprising:
(a) a surface (40, 41) for receiving the microlabels (50);
(b) illuminating means (80, 90, 91) for illuminating the microlabels (50); (c) imaging means (20, 21) for generating at least one image of the illuminated microlabels (50);
(d) actuating means (30, 31) for selecting preferred areas of the surface (40, 41) and its microlabels (50); and
(e) data processing means (70, 71) for receiving the image signals;
the method comprising the steps of:
(f) illuminating the microlabels (50) using the illuminating means (80, 90, 91) to generate said at least one image of the illuminated microlabels (50);
(g) converting said at least one image into corresponding image signals;
(h) processing the signals to determine identities of microlabels (50) present in said at least one image and their associated optical responses, characterised in that the method further comprises in step (h) the step of locating and identifying the microlabels (50) by identifying spatially sequential groups of identification codes present on the microlabels (50) depicted in said at least one image.
14. A method according to Claim 13, the method further comprising in step (h) the steps of:
(a) processing the image signals in the processing means to identify spatial regions therein corresponding to groups of identification codes and hence their corresponding microlabel (50) positions, and then
(b) processing the image signals corresponding to a substantially central portion of each microlabel (50) to determine its corresponding identification code.
15. A method according to Claim 13 or 14, the method further comprising in step (h) the step of subjecting the image signals in the processing means to threshold detection to remove background artefacts therein.
16. A method according to Claim 13, 14 or 15, the method further comprising in step (h) the step of arranging for the illuminating means (80, 90, 91) to output radiation to interrogating the microlabels (50) at a plurality of selectable wavelengths for determining identification codes of the microlabels (50) and their corresponding optical responses.
17. A method according to Claim 16, wherein the illuminating means (80, 90, 91) is operable to output radiation capable of exciting microlabel fluorescence for determining the optical responses.
18. A method according to Claim 17, wherein the illuminating means (80, 90, 91) includes a filament light source (90) for illuminating the microlabels (50) to determine their identification codes, and a ultra-violet light source (80) for illuminating the microlabels (50) to determine their optical response.
19. A method according to any one of Claims 13 to 18, wherein the processing means (70, 71) is capable of identifying redundant identification code sequences at elongate ends of the microlabels (50), said redundant code sequences being included in the microlabels (50) for rendering them less susceptible to being misidentified in the system (10, 11) due to microlabel (50) edge damage.
20. A method according to any one of Claims 13 to 19, wherein the processing means (70, 71) is operable to compress intensity variations in the image signals for enhancing identification code detection when applying threshold detection to the compressed image signals.
21. A method according to Claim 20, wherein compression is applied to favour identification codes corresponding to regions of relatively high light transmission and/or relatively low light reflectivity of each microlabel (50).
22. A method according to any one of Claims 13 to 21, wherein the processing means (70, 71) is operable to determine the optical responses of the microlabels (50) based on emission substantially from solid regions of the microlabels (50) only.
23. A method of interrogating microlabels (50) in a bioassay reading system (10, 11) substantially as hereinbefore described with reference to one or more of Figures 1 to 8.
PCT/GB2003/005073 2002-11-21 2003-11-20 Bioassay reading system WO2004046697A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2003302130A AU2003302130A1 (en) 2002-11-21 2003-11-20 Bioassay reading system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0227209.4 2002-11-21
GB0227209A GB2395594A (en) 2002-11-21 2002-11-21 Bioassay reading system using a computer to locate and identify microlabels by identifying spatially sequential groups or identification codes

Publications (1)

Publication Number Publication Date
WO2004046697A1 true WO2004046697A1 (en) 2004-06-03

Family

ID=9948286

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2003/005073 WO2004046697A1 (en) 2002-11-21 2003-11-20 Bioassay reading system

Country Status (3)

Country Link
AU (1) AU2003302130A1 (en)
GB (1) GB2395594A (en)
WO (1) WO2004046697A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7745092B2 (en) 2005-09-13 2010-06-29 Affymetrix, Inc. Multiple step printing methods for microbarcodes
US7791802B2 (en) 2004-02-19 2010-09-07 Illumina, Inc. Optical identification element having a non-waveguide substrate
US7900836B2 (en) 2002-08-20 2011-03-08 Illumina, Inc. Optical reader system for substrates having an optically readable code
US8178278B2 (en) 2005-09-13 2012-05-15 Affymetrix, Inc. Miniaturized microparticles
US8470605B2 (en) 2002-09-12 2013-06-25 Illumina, Inc. Optical reader for reading encoded microparticles
US9268983B2 (en) 2003-01-22 2016-02-23 Illumina, Inc. Optical system and method for reading encoded microbeads

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1445098A (en) * 1973-04-04 1976-08-04 Plessey Co Ltd Optical code recognition
WO1998053300A2 (en) * 1997-05-23 1998-11-26 Lynx Therapeutics, Inc. System and apparaus for sequential processing of analytes
WO2000016893A2 (en) * 1998-09-17 2000-03-30 Smartbead Technologies Limited Bio-assay technique
WO2000063419A1 (en) * 1999-04-15 2000-10-26 Virtual Arrays, Inc. Combinatorial chemical library supports having indicia at coding positions and methods of use
US6193158B1 (en) * 1996-06-03 2001-02-27 Accu-Sort Systems, Inc. High speed image acquisition system and method
WO2001026038A1 (en) * 1999-10-01 2001-04-12 The Penn State Research Foundation Methods of imaging colloidal rod particles as nanobar codes
WO2002064829A2 (en) * 2001-02-13 2002-08-22 Smartbead Technologies Limited Biochemical method and apparatus for detecting genetic characteristics
WO2002065123A2 (en) * 2001-02-13 2002-08-22 Smartbead Technologies Limited Biochemical method and apparatus for detecting protein characteristics

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1445098A (en) * 1973-04-04 1976-08-04 Plessey Co Ltd Optical code recognition
US6193158B1 (en) * 1996-06-03 2001-02-27 Accu-Sort Systems, Inc. High speed image acquisition system and method
WO1998053300A2 (en) * 1997-05-23 1998-11-26 Lynx Therapeutics, Inc. System and apparaus for sequential processing of analytes
WO2000016893A2 (en) * 1998-09-17 2000-03-30 Smartbead Technologies Limited Bio-assay technique
WO2000063419A1 (en) * 1999-04-15 2000-10-26 Virtual Arrays, Inc. Combinatorial chemical library supports having indicia at coding positions and methods of use
WO2001026038A1 (en) * 1999-10-01 2001-04-12 The Penn State Research Foundation Methods of imaging colloidal rod particles as nanobar codes
WO2002064829A2 (en) * 2001-02-13 2002-08-22 Smartbead Technologies Limited Biochemical method and apparatus for detecting genetic characteristics
WO2002065123A2 (en) * 2001-02-13 2002-08-22 Smartbead Technologies Limited Biochemical method and apparatus for detecting protein characteristics

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7900836B2 (en) 2002-08-20 2011-03-08 Illumina, Inc. Optical reader system for substrates having an optically readable code
US8470605B2 (en) 2002-09-12 2013-06-25 Illumina, Inc. Optical reader for reading encoded microparticles
US9268983B2 (en) 2003-01-22 2016-02-23 Illumina, Inc. Optical system and method for reading encoded microbeads
US7791802B2 (en) 2004-02-19 2010-09-07 Illumina, Inc. Optical identification element having a non-waveguide substrate
US7745092B2 (en) 2005-09-13 2010-06-29 Affymetrix, Inc. Multiple step printing methods for microbarcodes
US7745091B2 (en) 2005-09-13 2010-06-29 Affymetrix, Inc. Miniaturized microparticles
US8088555B2 (en) 2005-09-13 2012-01-03 Affymetrix, Inc. Multiple step printing methods for microbarcodes
US8168368B2 (en) 2005-09-13 2012-05-01 Affymetrix, Inc. Miniaturized microparticles
US8178278B2 (en) 2005-09-13 2012-05-15 Affymetrix, Inc. Miniaturized microparticles
US8592136B2 (en) 2005-09-13 2013-11-26 Affymetrix, Inc. Methods for producing codes for microparticles
US8748079B2 (en) 2005-09-13 2014-06-10 Affymetrix, Inc. Multiple step printing methods for microbarcodes
US8945811B2 (en) 2005-09-13 2015-02-03 Affymetrix, Inc. Miniaturized microparticles

Also Published As

Publication number Publication date
AU2003302130A1 (en) 2004-06-15
GB2395594A (en) 2004-05-26
GB0227209D0 (en) 2002-12-24

Similar Documents

Publication Publication Date Title
US5585639A (en) Optical scanning apparatus
EP1507139A2 (en) Arrays for multiplexed surface plasmon resonance detection of biological molecules
JP3837165B2 (en) Digital imaging system for testing in well plates, gels and blots
US20110007955A1 (en) Apparatus and Method for Barcoded Magnetic Beads Analysis
EP1228354B1 (en) Apparatus and method for calibration of a microarray scanning system
US7269518B2 (en) Chemical array reading
JP4372357B2 (en) Automated imaging and analysis of microarray biochips
JP4286447B2 (en) Digital imaging system for assays in well plates, gels and blots
EP1797195B1 (en) Method and apparatus for the detection of labeling elements in a sample
US20030134330A1 (en) Chemical-library composition and method
US20040178338A1 (en) Differentiable spectral bar code methods and systems
US20060006237A1 (en) Scanning parameterization for biopolymeric array scanner
JP4633712B2 (en) Image forming apparatus
WO2009020506A1 (en) Apparatus and method for digital magnetic beads analysis
US8428398B2 (en) Hand-held portable microarray reader for biodetection
WO2004046697A1 (en) Bioassay reading system
WO2006007715A1 (en) System and method for rapid reading of macro and micro matrices
US7764361B2 (en) Systems and methods to analyze multiplexed bead-based assays using backscattered light
US20040063105A1 (en) Biopolymer array scanner with real-time saturation detection
JP4414333B2 (en) System and method for solutions based on multi-parameter analysis of specimens
JP2004527735A5 (en)
US7818129B2 (en) Detection of feature boundary pixels during array scanning
WO2001057501A1 (en) Improved microarray reader
EP1933131A1 (en) Efficient method and system for detecting luminescence
RU200805U1 (en) Fluorescent Biochip Analyzer

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP