US20060045348A1 - Method and apparatus for automated cellular bioinformatics - Google Patents

Method and apparatus for automated cellular bioinformatics Download PDF

Info

Publication number
US20060045348A1
US20060045348A1 US11/256,454 US25645405A US2006045348A1 US 20060045348 A1 US20060045348 A1 US 20060045348A1 US 25645405 A US25645405 A US 25645405A US 2006045348 A1 US2006045348 A1 US 2006045348A1
Authority
US
United States
Prior art keywords
experiment
processes
database
task
plate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/256,454
Inventor
Eskinder Kiros
Ping Ling
Robert Muller
Ramesh Venkat
Wesley Zink
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cytokinetics Inc
Original Assignee
Cytokinetics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cytokinetics Inc filed Critical Cytokinetics Inc
Priority to US11/256,454 priority Critical patent/US20060045348A1/en
Publication of US20060045348A1 publication Critical patent/US20060045348A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G01N15/1433
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/40Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/96Management of image or video recognition tasks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/02Investigating particle size or size distribution
    • G01N2015/0294Particle shape
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N2015/1006Investigating individual particles for cytology
    • G01N2015/1024
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N2015/1477Multiparameters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30024Cell structures in vitro; Tissue sections in vitro

Definitions

  • the present invention relates to computer-automated cellular biological systems. More particularly still, the present invention relates to computer-automated cellular biological systems for designing, conducting, monitoring, and validating a cell-line-based biological experiment including a treatment compound.
  • a cell-line-based biological experiment on specific biological markers is typically a process that groups a set of assay plates into a collection designed to achieve a scientific purpose, or is a composite of several such processes.
  • One known technique in cytobiological research involves the analysis of cellular images from such experiments.
  • An assay plate is a collection of wells arranged in groups of wells.
  • a well group is a set of wells on an assay plate, or ranging across two or more assay plates, that represents a specific collection of wells for distinct analysis.
  • a treatment is a particular drug or other external stimulus (or a combination of stimuli, drugs, or drugs+stimulus/stimuli) to which wells are exposed on an assay plate. Every plate typically contains multiple sets of wells that constitute treatment well groups.
  • a treatment plate is a plate containing an array of treatment compounds in well groups. Each well group may contain one or more treatment compounds in each well (the treatment). Each treatment well in a group contains a specific dilution (or dose) of the group treatment. Typically assay plate wells get a specific amount of compound from the corresponding well on the treatment plate.
  • a well image is one of several possible images of a single well and is the smallest unit of analysis in the system.
  • Well images relate to specific cell markers and are at specific sites in the well.
  • cells of a specified type are introduced into each of the wells of the assay plate by a process sometimes referred to as plating.
  • plating a process sometimes referred to as plating.
  • a certain amount of a reagent medium is added to each well to promote cell growth.
  • a certain amount of a treatment is added to each well, combining with the cells and media already present.
  • One or more reagents may comprise a treatment.
  • the cells After the treatment has acted upon the cells in the several wells of the assay plate for the time specified by the experimenter, the cells are typically washed, fixed, and stained. An experiment may contain groups of plates fixed at different times (time points). Images, typically photomicroscopic images, are taken for the cells in the several wells of the assay plate or plates. Finally, an experimenter analyzes these images to determine the effect of the treatment.
  • What is needed is a methodology which provides tools that allow a designer to design an experiment that combines cell lines, marker sets, time points, and treatment plates. These tools should permit the full specification of the experimental process through a process model that generates a process, or collection of tasks.
  • the system should provide the designer with the ability to specify the structure of the experimental process. The system should then specify the processes and tasks for each experiment, automating the process where possible.
  • the system should enable a user to plan for and maintain adequate experimental infrastructure for planned experiments.
  • this infrastructure includes, but is not limited to hardware, software, reagents, treatments, and maintenance processes.
  • the system should track the infrastructure of experiments by tracking the individual hardware systems, software systems, reagents, treatments, and maintenance processes required to conduct the experiment.
  • the system should provide reports as planning tools for users to help them to keep adequate supplies and systems on hand and in good repair.
  • Automated milestones for instance barcode scanning, task completion updates, and so forth, should be implemented to provide tracking capabilities that give designers, supervisors, and experimenters the ability to obtain experiment status and to intervene in the process where required, preferably through remote interfaces.
  • the system should provide a full range of tools for validating experimental results.
  • the system should validate experimental results by storing the results of the experiment and by enabling feedback from scientific analysis of the results.
  • Experimental result validation consists of internal consistency of the results and reproducibility of the results.
  • consistency metrics may include cell distribution, focus/exposure tests, contamination tests, and control measure consistency with respect to benchmarks.
  • reproducibility metrics include variance or standard deviation or coefficient of variation of consistency metrics.
  • the system should provide failure and defect tracking tools to track experimental defects and the failures they cause.
  • the system should assist in validating experimental processes by storing the processes and tasks undertaken as part of the experiment.
  • process and task objects provide a complete history of the experiment with all significant milestones recorded with their date and time together with their process models, reusable protocols for generating the process for each experiment.
  • the failure and defect tracking systems track defects and failures in the processes and tasks reported by the system and its users, both of which are sometimes referred to generically hereinafter as “actors”.
  • the system should be capable of creating reusable information, or feedback, about systems failures that is useful for improving the system. Users could thus use this system to improve the visibility of failures within the organization and to improve communication with respect to failures.
  • the system should be capable of creating reusable information about opportunities to improve the system. Users could thus also use this system to improve the visibility and communication of progress in realizing opportunities within the organization.
  • the system should provide for creating reusable information, or feedback about specific instances of the system that lets users make comments on operational systems. It should further enable management to plan improvement work based on prioritization of the comments.
  • the system should enable users, applications, and database servers to report and track system defects, and to provide management the ability to plan improvement work based on prioritization of defect fixing and to understand the current situation with respect to the life cycle of defects in the overall system. Managers can also use this information to improve the visibility of defects within the organization and to improve communication with respect to defects.
  • the system should present a flexible, fully automated system for applying image and data analysis algorithms to input images that optimizes image and analysis throughput.
  • the system should permit easy modification of the algorithm structure and easy control of runtime processing. Developers should be able to add new analytical transactions to the system quickly and easily, and operators should be able to control and prioritize analysis jobs using the running system.
  • the present invention meets these needs with an automated system for conducting, monitoring, and validating a cell-line-based biological experiment including a treatment compound or other external stimulus.
  • the automated system is referred to herein as “CytometrixTM.”
  • the system comprises two principal subsystems, and optionally three accessory subsystems.
  • the first principal subsystem is an automated laboratory experiment manager for designing the biological experiment, for constructing an assay plate used to conduct the biological experiment, and for managing one or more of the processes that constitute the biological experiment.
  • the second principal subsystem is an automated data analysis manager for analyzing images, for instance produced by the image production system, to detect image data including biological markers and objects, for analyzing the resulting image data to produce biological data, and for analyzing the biological data to produce biological phenotypes (sometimes represented as a quantitative phenotype) and treatment compound signatures (sometimes represented as stimulus response curves).
  • biological phenotypes sometimes represented as a quantitative phenotype
  • treatment compound signatures sometimes represented as stimulus response curves
  • a first accessory subsystem is an image production system for performing photomicroscopy of at least a portion of the assay plate responsive to directions from the laboratory experiment manager, thereby producing an image of the at least a portion of the assay plate.
  • the second accessory subsystem is a database system for storing data including at least one of the image, the image data, the biological data, the biological phenotypes and treatment compound signatures.
  • the third accessory subsystem is a report generator for providing secure access to the data stored in the database system, and, responsive to a user request, for generating a report compiled from the data.
  • the system also includes several auxiliary components including, but specifically not limited to, components for tracking defects within the system, and for tracking one or more of the processes of the system.
  • the present invention provides a flexible and easy-to-use system for the design of cell-line-based biological experiments on specific biological markers. It provides tools that allow a designer to design an experiment that combines cell lines, marker sets, and treatment plates into a collection of assay plates. These tools also permit the full specification of the experimental process through a process model that generates a process, or collection of tasks.
  • the system's process modeling features provide the designer the ability to specify the structure of the experimental process.
  • the system then generates processes and tasks for each experiment that automate the process where possible.
  • Automated milestones including but not limited to barcode scanning, and task completion updates, provide tracking capabilities that give users the ability to get experiment status and to intervene in the process where required, preferably through remote interfaces.
  • the system enables users to plan for and maintain adequate experimental infrastructure, including but not limited to hardware, software, reagents, treatments, and maintenance processes for planned experiments.
  • the system tracks the infrastructure of experiments by tracking the individual hardware systems, software systems, reagents, treatments, and maintenance processes. Reports provide planning tools for users that help them to keep adequate supplies and systems on hand and in good repair.
  • the system helps to validate experimental results by storing the results and by enabling feedback from scientific analysis of the results.
  • Experimental result validation includes checks for internal consistency of the results and reproducibility of the results.
  • Consistency metrics and reproducibility metrics provide means for designers and experimenters to identify result failures in images, wells, and plates. The failure and defect tracking systems track these defects and the failures they cause. The stored results thus form a part of the experimental protocol
  • the system helps to validate experimental processes by storing the processes and tasks undertaken as part of the experiment. These process and task objects provide a complete history of the experiment with all significant milestones recorded with their date and time together with their process models, reusable protocols for generating the process for each experiment.
  • the failure and defect tracking systems track defects and failures in the processes and tasks reported by the process actors. The stored process information thus forms a part of the experimental protocol.
  • the system includes an information system that lets users, applications, and database servers create and track system failures.
  • the invention also provides applications that enable management to plan improvement work based on prioritization of the failures and to understand the current situation with respect to the life cycle of failures in the overall system. Managers can also use this system to improve the visibility of failures within the organization and to improve communication with respect to failures.
  • the system enables users to create reusable information or feedback about systems' defects that is useful for improving the system. It builds an information system that lets users, applications, and database servers create and track system defects. The system further provides applications that enable management to plan improvement work based on prioritization of defect fixing and to understand the current situation with respect to the life cycle of defects in the overall system. Managers can also use this system to improve the visibility of defects within the organization and to improve communication with respect to defects.
  • the principles of the present invention implement a fully automated system for applying image and data analysis algorithms to input images.
  • the system first determines whether there are input images. If necessary, the system preprocesses the images into an appropriate format and location, then notifies a server group that image analysis can start. Each analysis transaction results in a results data set in a database. Transaction data dependencies result in input data from prior transactions read from the database as input to a new transaction.
  • the system optimizes image and analysis throughput.
  • Each server processes a transaction comprising a minimal set of operations in the overall analysis sequence, optimizing parallel processing where possible to improve performance throughput.
  • the system permits easy modification of the algorithm structure and easy control of runtime processing. Developers are able to add new analytical transactions to the system quickly and easily, and operators are able to control and prioritize analysis jobs using the running system.
  • Another aspect of the invention pertains to automated methods for analyzing a plurality of cellular images.
  • the methods may be characterized by the following sequence: (a) from a plurality of image analysis tasks, identifying a next image analysis task for execution; (b) selecting one of a plurality of feature extractor servers available to handle the next image analysis task; (c) identifying an algorithm for extracting features as part of the next image analysis task; and (d) executing the algorithm under the control of the selected feature extractor.
  • the image analysis task characterizes a cellular organelle, a material in the cell, or a combination thereof.
  • the image analysis task determines the shape of a cell, characterizes the nucleic acid of a cell, characterizes the Golgi of a cell, or a combination thereof.
  • the invention employs a supervisor entity that identifies the next image task and selects the feature extractor server to handle the next image analysis task.
  • the identified algorithm is then imported into the selected feature extractor for execution.
  • the method may involve inputting one or more selected cellular images required for the image analysis task. Preferably, these images are generated using a process model generated by an automated laboratory experiment manager for designing the biological experiment.
  • the method may further involve inputting parameters required to execute the algorithm from a database.
  • the feature extractor server may be returned to a queue of available feature extractor servers.
  • the method may further comprise: (a) receiving data representing a design of a biological experiment defining an assay plate and comprising one or more processes involving forming at least one image of at least a portion of at least one well of the assay plate; and (b) directing the biological experiment in accordance with the data to generate the at least one of the plurality of cellular images from at least a portion of at least one well of the assay plate.
  • FIG. 1A is a conceptual overview of a logical system architecture in accordance with one embodiment of the present invention.
  • FIG. 1B depicts a sample process model and associated model of the type that may be employed with the present invention.
  • FIG. 2 is a high level logical outline of an automated image analysis manager including a supervisor, a number of feature extractor servers, and an algorithm subsystem.
  • FIG. 3 is a process flow diagram illustrating the interaction between some of the entities depicted in FIG. 2 .
  • FIG. 4A presents a logical system architecture for an automated laboratory manager and image analysis system in accordance with an embodiment of this invention.
  • FIG. 4B depicts a specific physical architecture for implementing the automated manager depicted in FIG. 4A .
  • FIG. 5 is a context diagram illustrating various youth cases associated with an automated image analysis manger of this invention.
  • FIG. 6A presents a sample laboratory experiment process model.
  • FIG. 6B presents a process tree generated from the process model of FIG. 6A .
  • FIG. 7 depicts a supervisor subsystem in accordance with one embodiment of this invention.
  • FIG. 8A depicts the architecture of a feature extractor in accordance with one embodiment of this invention.
  • FIG. 8B presents a specific example process of running a task in the feature extractor system.
  • FIG. 9A presents a block diagram of the algorithm subsystem in accordance with one embodiment of the invention.
  • FIG. 9B presents a sequence diagram illustrating certain actions of the algorithm subsystem while it runs an algorithm.
  • FIG. 10A presents a block diagram of the architecture of an image loader subsystem in accordance with an embodiment of this invention.
  • FIG. 10B presents a sequence diagram illustrating activities of the image loader subsystem.
  • FIG. 11A presents a context diagram of exemplary use cases handled by an automated laboratory experiment manager in accordance with an embodiment of this invention.
  • FIG. 11B illustrates a possible analysis process model with a representation of a model originally identified in FIG. 6A .
  • FIG. 11C illustrates a process tree created from the process model depicted in FIG. 11B .
  • FIG. 12 presents a block diagram of an experimental protocol design architecture in accordance with an embodiment of this invention.
  • FIGS. 13A through 13H depict pages of an experiment wizard user interface that facilitate creation of a laboratory experiment in accordance with an embodiment of this invention.
  • FIG. 14A presents a context diagram illustrating various use cases associated with passaging to grow cells continuously in media.
  • FIGS. 14B and 14C show suitable spreadsheets showing two types of plating in accordance with this invention.
  • FIG. 15A depicts a block diagram associated with a treatment plate generator in accordance with an embodiment of this invention.
  • FIG. 15B shows a sample user interface page for a treatment plate generator.
  • FIG. 15C depicts a basic process flow through the treatment plate generator form in accordance with an embodiment of this invention.
  • FIG. 16A depicts a failure life cycle associated with a process tracking system of this invention.
  • FIG. 16B depicts an opportunity life cycle associated with a process tracking system of this invention.
  • FIG. 16C depicts a comment life cycle associated with a process tracking system of this invention.
  • FIG. 16B depicts various use cases associated with a process tracking system of this invention.
  • FIG. 16E depicts a defect life cycle associated with a defect tracking system of this invention.
  • FIG. 16F depicts various use cases associated with a failure tracking system of this invention.
  • FIG. 16G depicts various use cases associated with a defect report system of this invention.
  • the system, 1 comprises two main modules, an automated laboratory experiment manager, 50 , sometimes herein referred to as “LabRat” and an automated data analysis manager, 60 , sometimes herein referred to as “StatRat”. These major subsystems or modules interact with other systems, modules, and processes, generally discussed hereafter, to form the present invention.
  • the automated laboratory experiment manager generally interfaces with a cellular biology module 62 , a fluidics automation module 64 , an imaging process or program 66 , automated data analysis manager 60 , and Cytoanalyst 68 (a user interface subsystem that reports and displaying scientific results) to define, conduct, and oversee the experiment.
  • An experiment can be said to encompass a number of processes. Some of these processes are simple one-step procedures. Other processes are complex and may require many tasks or even many other processes to complete.
  • the present invention implements a novel methodology for modeling and conducting the several processes required to perform a biological experiment. This novel methodology includes the use of a process model, which is a reusable system. The process model is used to define a specific process for an experiment.
  • Process model 75 utilizes one or more task models 76 and may implement a composite process model 77 .
  • a task is generally a simple one-step procedure.
  • a composite process is generally a multistep or multi-level procedure.
  • An example of a composite process model 77 includes the highest level of abstraction the experiment 78 , and in this example, a fluidics composite process 79 and a simple task 80 .
  • the fluidics composite process 80 comprises a further composite process, fluid addition, composite 81 incorporating a plurality of tasks 80 .
  • Process model 75 and composite process model 77 are used to define a specific process, 90 .
  • Process 90 may be considered to be a specific instantiation of the abstract process defined in process model 75 .
  • Process model 75 defines process 90 , and process 90 may incorporate one or more composite processes for instance 91 and may further incorporate one or more tasks 92 .
  • Composite process 91 is defined by composite process model 77 .
  • the system taught herein relates to the conduct of cellular biological experiments, especially experiments conducted to determine the effects of one or more treatment compounds on cells, particularly cells within a given cell line.
  • the system taught by the present invention causes fluorescent microscope images (or images from other microscopy techniques such as phase contrast, confocal, epi-fluorescence and polarized light) to made of cells within assay plates, analyzes the images to detect biological markers and objects, then analyses the resulting image data to produce biological data. Higher-level statistical analyses then produce biological phenotypes and signatures for treatment compounds in the experiment from this biological data.
  • This process is automated by a series of feature extractor's managed by a single automated supervisor.
  • the supervisor maintains a list of all outstanding analysis tasks. When a task becomes ready for processing, the supervisor broadcasts a message requesting such processing through a message queue.
  • the feature extractors are individual servers that check the message queue for processing requests and undertake the tasks as they become available.
  • This architecture distributes the image and data analysis algorithms for an experiment over multiple servers, providing a highly scalable way to manage automated data analysis.
  • the servers retrieve and store data in the database (or local or distributed file system or archival data store), including images. According to one embodiment of the present invention, the servers retrieve and store this data by means of Enterprise Javabeans.
  • the extractor notifies the supervisor of task completion or failure, so the supervisor maintains the status for all tasks underway in an experiment.
  • the process monitor displays his data through a web browser for any user who wants to track progress on the data analysis.
  • One of the significant advantages of the present invention is the ability to distribute a number of tasks over an arbitrary number of computing devices.
  • the tasks are specifically associated with process monitoring and image analysis.
  • the logical entities primarily responsible for this functionality are a supervisor, multiple feature extractors, and an algorithm system.
  • a process monitor may also be available to query the supervisor for information about the process state.
  • a high level logical outline of the automated image analysis manager 201 includes a supervisor 203 , a number of feature extractor servers 205 , and an algorithm subsystem 207 .
  • Subsystem 207 interfaces with a source of specific algorithms 209 and a source of specific input data (pertinent to particular ones of the algorithms) 211 .
  • the supervisor 203 oversees allocation of analysis tasks among the various feature extractor servers 205 . As feature extractors become available, the supervisor assigns them to a specific task. Upon assignment of such task, the designated feature extractor server 205 imports the algorithm subsystem 209 and starts a thread that accesses an interface to algorithms 209 in order to run the appropriate algorithm. The thread also accesses the input data as necessary to run the algorithm.
  • the input data provided by 211 may be in various forms such as dynamic arrays or images.
  • FIG. 3 depicts a process 301 illustrating the interaction between some of the entities depicted in FIG. 2 .
  • process 301 begins at 303 with a supervisor identifying all ready tasks.
  • the supervisor selects a given task and puts it into a message queue at 305 .
  • one of the available feature extractors 205 takes responsibility for the task. See 307 .
  • That feature extractor starts the appropriate thread to identify the required algorithm for the task and any associated parameters needed to complete it. See 309 .
  • the feature extractor then gets the identified algorithm via subsystem 207 and the required parameters from block 211 via subsystem 207 . See 311 .
  • the input data and parameters will be obtained from a database of such information.
  • the task is executed. That is, the selected algorithm operates on the input data to generate one or more outputs. See 313 . The results of executing this task are then put in to appropriate locations in a database of interest. See 315 .
  • the task thread is terminated and the feature extractor server goes back into a queue of available feature extractors. See 317 .
  • the feature extractor server returns a task completed or task broken message to supervisor 203 .
  • the feature extractor server looks for or becomes available for the next task assigned to it by the supervisor. See 321 .
  • the automated system system of this invention may be implemented via an architecture and deployment technology as described in this section. It has a number of different major systems that interact to support the various processes that support the overall service and product available to users.
  • the automated system system architecture embodiment depicted in FIG. 4A has the following component subsystems.
  • Process Status Display ( 401 ): A user interface subsystem that displays process status for active processes, displays Feature Extractor status, and provides an interface for interacting with a subsystem known as the automated system Supervisor 403 .
  • a server subsystem (sometimes implemented as multiple subsystems) that coordinates processes in Feature Extractors 405 through message queues and manages the storage of images through a DBMS subsystem 407 (e.g., the Oracle8i interMediaImage subsystem) that facilitates storage and retrieval of images.
  • DBMS subsystem 407 e.g., the Oracle8i interMediaImage subsystem
  • Message Queue ( 409 ): A server subsystem or subsystems that provides messaging services to the Supervisor and Feature Extractor subsystems.
  • Feature Extractor Server subsystems that automate the extraction of features from images of assay plate wells.
  • Automated laboratory experiment manager ( 411 ): A user interface subsystem that provides a comprehensive array of forms and reports on different aspects of the CytometrixTM system, including data entry, process modeling, process tracking, failure and defect tracking, and other features of the experimental process.
  • CytoAnalyst ( 413 ): A user interface subsystem that provides a results reporting capability as a web-based system for displaying scientific results as HTML pages through web browsers, plus some interface technologies for providing data access to the results for further data analysis using third-party data analysis tools such as SPLUS or SAS.
  • Hardware Status Display ( 415 ): A user interface subsystem that displays the status of various hardware components of the automated system to enable monitoring of the system
  • Oracle8I ( 417 ): An object-relational database management system that provides data storage and retrieval capabilities as well as application server capabilities. Other relational DBMSs may be used.
  • Persistent Messaging Middleware ( 419 —also referred to as OAQ herein): Oracle Advanced Queuing, an Oracle8i subsystem that provides a persistent messaging middleware solution for Oracle8i clients. Other comparable non-Oracle middleware solutions may be employed.
  • InterMediaImage ( 409 ): An Oracle8i subsystem that provides storage and retrieval services for images.
  • the physical system architecture of the automated system infrastructure can take many different forms. In a specific embodiment that has now been implemented, the physical architecture has the form shown in FIG. 4B . It is based on the integration of several technologies:
  • the shadowed boxes are computers (nodes) and the complex boxes are components such as jar files, exe files, HTML pages, and so on.
  • CMTRXPRD Oracle8i Server ( 425 ): The Oracle8i instance that holds all the system's data and stored procedures; also the server for the EJBs relating to data access (“Entity Beans”). Note again that while a specific Oracle product is depicted here, numerous other suitable DBMS products (now available or developed in the future) can be used in its place.
  • Supervisor ( 426 ): The server devoted to running the Supervisor entity bean. It may expand to multiple servers if required. In this example, it runs a JServer application server on an Oracle8i instance.
  • Feature Extractor Servers ( 427 ): Any number of individual servers dedicated to running feature-extractor algorithms at the request of the Supervisor.
  • Web Server ( 429 ): The server dedicated to running Forms, Reports, Java Server Pages, and serving Java applets for user interfaces.
  • Browser Clients Any number of individual computers that run a web browser of some kind to display HTML or run Java applets.
  • the system's Oracle8i instance runs on a specific server.
  • This Oracle8i instance contains all the production data from automated system's operations. It runs a single instance 431 of Oracle8I that includes three optional subsystems: the JServer application server 433 , the Advanced Queuing option 435 , and the interMediaImage option 437 .
  • the Oracle8i instance 431 was structured as a high-availability Oracle8i system with full server optimization and hot backup.
  • the server runs continuously day-in and day-out to provide data services to all database clients.
  • the JServer application server on the CMTRXPRD instance runs one or more containers of entity beans, EJBs that support persistent data objects (Objects.jar 439 ). These beans provide data management interfaces for all the objects in the database.
  • a Java client of this application server requests a handle to a particular persistent object from the server through an RMI/IIOP connection.
  • the server instantiates it as required and passes the data back.
  • objects can be simple objects such as cell lines or task models, or complex objects representing extensive queries of the database.
  • the queries required to run an algorithm on a Feature Extractor and to save extracted results are entity beans on the server.
  • the Advanced Queuing option provides a messaging middleware solution.
  • Messaging middleware allows networked nodes to communicate with one another by passing messages with embedded objects.
  • the Oracle8i Advanced Queuing version adds persistence to this functionality, allowing the message queue to persist even across major server outages. It is simpler to implement but does not have all the features of a remote invocation system such as CORBA or EJB, however.
  • the interMediaImage option provides storage and retrieval services for biological images.
  • the image database will incorporate table partitioning, an Oracle8i feature that allows one to partition a table physically by the data in the table.
  • the partition is by date, adding one partition each week. After creating the new week's partition, one can take the prior week's partition offline and delete the file after archiving it.
  • the Supervisor 426 coordinates feature extractor activities and also provides data to a process status display 471 .
  • the Supervisor is an NT Service.
  • the Supervisor communicates with the Feature Extractors through the Oracle8i Advanced Queuing message queue. This enables the Feature Extractors to poll for tasks to perform, distributing tasks in a fair way across the Feature Extractor Servers 427 . As well, the Feature Extractor Servers 427 communicate their status through the message queue, sending notifications back to the Supervisor 426 when starting and finishing tasks or on demand (this is the job of an FE Listener 443 ).
  • the Supervisor accesses the Object.jar 439 entity beans through RMI/IIOP to access task and process data in the database.
  • the Feature Extractor Servers 443 are a group of servers, each of which performs identical functions in parallel. This allows the system to distribute image analysis functions over an arbitrary number of computers.
  • Each server has an FE Listener 443 that polls the message queue for messages when the server becomes available for work.
  • the Listener may be implemented as a Java application that is constantly running on the server. The Listener runs in a separate thread and continues polling after starting a task thread; this permits the Listener to (1) run multiple tasks on the single server and (2) to accept requests for status from the Supervisor and respond (for example, the Supervisor may request acknowledgement from the server to check whether it is alive).
  • the listener calls a Java object in an FE.jar file 447 to run an algorithm task.
  • the object assembles the input data by calling an EJB on the CMTRXPRD server 425 using RMI/IIOP. It then passes the data to a MatLab interface 449 (a C++ class accessed through the Java Native Interface (JNI)) and calls a MatLab script 451 running in a MatLab server executable 453 . Non-MatLab algorithms may also be employed and various embodiments have been implemented outside MatLab.
  • the script 451 returns result data to the bean, which then calls another EJB on the CMTRXPRD server 425 using RMI/IIOP to store the result data in the database.
  • the Web Server 429 is a machine dedicated to running the Internet Information Server and several other software components that support most of the user interface components of the automated system.
  • the server includes one or more of the following:
  • Internet Information Server ( 455 ): The standard web server that comes with, for example, Microsoft Windows NT.
  • Forms Server 61 ( 457 ): The Oracle Forms server for displaying forms applications (LabRat/StatRat data entry and query forms); this works through a set of HTML pages 459 that run the Forms applet with a particular Forms executable (FMX) file 461 , with HTML and executables both stored in web server virtual directories.
  • forms applications LabRat/StatRat data entry and query forms
  • FMX Forms executable
  • Reports Server 61 ( 463 ): The Oracle Reports server for displaying reports 465 in HTML or PDF format (failure, defect, and opportunity reports); the report executables are in another web server virtual directory.
  • Tomcat/Jakarta ( 467 ): The Apache implementation of Java Server Pages, the web HTML generation component that works with EJBs to create interactive HTML displays in a web browser. This is also used for presentation of analytical results in the CytoAnalyst 469 .
  • the automated data analysis manager (“StatRat”) is the system component that manages the automated data analysis process. In involves the Supervisor and Feature Extractor subsystems introduced above. This process analyzes images produced by the imaging process and then extracts features from the image analysis through statistical and other kinds of algorithms. Examples of such algorithms are described in U.S. patent application Ser. No. 09/888,063 (filed Jun. 22, 2001), U.S. patent application Ser. No. 09/729,754 (filed Dec. 4, 2000), U.S. patent application Ser. No. 09/789,595 (filed Feb. 20, 2001), U.S. patent application Ser. No. 09/792,012 (filed Feb. 20, 2001), and U.S. patent application Ser. No. 09/792,013 (filed Feb. 20, 2001). Each of these documents is incorporated herein by reference for all purposes.
  • component refers to a part of a cell having some interesting property that can be employed to derive biologically relevant information using image analysis algorithms of this invention.
  • cell components include biomolecules and cellular organelles. Specific examples of biomolecules that could serve as cell components for use with this invention include proteins, lipids, polysaccharides, proteins, etc.
  • the relevant component will refer to a group of structurally or functionally related biomolecules. Alternatively, the component may represent a portion of a biomolecule such as a polysaccharide group on a protein, or a particular sequence of a nucleic acid or protein. Collections of molecules such as micells can also serve as cellular components for use with this invention. And subcellular structures such as vesicles and organelles may also serve the purpose.
  • markers refers to materials that specifically bind to and label cell components. These markers or labeling agents should be detectable in an image of the relevant cells.
  • the image analysis algorithms of this invention often operate on images of markers or images highlighting the locations of markers.
  • a labeling agent emits a signal whose intensity is related to the concentration of the cell component to which the agent binds. Preferably, the signal intensity is directly proportional to the concentration of the underlying cell component.
  • the location of the signal source i.e., the position of the marker should be detectable in an image of the relevant cells.
  • the chosen marker binds indiscriminately with its corresponding cellular component, regardless of location within the cell.
  • the chosen marker may bind to specific subsets of the component of interest (e.g., it binds only to sequences of DNA or regions of a chromosome).
  • the marker should provide a strong contrast to other features in a given image.
  • the marker should be luminescent, radioactive, fluorescent, etc.
  • Various stains and compounds may serve this purpose. Examples of such compounds include fluorescently labeled antibodies to the cellular component of interest, fluorescent intercalators, and fluorescent lectins. The antibodies may be fluorescently labeled either directly or indirectly.
  • Stimuli refers to something that may influence the biological condition of a cell. Often the term will be synonymous with “agent” or “manipulation.” Stimuli may be materials, radiation (including all manner of electromagnetic and particle radiation), forces (including mechanical (e.g., gravitational), electrical, magnetic, and nuclear), fields, thermal energy, and the like. General examples of materials that may be used as stimuli include organic and inorganic chemical compounds, biological materials such as nucleic acids, carbohydrates, proteins and peptides, lipids, various infectious agents, mixtures of the foregoing, and the like. Other general examples of stimuli include non-ambient temperature, non-ambient pressure, acoustic energy, electromagnetic radiation of all frequencies, the lack of a particular material (e.g., the lack of oxygen as in ischemia), temporal factors, etc.
  • biological stimuli include exposure to hormones, growth factors, antibodies, or extracellular matrix components. Or exposure to biologics such as infective materials such as viruses that may be naturally occurring viruses or viruses engineered to express exogenous genes at various levels. Biological stimuli could also include delivery of antisense polynucleotides by means such as gene transfection. Stimuli also could include exposure of cells to conditions that promote cell fusion. Specific physical stimuli could include exposing cells to shear stress under different rates of fluid flow, exposure of cells to different temperatures, exposure of cells to vacuum or positive pressure, or exposure of cells to sonication. Another stimulus includes applying centrifugal force. Still other specific stimuli include changes in gravitational force, including sub-gravitation, application of a constant or pulsed electrical current.
  • Still other stimuli include photobleaching, which in some embodiments may include prior addition of a substance that would specifically mark areas to be photobleached by subsequent light exposure.
  • these types of stimuli may be varied as to time of exposure, or cells could be subjected to multiple stimuli in various combinations and orders of addition. Of course, the type of manipulation used depends upon the application.
  • phenotype generally refers to the total appearance of an organism or cell from an organism.
  • cellular phenotypes and their representations in processing systems are particularly interesting.
  • a given cell's phenotype is a function of its genetic constitution and environment. Often a particular phenotype can be correlated or associated with a particular biological condition or mechanism of action resulting from exposure to a stimulus. Generally, cells undergoing a change in biological conditions will undergo a corresponding change in phenotype.
  • cellular phenotypic data and characterizations may be exploited to deduce mechanisms of action and other aspects of cellular responses to various stimuli.
  • an image analysis algorithm produces “quantitative phenotypes.” These are multivariate phenotypic representations of the cell(s). They include various features of the cell(s) obtained by image analysis. Such features often include basic parameters obtained from images (e.g., cell shape and size, nucleus area, Golgi texture, concentration distribution of particular biomolecules within the organelle, etc.) and/or biological characterizations derived from the basic parameters (e.g., cell cycle state, mitotic index, etc.). Other attributes include changes in a migration pattern, a growth rate, cord formation, an extracellular matrix deposition, and even cell count. The multiple cellular attributes or features of the quantitative phenotype can be collectively stored and/or indexed, numerically or otherwise. The attributes are typically quantified in the context of specific cellular components or markers.
  • the quantitative phenotypes are represented by stimulus response curves that show a change in the quantitative phenotype in response to stimulus.
  • One or more algorithms used with this invention provide this function.
  • the quantitative phenotypes may themselves serve as individual points on response curves.
  • a phenotypic response to stimulus may be characterized by exposing various cell lines to a stimulus of interest at various levels (e.g., doses of radiation or concentrations of a compound). In each level within this range, the phenotypic descriptors of interest are measured to generate quantitative phenotypes associated with levels of stimulus.
  • Such curves may be compared (by algorithms used with this invention) to allow classification of stimuli and identify subtle differences in related stimuli. To facilitate the comparison, it may be desirable to present the response curves in a principal component space.
  • the automated data analysis manager is arranged to provide a stable, automated analysis process that provides timely, accurate analytical data on experiments for presentation and further data analysis. It enables the application of image and data summary analysis algorithms to input images, execute the analysis transactions and save all the results of those transactions to a database (e.g., an Oracle database).
  • a database e.g., an Oracle database.
  • Each server processes a transaction comprising a minimal set of operations in the overall analysis sequence, optimizing parallel processing where possible to improve performance throughput.
  • the automated data analysis manager first determines whether there are input images to the system. If necessary, it preprocesses the images into an appropriate format and location, then notifies a data analysis server group that image analysis can start. Each analysis transaction results in a “results data set” in the database. Transaction data dependencies can result in input data from prior transactions read from the database as input to a new transaction.
  • the StatRat system actors are both human and automated. They are illustrated in a use cases figure, FIG. 5 .
  • Automated Supervisor ( 501 ) is the software system that uses the automated data analysis manager (StatRat) to initiate and control analysis jobs.
  • Automated Feature Extractor ( 503 ) is the software system that accepts assigned jobs and executes a transaction.
  • An Automated Image Loader is the software system that monitors image analysis processes, moves files to a standard location, and updates the status of those processes when they are complete.
  • System Operator 507
  • Developer 509
  • Developer ( 509 ) is the person who develops and tests feature-extraction algorithms.
  • Experimental Database ( 511 ) is the production (or development production) database containing experimental data and extracted features.
  • Development Database ( 513 ) is the database containing the experimental test bed against which developers run integration and system tests.
  • the automated data analysis manager contains a range of use cases distributed among the various actors.
  • An analysis object is one of several kinds of process elements that a data analysis process may treat as the thing to process.
  • process elements that may be handled include the following: an experiment, an assay plate, a well group, a treatment, a treatment well, a well image, and a cell.
  • the Analyze Object use case begins with a request to a group of Automated Feature Extractors to begin processing the object. Any Extractor that is a member of the group may receive the message and process the request. If there are any process or data dependencies for a process, the process model that generated the process should include other processes that structurally represent those dependencies. Marking composite processes as sequential ensures that the dependent process does not proceed until the other processes are complete.
  • a Maintain Process Model use case 517 discussed below provides details on the analysis process object and how it works to describe a sequence of algorithms and dependencies between them.
  • a sequence of the Analyze Object use case for executing an algorithm is depicted in the interaction Table 1.
  • TABLE 1 Actor System Read an analyze message Extract the algorithm to a current Extractor task and analysis object group from the message from the message. queue. Gather data inputs and Query task inputs and parameters. parameter arguments as required by the algorithm. Run the algorithm, passing Run the algorithm. in inputs and parameters. Save the analysis results to Save the features and the Experimental Database. commit. Send a finished-task End the use case. message to the Supervisor to report that the analysis task is complete.
  • Extension 1 If the algorithm task fails to execute and raises an exception, log the error message to the Experimental Database, identifying the Extractor and the algorithm program that failed. Notify the Supervisor with a cannot-process-request message for the task, including the Extractor and program names with the error message. The Supervisor will set the task status to Broken.
  • Image Analysis performs all the tasks relating to production of MatLab MAT files from images (image input, MAT file output, no database output) for a given plate. The algorithm looks in the database for images to analyze and reads the images from their standard location on disk.
  • Extension 4 Summary Analysis performs statistical analysis on DNA and Golgi markers for a given plate, producing summary data in the database (MAT file input, database output to Features table) for that plate.
  • the algorithm looks for MAT files for input; there is no input from the database of any kind.
  • the algorithm produces features in the database, saving them to a single Features table.
  • a Convert Old Data to New System use case 519 converts data from the previous version(s) of the system database to the current version. This may involve some gaps in information, as the current schema sometimes expands the amount of information about many or all aspects of the system.
  • Automated Feature Extractor 503 is an image analysis system actor that runs an algorithm as part of an analysis process.
  • the Automated Supervisor sends messages through a message queue to Feature Extractor actors to perform analysis tasks (pieces of an analysis process).
  • the scalability of this system depends on having the ability to assign tasks to available Feature Extractors.
  • Feature Extractors should be able to maintain individual servers without disrupting overall system processing. Also, they should be able to allocate certain servers by date and time or to allocate servers to special projects. All of these requirements are satisfied by the concept of Feature Extractor groups, collections of Feature Extractor servers that share status. An Extractor may belong to more than one group at any given time.
  • the Supervisor then gets requests including the group identifier to assign analysis processes to a specific group of Extractors.
  • Feature Extractors In a Group Feature Extractors use case 521 , the System Operator creates, modifies, or removes a group of Feature Extractors in the Experimental Database through the Automated Supervisor.
  • the use case also is the place where one can add, modify, or remove Feature Extractor objects in the Experimental Database 511 .
  • Suitable processes of the Group Feature Extractors use case are depicted in Table 2 below.
  • TABLE 2 Actor System Add a new group of Feature Insert any new servers (name, Extractors, supplying a list description) into the of existing and/or new Experimental Database. Update servers as well as a group any modified server names or name and description. descriptions in the database. Insert the new Feature Extractor Group name and description into the database. Add the new servers to the new group. Remove the existing servers from their current group (if any) and add them to the new group. Commit the changes. Modify a group by Modify the name or description modifying the name or of the group in the Experimental description or by adding or Database. Insert any new servers removing servers. (name and description) into the database, then add them to the modified group.
  • the group time slots and current feature extractor display the start and end time group. (and other data depending on the kind of time slot). Remove a time slot from the Remove the time slot from the current set of slots for the group. Commit the changes. current feature extractor group.
  • An algorithm is an independent system that accepts inputs, processes the inputs, and produces results.
  • the StatRat the automated data analysis manager system
  • the StatRat is able to provide a platform for executing algorithms and storing their results in a database. Another part of this mission is to enable developers to maintain their algorithms within the automated data analysis manager.
  • the system can employ versioning to add the version to a list of supported algorithms rather than actually replacing an algorithm.
  • Parameter lists typically belong to the version, not to the algorithm.
  • Maintaining an algorithm may have various aspects such as the following: adding a new algorithm to the automated data analysis manager; removing an existing algorithm version from the automated data analysis manager; versioning an algorithm; changing an algorithm's name, purpose, or parameter set.
  • the parameter list typically includes input parameters. Input parameters are those that the driver for the algorithm collects together and passes to the algorithm. Output parameters are those that the algorithm returns; see the Analyze Object use case for result storage.
  • an Image Loader monitors the status of imaging tasks within an experiment to find any that require file movement services or that require status updating. Ultimately, the Image Loader marks an imaging task Complete, which informs the Supervisor 501 that analysis tasks can now begin.
  • An imaging task is a task generated from a specific Task Model object in the automated system database (a pre-allocated process model ID).
  • the Image Loader uses this ID to find imaging tasks.
  • Some processes of the use case are depicted in Table 3.
  • the Automated Supervisor 501 can monitor the Feature Extractors to enable status reporting to the System Operator 507 and to facilitate control of analysis processes.
  • a Monitor Feature Extractor use case 525 enables the Query Process Status use case 527 , which displays status information to the System Operator 507 .
  • the Supervisor requests status from the Extractor.
  • the Supervisor After a designated time passes with no messages at all from an Extractor in the active extractor groups, the Supervisor requests an acknowledgment.
  • This Supervisor and Extractor can be designed so that changing the status of the Feature Extractor does nothing whatever to change the control flow of the system. It is purely for the status display through the Process Monitor. For example, if one sees a dead Extractor and go and reboot it, the Extractor will eventually pick up the message requesting acknowledgment and respond, changing the status back to ready.
  • the Automated Supervisor 501 queries all active processes from the database and determines which Algorithm Tasks are ready to run. The Automated Supervisor then sends messages to Automated Feature Extractors run the task, sending the task ID as the body of the message.
  • the Automated Supervisor 501 receives a message from an Automated Feature Extractor through the message queue notifying the Supervisor of the starting or completion of an assigned task by an Extractor.
  • the Automated Supervisor then updates the process status in the status list and the database and (for a finished-task message) and updates the status of any processes waiting on the completion of the first process.
  • Monitor Feature Extractor use case 531 which handles special acknowledgment notification in addition to standard starting-task and finished-task messages.
  • the System Operator 507 may need to know the status of the analysis processes for all active processes as well as the current status of all Automated Feature Extractors and the Automated Supervisor 501 .
  • the Query Process Status use case 527 presents this information to the System Operator 507 through the Process Monitor in this example.
  • Actor System Query active processes Display a list of active from the database. processes, listing all active tasks and their Feature Extractors and a list of all queued tasks waiting for a free Extractor. Display a list of Feature Extractors with status (ready, busy, dead). Display a list of process requests waiting for processing (not yet sent to the message queue as tasks). Update the status of a Update the task status. Waiting task to Ready, subject to process status requirements. Update the status of a Update the task status. Broken task to Ready, subject to process status requirements. Update the status of a Update the task status. Started task to Broken.
  • a Query Results Ad Hoc use case 533 lets the Operator get information from the Experimental Database based on queries in a standard query language.
  • the database should be available from the standard analytical tools used to post-process the results so that the Operator can perform exploratory data analysis on the data.
  • This need may be satisfied through a combination of the SQLPLUS query tool from Oracle (or comparable tool) and the ODBC interface for getting data into standard tools.
  • a unit test (use case 535 ) tests a program unit (module, class, function, or whatever) in isolation.
  • the objective of a unit test is to make the unit fail until achieving some coverage criterion such as branch coverage (all paths through the test model executed at least once) without failure.
  • Test models are usually white-box models that model the actual code structure, such as control-flow diagrams or data-flow diagrams, and coverage usually means testing all paths through such diagrams.
  • the automated data analysis manager has as part of its mission assisting developers in testing their algorithms.
  • the system therefore provides use cases for the common types of test and features that enable such testing.
  • the automated data analysis manager provides a way to run an algorithm in isolation from both the database and the rest of the system, preferably in the developer's environment away from the running production or development system running as a whole.
  • the automated data analysis manager runs the test suite (a collection of test cases) and puts the results into the Development Database.
  • test framework architectures that can be used to provide the test system. Ideally, developers would be able to build their own test suites and result saving code. Other possibilities exist, however, including automatic test suite generation and custom test script development services by a dedicated test group.
  • An integration test tests a subsystem working as an integrated whole.
  • the objective of an integration test is to make the system fail by combining the subsystem elements, focusing on relationships between elements (including use of the database), until achieving some coverage criterion such as branch coverage. Missing parameters, invalid data passed to another function, and violated database constraints are all examples of such errors.
  • Test models are usually black-box models that model the function of the subsystem, such as a state-transition diagram, but also calling-tree graphs showing what elements use what other elements and what assumptions are made for each relationship.
  • the automated data analysis manager provides a way to run an algorithm or an analysis process as a complete process isolated from other subsystems. That is, you should be able to execute an algorithm test suite with full input and output processing from the database and assuming appropriate data exists as it would in the real system.
  • the Run Integration Test use case thus executes test suites comprising a set of transactional use cases such as Analyze Well or Analyze Experiment with the designated algorithm or package as the result.
  • the use case encapsulates any results that move outside the subsystem under test, however, such as messages queued to start other processes and so on.
  • a system test (use case 539 ) is the combination of an integration test for the automated data analysis manager as a whole plus a series of test suites designed to test system capabilities.
  • the objective of the system test is to make the system fail by exposing it to situations likely to make it fail (crashing a server, running a large number of analyses at once, and so on).
  • Test models for system testing are typically black-box tests of functionality at the level of use cases in this document. The system test may verify that all use cases in this document can execute without failure, covering the requirements for the system.
  • the automated data analysis manager should be able to run in a controlled environment that allows testers to structure the test suites designed to make the system fail. Usually this entails a complete environment mirroring production but with a specially constructed database and sequence of user operations, often run as automated system test scripts.
  • the Experiment Database 511 scans for images that are ready to process and automatically initiates processing on ready images.
  • the System Operator 507 may want to restart an interrupted analysis, reprioritize analyses, or do a special analysis on an object (experiment, plate, well group, well, or well image).
  • the Operator schedules the analysis by queuing it in the analysis task queue manually to start as soon as possible or at a given date and time.
  • the Operator specifies the analysis object, an analysis process model, and an optional Feature Extractor group. If the Operator does not specify an Extractor group, the system uses the default Extractor group.
  • the Operator may query the scheduled analysis tasks in the queue and prioritize or remove them.
  • Processes of the Schedule and Prioritize Analysis use case 541 are depicted in Table 7.
  • TABLE 7 Actor System Set up an analysis process Send a message to the execution by entering the Automated Supervisor to analysis object start an analysis process. (experiment, plate, well The message includes the group, or well).
  • analysis object, the process Optionally, specify any of model, the arguments the analysis process (default to default model, process parameter arguments), the group arguments, Feature (default to default group), Extractor group, priority, the priority (default to or the date and time to group priority), and the queue the process for target execution date and execution. time. Refresh the current Request the Supervisor to display of scheduled send and display a list of analysis processes.
  • the Process Generator subsystem is preferably a standalone subsystem that generates processes from process models.
  • a Model Experimental Process use case builds process model graphs.
  • a Maintain Experiment use case creates an experiment process from an experiment process model.
  • a Generate Processes use case generates composite processes and tasks under the experiment process model.
  • An experimental process model is a tree hierarchy of composite processes and tasks that represent the elements of the experimental process that we want to track in terms of start and end dates.
  • the Composite pattern organizes trees in terms of abstract base classes, composite collection node classes, and leaf classes. Composite classes group composites and leaves, resulting in a recursive tree structure. (See for example, Gamma et al., Design Patterns , Addison-Wesley, 1995, and R. Muller, Database Design for Smarties , Morgan Kaufmann Publishers, 1999 (both incorporated herein by reference) for details of this pattern.)
  • the Composite Process Model orders its children Process Model objects. This ordering permits the ordered, sequential execution of algorithm tasks and represents the process (and data) dependencies of the analysis process. Each composite has a control flag that specifies sequential or parallel execution. Sequential execution tells the system to run the children in order. Parallel execution tells the system to run the children in parallel.
  • Sequential execution tells the system to run the children in order.
  • Parallel execution tells the system to run the children in parallel.
  • the process model also specifies an iteration structure based on the relationship of the objects that are the target of the process.
  • Experiments are collections of plates (or other experiments, composite experiments). Plates are collections of wells. Wells are imaged to produce some number of images per well, and there may be some number of cells in each well or image.
  • This hierarchy lets the process model automatically generate tasks for the appropriate objects. For example, if you process an experiment, and one subprocess is at the plate level, the model generates one subprocess for each plate that belongs to the experiment.
  • FIG. 6A illustrates the processing logic associated with a sample laboratory experiment process model.
  • a tree 601 possesses 3 composite process models ( 603 , 605 , and 607 ) and 7 task models ( 609 , 611 , 613 , 615 , 617 , 619 , and 621 , excluding the Alpha Analysis Model structure).
  • a typical Process experiment model 623 runs four subprocesses.
  • Initializing the experiment 603 by creating the cell lines 611 for the experiment (a task model here, per experiment) and, in parallel, by creating the daughter treatment plates 609 for the experiment (a task model here, per experiment).
  • the standard automation process 605 for all plates in the experiment a composite process model for the experiment with four task models underneath it that run sequentially, one for each plate in an experiment.
  • the standard imaging process 621 (per well) for all plates in the experiment is a task model here.
  • the Alpha Analysis Model 607 is provided as one for each experiment.
  • a tree 631 in FIG. 6B represents the process tree generated from the above model:
  • the composite process models generate composite processes, and the task models generate tasks.
  • the Experiment Composite Model generates an Experiment Process.
  • the Add Chemical Task Model 617 ′ generates an Add Chemical Task.
  • the model Where a model is at a different level from the process element, the model generates multiple processes or tasks at the appropriate object level. For example, the process element is an experiment, but the Standard Imaging task model 621 ′ is at the well level, so the model generates one imaging task per well in the experiment. Similarly, as the Method 0 task model 613 ′ is at the plate level, the model generates one Method 0 per plate.
  • the Initialize Experiment process model 603 ′ is marked as parallel. Therefore, both of the children tasks become ready to run. Since the Standard Process model 623 ′ is sequential, however, the children of the Standard Automation process 605 ′ are waiting, not ready. The experiment initialization should complete before any standard automation can begin.
  • One implication of this model is that all the plates need to go through Method 0 before any of them can start Method 1.
  • a model When a model has a level lower than the one above it, it means the Process Generator must create multiple processes for the single model node. No child model of that model may have a level higher than the one for that model. That is, as one goes down the tree, if one moves to finer levels of granularity, one has to stay at that level of granularity. Also, if a model generates multiple processes, its children generate at least one process linked to each of those processes. This situation reflects a desire to limit sequential processing to the process element rather than to the entire process step. For example, if Standard Automation in the above example were at the plate level instead of the experiment level, there would be one Standard Automation composite process for each plate and one each of the four subprocesses for each plate.
  • process generation works on an as-required basis (just-in-time process generation).
  • Process generation generates only those processes next in order in processing sequence.
  • Process generation takes into account the model element level and the process element type for the process (an experiment, usually) by generating the correct number of processes for the process element (all the wells on all the plates in the experiment, for example). It also generates all processes under a composite process marked as parallel.
  • Sequential composite processes generate their children one at a time in sequence as the processes end. As each Process is generated the attribute childSequence is set as obtained from the parent Process as an incremented index.
  • the Process Generator architecture rests on top of an array of persistent schema subsystems.
  • the Process Generator itself is preferably a stored program unit (a package) residing in the database.
  • the Oracle8i job queue runs the process generator periodically (e.g., once every fifteen minutes) to ensure the rapid generation of processes from models and experiment designs.
  • a process monitor subsystem provides a graphic user interface (GUI) to display status of the algorithm analysis processes, and to enable the users to modify the process's status as well.
  • GUI graphic user interface
  • the look of the GUI is designed similar to that of the Window Explorer.
  • the hierarchy relationship of process data is displayed in a tree control at the left side, and the detailed information for the process data are shown in a tabular format at the right side.
  • the process monitor may be a standalone Java application. It supports multi-user environment. The user is able to send a command to fetch and view all the related processes data, and to send another command to commit the modifications he/she has made for the processes data. Data concurrency and consistency are handled at application level.
  • the process monitor runs in a standard web browser, and the applet may interact with servlets running on the web server to access database for status display or modification.
  • the Process Monitor subsystem contains all the code required to view and modify the analysis process data.
  • the Supervisor subsystem is an automatic process execution control system for the experiment process.
  • the Supervisor sends task requests to different task executors implemented for the experiment process.
  • the execution path begins with a predetermined top-level composite process, runs each of its child processes or tasks either in ordered sequential or in parallel depending on the rules specified for the parent process.
  • the supervisor is able to support two kinds of task executions.
  • the first is an algorithm task proxy executor that runs algorithm tasks through the message queue subsystem.
  • the second is an image loader that loads well image files generated by the imaging station to the database. The first is implanted inside the supervisor as an internal package, and the second is imported as an external package.
  • algorithm task proxy executor For the algorithm task proxy executor, its main functionality is sending algorithm task requests to feature extractor servers through the message queue and taking care of message notifications from feature extractor servers. Depending on the returned status and execution history for a particular algorithm task, the supervisor can either change the status of the algorithm task and update its corresponding entries in database, or it can re-send the algorithm task under certain circumstances. There may also be a housekeeping routine running in the algorithm task proxy executor that periodically checks the status of started algorithm tasks to ensure that all the tasks are still running on their associated feature extractor servers, or it may re-send the task if the feature extractor which originally started the task is not responsive.
  • the supervisor simply invokes the image loader to carry out an image-loading task as it encounters an imaging task along its process execution path.
  • the Supervisor subsystem contains all the code to run the algorithm analysis tasks on a group of feature extractor servers and to initiate image-loading tasks.
  • a Supervisor subsystem 701 comprises three parts. They are a ProcessTree package 703 , an AlgorithmTaskProxyExecutor package 705 , and a ProcessExecutor package 707 .
  • the ProcessTree package 703 contains classes that deal with getting process data from database, storing process data in memory, creating process nodes, linking process nodes to the process tree, running processes or tasks, and updating process status to the database. It interacts with the AlgorithmTaskProxyExecutor 705 to run the algorithm tasks and invokes an ImageLoader subsystem 709 to run the image-loading tasks.
  • the ProcessTree package uses persistent objects from the Configuration subsystem (composite processes, tasks, and experiment processes) and their corresponding process models.
  • the AlgorithmTaskProxyExecutor package 705 contains classes that deal with dispatching analysis tasks to feature extractor servers, listening for responses from feature extractor servers, and tracking the started tasks. To this end, it employs a MessageQueue 711 .
  • the ProcessExecutor package 707 contains classes that deal with building a top-level process tree for a particular Supervisor, instantiating task-related objects, running the process tree, and starting the Supervisor as a NT service, for example.
  • a Feature Extractor is a server that provides task execution services to the automated system.
  • the system has any number of FeatureExtractor servers running on various servers around an enterprise.
  • the servers may be dedicated servers and/or individual workstations running extractors in off hours.
  • the Feature Extractor uses four message queues, all implemented with Oracle Advanced Queuing:
  • the Feature Extractor has two components, a small NT service (FeatureExtractor Service) and a Java application (FeatureExtractor Server).
  • the NT service is a C++ program that simply starts up the Java application, which then runs by itself until shut down by an operator.
  • the Feature Extractor Server has multiple threads, the main thread and a series of child threads.
  • the main thread polls two message queues, one for incoming tasks and one for incoming pings (requests for status). These queues deliver a payload that contains the algorithm task id to run or query.
  • the Server On receiving a task request through the Task Request message queue, the Server creates and starts a thread that uses the Algorithm subsystem to run an algorithm as structured by the database. When the thread completes, the Server sends a status message to the Supervisor through the Task Response message queue giving the status of the algorithm.
  • the Server On receiving a ping through the Ping Request message queue, the Server figures out the current status of the algorithm that's running and responds with that status through the Ping Response message queue. Pings are handled entirely in the main thread, so the running algorithm never interferes with responding to a ping other than by consuming the CPU completely.
  • FIG. 8A One architecture of a FeatureExtractor 800 is depicted in FIG. 8A . This architecture brings together all the elements required to run algorithms in an independent server, including message queue operations and algorithm processing.
  • a FeatureExtractor Service package 801 contains a small C++ program that runs as a Windows NT service. This service enables the Feature Extractor to start up automatically in a standard Windows manner.
  • the service instantiates a FeatureExtractor Java application 803 .
  • the single parameter for the service is the name of the feature extractor, which it passes to the Java application on the command line. This name corresponds to a FeatureExtractor object in a FeatureExtractor schema 805 in the Oracle database.
  • the FeatureExtractor schema 805 in the database contains information about the Feature Extractor (name, date created, and so on). The names should be consistent with the FeatureExtractor Service name settings mentioned in the prior paragraph. The Process Monitor uses this information in its display of FeatureExtractor status.
  • a CoreAQOperation package 807 defines a set of base classes and an interface that comprise a reusable basis for specific messaging frameworks.
  • a MessageQOperation package 809 is such a framework, providing factories and queues based on the Core package superclasses.
  • a PayloadDataType package 811 provides a set of data types that one can use to send information through the StatRat queues.
  • An Algorithm package 813 provides a complete system for running an algorithm task. The Algorithm Subsystem is described in more detail below.
  • FIG. 8B illustrates a very specific example process of running a task, an interaction in the FeatureExtractor system.
  • This scenario assumes that the Server has already created the four message queues.
  • the Feature Extractor Server first polls the Task Request Queue (queue in the queue array) by calling deQueue to get any requests to perform a task. While there is no algorithm work going on, this loop continues indefinitely until there is work to do.
  • the Feature Extractor Server gets a TaskReqPayload object (downcast from Object).
  • the Server extracts the integer system id of the requested algorithm task from the payload with getID( ).
  • the Server then creates the task thread using the ID and starts the thread.
  • the task creates the AlgorithmFactory object and runs the algorithm with the runAlgorithm method, passing in the systemID.
  • the Server polls the thread in a loop asking whether the task is alive.
  • the AlgorithmFactory object returns and the thread stops.
  • the looping call to is Active will return false and the Server can proceed.
  • the loop sleeps for 500 milliseconds between each iteration to conserve CPU resources.
  • the server gets the status of the algorithm, a TaskStatus enumeration variable set by the algorithm in the task thread object (value will be Complete or Broken). At this point, the thread object is freed for garbage collection, which in turn frees the AlgorithmFactory object for garbage collection.
  • the Server then enqueues a message in the Task Response message queue (TaskResponseQ), telling the Supervisor what algorithm task has which status (systemID and status).
  • the Feature Extractor Server resumes the iteration on the Task Request message queue looking for additional tasks to perform.
  • the Algorithm subsystem enables the automated data analysis manager to run algorithms developed as MatLab scripts, C++ class function members, Java methods, etc. Often, these scripts or functions contain only algorithm code. All database and image inputs come through parameters to the script.
  • the Algorithm subsystem contains Algorithm subclasses for each MatLab algorithm, InputData classes for each set of tabular inputs, ImageData classes for each image file input, and ResultData classes for each set of tabular outputs. Different algorithms may share inputs and/or results. Inputs and results are implemented Enterprise Javabeans, for example, residing on the Oracle database server, as both interact heavily with the database.
  • the Algorithm subsystem uses a C++ version of the CDynArray MatLab data structure to use for tabular inputs and results.
  • the Feature Extractor first activates an Enterprise Javabean based on a Supervisor message it receives. It then uses an Algorithm factory object to instantiate and run the algorithm.
  • the Algorithm interfaces with the MatLab engine interface to run the script, passing in the parameters and getting back the results. After completing the algorithm, the FeatureExtractor frees the AlgorithmFactory object, which in turn frees all the other objects.
  • the Algorithm subsystem contains all the code related to instantiating and running an algorithm on a Feature Extractor server.
  • FIG. 9A presents a block diagram of the subsystem's architecture in accordance with one embodiment of the invention.
  • the Feature Extractor subsystem 903 imports the Algorithm subsystem 905 and starts a thread that accesses the AlgorithmFactory singleton object interface to run an algorithm.
  • the factory queries and activates an AlgorithmTask entity bean in an Analysis schema 907 that supplies details for the algorithm execution.
  • the factory then creates the Algorithm object of the appropriate subclass and runs it, passing in the ProcessElement obtained through a ProcessElement subsystem 906 .
  • the Algorithm object either uses a C++ MatLab interface 909 to run a MatLab script, creating InputData 911 and ResultData 913 session beans to hold inputs and outputs, or it runs C++ or Java algorithms directly by querying and storing data.
  • the MatLab script or C++/Java algorithm returns a return code and results. If the return code is not 0, the Algorithm object logs a failure in the database through a Failure subsystem 908 ; otherwise, it stores the results. The Algorithm and its AlgorithmFactory return the ultimate status to the caller. The Algorithm object ensures that the process only stores results once through the Process subsystem 910 .
  • the main action in the Algorithm subsystem is the running of the algorithm.
  • the sequence diagram of FIG. 9B shows how this works.
  • the Feature Extractor instantiates the factory.
  • the factory instantiates the algorithm task bean to get the process element (an interface for the various kinds of objects that a task may process) and the task arguments. Based on the algorithm name, the factory then instantiates the appropriate subclass of Algorithm, passing in the process element and the argument list.
  • the constructor for the Algorithm creates InputTable and InputImage session beans of the appropriate subclasses.
  • InputTable objects in turn create an MatLabDynamicArray object and construct their internal data through database queries.
  • the constructor then creates a ResultData session bean, which creates another MatLabDynamicArray object to hold the results.
  • the Algorithm calls MatLab to bind the various arguments, including the returns, into the MatLab engine using the argument names or values passed from the AlgorithmTask.
  • the factory then runs the algorithm by calling the run method on the Algorithm object.
  • This method starts the MatLab engine, binds in the input arguments, the input data array(s), the result data array, and the return code, all of which correspond to named elements in the command script (not shown explicitly for simplicity).
  • the Algorithm then runs the command script.
  • TIFF image (WellImage table) is passed by the InputData object's constructing a temporary TIFF image file available to the server and passing the resulting path and filename as a string argument to the command script.
  • the script processes the inputs and produces an error return and a single dynamic array.
  • the algorithm object checks the error and handles it as appropriate, raising an exception as required.
  • Exception handling uses the Application Failure Logger subsystem to log the error to the database. It also handles the recovery logic, permitting the algorithm to control retries or other recovery processes.
  • the Algorithm calls the store method on the ResultData array to pass the mxArray (internal MatLab array) to the ResultData entity bean for storage in the database.
  • the bean stores the data and returns, and the Algorithm run method returns to the factory runAlgorithm method. The factory then frees the Algorithm object for garbage collection and returns.
  • the automated system processes comprise many algorithm tasks for processing data. Different versions of an algorithm may behave differently. Usually the latest version is the one that works best in most circumstances and is the one deployed to run the process. However, members of a group may need to run different versions of the algorithms through the system at the same time. For example, one may need to use different versions of data analysis algorithms to analysis the ever-increasing data sets to further test the algorithms themselves, or one may want to run a specific version of algorithm because we need the functions of that version.
  • the feature extractor server is the algorithm task manager. It launches and/or stops algorithm tasks.
  • the feature extractor server and the high-level algorithm routines are, in the specific implementation, all Java modules, while the low-level algorithm routines can be implemented in either Java or C/C++.
  • algorithm modules implemented in C/C++ they may reside in Windows DLLs. Therefore, the basic question here is how to run different versions of algorithms in Java and indirectly from Windows DLLs in a dynamic way.
  • a Java virtual machine uses the default class loader (the system class loader) to load classes specified at the system class path. If two or more versions of Java classes with the same class name (package structure also the same) are specified at the class path, there is no way to tell the system class loader which one to load to run a specific version, the system class loader always loads the one it finds first on its class path. The same situation holds true for loading DLLs in Windows.
  • the usual way to load a DLL is to put the DLLs in the search path of the system. If we put multiple versions of a DLL with the same name at the search path, Windows only loads the one it finds first on the search path.
  • Java provides a standard way to load and run different versions of algorithms with the same class signature but at different file system or network locations.
  • To use the feature extractor server to load and run different versions of Java algorithms one needs to install a customized algorithm class loader for the feature extractor server. Therefore when the feature extractor server gets a request to run a specific version of an algorithm, it can be configured to figure out where the class files (or jar files) are located for the requested version, and then use the customized algorithm class loader to load and run the algorithm. In this way, the feature extractor server can run multiple versions of an algorithm either sequentially or in parallel in one JVM, using different instances of algorithm class loaders to load the classes.
  • the customized class loader can also be instructed to load the version dependent DLL at a specific location.
  • This DLL may be called the entry DLL for the Java algorithm. If this entry DLL depends on other version-dependent DLLs, and the dependencies can be chained to arbitrary depth, then one needs a mechanism to have those version-dependent DLLs finds and loads their dependent ones. There are a couple of ways to do that.
  • Dynamically loading DLLs is a preferred approach.
  • the usual way to dynamically load a DLL starts with calling LoadLibrary with the DLL name as the parameter.
  • LoadLibrary to specify the absolute path of the DLL's module, in this way we can load the DLL of the desired version with the same name but at different network location.
  • Java classes and DLLs are registered with the CLASSPATH and PATH environment variables respectively.
  • the feature extractor server reads the configuration file when it starts. As it gets an algorithm task request for a specific version, it changes its working directory to the directory that corresponds to the required version. It then uses the algorithm class loader to load classes for that version, and it can also link and load the right version of DLLs down the chain.
  • the loading mechanism always tries to load Java classes or DLLs from the system standard path first. If the required module is not found, it then tries to load it from the version-tagged path.
  • An image loader subsystem may be used as one of the task executors of the experiment process. It integrates the functionality of the imaging system into the experiment process. Specifically, it carries out the task of registering the well image files with the database so that these images can be traced and processed later.
  • the image loader is an extension to the supervisor system.
  • the supervisor simply invokes the image loader to carry out an image-loading task as it encounters an imaging task in its execution path.
  • the image loader When the image loader gets an imaging-loading task from the supervisor, it queries the database to get the information about the task. It then uses this information to build a filter to work only with the image files satisfying certain qualifying criteria. The image loader picks up the files, transfers them to a permanent depository and registers them with the database.
  • the image loader subsystem contains all the code related to run image-loading tasks.
  • the Image Loader is a separate NT Service running on a separate machine, communicating with the Supervisor through a message queue.
  • an image loader subsystem 1001 interacts with four external packages. They are image files 1003 , the AssayPlate schema 1005 , Configuration packages 1007 , and the supervisor subsystem 1009 .
  • the image files 1003 generated by the imaging station have a fixed file name format that provides the necessary information for the image loader to work with the database.
  • the filename is based on the combination of assay plate barcode, well name, site number, channel number and a prefix. For example, 00023558_B04_S1_W2.TIF means this image is for well B04 of assay plate with barcode 00023558 on site 1 and channel 2.
  • the imaging station When the imaging station produces the files, it stores them in a specific image-dumping directory.
  • the Image Loader moves the files from that directory into a network depository and registers the files in the database WellImage table.
  • the AssayPlate and Configuration packages 1005 and 1007 provide the database objects with which the image loader queries and updates information related to imaging task and well images.
  • the sequence diagram of the image loader is very straightforward. After creating an image loader object for an imaging task, the run function of the object calls several methods in a loop until all the file registration is finished.
  • the automated laboratory experiment manager (LabRat) is the automated system component that manages the laboratory experimentation process. This process designs and constructs assay plates and shepherds them through the plating, washing, fixing and staining, imaging, and analysis process.
  • the focus of the automated laboratory experiment manager is the assay plate and the experimental process as well as other, related processes.
  • data analysis process has its own system, the automated data analysis manager. Important subsystems within the automated laboratory experiment manager are the failure and defect tracking processes.
  • the automated laboratory experiment manager (LabRat) aspect of the invention enables at least some of the following functions: the design of cell-line-based biological experiments on specific biological markers, the tracking and control of those experiments from plate creation through data analysis, the tracking and control of the inputs and infrastructure of the experimental process, and provision for product and process validation of experimental results. Further, the automated laboratory experiment manager may provide tools that allow a Designer to design an experiment that combines cell lines, marker sets, and ActivityBase treatment plates into a collection of assay plates. These tools also permit the full specification of the experimental process through a process model that generates a process (collection of tasks).
  • Process modeling features can provide the Designer with the ability to specify the structure of the experimental process.
  • the automated laboratory experiment manager then generates processes and tasks for each experiment that automate the process where possible.
  • Automated milestones barcode scanning, task completion updates, and so on
  • provide tracking capabilities that give Designers, supervisors, and Experimenters the ability to get experiment status and to intervene in the process where required, preferably through remote interfaces.
  • the automated laboratory experiment manager can track the infrastructure of experiments by tracking the individual hardware systems, software systems, reagents, treatments, and maintenance processes. Reports provide planning tools for Designers and Experimenters that help them to keep adequate supplies and systems on hand and in good repair.
  • the automated laboratory experiment manager helps to validate experimental results by storing the results and by enabling feedback from scientific analysis of the results.
  • Experimental result validation embodies internal consistency of the results and reproducibility of the results.
  • Consistency metrics cell distribution, focus/exposure tests, contamination tests, control measure consistency with respect to benchmarks
  • reproducibility metrics variable or standard deviation or coefficient of variation of consistency metrics
  • the automated laboratory experiment manager may help to validate experimental processes by storing the processes and tasks undertaken as part of the experiment. These process and task objects may provide a complete history of the experiment with all significant milestones recorded with their date and time together with their process models, reusable protocols for generating the process for each experiment.
  • the failure and defect tracking systems track defects and failures in the processes and tasks reported by the process actors (human and automated). The stored process information thus forms a part of the experimental protocol.
  • a Designer 1101 is an employee responsible for the design and supervision of an experiment.
  • An Experimenter 1103 is an employee responsible for the conduct of an experiment. Note that in many scenarios the Designer 1101 can do anything in the system that the Experimenter 1103 can do.
  • a Specialist 1105 is an employee responsible for any of a variety of infrastructure systems (hardware, software, reagents, treatment plates, tissue culture).
  • a Robot 1107 is a hardware device that actively participates in the experimental or maintenance process, updating status and failure information in an Experimental Database as required.
  • An Automated Process Generator 1109 is a server that automatically generates processes from process models.
  • An Experimental Database (not shown explicitly) is a database (e.g., an Oracle database) that contains the persistent experiment protocols, models, and other laboratory-related information. Since virtually every aspect of the system uses the Experimental Database, the context diagram does not explicitly show it or the connections from the use cases to it.
  • An ActivityBase 1111 a database that contains records of treatments for all departments of an organization.
  • FIG. 11A shows how the above actors communicate with the use cases that make up the automated laboratory experiment manager in accordance with one embodiment of this invention.
  • a Model Experiment Process use case 1113 builds process model graphs.
  • a Maintain Experiment use case 1115 creates an experiment process from an experiment process model.
  • a Generate Processes use case 1117 generates composite processes and tasks under the experiment process model.
  • process generation works on an as-required basis (just-in-time process generation). This use case generates those processes next in order in processing sequence.
  • Process generation takes into account the model element level and the process element for the process (an experiment, usually) by generating the correct number of processes for the process element (all the wells on all the plates in the experiment, for example). It also generates all processes under a composite process marked as parallel. Sequential composite processes generate their children one at a time in sequence as the processes end. Also, the process generator generates processes for parent composite processes with a start date greater than or equal to the current date, allowing the system to control process generation timing.
  • Suitable processes of the Generate Processes use case 1117 are depicted in Table 8 below.
  • TABLE 8 Actor System Query all experiment Retrieve the processes processes that do not have and any objects an end date, that have a start needed to determine date greater than or equal to what the next process the current date, and that is to generate. have the root experiment as a direct parent. Generate the next set of Insert the new processes for each processes and process experiment process. element links. End the use case. Commit the transaction.
  • a Maintain Assay Plate use case 1119 may be understood as follows.
  • the Experimenter creates, changes, and tracks assay plates through any number of processes.
  • the Experimenter queries a cell line and marker set, then generates an assay plate by, for example, supplying a new assay plate barcode and the cell line passage number.
  • a process applies a treatment to the plate.
  • the Experimenter may supply the barcode of the daughter treatment plate that supplied the treatment compounds for the plate, and the System generates the wells for the plate based on the master treatment plate format.
  • the System sets the well group type based on the type that the master format specifies.
  • the Experimenter can designate the assay plate as no longer available—for example, the plate may be too old for further use given the reagents and cells on the plate, or it may have been damaged during processing.
  • a Specialist may mark the plate processed, indicating it should no longer be available for tasks involving plate processing (non-repeatable tasks).
  • the Maintain Experiment use Case 1115 may be understood as follows.
  • the Experimenter creates an experiment by generating an experiment process from an experiment process model and associating a group of assay plates with it.
  • the Experimenter would have already created the assay plates in a scenario of the Maintain Assay Plate use case 1119 .
  • the Generate Processes use case 1117 will generate the tasks for the process on or after the start date the Experimenter specifies.
  • a well group is a collection of wells on one or more plate formats.
  • Well groups permit data analysis to distinguish certain wells on plates as a unified group.
  • Modeling well groups permits a Designer to create standard well groups in certain plate locations, such as control groups.
  • an Experimenter or Data Analyst can create an arbitrary group of wells for analysis purposes.
  • a Model Well Group use case 1121 permits the Designer to create a group and its wells, to change its structure, or to remove the group from active availability in the database.
  • Exemplary processes of the Maintain Experiment use case 1121 are depicted in Table 11 below.
  • TABLE 11 Actor System Create a well group Create the group in the giving it a name and Experimental Database. optional description and Set the creator and the reuse potential as well as creation date to the user supplying the optional creating the group model system characteristics and the current system (vision, mission, date, respectively. objectives, and so on).
  • Display the group model Specify an ordered list of its group type, and its list well-group wells (row and of wells. column) and a group type from a lookup table of types.
  • Query a well group Display the well group and its wells, displaying system information, name, description, reuse potential for the group and the row and column for each well.
  • a Model Plate Format use case 1123 may be understood as follows.
  • a plate format is a plate geometry and a collection of well groups laid out on a plate template.
  • a plate format is the template for any number of plates, each of which has exactly one plate format that, once assigned, does not change.
  • the Designer can create a reusable template that describes the basic layout of wells on a plate for use in generating assay plates. The Designer associates this plate format with a master treatment plate, and through that plate it determines the well structure of all the daughter treatment plates associated with the master plate and also of all the assay plates to which the daughter treatment plates are applied.
  • the Model Plate Format use case 1123 permits the Designer to create a plate format from the existing set of well groups (see the Model Well Group use case) and a plate type, to change its structure (if it is not already in use on existing plates), or to remove the group from active availability in the database.
  • Some processes of the Model Plate Format use case 1123 are depicted in Table 12 below.
  • TABLE 12 Actor System Create a plate format, giving it a Create the group in the name and optional description Experimental Database. Set and reuse potential as well as the creator and the creation supplying the optional system date to the user creating the characteristics (vision, mission, group model and the current objectives, and so on). Choose a system date, respectively. plate type from a lookup list of Display the group model, its plate types.
  • the Model Experimental Process use case 1113 may be understood as follows. As explained above in the discussion of the “Process Generator” subsystem, an experimental process model is a tree hierarchy of composite processes and tasks that represent the elements of the experimental process that one may want to track in terms of start and end dates. FIGS. 6A and 6B and the associated discussions set forth a typical experiment model.
  • FIG. 1B illustrates a possible analysis process model with a representation of the Alpha analysis process model 607 (originally identified in FIG. 6A ).
  • This is a reusable composite process with multiple parts.
  • the tree consists of a top-level composite process model 607 , two composite process models 1151 and 1153 at the second level, each containing a set of different kinds of process models including tasks, composite processes, and algorithm tasks.
  • the composite contains two parts, a DNA analysis 1151 and a non-DNA analysis 1153 .
  • the DNA Analysis 1151 contains a Control Threshold algorithm 1155 followed by an image cell count algorithm 1157 followed by a norm factor algorithm 1159 , followed by a well summary process 1161 containing three algorithms, and terminated by a G150 algorithm 1163 .
  • a sequential marking 1165 on the DNA Analysis composite process model 1151 indicates the five subprocesses run sequentially.
  • the plate marking (also 1165 ) indicates the DNA Analysis is done once for each plate in the experiment.
  • the well group marking 1167 indicates the algorithm runs once for each well group on each plate.
  • the second composite process, non-DNA Analysis 1153 has a parallel marking 1169 , which means its two subprocesses run in parallel.
  • FIG. 11C When the database creates a process tree (see FIG. 11C ) from this structure, it sets the status as appropriate.
  • the FIG. 11C depicted tree represents the process tree generated from the above model:
  • the process model generates multiple processes for each process model depending on the iteration structure.
  • a Monitor Hardware Systems use case 1125 can be understood as follows.
  • the automation features of the automated system involve the coordination and maintenance of various hardware systems such as robots and incubators. Each such system is tracked as part of the Configuration subsystem of the system database for failure and defect tracking purposes. As well, a specialist can monitor the current status of these systems.
  • the system can display database records of hardware status.
  • the system canl integrate real-time hardware monitoring features into the system, providing web-based updates and control of individual hardware deliverable systems.
  • Monitor Hardware Status use case 1125 Some processes of the Monitor Hardware Status use case 1125 are depicted in Table 14 below. TABLE 14 Actor System Query the system for current Display a list of all hardware hardware status. deliverable systems. Display any feedback available in the database about the system. Log a comment on a specific Save the comment with a time hardware system. stamp to the Experimental Database, linking the comment to the hardware system. End the use case. Commit the transaction.
  • a Query Process Status use case 1127 can be understood as follows. The Experimenter needs to know the status of the experimental processes for all active processes. The Query Process Status use case 1127 presents this information to the Experimenter, showing the process trees of active processes and allowing the Experimenter to drill down to the start and end times of individual processes, to see any comments about the processes, and to log comments about specific processes.
  • a Track Cell Line use case 1129 can be understood as follows.
  • a cell line is a specific kind of cell that a Designer can use in an experiment.
  • the automated system typically maintains a specific set of cell lines.
  • the Track Cell Line use case 1129 lets the Experimenter or Specialist create, modify, or remove cell lines from the set of available lines in the system. See the discussion of the Maintain Assay Plate use case 1119 for the association of cell lines to assay plates.
  • Some processes of the Track Cell Line use case 1129 are depicted in Table 16 below. TABLE 16 Actor System Create a cell line, specifying its Save the cell line to the name, description, reuse Experimental Database.
  • Query a set of cell lines on id Display the cell line name name, or description. and description and a list of all active assay plates for the cell line. Also display any cell line feedback. Change the cell line name, Save the changes to the description, reuse potential, or Experimental Database. system characteristics. Remove a cell line. Mark the cell line inactive in the Experimental Database. End the use case. Commit the transaction.
  • a Track Marker use case 1131 may be understood as follows.
  • a marker is a specific reagent or other indicator detectable in an image.
  • the marker may be an autofluorescent reagent used to mark specific proteins or other materials in the well and thereby show the location of such materials in an image obtained with a fluorescent microscope.
  • each marker fluoresces at a particular frequency of light and occupies a channel on the microscope.
  • the Specialist may create, change, or remove markers in the automated system. See the discussion of a Maintain Marker Set use case 1133 for the association of markers to assay plates.
  • Exemplary processes of the Track Marker use case 1129 are depicted in Table 17 below.
  • TABLE 17 Actor System Create a marker, Save the marker to the specifying its name, Experimental Database. description, reuse potential, and any optional system characteristics (mission, vision, operational objectives, and so on).
  • Query a set of markers Display the marker on id, name, or name and description. description. Change the marker name, Save the changes to the description, reuse Experimental Database. potential, or system characteristics. Remove a marker. Mark the marker inactive in the Experimental Database. End the use case. Commit the transaction.
  • the Maintain Marker Set use case 1133 may be understood as follows.
  • a marker set is a collection of different markers assigned to specific channels on a fluorescent microscope (or other instrument employed in the imaging process). A Engineer assigns the marker set to an assay plate to indicate which channels are active on the plate for imaging. See the discussion of the Maintain Assay Plate use case 1119 for the association of marker sets to assay plates.
  • Exemplary processes of the Maintain Marker Set use case 1133 are depicted in Table 18 below.
  • TABLE 18 Actor System Create a marker set, specifying Save the marker set to the its name, description, reuse Experimental Database. potential, and any optional system characteristics (mission, vision, operational objectives, and so on).
  • a Track Reagent use case 1135 may be understood as follows.
  • a reagent is a chemical other than a treatment agent that someone may use as part of the experiment process, such as media added to wells to hold cells or the fixing chemicals added during the fix and stain process.
  • the Track Reagent use case 1135 lets the system track reagent inventory to ensure that enough reagent volume is on hand to meet experimental demand.
  • the reagent inventory is a bit complicated by the need to represent various kinds of containment for the reagents.
  • the original packaging of the reagent contains a certain amount of reagent from a given lot, and the automated system stores it in a specific storage location.
  • Much of what the automated system uses as reagent is a working solution comprising several reagents mixed together.
  • Specialists or Experimenters may divide a reagent lot into a series of aliquots, which are by definition a complete division of the original amount into a series of smaller amounts.
  • the system database may track sets of aliquots that come from the same lot and have the same volume, rather than tracking individual aliquots.
  • reagent tracking does not attempt to manage the actual flows of reagents through the automated system. Rather, it tracks receipt of reagent lots, creation of working solutions, and aliquoting of the inventories. This permits the recording of experimental protocol information as required to tie experimental results to specific lots.
  • Another embodiment of the system implements a full-scale inventory system for reagents.
  • Exemplary processes of the Track Reagent use case 1135 are depicted in Table 19 below.
  • Actor System Create a reagent product with a Create the reagent product in vendor, product name, catalog the Experimental Database. number, and notes.
  • Query a set of reagent products Display the reagent products by vendor, product name, catalog with vendor, product name, number, or notes. catalog number, and notes.
  • Change a reagent product by Save the changes to the changing the product name, Experimental Database. catalog number, or notes.
  • reagent in each unit of reagent and the units of the amount, the total number of units received for this lot, and any notes on the lot Query a set of reagent lots from Display the reagent lots the database by any of the reagent queried. lot fields. Change the reagent lots to correct Save the changes to the errors by changing lot number, Experimental Database. inventory date, expiration date, amount, unit, units received, and notes. Create a working solution, Create the working solution in specifying the set of reagents or the Experimental Database. working solutions (product Specify the current user as the inventories) you are combining creator of the solution.
  • a Track Treatment use case 1137 may be understood as follows.
  • a treatment compound may be a designated compound obtained by the enterprise for inclusion in the assay program as an “active” substance in the evaluation process.
  • the enterprise When the enterprise receives a treatment compound, it plates it onto one or more master treatment plates and registers these plates in ActivityBase, the orgaization's research database system.
  • ActivityBase tracks treatment lots rather than treatments, and the automated system needs to track the treatment compound as an object rather than the lots. It identifies the compound with an ID number, but there may be multiple entries for these compounds with slightly different molecular weights and formulas but the same ID.
  • the automated system thus queries ActivityBase to find all registered treatment compounds marked as CytometrixTM compounds which are not already part of CytometrixTM and records treatments and IDs in a CytometrixTM table. It takes the first molecular formula and molecular weight it finds to store in the table. Note that in some embodiments the automated laboratory experiment manager allows for querying and/or examining treatments.
  • a Track Master Treatment Plates use case 1139 may be understood as follows. When an organization receives a treatment compound, it may plate it onto one or more master treatment plates and register these plates in ActivityBase, the organization's research database system. The wells of the master treatment plate thus contain the initial concentration of the compound that serves as the basis for dilution onto daughter treatment plates and assay plates.
  • the Track Master Treatment Plates use case 1139 lets the Designer track the master plates that contain treatment compounds by querying ActivityBase through an interface. That means that the Designer does not have to create treatment compounds or master plates but rather queries them from ActivityBase. In one embodiment, the Designer cannot change master treatment plates or remove them.
  • This use case also lets the Designer associate a plate format with the ActivityBase master treatment plate (see the discussion of the Model Plate Format use case 1123 for more information on plate formats).
  • a Maintain Daughter Treatment Plates use case 1141 may be understood as follows.
  • the automated system produces daughter treatment plates from master treatment plates. Each well in an assay plate has a specific dilution or other characteristic treatment from a well on a daughter treatment plate. See the Model Well Group use case 1121 for details on modeling groups of wells; see the Model Plate Format use case 1123 for details on mapping well groups to assay plates; and see the Maintain Assay Plate use case 1119 for details on combining a treatment plate with an assay plate to generate the wells on the assay plate.
  • the Track Daughter Treatment Plates use case lets one create and maintain daughter plates.
  • a daughter plate can be generated based on a master plate (see the Track Master Treatment Plates use case 1139 ).
  • Exemplary processes of the Maintain Daughter Plates use case 1141 are depicted in Table 22 below.
  • TABLE 22 Actor System Query a master treatment Display the master plate using its system treatment plate system identifier, its barcode, and/or identifier, barcodes, and its descriptive text. description and the set of existing daughter treatment plates for the master and the set of wells for each daughter.
  • Create a set of daughter Create the new plate in treatment plates, supplying the Experimental the number of plates to Database and generate create, the range of treatment the set of treatment plate plate barcodes and the media wells, setting the row, and treatment volumes added column, concentration, to the plates when creating concentration unit, them from the master. treatment volume, volume unit, and plate description from the master wells and the added media volume from input.
  • Select a treatment plate well Display the well on a master treatment plate. information for the well, including row and column numbers; treatment ID, name, molecular mass, and molecular formula; compound concentration and volume; and plate description. Select and change a daughter Update the barcode or plate by changing the media volume in the barcode or media volume for Experimental Database. the plate. Remove a daughter plate Mark the daughter plate from active use. as inactive. End the use case. Commit the transaction.
  • the Experiment Protocol system is a LabRat application that lets a Designer create and maintain a set of experiment protocols. These protocols typically include one or more of the following aspects of an experiment design: a set of cell lines; a set of marker sets; a number of replicates; a list of time points; and a set of QC target sets.
  • the protocol contains the general layout parameters; an experimenter chooses the protocol, then supplies the necessary specific information to create the experiment in an Experiment Wizard (described below).
  • the ExperimentProtocol system 1201 is a Java applet in the presentation layer that allows maintenance of persistent experiment protocols.
  • the system 1205 e.g., a Java Server Page
  • the ExperimentProtocol system 1201 uses two subsystems in the business object layer (EJBs), AssayPlate 1207 and Experiment 1203 . Both correspond to schemas in the database layer.
  • a QCTargetSet systsem 1209 may be a Java applet in the presentation layer that lets you maintain persistent QC target sets.
  • the system (a JSP) provides access to a QC subpackage 1211 of the Experiment subsystem in the business object layer, consisting of EJBs and the underlying schema in the database server layer.
  • the invention may include an “Experiment Wizard” system (e.g., a LabRat application) that lets a Production experimenter create an experiment quickly and easily.
  • the Wizard provides one or more of the following parameters: (1) experiment protocol (specifies cell lines, marker sets, time points, number of replicates) (choose from list); (2) imaging protocol (choose from list); (3) QC target set (choose from list); (4) master treatment plates and plate format (enter series of barcodes and choose plate format for each from a list of compatible formats); (5) control master treatment plates (enter Taxol and DMSO or accept defaults); (6) daughter treatment plate barcodes (generated from specification or entered directly); and (7) cell plate barcodes (generated from specification or entered directly).
  • the Wizard uses the experiment protocol and the selected specific settings to create a complete experiment design. It creates the daughter plates and cell plates (including control plates). It allows the user to prune out particular plates not needed. It then lets the user choose an experiment model for each batch and generates the processes required for the batches. It produces a “Drug Add Worksheet” for each batch that tells the Experimenter how to process the batches through tissue culture and fluidics.
  • a first page 1301 of the wizard allows one to choose an experiment protocol, an imaging protocol, and a QC target set.
  • the experiment protocol identifies an experiment setup, including a set of cell lines, a set of marker sets, a set of time points, and a number of replicates.
  • a “Standard Experiment” might, for example, use six cell lines, OneStep and TriStain (three designated markers), a 24-hour time point, and 3 replicates.
  • the imaging protocol sets the desired microscope and imaging parameters (this can be changed later in the Process Monitor).
  • the QC target set is a set of features with upper and lower specification limits and a target value. The user can change the quality settings by creating multiple sets of QC targets, then creating the experiment with the appropriate set.
  • the targets are associated with a particular experiment protocol, so the user sees only the target sets for the chosen protocol.
  • the user may, in the depicted example, first choose the master treatment plates for DMSO, Media Only, and Taxol control plates.
  • This page may display the “usual” master barcode to use for these by default, but the user can replace this barcode with another one if required.
  • the user then chooses a series of master treatment plates by typing in a barcode.
  • the system restricts her choice of plate formats to the formats compatible with the master plate. She then chooses one plate format from the dropdown list of compatible plate formats.
  • a “compatible” plate format is one with a set of well group wells that matches in number the set of master plate wells.
  • a next page 1305 lets the user choose a starting barcode to use for daughter treatment plates for a selected master barcode as well as specifying a number of such plates to generate.
  • the user can type in a list of daughter barcodes directly into the list of plates.
  • a special case is using the master plate as a daughter: the user does this by entering the master barcode as the starting barcode and setting the number of daughters to 1.
  • the Wizard On clicking the “Generate daughters” button, the Wizard generates the required number of daughter plates using the TreatmentPlateGenerator session bean. Each generated plate will have a unique barcode incremented by one from the previous barcode, with the first plate having the starting barcode.
  • a next page 1307 displays the number of plates required at this point in the Wizard. It lets the user enter the starting barcode to use for the assay plates generated by the design. In one embodiment, each plate will have a unique barcode incremented by one from the previous barcode, with the first plate having the starting barcode. Alternatively, the user can just type in the barcodes into the text box, which lets her enter a list of non-sequential barcodes. Clicking on “Prune experiment” lets her remove certain branches of the experiment tree (see the following explanation). Clicking on “Generate cell plates” lets her see the list of generated cell plates; clicking on “Next>” finalizes the list of cell plates.
  • An ExperimentPruner applet gives the user a way to prune branches from an experiment.
  • the system presents a tree 1309 of the combinations of the experiment parameters (master treatment plate, time point, marker set, and cell line, in that order). The user can prune out whatever branches of this tree are not required for the experiment.
  • the system After saving and exiting from the applet, the system displays the Cell Plates form, and the user can click on the “Generate cell plates” button, and then click on next to see the Batch Generator applet.
  • the Batch Generator lets the user divide an experiment into batches.
  • the system displays the remaining tree branches divided into batches, one per cell line. See FIG. 13G . It then lets the user combine these branches to merge several cell lines into a single branch corresponding to a single batch.
  • the user can also label the batches with a name so she can easily understand which is which in the next Wizard screen.
  • Passaging is a process used to grow cells continuously in media. CytometrixTM experiments may require a significant quantity of a commercial cell line (a particular kind of cell, such as A549 or HUVEC). CytometrixTM has qualified several cell lines for use with experiments and has a database with target cell counts and quality specifications for each cell line. Passaging lets one grow cells from the commercial lot.
  • a commercial cell line a particular kind of cell, such as A549 or HUVEC.
  • a group within an organization typically has the responsibility of maintaining and growing the cells to supply experiments with microtiter plates with cells of a certain density within a certain maximum passage number.
  • Research associates grow the cells in, e.g., T-175 flasks or roller bottles; when the cells reach a certain confluence (coverage of the surface area of the flask) the tissue culture research associate passages the cells and either puts them into new vessels or plates them onto microtiter plates. The passaging allows the cells to grow by reducing their confluence to a level that will promote growth.
  • the density of cells in the wells of the plate is typically an important process variable for the automated system. If plating density is not within specification limits or diverges widely from its target, the image processing and biological analysis algorithms can fail.
  • Passaging involves trypsinizing the cells (applying the chemical trypsin) in the flask to disrupt their adherence to the flask, combining flasks into a single cell suspension, counting the resulting cells, then either putting the cell suspension into a new set of flasks at the right density or plating the cells onto microtiter plates with the Multidrop device for an experiment (or both).
  • This process adds one more passage number to the cell line. For example, the cells are said to go from passage 3 to passage 4 after trypsinization.
  • the primary actor is a Research Associate 1403 , who is the main user of the application.
  • the Research Associate 1403 enters various pieces of information during the processes and uses the computed information delivered through the application to complete the processes.
  • the RA 1403 is responsible for correct data entry and for using the computed information properly by applying the tissue culture SOPs (standard operating procedures).
  • a secondary actor is an Operations Manager 1401 , who monitors cell-plating processes and inspects the tissue culture worksheet information.
  • Another secondary actor is a Quality Control Manager 1405 , who inspects the tissue culture worksheet information to improve process quality.
  • the Operations Manager 1401 inherits all the abilities of the Research Associate 1403 , allowing him or her to enter data and use results.
  • Another secondary actor is an Automation Specialist 1407 , who uses the passaging report.
  • the Operations Manager 1401 is responsible for the system's tissue culture. She should be able to understand what is happening in the tissue culture passaging and cell plating processes, enter passaging information, count cells, plate cells into plates, plate cells into single-well vessels, monitor passaging, and report on passaging. She should also be able to trace what happened in passaging and cell plating when there is a plating density failure.
  • the Research Associate 1403 is generally responsible for laboratory work during the tissue culture processes. She should be able to get correct values for required process values based on minimal inputs, enter passaging information, count cells, plate cells into plates, and plate cells into single-well vessels.
  • the Automation Specialist 1407 is generally responsible for laboratory work during the drug add processes. She should be able to verify that a set of plates have a particular cell line on them before proceeding with a drug-add process and print plating report.
  • An Enter Passaging Information use case 1409 can be understood as follows.
  • the RA 1403 creates a new passaging task by entering information about the passaging process.
  • the system calculates the total number of milliliters of cell suspension that will be available for plating into the target number of vessels at the end of the passaging process as well as various other target values.
  • Passaging takes a set of input vessels containing cells and plates the contents into some combination of output vessels. For example, one kind of passaging takes roller bottles as inputs and produces roller bottles as output. Another kind of passaging takes T-175 flasks as inputs and produces a combination of 386-well plates and T-175 flasks. The plates go on to become part of an experiment; the flasks go back into the next passaging task for further growth of the cells.
  • the input vessels should all be of the same type and plating volume and should contain cells with the same passage number. There are three types of passaging:
  • the RA is maintaining the cell line with no intention of plating the cells within one passage of the current passaging. That is, the cells are going into another flask with the intention of repeating the process at least once into another, additional flask.
  • the RA is preparing the cells for plating with one additional passaging before the plating occurs. That is, the cells are going into another flask with the intention of passaging them into a set of plates on the next passage.
  • the RA is passaging the cells for plating onto plates in the current process.
  • the RA may passage some of the cells into flasks as for maintenance or pre-plating while plating some of the cells onto plates.
  • a “well” is a receptacle or set of receptacles in a vessel.
  • a flask for example, has one well (itself), as does a roller bottle.
  • An 8 ⁇ 12 plate has 96 wells, and a 16 ⁇ 24 plate has 384 wells.
  • An output plate may use only some of the available wells; hence the RA can specify how many wells to output per vessel, which allows for correct calculation of required volume amounts.
  • the Engineer can specify a default number of wells to plate for each kind of plate.
  • the Enter Passaging Information use case 1409 sequence may generally proceed as follows.
  • the RA logs on to the system.
  • the system displays a new passaging task with the name of the logged-on RA's name and the current date and time.
  • the RA sets the name of the RA responsible for the passaging, replacing the logged-on RA's name.
  • the RA sets the cell line from the list of available cell lines.
  • the RA sets the number of input vessels.
  • the RA selects the vessel type, plating volume, and plating type (Maintenance, Pre-Plating, or Plating) (one field, all items together from the list of supported vessels, volumes, and types for the cell line).
  • the RA enters the starting passage number from the input vessel labels.
  • the RA estimates the confluency of the cells in the flask and enters the confluency as a percentage (5, 10, 15, 20, 25, 30, 35, 40, . . . , 95, 100).
  • the RA takes digital images of each input flask and stores them on disk in a network storage directory. The RA selects one image to represent the confluency estimate and enters its path and filename.
  • the RA enters the media working number that identifies the media lot being used.
  • the RA enters the trypsin aliquot number that identifies the trypsin lot being used.
  • the RA enters the PBS aliquot number that identifies the PBS lot being used.
  • the RA saves the passaging task.
  • the system stores the passaging task in the database.
  • the name is the name of the cell line plus the date plus the starting passage number: ‘A498 6/23/2001 09:05:27 Passage 17’, for example.
  • the system sets the task status to Started.
  • a Count Cells use case 1411 may be understood as follows.
  • the RA 1403 counts the cells after trypsinizing the flask.
  • the RA takes three counts with the Coulter counter device and the system calculates the average.
  • the RA counts the cells with a hemocytometer to check the Coulter counter number.
  • the system calculates the average number of cells per milliliter and the total number of cells available.
  • a goal of this use case is to track cell counts going into passaging and to provide estimates to the RA of the current count and density in the flasks.
  • it involves specifying a number of T-175 flasks (nT175) and a total number of milliliters of cell suspension (totalSuspension)
  • the RA enters 3 Coulter Counter cell counts.
  • the system calculates the average count and displays it once; the RA enters all 3 values.
  • the RA enters a hemocytometer count for four squares.
  • the system displays two calculated values: average cells per milliliter and total number of cells available (see calculation formulas above).
  • the RA saves the cell counts.
  • the system stores the counts in the database along with the date and time of the last count entered.
  • a plate cells into plates use case 1413 may be understood as follows.
  • the RA should create some number of cell plates from the cell suspension.
  • the RA enters the number of plates to process, then runs the plates through the “Multidrop” device to plate the cells.
  • the RA reads the barcode for each plate with a barcode reader.
  • the system creates an assay plate object in the database with the cell line and passage number (plus one) from the worksheet.
  • the system also creates a completed Plating Task for all plates processed, associating all plates with the task as process elements, allowing the Process Monitor to display the status of plating to the Operations Manager.
  • the barcode reading operation happens after a Multidrop plating process is complete.
  • the RA takes the stack of plates over to the bench and scans all the barcodes into the worksheet. Because this is a single-point event, there is only one task for all the plates, and the date and time for task start and complete is the barcoding start and complete time. This is easier than scanning the barcodes directly; assuming that the individual times are not important.
  • the concentrated cell stock may be calculated as follows.
  • the RA chooses the plate type, plating volume, and passaging type (Plating in this case, all items in one field), the number of plates, and the number of wells to plate in each vessel (default).
  • the system displays the total media needed, the total cells needed, and the amount of concentrated cell stock to add (mls) for this set of plates.
  • the system also displays the total cells needed for the passaging task (sum of all output vessels including this set of plates) and calculates whether the plating has failed (that is, whether there are enough cells available to accommodate the number of plates and other vessels entered as output in this use case or the “Plate cells into single-well vessels” use case). See the above calculations.
  • the RA enters 3 Coulter Counter cell counts.
  • the system calculates the average before-plating count and displays it once the RA enters all 3 values.
  • the RA plates the cells using the Multidrop device. After completing the plating, the RA scans the plate barcodes into the Passaging Worksheet. For each plate, the system creates a plate object with the barcode and sets the cell line (cellLineID) and passage number (starting passage number plus 1). The system displays the number of plates processed. The step ends when the system increments the number of plates processed to a value that is equal to the number of plates to process that the RA entered in step 1. At this point the RA cannot process any more plates.
  • the RA enters 3 Coulter Counter cell counts. The system calculates the average after-plating count and displays it once the RA enters all 3 values.
  • the RA enters a comment on the plating process.
  • the system logs the comment and attaches it to the passaging process associated with the plating.
  • the RA ends the use case, saving the changes.
  • the system sets the completion date of the passaging task to the current date and time.
  • a Plate cells into single-wells vessels use case 1415 may be understood as follows.
  • the goal of this use case is to track the transfer of cells into different single-well vessels as part of the passaging process (maintenance, pre-plating, or along with plating).
  • the cell line seed density settings are entered in Cell Line Vessel Profile as target concentrated cells for maintenance and pre-plating plating types.
  • An average number of cells per milliliter is calculated in “Count cells.”
  • the RA 1403 needs to transfer the cell suspension (less the amount plated on 384-well plates) into new single-well vessels, either as maintenance or as a pre-plating passaging.
  • the narrative for use case 1415 follows.
  • the RA chooses the plate type, plating volume, and passaging type (all items in one field), and the number of vessels.
  • the system displays the total media needed, the concentrated cell stock needed, and the total cells needed for this set of vessels (based on the passaging type, plating volume, and cell target).
  • the system also displays the total cells needed for the passaging task (sum of all output vessels including this set of vessels and possibly a set of plates) and calculates whether the plating has failed (that is, whether there are enough cells available to accommodate the number of vessels entered as output in this use case or the “Plate cells into plates” use case). See the discussion in the “Plate cells into plates” use case 1413 for the calculations.
  • the RA enters a comment on the passaging process.
  • the system logs the comment and attaches it to the passaging process associated with the plating (see the “Enter passaging information” use case).
  • the RA ends the use case, saving the changes.
  • the system sets the completion date of the passaging task to the current date and time.
  • the RA may print a report listing the cell line, the date and time of passaging, and the list of barcodes of the plates made by the passaging task.
  • This is represented by a Print plating report use case 1417 .
  • One goal of use case 1417 is to provide the automation Specialist with a hard-copy record of the set of plates and their cell line for use during incubation and drug add tasks. The Automation specialist uses the printed report to ensure that the plates are the right ones given the experiment design.
  • the RA chooses to print the plating report.
  • the system sends a report giving the cell line, the passaging task completion date and time, and a list of cell plate barcodes plated by the passaging task.
  • a Monitor passaging use case 1419 may be understood as follows. Its goal is to display the status of a passaging process to the Operations Manager 1401 . Generally, the “Plate cells into plates” use case or the “Plate cells into single-well vessels” use case must be in progress or completed to see the tasks.
  • the Operations Manager uses the Process Monitor to see the status of plating tasks.
  • the Process Monitor displays the Passaging task. The status appears first as Started, then changes to Completed when the RA saves the plating information.
  • the system displays all passaging tasks, displaying the name, description, start date, completion date, and status for the task. The system then refreshes the monitor display, getting any new processes and tasks. If appropriate, the Operations Manager sets the status of a Started task or process to Broken, stopping any further processing of the task. If appropriate, the Operations Manager sets the status of a Broken task or process to Started, allowing further work on the plating tasks. In some embodiments, the Process Monitor may log an application failure and displays the error, then offer the Operations Manager the choice of continuing or closing the monitor.
  • a Report on passaging use case 1421 may be understood as follows. Its goal is to give the Operations Manager 1401 and Quality Control Manager 1405 all the information about the passaging tasks that have taken place during a specific time period. One of the managers runs the report.
  • the Operations Manager 1401 specifies the cell line, starting timestamp and ending timestamp to define the reporting period.
  • the system displays the report, showing for each Passaging task with a start date within the specified time interval the process name, description, RA, cell line name, start date, end date, input vessels and their image, confluency, starting and ending passage numbers, media working number, trypsin batch, PBS batch, hemocytometer cell count, average Coulter counter cell count, average before-plating cell count, number of output plates made, average after-plating cell count, and number of output single-well vessels made.
  • the system calculates and displays the status of passage failure and plating failure for each task.
  • the system also displays any comment (with last status date and owner person) linked to the task and any failures (with last status date and owner person) logged against the task.
  • FIGS. 14B and 14C show the suitable spreadsheets for T-175 flask and 384-well plating.
  • a passaging worksheet should find a way to emphasize these items as important.
  • the UI should typically provide a Save feature and a New Passage feature. It might also provide an End Passage feature to enable ending the 384-well plating use case without actually creating a new passage.
  • the Passaging Task contains a confluency estimate and an image file of the confluency sample, the starting passage number, the identifiers for the input reagents, various cell counts, and the date and time of cell counting.
  • Methods on this class calculate count averages, total cells available for passaging, total cells needed for passaging, whether the passaging and/or plating failed, and the cell line for the passaging (all vessels should have the same cell line, and there is no direct link to the cell line table, hence the method).
  • An InputVessels table is a set of vessels that provide cells to the passaging task.
  • the class has the number of vessels in the set and calculates the cell suspension volume in mls. There is exactly one set of input vessels.
  • the OutputVessels table is a set of vessels that hold the passaged cells, and there can be any number of such sets (usually 2, a set of plates and a set of single-well vessels).
  • the class specifies the number of vessels and the number of wells in each vessel actually used.
  • the class provides methods to calculate the total amount of media (mls) required for the output vessels, the total cells needed, and the amount of concentrated cell stock needed for the vessels (mls).
  • the automate system produces daughter treatment plates from master treatment plates.
  • Each well in an assay plate has a specific dilution of a treatment from a well on a daughter treatment plate.
  • a Track Daughter Treatment Plates use case lets a user create and maintain daughter plates. The user generates a daughter plate based on a master plate.
  • TABLE 23 Actor System Query a master treatment plate Display the master treatment using its system identifier, its plate system identifier, barcode, and/or its descriptive barcodes, and description and text.
  • Create a set of daughter Create the new plate in the treatment plates, supplying the Experimental Database and number of plates to create, the generate the set of treatment range of treatment plate plate wells, setting the row, barcodes and the media volume column, concentration, added to the plates when concentration unit, treatment creating them from the master. volume, volume unit, and plate description from the master wells and the added media volume from input.
  • a Treatment Plate Generator 1501 is a form and a stored procedure that uses the Assay Plate schema 1503 and the ActivityBase integration to generate daughter treatment plate records in the Assay Plate schema as illustrated in FIG. 15A .
  • a Treatment Plate package contains most of the relevant persistent classes that the application uses.
  • a Master Treatment Plate class is a view on the ActivityBase tables that represent treatments and plates. It contains a barcode, a description, and an ActivityBase plate format.
  • a Treatment Plate class represents a daughter treatment plate, a plate onto which one transfers some of the volume of treatments from the master treatment plate. It has a unique treatmentID (the implicit OID), a separate barcode, and the volume of media added to each well on the plate when the plate is set up. This volume is part of the ultimate calculation of the concentration of treatment compound in the daughter treatment plate well.
  • a Treatment Plate Well class represents a single well on the daughter treatment plate, and each well links to the corresponding well on the master treatment plate. All treatment plate wells have a treatment compound, empty wells do not exist in the Treatment Plate Well table.
  • the class contains the row and column number that map to the master well, a concentration and concentration unit taken from the master well (so that there is no need to join to the view, a considerable performance problem), and a volume of treatment compound added to the treatment plate well. This will usually be the same volume for all wells on the plate, an assumption that the Treatment Plate Generator uses in generating the daughter plates.
  • the Treatment Plate Generator lets the user attach a plate format and checks to ensure the plate format is compatible with the ActivityBase plate layout.
  • the Plate Format has a plate type (8 ⁇ 12 or 96 wells versus 16 ⁇ 24 or 384 wells) and a group of well groups.
  • a well group identifies a set of generic wells that will either be controls or will contain a single treatment (or possibly some other designation as time goes on).
  • Each well in a well group has a row and column number to identify the well within the group (and to link the well to wells on treatment and assay plates).
  • the Treatment Plate Generator checks to make sure the basic plate type is compatible with the ActivityBase master plate format. It also checks to make sure the well group wells correspond to non-empty wells in the Master Treatment Plate Well table.
  • a sample user interface for the treatment plate generator is a single form as depicted in FIG. 15B .
  • the top block lets the user query any master treatment plate from ActivityBase.
  • the lower block lets the user specify the number of plates to generate, the starting barcode, the volume of media to add to each well on each plate, and the volume of treatment to add to each well on each plate.
  • the application When the user clicks on the Generate button, the application generates the plates.
  • the basic flow through the treatment plate generator form includes the activities depicted in FIG. 15C .
  • CytometrixTM operates as a collection of systems interacting to run, track, and validate experiments. To validate processes and products, the system contains a feedback mechanism that provides information relating to the success or failure of any Cytometrix system.
  • a system failure occurs when an event happens as a result of system operation that departs from the requirements for the system.
  • a system opportunity occurs when a system user or developer realizes that there is an opportunity to solve a problem in a better way or to improve operation of the system (synonyms: suggestion, enhancement).
  • a system comment occurs when a system user gives some kind of feedback about the system other than a departure from requirements of a suggestion for improvement. All three events are a kind of system feedback that injects information into the automated system.
  • defect corresponds to the concept of fault. There is a many-to-many relationship between these concepts: a fault may cause many failures, and a failure may result from faults in several systems.
  • the Process Tracking System addresses failure feedback, not fault tracking.
  • the process tracking system provides an information system that lets users (including developers), applications, and database servers create and track system failures. It provides applications that enable management to plan improvement work based on prioritization of the failures and to understand the current situation with respect to the life cycle of failures in the overall system. Managers can also use this system to improve the visibility of failures within the organization and to improve communication with respect to failures.
  • the process tracking system also provides an information system that lets users (including developers) suggest and track improvement opportunities.
  • Provide applications that enable management to plan improvement work based on prioritization of the opportunities. Managers can also use this system to improve the visibility and communication of progress in realizing opportunities within the organization.
  • the process tracking system provides an information system that lets users make comments on operational systems. To this end, it provide applications that enable management to plan improvement work based on prioritization of the comments.
  • a failure life cycle appears as shown in FIG. 16A .
  • the user creates a failure, it has status Reported 1601 .
  • a Manager assigns the failure to an Investigator, changing the status to Investigating 1603 until the Investigator or a Manager puts it into Resolving 1605 by assigning the problem to Development to discover the cause of the failure and fix it or decides to Ignore the problem, putting it into the Ignored state 1607 .
  • Resolving means that someone is working on fixing the failure. Again, a manager may decide to ignore the failure by putting it into the Ignored state from Resolving.
  • Development reports that the problem is fixed a Manager verifies the fix and changes the status to Resolved 1609 . When the failure is resolved, the life cycle ends.
  • the opportunity life cycle appears as shown in FIG. 16B .
  • a user or developer suggests an opportunity, it has status Suggested 1611 .
  • a Manager either approves the suggestion and assigns it to a Developer or rejects the suggestion. In the former case, the status becomes Approved 1613 ; in the latter, Rejected 1615 .
  • the Developer integrates the changes into the system, the status changes to Built 1617 . It is also possible for a Manager to decide to reject an approved opportunity, moving the status from Approved to Rejected.
  • a comment life cycle as depicted in FIG. 16C , has one state, Made 1619 .
  • the system does not support any other process relating to comments.
  • Priorities may be set to a number between 0 and 1, with 0 being lowest priority and 1 being highest priority.
  • the text priorities may appear in form input fields, but the database will represent the priorities as decimal numbers to use in calculating the weighted metrics.
  • a Reporter 1621 is any individual with authority to report a failure of, suggest an opportunity for, or comment on a CytometrixTM system.
  • An Investigator 1623 is any individual assigned the responsibility for investigating the causes of a failure or the usefulness of an opportunity.
  • An Application 1625 is any running program that can access the failure database to log a failure in the program.
  • a Database Server 1627 is any running server process that can access the failure database to log a failure on the database server.
  • a Manager 1629 is an individual with responsibility for planning and control of Cytometrics systems.
  • a Database Administrator 1631 is an individual with responsibility for maintaining database tables in the Information Management System schema.
  • An Information Management System Database (not shown) is the schema and storage dedicated to managing information about the automated system as a product.
  • Investigators are also Reporters, as are Managers.
  • Investigators are also Discoverers in the Defect Tracking subsystem.
  • the use cases for the Process Tracking System represent the transactions the various actors can undertake in the system.
  • a Maintain Failures use case 1633 may be understood as follows. A failure occurs when a system fails to perform its intended purpose. A Reporter enters or modifies failures. Investigators and Managers are also Reporters but have special privileges to add resolutions and set management priority.
  • Some processes for the Maintain Failures use case 1633 are depicted in Table 24.
  • TABLE 24 Actor System query a set of failures. Retrieve the set, displaying ID, description, resolution, management priority, user priority, the ordered list of status changes, any linked defects, and any linked opportunities. Create a new user failure, specify Insert the user failure report the failing system, and supply the into the Database, supplying a description of the failure and the unique ID and creating an management and user priority of initial status history of the failure. Reported with a time stamp and changer (based on the Oracle username). The owner is the Reporter. Modify an existing failure by Modify the failure report in the editing the description, supplying Database. or editing a resolution description, or changing the user priority.
  • Extension 1 If a Manager decides to change the status of a failure, he or she sets the status to an appropriate value (see failure life cycle) and optionally changes the owner of the failure to another person and/or sets the management priority.
  • Extension 2 If a Investigator or Manager sees a relationship between one or more defects and a failure, the Investigator or Manager may link the failure to the defects by extending the use case. This permits management to resolve failures by fixing defects and then tracking the failure resolution through the fixing of the defects.
  • Extension 3 If an Investigator or Manager sees a relationship between a failure and an opportunity, the Investigator or Manager may link the failure to the opportunity by extending the use case. This permits management to resolve failures by creating opportunities and then track the failure resolution through opportunity implementation.
  • a Maintain Opportunities use case 1635 may involve a Reporter suggesting or modifying opportunities. Investigators and Managers track the opportunities. Table 25 elaborates. TABLE 25 Actor System
  • query a set of Retrieve the set showing ID, opportunities. description, target release, actual release, suggestor priority, management priority, the ordered list of status changes, any linked components, and any linked failures. Create a new opportunity and Insert the opportunity into the supply the description of the Database, supplying a unique ID and opportunity and the suggested creating an initial status history of priority of the opportunity. Suggested with a time stamp and changer (based on the Oracle username).
  • Modify an existing opportunity Modify the opportunity in the by editing the description, Database, creating a revision status changing the status to an history with a time stamp, changer appropriate value (see (based on the Oracle username), and opportunity life cycle), the status the user sets. supplying a resolution description (with a change to status Resolved) or modifying an existing one, or supplying a management priority for the opportunity.
  • a Reporter makes, modifies, or tracks comments as indicated in Table 26.
  • TABLE 26 Actor System query a set of Retrieve the set, showing ID, comments. description, and priority and any links to the automated system. Make a comment, supplying the Insert the comment into the description of the comment and Database, supplying a unique ID its suggested priority. and creating an initial status history of Made with a time stamp and changer (based on the Oracle username). Modify an existing comment by Modify the comment in the editing the description or Database, setting the new changing the priority. description and priority.
  • a Maintain Deliverables use case 1639 may be understood as follows.
  • a Database Administrator enters, changes, or removes deliverables from the system.
  • a deliverable is a reusable system that is one of several kinds of system that delivers value to a customer (a product document, a hardware system, or a software system). Deliverables can be a major source for failures. Exemplary processes for this use case are depicted in Table 27. TABLE 27 Actor System Create a new deliverable, Create the deliverable in specifying the deliverable name, the database, generating a type (Document, Hardware, unique identifier and Software), description, project data displaying it. (planned value, earned value, actual value, actual cost), and system characteristics (vision, mission, risk, objectives, and so on).
  • Query a deliverable based on ID Display the query result name, type, or description. set, displaying ID, name, type, and description. Display only active deliverables (inactive is false). Modify the name, type, and/or Store the changes in the description of the deliverable. database. If the type changes, remove the existing objects and replace them in the correct tables. Remove the deliverable. Mark the deliverable inactive in the database.
  • a Log Application Failure use case 1641 may be understood as follows. Application software systems log their failures to the Experiment database as application failures. See Table 28 for a sample process. TABLE 28 Actor System Create an application Insert the failure into the failure, specifying the error Database, supplying a unique ID, number, the name of the creating an initial status history of software system actor Reported with a timestamp and logging the error, the changer (based on the program namespace and name of the name), and linking the application failing module, and error failure to the indicated module. (“description”) and context messages.
  • the database server can log a failure in a database object in the automated system Database.
  • An exemplary process for this use case is depicted in Table 29.
  • TABLE 29 Actor System Create a database object failure, Insert the failure into the Database, specifying the error number; the supplying a unique ID, creating an name of the software system actor initial status history of Reported logging the error; schema, object with a timestamp and changer type, and name of the failing (based on the Oracle username), and object; and error (“description”) linking the failure to the indicated and context messages. schema object.
  • Extension 1 If the program logging the error does not exist in the configuration database, the logger raises an application exception.
  • Extension 2 If the system cannot insert the failure into the database for some reason, the logger raises an application exception. One reason might be that the database object does not exist in the configuration database, for example.
  • a Report Status of Failures use case 1645 may be understood as follows. The Investigator and Manager can generate a report of failure status from the system Database.
  • Extension 1 If the report lists user failures, display the user priority.
  • Extension 2 If the report lists application failures, display the system error ID, the system error message, and the context.
  • Extension 3 If the report lists database object failures, display the database identifier, schema name, schema object name, system error ID, system error message, and context.
  • a Report Status of Opportunities use case 1647 , the Investigator and Manager can generate a report of opportunity status from the automated system Database. See Table 31. TABLE 31 Actor System Request a status report, Generate a report ordered specifying the inclusive status by priority and breaking on change dates between which to last reported status select opportunities (default all displaying the opportunity opportunities), a minimum ID, system ID and name, management priority (default 0), description, resolution, and a person who was the last suggestor priority, and person to change the status of the management priority. opportunity.
  • a Manage System Tables use case 1649 , the Database Administrator manages the various tables that support the Process Tracking process. See Table 32. TABLE 32 Actor System Optionally, query a set of data. Retrieve the set, displaying all the columns from the table. Create a new row and supply Insert the new row, creating whatever data is required. new ID as required. Modify an existing row by Modify the row in the changing data as appropriate. Database as specified.
  • Tables to administer include the following: Problem Status, System Error, and Actor (including people, organizations, and programs).
  • a system defect or fault is a flaw in a reusable system that has the potential to cause the system to fail to achieve its mission.
  • a Defect Tracking System should provide consistent, easily accessed feedback about defects in automated systems to management in a persistent format.
  • the associated information system should let users (including developers), applications, and database servers create and track system defects. It should provide applications that enable management to plan improvement work based on prioritization of defect fixing and to understand the current situation with respect to the life cycle of defects in the overall system. Managers can also use this system to improve the visibility of defects within the organization and to improve communication with respect to defects.
  • the defect life cycle appears as shown in FIG. 16E .
  • a user discovers a defect, it has status Discovered 1651 .
  • Management may then decide to get the defect fixed (Fixing 1653 ) or to ignore the defect (Ignored 1655 ).
  • the defect moves to Fixed status 1657 when the user integrates the defect fix into the configuration management system and tests the fix. It is also possible for a manager to decide to ignore the defect after trying for awhile to fix it.
  • the life cycle ends.
  • a Discoverer 1659 is any individual with authority to report a defect in a CytometrixTM system.
  • a Fixer 1661 is any individual assigned the responsibility for investigating the root causes of the defect and for implementing a fix to the defect.
  • a Manager 1663 is an individual with responsibility for planning and control of automated systems.
  • a Database Administrator 1665 is an individual with responsibility for maintaining database tables in the Information Management System schema.
  • An Information Management System Database 1667 is the schema and storage dedicated to managing information about the automated system as a product. Fixers may also be Discoverers, as are Managers.
  • a Maintain Components use case 1669 may be understood as follows.
  • a Database Administrator enters, changes, or removes components from the system.
  • a component is a reusable system that is either a module (hardware, software, database, or file) or a subsystem comprising several modules.
  • Components are the major source for defects that cause failures in deliverables and other systems (see the Process Tracking System Use Cases for details on failures). In particular, all system failures logged automatically are logged against a component. Table 33 provides some relevant processes for the Maintain Components use case 1669 .
  • Actor System Create a new component, specifying Create the component in the the component name, type (Subsystem, database, generating a unique Hardware, Software, Database, or File), identifier and displaying it. description, and system characteristics (vision, mission, risk, objectives, and so on).
  • Query a component based on ID, name, Display the query result set, type, or description. displaying ID, name, type, and description. Display only active components (inactive is false).
  • a Discoverer enters system defects and modifies or tracks them. Fixers and Managers are also Discoverers but have special privileges to change status and to set management priorities. See Table 34. TABLE 34 Actor System Optionally, query a set of Retrieve the set, displaying defects for a component component name, ID, system. description, cause, fix description, priority, the ordered list of status changes, and any linked failures Create a new defect for a Insert the defect report into component, identify the the Database, supplying a system that is defective, and unique ID and creating an supply the description of the initial status history of defect and the priority of the Discovered with a time failure. stamp and changer (based on the Oracle username).
  • Modify an existing defect by Modify the defect report in editing the description, the Database, creating a changing the status to an revision status history with a appropriate value (see defect time stamp, changer (based life cycle), supplying or on the Oracle username), and modifying a cause, supplying the status the user sets. or modifying a fix description (with a change to status Fixed), or modifying the priority for the defect.
  • the Fixer and Manager can generate a report of defect status from the automated system Database. See Table 35. TABLE 35 Actor System Request a status report, specifying Generate a report displaying the the inclusive dates between which defect status, defect ID, description, to select defects (default all system ID and name, owner ID and failures) and a minimum priority name, cause, fix description, and (default 0). priority. Break the report on status. Order the report by status and priority.
  • a Manage System Tables use case 1675 the Database Administrator manages the various tables that support the failure tracking process. See Table 36. TABLE 36 Actor System Optionally, query a set of data. Retrieve the set, displaying all the columns from the table. Create a new row and supply Insert the new row, creating whatever data is required. new ID as required. Modify an existing row by Modify the row in the changing data as appropriate. Database as specified.
  • Tables to administer include the following: ProblemStatus, ObjectType, and Language.
  • the Defect Report provides a sorted list of defects with status Discovered or Fixing.
  • the report provides information on defects to a Quality Review Board, for example, for management and prioritization of defect fixing.
  • the report is sorted into those two status categories (in that order), then by descending priority (highest priority first).
  • the report displays the defect ID, the description, the system against which the defect was logged, the priority, the current owner of the defect, and a list of failures that the defect causes.
  • the report lets you specify a date range for the last status date change and a minimum priority to display, letting you list defects changed between certain dates and defects at or above a certain priority.
  • QRB members and managers should be able to access a current version of the report on demand, either as an HTML file or as a PDF (Adobe Acrobat document).
  • QRB Member 1679 who is a member of the Quality Review Board
  • Manager 1681 who is a departmental manager. See FIG. 16G .
  • the Defect Report system is part of the Defect Tracking system.
  • the context diagram of FIG. 16G shows the Report Status of Defects use case in the context of the other use cases in the Defect Tracking system.
  • the Report Status of Defects use case 1673 was touched on above.
  • the Manager or QRB Member generates a current Defect Report.
  • the user can specify a date range for the last status change; this selects defects that have changed during that time interval.
  • the user can also specify a minimum priority; this selects defects at or above that priority (on a scale of 0 to 100, where 0 is lowest priority and 100 is highest priority).
  • the user can request a specific display format for the report (HTML or PDF).
  • the System displays a report in the requested format with the requested defects in Discovered and Fixing status.
  • the report groups the defects into two groups in order: Discovered and Fixing.
  • the user runs the report.
  • the system then displays the report in PDF format for all Discovered or Fixing defects at or above priority 50 .
  • the report groups the defects into two groups, in order: Discovered and Fixing.
  • the report displays for each group the defect ID, defect description, system name, priority, current owner, and list of failures the defect causes.
  • a user supplies a date range.
  • the system subsets the defects to display only defects with the last status change occurring between the dates.
  • the user supplies priority between 0 and 100.
  • the system subsets the defects to display only defects with a priority greater than or equal to the supplied priority.
  • the user supplies HTML.
  • the system displays the defect report in HTML in the web browser.
  • the present invention has a much broader range of applicability.
  • the present invention is not limited to any particular kind of biological image data, but can be applied to virtually any cellular images or markers. It is not necessarily limited to the specific algorithms and calculations described herein.
  • the invention is not limited to any particular arrangement of selected hardware or software products. Rather the invention can be practiced with any combination of hardware and software products (whether or custom developed) that can provide the functions described herein.
  • the present invention could be implemented with numerous other products beyond those described herein.
  • one of ordinary skill in the art would recognize other variations, modifications, and alternatives.

Abstract

An automated system that conducts, monitors, and validates a cell-line-based biological experiment including one or more treatment compounds or other external stimuli. In one preferred embodiment, the system comprises two principal subsystems, and optionally accessory subsystems. A first principal subsystem is an automated laboratory experiment manager for designing the biological experiment, for constructing an assay plate used to conduct the biological experiment, and for managing one or more of the processes that constitute the biological experiment. A second principal subsystem is an automated data analysis manager for analyzing images, for instance produced by the image production system, to detect image data including biological markers and objects, for analyzing the resulting image data to produce biological data, and for analyzing the biological data to produce biological phenotypes and treatment compound signatures.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of and claims priority from U.S. patent application Ser. No. 10/467,183, filed Jan. 12, 2004, which was the National Stage of International Application No. PCT/US02/05266, filed Feb. 20, 2002, which claims priority under 35 USC §119(e) from U.S. Provisional Patent Application No. 60/270,314, filed Feb. 20, 2001. These applications are incorporated herein by reference in their entirety and for all purposes.
  • COPYRIGHT NOTICE
  • A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyrights whatsoever.
  • FIELD OF THE INVENTION
  • The present invention relates to computer-automated cellular biological systems. More particularly still, the present invention relates to computer-automated cellular biological systems for designing, conducting, monitoring, and validating a cell-line-based biological experiment including a treatment compound.
  • BACKGROUND OF THE INVENTION
  • The techniques of cellular biology have been applied to numerous fields of scientific inquiry. A cell-line-based biological experiment on specific biological markers is typically a process that groups a set of assay plates into a collection designed to achieve a scientific purpose, or is a composite of several such processes. One known technique in cytobiological research involves the analysis of cellular images from such experiments.
  • Experiments typically combine sets of assay plates to achieve some scientific purpose. An assay plate is a collection of wells arranged in groups of wells. A well group is a set of wells on an assay plate, or ranging across two or more assay plates, that represents a specific collection of wells for distinct analysis.
  • A treatment is a particular drug or other external stimulus (or a combination of stimuli, drugs, or drugs+stimulus/stimuli) to which wells are exposed on an assay plate. Every plate typically contains multiple sets of wells that constitute treatment well groups. A treatment plate is a plate containing an array of treatment compounds in well groups. Each well group may contain one or more treatment compounds in each well (the treatment). Each treatment well in a group contains a specific dilution (or dose) of the group treatment. Typically assay plate wells get a specific amount of compound from the corresponding well on the treatment plate.
  • A well image is one of several possible images of a single well and is the smallest unit of analysis in the system. Well images relate to specific cell markers and are at specific sites in the well. Typically cells of a specified type are introduced into each of the wells of the assay plate by a process sometimes referred to as plating. (Note that a given well may include cells of different types, specifically selected for a particular experiment.) A certain amount of a reagent medium is added to each well to promote cell growth. A certain amount of a treatment is added to each well, combining with the cells and media already present. One or more reagents may comprise a treatment. After the treatment has acted upon the cells in the several wells of the assay plate for the time specified by the experimenter, the cells are typically washed, fixed, and stained. An experiment may contain groups of plates fixed at different times (time points). Images, typically photomicroscopic images, are taken for the cells in the several wells of the assay plate or plates. Finally, an experimenter analyzes these images to determine the effect of the treatment.
  • Each of these steps is exacting, repetitive, and many of them require significant amounts of time from highly trained experimenters to complete. A thorough analysis of the effects of one treatment on one cell line may require tens or even hundreds of wells. This is multiplied where the treatment is analyzed against multiple cell lines, or where a cell line is used to determine the effects of multiple treatments.
  • What is needed is a methodology which provides tools that allow a designer to design an experiment that combines cell lines, marker sets, time points, and treatment plates. These tools should permit the full specification of the experimental process through a process model that generates a process, or collection of tasks. The system should provide the designer with the ability to specify the structure of the experimental process. The system should then specify the processes and tasks for each experiment, automating the process where possible.
  • The system should enable a user to plan for and maintain adequate experimental infrastructure for planned experiments. By way of illustration, this infrastructure includes, but is not limited to hardware, software, reagents, treatments, and maintenance processes. The system should track the infrastructure of experiments by tracking the individual hardware systems, software systems, reagents, treatments, and maintenance processes required to conduct the experiment. The system should provide reports as planning tools for users to help them to keep adequate supplies and systems on hand and in good repair.
  • Automated milestones, for instance barcode scanning, task completion updates, and so forth, should be implemented to provide tracking capabilities that give designers, supervisors, and experimenters the ability to obtain experiment status and to intervene in the process where required, preferably through remote interfaces.
  • The system should provide a full range of tools for validating experimental results. The system should validate experimental results by storing the results of the experiment and by enabling feedback from scientific analysis of the results. Experimental result validation consists of internal consistency of the results and reproducibility of the results. These consistency and reproducibility metrics provide means for designers and experimenters to identify result failures in images, wells, and plates. By way of illustration, but not limitation, consistency metrics may include cell distribution, focus/exposure tests, contamination tests, and control measure consistency with respect to benchmarks. Examples of reproducibility metrics include variance or standard deviation or coefficient of variation of consistency metrics.
  • The system should provide failure and defect tracking tools to track experimental defects and the failures they cause.
  • To create a system for validating experimental processes the system should assist in validating experimental processes by storing the processes and tasks undertaken as part of the experiment. These process and task objects provide a complete history of the experiment with all significant milestones recorded with their date and time together with their process models, reusable protocols for generating the process for each experiment. The failure and defect tracking systems track defects and failures in the processes and tasks reported by the system and its users, both of which are sometimes referred to generically hereinafter as “actors”.
  • The system should be capable of creating reusable information, or feedback, about systems failures that is useful for improving the system. Users could thus use this system to improve the visibility of failures within the organization and to improve communication with respect to failures.
  • The system should be capable of creating reusable information about opportunities to improve the system. Users could thus also use this system to improve the visibility and communication of progress in realizing opportunities within the organization. The system should provide for creating reusable information, or feedback about specific instances of the system that lets users make comments on operational systems. It should further enable management to plan improvement work based on prioritization of the comments.
  • The system should enable users, applications, and database servers to report and track system defects, and to provide management the ability to plan improvement work based on prioritization of defect fixing and to understand the current situation with respect to the life cycle of defects in the overall system. Managers can also use this information to improve the visibility of defects within the organization and to improve communication with respect to defects.
  • Optimally, the system should present a flexible, fully automated system for applying image and data analysis algorithms to input images that optimizes image and analysis throughput. The system should permit easy modification of the algorithm structure and easy control of runtime processing. Developers should be able to add new analytical transactions to the system quickly and easily, and operators should be able to control and prioritize analysis jobs using the running system.
  • SUMMARY
  • The present invention meets these needs with an automated system for conducting, monitoring, and validating a cell-line-based biological experiment including a treatment compound or other external stimulus. Sometimes, the automated system is referred to herein as “Cytometrix™.” In one preferred embodiment, the system comprises two principal subsystems, and optionally three accessory subsystems.
  • The first principal subsystem is an automated laboratory experiment manager for designing the biological experiment, for constructing an assay plate used to conduct the biological experiment, and for managing one or more of the processes that constitute the biological experiment.
  • The second principal subsystem is an automated data analysis manager for analyzing images, for instance produced by the image production system, to detect image data including biological markers and objects, for analyzing the resulting image data to produce biological data, and for analyzing the biological data to produce biological phenotypes (sometimes represented as a quantitative phenotype) and treatment compound signatures (sometimes represented as stimulus response curves).
  • A first accessory subsystem is an image production system for performing photomicroscopy of at least a portion of the assay plate responsive to directions from the laboratory experiment manager, thereby producing an image of the at least a portion of the assay plate.
  • The second accessory subsystem is a database system for storing data including at least one of the image, the image data, the biological data, the biological phenotypes and treatment compound signatures.
  • Finally, the third accessory subsystem is a report generator for providing secure access to the data stored in the database system, and, responsive to a user request, for generating a report compiled from the data.
  • The system also includes several auxiliary components including, but specifically not limited to, components for tracking defects within the system, and for tracking one or more of the processes of the system.
  • The present invention provides a flexible and easy-to-use system for the design of cell-line-based biological experiments on specific biological markers. It provides tools that allow a designer to design an experiment that combines cell lines, marker sets, and treatment plates into a collection of assay plates. These tools also permit the full specification of the experimental process through a process model that generates a process, or collection of tasks. The system's process modeling features provide the designer the ability to specify the structure of the experimental process. The system then generates processes and tasks for each experiment that automate the process where possible. Automated milestones including but not limited to barcode scanning, and task completion updates, provide tracking capabilities that give users the ability to get experiment status and to intervene in the process where required, preferably through remote interfaces.
  • The system enables users to plan for and maintain adequate experimental infrastructure, including but not limited to hardware, software, reagents, treatments, and maintenance processes for planned experiments. The system tracks the infrastructure of experiments by tracking the individual hardware systems, software systems, reagents, treatments, and maintenance processes. Reports provide planning tools for users that help them to keep adequate supplies and systems on hand and in good repair.
  • The system helps to validate experimental results by storing the results and by enabling feedback from scientific analysis of the results. Experimental result validation includes checks for internal consistency of the results and reproducibility of the results. Consistency metrics and reproducibility metrics provide means for designers and experimenters to identify result failures in images, wells, and plates. The failure and defect tracking systems track these defects and the failures they cause. The stored results thus form a part of the experimental protocol
  • The system helps to validate experimental processes by storing the processes and tasks undertaken as part of the experiment. These process and task objects provide a complete history of the experiment with all significant milestones recorded with their date and time together with their process models, reusable protocols for generating the process for each experiment. The failure and defect tracking systems track defects and failures in the processes and tasks reported by the process actors. The stored process information thus forms a part of the experimental protocol.
  • The system includes an information system that lets users, applications, and database servers create and track system failures. The invention also provides applications that enable management to plan improvement work based on prioritization of the failures and to understand the current situation with respect to the life cycle of failures in the overall system. Managers can also use this system to improve the visibility of failures within the organization and to improve communication with respect to failures.
  • To create reusable information or feedback about opportunities to improve the system, it builds an information system that enables users to suggest and track improvement opportunities. It also provides applications that enable management to plan improvement work based on prioritization of the opportunities. Managers can also use this system to improve the visibility and communication of progress in realizing opportunities within the organization. The system also enables users to make comments on operational systems, and provides applications that enable management to plan improvement work based on prioritization of the comments.
  • The system enables users to create reusable information or feedback about systems' defects that is useful for improving the system. It builds an information system that lets users, applications, and database servers create and track system defects. The system further provides applications that enable management to plan improvement work based on prioritization of defect fixing and to understand the current situation with respect to the life cycle of defects in the overall system. Managers can also use this system to improve the visibility of defects within the organization and to improve communication with respect to defects.
  • The principles of the present invention implement a fully automated system for applying image and data analysis algorithms to input images. The system first determines whether there are input images. If necessary, the system preprocesses the images into an appropriate format and location, then notifies a server group that image analysis can start. Each analysis transaction results in a results data set in a database. Transaction data dependencies result in input data from prior transactions read from the database as input to a new transaction.
  • The system optimizes image and analysis throughput. Each server processes a transaction comprising a minimal set of operations in the overall analysis sequence, optimizing parallel processing where possible to improve performance throughput.
  • The system permits easy modification of the algorithm structure and easy control of runtime processing. Developers are able to add new analytical transactions to the system quickly and easily, and operators are able to control and prioritize analysis jobs using the running system.
  • Another aspect of the invention pertains to automated methods for analyzing a plurality of cellular images. The methods may be characterized by the following sequence: (a) from a plurality of image analysis tasks, identifying a next image analysis task for execution; (b) selecting one of a plurality of feature extractor servers available to handle the next image analysis task; (c) identifying an algorithm for extracting features as part of the next image analysis task; and (d) executing the algorithm under the control of the selected feature extractor. In many important embodiments, the image analysis task characterizes a cellular organelle, a material in the cell, or a combination thereof. In some more specific examples, the image analysis task determines the shape of a cell, characterizes the nucleic acid of a cell, characterizes the Golgi of a cell, or a combination thereof.
  • While the invention can be implemented on a number of different software architectures, in one preferred embodiment, the invention employs a supervisor entity that identifies the next image task and selects the feature extractor server to handle the next image analysis task. The identified algorithm is then imported into the selected feature extractor for execution. Further, the method may involve inputting one or more selected cellular images required for the image analysis task. Preferably, these images are generated using a process model generated by an automated laboratory experiment manager for designing the biological experiment. The method may further involve inputting parameters required to execute the algorithm from a database. After the image analysis task is completed, the feature extractor server may be returned to a queue of available feature extractor servers.
  • In a larger context, the method may further comprise: (a) receiving data representing a design of a biological experiment defining an assay plate and comprising one or more processes involving forming at least one image of at least a portion of at least one well of the assay plate; and (b) directing the biological experiment in accordance with the data to generate the at least one of the plurality of cellular images from at least a portion of at least one well of the assay plate.
  • These and other advantages and details of the present invention will become apparent upon reading the following detailed description.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1A is a conceptual overview of a logical system architecture in accordance with one embodiment of the present invention.
  • FIG. 1B depicts a sample process model and associated model of the type that may be employed with the present invention.
  • FIG. 2 is a high level logical outline of an automated image analysis manager including a supervisor, a number of feature extractor servers, and an algorithm subsystem.
  • FIG. 3 is a process flow diagram illustrating the interaction between some of the entities depicted in FIG. 2.
  • FIG. 4A presents a logical system architecture for an automated laboratory manager and image analysis system in accordance with an embodiment of this invention.
  • FIG. 4B depicts a specific physical architecture for implementing the automated manager depicted in FIG. 4A.
  • FIG. 5 is a context diagram illustrating various youth cases associated with an automated image analysis manger of this invention.
  • FIG. 6A presents a sample laboratory experiment process model.
  • FIG. 6B presents a process tree generated from the process model of FIG. 6A.
  • FIG. 7 depicts a supervisor subsystem in accordance with one embodiment of this invention.
  • FIG. 8A depicts the architecture of a feature extractor in accordance with one embodiment of this invention.
  • FIG. 8B presents a specific example process of running a task in the feature extractor system.
  • FIG. 9A presents a block diagram of the algorithm subsystem in accordance with one embodiment of the invention.
  • FIG. 9B presents a sequence diagram illustrating certain actions of the algorithm subsystem while it runs an algorithm.
  • FIG. 10A presents a block diagram of the architecture of an image loader subsystem in accordance with an embodiment of this invention.
  • FIG. 10B presents a sequence diagram illustrating activities of the image loader subsystem.
  • FIG. 11A presents a context diagram of exemplary use cases handled by an automated laboratory experiment manager in accordance with an embodiment of this invention.
  • FIG. 11B illustrates a possible analysis process model with a representation of a model originally identified in FIG. 6A.
  • FIG. 11C illustrates a process tree created from the process model depicted in FIG. 11B.
  • FIG. 12 presents a block diagram of an experimental protocol design architecture in accordance with an embodiment of this invention.
  • FIGS. 13A through 13H depict pages of an experiment wizard user interface that facilitate creation of a laboratory experiment in accordance with an embodiment of this invention.
  • FIG. 14A presents a context diagram illustrating various use cases associated with passaging to grow cells continuously in media.
  • FIGS. 14B and 14C show suitable spreadsheets showing two types of plating in accordance with this invention.
  • FIG. 15A depicts a block diagram associated with a treatment plate generator in accordance with an embodiment of this invention.
  • FIG. 15B shows a sample user interface page for a treatment plate generator.
  • FIG. 15C depicts a basic process flow through the treatment plate generator form in accordance with an embodiment of this invention.
  • FIG. 16A depicts a failure life cycle associated with a process tracking system of this invention.
  • FIG. 16B depicts an opportunity life cycle associated with a process tracking system of this invention.
  • FIG. 16C depicts a comment life cycle associated with a process tracking system of this invention.
  • FIG. 16B depicts various use cases associated with a process tracking system of this invention.
  • FIG. 16E depicts a defect life cycle associated with a defect tracking system of this invention.
  • FIG. 16F depicts various use cases associated with a failure tracking system of this invention.
  • FIG. 16G depicts various use cases associated with a defect report system of this invention.
  • DETAILED DESCRIPTION
  • System Overview
  • The succeeding discussion centers on one or more preferred embodiments of the present invention, implemented by a number of hardware and software components. It will be understood by those having skill in the art that where the embodiments enumerated herein specify certain commercially available hardware, software, or services, these are by way of example. The principles of the present invention are capable of implementation utilizing a wide variety of hardware, software and service combinations, and these principles specifically contemplate all such embodiments.
  • Having reference now to FIG. 1A, a conceptual overview of one specific embodiment of the present invention is presented. The system, 1, comprises two main modules, an automated laboratory experiment manager, 50, sometimes herein referred to as “LabRat” and an automated data analysis manager, 60, sometimes herein referred to as “StatRat”. These major subsystems or modules interact with other systems, modules, and processes, generally discussed hereafter, to form the present invention.
  • The automated laboratory experiment manager generally interfaces with a cellular biology module 62, a fluidics automation module 64, an imaging process or program 66, automated data analysis manager 60, and Cytoanalyst 68 (a user interface subsystem that reports and displaying scientific results) to define, conduct, and oversee the experiment.
  • An experiment can be said to encompass a number of processes. Some of these processes are simple one-step procedures. Other processes are complex and may require many tasks or even many other processes to complete. The present invention implements a novel methodology for modeling and conducting the several processes required to perform a biological experiment. This novel methodology includes the use of a process model, which is a reusable system. The process model is used to define a specific process for an experiment.
  • Having reference now to FIG. 1B, a process model 75 is shown. Process model 75 utilizes one or more task models 76 and may implement a composite process model 77. A task is generally a simple one-step procedure. A composite process is generally a multistep or multi-level procedure. An example of a composite process model 77 includes the highest level of abstraction the experiment 78, and in this example, a fluidics composite process 79 and a simple task 80. The fluidics composite process 80 comprises a further composite process, fluid addition, composite 81 incorporating a plurality of tasks 80.
  • Process model 75 and composite process model 77 are used to define a specific process, 90. Process 90 may be considered to be a specific instantiation of the abstract process defined in process model 75. Process model 75 defines process 90, and process 90 may incorporate one or more composite processes for instance 91 and may further incorporate one or more tasks 92. Composite process 91 is defined by composite process model 77.
  • As discussed, the system taught herein relates to the conduct of cellular biological experiments, especially experiments conducted to determine the effects of one or more treatment compounds on cells, particularly cells within a given cell line. The system taught by the present invention causes fluorescent microscope images (or images from other microscopy techniques such as phase contrast, confocal, epi-fluorescence and polarized light) to made of cells within assay plates, analyzes the images to detect biological markers and objects, then analyses the resulting image data to produce biological data. Higher-level statistical analyses then produce biological phenotypes and signatures for treatment compounds in the experiment from this biological data.
  • This process is automated by a series of feature extractor's managed by a single automated supervisor. The supervisor maintains a list of all outstanding analysis tasks. When a task becomes ready for processing, the supervisor broadcasts a message requesting such processing through a message queue. The feature extractors are individual servers that check the message queue for processing requests and undertake the tasks as they become available. This architecture distributes the image and data analysis algorithms for an experiment over multiple servers, providing a highly scalable way to manage automated data analysis. The servers retrieve and store data in the database (or local or distributed file system or archival data store), including images. According to one embodiment of the present invention, the servers retrieve and store this data by means of Enterprise Javabeans. When a task is completed, the extractor notifies the supervisor of task completion or failure, so the supervisor maintains the status for all tasks underway in an experiment. The process monitor displays his data through a web browser for any user who wants to track progress on the data analysis.
  • One of the significant advantages of the present invention is the ability to distribute a number of tasks over an arbitrary number of computing devices. The tasks are specifically associated with process monitoring and image analysis. As will be explained in the discussion of FIG. 2, the logical entities primarily responsible for this functionality are a supervisor, multiple feature extractors, and an algorithm system. A process monitor may also be available to query the supervisor for information about the process state.
  • As shown in FIG. 2, a high level logical outline of the automated image analysis manager 201 includes a supervisor 203, a number of feature extractor servers 205, and an algorithm subsystem 207. Subsystem 207 interfaces with a source of specific algorithms 209 and a source of specific input data (pertinent to particular ones of the algorithms) 211.
  • The supervisor 203 oversees allocation of analysis tasks among the various feature extractor servers 205. As feature extractors become available, the supervisor assigns them to a specific task. Upon assignment of such task, the designated feature extractor server 205 imports the algorithm subsystem 209 and starts a thread that accesses an interface to algorithms 209 in order to run the appropriate algorithm. The thread also accesses the input data as necessary to run the algorithm. The input data provided by 211 may be in various forms such as dynamic arrays or images.
  • FIG. 3 depicts a process 301 illustrating the interaction between some of the entities depicted in FIG. 2. As shown, process 301 begins at 303 with a supervisor identifying all ready tasks. Next, the supervisor selects a given task and puts it into a message queue at 305. Then, one of the available feature extractors 205 takes responsibility for the task. See 307. That feature extractor starts the appropriate thread to identify the required algorithm for the task and any associated parameters needed to complete it. See 309. The feature extractor then gets the identified algorithm via subsystem 207 and the required parameters from block 211 via subsystem 207. See 311. Typically, though not necessarily, the input data and parameters will be obtained from a database of such information.
  • At this point, the task is executed. That is, the selected algorithm operates on the input data to generate one or more outputs. See 313. The results of executing this task are then put in to appropriate locations in a database of interest. See 315.
  • Next, the task thread is terminated and the feature extractor server goes back into a queue of available feature extractors. See 317. Concurrently, at 319, the feature extractor server returns a task completed or task broken message to supervisor 203. As illustrated, the feature extractor server then looks for or becomes available for the next task assigned to it by the supervisor. See 321.
  • Overall Architecture—Logical
  • In one specific embodiment, the automated system system of this invention may be implemented via an architecture and deployment technology as described in this section. It has a number of different major systems that interact to support the various processes that support the overall service and product available to users.
  • The automated system system architecture embodiment depicted in FIG. 4A has the following component subsystems.
  • Process Status Display (401): A user interface subsystem that displays process status for active processes, displays Feature Extractor status, and provides an interface for interacting with a subsystem known as the automated system Supervisor 403.
  • Supervisor (403): A server subsystem (sometimes implemented as multiple subsystems) that coordinates processes in Feature Extractors 405 through message queues and manages the storage of images through a DBMS subsystem 407 (e.g., the Oracle8i interMediaImage subsystem) that facilitates storage and retrieval of images.
  • Message Queue (409): A server subsystem or subsystems that provides messaging services to the Supervisor and Feature Extractor subsystems.
  • Feature Extractor (405): Server subsystems that automate the extraction of features from images of assay plate wells.
  • Automated laboratory experiment manager (LabRat) (411): A user interface subsystem that provides a comprehensive array of forms and reports on different aspects of the Cytometrix™ system, including data entry, process modeling, process tracking, failure and defect tracking, and other features of the experimental process.
  • CytoAnalyst (413): A user interface subsystem that provides a results reporting capability as a web-based system for displaying scientific results as HTML pages through web browsers, plus some interface technologies for providing data access to the results for further data analysis using third-party data analysis tools such as SPLUS or SAS.
  • Hardware Status Display (415): A user interface subsystem that displays the status of various hardware components of the automated system to enable monitoring of the system
  • Oracle8I (417): An object-relational database management system that provides data storage and retrieval capabilities as well as application server capabilities. Other relational DBMSs may be used.
  • Persistent Messaging Middleware (419—also referred to as OAQ herein): Oracle Advanced Queuing, an Oracle8i subsystem that provides a persistent messaging middleware solution for Oracle8i clients. Other comparable non-Oracle middleware solutions may be employed.
  • InterMediaImage (409): An Oracle8i subsystem that provides storage and retrieval services for images.
  • Overall Architecture—Physical
  • The physical system architecture of the automated system infrastructure can take many different forms. In a specific embodiment that has now been implemented, the physical architecture has the form shown in FIG. 4B. It is based on the integration of several technologies:
      • Oracle8i (Oracle, JServer, CORBA, interMediaImage)
      • Enterprise Javabeans (EJBs)
      • Java Server Pages
      • Java applets
      • Oracle Forms Server
      • Oracle Reports Server
      • Matlab
      • C++ applications and wrappers
  • In the UML (Universal Modeling Language) deployment diagram shown in FIG. 4B, the shadowed boxes are computers (nodes) and the complex boxes are components such as jar files, exe files, HTML pages, and so on.
  • There are five basic nodes in the depicted system:
  • CMTRXPRD Oracle8i Server (425): The Oracle8i instance that holds all the system's data and stored procedures; also the server for the EJBs relating to data access (“Entity Beans”). Note again that while a specific Oracle product is depicted here, numerous other suitable DBMS products (now available or developed in the future) can be used in its place.
  • Supervisor (426): The server devoted to running the Supervisor entity bean. It may expand to multiple servers if required. In this example, it runs a JServer application server on an Oracle8i instance.
  • Feature Extractor Servers (427): Any number of individual servers dedicated to running feature-extractor algorithms at the request of the Supervisor.
  • Web Server (429): The server dedicated to running Forms, Reports, Java Server Pages, and serving Java applets for user interfaces.
  • Browser Clients (431): Any number of individual computers that run a web browser of some kind to display HTML or run Java applets.
  • In a specific embodiment, the system's Oracle8i instance runs on a specific server. This Oracle8i instance contains all the production data from automated system's operations. It runs a single instance 431 of Oracle8I that includes three optional subsystems: the JServer application server 433, the Advanced Queuing option 435, and the interMediaImage option 437.
  • The Oracle8i instance 431 was structured as a high-availability Oracle8i system with full server optimization and hot backup. The server runs continuously day-in and day-out to provide data services to all database clients.
  • The JServer application server on the CMTRXPRD instance runs one or more containers of entity beans, EJBs that support persistent data objects (Objects.jar 439). These beans provide data management interfaces for all the objects in the database. A Java client of this application server requests a handle to a particular persistent object from the server through an RMI/IIOP connection. The server instantiates it as required and passes the data back. These objects can be simple objects such as cell lines or task models, or complex objects representing extensive queries of the database. In particular, the queries required to run an algorithm on a Feature Extractor and to save extracted results are entity beans on the server.
  • The Advanced Queuing option provides a messaging middleware solution. Messaging middleware allows networked nodes to communicate with one another by passing messages with embedded objects. The Oracle8i Advanced Queuing version adds persistence to this functionality, allowing the message queue to persist even across major server outages. It is simpler to implement but does not have all the features of a remote invocation system such as CORBA or EJB, however.
  • The interMediaImage option provides storage and retrieval services for biological images. The image database will incorporate table partitioning, an Oracle8i feature that allows one to partition a table physically by the data in the table. In one case, the partition is by date, adding one partition each week. After creating the new week's partition, one can take the prior week's partition offline and delete the file after archiving it.
  • The Supervisor 426 coordinates feature extractor activities and also provides data to a process status display 471. In an implemented embodiment, the Supervisor is an NT Service.
  • The Supervisor communicates with the Feature Extractors through the Oracle8i Advanced Queuing message queue. This enables the Feature Extractors to poll for tasks to perform, distributing tasks in a fair way across the Feature Extractor Servers 427. As well, the Feature Extractor Servers 427 communicate their status through the message queue, sending notifications back to the Supervisor 426 when starting and finishing tasks or on demand (this is the job of an FE Listener 443).
  • The Supervisor accesses the Object.jar 439 entity beans through RMI/IIOP to access task and process data in the database.
  • The Feature Extractor Servers 443 are a group of servers, each of which performs identical functions in parallel. This allows the system to distribute image analysis functions over an arbitrary number of computers. Each server has an FE Listener 443 that polls the message queue for messages when the server becomes available for work. The Listener may be implemented as a Java application that is constantly running on the server. The Listener runs in a separate thread and continues polling after starting a task thread; this permits the Listener to (1) run multiple tasks on the single server and (2) to accept requests for status from the Supervisor and respond (for example, the Supervisor may request acknowledgement from the server to check whether it is alive).
  • In a specific embodiment, the listener calls a Java object in an FE.jar file 447 to run an algorithm task. The object assembles the input data by calling an EJB on the CMTRXPRD server 425 using RMI/IIOP. It then passes the data to a MatLab interface 449 (a C++ class accessed through the Java Native Interface (JNI)) and calls a MatLab script 451 running in a MatLab server executable 453. Non-MatLab algorithms may also be employed and various embodiments have been implemented outside MatLab. The script 451 returns result data to the bean, which then calls another EJB on the CMTRXPRD server 425 using RMI/IIOP to store the result data in the database.
  • The Web Server 429 is a machine dedicated to running the Internet Information Server and several other software components that support most of the user interface components of the automated system. In a specific embodiment, the server includes one or more of the following:
  • Hardware Status Monitor 473.
  • Internet Information Server (455): The standard web server that comes with, for example, Microsoft Windows NT.
  • Forms Server 61 (457): The Oracle Forms server for displaying forms applications (LabRat/StatRat data entry and query forms); this works through a set of HTML pages 459 that run the Forms applet with a particular Forms executable (FMX) file 461, with HTML and executables both stored in web server virtual directories.
  • Reports Server 61 (463): The Oracle Reports server for displaying reports 465 in HTML or PDF format (failure, defect, and opportunity reports); the report executables are in another web server virtual directory.
  • Tomcat/Jakarta (467): The Apache implementation of Java Server Pages, the web HTML generation component that works with EJBs to create interactive HTML displays in a web browser. This is also used for presentation of analytical results in the CytoAnalyst 469.
  • Automated Data Analysis Manager (StatRat)
  • The automated data analysis manager (“StatRat”) is the system component that manages the automated data analysis process. In involves the Supervisor and Feature Extractor subsystems introduced above. This process analyzes images produced by the imaging process and then extracts features from the image analysis through statistical and other kinds of algorithms. Examples of such algorithms are described in U.S. patent application Ser. No. 09/888,063 (filed Jun. 22, 2001), U.S. patent application Ser. No. 09/729,754 (filed Dec. 4, 2000), U.S. patent application Ser. No. 09/789,595 (filed Feb. 20, 2001), U.S. patent application Ser. No. 09/792,012 (filed Feb. 20, 2001), and U.S. patent application Ser. No. 09/792,013 (filed Feb. 20, 2001). Each of these documents is incorporated herein by reference for all purposes.
  • Some of aspects used to characterize image analysis algorithms used with this invention will now be described.
  • The term “component” or “component of a cell” refers to a part of a cell having some interesting property that can be employed to derive biologically relevant information using image analysis algorithms of this invention. General examples of cell components include biomolecules and cellular organelles. Specific examples of biomolecules that could serve as cell components for use with this invention include proteins, lipids, polysaccharides, proteins, etc. Sometimes, the relevant component will refer to a group of structurally or functionally related biomolecules. Alternatively, the component may represent a portion of a biomolecule such as a polysaccharide group on a protein, or a particular sequence of a nucleic acid or protein. Collections of molecules such as micells can also serve as cellular components for use with this invention. And subcellular structures such as vesicles and organelles may also serve the purpose.
  • The term “marker” or “labeling agent” refers to materials that specifically bind to and label cell components. These markers or labeling agents should be detectable in an image of the relevant cells. The image analysis algorithms of this invention often operate on images of markers or images highlighting the locations of markers. Typically, a labeling agent emits a signal whose intensity is related to the concentration of the cell component to which the agent binds. Preferably, the signal intensity is directly proportional to the concentration of the underlying cell component. The location of the signal source (i.e., the position of the marker) should be detectable in an image of the relevant cells.
  • Preferably, the chosen marker binds indiscriminately with its corresponding cellular component, regardless of location within the cell. Although in other embodiments, the chosen marker may bind to specific subsets of the component of interest (e.g., it binds only to sequences of DNA or regions of a chromosome). The marker should provide a strong contrast to other features in a given image. To this end, the marker should be luminescent, radioactive, fluorescent, etc. Various stains and compounds may serve this purpose. Examples of such compounds include fluorescently labeled antibodies to the cellular component of interest, fluorescent intercalators, and fluorescent lectins. The antibodies may be fluorescently labeled either directly or indirectly.
  • The term “stimulus” refers to something that may influence the biological condition of a cell. Often the term will be synonymous with “agent” or “manipulation.” Stimuli may be materials, radiation (including all manner of electromagnetic and particle radiation), forces (including mechanical (e.g., gravitational), electrical, magnetic, and nuclear), fields, thermal energy, and the like. General examples of materials that may be used as stimuli include organic and inorganic chemical compounds, biological materials such as nucleic acids, carbohydrates, proteins and peptides, lipids, various infectious agents, mixtures of the foregoing, and the like. Other general examples of stimuli include non-ambient temperature, non-ambient pressure, acoustic energy, electromagnetic radiation of all frequencies, the lack of a particular material (e.g., the lack of oxygen as in ischemia), temporal factors, etc.
  • Specific examples of biological stimuli include exposure to hormones, growth factors, antibodies, or extracellular matrix components. Or exposure to biologics such as infective materials such as viruses that may be naturally occurring viruses or viruses engineered to express exogenous genes at various levels. Biological stimuli could also include delivery of antisense polynucleotides by means such as gene transfection. Stimuli also could include exposure of cells to conditions that promote cell fusion. Specific physical stimuli could include exposing cells to shear stress under different rates of fluid flow, exposure of cells to different temperatures, exposure of cells to vacuum or positive pressure, or exposure of cells to sonication. Another stimulus includes applying centrifugal force. Still other specific stimuli include changes in gravitational force, including sub-gravitation, application of a constant or pulsed electrical current. Still other stimuli include photobleaching, which in some embodiments may include prior addition of a substance that would specifically mark areas to be photobleached by subsequent light exposure. In addition, these types of stimuli may be varied as to time of exposure, or cells could be subjected to multiple stimuli in various combinations and orders of addition. Of course, the type of manipulation used depends upon the application.
  • The term “phenotype” generally refers to the total appearance of an organism or cell from an organism. In the context of this invention, cellular phenotypes and their representations in processing systems (e.g., computers) are particularly interesting. A given cell's phenotype is a function of its genetic constitution and environment. Often a particular phenotype can be correlated or associated with a particular biological condition or mechanism of action resulting from exposure to a stimulus. Generally, cells undergoing a change in biological conditions will undergo a corresponding change in phenotype. Thus, cellular phenotypic data and characterizations may be exploited to deduce mechanisms of action and other aspects of cellular responses to various stimuli.
  • Often an image analysis algorithm produces “quantitative phenotypes.” These are multivariate phenotypic representations of the cell(s). They include various features of the cell(s) obtained by image analysis. Such features often include basic parameters obtained from images (e.g., cell shape and size, nucleus area, Golgi texture, concentration distribution of particular biomolecules within the organelle, etc.) and/or biological characterizations derived from the basic parameters (e.g., cell cycle state, mitotic index, etc.). Other attributes include changes in a migration pattern, a growth rate, cord formation, an extracellular matrix deposition, and even cell count. The multiple cellular attributes or features of the quantitative phenotype can be collectively stored and/or indexed, numerically or otherwise. The attributes are typically quantified in the context of specific cellular components or markers.
  • Sometimes, the quantitative phenotypes are represented by stimulus response curves that show a change in the quantitative phenotype in response to stimulus. One or more algorithms used with this invention provide this function. The quantitative phenotypes may themselves serve as individual points on response curves. A phenotypic response to stimulus may be characterized by exposing various cell lines to a stimulus of interest at various levels (e.g., doses of radiation or concentrations of a compound). In each level within this range, the phenotypic descriptors of interest are measured to generate quantitative phenotypes associated with levels of stimulus. Such curves may be compared (by algorithms used with this invention) to allow classification of stimuli and identify subtle differences in related stimuli. To facilitate the comparison, it may be desirable to present the response curves in a principal component space.
  • The automated data analysis manager is arranged to provide a stable, automated analysis process that provides timely, accurate analytical data on experiments for presentation and further data analysis. It enables the application of image and data summary analysis algorithms to input images, execute the analysis transactions and save all the results of those transactions to a database (e.g., an Oracle database). Each server processes a transaction comprising a minimal set of operations in the overall analysis sequence, optimizing parallel processing where possible to improve performance throughput.
  • In operation, the automated data analysis manager first determines whether there are input images to the system. If necessary, it preprocesses the images into an appropriate format and location, then notifies a data analysis server group that image analysis can start. Each analysis transaction results in a “results data set” in the database. Transaction data dependencies can result in input data from prior transactions read from the database as input to a new transaction.
  • The StatRat system actors are both human and automated. They are illustrated in a use cases figure, FIG. 5. Automated Supervisor (501) is the software system that uses the automated data analysis manager (StatRat) to initiate and control analysis jobs. Automated Feature Extractor (503) is the software system that accepts assigned jobs and executes a transaction. An Automated Image Loader is the software system that monitors image analysis processes, moves files to a standard location, and updates the status of those processes when they are complete. System Operator (507) is the person who starts and monitors the status of the automated supervisor and automated feature extractors. Developer (509) is the person who develops and tests feature-extraction algorithms. Experimental Database (511) is the production (or development production) database containing experimental data and extracted features. Development Database (513) is the database containing the experimental test bed against which developers run integration and system tests.
  • The automated data analysis manager contains a range of use cases distributed among the various actors.
  • An analysis object is one of several kinds of process elements that a data analysis process may treat as the thing to process. Examples of process elements that may be handled include the following: an experiment, an assay plate, a well group, a treatment, a treatment well, a well image, and a cell. The Analyze Object use case begins with a request to a group of Automated Feature Extractors to begin processing the object. Any Extractor that is a member of the group may receive the message and process the request. If there are any process or data dependencies for a process, the process model that generated the process should include other processes that structurally represent those dependencies. Marking composite processes as sequential ensures that the dependent process does not proceed until the other processes are complete.
  • A Maintain Process Model use case 517 discussed below provides details on the analysis process object and how it works to describe a sequence of algorithms and dependencies between them.
  • A sequence of the Analyze Object use case for executing an algorithm is depicted in the interaction Table 1.
    TABLE 1
    Actor System
    Read an analyze message Extract the algorithm
    to a current Extractor task and analysis object
    group from the message from the message.
    queue.
    Gather data inputs and Query task inputs and
    parameters. parameter arguments as
    required by the
    algorithm.
    Run the algorithm, passing Run the algorithm.
    in inputs and parameters.
    Save the analysis results to Save the features and
    the Experimental Database. commit.
    Send a finished-task End the use case.
    message to the Supervisor
    to report that the analysis
    task is complete.
  • Various extensions on the Analyze Object use case interaction may be implemented. Some of them follow.
  • Extension 1: If the algorithm task fails to execute and raises an exception, log the error message to the Experimental Database, identifying the Extractor and the algorithm program that failed. Notify the Supervisor with a cannot-process-request message for the task, including the Extractor and program names with the error message. The Supervisor will set the task status to Broken.
  • Extension 2: Image Analysis performs all the tasks relating to production of MatLab MAT files from images (image input, MAT file output, no database output) for a given plate. The algorithm looks in the database for images to analyze and reads the images from their standard location on disk.
  • Extension 3: Montage Production produces a montage of well images for a given plate (image input, image output, no database output). The algorithm looks in the database for images to analyze and reads the images from their standard location on disk.
  • Extension 4: Summary Analysis performs statistical analysis on DNA and Golgi markers for a given plate, producing summary data in the database (MAT file input, database output to Features table) for that plate. The algorithm looks for MAT files for input; there is no input from the database of any kind. The algorithm produces features in the database, saving them to a single Features table.
  • A Convert Old Data to New System use case 519 converts data from the previous version(s) of the system database to the current version. This may involve some gaps in information, as the current schema sometimes expands the amount of information about many or all aspects of the system.
  • Automated Feature Extractor 503 is an image analysis system actor that runs an algorithm as part of an analysis process. In a specific implementation, the Automated Supervisor sends messages through a message queue to Feature Extractor actors to perform analysis tasks (pieces of an analysis process). The scalability of this system depends on having the ability to assign tasks to available Feature Extractors. Feature Extractors should be able to maintain individual servers without disrupting overall system processing. Also, they should be able to allocate certain servers by date and time or to allocate servers to special projects. All of these requirements are satisfied by the concept of Feature Extractor groups, collections of Feature Extractor servers that share status. An Extractor may belong to more than one group at any given time. The Supervisor then gets requests including the group identifier to assign analysis processes to a specific group of Extractors.
  • In a Group Feature Extractors use case 521, the System Operator creates, modifies, or removes a group of Feature Extractors in the Experimental Database through the Automated Supervisor. The use case also is the place where one can add, modify, or remove Feature Extractor objects in the Experimental Database 511.
  • Suitable processes of the Group Feature Extractors use case are depicted in Table 2 below.
    TABLE 2
    Actor System
    Add a new group of Feature Insert any new servers (name,
    Extractors, supplying a list description) into the
    of existing and/or new Experimental Database. Update
    servers as well as a group any modified server names or
    name and description. descriptions in the database.
    Insert the new Feature Extractor
    Group name and description into
    the database. Add the new
    servers to the new group.
    Remove the existing servers
    from their current group (if any)
    and add them to the new group.
    Commit the changes.
    Modify a group by Modify the name or description
    modifying the name or of the group in the Experimental
    description or by adding or Database. Insert any new servers
    removing servers. (name and description) into the
    database, then add them to the
    modified group. Remove any
    existing servers from their
    current group and add them to
    the modified group. Remove any
    servers marked for removal from
    the modified group (they then
    have no group). Commit the
    changes.
    Move a server from one Remove the server from its
    group to another. current group and add it to the
    target group. Commit the
    changes.
    Remove a server from a Remove the server from its
    group. current group. Commit the
    changes.
    Remove a server from the Remove the server from its
    system. current group and from the set of
    Feature Extractors in the system.
    Commit the changes.
    Remove a group from the Remove any servers from the
    system. group. Remove the group from
    the system. Commit the changes.
    Create a time slot for the Save the start and end times for
    feature extractor group. the group to the database.
    Commit the changes.
    Query time slots for the Query the group time slots and
    current feature extractor display the start and end time
    group. (and other data depending on the
    kind of time slot).
    Remove a time slot from the Remove the time slot from the
    current set of slots for the group. Commit the changes.
    current feature extractor
    group.
  • An algorithm is an independent system that accepts inputs, processes the inputs, and produces results. Generally, the StatRat (the automated data analysis manager system) is able to provide a platform for executing algorithms and storing their results in a database. Another part of this mission is to enable developers to maintain their algorithms within the automated data analysis manager.
  • Developers can make available several versions of an algorithm. In a preferred embodiment, the system can employ versioning to add the version to a list of supported algorithms rather than actually replacing an algorithm. Parameter lists typically belong to the version, not to the algorithm.
  • Maintaining an algorithm (use case 523) may have various aspects such as the following: adding a new algorithm to the automated data analysis manager; removing an existing algorithm version from the automated data analysis manager; versioning an algorithm; changing an algorithm's name, purpose, or parameter set. The parameter list typically includes input parameters. Input parameters are those that the driver for the algorithm collects together and passes to the algorithm. Output parameters are those that the algorithm returns; see the Analyze Object use case for result storage.
  • Regarding the Prepare Image for Analysis use case 532, an Image Loader monitors the status of imaging tasks within an experiment to find any that require file movement services or that require status updating. Ultimately, the Image Loader marks an imaging task Complete, which informs the Supervisor 501 that analysis tasks can now begin.
  • An imaging task is a task generated from a specific Task Model object in the automated system database (a pre-allocated process model ID). The Image Loader uses this ID to find imaging tasks. Some processes of the use case are depicted in Table 3.
    TABLE 3
    Actor System
    Query the wells on plates Return a result set of
    that are process elements for wells.
    imaging tasks with status
    Started or Restarted where
    the wells have no associated
    well image files registered in
    the database.
    For each well, check whether Return files.
    the microscope has produced
    one or more required image
    files.
    For each file, copy the file to Copy the file and
    its standard location and update the database
    update the database with the with the file and its
    file. location (WellImage
    table). Commit the
    transaction.
    On completing the last well Updated the task status
    for a plate, update the status to Completed.
    of the corresponding task to
    Completed.
    End the use case. Complete the
    transaction.
  • The Automated Supervisor 501 can monitor the Feature Extractors to enable status reporting to the System Operator 507 and to facilitate control of analysis processes. A Monitor Feature Extractor use case 525 enables the Query Process Status use case 527, which displays status information to the System Operator 507.
  • In one implementation, there are three situations in which the Supervisor requests status from the Extractor. (1) After an Extractor sends a message that it has started a task and a designated time passes without a message completing the task, the Supervisor requests an acknowledgement from the Extractor that it is still alive. (2) After a designated time passes with no messages at all from an Extractor in the active extractor groups, the Supervisor requests an acknowledgment. (3) At the request of the System Operator, the Supervisor immediately requests an acknowledgment from a group (or all groups) of Feature Extractors. In this embodiment, if no acknowledgment is forthcoming, the Supervisor marks the Feature Extractor(s) as dead. If the Extractor responds with the name of the current task, the Supervisor marks the Extractor as busy. If the Extractor responds with a ready message, the Supervisor marks the Extractor as Ready.
  • This Supervisor and Extractor can be designed so that changing the status of the Feature Extractor does nothing whatever to change the control flow of the system. It is purely for the status display through the Process Monitor. For example, if one sees a dead Extractor and go and reboot it, the Extractor will eventually pick up the message requesting acknowledgment and respond, changing the status back to ready.
  • When the Supervisor receives a “starting-process” or “finished-process” message from the Extractor, it marks the Extractor as busy or ready, respectively. Table 4 below shows some processes of this use case.
    TABLE 4
    Actor System
    Request status from Enqueue a message to
    one or more Feature the Extractors
    Extractors if any of the requesting status.
    situations 1-3 is true.
    Receive a message Receive the message.
    from the message
    queue addressed to
    Supervisor.
    End the use case. Commit the
    transaction.
  • Regarding the Process Analysis Request use case 534, to initiate a process, the Automated Supervisor 501 queries all active processes from the database and determines which Algorithm Tasks are ready to run. The Automated Supervisor then sends messages to Automated Feature Extractors run the task, sending the task ID as the body of the message.
  • In a Process Extractor Notification use case 529, the Automated Supervisor 501 receives a message from an Automated Feature Extractor through the message queue notifying the Supervisor of the starting or completion of an assigned task by an Extractor. The Automated Supervisor then updates the process status in the status list and the database and (for a finished-task message) and updates the status of any processes waiting on the completion of the first process.
  • Note that this use case shares some processes with a Monitor Feature Extractor use case 531, which handles special acknowledgment notification in addition to standard starting-task and finished-task messages.
  • The System Operator 507 may need to know the status of the analysis processes for all active processes as well as the current status of all Automated Feature Extractors and the Automated Supervisor 501. The Query Process Status use case 527 presents this information to the System Operator 507 through the Process Monitor in this example.
  • Table 5 below shows some processes of this use case.
    TABLE 5
    Actor System
    Query active processes Display a list of active
    from the database. processes, listing all active
    tasks and their Feature
    Extractors and a list of all
    queued tasks waiting for a
    free Extractor. Display a
    list of Feature Extractors
    with status (ready, busy,
    dead). Display a list of
    process requests waiting
    for processing (not yet sent
    to the message queue as
    tasks).
    Update the status of a Update the task status.
    Waiting task to Ready,
    subject to process
    status requirements.
    Update the status of a Update the task status.
    Broken task to Ready,
    subject to process
    status requirements.
    Update the status of a Update the task status.
    Started task to Broken.
  • After completing automated analysis, the Operator 507 may want to look at the data to investigate results. A Query Results Ad Hoc use case 533 lets the Operator get information from the Experimental Database based on queries in a standard query language. Preferably, the database should be available from the standard analytical tools used to post-process the results so that the Operator can perform exploratory data analysis on the data.
  • This need may be satisfied through a combination of the SQLPLUS query tool from Oracle (or comparable tool) and the ODBC interface for getting data into standard tools.
  • A unit test (use case 535) tests a program unit (module, class, function, or whatever) in isolation. The objective of a unit test is to make the unit fail until achieving some coverage criterion such as branch coverage (all paths through the test model executed at least once) without failure. Test models are usually white-box models that model the actual code structure, such as control-flow diagrams or data-flow diagrams, and coverage usually means testing all paths through such diagrams.
  • The automated data analysis manager has as part of its mission assisting developers in testing their algorithms. The system therefore provides use cases for the common types of test and features that enable such testing. For a unit test, the automated data analysis manager provides a way to run an algorithm in isolation from both the database and the rest of the system, preferably in the developer's environment away from the running production or development system running as a whole. The automated data analysis manager runs the test suite (a collection of test cases) and puts the results into the Development Database.
  • Note that there are many different test framework architectures that can be used to provide the test system. Ideally, developers would be able to build their own test suites and result saving code. Other possibilities exist, however, including automatic test suite generation and custom test script development services by a dedicated test group.
  • An integration test (use case 537) tests a subsystem working as an integrated whole. The objective of an integration test is to make the system fail by combining the subsystem elements, focusing on relationships between elements (including use of the database), until achieving some coverage criterion such as branch coverage. Missing parameters, invalid data passed to another function, and violated database constraints are all examples of such errors. Test models are usually black-box models that model the function of the subsystem, such as a state-transition diagram, but also calling-tree graphs showing what elements use what other elements and what assumptions are made for each relationship.
  • For an integration test, the automated data analysis manager provides a way to run an algorithm or an analysis process as a complete process isolated from other subsystems. That is, you should be able to execute an algorithm test suite with full input and output processing from the database and assuming appropriate data exists as it would in the real system. The Run Integration Test use case thus executes test suites comprising a set of transactional use cases such as Analyze Well or Analyze Experiment with the designated algorithm or package as the result. The use case encapsulates any results that move outside the subsystem under test, however, such as messages queued to start other processes and so on.
  • Exemplary processes of this use case are depicted in Table 6.
    TABLE 6
    Actor System
    Start an integration test Run the test suite, supplying any
    suite. required data for the test
    environment and trapping any
    outputs to other subsystems.
    Store the test results in the
    Development Database.
    Query the test results. Display the test results.
  • A system test (use case 539) is the combination of an integration test for the automated data analysis manager as a whole plus a series of test suites designed to test system capabilities. The objective of the system test is to make the system fail by exposing it to situations likely to make it fail (crashing a server, running a large number of analyses at once, and so on). Test models for system testing are typically black-box tests of functionality at the level of use cases in this document. The system test may verify that all use cases in this document can execute without failure, covering the requirements for the system.
  • For a system test, the automated data analysis manager should be able to run in a controlled environment that allows testers to structure the test suites designed to make the system fail. Usually this entails a complete environment mirroring production but with a specially constructed database and sequence of user operations, often run as automated system test scripts.
  • Preferably, there are two kinds of analysis scheduling (use case 541) in the automated data analysis manager. The Experiment Database 511 scans for images that are ready to process and automatically initiates processing on ready images. Alternatively, the System Operator 507 may want to restart an interrupted analysis, reprioritize analyses, or do a special analysis on an object (experiment, plate, well group, well, or well image). When this is the case, the Operator schedules the analysis by queuing it in the analysis task queue manually to start as soon as possible or at a given date and time. The Operator specifies the analysis object, an analysis process model, and an optional Feature Extractor group. If the Operator does not specify an Extractor group, the system uses the default Extractor group.
  • The Operator may query the scheduled analysis tasks in the queue and prioritize or remove them. Processes of the Schedule and Prioritize Analysis use case 541 are depicted in Table 7.
    TABLE 7
    Actor System
    Set up an analysis process Send a message to the
    execution by entering the Automated Supervisor to
    analysis object start an analysis process.
    (experiment, plate, well The message includes the
    group, or well). analysis object, the process
    Optionally, specify any of model, the arguments
    the analysis process (default to default
    model, process parameter arguments), the group
    arguments, Feature (default to default group),
    Extractor group, priority, the priority (default to
    or the date and time to group priority), and the
    queue the process for target execution date and
    execution. time.
    Refresh the current Request the Supervisor to
    display of scheduled send and display a list of
    analysis processes. currently queued analysis
    processes (object, process,
    parameter arguments,
    extractor group, priority,
    and queue timestamp).
    Change any of the parts of Modify the task in the
    the analysis process queue, adjusting priority
    (object, process, position as required.
    parameter arguments, Generate the relevant
    extractor group, priority, extractor request(s) for the
    and queue timestamp). modified task.
  • Process Generator Design
  • The Process Generator subsystem is preferably a standalone subsystem that generates processes from process models.
  • This subsystem implements certain use cases. A Model Experimental Process use case builds process model graphs. A Maintain Experiment use case creates an experiment process from an experiment process model. A Generate Processes use case generates composite processes and tasks under the experiment process model.
  • The Model Experimental Process use case describes the modeling of experiments: An experimental process model is a tree hierarchy of composite processes and tasks that represent the elements of the experimental process that we want to track in terms of start and end dates.
  • The Composite pattern organizes trees in terms of abstract base classes, composite collection node classes, and leaf classes. Composite classes group composites and leaves, resulting in a recursive tree structure. (See for example, Gamma et al., Design Patterns, Addison-Wesley, 1995, and R. Muller, Database Design for Smarties, Morgan Kaufmann Publishers, 1999 (both incorporated herein by reference) for details of this pattern.)
  • The Composite Process Model orders its children Process Model objects. This ordering permits the ordered, sequential execution of algorithm tasks and represents the process (and data) dependencies of the analysis process. Each composite has a control flag that specifies sequential or parallel execution. Sequential execution tells the system to run the children in order. Parallel execution tells the system to run the children in parallel. One can thus design experiments that have both sequential tasks and tasks that may run parallel to one another. As well, one can query and reuse any process model as a child of more than one parent, which lets you reuse subprocesses in several different experiment models.
  • As well as specifying the parallel versus sequential execution of the tasks, the process model also specifies an iteration structure based on the relationship of the objects that are the target of the process. Experiments are collections of plates (or other experiments, composite experiments). Plates are collections of wells. Wells are imaged to produce some number of images per well, and there may be some number of cells in each well or image. This hierarchy lets the process model automatically generate tasks for the appropriate objects. For example, if you process an experiment, and one subprocess is at the plate level, the model generates one subprocess for each plate that belongs to the experiment.
  • In a specific embodiment, one can track process execution through the processes that the model generates and their start and end dates. One can add feedback about the processes through the Logged Comment class in the Feedback subsystem; every subclass of System can have logged comments. See the Failure Tracking System use cases below for details of logging and failure tracking for processes and other reusable systems.
  • FIG. 6A illustrates the processing logic associated with a sample laboratory experiment process model. A tree 601 possesses 3 composite process models (603, 605, and 607) and 7 task models (609, 611, 613, 615, 617, 619, and 621, excluding the Alpha Analysis Model structure).
  • A typical Process experiment model 623 runs four subprocesses. (1) Initializing the experiment 603 by creating the cell lines 611 for the experiment (a task model here, per experiment) and, in parallel, by creating the daughter treatment plates 609 for the experiment (a task model here, per experiment). (2) The standard automation process 605 for all plates in the experiment, a composite process model for the experiment with four task models underneath it that run sequentially, one for each plate in an experiment. (3) The standard imaging process 621 (per well) for all plates in the experiment is a task model here. (4) The Alpha Analysis Model 607 is provided as one for each experiment.
  • When the database creates a process tree from this structure, it sets the status as appropriate. For example, a tree 631 in FIG. 6B represents the process tree generated from the above model:
  • The composite process models generate composite processes, and the task models generate tasks. The Experiment Composite Model generates an Experiment Process. The Add Chemical Task Model 617′ generates an Add Chemical Task. Where a model is at a different level from the process element, the model generates multiple processes or tasks at the appropriate object level. For example, the process element is an experiment, but the Standard Imaging task model 621′ is at the well level, so the model generates one imaging task per well in the experiment. Similarly, as the Method 0 task model 613′ is at the plate level, the model generates one Method 0 per plate.
  • The Initialize Experiment process model 603′ is marked as parallel. Therefore, both of the children tasks become ready to run. Since the Standard Process model 623′ is sequential, however, the children of the Standard Automation process 605′ are waiting, not ready. The experiment initialization should complete before any standard automation can begin. One implication of this model is that all the plates need to go through Method 0 before any of them can start Method 1.
  • When a model has a level lower than the one above it, it means the Process Generator must create multiple processes for the single model node. No child model of that model may have a level higher than the one for that model. That is, as one goes down the tree, if one moves to finer levels of granularity, one has to stay at that level of granularity. Also, if a model generates multiple processes, its children generate at least one process linked to each of those processes. This situation reflects a desire to limit sequential processing to the process element rather than to the entire process step. For example, if Standard Automation in the above example were at the plate level instead of the experiment level, there would be one Standard Automation composite process for each plate and one each of the four subprocesses for each plate. When these processes run, the composite process for each plate completes in parallel with that for all the other plates, and one needs only complete each process for the single plate to move on to the next one in sequence for that plate. The example above forces all plates to go through Method 0 before any plate can go through Method 1 because the composite process is at the experiment level rather than at the plate level.
  • Preferably, process generation works on an as-required basis (just-in-time process generation). Process generation generates only those processes next in order in processing sequence. Process generation takes into account the model element level and the process element type for the process (an experiment, usually) by generating the correct number of processes for the process element (all the wells on all the plates in the experiment, for example). It also generates all processes under a composite process marked as parallel. Sequential composite processes generate their children one at a time in sequence as the processes end. As each Process is generated the attribute childSequence is set as obtained from the parent Process as an incremented index.
  • In one implementation, the Process Generator architecture rests on top of an array of persistent schema subsystems. The Process Generator itself is preferably a stored program unit (a package) residing in the database. The Oracle8i job queue runs the process generator periodically (e.g., once every fifteen minutes) to ensure the rapid generation of processes from models and experiment designs.
  • Process Monitor Subsystem
  • A process monitor subsystem provides a graphic user interface (GUI) to display status of the algorithm analysis processes, and to enable the users to modify the process's status as well.
  • In one embodiment, the look of the GUI is designed similar to that of the Window Explorer. The hierarchy relationship of process data is displayed in a tree control at the left side, and the detailed information for the process data are shown in a tabular format at the right side. There are several buttons on the GUI to let users send commands, and a context sensitive popup menu for the same purpose as well.
  • In this embodiment, the process monitor may be a standalone Java application. It supports multi-user environment. The user is able to send a command to fetch and view all the related processes data, and to send another command to commit the modifications he/she has made for the processes data. Data concurrency and consistency are handled at application level. In another embodiment, the process monitor runs in a standard web browser, and the applet may interact with servlets running on the web server to access database for status display or modification. Preferably, the Process Monitor subsystem contains all the code required to view and modify the analysis process data.
  • Supervisor
  • The Supervisor subsystem is an automatic process execution control system for the experiment process. The Supervisor sends task requests to different task executors implemented for the experiment process. The execution path begins with a predetermined top-level composite process, runs each of its child processes or tasks either in ordered sequential or in parallel depending on the rules specified for the parent process.
  • In one embodiment, the supervisor is able to support two kinds of task executions. The first is an algorithm task proxy executor that runs algorithm tasks through the message queue subsystem. The second is an image loader that loads well image files generated by the imaging station to the database. The first is implanted inside the supervisor as an internal package, and the second is imported as an external package.
  • For the algorithm task proxy executor, its main functionality is sending algorithm task requests to feature extractor servers through the message queue and taking care of message notifications from feature extractor servers. Depending on the returned status and execution history for a particular algorithm task, the supervisor can either change the status of the algorithm task and update its corresponding entries in database, or it can re-send the algorithm task under certain circumstances. There may also be a housekeeping routine running in the algorithm task proxy executor that periodically checks the status of started algorithm tasks to ensure that all the tasks are still running on their associated feature extractor servers, or it may re-send the task if the feature extractor which originally started the task is not responsive.
  • For the image loader, the supervisor simply invokes the image loader to carry out an image-loading task as it encounters an imaging task along its process execution path. Preferably, the Supervisor subsystem contains all the code to run the algorithm analysis tasks on a group of feature extractor servers and to initiate image-loading tasks.
  • In one embodiment, depicted in FIG. 7, a Supervisor subsystem 701 comprises three parts. They are a ProcessTree package 703, an AlgorithmTaskProxyExecutor package 705, and a ProcessExecutor package 707.
  • The ProcessTree package 703 contains classes that deal with getting process data from database, storing process data in memory, creating process nodes, linking process nodes to the process tree, running processes or tasks, and updating process status to the database. It interacts with the AlgorithmTaskProxyExecutor 705 to run the algorithm tasks and invokes an ImageLoader subsystem 709 to run the image-loading tasks. The ProcessTree package uses persistent objects from the Configuration subsystem (composite processes, tasks, and experiment processes) and their corresponding process models.
  • The AlgorithmTaskProxyExecutor package 705 contains classes that deal with dispatching analysis tasks to feature extractor servers, listening for responses from feature extractor servers, and tracking the started tasks. To this end, it employs a MessageQueue 711.
  • The ProcessExecutor package 707 contains classes that deal with building a top-level process tree for a particular Supervisor, instantiating task-related objects, running the process tree, and starting the Supervisor as a NT service, for example.
  • Feature Extractor
  • In accordance with preferred embodiments of this invention, a Feature Extractor is a server that provides task execution services to the automated system. The system has any number of FeatureExtractor servers running on various servers around an enterprise. The servers may be dedicated servers and/or individual workstations running extractors in off hours.
  • In one embodiment, the Feature Extractor uses four message queues, all implemented with Oracle Advanced Queuing:
      • Task Request: messages to the Server requesting that a task be run
      • Task Response: messages from the Server giving task status after completion
      • Ping Request: messages to the Server requesting task status
      • Ping Response: messages from the Server giving task status in response to a ping
  • In a specific implementation, the Feature Extractor has two components, a small NT service (FeatureExtractor Service) and a Java application (FeatureExtractor Server). The NT service is a C++ program that simply starts up the Java application, which then runs by itself until shut down by an operator.
  • The Feature Extractor Server has multiple threads, the main thread and a series of child threads. The main thread polls two message queues, one for incoming tasks and one for incoming pings (requests for status). These queues deliver a payload that contains the algorithm task id to run or query.
  • On receiving a task request through the Task Request message queue, the Server creates and starts a thread that uses the Algorithm subsystem to run an algorithm as structured by the database. When the thread completes, the Server sends a status message to the Supervisor through the Task Response message queue giving the status of the algorithm.
  • On receiving a ping through the Ping Request message queue, the Server figures out the current status of the algorithm that's running and responds with that status through the Ping Response message queue. Pings are handled entirely in the main thread, so the running algorithm never interferes with responding to a ping other than by consuming the CPU completely.
  • One architecture of a FeatureExtractor 800 is depicted in FIG. 8A. This architecture brings together all the elements required to run algorithms in an independent server, including message queue operations and algorithm processing.
  • A FeatureExtractor Service package 801 contains a small C++ program that runs as a Windows NT service. This service enables the Feature Extractor to start up automatically in a standard Windows manner. The service instantiates a FeatureExtractor Java application 803. The single parameter for the service is the name of the feature extractor, which it passes to the Java application on the command line. This name corresponds to a FeatureExtractor object in a FeatureExtractor schema 805 in the Oracle database.
  • The FeatureExtractor schema 805 in the database contains information about the Feature Extractor (name, date created, and so on). The names should be consistent with the FeatureExtractor Service name settings mentioned in the prior paragraph. The Process Monitor uses this information in its display of FeatureExtractor status.
  • The bulk of the Feature Extractor Server involves managing the four Oracle Advanced Queueing queues. A CoreAQOperation package 807 defines a set of base classes and an interface that comprise a reusable basis for specific messaging frameworks. A MessageQOperation package 809 is such a framework, providing factories and queues based on the Core package superclasses. A PayloadDataType package 811 provides a set of data types that one can use to send information through the StatRat queues. An Algorithm package 813 provides a complete system for running an algorithm task. The Algorithm Subsystem is described in more detail below.
  • FIG. 8B illustrates a very specific example process of running a task, an interaction in the FeatureExtractor system. This scenario assumes that the Server has already created the four message queues. The Feature Extractor Server first polls the Task Request Queue (queue in the queue array) by calling deQueue to get any requests to perform a task. While there is no algorithm work going on, this loop continues indefinitely until there is work to do.
  • On receiving a message, the Feature Extractor Server gets a TaskReqPayload object (downcast from Object). The Server extracts the integer system id of the requested algorithm task from the payload with getID( ). The Server then creates the task thread using the ID and starts the thread. The task creates the AlgorithmFactory object and runs the algorithm with the runAlgorithm method, passing in the systemID.
  • After starting the thread, the Server polls the thread in a loop asking whether the task is alive. When the algorithm finishes, the AlgorithmFactory object returns and the thread stops. At this point, the looping call to is Active will return false and the Server can proceed. The loop sleeps for 500 milliseconds between each iteration to conserve CPU resources.
  • After the thread stops, the server gets the status of the algorithm, a TaskStatus enumeration variable set by the algorithm in the task thread object (value will be Complete or Broken). At this point, the thread object is freed for garbage collection, which in turn frees the AlgorithmFactory object for garbage collection.
  • The Server then enqueues a message in the Task Response message queue (TaskResponseQ), telling the Supervisor what algorithm task has which status (systemID and status). At this point, the Feature Extractor Server resumes the iteration on the Task Request message queue looking for additional tasks to perform.
  • Algorithm Subsystem
  • The Algorithm subsystem enables the automated data analysis manager to run algorithms developed as MatLab scripts, C++ class function members, Java methods, etc. Often, these scripts or functions contain only algorithm code. All database and image inputs come through parameters to the script. The Algorithm subsystem contains Algorithm subclasses for each MatLab algorithm, InputData classes for each set of tabular inputs, ImageData classes for each image file input, and ResultData classes for each set of tabular outputs. Different algorithms may share inputs and/or results. Inputs and results are implemented Enterprise Javabeans, for example, residing on the Oracle database server, as both interact heavily with the database.
  • In a specific embodiment, the Algorithm subsystem uses a C++ version of the CDynArray MatLab data structure to use for tabular inputs and results. The Feature Extractor first activates an Enterprise Javabean based on a Supervisor message it receives. It then uses an Algorithm factory object to instantiate and run the algorithm. The Algorithm interfaces with the MatLab engine interface to run the script, passing in the parameters and getting back the results. After completing the algorithm, the FeatureExtractor frees the AlgorithmFactory object, which in turn frees all the other objects.
  • Preferably, the Algorithm subsystem contains all the code related to instantiating and running an algorithm on a Feature Extractor server. FIG. 9A presents a block diagram of the subsystem's architecture in accordance with one embodiment of the invention.
  • The Feature Extractor subsystem 903 imports the Algorithm subsystem 905 and starts a thread that accesses the AlgorithmFactory singleton object interface to run an algorithm. The factory in turn queries and activates an AlgorithmTask entity bean in an Analysis schema 907 that supplies details for the algorithm execution. The factory then creates the Algorithm object of the appropriate subclass and runs it, passing in the ProcessElement obtained through a ProcessElement subsystem 906. To run the algorithm, the Algorithm object either uses a C++ MatLab interface 909 to run a MatLab script, creating InputData 911 and ResultData 913 session beans to hold inputs and outputs, or it runs C++ or Java algorithms directly by querying and storing data. The MatLab script or C++/Java algorithm returns a return code and results. If the return code is not 0, the Algorithm object logs a failure in the database through a Failure subsystem 908; otherwise, it stores the results. The Algorithm and its AlgorithmFactory return the ultimate status to the caller. The Algorithm object ensures that the process only stores results once through the Process subsystem 910.
  • The main action in the Algorithm subsystem is the running of the algorithm. In very specific embodiment, the sequence diagram of FIG. 9B shows how this works.
  • The Feature Extractor instantiates the factory. The factory instantiates the algorithm task bean to get the process element (an interface for the various kinds of objects that a task may process) and the task arguments. Based on the algorithm name, the factory then instantiates the appropriate subclass of Algorithm, passing in the process element and the argument list.
  • The constructor for the Algorithm creates InputTable and InputImage session beans of the appropriate subclasses. InputTable objects in turn create an MatLabDynamicArray object and construct their internal data through database queries. The constructor then creates a ResultData session bean, which creates another MatLabDynamicArray object to hold the results. The Algorithm calls MatLab to bind the various arguments, including the returns, into the MatLab engine using the argument names or values passed from the AlgorithmTask.
  • The factory then runs the algorithm by calling the run method on the Algorithm object. This method starts the MatLab engine, binds in the input arguments, the input data array(s), the result data array, and the return code, all of which correspond to named elements in the command script (not shown explicitly for simplicity). The Algorithm then runs the command script.
  • Note that a TIFF image (WellImage table) is passed by the InputData object's constructing a temporary TIFF image file available to the server and passing the resulting path and filename as a string argument to the command script.
  • The script processes the inputs and produces an error return and a single dynamic array. The algorithm object checks the error and handles it as appropriate, raising an exception as required. Exception handling uses the Application Failure Logger subsystem to log the error to the database. It also handles the recovery logic, permitting the algorithm to control retries or other recovery processes.
  • If the return code is 0, it means the algorithm succeeded, so the Algorithm calls the store method on the ResultData array to pass the mxArray (internal MatLab array) to the ResultData entity bean for storage in the database. The bean stores the data and returns, and the Algorithm run method returns to the factory runAlgorithm method. The factory then frees the Algorithm object for garbage collection and returns.
  • Version Dependent Algorithm Launcher Design
  • The automated system processes comprise many algorithm tasks for processing data. Different versions of an algorithm may behave differently. Usually the latest version is the one that works best in most circumstances and is the one deployed to run the process. However, members of a group may need to run different versions of the algorithms through the system at the same time. For example, one may need to use different versions of data analysis algorithms to analysis the ever-increasing data sets to further test the algorithms themselves, or one may want to run a specific version of algorithm because we need the functions of that version.
  • As indicated, the feature extractor server is the algorithm task manager. It launches and/or stops algorithm tasks. The feature extractor server and the high-level algorithm routines are, in the specific implementation, all Java modules, while the low-level algorithm routines can be implemented in either Java or C/C++. In the case of algorithm modules implemented in C/C++, they may reside in Windows DLLs. Therefore, the basic question here is how to run different versions of algorithms in Java and indirectly from Windows DLLs in a dynamic way.
  • Usually when a Java virtual machine starts, it uses the default class loader (the system class loader) to load classes specified at the system class path. If two or more versions of Java classes with the same class name (package structure also the same) are specified at the class path, there is no way to tell the system class loader which one to load to run a specific version, the system class loader always loads the one it finds first on its class path. The same situation holds true for loading DLLs in Windows. The usual way to load a DLL is to put the DLLs in the search path of the system. If we put multiple versions of a DLL with the same name at the search path, Windows only loads the one it finds first on the search path.
  • To run different versions of Java program in a dynamic way, one can use customized class loaders to load and run different versions of algorithms. Java provides a standard way to load and run different versions of algorithms with the same class signature but at different file system or network locations. To use the feature extractor server to load and run different versions of Java algorithms, one needs to install a customized algorithm class loader for the feature extractor server. Therefore when the feature extractor server gets a request to run a specific version of an algorithm, it can be configured to figure out where the class files (or jar files) are located for the requested version, and then use the customized algorithm class loader to load and run the algorithm. In this way, the feature extractor server can run multiple versions of an algorithm either sequentially or in parallel in one JVM, using different instances of algorithm class loaders to load the classes.
  • In the case that Java algorithm needs to use a native (C++ or other natively compiled code) method to implement some of its functionalities, the customized class loader can also be instructed to load the version dependent DLL at a specific location. This DLL may be called the entry DLL for the Java algorithm. If this entry DLL depends on other version-dependent DLLs, and the dependencies can be chained to arbitrary depth, then one needs a mechanism to have those version-dependent DLLs finds and loads their dependent ones. There are a couple of ways to do that.
  • Dynamically loading DLLs is a preferred approach. The usual way to dynamically load a DLL starts with calling LoadLibrary with the DLL name as the parameter. However, one can also use LoadLibrary to specify the absolute path of the DLL's module, in this way we can load the DLL of the desired version with the same name but at different network location.
  • The following procedures apply to run multiple versions of algorithms with either Java or DLLs.
  • Put all Java classes (in either jar files or expanded folder structure) and DLLs for a particular version of algorithms in a network folder designed to hold that version's contents.
  • Put all versions independent Java classes and DLLs in a common network folder. Java classes and DLLs are registered with the CLASSPATH and PATH environment variables respectively.
  • In a configuration file, specify the mappings between algorithm versions and the paths that point to those versions.
  • The feature extractor server reads the configuration file when it starts. As it gets an algorithm task request for a specific version, it changes its working directory to the directory that corresponds to the required version. It then uses the algorithm class loader to load classes for that version, and it can also link and load the right version of DLLs down the chain.
  • The loading mechanism always tries to load Java classes or DLLs from the system standard path first. If the required module is not found, it then tries to load it from the version-tagged path.
  • Image Loader Subsystem
  • An image loader subsystem may be used as one of the task executors of the experiment process. It integrates the functionality of the imaging system into the experiment process. Specifically, it carries out the task of registering the well image files with the database so that these images can be traced and processed later.
  • In a preferred implementation, the image loader is an extension to the supervisor system. The supervisor simply invokes the image loader to carry out an image-loading task as it encounters an imaging task in its execution path.
  • When the image loader gets an imaging-loading task from the supervisor, it queries the database to get the information about the task. It then uses this information to build a filter to work only with the image files satisfying certain qualifying criteria. The image loader picks up the files, transfers them to a permanent depository and registers them with the database.
  • The image loader subsystem contains all the code related to run image-loading tasks. In another implementation, the Image Loader is a separate NT Service running on a separate machine, communicating with the Supervisor through a message queue.
  • As shown in the embodiment of FIG. 10A, an image loader subsystem 1001 interacts with four external packages. They are image files 1003, the AssayPlate schema 1005, Configuration packages 1007, and the supervisor subsystem 1009.
  • The image files 1003 generated by the imaging station have a fixed file name format that provides the necessary information for the image loader to work with the database. The filename is based on the combination of assay plate barcode, well name, site number, channel number and a prefix. For example, 00023558_B04_S1_W2.TIF means this image is for well B04 of assay plate with barcode 00023558 on site 1 and channel 2.
  • When the imaging station produces the files, it stores them in a specific image-dumping directory. The Image Loader moves the files from that directory into a network depository and registers the files in the database WellImage table.
  • The AssayPlate and Configuration packages 1005 and 1007 provide the database objects with which the image loader queries and updates information related to imaging task and well images.
  • As shown in FIG. 10B, the sequence diagram of the image loader is very straightforward. After creating an image loader object for an imaging task, the run function of the object calls several methods in a loop until all the file registration is finished.
  • Automated Laboratory Experiment Manager (LabRat) Use Cases
  • The automated laboratory experiment manager (LabRat) is the automated system component that manages the laboratory experimentation process. This process designs and constructs assay plates and shepherds them through the plating, washing, fixing and staining, imaging, and analysis process. The focus of the automated laboratory experiment manager is the assay plate and the experimental process as well as other, related processes. As indicated above, data analysis process has its own system, the automated data analysis manager. Important subsystems within the automated laboratory experiment manager are the failure and defect tracking processes.
  • The automated laboratory experiment manager (LabRat) aspect of the invention enables at least some of the following functions: the design of cell-line-based biological experiments on specific biological markers, the tracking and control of those experiments from plate creation through data analysis, the tracking and control of the inputs and infrastructure of the experimental process, and provision for product and process validation of experimental results. Further, the automated laboratory experiment manager may provide tools that allow a Designer to design an experiment that combines cell lines, marker sets, and ActivityBase treatment plates into a collection of assay plates. These tools also permit the full specification of the experimental process through a process model that generates a process (collection of tasks).
  • Process modeling features can provide the Designer with the ability to specify the structure of the experimental process. The automated laboratory experiment manager then generates processes and tasks for each experiment that automate the process where possible. Automated milestones (barcode scanning, task completion updates, and so on) provide tracking capabilities that give Designers, supervisors, and Experimenters the ability to get experiment status and to intervene in the process where required, preferably through remote interfaces.
  • In some embodiments, the automated laboratory experiment manager can track the infrastructure of experiments by tracking the individual hardware systems, software systems, reagents, treatments, and maintenance processes. Reports provide planning tools for Designers and Experimenters that help them to keep adequate supplies and systems on hand and in good repair.
  • In some embodiments described herein, the automated laboratory experiment manager helps to validate experimental results by storing the results and by enabling feedback from scientific analysis of the results. Experimental result validation embodies internal consistency of the results and reproducibility of the results. Consistency metrics (cell distribution, focus/exposure tests, contamination tests, control measure consistency with respect to benchmarks) and reproducibility metrics (variance or standard deviation or coefficient of variation of consistency metrics) provide a way for Designers and Experimenters to identify result failures in images, wells, and plates. The failure and defect tracking systems track these defects and the failures they cause. The stored results thus form a part of the experimental protocol.
  • The automated laboratory experiment manager may help to validate experimental processes by storing the processes and tasks undertaken as part of the experiment. These process and task objects may provide a complete history of the experiment with all significant milestones recorded with their date and time together with their process models, reusable protocols for generating the process for each experiment. The failure and defect tracking systems track defects and failures in the processes and tasks reported by the process actors (human and automated). The stored process information thus forms a part of the experimental protocol.
  • As shown in a context diagram (FIG. 11A) of exemplary use cases, the automated laboratory experiment manager has both human and automated roles. A Designer 1101 is an employee responsible for the design and supervision of an experiment. An Experimenter 1103 is an employee responsible for the conduct of an experiment. Note that in many scenarios the Designer 1101 can do anything in the system that the Experimenter 1103 can do. A Specialist 1105 is an employee responsible for any of a variety of infrastructure systems (hardware, software, reagents, treatment plates, tissue culture). A Robot 1107 is a hardware device that actively participates in the experimental or maintenance process, updating status and failure information in an Experimental Database as required. An Automated Process Generator 1109 is a server that automatically generates processes from process models. An Experimental Database (not shown explicitly) is a database (e.g., an Oracle database) that contains the persistent experiment protocols, models, and other laboratory-related information. Since virtually every aspect of the system uses the Experimental Database, the context diagram does not explicitly show it or the connections from the use cases to it. An ActivityBase 1111 a database that contains records of treatments for all departments of an organization.
  • The context diagram of FIG. 11A shows how the above actors communicate with the use cases that make up the automated laboratory experiment manager in accordance with one embodiment of this invention.
  • A Model Experiment Process use case 1113 builds process model graphs. A Maintain Experiment use case 1115 creates an experiment process from an experiment process model. A Generate Processes use case 1117 generates composite processes and tasks under the experiment process model.
  • Typically, process generation works on an as-required basis (just-in-time process generation). This use case generates those processes next in order in processing sequence. Process generation takes into account the model element level and the process element for the process (an experiment, usually) by generating the correct number of processes for the process element (all the wells on all the plates in the experiment, for example). It also generates all processes under a composite process marked as parallel. Sequential composite processes generate their children one at a time in sequence as the processes end. Also, the process generator generates processes for parent composite processes with a start date greater than or equal to the current date, allowing the system to control process generation timing.
  • Suitable processes of the Generate Processes use case 1117 are depicted in Table 8 below.
    TABLE 8
    Actor System
    Query all experiment Retrieve the processes
    processes that do not have and any objects
    an end date, that have a start needed to determine
    date greater than or equal to what the next process
    the current date, and that is to generate.
    have the root experiment as
    a direct parent.
    Generate the next set of Insert the new
    processes for each processes and process
    experiment process. element links.
    End the use case. Commit the
    transaction.
  • A Maintain Assay Plate use case 1119 may be understood as follows. The Experimenter creates, changes, and tracks assay plates through any number of processes. To create an assay plate, the Experimenter queries a cell line and marker set, then generates an assay plate by, for example, supplying a new assay plate barcode and the cell line passage number.
  • At some point in the processing of the plate, a process applies a treatment to the plate. At this point, the Experimenter may supply the barcode of the daughter treatment plate that supplied the treatment compounds for the plate, and the System generates the wells for the plate based on the master treatment plate format. The System sets the well group type based on the type that the master format specifies.
  • At any time, the Experimenter can designate the assay plate as no longer available—for example, the plate may be too old for further use given the reagents and cells on the plate, or it may have been damaged during processing.
  • When the plate has been processed through fluidics, a Specialist may mark the plate processed, indicating it should no longer be available for tasks involving plate processing (non-repeatable tasks).
  • It is possible to combine several daughter treatment plates onto a single assay plate. Thus a well may have more than one treatment associated with it through multiple associated treatment plate wells. It is also possible to use a master treatment plate as a daughter plate. Also, one may want to create an operational objective for the plate that specifies target metrics for things like number of cells per well.
  • Some processes of the Maintain Assay Plate use case 1119 are depicted in Table 9 below.
    TABLE 9
    Actor System
    Create the assay plate Create the assay plate
    using a marker set, cell in the Experimental
    line, cell line passage Database and display
    number, and a barcode, it (barcode, system
    optionally entering any characteristics,
    of the system marker set, cell line,
    characteristics (vision, and passage number.
    mission, risk, objectives,
    and so on).
    Query an existing assay Display the assay
    plate. plate and its wells (if
    any), showing the
    well groups and
    relative
    concentrations of the
    treatments (if any),
    and show the
    barcode, processing
    status (Processed or
    Not Processed), and
    availability of the
    plate.
    Modify the system Display the modified
    characteristics of the system characteristics
    plate (vision, mission, and save them to the
    risk tolerance, risk, database.
    operational objectives).
    Change the availability Display the modified
    status of the plate to plate with availability
    False when the plate is set to False.
    no longer available for
    analysis.
    Change the processed Display the modified
    status of the plate to True plate with processed
    when the plate is no set to True.
    longer available for
    processing.
    End the use case. Commit the
    transaction.
  • The Maintain Experiment use Case 1115 may be understood as follows. The Experimenter creates an experiment by generating an experiment process from an experiment process model and associating a group of assay plates with it. The Experimenter would have already created the assay plates in a scenario of the Maintain Assay Plate use case 1119. The Generate Processes use case 1117 will generate the tasks for the process on or after the start date the Experimenter specifies.
  • Some processes of the Maintain Experiment use case 1115 are depicted in Table 10 below.
    TABLE 10
    Actor System
    Generate the experiment Generate the process
    process from an tree and update the
    experiment process model, process start date and
    setting the start date and system characteristics.
    any of the optional system Display the process with
    characteristics (vision, its start date and system
    mission and so on). characteristics.
    Associate a group of assay Associate the plates in
    plates with the experiment the group with the
    process. experiment process.
    Query existing Retrieve the
    experiments. experiments and display
    them with start date, end
    date, and system
    characteristics. Display
    the list of associated
    assay plates.
    Select and modify any Associate the assay
    unprocessed experiment plates to the experiment
    (an experiment with a start process.
    date in the future) by
    adding assay plates.
    Select and modify any Update the system
    experiment by changing characteristics and
    the system characteristics associate the assay
    [or by adding assay plates plates to the experiment
    or assay plate groups] process.
    Select and delete an Remove the
    unprocessed experiment unprocessed experiment
    (an experiment process and all its child
    with no task with an end processes from the
    date). Experimental Database.
    Select and modify an Remove the plates from
    experiment by removing the experiment.
    any unprocessed plates (all
    at once, aborting the
    experiment, or one at a
    time).
    End the use case. Commit the transaction.
  • A well group is a collection of wells on one or more plate formats. Well groups permit data analysis to distinguish certain wells on plates as a unified group. Modeling well groups permits a Designer to create standard well groups in certain plate locations, such as control groups. As well, an Experimenter (or Data Analyst) can create an arbitrary group of wells for analysis purposes.
  • A Model Well Group use case 1121 permits the Designer to create a group and its wells, to change its structure, or to remove the group from active availability in the database.
  • Exemplary processes of the Maintain Experiment use case 1121 are depicted in Table 11 below.
    TABLE 11
    Actor System
    Create a well group, Create the group in the
    giving it a name and Experimental Database.
    optional description and Set the creator and the
    reuse potential as well as creation date to the user
    supplying the optional creating the group model
    system characteristics and the current system
    (vision, mission, date, respectively.
    objectives, and so on). Display the group model,
    Specify an ordered list of its group type, and its list
    well-group wells (row and of wells.
    column) and a group type
    from a lookup table of
    types.
    Query a well group. Display the well group
    and its wells, displaying
    system information,
    name, description, reuse
    potential for the group
    and the row and column
    for each well.
    Select a well group and Display the changes and
    change the name, save them to the
    description, reuse Experimental database.
    potential, system
    characteristics, group
    type, or well structure of
    the group.
    Remove the well group. Mark the system as
    inactive and remove the
    system from the display.
    Duplicate the well group, Copy the group and its
    supplying a new name. wells into a new object,
    setting the name to the
    new name.
    End the use case. Commit the transaction.
  • A Model Plate Format use case 1123 may be understood as follows. A plate format is a plate geometry and a collection of well groups laid out on a plate template. A plate format is the template for any number of plates, each of which has exactly one plate format that, once assigned, does not change. By designing plate formats, the Designer can create a reusable template that describes the basic layout of wells on a plate for use in generating assay plates. The Designer associates this plate format with a master treatment plate, and through that plate it determines the well structure of all the daughter treatment plates associated with the master plate and also of all the assay plates to which the daughter treatment plates are applied.
  • The Model Plate Format use case 1123 permits the Designer to create a plate format from the existing set of well groups (see the Model Well Group use case) and a plate type, to change its structure (if it is not already in use on existing plates), or to remove the group from active availability in the database. Some processes of the Model Plate Format use case 1123 are depicted in Table 12 below.
    TABLE 12
    Actor System
    Create a plate format, giving it a Create the group in the
    name and optional description Experimental Database. Set
    and reuse potential as well as the creator and the creation
    supplying the optional system date to the user creating the
    characteristics (vision, mission, group model and the current
    objectives, and so on). Choose a system date, respectively.
    plate type from a lookup list of Display the group model, its
    plate types. Add any number of plate type, and its list of well
    well groups to the list of well groups. Check that none of
    groups for the format. the well groups overlaps on
    the plate layout (offer only
    non-overlapping well groups
    for inclusion in the list
    through the user interface).
    Query a plate format. Display the plate format and
    its list of well groups,
    displaying system
    information, name,
    description, reuse potential
    for the group, plate type, and
    the well group name and
    description for each well
    group.
    Select a plate format and Display the changes and save
    change the name, description, them to the Experimental
    reuse potential, or system database.
    characteristics.
    Remove the plate format. Mark the system as inactive
    and remove the system from
    the display.
    Duplicate the plate format, Copy the plate format and its
    supplying a new name. well groups into a new
    object, setting the name to
    the new name.
    End the use case. Commit the transaction.
  • The Model Experimental Process use case 1113 may be understood as follows. As explained above in the discussion of the “Process Generator” subsystem, an experimental process model is a tree hierarchy of composite processes and tasks that represent the elements of the experimental process that one may want to track in terms of start and end dates. FIGS. 6A and 6B and the associated discussions set forth a typical experiment model.
  • Following up on that discussion, FIG. 1B illustrates a possible analysis process model with a representation of the Alpha analysis process model 607 (originally identified in FIG. 6A). This is a reusable composite process with multiple parts. The tree consists of a top-level composite process model 607, two composite process models 1151 and 1153 at the second level, each containing a set of different kinds of process models including tasks, composite processes, and algorithm tasks. As shown, the composite contains two parts, a DNA analysis 1151 and a non-DNA analysis 1153. The DNA Analysis 1151 contains a Control Threshold algorithm 1155 followed by an image cell count algorithm 1157 followed by a norm factor algorithm 1159, followed by a well summary process 1161 containing three algorithms, and terminated by a G150 algorithm 1163. A sequential marking 1165 on the DNA Analysis composite process model 1151 indicates the five subprocesses run sequentially. The plate marking (also 1165) indicates the DNA Analysis is done once for each plate in the experiment. Similarly, for the Control Threshold task 1155, the well group marking 1167 indicates the algorithm runs once for each well group on each plate. The second composite process, non-DNA Analysis 1153, has a parallel marking 1169, which means its two subprocesses run in parallel.
  • When the database creates a process tree (see FIG. 11C) from this structure, it sets the status as appropriate. For example, the FIG. 11C depicted tree represents the process tree generated from the above model:
  • The process model generates multiple processes for each process model depending on the iteration structure. There is one Analysis Process for the experiment. There is one DNA process for each plate in the experiment. There is one Golgi task 1171′ for each well on each plate in the experiment (all running in parallel with each other and with the DNA tasks. And so on.
  • Some processes of the Model Experimental Process use case 1123 are depicted in Table 13 below.
    TABLE 13
    Actor System
    Create a composite process Save the process model in
    model, specifying the name the Experimental Database,
    and description of the optionally linking it to the
    process and any system parent composite process.
    characteristics (vision,
    mission, objectives, and so
    on), and optionally
    connecting it to a parent
    composite process model.
    This may be an experiment
    model or a generic
    composite process model.
    Set the composite to
    execute its children in
    parallel or sequentially.
    Create a task model, Save the task model in the
    specifying the task name Experimental database,
    and description, parent linking it to its parents.
    process model, and any
    system characteristics.
    Query an existing process Get the process model tree
    model. from the Experimental
    Database. Display the
    process model names and
    descriptions.
    Duplicate a process model. Add a new process model
    tree copied from the
    queried one to the
    Experimental Database.
    Change the name by
    adding “Copy of” to create
    a unique name.
    Change the name or Update the name and
    description of the queried description of the process
    process model or any of the model in the Experimental
    system characteristics. Database.
    Remove an experimental Mark the process as
    process model. inactive in the
    Experimental Database.
    End the use case. Commit the transaction to
    the database.
  • A Monitor Hardware Systems use case 1125 can be understood as follows. The automation features of the automated system involve the coordination and maintenance of various hardware systems such as robots and incubators. Each such system is tracked as part of the Configuration subsystem of the system database for failure and defect tracking purposes. As well, a specialist can monitor the current status of these systems.
  • The system can display database records of hardware status. Alternatively, the system canl integrate real-time hardware monitoring features into the system, providing web-based updates and control of individual hardware deliverable systems.
  • Some processes of the Monitor Hardware Status use case 1125 are depicted in Table 14 below.
    TABLE 14
    Actor System
    Query the system for current Display a list of all hardware
    hardware status. deliverable systems. Display
    any feedback available in the
    database about the system.
    Log a comment on a specific Save the comment with a time
    hardware system. stamp to the Experimental
    Database, linking the comment
    to the hardware system.
    End the use case. Commit the transaction.
  • A Query Process Status use case 1127 can be understood as follows. The Experimenter needs to know the status of the experimental processes for all active processes. The Query Process Status use case 1127 presents this information to the Experimenter, showing the process trees of active processes and allowing the Experimenter to drill down to the start and end times of individual processes, to see any comments about the processes, and to log comments about specific processes.
  • Some processes of the Query Process Status use case 1127 are depicted in Table 15 below.
    TABLE 15
    Actor System
    Query the system for Display a list of active
    current process status. processes, listing all process
    trees with active tasks in a tree
    hierarchy display. For each
    process display the start time
    and end time of the process
    and any feedback for the
    process.
    Modify status to Set the status in the database
    Complete or Broken. and set process end date to the
    current date and time.
    Log a comment on a Save the comment with a time
    specific process. stamp to the Experimental
    Database, linking the comment
    to the process object.
    End the use case. Commit the transaction.
  • A Track Cell Line use case 1129 can be understood as follows. A cell line is a specific kind of cell that a Designer can use in an experiment. The automated system typically maintains a specific set of cell lines. When a Designer creates an assay plate, he or she specifies a cell line for the plate. The Track Cell Line use case 1129 lets the Experimenter or Specialist create, modify, or remove cell lines from the set of available lines in the system. See the discussion of the Maintain Assay Plate use case 1119 for the association of cell lines to assay plates. Some processes of the Track Cell Line use case 1129 are depicted in Table 16 below.
    TABLE 16
    Actor System
    Create a cell line, specifying its Save the cell line to the
    name, description, reuse Experimental Database.
    potential, and any optional
    system characteristics (mission,
    vision, operational objectives,
    and so on).
    Query a set of cell lines on id, Display the cell line name
    name, or description. and description and a list
    of all active assay plates
    for the cell line. Also
    display any cell line
    feedback.
    Change the cell line name, Save the changes to the
    description, reuse potential, or Experimental Database.
    system characteristics.
    Remove a cell line. Mark the cell line inactive
    in the Experimental
    Database.
    End the use case. Commit the transaction.
  • A Track Marker use case 1131 may be understood as follows. A marker is a specific reagent or other indicator detectable in an image. For example, the marker may be an autofluorescent reagent used to mark specific proteins or other materials in the well and thereby show the location of such materials in an image obtained with a fluorescent microscope. In a typical example, each marker fluoresces at a particular frequency of light and occupies a channel on the microscope. The Specialist may create, change, or remove markers in the automated system. See the discussion of a Maintain Marker Set use case 1133 for the association of markers to assay plates.
  • Exemplary processes of the Track Marker use case 1129 are depicted in Table 17 below.
    TABLE 17
    Actor System
    Create a marker, Save the marker to the
    specifying its name, Experimental Database.
    description, reuse
    potential, and any
    optional system
    characteristics (mission,
    vision, operational
    objectives, and so on).
    Query a set of markers Display the marker
    on id, name, or name and description.
    description.
    Change the marker name, Save the changes to the
    description, reuse Experimental Database.
    potential, or system
    characteristics.
    Remove a marker. Mark the marker
    inactive in the
    Experimental Database.
    End the use case. Commit the transaction.
  • The Maintain Marker Set use case 1133 may be understood as follows. A marker set is a collection of different markers assigned to specific channels on a fluorescent microscope (or other instrument employed in the imaging process). A Scientist assigns the marker set to an assay plate to indicate which channels are active on the plate for imaging. See the discussion of the Maintain Assay Plate use case 1119 for the association of marker sets to assay plates.
  • Exemplary processes of the Maintain Marker Set use case 1133 are depicted in Table 18 below.
    TABLE 18
    Actor System
    Create a marker set, specifying Save the marker set to the
    its name, description, reuse Experimental Database.
    potential, and any optional
    system
    characteristics (mission, vision,
    operational objectives, and so
    on).
    Query marker sets on id, name, Display the marker set name
    or description. and description and a list of
    all markers in the set.
    Change the marker set name, Save the changes to the
    description, reuse potential, list Experimental Database.
    of markers, or system
    characteristics.
    Remove a marker set. Mark the marker set
    inactive in the Experimental
    Database.
    End the use case. Commit the transaction.
  • A Track Reagent use case 1135 may be understood as follows. A reagent is a chemical other than a treatment agent that someone may use as part of the experiment process, such as media added to wells to hold cells or the fixing chemicals added during the fix and stain process. The Track Reagent use case 1135 lets the system track reagent inventory to ensure that enough reagent volume is on hand to meet experimental demand.
  • The reagent inventory is a bit complicated by the need to represent various kinds of containment for the reagents. The original packaging of the reagent contains a certain amount of reagent from a given lot, and the automated system stores it in a specific storage location. Much of what the automated system uses as reagent, however, is a working solution comprising several reagents mixed together. As well, Specialists or Experimenters may divide a reagent lot into a series of aliquots, which are by definition a complete division of the original amount into a series of smaller amounts. The system database may track sets of aliquots that come from the same lot and have the same volume, rather than tracking individual aliquots.
  • In one embodiment, reagent tracking does not attempt to manage the actual flows of reagents through the automated system. Rather, it tracks receipt of reagent lots, creation of working solutions, and aliquoting of the inventories. This permits the recording of experimental protocol information as required to tie experimental results to specific lots. Another embodiment of the system implements a full-scale inventory system for reagents.
  • Exemplary processes of the Track Reagent use case 1135 are depicted in Table 19 below.
    TABLE 19
    Actor System
    Create a reagent product with a Create the reagent product in
    vendor, product name, catalog the Experimental Database.
    number, and notes.
    Query a set of reagent products Display the reagent products
    by vendor, product name, catalog with vendor, product name,
    number, or notes. catalog number, and notes.
    Change a reagent product by Save the changes to the
    changing the product name, Experimental Database.
    catalog number, or notes.
    Create a reagent lot from a Create the reagent lot in the
    reagent product, specifying the lot Experimental Database.
    number, inventory date, Specify the current user as the
    expiration date, the amount of creator of the lot.
    reagent in each unit of reagent
    and the units of the amount, the
    total number of units received for
    this lot, and any notes on the lot.
    Query a set of reagent lots from Display the reagent lots
    the database by any of the reagent queried.
    lot fields.
    Change the reagent lots to correct Save the changes to the
    errors by changing lot number, Experimental Database.
    inventory date, expiration date,
    amount, unit, units received, and
    notes.
    Create a working solution, Create the working solution in
    specifying the set of reagents or the Experimental Database.
    working solutions (product Specify the current user as the
    inventories) you are combining creator of the solution.
    into the solution, the name of the
    solution, the inventory date, the
    expiration date, the amount of
    solution in each unit of solution
    and the units of the amount, the
    total number of units made for
    this solution batch, and any notes
    on the solution.
    Query a set of working solutions Display the working solutions
    from the database by any of the queried.
    inventory fields or by specifying
    an inventory component.
    Change the working solution to Save the changes to the
    correct errors by changing Experimental Database.
    inventory date, expiration date,
    amount, unit, units made, notes,
    or the inventory components of
    the solution.
    Create an aliquot set from a Create the aliquot set in the
    reagent or working solution Experimental Database.
    (product inventory). Specify the Specify the current user as the
    date on which you aliquotted the creator of the set.
    inventory, the number of aliquots
    in the set, the volume of the set
    (all aliquots in the set must have
    the same volume), the volume
    unit, and some text giving the
    purpose of the aliquot set.
    Query a set of aliquot sets from Display the aliquots queried.
    the database by any of the
    inventory components or by any
    of the aliquot fields.
    Change the aliquot set to correct Save the changes to the
    errors by changing the aliquoting Experimental database.
    date, number of aliquots, volume,
    unit, or purpose or the inventory
    component that was aliquotted.
    End the use case. Commit the transaction.
  • A Track Treatment use case 1137 may be understood as follows. A treatment compound may be a designated compound obtained by the enterprise for inclusion in the assay program as an “active” substance in the evaluation process. When the enterprise receives a treatment compound, it plates it onto one or more master treatment plates and registers these plates in ActivityBase, the orgaization's research database system. ActivityBase tracks treatment lots rather than treatments, and the automated system needs to track the treatment compound as an object rather than the lots. It identifies the compound with an ID number, but there may be multiple entries for these compounds with slightly different molecular weights and formulas but the same ID. The automated system thus queries ActivityBase to find all registered treatment compounds marked as Cytometrix™ compounds which are not already part of Cytometrix™ and records treatments and IDs in a Cytometrix™ table. It takes the first molecular formula and molecular weight it finds to store in the table. Note that in some embodiments the automated laboratory experiment manager allows for querying and/or examining treatments.
  • Exemplary processes of the Track Treatment use case 1137 are depicted in Table 20 below.
    TABLE 20
    Actor System
    Query ActivityBase to find Retrieve the treatment
    any ID not already in the compound ID, then query
    Experiment database. and retrieve the
    molecular weight and
    formula for an arbitrary
    treatment entry for the
    ID.
    End the use case. Commit the transaction.
  • A Track Master Treatment Plates use case 1139 may be understood as follows. When an organization receives a treatment compound, it may plate it onto one or more master treatment plates and register these plates in ActivityBase, the organization's research database system. The wells of the master treatment plate thus contain the initial concentration of the compound that serves as the basis for dilution onto daughter treatment plates and assay plates.
  • The Track Master Treatment Plates use case 1139 lets the Designer track the master plates that contain treatment compounds by querying ActivityBase through an interface. That means that the Designer does not have to create treatment compounds or master plates but rather queries them from ActivityBase. In one embodiment, the Designer cannot change master treatment plates or remove them.
  • This use case also lets the Designer associate a plate format with the ActivityBase master treatment plate (see the discussion of the Model Plate Format use case 1123 for more information on plate formats).
  • Exemplary processes of the Track Master Treatment Plates use case 1139 are depicted in Table 21 below.
    TABLE 21
    Actor System
    Query a set of master Display the treatment plate
    treatment plates using barcodes, descriptions, and
    barcode, description ActivityBase plate format
    text, or plate format name. Display the treatment
    name. plate wells.
    Specify a plate format Display the plate format ID
    for the master treatment and name.
    plate.
    End the use case. Commit the transaction.
  • A Maintain Daughter Treatment Plates use case 1141 may be understood as follows. The automated system produces daughter treatment plates from master treatment plates. Each well in an assay plate has a specific dilution or other characteristic treatment from a well on a daughter treatment plate. See the Model Well Group use case 1121 for details on modeling groups of wells; see the Model Plate Format use case 1123 for details on mapping well groups to assay plates; and see the Maintain Assay Plate use case 1119 for details on combining a treatment plate with an assay plate to generate the wells on the assay plate.
  • The Track Daughter Treatment Plates use case lets one create and maintain daughter plates. A daughter plate can be generated based on a master plate (see the Track Master Treatment Plates use case 1139).
  • Exemplary processes of the Maintain Daughter Plates use case 1141 are depicted in Table 22 below.
    TABLE 22
    Actor System
    Query a master treatment Display the master
    plate using its system treatment plate system
    identifier, its barcode, and/or identifier, barcodes, and
    its descriptive text. description and the set of
    existing daughter
    treatment plates for the
    master and the set of
    wells for each daughter.
    Create a set of daughter Create the new plate in
    treatment plates, supplying the Experimental
    the number of plates to Database and generate
    create, the range of treatment the set of treatment plate
    plate barcodes and the media wells, setting the row,
    and treatment volumes added column, concentration,
    to the plates when creating concentration unit,
    them from the master. treatment volume,
    volume unit, and plate
    description from the
    master wells and the
    added media volume
    from input.
    Select a treatment plate well Display the well
    on a master treatment plate. information for the well,
    including row and
    column numbers;
    treatment ID, name,
    molecular mass, and
    molecular formula;
    compound concentration
    and volume; and plate
    description.
    Select and change a daughter Update the barcode or
    plate by changing the media volume in the
    barcode or media volume for Experimental Database.
    the plate.
    Remove a daughter plate Mark the daughter plate
    from active use. as inactive.
    End the use case. Commit the transaction.
  • Experimental Protocol Design
  • The Experiment Protocol system is a LabRat application that lets a Designer create and maintain a set of experiment protocols. These protocols typically include one or more of the following aspects of an experiment design: a set of cell lines; a set of marker sets; a number of replicates; a list of time points; and a set of QC target sets.
  • These parameters, plus some additional specifications such as a set of master treatment plates, typically provides enough information to create a complete experiment layout. The protocol contains the general layout parameters; an experimenter chooses the protocol, then supplies the necessary specific information to create the experiment in an Experiment Wizard (described below).
  • In one preferred embodiment as depicted in FIG. 12, the ExperimentProtocol system 1201 is a Java applet in the presentation layer that allows maintenance of persistent experiment protocols. The system 1205 (e.g., a Java Server Page) provides access to the ExperimentProtocol system 1201. In this example, the ExperimentProtocol system 1201 uses two subsystems in the business object layer (EJBs), AssayPlate 1207 and Experiment 1203. Both correspond to schemas in the database layer.
  • A QCTargetSet systsem 1209 may be a Java applet in the presentation layer that lets you maintain persistent QC target sets. The system (a JSP) provides access to a QC subpackage 1211 of the Experiment subsystem in the business object layer, consisting of EJBs and the underlying schema in the database server layer.
  • Experiment Wizard User Interface
  • The invention may include an “Experiment Wizard” system (e.g., a LabRat application) that lets a Production experimenter create an experiment quickly and easily. In a preferred embodiment, the Wizard provides one or more of the following parameters: (1) experiment protocol (specifies cell lines, marker sets, time points, number of replicates) (choose from list); (2) imaging protocol (choose from list); (3) QC target set (choose from list); (4) master treatment plates and plate format (enter series of barcodes and choose plate format for each from a list of compatible formats); (5) control master treatment plates (enter Taxol and DMSO or accept defaults); (6) daughter treatment plate barcodes (generated from specification or entered directly); and (7) cell plate barcodes (generated from specification or entered directly).
  • In the specific embodiment depicted in FIGS. 13A-13H, the Wizard uses the experiment protocol and the selected specific settings to create a complete experiment design. It creates the daughter plates and cell plates (including control plates). It allows the user to prune out particular plates not needed. It then lets the user choose an experiment model for each batch and generates the processes required for the batches. It produces a “Drug Add Worksheet” for each batch that tells the Experimenter how to process the batches through tissue culture and fluidics.
  • As depicted in FIG. 13A, a first page 1301 of the wizard allows one to choose an experiment protocol, an imaging protocol, and a QC target set. One can inspect or change all of these items through the automated laboratory experiment manager. The experiment protocol identifies an experiment setup, including a set of cell lines, a set of marker sets, a set of time points, and a number of replicates. A “Standard Experiment” might, for example, use six cell lines, OneStep and TriStain (three designated markers), a 24-hour time point, and 3 replicates. The imaging protocol sets the desired microscope and imaging parameters (this can be changed later in the Process Monitor). The QC target set is a set of features with upper and lower specification limits and a target value. The user can change the quality settings by creating multiple sets of QC targets, then creating the experiment with the appropriate set. The targets are associated with a particular experiment protocol, so the user sees only the target sets for the chosen protocol.
  • On a next page 1303 shown in FIG. 13B, the user may, in the depicted example, first choose the master treatment plates for DMSO, Media Only, and Taxol control plates. This page may display the “usual” master barcode to use for these by default, but the user can replace this barcode with another one if required. The user then chooses a series of master treatment plates by typing in a barcode. When the user enters a master plate barcode into the data entry field, the system restricts her choice of plate formats to the formats compatible with the master plate. She then chooses one plate format from the dropdown list of compatible plate formats. A “compatible” plate format is one with a set of well group wells that matches in number the set of master plate wells.
  • As shown in FIG. 13C, a next page 1305 lets the user choose a starting barcode to use for daughter treatment plates for a selected master barcode as well as specifying a number of such plates to generate. Alternatively, the user can type in a list of daughter barcodes directly into the list of plates. A special case is using the master plate as a daughter: the user does this by entering the master barcode as the starting barcode and setting the number of daughters to 1. On clicking the “Generate daughters” button, the Wizard generates the required number of daughter plates using the TreatmentPlateGenerator session bean. Each generated plate will have a unique barcode incremented by one from the previous barcode, with the first plate having the starting barcode. In alternative embodiments, it is possible to generate daughter plates automatically based on the number of assay plates required.
  • As shown in FIG. 13D, a next page 1307 displays the number of plates required at this point in the Wizard. It lets the user enter the starting barcode to use for the assay plates generated by the design. In one embodiment, each plate will have a unique barcode incremented by one from the previous barcode, with the first plate having the starting barcode. Alternatively, the user can just type in the barcodes into the text box, which lets her enter a list of non-sequential barcodes. Clicking on “Prune experiment” lets her remove certain branches of the experiment tree (see the following explanation). Clicking on “Generate cell plates” lets her see the list of generated cell plates; clicking on “Next>” finalizes the list of cell plates.
  • An ExperimentPruner applet gives the user a way to prune branches from an experiment. As shown in FIG. 13E, the system presents a tree 1309 of the combinations of the experiment parameters (master treatment plate, time point, marker set, and cell line, in that order). The user can prune out whatever branches of this tree are not required for the experiment.
  • In the depicted example, there are two cell lines, two marker sets, and two time points. The Experimenter determines that one marker set is unnecessary at one time point, so he or she prunes that marker set from that time point branch, removing those plates from the experiment as shown in FIG. 13F.
  • After saving and exiting from the applet, the system displays the Cell Plates form, and the user can click on the “Generate cell plates” button, and then click on next to see the Batch Generator applet.
  • The Batch Generator lets the user divide an experiment into batches. The system displays the remaining tree branches divided into batches, one per cell line. See FIG. 13G. It then lets the user combine these branches to merge several cell lines into a single branch corresponding to a single batch.
  • The user can also label the batches with a name so she can easily understand which is which in the next Wizard screen.
  • When the user exits the Batch Generator applet after saving, she sees a final page 1311. See FIG. 13H. Here, she generates the experiment by associating experiment models with each batch.
  • Clicking on Report for a batch gives the user an Drug Add Worksheet for that batch. Clicking on Finish runs the process generator. If there are sub-experiments, the generator will prompt the user to enter subsets of plates where required.
  • Passaging
  • Passaging, or splitting, is a process used to grow cells continuously in media. Cytometrix™ experiments may require a significant quantity of a commercial cell line (a particular kind of cell, such as A549 or HUVEC). Cytometrix™ has qualified several cell lines for use with experiments and has a database with target cell counts and quality specifications for each cell line. Passaging lets one grow cells from the commercial lot.
  • A group within an organization typically has the responsibility of maintaining and growing the cells to supply experiments with microtiter plates with cells of a certain density within a certain maximum passage number. Research associates grow the cells in, e.g., T-175 flasks or roller bottles; when the cells reach a certain confluence (coverage of the surface area of the flask) the tissue culture research associate passages the cells and either puts them into new vessels or plates them onto microtiter plates. The passaging allows the cells to grow by reducing their confluence to a level that will promote growth.
  • The density of cells in the wells of the plate is typically an important process variable for the automated system. If plating density is not within specification limits or diverges widely from its target, the image processing and biological analysis algorithms can fail.
  • Passaging involves trypsinizing the cells (applying the chemical trypsin) in the flask to disrupt their adherence to the flask, combining flasks into a single cell suspension, counting the resulting cells, then either putting the cell suspension into a new set of flasks at the right density or plating the cells onto microtiter plates with the Multidrop device for an experiment (or both). This process adds one more passage number to the cell line. For example, the cells are said to go from passage 3 to passage 4 after trypsinization.
  • Various actors participate in the passaging use cases shown in FIG. 14A. The primary actor is a Research Associate 1403, who is the main user of the application. The Research Associate 1403 enters various pieces of information during the processes and uses the computed information delivered through the application to complete the processes. The RA 1403 is responsible for correct data entry and for using the computed information properly by applying the tissue culture SOPs (standard operating procedures). A secondary actor is an Operations Manager 1401, who monitors cell-plating processes and inspects the tissue culture worksheet information. Another secondary actor is a Quality Control Manager 1405, who inspects the tissue culture worksheet information to improve process quality. The Operations Manager 1401 inherits all the abilities of the Research Associate 1403, allowing him or her to enter data and use results. Another secondary actor is an Automation Specialist 1407, who uses the passaging report.
  • Generally, the Operations Manager 1401 is responsible for the system's tissue culture. She should be able to understand what is happening in the tissue culture passaging and cell plating processes, enter passaging information, count cells, plate cells into plates, plate cells into single-well vessels, monitor passaging, and report on passaging. She should also be able to trace what happened in passaging and cell plating when there is a plating density failure.
  • The Research Associate 1403 is generally responsible for laboratory work during the tissue culture processes. She should be able to get correct values for required process values based on minimal inputs, enter passaging information, count cells, plate cells into plates, and plate cells into single-well vessels.
  • The Automation Specialist 1407 is generally responsible for laboratory work during the drug add processes. She should be able to verify that a set of plates have a particular cell line on them before proceeding with a drug-add process and print plating report.
  • An Enter Passaging Information use case 1409 can be understood as follows. The RA 1403 creates a new passaging task by entering information about the passaging process. The system calculates the total number of milliliters of cell suspension that will be available for plating into the target number of vessels at the end of the passaging process as well as various other target values.
  • Passaging takes a set of input vessels containing cells and plates the contents into some combination of output vessels. For example, one kind of passaging takes roller bottles as inputs and produces roller bottles as output. Another kind of passaging takes T-175 flasks as inputs and produces a combination of 386-well plates and T-175 flasks. The plates go on to become part of an experiment; the flasks go back into the next passaging task for further growth of the cells. The input vessels should all be of the same type and plating volume and should contain cells with the same passage number. There are three types of passaging:
  • Maintenance: The RA is maintaining the cell line with no intention of plating the cells within one passage of the current passaging. That is, the cells are going into another flask with the intention of repeating the process at least once into another, additional flask.
  • Pre-plating: The RA is preparing the cells for plating with one additional passaging before the plating occurs. That is, the cells are going into another flask with the intention of passaging them into a set of plates on the next passage.
  • Plating: The RA is passaging the cells for plating onto plates in the current process. The RA may passage some of the cells into flasks as for maintenance or pre-plating while plating some of the cells onto plates.
  • Note that this use case narrative refers to wells. Generally, a “well” is a receptacle or set of receptacles in a vessel. A flask, for example, has one well (itself), as does a roller bottle. An 8×12 plate has 96 wells, and a 16×24 plate has 384 wells. An output plate may use only some of the available wells; hence the RA can specify how many wells to output per vessel, which allows for correct calculation of required volume amounts. The Scientist can specify a default number of wells to plate for each kind of plate.
  • The Enter Passaging Information use case 1409 sequence may generally proceed as follows. The RA logs on to the system. The system displays a new passaging task with the name of the logged-on RA's name and the current date and time. The RA sets the name of the RA responsible for the passaging, replacing the logged-on RA's name. The RA sets the cell line from the list of available cell lines. The RA sets the number of input vessels. The RA selects the vessel type, plating volume, and plating type (Maintenance, Pre-Plating, or Plating) (one field, all items together from the list of supported vessels, volumes, and types for the cell line). The RA enters the starting passage number from the input vessel labels. The RA estimates the confluency of the cells in the flask and enters the confluency as a percentage (5, 10, 15, 20, 25, 30, 35, 40, . . . , 95, 100). The RA takes digital images of each input flask and stores them on disk in a network storage directory. The RA selects one image to represent the confluency estimate and enters its path and filename. The RA enters the media working number that identifies the media lot being used. The RA enters the trypsin aliquot number that identifies the trypsin lot being used. The RA enters the PBS aliquot number that identifies the PBS lot being used. The RA saves the passaging task. The system stores the passaging task in the database. The name is the name of the cell line plus the date plus the starting passage number: ‘A498 6/23/2001 09:05:27 Passage 17’, for example. The system sets the task status to Started. The start date is set to the current date and time.
  • A Count Cells use case 1411 may be understood as follows. The RA 1403 counts the cells after trypsinizing the flask. In a specific example, the RA takes three counts with the Coulter counter device and the system calculates the average. The RA counts the cells with a hemocytometer to check the Coulter counter number. The system calculates the average number of cells per milliliter and the total number of cells available.
  • A goal of this use case is to track cell counts going into passaging and to provide estimates to the RA of the current count and density in the flasks. In a particular example, it involves specifying a number of T-175 flasks (nT175) and a total number of milliliters of cell suspension (totalSuspension)
  • The average cells per milliliter can be calculated as follows.
    average cells per ml=average cell count/cell suspension volume (mls)
    where
    average cell count=(hemocytometer count+coulter 1+coulter 2+coulter 3)/4
    cell suspension volume=number of vessels*resuspension volume per vessel (mls)
    resuspension volume per vessel=resuspension volume per well (mls)*number of wells per vessel
  • Then the total cells available may be calculated as follows.
    total cells available=number of vessels*cell suspension volume (mls)*average cells per ml
  • A simple Count Cells use case 1411 narrative follows. The RA enters 3 Coulter Counter cell counts. The system calculates the average count and displays it once; the RA enters all 3 values. The RA enters a hemocytometer count for four squares. The system displays two calculated values: average cells per milliliter and total number of cells available (see calculation formulas above). The RA saves the cell counts. The system stores the counts in the database along with the date and time of the last count entered.
  • A plate cells into plates use case 1413 may be understood as follows. When one or more experiments are pending, the RA should create some number of cell plates from the cell suspension. The RA enters the number of plates to process, then runs the plates through the “Multidrop” device to plate the cells. The RA reads the barcode for each plate with a barcode reader. For each plate, the system creates an assay plate object in the database with the cell line and passage number (plus one) from the worksheet. The system also creates a completed Plating Task for all plates processed, associating all plates with the task as process elements, allowing the Process Monitor to display the status of plating to the Operations Manager.
  • Note that the use case assumes there is one set of output plates, all of which are the same type. The barcode reading operation happens after a Multidrop plating process is complete. The RA takes the stack of plates over to the bench and scans all the barcodes into the worksheet. Because this is a single-point event, there is only one task for all the plates, and the date and time for task start and complete is the barcoding start and complete time. This is easier than scanning the barcodes directly; assuming that the individual times are not important.
  • The total media required may be calculated as follows.
    total media needed=number of vessels*plating volume (mls per vessel)+dead volume (mls)
    where number of vessels is entered by the RA, dead volume is from the Vessel table, and plating volume is calculated from the plating volume per well as follows.
    plating volume (mls per vessel)=plating volume (mls per well)*number of wells
  • The total cells required may be calculated as follows.
    total cells needed=target diluted cells per ml*total media needed (Mls)
    where total media needed (mls) comes from the previous calculation and target diluted cells per well ml is calculated from the Cell Line Vessel Profile target diluted cells per well entered by a Scientist.
    target diluted cells per ml=target diluted cells per well/plating volume (mls per well)
  • The concentrated cell stock may be calculated as follows.
    concentrated cell stock (mls)=total cells needed/average cells per ml
    where total cells needed is calculated above and average cells per ml comes from the average cell count:
    average cell count=(hemocytometerCount+coulter1+coulter2+coulter3)/4)
    average cells per ml=average cell count/cell suspension volume (mls)
    where the counts come from the “Count cells” use case and the cell suspension volume (mls) comes from the calculation:
    number of vessels*number of wells*resuspension volume mls per well
    where number of vessels is the number of output plates, number of wells is the number of wells to plate (not the number of wells on the plate, necessarily), and resuspension volume comes from the Cell Line Vessel Profile. If total cells needed is greater than the total cells available from the “Count cells” use case, the plating has failed.
  • An example Plate cells into plate use case narrative follows. The RA chooses the plate type, plating volume, and passaging type (Plating in this case, all items in one field), the number of plates, and the number of wells to plate in each vessel (default). The system displays the total media needed, the total cells needed, and the amount of concentrated cell stock to add (mls) for this set of plates. The system also displays the total cells needed for the passaging task (sum of all output vessels including this set of plates) and calculates whether the plating has failed (that is, whether there are enough cells available to accommodate the number of plates and other vessels entered as output in this use case or the “Plate cells into single-well vessels” use case). See the above calculations. The RA enters 3 Coulter Counter cell counts. The system calculates the average before-plating count and displays it once the RA enters all 3 values. The RA plates the cells using the Multidrop device. After completing the plating, the RA scans the plate barcodes into the Passaging Worksheet. For each plate, the system creates a plate object with the barcode and sets the cell line (cellLineID) and passage number (starting passage number plus 1). The system displays the number of plates processed. The step ends when the system increments the number of plates processed to a value that is equal to the number of plates to process that the RA entered in step 1. At this point the RA cannot process any more plates. The RA enters 3 Coulter Counter cell counts. The system calculates the average after-plating count and displays it once the RA enters all 3 values. The RA enters a comment on the plating process. The system logs the comment and attaches it to the passaging process associated with the plating. The RA ends the use case, saving the changes. The system sets the completion date of the passaging task to the current date and time.
  • A Plate cells into single-wells vessels use case 1415 may be understood as follows. The goal of this use case is to track the transfer of cells into different single-well vessels as part of the passaging process (maintenance, pre-plating, or along with plating). As a precondition, the cell line seed density settings are entered in Cell Line Vessel Profile as target concentrated cells for maintenance and pre-plating plating types. An average number of cells per milliliter is calculated in “Count cells.” After trypsinization, the RA 1403 needs to transfer the cell suspension (less the amount plated on 384-well plates) into new single-well vessels, either as maintenance or as a pre-plating passaging.
  • The narrative for use case 1415 follows. The RA chooses the plate type, plating volume, and passaging type (all items in one field), and the number of vessels. The system displays the total media needed, the concentrated cell stock needed, and the total cells needed for this set of vessels (based on the passaging type, plating volume, and cell target). The system also displays the total cells needed for the passaging task (sum of all output vessels including this set of vessels and possibly a set of plates) and calculates whether the plating has failed (that is, whether there are enough cells available to accommodate the number of vessels entered as output in this use case or the “Plate cells into plates” use case). See the discussion in the “Plate cells into plates” use case 1413 for the calculations. The RA enters a comment on the passaging process. The system logs the comment and attaches it to the passaging process associated with the plating (see the “Enter passaging information” use case). The RA ends the use case, saving the changes. The system sets the completion date of the passaging task to the current date and time.
  • After completing plating, the RA may print a report listing the cell line, the date and time of passaging, and the list of barcodes of the plates made by the passaging task. This is represented by a Print plating report use case 1417. One goal of use case 1417 is to provide the automation Specialist with a hard-copy record of the set of plates and their cell line for use during incubation and drug add tasks. The Automation specialist uses the printed report to ensure that the plates are the right ones given the experiment design. During the use case 1417, the RA chooses to print the plating report. The system sends a report giving the cell line, the passaging task completion date and time, and a list of cell plate barcodes plated by the passaging task.
  • A Monitor passaging use case 1419 may be understood as follows. Its goal is to display the status of a passaging process to the Operations Manager 1401. Generally, the “Plate cells into plates” use case or the “Plate cells into single-well vessels” use case must be in progress or completed to see the tasks.
  • The Operations Manager uses the Process Monitor to see the status of plating tasks. When an RA saves passaging information, the Process Monitor displays the Passaging task. The status appears first as Started, then changes to Completed when the RA saves the plating information.
  • During the use case 1419, the system displays all passaging tasks, displaying the name, description, start date, completion date, and status for the task. The system then refreshes the monitor display, getting any new processes and tasks. If appropriate, the Operations Manager sets the status of a Started task or process to Broken, stopping any further processing of the task. If appropriate, the Operations Manager sets the status of a Broken task or process to Started, allowing further work on the plating tasks. In some embodiments, the Process Monitor may log an application failure and displays the error, then offer the Operations Manager the choice of continuing or closing the monitor.
  • A Report on passaging use case 1421 may be understood as follows. Its goal is to give the Operations Manager 1401 and Quality Control Manager 1405 all the information about the passaging tasks that have taken place during a specific time period. One of the managers runs the report.
  • During the use case 1421, the Operations Manager 1401 specifies the cell line, starting timestamp and ending timestamp to define the reporting period. The system then displays the report, showing for each Passaging task with a start date within the specified time interval the process name, description, RA, cell line name, start date, end date, input vessels and their image, confluency, starting and ending passage numbers, media working number, trypsin batch, PBS batch, hemocytometer cell count, average Coulter counter cell count, average before-plating cell count, number of output plates made, average after-plating cell count, and number of output single-well vessels made. The system calculates and displays the status of passage failure and plating failure for each task. The system also displays any comment (with last status date and owner person) linked to the task and any failures (with last status date and owner person) logged against the task.
  • A tissue culture user interface suitable for use with this invention is constrained only by the need to represent certain data. In one embodiment, FIGS. 14B and 14C show the suitable spreadsheets for T-175 flask and 384-well plating.
  • There are two tables, one in each spreadsheet, that describe the characteristics of the cell lines. There are some fields mentioned in the passaging use cases that do not appear on these spreadsheets, such as the count of actual plates processed and the comment fields.
  • Note the emphasis placed on the cell line name display and on the counts, which are in large boxes. Generally, a passaging worksheet should find a way to emphasize these items as important. The UI should typically provide a Save feature and a New Passage feature. It might also provide an End Passage feature to enable ending the 384-well plating use case without actually creating a new passage.
  • The Passaging Task contains a confluency estimate and an image file of the confluency sample, the starting passage number, the identifiers for the input reagents, various cell counts, and the date and time of cell counting. Methods on this class calculate count averages, total cells available for passaging, total cells needed for passaging, whether the passaging and/or plating failed, and the cell line for the passaging (all vessels should have the same cell line, and there is no direct link to the cell line table, hence the method).
  • An InputVessels table is a set of vessels that provide cells to the passaging task. The class has the number of vessels in the set and calculates the cell suspension volume in mls. There is exactly one set of input vessels. The OutputVessels table is a set of vessels that hold the passaged cells, and there can be any number of such sets (usually 2, a set of plates and a set of single-well vessels). The class specifies the number of vessels and the number of wells in each vessel actually used. The class provides methods to calculate the total amount of media (mls) required for the output vessels, the total cells needed, and the amount of concentrated cell stock needed for the vessels (mls).
  • Treatment Plate Generator Design
  • The automate system produces daughter treatment plates from master treatment plates. Each well in an assay plate has a specific dilution of a treatment from a well on a daughter treatment plate. A Track Daughter Treatment Plates use case lets a user create and maintain daughter plates. The user generates a daughter plate based on a master plate.
  • Some relevant processes are depicted in Table 23 below.
    TABLE 23
    Actor System
    Query a master treatment plate Display the master treatment
    using its system identifier, its plate system identifier,
    barcode, and/or its descriptive barcodes, and description and
    text. the set of existing daughter
    treatment plates for the master
    and the set of wells for each
    daughter.
    Create a set of daughter Create the new plate in the
    treatment plates, supplying the Experimental Database and
    number of plates to create, the generate the set of treatment
    range of treatment plate plate wells, setting the row,
    barcodes and the media volume column, concentration,
    added to the plates when concentration unit, treatment
    creating them from the master. volume, volume unit, and
    plate description from the
    master wells and the added
    media volume from input.
    Select a treatment plate well on Display the well information
    a master treatment plate. for the well, including row
    and column numbers;
    treatment ID, name,
    molecular mass, and
    molecular formula; compound
    concentration and volume;
    and plate description.
    Select and change a daughter Update the barcode or media
    plate by changing the barcode volume in the Experimental
    or media volume for the plate. Database.
    Remove a daughter plate from Mark the daughter plate as
    active use. inactive.
    End the use case. Commit the transaction.
  • In a preferred embodiment, a Treatment Plate Generator 1501 is a form and a stored procedure that uses the Assay Plate schema 1503 and the ActivityBase integration to generate daughter treatment plate records in the Assay Plate schema as illustrated in FIG. 15A.
  • In a specific embodiment, a Treatment Plate package contains most of the relevant persistent classes that the application uses. A Master Treatment Plate class is a view on the ActivityBase tables that represent treatments and plates. It contains a barcode, a description, and an ActivityBase plate format. A Treatment Plate class represents a daughter treatment plate, a plate onto which one transfers some of the volume of treatments from the master treatment plate. It has a unique treatmentID (the implicit OID), a separate barcode, and the volume of media added to each well on the plate when the plate is set up. This volume is part of the ultimate calculation of the concentration of treatment compound in the daughter treatment plate well.
  • A Treatment Plate Well class represents a single well on the daughter treatment plate, and each well links to the corresponding well on the master treatment plate. All treatment plate wells have a treatment compound, empty wells do not exist in the Treatment Plate Well table. The class contains the row and column number that map to the master well, a concentration and concentration unit taken from the master well (so that there is no need to join to the view, a considerable performance problem), and a volume of treatment compound added to the treatment plate well. This will usually be the same volume for all wells on the plate, an assumption that the Treatment Plate Generator uses in generating the daughter plates.
  • Plate generation also requires the addition of a plate format tied to the master plate. The Treatment Plate Generator lets the user attach a plate format and checks to ensure the plate format is compatible with the ActivityBase plate layout.
  • The Plate Format has a plate type (8×12 or 96 wells versus 16×24 or 384 wells) and a group of well groups. A well group identifies a set of generic wells that will either be controls or will contain a single treatment (or possibly some other designation as time goes on). Each well in a well group has a row and column number to identify the well within the group (and to link the well to wells on treatment and assay plates).
  • The Treatment Plate Generator checks to make sure the basic plate type is compatible with the ActivityBase master plate format. It also checks to make sure the well group wells correspond to non-empty wells in the Master Treatment Plate Well table.
  • A sample user interface for the treatment plate generator is a single form as depicted in FIG. 15B.
  • The top block lets the user query any master treatment plate from ActivityBase. The lower block lets the user specify the number of plates to generate, the starting barcode, the volume of media to add to each well on each plate, and the volume of treatment to add to each well on each plate. When the user clicks on the Generate button, the application generates the plates.
  • The basic flow through the treatment plate generator form includes the activities depicted in FIG. 15C.
  • Process Tracking System
  • Cytometrix™ operates as a collection of systems interacting to run, track, and validate experiments. To validate processes and products, the system contains a feedback mechanism that provides information relating to the success or failure of any Cytometrix system.
  • A system failure occurs when an event happens as a result of system operation that departs from the requirements for the system. A system opportunity occurs when a system user or developer realizes that there is an opportunity to solve a problem in a better way or to improve operation of the system (synonyms: suggestion, enhancement). A system comment occurs when a system user gives some kind of feedback about the system other than a departure from requirements of a suggestion for improvement. All three events are a kind of system feedback that injects information into the automated system.
  • Note that modern quality assurance practice distinguishes between the “failures” of a system and the “faults” that cause those failures. As used herein, the term “defect” corresponds to the concept of fault. There is a many-to-many relationship between these concepts: a fault may cause many failures, and a failure may result from faults in several systems. The Process Tracking System addresses failure feedback, not fault tracking.
  • The process tracking system provides an information system that lets users (including developers), applications, and database servers create and track system failures. It provides applications that enable management to plan improvement work based on prioritization of the failures and to understand the current situation with respect to the life cycle of failures in the overall system. Managers can also use this system to improve the visibility of failures within the organization and to improve communication with respect to failures.
  • The process tracking system also provides an information system that lets users (including developers) suggest and track improvement opportunities. Provide applications that enable management to plan improvement work based on prioritization of the opportunities. Managers can also use this system to improve the visibility and communication of progress in realizing opportunities within the organization.
  • Finally, the process tracking system provides an information system that lets users make comments on operational systems. To this end, it provide applications that enable management to plan improvement work based on prioritization of the comments.
  • In one embodiment, a failure life cycle appears as shown in FIG. 16A. When the user creates a failure, it has status Reported 1601. A Manager assigns the failure to an Investigator, changing the status to Investigating 1603 until the Investigator or a Manager puts it into Resolving 1605 by assigning the problem to Development to discover the cause of the failure and fix it or decides to Ignore the problem, putting it into the Ignored state 1607. Resolving means that someone is working on fixing the failure. Again, a manager may decide to ignore the failure by putting it into the Ignored state from Resolving. Finally, when Development reports that the problem is fixed, a Manager verifies the fix and changes the status to Resolved 1609. When the failure is resolved, the life cycle ends.
  • The opportunity life cycle appears as shown in FIG. 16B. When a user or developer suggests an opportunity, it has status Suggested 1611. A Manager either approves the suggestion and assigns it to a Developer or rejects the suggestion. In the former case, the status becomes Approved 1613; in the latter, Rejected 1615. When the Developer integrates the changes into the system, the status changes to Built 1617. It is also possible for a Manager to decide to reject an approved opportunity, moving the status from Approved to Rejected.
  • A comment life cycle, as depicted in FIG. 16C, has one state, Made 1619. In one embodiment, the system does not support any other process relating to comments.
  • Priorities may be set to a number between 0 and 1, with 0 being lowest priority and 1 being highest priority. The text priorities may appear in form input fields, but the database will represent the priorities as decimal numbers to use in calculating the weighted metrics.
  • The actors in the Process Tracking System are both human and automated. As depicted in FIG. 16D, they include the following. A Reporter 1621 is any individual with authority to report a failure of, suggest an opportunity for, or comment on a Cytometrix™ system. An Investigator 1623 is any individual assigned the responsibility for investigating the causes of a failure or the usefulness of an opportunity. An Application 1625 is any running program that can access the failure database to log a failure in the program. A Database Server 1627 is any running server process that can access the failure database to log a failure on the database server. A Manager 1629 is an individual with responsibility for planning and control of Cytometrics systems. A Database Administrator 1631 is an individual with responsibility for maintaining database tables in the Information Management System schema. An Information Management System Database (not shown) is the schema and storage dedicated to managing information about the automated system as a product. Investigators are also Reporters, as are Managers. Investigators are also Discoverers in the Defect Tracking subsystem.
  • As depicted in FIG. 16D, the use cases for the Process Tracking System represent the transactions the various actors can undertake in the system.
  • A Maintain Failures use case 1633 may be understood as follows. A failure occurs when a system fails to perform its intended purpose. A Reporter enters or modifies failures. Investigators and Managers are also Reporters but have special privileges to add resolutions and set management priority.
  • Some processes for the Maintain Failures use case 1633 are depicted in Table 24.
    TABLE 24
    Actor System
    Optionally, query a set of failures. Retrieve the set, displaying ID,
    description, resolution,
    management priority, user
    priority, the ordered list of
    status changes, any linked
    defects, and any linked
    opportunities.
    Create a new user failure, specify Insert the user failure report
    the failing system, and supply the into the Database, supplying a
    description of the failure and the unique ID and creating an
    management and user priority of initial status history of
    the failure. Reported with a time stamp
    and changer (based on the
    Oracle username). The owner
    is the Reporter.
    Modify an existing failure by Modify the failure report in the
    editing the description, supplying Database.
    or editing a resolution
    description, or changing the user
    priority.
  • Various extensions are possible with this use case.
  • Extension 1: If a Manager decides to change the status of a failure, he or she sets the status to an appropriate value (see failure life cycle) and optionally changes the owner of the failure to another person and/or sets the management priority.
  • Extension 2: If a Investigator or Manager sees a relationship between one or more defects and a failure, the Investigator or Manager may link the failure to the defects by extending the use case. This permits management to resolve failures by fixing defects and then tracking the failure resolution through the fixing of the defects.
  • Extension 3: If an Investigator or Manager sees a relationship between a failure and an opportunity, the Investigator or Manager may link the failure to the opportunity by extending the use case. This permits management to resolve failures by creating opportunities and then track the failure resolution through opportunity implementation.
  • A Maintain Opportunities use case 1635 may involve a Reporter suggesting or modifying opportunities. Investigators and Managers track the opportunities. Table 25 elaborates.
    TABLE 25
    Actor System
    Optionally, query a set of Retrieve the set, showing ID,
    opportunities. description, target release, actual
    release, suggestor priority,
    management priority, the ordered
    list of status changes, any linked
    components, and any linked failures.
    Create a new opportunity and Insert the opportunity into the
    supply the description of the Database, supplying a unique ID and
    opportunity and the suggested creating an initial status history of
    priority of the opportunity. Suggested with a time stamp and
    changer (based on the Oracle
    username).
    Modify an existing opportunity Modify the opportunity in the
    by editing the description, Database, creating a revision status
    changing the status to an history with a time stamp, changer
    appropriate value (see (based on the Oracle username), and
    opportunity life cycle), the status the user sets.
    supplying a resolution
    description (with a change to
    status Resolved) or modifying
    an existing one, or supplying a
    management priority for the
    opportunity.
  • In a Maintain Comments use case 1637, a Reporter makes, modifies, or tracks comments as indicated in Table 26.
    TABLE 26
    Actor System
    Optionally, query a set of Retrieve the set, showing ID,
    comments. description, and priority and any
    links to the automated system.
    Make a comment, supplying the Insert the comment into the
    description of the comment and Database, supplying a unique ID
    its suggested priority. and creating an initial status history
    of Made with a time stamp and
    changer (based on the Oracle
    username).
    Modify an existing comment by Modify the comment in the
    editing the description or Database, setting the new
    changing the priority. description and priority.
  • A Maintain Deliverables use case 1639 may be understood as follows. A Database Administrator enters, changes, or removes deliverables from the system. A deliverable is a reusable system that is one of several kinds of system that delivers value to a customer (a product document, a hardware system, or a software system). Deliverables can be a major source for failures. Exemplary processes for this use case are depicted in Table 27.
    TABLE 27
    Actor System
    Create a new deliverable, Create the deliverable in
    specifying the deliverable name, the database, generating a
    type (Document, Hardware, unique identifier and
    Software), description, project data displaying it.
    (planned value, earned value, actual
    value, actual cost), and system
    characteristics (vision, mission,
    risk, objectives, and so on).
    Query a deliverable based on ID, Display the query result
    name, type, or description. set, displaying ID, name,
    type, and description.
    Display only active
    deliverables (inactive is
    false).
    Modify the name, type, and/or Store the changes in the
    description of the deliverable. database. If the type
    changes, remove the
    existing objects and
    replace them in the correct
    tables.
    Remove the deliverable. Mark the deliverable
    inactive in the database.
  • A Log Application Failure use case 1641 may be understood as follows. Application software systems log their failures to the Experiment database as application failures. See Table 28 for a sample process.
    TABLE 28
    Actor System
    Create an application Insert the failure into the
    failure, specifying the error Database, supplying a unique ID,
    number, the name of the creating an initial status history of
    software system actor Reported with a timestamp and
    logging the error, the changer (based on the program
    namespace and name of the name), and linking the application
    failing module, and error failure to the indicated module.
    (“description”) and context
    messages.
  • In a Log Database Object Failure use case 1643, the database server can log a failure in a database object in the automated system Database. An exemplary process for this use case is depicted in Table 29.
    TABLE 29
    Actor System
    Create a database object failure, Insert the failure into the Database,
    specifying the error number; the supplying a unique ID, creating an
    name of the software system actor initial status history of Reported
    logging the error; schema, object with a timestamp and changer
    type, and name of the failing (based on the Oracle username), and
    object; and error (“description”) linking the failure to the indicated
    and context messages. schema object.
  • Two possible extensions to this use case follow.
  • Extension 1: If the program logging the error does not exist in the configuration database, the logger raises an application exception.
  • Extension 2: If the system cannot insert the failure into the database for some reason, the logger raises an application exception. One reason might be that the database object does not exist in the configuration database, for example.
  • A Report Status of Failures use case 1645 may be understood as follows. The Investigator and Manager can generate a report of failure status from the system Database.
  • Note that in a typical system there are three types of failure: user failures, application failures, and database object failures. Each type has some special report needs. These may be separate reports or they may be sections in a single report, or you might figure out a way to combine them into a single report with one section. Table 30 presents more information.
    TABLE 30
    Actor System
    Request a status report, Generate a report displaying
    specifying the inclusive status the current failure status,
    change dates between which to failure ID, description,
    select failures (default all failures) status date, reusable system
    and a minimum management ID and name, owner ID and
    priority (default 0). name, resolution,
    management priority, and
    user priority. Break on
    status. Order by status and
    failure ID.
  • Extension 1: If the report lists user failures, display the user priority.
  • Extension 2: If the report lists application failures, display the system error ID, the system error message, and the context.
  • Extension 3: If the report lists database object failures, display the database identifier, schema name, schema object name, system error ID, system error message, and context.
  • In a Report Status of Opportunities use case 1647, the Investigator and Manager can generate a report of opportunity status from the automated system Database. See Table 31.
    TABLE 31
    Actor System
    Request a status report, Generate a report ordered
    specifying the inclusive status by priority and breaking on
    change dates between which to last reported status
    select opportunities (default all displaying the opportunity
    opportunities), a minimum ID, system ID and name,
    management priority (default 0), description, resolution,
    and a person who was the last suggestor priority, and
    person to change the status of the management priority.
    opportunity.
  • In a Manage System Tables use case 1649, the Database Administrator manages the various tables that support the Process Tracking process. See Table 32.
    TABLE 32
    Actor System
    Optionally, query a set of data. Retrieve the set, displaying
    all the columns from the
    table.
    Create a new row and supply Insert the new row, creating
    whatever data is required. new ID as required.
    Modify an existing row by Modify the row in the
    changing data as appropriate. Database as specified.
  • Tables to administer include the following: Problem Status, System Error, and Actor (including people, organizations, and programs).
  • Defect Tracking System
  • A system defect or fault is a flaw in a reusable system that has the potential to cause the system to fail to achieve its mission. A Defect Tracking System should provide consistent, easily accessed feedback about defects in automated systems to management in a persistent format. The associated information system should let users (including developers), applications, and database servers create and track system defects. It should provide applications that enable management to plan improvement work based on prioritization of defect fixing and to understand the current situation with respect to the life cycle of defects in the overall system. Managers can also use this system to improve the visibility of defects within the organization and to improve communication with respect to defects.
  • The defect life cycle appears as shown in FIG. 16E. When a user discovers a defect, it has status Discovered 1651. Management may then decide to get the defect fixed (Fixing 1653) or to ignore the defect (Ignored 1655). When the defect is in Fixing status, it moves to Fixed status 1657 when the user integrates the defect fix into the configuration management system and tests the fix. It is also possible for a manager to decide to ignore the defect after trying for awhile to fix it. When a failure moves to the Ignored state 1655 or to the Fixed state 1653, the life cycle ends.
  • The actors in a the Failure Tracking System are depicted in FIG. 16F. They may be both human and automated. A Discoverer 1659 is any individual with authority to report a defect in a Cytometrix™ system. A Fixer 1661 is any individual assigned the responsibility for investigating the root causes of the defect and for implementing a fix to the defect. A Manager 1663 is an individual with responsibility for planning and control of automated systems. A Database Administrator 1665 is an individual with responsibility for maintaining database tables in the Information Management System schema. An Information Management System Database 1667 is the schema and storage dedicated to managing information about the automated system as a product. Fixers may also be Discoverers, as are Managers.
  • As illustrated in FIG. 16F, the use cases for the Failure Tracking System represent the transactions the various actors can undertake in the system. A Maintain Components use case 1669 may be understood as follows. A Database Administrator enters, changes, or removes components from the system. A component is a reusable system that is either a module (hardware, software, database, or file) or a subsystem comprising several modules. Components are the major source for defects that cause failures in deliverables and other systems (see the Process Tracking System Use Cases for details on failures). In particular, all system failures logged automatically are logged against a component. Table 33 provides some relevant processes for the Maintain Components use case 1669.
    TABLE 33
    Actor System
    Create a new component, specifying Create the component in the
    the component name, type (Subsystem, database, generating a unique
    Hardware, Software, Database, or File), identifier and displaying it.
    description, and system characteristics
    (vision, mission, risk, objectives, and
    so on).
    Query a component based on ID, name, Display the query result set,
    type, or description. displaying ID, name, type, and
    description. Display only
    active components (inactive is
    false).
    Modify the name, type, and/or Store the changes in the
    description of the component. database. If the type changes,
    remove the existing objects
    and replace them in the correct
    tables.
    Remove the component. Mark the component inactive
    in the database.
  • In a Maintain Defects use case 1671, a Discoverer enters system defects and modifies or tracks them. Fixers and Managers are also Discoverers but have special privileges to change status and to set management priorities. See Table 34.
    TABLE 34
    Actor System
    Optionally, query a set of Retrieve the set, displaying
    defects for a component component name, ID,
    system. description, cause, fix
    description, priority, the
    ordered list of status
    changes, and any linked
    failures
    Create a new defect for a Insert the defect report into
    component, identify the the Database, supplying a
    system that is defective, and unique ID and creating an
    supply the description of the initial status history of
    defect and the priority of the Discovered with a time
    failure. stamp and changer (based on
    the Oracle username).
    Modify an existing defect by Modify the defect report in
    editing the description, the Database, creating a
    changing the status to an revision status history with a
    appropriate value (see defect time stamp, changer (based
    life cycle), supplying or on the Oracle username), and
    modifying a cause, supplying the status the user sets.
    or modifying a fix
    description (with a change to
    status Fixed), or modifying
    the priority for the defect.
  • In a Report Status of Defects use case 1673, the Fixer and Manager can generate a report of defect status from the automated system Database. See Table 35.
    TABLE 35
    Actor System
    Request a status report, specifying Generate a report displaying the
    the inclusive dates between which defect status, defect ID, description,
    to select defects (default all system ID and name, owner ID and
    failures) and a minimum priority name, cause, fix description, and
    (default 0). priority. Break the report on status.
    Order the report by status and
    priority.
  • In a Manage System Tables use case 1675, the Database Administrator manages the various tables that support the failure tracking process. See Table 36.
    TABLE 36
    Actor System
    Optionally, query a set of data. Retrieve the set, displaying all
    the columns from the table.
    Create a new row and supply Insert the new row, creating
    whatever data is required. new ID as required.
    Modify an existing row by Modify the row in the
    changing data as appropriate. Database as specified.
  • Tables to administer include the following: ProblemStatus, ObjectType, and Language.
  • Defect Report
  • The Defect Report provides a sorted list of defects with status Discovered or Fixing. The report provides information on defects to a Quality Review Board, for example, for management and prioritization of defect fixing. The report is sorted into those two status categories (in that order), then by descending priority (highest priority first). Within each status grouping, the report displays the defect ID, the description, the system against which the defect was logged, the priority, the current owner of the defect, and a list of failures that the defect causes. The report lets you specify a date range for the last status date change and a minimum priority to display, letting you list defects changed between certain dates and defects at or above a certain priority. QRB members and managers should be able to access a current version of the report on demand, either as an HTML file or as a PDF (Adobe Acrobat document).
  • There are only two significant actors beyond those specifically discussed in the context of the Defect Tracking use cases (FIG. 16F). These are a QRB Member 1679, who is a member of the Quality Review Board, and a Manager 1681, who is a departmental manager. See FIG. 16G.
  • The Defect Report system is part of the Defect Tracking system. The context diagram of FIG. 16G shows the Report Status of Defects use case in the context of the other use cases in the Defect Tracking system.
  • The Report Status of Defects use case 1673 was touched on above. In this use case, the Manager or QRB Member generates a current Defect Report. The user can specify a date range for the last status change; this selects defects that have changed during that time interval. The user can also specify a minimum priority; this selects defects at or above that priority (on a scale of 0 to 100, where 0 is lowest priority and 100 is highest priority). Finally, the user can request a specific display format for the report (HTML or PDF).
  • The System displays a report in the requested format with the requested defects in Discovered and Fixing status. The report groups the defects into two groups in order: Discovered and Fixing.
  • During operation in this use case, the user runs the report. The system then displays the report in PDF format for all Discovered or Fixing defects at or above priority 50. The report groups the defects into two groups, in order: Discovered and Fixing. The report displays for each group the defect ID, defect description, system name, priority, current owner, and list of failures the defect causes.
  • In one extension, a user supplies a date range. The system subsets the defects to display only defects with the last status change occurring between the dates. In another extension, the user supplies priority between 0 and 100. In response, the system subsets the defects to display only defects with a priority greater than or equal to the supplied priority. In another extension, the user supplies HTML. The system displays the defect report in HTML in the web browser.
  • Other Embodiments
  • Although the above has generally described the present invention according to specific processes and apparatus, the present invention has a much broader range of applicability. In particular, the present invention is not limited to any particular kind of biological image data, but can be applied to virtually any cellular images or markers. It is not necessarily limited to the specific algorithms and calculations described herein. Further, the invention is not limited to any particular arrangement of selected hardware or software products. Rather the invention can be practiced with any combination of hardware and software products (whether or custom developed) that can provide the functions described herein. Thus, in some embodiments, the present invention could be implemented with numerous other products beyond those described herein. Of course, one of ordinary skill in the art would recognize other variations, modifications, and alternatives.

Claims (20)

1. An automated system for analyzing cellular images comprising:
(a) a plurality of feature extractor subsystems to extract features from images of assay plate wells, the features to be used in image analysis tasks;
(b) a supervisor subsystem for facilitating storage and retrieval of the images and coordinating feature extractors processes through message queues;
(c) a source of algorithms, each algorithm associated with an image analysis task;
(d) a source of input data; and
(e) an algorithm subsystem to interface with the source of algorithms and the source of input data.
2. The system of claim 1, wherein the image analysis tasks characterize a cellular organelle, a material in the cell, or a combination thereof.
3. The system of claim 2, wherein the image analysis tasks are selected from the group comprising determining the shape of a cell, characterizing the nucleic acid of a cell, characterizing the Golgi of a cell, and combinations thereof.
4. The system of claim 1, wherein the feature extractor subsystems perform the image analysis tasks.
5. The system of 4, wherein the supervisor subsystem allocates image analysis tasks across the feature extractor subsystems.
6. The system of claim 4, wherein the feature extractor subsystems perform the image analysis tasks in parallel.
7. The system of claim 1, wherein each feature extractor subsystem comprises one or more individual servers.
8. An automated method for analyzing a plurality of cellular images, the method comprising:
(a) generating a plurality of assay plate well image files;
(b) storing the image files in a depository;
(c) registering the image files with a database;
(d) identifying a plurality of image analysis tasks;
(e) for each identified image analysis task, selecting a feature extractor to handle the task;
(f) for each identified image analysis task, inputting one or more of the registered image files; and
(g) performing the identified image analysis tasks in parallel on the selected feature extractors.
9. The method of claim 8, wherein a supervisor software entity identifies the image analysis tasks and selects the feature extractors.
10. The method of claim 8, wherein a supervisor software entity stores and registers the image files.
11. The method of claim 8, further comprising, for each identified image analysis task, identifying an algorithm to extract features from the image files as part of the image analysis task.
12. The method of claim 11, further comprising importing the identified algorithm into the selected feature extractor for execution.
13. The method of claim 8, wherein the image analysis tasks characterize a cellular organelle, a material in the cell, or a combination thereof.
14. A method for designing and conducting a biological experiment comprising:
a) designing a biological experiment;
b) automatically generating processes to conduct the experiment;
c) constructing an assay plate used to conduct the biological experiment; and
d) automatically managing one or more of the processes to conduct the experiment.
15. The method of claim 14, further comprising generating an image of at least a portion of at least one well of the assay plate.
16. The method of claim 14, wherein at least some of the processes are selected from the following: plating processes, washing processes, fixing processes, staining processes, imaging processes, DNA analysis processes, non-DNA analysis processes and fluidics processes.
17. The method of claim 14, further comprising automatically tracking a cell line used in the experiment.
18. The method of claim 14, further comprising automatically tracking a reagent used in the experiment.
19. The method of claim 14, further comprising automatically tracking a treatment compound used in the experiment.
20. The method of claim 14, wherein designing the biological experiment comprises entering parameters defining the experiment using a user interface.
US11/256,454 2001-02-20 2005-10-19 Method and apparatus for automated cellular bioinformatics Abandoned US20060045348A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/256,454 US20060045348A1 (en) 2001-02-20 2005-10-19 Method and apparatus for automated cellular bioinformatics

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US27031401P 2001-02-20 2001-02-20
US10/467,183 US6999607B2 (en) 2001-02-20 2002-02-20 Method and apparatus for automated cellular bioinformatics
PCT/US2002/005266 WO2002066961A1 (en) 2001-02-20 2002-02-20 Method and apparatus for automated cellular bioinformatics
US11/256,454 US20060045348A1 (en) 2001-02-20 2005-10-19 Method and apparatus for automated cellular bioinformatics

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US10/467,183 Continuation US6999607B2 (en) 2001-02-20 2002-02-20 Method and apparatus for automated cellular bioinformatics
PCT/US2002/005266 Continuation WO2002066961A1 (en) 2001-02-20 2002-02-20 Method and apparatus for automated cellular bioinformatics

Publications (1)

Publication Number Publication Date
US20060045348A1 true US20060045348A1 (en) 2006-03-02

Family

ID=23030813

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/467,183 Expired - Fee Related US6999607B2 (en) 2001-02-20 2002-02-20 Method and apparatus for automated cellular bioinformatics
US11/256,454 Abandoned US20060045348A1 (en) 2001-02-20 2005-10-19 Method and apparatus for automated cellular bioinformatics

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/467,183 Expired - Fee Related US6999607B2 (en) 2001-02-20 2002-02-20 Method and apparatus for automated cellular bioinformatics

Country Status (4)

Country Link
US (2) US6999607B2 (en)
EP (1) EP1379855A1 (en)
GB (1) GB2389692B (en)
WO (1) WO2002066961A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050044110A1 (en) * 1999-11-05 2005-02-24 Leonore Herzenberg System and method for internet-accessible tools and knowledge base for protocol design, metadata capture and laboratory experiment management
US20070067336A1 (en) * 2005-09-20 2007-03-22 Innodata Isogen, Inc. Electronic publishing system and method for managing publishing requirements in a neutral format
US20070247463A1 (en) * 2006-04-21 2007-10-25 Beckman Coulter, Inc. Displaying cellular analysis result data using a template
US20100211602A1 (en) * 2009-02-18 2010-08-19 Keshav Menon Method and system for image matching
US20110161207A1 (en) * 2009-12-31 2011-06-30 Cerner Innovation, Inc. Biological Reagent Catalog
US20140153833A1 (en) * 2011-05-24 2014-06-05 Hitachi, Ltd. Image processing apparatus and method
US9043349B1 (en) 2012-11-29 2015-05-26 A9.Com, Inc. Image-based character recognition
US9147275B1 (en) 2012-11-19 2015-09-29 A9.Com, Inc. Approaches to text editing
US9342930B1 (en) 2013-01-25 2016-05-17 A9.Com, Inc. Information aggregation for recognized locations
US20160321495A1 (en) * 2013-10-07 2016-11-03 Ventana Medical Systems, Inc. Systems and methods for comprehensive multi-assay tissue analysis
US9536161B1 (en) 2014-06-17 2017-01-03 Amazon Technologies, Inc. Visual and audio recognition for scene change events
WO2018060523A3 (en) * 2016-09-30 2018-06-14 Ge Healthcare Bio-Sciences Corp Computer device for detecting an optimal candidate compound and methods thereof

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6673554B1 (en) * 1999-06-14 2004-01-06 Trellie Bioinformatics, Inc. Protein localization assays for toxicity and antidotes thereto
WO2002066961A1 (en) * 2001-02-20 2002-08-29 Cytokinetics, Inc. Method and apparatus for automated cellular bioinformatics
US6983307B2 (en) * 2001-07-11 2006-01-03 Kirusa, Inc. Synchronization among plural browsers
US7298885B2 (en) * 2002-11-27 2007-11-20 3M Innovative Properties Company Biological growth plate scanner with automated image processing profile selection
US20040101954A1 (en) * 2002-11-27 2004-05-27 Graessle Josef A. Back side plate illumination for biological growth plate scanner
US20040102903A1 (en) * 2002-11-27 2004-05-27 Graessle Josef A. Biological growth plate scanner
US7351574B2 (en) * 2002-11-27 2008-04-01 3M Innovative Properties Company Loading and ejection systems for biological growth plate scanner
US20070048732A1 (en) * 2005-08-30 2007-03-01 Hepahope, Inc. Chemosensitivity tester
US7496225B2 (en) * 2003-09-04 2009-02-24 3M Innovative Properties Company Biological growth plate scanner with automated intake
US7298886B2 (en) * 2003-09-05 2007-11-20 3M Innovative Properties Company Counting biological agents on biological growth plates
JP4454998B2 (en) * 2003-09-29 2010-04-21 株式会社ニコン Cell observation apparatus and cell observation method
US7752241B1 (en) * 2004-11-22 2010-07-06 Oracle America, Inc. Message based file system
US7606833B2 (en) * 2005-04-08 2009-10-20 The Mathworks, Inc. System and method for using an RMI activation system daemon with non-JAVA applications
US7562349B2 (en) * 2005-04-25 2009-07-14 Sap Ag Version adaptation interface for integration of different virtual machines
DE102006042157B4 (en) 2006-09-06 2013-03-21 Leica Microsystems Cms Gmbh Method and microscope system for scanning a sample
DE102007013566B4 (en) * 2007-03-21 2017-02-23 Siemens Healthcare Gmbh Method for image data acquisition and medical modality
US9047502B2 (en) * 2007-12-13 2015-06-02 Nikon Corporation Automatic system for judging quality of cell
JP5306382B2 (en) * 2008-03-04 2013-10-02 スリーエム イノベイティブ プロパティズ カンパニー Treatment of biological growth media based on measured manufacturing characteristics
US8417013B2 (en) * 2008-03-04 2013-04-09 3M Innovative Properties Company Information management in automated processing of biological growth media
US8934994B1 (en) 2008-07-30 2015-01-13 Rusty S. Lee Method and apparatus for automated fabrication
US20100161678A1 (en) * 2008-12-23 2010-06-24 Honeywell International Inc. Method and apparatus for utilizing matlab functionality in java-enabled environment
US8824769B2 (en) * 2009-10-16 2014-09-02 General Electric Company Process and system for analyzing the expression of biomarkers in a cell
US20110091081A1 (en) * 2009-10-16 2011-04-21 General Electric Company Method and system for analyzing the expression of biomarkers in cells in situ in their tissue of origin
US8320655B2 (en) * 2009-10-16 2012-11-27 General Electric Company Process and system for analyzing the expression of biomarkers in cells
CN102054221B (en) * 2010-12-07 2013-12-04 北京航空航天大学 Visual monitoring method for RMTSS (reliability, maintainability, testability, supportability, safety) characters during manufacturing process of complex products
US20150131887A1 (en) * 2011-04-15 2015-05-14 Fluofarma System and method to visualize and analyze data from image-based cellular assays or high content screening
US8934698B2 (en) 2011-06-22 2015-01-13 The Johns Hopkins University System and device for characterizing cells
US10467594B2 (en) 2012-08-03 2019-11-05 Label Independent, Inc. Systems and methods for designing, developing, and sharing assays
EP2713166B1 (en) * 2012-10-01 2019-05-22 Eppendorf Ag Laboratory device and method for the automatically treatment of laboratory samples
US10181974B2 (en) * 2012-12-04 2019-01-15 Genesys Telecommunications Laboratories, Inc. Distributed agent reservation in SIP cluster
US20150242395A1 (en) * 2014-02-24 2015-08-27 Transcriptic, Inc. Systems and methods for equipment sharing
JP6393053B2 (en) * 2014-03-27 2018-09-19 オリンパス株式会社 Cell observation information processing system, cell observation information processing method, cell observation information processing program, recording unit provided in cell observation information processing system, device provided in cell observation information processing system
JP6670757B2 (en) 2014-12-26 2020-03-25 国立大学法人 東京大学 Judgment device, analysis method, and analysis program
US9811390B1 (en) * 2015-03-30 2017-11-07 EMC IP Holding Company LLC Consolidating tasks into a composite request
CN109827891A (en) * 2019-02-01 2019-05-31 天津中环领先材料技术有限公司 A kind of COP detection method based on SP1 particle test instrument
DE102019114012A1 (en) * 2019-05-24 2020-11-26 Carl Zeiss Microscopy Gmbh Microscopy method, microscope and computer program with verification algorithm for image processing results
GB2587432A (en) * 2019-09-30 2021-03-31 Univ Dublin City System and method for software architecture redesign
CN112649367B (en) * 2020-12-07 2023-03-28 南京溯远基因科技有限公司 Quantitative evaluation system of gene analyzer

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5369566A (en) * 1986-03-26 1994-11-29 Beckman Instruments, Inc. User programmable control
US5548661A (en) * 1991-07-12 1996-08-20 Price; Jeffrey H. Operator independent image cytometer
US5989835A (en) * 1997-02-27 1999-11-23 Cellomics, Inc. System for cell-based screening
US6031930A (en) * 1996-08-23 2000-02-29 Bacus Research Laboratories, Inc. Method and apparatus for testing a progression of neoplasia including cancer chemoprevention testing
US6103479A (en) * 1996-05-30 2000-08-15 Cellomics, Inc. Miniaturized cell array methods and apparatus for cell-based screening
US6272235B1 (en) * 1997-03-03 2001-08-07 Bacus Research Laboratories, Inc. Method and apparatus for creating a virtual microscope slide
US6453241B1 (en) * 1998-12-23 2002-09-17 Rosetta Inpharmatics, Inc. Method and system for analyzing biological response signal data
US20020141631A1 (en) * 2001-02-20 2002-10-03 Cytokinetics, Inc. Image analysis of the golgi complex
US20020154798A1 (en) * 2001-02-20 2002-10-24 Ge Cong Extracting shape information contained in cell images
US20020155420A1 (en) * 2001-02-20 2002-10-24 Vaisberg Eugeni A. Characterizing biological stimuli by response curves
US20030228565A1 (en) * 2000-04-26 2003-12-11 Cytokinetics, Inc. Method and apparatus for predictive cellular bioinformatics
US6743576B1 (en) * 1999-05-14 2004-06-01 Cytokinetics, Inc. Database system for predictive cellular bioinformatics
US6768982B1 (en) * 2000-09-06 2004-07-27 Cellomics, Inc. Method and system for creating and using knowledge patterns
US6999607B2 (en) * 2001-02-20 2006-02-14 Cytokinetics, Inc. Method and apparatus for automated cellular bioinformatics

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996009598A1 (en) * 1994-09-20 1996-03-28 Neopath, Inc. Cytological slide scoring apparatus
AU734704B2 (en) 1996-05-30 2001-06-21 Cellomics, Inc. Miniaturized cell array methods and apparatus for cell-based screening
EP0983498B1 (en) 1997-02-27 2004-05-26 Cellomics, Inc. A system for cell-based screening
AU2241899A (en) 1998-01-29 1999-08-16 Ribozyme Pharmaceuticals, Inc. Image acquisition and image analysis of biological material
WO1999067739A1 (en) 1998-06-25 1999-12-29 University Of Iowa Research Foundation Three dimensional dynamic image analysis system
AU4992599A (en) 1998-07-13 2000-02-01 Cellomics, Inc. A system for cell-based screening
JP2002525603A (en) 1998-09-18 2002-08-13 セロミックス インコーポレイテッド System for cell-based screening
CA2345151A1 (en) 1998-09-22 2000-03-30 Cellomics, Inc. Miniaturized cell array methods and apparatus for cell-based screening
EP1131471B1 (en) 1998-10-30 2002-10-02 Cellomics, Inc. A system for cell-based screening
ATE292822T1 (en) 1998-11-13 2005-04-15 Cellomics Inc METHOD AND SYSTEM FOR EFFICIENTLY OBTAINING AND STORING EXPERIMENTAL DATA
EP1314980B1 (en) 1999-02-26 2009-12-09 Cellomics, Inc. A system for cell-based screening
WO2000060356A1 (en) 1999-04-01 2000-10-12 Cellomics, Inc. Miniaturized cell array methods and apparatus for cell-based screening
AU4847100A (en) 1999-05-14 2000-12-05 Cytokinetics, Inc. Method and apparatus for predictive cellular bioinformatics
WO2000072258A2 (en) 1999-05-24 2000-11-30 Cellomics, Inc. Method and system for general purpose analysis of experimental data

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5369566A (en) * 1986-03-26 1994-11-29 Beckman Instruments, Inc. User programmable control
US5548661A (en) * 1991-07-12 1996-08-20 Price; Jeffrey H. Operator independent image cytometer
US6103479A (en) * 1996-05-30 2000-08-15 Cellomics, Inc. Miniaturized cell array methods and apparatus for cell-based screening
US6031930A (en) * 1996-08-23 2000-02-29 Bacus Research Laboratories, Inc. Method and apparatus for testing a progression of neoplasia including cancer chemoprevention testing
US6101265A (en) * 1996-08-23 2000-08-08 Bacus Research Laboratories, Inc. Method and apparatus for acquiring and reconstructing magnified specimen images from a computer-controlled microscope
US5989835A (en) * 1997-02-27 1999-11-23 Cellomics, Inc. System for cell-based screening
US6272235B1 (en) * 1997-03-03 2001-08-07 Bacus Research Laboratories, Inc. Method and apparatus for creating a virtual microscope slide
US6453241B1 (en) * 1998-12-23 2002-09-17 Rosetta Inpharmatics, Inc. Method and system for analyzing biological response signal data
US6847897B1 (en) * 1998-12-23 2005-01-25 Rosetta Inpharmatics Llc Method and system for analyzing biological response signal data
US6743576B1 (en) * 1999-05-14 2004-06-01 Cytokinetics, Inc. Database system for predictive cellular bioinformatics
US20030228565A1 (en) * 2000-04-26 2003-12-11 Cytokinetics, Inc. Method and apparatus for predictive cellular bioinformatics
US6768982B1 (en) * 2000-09-06 2004-07-27 Cellomics, Inc. Method and system for creating and using knowledge patterns
US20020155420A1 (en) * 2001-02-20 2002-10-24 Vaisberg Eugeni A. Characterizing biological stimuli by response curves
US20020154798A1 (en) * 2001-02-20 2002-10-24 Ge Cong Extracting shape information contained in cell images
US20020141631A1 (en) * 2001-02-20 2002-10-03 Cytokinetics, Inc. Image analysis of the golgi complex
US6999607B2 (en) * 2001-02-20 2006-02-14 Cytokinetics, Inc. Method and apparatus for automated cellular bioinformatics

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050044110A1 (en) * 1999-11-05 2005-02-24 Leonore Herzenberg System and method for internet-accessible tools and knowledge base for protocol design, metadata capture and laboratory experiment management
US7555492B2 (en) * 1999-11-05 2009-06-30 The Board Of Trustees At The Leland Stanford Junior University System and method for internet-accessible tools and knowledge base for protocol design, metadata capture and laboratory experiment management
US20070067336A1 (en) * 2005-09-20 2007-03-22 Innodata Isogen, Inc. Electronic publishing system and method for managing publishing requirements in a neutral format
US20070247463A1 (en) * 2006-04-21 2007-10-25 Beckman Coulter, Inc. Displaying cellular analysis result data using a template
WO2007124233A3 (en) * 2006-04-21 2008-07-31 Beckman Coulter Inc Displaying cellular analysis result data using a template
US8217943B2 (en) 2006-04-21 2012-07-10 Beckman Coulter, Inc. Displaying cellular analysis result data using a template
US20100211602A1 (en) * 2009-02-18 2010-08-19 Keshav Menon Method and system for image matching
US8738647B2 (en) * 2009-02-18 2014-05-27 A9.Com, Inc. Method and system for image matching
US20110161207A1 (en) * 2009-12-31 2011-06-30 Cerner Innovation, Inc. Biological Reagent Catalog
US8412596B2 (en) * 2009-12-31 2013-04-02 Cerner Innovation, Inc. Biological reagent catalog
US20140153833A1 (en) * 2011-05-24 2014-06-05 Hitachi, Ltd. Image processing apparatus and method
US9147275B1 (en) 2012-11-19 2015-09-29 A9.Com, Inc. Approaches to text editing
US9043349B1 (en) 2012-11-29 2015-05-26 A9.Com, Inc. Image-based character recognition
US9390340B2 (en) 2012-11-29 2016-07-12 A9.com Image-based character recognition
US9342930B1 (en) 2013-01-25 2016-05-17 A9.Com, Inc. Information aggregation for recognized locations
US20160321495A1 (en) * 2013-10-07 2016-11-03 Ventana Medical Systems, Inc. Systems and methods for comprehensive multi-assay tissue analysis
US10650221B2 (en) * 2013-10-07 2020-05-12 Ventana Medical Systems, Inc. Systems and methods for comprehensive multi-assay tissue analysis
US9536161B1 (en) 2014-06-17 2017-01-03 Amazon Technologies, Inc. Visual and audio recognition for scene change events
WO2018060523A3 (en) * 2016-09-30 2018-06-14 Ge Healthcare Bio-Sciences Corp Computer device for detecting an optimal candidate compound and methods thereof
US11636924B2 (en) * 2016-09-30 2023-04-25 Molecular Devices, Llc Computer device for detecting an optimal candidate compound and methods thereof
US20240013867A1 (en) * 2016-09-30 2024-01-11 Molecular Devices, Llc Computer device for detecting an optimal candidate compound and methods thereof

Also Published As

Publication number Publication date
GB2389692A (en) 2003-12-17
GB2389692B (en) 2005-06-29
GB0321748D0 (en) 2003-10-15
EP1379855A1 (en) 2004-01-14
WO2002066961A1 (en) 2002-08-29
US6999607B2 (en) 2006-02-14
US20040117124A1 (en) 2004-06-17

Similar Documents

Publication Publication Date Title
US6999607B2 (en) Method and apparatus for automated cellular bioinformatics
EP1015969B1 (en) Method and system for database application software creation requiring minimal programming
US7562339B2 (en) System architecture for business process development and execution with introspection and generic components
Fernstrom PROCESS WEAVER: Adding process support to UNIX
Leymann et al. Business process management with flowmark
US6115646A (en) Dynamic and generic process automation system
US6144967A (en) Object oriented processing log analysis tool framework mechanism
US8645326B2 (en) System to plan, execute, store and query automation tests
US6618852B1 (en) Object-oriented framework for chemical-process-development decision-support applications
Jäger et al. Using UML for software process modeling
US9513874B2 (en) Enterprise computing platform with support for editing documents via logical views
WO2001048603A9 (en) Object oriented software development tool with the ability to create or purchase new components and add them to an inventory (catalog)
US7908581B2 (en) Information management and tracking system (IMTS)
US9858121B1 (en) Context subsystems for system configurations
US20050071350A1 (en) Systems and methods for information technology resource management
US20100153155A1 (en) Method and system for identifying software applications for offshore testing
Mato GAUDI-Architecture design document
GB2407193A (en) Apparatus for automated cellular bioinformatics
McClatchey et al. A distributed workflow and product data management application for the construction of large scale scientific apparatus
Vaisberg et al. An infrastructure for high‐throughput microscopy: instrumentation, informatics, and integration
Papaioannou et al. Mobile agent technology in support of sales order processing in the virtual enterprise
Casquero et al. Customization of agent-based manufacturing applications based on domain modelling
EP1493096B1 (en) Data-centric automation
CA2438347A1 (en) Method and apparatus for providing an automated information management for high throughput screening
Hentrich Six Patterns for Process-Driven Architectures.

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION