CA2166464C - Computerized microscope specimen encoder - Google Patents
Computerized microscope specimen encoder Download PDFInfo
- Publication number
- CA2166464C CA2166464C CA002166464A CA2166464A CA2166464C CA 2166464 C CA2166464 C CA 2166464C CA 002166464 A CA002166464 A CA 002166464A CA 2166464 A CA2166464 A CA 2166464A CA 2166464 C CA2166464 C CA 2166464C
- Authority
- CA
- Canada
- Prior art keywords
- slide
- computer
- microscope
- movement
- specimen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 76
- 230000000875 corresponding effect Effects 0.000 claims abstract description 13
- 230000002596 correlated effect Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 25
- 238000012552 review Methods 0.000 claims description 20
- 230000000694 effects Effects 0.000 claims description 6
- 230000001575 pathological effect Effects 0.000 abstract description 7
- 238000005096 rolling process Methods 0.000 abstract description 6
- 230000001755 vocal effect Effects 0.000 abstract description 5
- 238000004458 analytical method Methods 0.000 abstract description 3
- 238000013518 transcription Methods 0.000 abstract description 2
- 230000035897 transcription Effects 0.000 abstract description 2
- 238000012216 screening Methods 0.000 description 5
- 230000010076 replication Effects 0.000 description 4
- 206010028980 Neoplasm Diseases 0.000 description 3
- 201000011510 cancer Diseases 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 239000010432 diamond Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000010437 gem Substances 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000004163 cytometry Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009595 pap smear Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/34—Microscope slides, e.g. mounting specimens on microscope slides
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/2813—Producing thin layers of samples on a substrate, e.g. smearing, spinning-on
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/26—Stages; Adjusting means therefor
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/40—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/2813—Producing thin layers of samples on a substrate, e.g. smearing, spinning-on
- G01N2001/282—Producing thin layers of samples on a substrate, e.g. smearing, spinning-on with mapping; Identification of areas; Spatial correlated pattern
Abstract
A computerized slide encoder for use with microscope analysis and pathological studies. The slide encoder is attached to the movable microscope stage, whereby x-y direction plane movement and location, is correlated to examination of an identified slide, with information marking and location being directly correspondingly written, at pre-defined times, on computer storage media, during the examination. Subsequent use of the computer-stored information, coupled with the slide encoder, in a slide re-examination, permits independent retrieval of such information and location on the slide. The computer storage media includes digitized vocal transcription of history of the slide made during the original examination.
An embodiment of the slide encoder includes a computer mouse pen affixed to the stage of the microscope and a rolling surface, for the mouse pen, being affixed to the movable slide holder. Examination movement of the slide causes a corresponding movement of the rolling surface and the roller ball of the mouse pen. Alternatively, the control movement of the slide holder and microscope stage is directly linked to a computer bus for a direct, software controlled, recordation of slide examination and information location markings.
An embodiment of the slide encoder includes a computer mouse pen affixed to the stage of the microscope and a rolling surface, for the mouse pen, being affixed to the movable slide holder. Examination movement of the slide causes a corresponding movement of the rolling surface and the roller ball of the mouse pen. Alternatively, the control movement of the slide holder and microscope stage is directly linked to a computer bus for a direct, software controlled, recordation of slide examination and information location markings.
Description
95/02204 ~ PCT/US94/07616 COMPUTERIZED MICROSCOPE SPECIMEN ENCODER
~'~.eld of the Invention . 5 This invention relates to computerized location marking of information on microscope specimens such as on microscope slides, with particular utility in pathological examination and re-examination of the slides.
BACKGROUND OF THE INVENTION
Specimen slides such as Pap smears are examined by microscope users for specific types of events such as cancer cells. These events are, however, relatively rare and once found are difficult to re-locate for confirmation by others. This is a severe drawback, since an important requirement for cancer screening laboratories is certification by a pathologist, with the need for independent relocation.
The prevailing method in aiding relocation is the placement of an ink dot on the slide near the location of the event. This method has proven to be awkward, time consuming and inaccurate. In addition, with this method, it is not possible to ascertain if the entire specimen area of the slide has been uniformly examined or if the areas of the specimen have or have not been scanned. It is accordingly often the case, that if the user is interrupted, it is necessary to restart slide examination. With microscope examination of items, such as diamonds or other types of jewels, for identifying characteristics, the use of ink dots can actually detrimentally mar the appearance of the item.
Ink dot marking and other similar location methods also do not provide any information at all regarding the rate (an important quality control factor) at which each area WO 95/02204 ~ ~ PCT/US94/07616 has been examined. The dots merely function as markers and cannot provide a description of the event or any scan history record. As a result of the realization that cancer screening is inaccurate, because areas are missed, , there is a major effort in place to improve the quality of screening laboratories by requiring re-screening of randomly selected slides.
In accordance with current ink dot marking practice, l0 slides are marked with ink dots, at particular events of interest, with electrically controlled pens or marking, with the push of a button. These marking devices are exemplified by those disclosed in US Patent Nos.
~'~.eld of the Invention . 5 This invention relates to computerized location marking of information on microscope specimens such as on microscope slides, with particular utility in pathological examination and re-examination of the slides.
BACKGROUND OF THE INVENTION
Specimen slides such as Pap smears are examined by microscope users for specific types of events such as cancer cells. These events are, however, relatively rare and once found are difficult to re-locate for confirmation by others. This is a severe drawback, since an important requirement for cancer screening laboratories is certification by a pathologist, with the need for independent relocation.
The prevailing method in aiding relocation is the placement of an ink dot on the slide near the location of the event. This method has proven to be awkward, time consuming and inaccurate. In addition, with this method, it is not possible to ascertain if the entire specimen area of the slide has been uniformly examined or if the areas of the specimen have or have not been scanned. It is accordingly often the case, that if the user is interrupted, it is necessary to restart slide examination. With microscope examination of items, such as diamonds or other types of jewels, for identifying characteristics, the use of ink dots can actually detrimentally mar the appearance of the item.
Ink dot marking and other similar location methods also do not provide any information at all regarding the rate (an important quality control factor) at which each area WO 95/02204 ~ ~ PCT/US94/07616 has been examined. The dots merely function as markers and cannot provide a description of the event or any scan history record. As a result of the realization that cancer screening is inaccurate, because areas are missed, , there is a major effort in place to improve the quality of screening laboratories by requiring re-screening of randomly selected slides.
In accordance with current ink dot marking practice, l0 slides are marked with ink dots, at particular events of interest, with electrically controlled pens or marking, with the push of a button. These marking devices are exemplified by those disclosed in US Patent Nos.
3,600,057; 4,262,426; 4,690,521; and 5,076,679.
More sophisticated location methods, with event location coordinates, include those, such as disclosed in US
Patent No. 4,190,314, wherein microscope slides or cover slips are marked with a grid of lines which is visible through the microscope lens. However, it is necessary to continually interrupt scanning to write down coordinates.
Furthermore, no scan history is possible and special slides are required for each specimen.
Similarly, US Patent Nos. 1,996,141 and 3,514,180 provide viewable stage coordinates and modern microscopes are , available with scales to determine stage position However, there is no scan history and the user must stop scanning to interpret the scale and write down the coordinates of events of interest.
Motor controlled stage or slide holder devices such as embodied in US Patent Nos. 3,999,047; 4,012,112;
More sophisticated location methods, with event location coordinates, include those, such as disclosed in US
Patent No. 4,190,314, wherein microscope slides or cover slips are marked with a grid of lines which is visible through the microscope lens. However, it is necessary to continually interrupt scanning to write down coordinates.
Furthermore, no scan history is possible and special slides are required for each specimen.
Similarly, US Patent Nos. 1,996,141 and 3,514,180 provide viewable stage coordinates and modern microscopes are , available with scales to determine stage position However, there is no scan history and the user must stop scanning to interpret the scale and write down the coordinates of events of interest.
Motor controlled stage or slide holder devices such as embodied in US Patent Nos. 3,999,047; 4,012,112;
4,833,382 and 5,072,382, generally provide a visible indicia on a slide for observation by the user with coordinates set into the device. The slide is moved in a meander pattern until an event of interest is discovered, at which point the slide is stopped and the position is recorded. While this provides both recording of position and a recording of scan history, it is limited by the need for the user to wait until the event comes into the field of view to stop the meander, rather than by controlling movement by hand.
Such devices, besides being very expensive, also interfere with normal use of the microscope and the motion control devices thereof detract from the feel of a normal microscope stage positioning control.
Very recently, a new device has been developed which utilizes personal computers to record slide data. This device, with video input to specially modified microscopes, superimposes the display of a computer output on the microscope, superimposes the display of a computer output on the microscope field for viewing by the user. A mouse is used to mark off events of interest. The device is described in Cytometry, vol. 13, pages 109-166 (1992) and Analytical &
Quantitative Cytology & Histology, vol. 14, August 1992. While useful, such devices are inherently expensive and complex in requiring extensive modification of microscopes, thereby limiting their utility with respect to different field-available microscopes. As a result, widespread reviewing capability is severely restricted.
In accordance with the present invention, there is provided a computerized specimen encoder device for use during examination of a specimen, mounted on a slide stage of a microscope, wherein the slide stage is movable in an x-y direction plane, during said examination; the encoder device comprising, in conjunction with computer means: (a) correlation means for translating movement of the microscope stage, with mounted specimen, in the x-y direction plane, to retrievable corresponding computer pixel locations and cursor movement on a computer generated specimen image; (b) means for marking a 3a selected microscope viewing areas, as correlated to the computer pixel locations, on the computer generated specimen image, with indicia, at pre-selected time intervals; and (c) means for marking the indicia as being areas of interest for subsequent review, wherein said specimen is carried on a slide during said examination, and wherein said correlation means comprises a computer mouse element affixed to the movable slide stage, with said mouse element being positioned to operatively roll on a relatively stationary surface, in congruence with movement of the slide stage.
In accordance with the present invention, there is further provided a method for specimen encoding during scanning examination of a specimen with a microscope having a moving slide stage, on which said specimen is mounted, the method comprising the steps of: (a) operatively linking a computer, with correlation means, to the movable slide stage of the microscope, to correlatively record movement of the slide stage in an xy direction plane in which the slide stage is movable;
(b) generating a computer image of a predetermined area of the specimen to be examined; (c) fixedly placing the specimen on the movable stage of the microscope; (d) moving the stage, with concomitant specimen movement, until the microscope viewing area is fixed on a predetermined starting location point; (e) instructing the computer, operatively linked to said movable stage, to start to record subsequent movement in the x-y direction plane in which the stage and specimen are movable;
(f) moving the stage, with concomitant specimen movement, away from the starting location point, with microscope examination of the specimen at various locations on the specimen; with the linked computer, recording the movement and various locations on the generated image and into computer storage medium; (g) causing the computer to automatically record, on computer storage medium, indicia on the computer generated image of said r 3b specimen, at pre-determined time intervals, with said indicia correlating to a microscope viewing area location on the specimen, at the pre-determined time intervals; and (h) marking indicia of interest with a distinguishing marking for subsequent review recognition; (i) wherein said specimen is carried on a slide; and (j) wherein said marking comprises a computer generated numerical grading to selected indicia of interest.
SUMMARY OF THE INVENTION
Generally, the present invention comprises an economical encoding method for microscope examination of specimens, particularly of specimen slides, and a computerized encoder device for use in such method. The method and device are suitable for encoding any microscope examined specimen which presents one or more generally planar surfaces for viewing by the microscope lens. The method and device have particular utility in the encoding of pathological slide specimens and the following discussion WO 95/02204 ~ ~ ~ Q ~ ~ ~ PCT/U894/07616 is with reference to such utility.
The method and device are operable with universally available personal computers or with an inexpensive modified computer device to be described hereinafter.
Both method and device utilize the standard x-y plane motion of microscope slide stages and specimens such as specimen slides thereon, to effect encoding. The encoding is effected by correlating motion of the slide stage and of the slide to pixel locations on a computer generated image of the slide, for direct translation into a corresponding computer readable and storage retrievable replication. Such replication includes the motion of the slide during examination, as well as position location, on the slide, of events, and their relative degree of interest. The correlation replication and encoding is made initially with reference to preset location areas on slides to be examined. Accordingly, on review of the slide, the image and replication is retrieved by the re-initiation at such preset location area.
The encoder device of the present invention comprises, in conjunction with computer means or with integrated computer means, correlation means for translating movement of the microscope stage, with mounted slide, in the x-y plane, to retrievable corresponding computer pixel locations and cursor movement, which are stored on computer storage media linked to the computer means. The encoder device further comprises means for marking selected microscope viewing areas, as correlated to the computer pixel locations, with indicia, at pre-selected time intervals. Means are further included for marking the indicia with ratings of areas of interest and/or digitized vocalized or audio accounts. The encoder device further comprises reviewing means whereby a stored image of the indicia is reviewable, upon demand, and wherein movement of the microscope stage causes ~O 95/02204 ~'~' PCT/US94/07616 corresponding movement of a computer cursor on the image and the selected marked indicia.
With cursor location on a specific area of interest, and 5 positioning of the specimen slide on the microscope stage, the area is directly viewable under the microscope and a voice record associated with the event can be made or retrieved.
In accordance with the present invention, the slide encoder is attached to the movable stage of essentially any microscope with a moving stage, whereby x-y plane movement and location, is correlated to examination of an identified slide, with information marking and location being directly correspondingly written on computer storage media, during or directly after the examination.' The x-y plane described herein corresponds to the two dimensional viewed area of a specimen slide being examined.
Subsequent use of the computer-stored information, coupled with the slide encoder, in a slide re-examination, permits independent retrieval of such information and location on the same slide previously examined. The computer storage media may also include digitized vocal transcription of history of the slide and events, made during the original examination and/or subsequent re-examinations.
In a preferred economical embodiment of the present invention, the slide encoder includes a standard computer mouse pen affixed to the movable stage of the microscope.
A stationary surface (i.e. mouse pad), for the mouse pen to roll on, may be the supporting surface for the microscope, a surface element separately affixed to the non-moving frame of the microscope stage, or any other stationary element positioned in contact with the rolling WO 95/02204 ~ ~ .
Such devices, besides being very expensive, also interfere with normal use of the microscope and the motion control devices thereof detract from the feel of a normal microscope stage positioning control.
Very recently, a new device has been developed which utilizes personal computers to record slide data. This device, with video input to specially modified microscopes, superimposes the display of a computer output on the microscope, superimposes the display of a computer output on the microscope field for viewing by the user. A mouse is used to mark off events of interest. The device is described in Cytometry, vol. 13, pages 109-166 (1992) and Analytical &
Quantitative Cytology & Histology, vol. 14, August 1992. While useful, such devices are inherently expensive and complex in requiring extensive modification of microscopes, thereby limiting their utility with respect to different field-available microscopes. As a result, widespread reviewing capability is severely restricted.
In accordance with the present invention, there is provided a computerized specimen encoder device for use during examination of a specimen, mounted on a slide stage of a microscope, wherein the slide stage is movable in an x-y direction plane, during said examination; the encoder device comprising, in conjunction with computer means: (a) correlation means for translating movement of the microscope stage, with mounted specimen, in the x-y direction plane, to retrievable corresponding computer pixel locations and cursor movement on a computer generated specimen image; (b) means for marking a 3a selected microscope viewing areas, as correlated to the computer pixel locations, on the computer generated specimen image, with indicia, at pre-selected time intervals; and (c) means for marking the indicia as being areas of interest for subsequent review, wherein said specimen is carried on a slide during said examination, and wherein said correlation means comprises a computer mouse element affixed to the movable slide stage, with said mouse element being positioned to operatively roll on a relatively stationary surface, in congruence with movement of the slide stage.
In accordance with the present invention, there is further provided a method for specimen encoding during scanning examination of a specimen with a microscope having a moving slide stage, on which said specimen is mounted, the method comprising the steps of: (a) operatively linking a computer, with correlation means, to the movable slide stage of the microscope, to correlatively record movement of the slide stage in an xy direction plane in which the slide stage is movable;
(b) generating a computer image of a predetermined area of the specimen to be examined; (c) fixedly placing the specimen on the movable stage of the microscope; (d) moving the stage, with concomitant specimen movement, until the microscope viewing area is fixed on a predetermined starting location point; (e) instructing the computer, operatively linked to said movable stage, to start to record subsequent movement in the x-y direction plane in which the stage and specimen are movable;
(f) moving the stage, with concomitant specimen movement, away from the starting location point, with microscope examination of the specimen at various locations on the specimen; with the linked computer, recording the movement and various locations on the generated image and into computer storage medium; (g) causing the computer to automatically record, on computer storage medium, indicia on the computer generated image of said r 3b specimen, at pre-determined time intervals, with said indicia correlating to a microscope viewing area location on the specimen, at the pre-determined time intervals; and (h) marking indicia of interest with a distinguishing marking for subsequent review recognition; (i) wherein said specimen is carried on a slide; and (j) wherein said marking comprises a computer generated numerical grading to selected indicia of interest.
SUMMARY OF THE INVENTION
Generally, the present invention comprises an economical encoding method for microscope examination of specimens, particularly of specimen slides, and a computerized encoder device for use in such method. The method and device are suitable for encoding any microscope examined specimen which presents one or more generally planar surfaces for viewing by the microscope lens. The method and device have particular utility in the encoding of pathological slide specimens and the following discussion WO 95/02204 ~ ~ ~ Q ~ ~ ~ PCT/U894/07616 is with reference to such utility.
The method and device are operable with universally available personal computers or with an inexpensive modified computer device to be described hereinafter.
Both method and device utilize the standard x-y plane motion of microscope slide stages and specimens such as specimen slides thereon, to effect encoding. The encoding is effected by correlating motion of the slide stage and of the slide to pixel locations on a computer generated image of the slide, for direct translation into a corresponding computer readable and storage retrievable replication. Such replication includes the motion of the slide during examination, as well as position location, on the slide, of events, and their relative degree of interest. The correlation replication and encoding is made initially with reference to preset location areas on slides to be examined. Accordingly, on review of the slide, the image and replication is retrieved by the re-initiation at such preset location area.
The encoder device of the present invention comprises, in conjunction with computer means or with integrated computer means, correlation means for translating movement of the microscope stage, with mounted slide, in the x-y plane, to retrievable corresponding computer pixel locations and cursor movement, which are stored on computer storage media linked to the computer means. The encoder device further comprises means for marking selected microscope viewing areas, as correlated to the computer pixel locations, with indicia, at pre-selected time intervals. Means are further included for marking the indicia with ratings of areas of interest and/or digitized vocalized or audio accounts. The encoder device further comprises reviewing means whereby a stored image of the indicia is reviewable, upon demand, and wherein movement of the microscope stage causes ~O 95/02204 ~'~' PCT/US94/07616 corresponding movement of a computer cursor on the image and the selected marked indicia.
With cursor location on a specific area of interest, and 5 positioning of the specimen slide on the microscope stage, the area is directly viewable under the microscope and a voice record associated with the event can be made or retrieved.
In accordance with the present invention, the slide encoder is attached to the movable stage of essentially any microscope with a moving stage, whereby x-y plane movement and location, is correlated to examination of an identified slide, with information marking and location being directly correspondingly written on computer storage media, during or directly after the examination.' The x-y plane described herein corresponds to the two dimensional viewed area of a specimen slide being examined.
Subsequent use of the computer-stored information, coupled with the slide encoder, in a slide re-examination, permits independent retrieval of such information and location on the same slide previously examined. The computer storage media may also include digitized vocal transcription of history of the slide and events, made during the original examination and/or subsequent re-examinations.
In a preferred economical embodiment of the present invention, the slide encoder includes a standard computer mouse pen affixed to the movable stage of the microscope.
A stationary surface (i.e. mouse pad), for the mouse pen to roll on, may be the supporting surface for the microscope, a surface element separately affixed to the non-moving frame of the microscope stage, or any other stationary element positioned in contact with the rolling WO 95/02204 ~ ~ .
ball of the mouse. Examination movement of the slide causes a corresponding movement of the roller ball of the computer mouse pen on the rolling surface. Such movement is readily translated and stored in the computer storage media and is displayed in the form of a representative slide image on a direct viewing screen. Alternatively, the actual control movement mechanism of the slide holder is directly linked to a computer bus for a direct, software controlled, recordation of slide examination and information location markings.
In accordance with the slide encoding method of the present invention, the computer is instructed to and generates time contrplled markings such as dots, which correlate to slide viewing areas, on the representative slide image. For example, at time intervals of one second, as regulated by the internal clock of the computer, a dot is generated as being representative of the full area being viewed at that time. As a result, with a subsequent review of the slide, there is a specific correlation of the computer stored dot notation on the representative slide image, directly with an actual full viewing area of the slide. It is also readily ascertainable which areas have and have not been viewed. In addition, the density of dots is a direct indication of the rate at which the slide had been examined. Thus, closely spaced dots indicate a slow scan and widely dispersed dots indicate a more rapid scan.
Such information is critical for quality control evaluations.
With the marking generation or subsequent review, each marked area is readily labelled, such as with a numerical grading, to inform a reviewer of specific events and their relative importance. If desired, a digitized voice record describing the particular events being labelled .may also be generated and stored for correlative retrieval upon review of the slide.
It is an object of the present invention to provide a slide encoding device for a microscope, wherein movement of the microscope stage, and slide, provides a - corresponding record on computer storage media of slide examination, wherein, in effect, the microscope stage functions as a computer mouse device.
It is a further object of the present invention to provide computer generated markings, on a simulated corresponding slide image, stored on the computer storage medium, which can be retrieved and reviewed with direct relation to a review, of the specific actual slide viewing, with the markings being further selectively marked for events of interest.
It is a still further object of the present invention to provide a retrievable record of events of interest, original scanning rate, specific areas scanned and a record of events of interest.
These and other objects features and advantages of the present invention will become more evident from the following discussion and drawings in which:
SHORT DESCRIPTION OF THE DRAWINGS
Figure 1 is an isometric view of a microscope with an embodiment of the present invention in the form of a standard mouse pen affixed to the movable microscope stage;
Figure 2A-C are bottom views of the movable microscope stage of the microscope of Figure 1, showing direct computer connection to the movement mechanism of the microscope stage in alternative embodiments;
In accordance with the slide encoding method of the present invention, the computer is instructed to and generates time contrplled markings such as dots, which correlate to slide viewing areas, on the representative slide image. For example, at time intervals of one second, as regulated by the internal clock of the computer, a dot is generated as being representative of the full area being viewed at that time. As a result, with a subsequent review of the slide, there is a specific correlation of the computer stored dot notation on the representative slide image, directly with an actual full viewing area of the slide. It is also readily ascertainable which areas have and have not been viewed. In addition, the density of dots is a direct indication of the rate at which the slide had been examined. Thus, closely spaced dots indicate a slow scan and widely dispersed dots indicate a more rapid scan.
Such information is critical for quality control evaluations.
With the marking generation or subsequent review, each marked area is readily labelled, such as with a numerical grading, to inform a reviewer of specific events and their relative importance. If desired, a digitized voice record describing the particular events being labelled .may also be generated and stored for correlative retrieval upon review of the slide.
It is an object of the present invention to provide a slide encoding device for a microscope, wherein movement of the microscope stage, and slide, provides a - corresponding record on computer storage media of slide examination, wherein, in effect, the microscope stage functions as a computer mouse device.
It is a further object of the present invention to provide computer generated markings, on a simulated corresponding slide image, stored on the computer storage medium, which can be retrieved and reviewed with direct relation to a review, of the specific actual slide viewing, with the markings being further selectively marked for events of interest.
It is a still further object of the present invention to provide a retrievable record of events of interest, original scanning rate, specific areas scanned and a record of events of interest.
These and other objects features and advantages of the present invention will become more evident from the following discussion and drawings in which:
SHORT DESCRIPTION OF THE DRAWINGS
Figure 1 is an isometric view of a microscope with an embodiment of the present invention in the form of a standard mouse pen affixed to the movable microscope stage;
Figure 2A-C are bottom views of the movable microscope stage of the microscope of Figure 1, showing direct computer connection to the movement mechanism of the microscope stage in alternative embodiments;
Figure 3 is a representative view of a computer device, with viewing screen and storage capability, having marking controls, voice input and retrieval review, which is used to monitor slides with computer correlative information and to provide markings and slide scanning history;
Figure 4 is a flow chart illustrating the operative method of the present invention;
Figure 5a is a representation of the computer view screen of Figure 3, wherein specimen area dimensions are selected to begin the operative method as shown in Figure 4;
Figure 5b is a further representation of the view screen of Figure 3, with selection of a particular slide by name and number identification;
Figure 5c is illustrative of the view screen awaiting placement of the selected slide to be examined, on the slide stage, and positioning the slide stage to the pre-determined start point;
Figure 5d is a computer generated non-magnified representation of the pathological slide selected in Figure 5b, showing the predetermined starting point, corresponding to the actual magnified microscope viewing area, as the upper left hand corner;
Figure 5e shows the slide representation of Figure 5d after slide screening, wherein dots have been generated to correspond to microscope viewing areas, with several areas having been marked as being of interest;
Figure 6a represents the screen of Figure 3 during slide information review and retrieval for slide selection;
WO 95/02204 ~ ~ PCTIUS94/07616 Figures 6b and 6c represent the screen immediately thereafter with the slide having been placed on the microscope stage and the stage being positioned at the ' stari:ing point; and Figure 6d represents additional areas of interest having been entered on review.
DETAILED DESCRIPTION OF THE INVENTION
In accordance with the method of the present invention, scanning examination of a microscope slide is effected in the following manner:
1) operatively linking a computer, with a movable slide stage of a microscope, to correlatively record movement of,the slide stage and a specimen such as a specimen carried on a slide, placed on the slide stage; in the x-y plane in which the slide stage and slide are movable;
2) fixedly placing an identified specimen slide on the movable stage;
3) moving the stage, with concomitant slide movement, until the microscope viewing area is fixed on a predetermined starting location point of the slide's cover slip, e.g. the upper left hand corner of the slide's cover slip;
4) initiating correlative start location by the computer, operatively linked to said movable stage, to record subsequent movement in the plane in which the stage and slide are movable;
5) moving the stage, with concomitant slide movement, away from the starting location point, with microscope examination of the slide at various locations on the slide, with the linked computer recording such motion and various locations on computer storage medium;
6) causing the computer to automatically record, on the computer storage medium, indicia (such as black dots), at pre-determined time intervals, with said indicia correlating to the microscope viewing area 10 location on the slide, at the pre-determined time intervals; and 7) marking indicia of interest with a distinguishing marking for subsequent retrieval and recognition.
The marking of the indicia of interest is either in the form of a recognizable numerical grade indicating its relative degree of importance or the indicia is marked with a digitized voice or audio record, describing the characteristics or importance of the area being so marked. The particular indicia can be so marked at any time during slide examination or subsequent review, when the particular indices is in the microscope viewing area.
With re-examination of the slide, the slide is placed on any similarly equipped microscope slide stage (review is however independent of the type of microscope being used). At the appropriate slide viewing area start point, the recording of the particular identified slide 3o is recovered from the computer storage medium to a viewing screen. Beginning from the reference start point correlation, a cursor on the viewing screen provides a continual correlation of position thereon to the actual microscope viewing area. Movement of the microscope stage causes concomitant movement of the cursor. As a result, the cursor can be made to fall on a selected marked indicia which correlates to the area of interest w v PCT/US94/07616 i on the slide which was so marked. Such area can then be direcaly viewed or any audio record can be played.
' The density of marked indicia on the viewing screen provides an indication of the rate at which the slide was ' originally examined. The denser the indicia, the slower and presumably the more careful the original examination.
Absence of indicia in a particular area of the slide is indicative of such area not having been originally scanned and examined.
It is understood that the present method and device are applicable to microscope slide examination in fields other than pathological determinations, such as metal stress analysis, fingerprint analysis, etc. in which areas or events°of interest are marked for subsequent review. The present method and device are also applicable to microscope examination of specimens which do not require a slide carrier, but which are fixed into position, such as with a clamp, in replicable positions.
For example, identification examination and re-examination of diamonds or other gems is possible with separate x-y plane examination of the various facets for specifically located identification markings. Similarly any three dimensional object, e.g. semiconductor chips, of appropriate dimensions, can be examined and re-examined for °'events of interest" in each/or any number of its surface planes.
DETAILED DESCRIPTION OF THE DRAWINGS
AND THE PREFERRED EMBODIMENT
With specific reference to the drawings, in Figure 1, a typical microscope 1 (Olympus BH-2), is shown with a slide stage 2, movable in the x-y plane shown, mounted on relatively fixed frame 3. Slide 5b, with pathological specimen to be examined, is located and fixed into WO 95/02204 PCT/US94/07616~
Figure 4 is a flow chart illustrating the operative method of the present invention;
Figure 5a is a representation of the computer view screen of Figure 3, wherein specimen area dimensions are selected to begin the operative method as shown in Figure 4;
Figure 5b is a further representation of the view screen of Figure 3, with selection of a particular slide by name and number identification;
Figure 5c is illustrative of the view screen awaiting placement of the selected slide to be examined, on the slide stage, and positioning the slide stage to the pre-determined start point;
Figure 5d is a computer generated non-magnified representation of the pathological slide selected in Figure 5b, showing the predetermined starting point, corresponding to the actual magnified microscope viewing area, as the upper left hand corner;
Figure 5e shows the slide representation of Figure 5d after slide screening, wherein dots have been generated to correspond to microscope viewing areas, with several areas having been marked as being of interest;
Figure 6a represents the screen of Figure 3 during slide information review and retrieval for slide selection;
WO 95/02204 ~ ~ PCTIUS94/07616 Figures 6b and 6c represent the screen immediately thereafter with the slide having been placed on the microscope stage and the stage being positioned at the ' stari:ing point; and Figure 6d represents additional areas of interest having been entered on review.
DETAILED DESCRIPTION OF THE INVENTION
In accordance with the method of the present invention, scanning examination of a microscope slide is effected in the following manner:
1) operatively linking a computer, with a movable slide stage of a microscope, to correlatively record movement of,the slide stage and a specimen such as a specimen carried on a slide, placed on the slide stage; in the x-y plane in which the slide stage and slide are movable;
2) fixedly placing an identified specimen slide on the movable stage;
3) moving the stage, with concomitant slide movement, until the microscope viewing area is fixed on a predetermined starting location point of the slide's cover slip, e.g. the upper left hand corner of the slide's cover slip;
4) initiating correlative start location by the computer, operatively linked to said movable stage, to record subsequent movement in the plane in which the stage and slide are movable;
5) moving the stage, with concomitant slide movement, away from the starting location point, with microscope examination of the slide at various locations on the slide, with the linked computer recording such motion and various locations on computer storage medium;
6) causing the computer to automatically record, on the computer storage medium, indicia (such as black dots), at pre-determined time intervals, with said indicia correlating to the microscope viewing area 10 location on the slide, at the pre-determined time intervals; and 7) marking indicia of interest with a distinguishing marking for subsequent retrieval and recognition.
The marking of the indicia of interest is either in the form of a recognizable numerical grade indicating its relative degree of importance or the indicia is marked with a digitized voice or audio record, describing the characteristics or importance of the area being so marked. The particular indicia can be so marked at any time during slide examination or subsequent review, when the particular indices is in the microscope viewing area.
With re-examination of the slide, the slide is placed on any similarly equipped microscope slide stage (review is however independent of the type of microscope being used). At the appropriate slide viewing area start point, the recording of the particular identified slide 3o is recovered from the computer storage medium to a viewing screen. Beginning from the reference start point correlation, a cursor on the viewing screen provides a continual correlation of position thereon to the actual microscope viewing area. Movement of the microscope stage causes concomitant movement of the cursor. As a result, the cursor can be made to fall on a selected marked indicia which correlates to the area of interest w v PCT/US94/07616 i on the slide which was so marked. Such area can then be direcaly viewed or any audio record can be played.
' The density of marked indicia on the viewing screen provides an indication of the rate at which the slide was ' originally examined. The denser the indicia, the slower and presumably the more careful the original examination.
Absence of indicia in a particular area of the slide is indicative of such area not having been originally scanned and examined.
It is understood that the present method and device are applicable to microscope slide examination in fields other than pathological determinations, such as metal stress analysis, fingerprint analysis, etc. in which areas or events°of interest are marked for subsequent review. The present method and device are also applicable to microscope examination of specimens which do not require a slide carrier, but which are fixed into position, such as with a clamp, in replicable positions.
For example, identification examination and re-examination of diamonds or other gems is possible with separate x-y plane examination of the various facets for specifically located identification markings. Similarly any three dimensional object, e.g. semiconductor chips, of appropriate dimensions, can be examined and re-examined for °'events of interest" in each/or any number of its surface planes.
DETAILED DESCRIPTION OF THE DRAWINGS
AND THE PREFERRED EMBODIMENT
With specific reference to the drawings, in Figure 1, a typical microscope 1 (Olympus BH-2), is shown with a slide stage 2, movable in the x-y plane shown, mounted on relatively fixed frame 3. Slide 5b, with pathological specimen to be examined, is located and fixed into WO 95/02204 PCT/US94/07616~
position on slide stage 2, with slide holder 5a. In operation, focus control knob 9 causes frame member 3 to move in the z-direction (up and down) for focussing relative to selected lens 25. At the point of proper -focus, frame 3 is fixed in position and slide stage 2 moved in the x-y direction (the two dimensional viewing area of slide 5b) for full scanning of the pathological sample on slide 5b. Concentric knob control 6 is geared, as is more clearly shown in Figure 2, to effect such x-y direction movement.
In accordance with the embodiment of the present invention shown in Figure 1, a first °'mouse pad°' element or plate bracket 4 is affixed, in a cantilevered manner to °'fixed°' frame 3. A standard mouse pen 7 is affixed via bracket 5 to movable slide stage 2, whereby the ball 8 of mouse pen 7 is in rolling contact with plate bracket 4. The rolling ball 8, in accordance with standard computer mouse technology is in contact, within the pen, with the surfaces of each of two cylinders with perpendicular axes. The motion of ball 8 in the x-axis direction causes one cylinder to rotate and its motion in the y-axis direction causes the other cylinder to rotate.
Each cylinder is coupled with a multi-slotted disk which interrupts light between two light sources and two photo detectors and as the disks rotate, the photo detector signals are transformed by internal circuitry to the amount and directions of each of the x and y direction motions of the ball. An integrated circuit chip (e. g., Motorola PIC 16C54-XT/P) in the mouse pen 7 provides a sequence of bytes encoding this motion through connecting wire 10 to the serial bus connection on a personal computer. Standard "mouse driver°' software in the computer s operating system converts these signals into the computer display screen's cursor position such as shown in Figure 5d.
In accordance with the embodiment of the present invention shown in Figure 1, a first °'mouse pad°' element or plate bracket 4 is affixed, in a cantilevered manner to °'fixed°' frame 3. A standard mouse pen 7 is affixed via bracket 5 to movable slide stage 2, whereby the ball 8 of mouse pen 7 is in rolling contact with plate bracket 4. The rolling ball 8, in accordance with standard computer mouse technology is in contact, within the pen, with the surfaces of each of two cylinders with perpendicular axes. The motion of ball 8 in the x-axis direction causes one cylinder to rotate and its motion in the y-axis direction causes the other cylinder to rotate.
Each cylinder is coupled with a multi-slotted disk which interrupts light between two light sources and two photo detectors and as the disks rotate, the photo detector signals are transformed by internal circuitry to the amount and directions of each of the x and y direction motions of the ball. An integrated circuit chip (e. g., Motorola PIC 16C54-XT/P) in the mouse pen 7 provides a sequence of bytes encoding this motion through connecting wire 10 to the serial bus connection on a personal computer. Standard "mouse driver°' software in the computer s operating system converts these signals into the computer display screen's cursor position such as shown in Figure 5d.
Figures 2A and 2B depict the geared rack movement mechanism of slide stage 2 for translation into mouse pen movement in the embodiment shown in Figure 1. Each of the inner and outer knobs of control 6 (shown in the right: hand control position) is comprised of a rotary gear (not shown), with the outer knob gear engaging geared rack 52 to cause platform 53 (and slide stage 2 thereon) to move in the y-direction relative to stage frame 3. The inner gear of control 6 (not shown) engages geared rack 54 which in turn causes bar 55, to move in the ~:-direction relative to platform 53, and causing attached block 56 to move in the x-direction. Slide holder 5a, attached, in turn to block 56, is moved, thereby moving slide,5b in the x-direction.
An alternative movement and monitoring geared rack mechanism for direct, rather than the intermediate mouse monitoring movement shown in Figure 1, is also depicted in Figure 2A, wherein geared rack 57 is mounted on stage frame 3, whereby it causes a gear in assembly 59, mounted on platform 53 (in the left hand mount position of control 6), to rotate as the slide 5b is moved in the y-direction. A second geared rack 58 is attached to bar 55 to move the slide in the x-direction. Two concentric gears in assembly 59 cause its inner and outer shafts to rotate with the slide's x and y motion to, in turn, rotate the inner and outer shafts of a concentric shaft encoder 59a in assembly 59, such as is available from Clarostat Sensors and Controls in Plano, Texas. Each of the x and y output signals from encoder 59a is decoded into a direction signal level and incremental counts proportional to distance using a "mouse" decoder chip or a personal computer board such as is available from Technology 80, Inc. in Minneapolis, Minnesota. An integrated circuit decoder chip provides a sequence of bytes encoding the motion through wire 10 to a serial bus connection on a personal computer. As with the other WO 95/02204 ~ PCTIUS94107616 embodiment, "mouse driver'° software in the computer's operating system converts these signals into the computer display screen's cursor position. If the computer board is used, the bytes are made available directly in the ' computer's memory.
In a further embodiment of the present invention, shown in Figure 2B, encoder 59a is a single shaft encoder such as is available from Dynamic Research Corporation, in Wilmington, MA, with a gear engaging geared rack 57. In such embodiment, in place of geared rack 58, a rack 61 is mounted to block 56 so as to move with the slide's x motion. A second encoder 60, mounted to platform 53, has a geared shaft engaging geared rack 61. Encoder 60 thus encodes the x motion of the slide. The two independent encoder signals are treated as described above.
In a still further embodiment of the present invention, shown in Figure 2C, linear encoders 70 and 71 are mounted between the frame 3 and the platform 53 and between the platform 53 and the bar 55 whereby differential motion between the slide and frame is monitored. Linear encoders of this type are available from Dynamic Research Corporation and computer boards such as from Technology 80, Inc. are used to interface them with a personal computer.
The device of the present invention can be embodied as a stage position encoding module which is plugged into one of the serial or parallel ports of a personal computer.
Alternatively, in place of a standard computer with a monitor screen, the monitoring of the encoder output, via wires 10, can be effected by use of the integrated device 11 shown in Figure 3. The device il integrates a personal computer board, as described above, with a small display panel 12, a special keyboard 13, an integral fixed storage device 14 such as a floppy disk or a flash card reader, and a vocal input 21. If desired, the keyboard may be a separated but connected element.
5 With reference to the flow chart of operation shown in Figure 4, a disk with slide information (such as patient identification) is placed into the device of Figure 3, and the screen, as shown in Figure 5a, queries regarding the slide area to be scanned. The various menu screens 10 are accessed by means of key 22 and appropriate selection movement is effected by use of keys 16 and 17. With selection of the desired slide area from menu list 109 (by means of entry key 18), the slide specimen list 110 (pre-entered with patient name or other identification) 15 appears for appropriate selection as shown in Figure 5b.
With selection of the appropriate slide, the actual corresponding slide is placed on the slide stage 2, shown in Figure 1, with the device waiting (Figure 5c) until such placement and positioning is effected to the preselected start point on the slide cover slip by viewing through the microscope lens. As shown in Figure 5d, a slide image 5b~ appears on the screen with the crosshair cursor 23, appearing on the slide image on screen 12, at the predetermined recordation starting position (shown as the upper left hand corner of image 5b~, in Figure 5d) and scanning is initiated. As the slide stage is moved, the crosshair cursor moves correspondingly, and at pre-set time intervals, the computer enters a black dot 90 on the slide image which corresponds, in time to the microscope viewing area being scanned at the time and in area to such microscope viewing area. At any of the black dot areas 90, a numerical interest rating can be entered via the keyboard number keys 19. Alternatively, or in addition, a voice record may be made by pressing key 20 to activate microphone 21 and speaking into microphone 21. The numerical rating or voice record as well as the entered i W0,95/02204 PCT/US94/07616 .
An alternative movement and monitoring geared rack mechanism for direct, rather than the intermediate mouse monitoring movement shown in Figure 1, is also depicted in Figure 2A, wherein geared rack 57 is mounted on stage frame 3, whereby it causes a gear in assembly 59, mounted on platform 53 (in the left hand mount position of control 6), to rotate as the slide 5b is moved in the y-direction. A second geared rack 58 is attached to bar 55 to move the slide in the x-direction. Two concentric gears in assembly 59 cause its inner and outer shafts to rotate with the slide's x and y motion to, in turn, rotate the inner and outer shafts of a concentric shaft encoder 59a in assembly 59, such as is available from Clarostat Sensors and Controls in Plano, Texas. Each of the x and y output signals from encoder 59a is decoded into a direction signal level and incremental counts proportional to distance using a "mouse" decoder chip or a personal computer board such as is available from Technology 80, Inc. in Minneapolis, Minnesota. An integrated circuit decoder chip provides a sequence of bytes encoding the motion through wire 10 to a serial bus connection on a personal computer. As with the other WO 95/02204 ~ PCTIUS94107616 embodiment, "mouse driver'° software in the computer's operating system converts these signals into the computer display screen's cursor position. If the computer board is used, the bytes are made available directly in the ' computer's memory.
In a further embodiment of the present invention, shown in Figure 2B, encoder 59a is a single shaft encoder such as is available from Dynamic Research Corporation, in Wilmington, MA, with a gear engaging geared rack 57. In such embodiment, in place of geared rack 58, a rack 61 is mounted to block 56 so as to move with the slide's x motion. A second encoder 60, mounted to platform 53, has a geared shaft engaging geared rack 61. Encoder 60 thus encodes the x motion of the slide. The two independent encoder signals are treated as described above.
In a still further embodiment of the present invention, shown in Figure 2C, linear encoders 70 and 71 are mounted between the frame 3 and the platform 53 and between the platform 53 and the bar 55 whereby differential motion between the slide and frame is monitored. Linear encoders of this type are available from Dynamic Research Corporation and computer boards such as from Technology 80, Inc. are used to interface them with a personal computer.
The device of the present invention can be embodied as a stage position encoding module which is plugged into one of the serial or parallel ports of a personal computer.
Alternatively, in place of a standard computer with a monitor screen, the monitoring of the encoder output, via wires 10, can be effected by use of the integrated device 11 shown in Figure 3. The device il integrates a personal computer board, as described above, with a small display panel 12, a special keyboard 13, an integral fixed storage device 14 such as a floppy disk or a flash card reader, and a vocal input 21. If desired, the keyboard may be a separated but connected element.
5 With reference to the flow chart of operation shown in Figure 4, a disk with slide information (such as patient identification) is placed into the device of Figure 3, and the screen, as shown in Figure 5a, queries regarding the slide area to be scanned. The various menu screens 10 are accessed by means of key 22 and appropriate selection movement is effected by use of keys 16 and 17. With selection of the desired slide area from menu list 109 (by means of entry key 18), the slide specimen list 110 (pre-entered with patient name or other identification) 15 appears for appropriate selection as shown in Figure 5b.
With selection of the appropriate slide, the actual corresponding slide is placed on the slide stage 2, shown in Figure 1, with the device waiting (Figure 5c) until such placement and positioning is effected to the preselected start point on the slide cover slip by viewing through the microscope lens. As shown in Figure 5d, a slide image 5b~ appears on the screen with the crosshair cursor 23, appearing on the slide image on screen 12, at the predetermined recordation starting position (shown as the upper left hand corner of image 5b~, in Figure 5d) and scanning is initiated. As the slide stage is moved, the crosshair cursor moves correspondingly, and at pre-set time intervals, the computer enters a black dot 90 on the slide image which corresponds, in time to the microscope viewing area being scanned at the time and in area to such microscope viewing area. At any of the black dot areas 90, a numerical interest rating can be entered via the keyboard number keys 19. Alternatively, or in addition, a voice record may be made by pressing key 20 to activate microphone 21 and speaking into microphone 21. The numerical rating or voice record as well as the entered i W0,95/02204 PCT/US94/07616 .
dots are recorded as a history of the slide for subsequent recall when the slide is re-examined. Thus, as shown in Figure 5e, at the end of a scanning session, two microscope viewing areas 103 and 105 have been marked with interest levels of 3 and 5 and a vocal history was recorded and marked with a "V'° at a third point 104.
Because of the density of dots, it is evident that the upper portion of the slide has been examined more intensively than the lower portion.
With re-examination of an already scanned slide, such as by a certifying pathologist, a slide which is identified, from menu list 110, as in Figure 6a is recalled from computer storage. The actual slide is placed on a microscope slide stage of a similarly equipped microscope. When the stage is positioned at the pre-determined starting point, review is initiated, as shown in Figures 6b and 6c. To view the marked points of interest (or for that matter any area), the microscope stage is moved while cursor position is monitored on the viewing screen. When the position of the cursor corresponds to that of the particular marked area of interest, it is in the viewing area of the microscope for the direct examination thereof. If a vocal history has been made, it can be replayed at such position. In addition, the slide may be re-examined during review, with additional areas being scanned or, as shown in Figure 6d, additional areas of interest e.g. at 106 and 107 can be appropriately marked or voice records made.
It is understood that the above description, drawings and examples are merely illustrative of the present invention and that changes in procedure and components may be made without departing from the scope of the present invention as defined in the following claims.
Because of the density of dots, it is evident that the upper portion of the slide has been examined more intensively than the lower portion.
With re-examination of an already scanned slide, such as by a certifying pathologist, a slide which is identified, from menu list 110, as in Figure 6a is recalled from computer storage. The actual slide is placed on a microscope slide stage of a similarly equipped microscope. When the stage is positioned at the pre-determined starting point, review is initiated, as shown in Figures 6b and 6c. To view the marked points of interest (or for that matter any area), the microscope stage is moved while cursor position is monitored on the viewing screen. When the position of the cursor corresponds to that of the particular marked area of interest, it is in the viewing area of the microscope for the direct examination thereof. If a vocal history has been made, it can be replayed at such position. In addition, the slide may be re-examined during review, with additional areas being scanned or, as shown in Figure 6d, additional areas of interest e.g. at 106 and 107 can be appropriately marked or voice records made.
It is understood that the above description, drawings and examples are merely illustrative of the present invention and that changes in procedure and components may be made without departing from the scope of the present invention as defined in the following claims.
Claims (15)
1. A computerized specimen encoder device for use during examination of a specimen, mounted on a slide stage of a microscope, wherein the slide stage is movable in an x-y direction plane, during said examination; the encoder device comprising, in conjunction with computer means:
(a) correlation means for translating movement of the microscope stage, with mounted specimen, in the x-y direction plane, to retrievable corresponding computer pixel locations and cursor movement on a computer generated specimen image;
(b) means for marking selected microscope viewing areas, as correlated to the computer pixel locations, on the computer generated specimen image, with indicia, at pre-selected time intervals; and (c) means for marking the indicia as being areas of interest for subsequent review, wherein said specimen is carried on a slide during said examination, and wherein said correlation means comprises a computer mouse element affixed to the movable slide stage, with said mouse element being positioned to operatively roll on a relatively stationary surface, in congruence with movement of the slide stage.
(a) correlation means for translating movement of the microscope stage, with mounted specimen, in the x-y direction plane, to retrievable corresponding computer pixel locations and cursor movement on a computer generated specimen image;
(b) means for marking selected microscope viewing areas, as correlated to the computer pixel locations, on the computer generated specimen image, with indicia, at pre-selected time intervals; and (c) means for marking the indicia as being areas of interest for subsequent review, wherein said specimen is carried on a slide during said examination, and wherein said correlation means comprises a computer mouse element affixed to the movable slide stage, with said mouse element being positioned to operatively roll on a relatively stationary surface, in congruence with movement of the slide stage.
2. The device of claim 1, wherein said stationary element comprises a mouse pad element, affixed to a relatively stationary supporting frame for said slide stage.
3. The device of claim 2 wherein said microscope comprises operator controlled gear elements adapted to move the slide stage and mounted specimen in the x-y plane, and wherein said gear elements effect correlative motion of said correlation means; with said correlation means comprising at least one rotatable shaft encoder mounted on said microscope.
4. The device of claim 3, wherein said correlation means comprises a single concentric shaft encoder having inner and outer rotatable shafts, with rotation of one of said inner and outer rotatable shafts, effected by movement of the operator controlled gear movement, correlating movement of the slide in the x direction of the plane and rotation of the other of said inner and outer rotatable shafts, effected by movement of the operator controlled gear movement, correlating movement of the slide in the y direction of the plane, said device further comprising means for decoding of x and y output from the inner and outer rotatable shafts into a direction signal level and incremental counts proportional to distance.
5. The device of claim 3, wherein said correlation means comprises two rotatable shaft encoders, with rotation of a first shaft encoder, effected by movement of the operator controlled gear movement, correlating movement of the slide in the x direction of the plane, and rotation of a second shaft encoder, effected by movement of the operator controlled gear movement, correlating movement of the slide in the y direction of the plane, said device further comprising means for decoding of the x and y output from the first and second shaft encoders respectively into a direction signal level and incremental counts proportional to distance.
6. The device of claim 4, wherein said means for decoding comprises a computer mouse chip.
7. The device of claim 5, wherein said means for decoding comprises a computer mouse chip.
8. The device of claim 1, wherein said microscope comprises a member fixed in position relative to movement of the slide stage in the x-y plane and wherein said device comprises first and second linear encoder elements, with the first of said linear encoder elements being mounted between the fixed member and the slide stage, to monitor relative movement therebetween, in one of the x and y directions in said plane and with the second of said linear encoder elements being mounted between the slide stage and the slide, to monitor relative movement therebetween in the other of the x and y directions.
9. The device of claim 1, wherein said device further comprises said computer means and wherein said computer means comprises means for displaying the computer generated specimen image which correlates to an area of the specimen viewable by the microscope.
10. The device of claim 1, wherein said means for marking the indicia, as being areas of interest for subsequent review, effects said marking by assigning a numerical grading to selected indicia.
11. The device of claim 1, wherein said means for marking the indicia, as being areas of interest for subsequent review, effects said marking by providing a digitized audio record, with information relating to the selected indicia.
12. A method for specimen encoding during scanning examination of a specimen with a microscope having a moving slide stage, on which said specimen is mounted, the method comprising the steps of:
(a) operatively linking a computer, with correlation means, to the movable slide stage of the microscope, to correlatively record movement of the slide stage in an xy direction plane in which the slide stage is movable;
(b) generating a computer image of a predetermined area of the specimen to be examined;
(c) fixedly placing the specimen on the movable stage of the microscope;
(d) moving the stage, with concomitant specimen movement, until the microscope viewing area is fixed on a predetermined starting location point;
(e) instructing the computer, operatively linked to said movable stage, to start to record subsequent movement in the x-y direction plane in which the stage and specimen are movable;
(f) moving the stage, with concomitant specimen movement, away from the starting location point, with microscope examination of the specimen at various locations on the specimen; with the linked computer, recording the movement and various locations on the generated image and into computer storage medium;
(g) causing the computer to automatically record, on computer storage medium, indicia on the computer generated image of said specimen, at pre-determined time intervals, with said indicia correlating to a microscope viewing area location on the specimen, at the pre-determined time intervals; and (h) marking indicia of interest with a distinguishing marking for subsequent review recognition;
(i) wherein said specimen is carried on a slide; and (j) wherein said marking comprises a computer generated numerical grading to selected indicia of interest.
(a) operatively linking a computer, with correlation means, to the movable slide stage of the microscope, to correlatively record movement of the slide stage in an xy direction plane in which the slide stage is movable;
(b) generating a computer image of a predetermined area of the specimen to be examined;
(c) fixedly placing the specimen on the movable stage of the microscope;
(d) moving the stage, with concomitant specimen movement, until the microscope viewing area is fixed on a predetermined starting location point;
(e) instructing the computer, operatively linked to said movable stage, to start to record subsequent movement in the x-y direction plane in which the stage and specimen are movable;
(f) moving the stage, with concomitant specimen movement, away from the starting location point, with microscope examination of the specimen at various locations on the specimen; with the linked computer, recording the movement and various locations on the generated image and into computer storage medium;
(g) causing the computer to automatically record, on computer storage medium, indicia on the computer generated image of said specimen, at pre-determined time intervals, with said indicia correlating to a microscope viewing area location on the specimen, at the pre-determined time intervals; and (h) marking indicia of interest with a distinguishing marking for subsequent review recognition;
(i) wherein said specimen is carried on a slide; and (j) wherein said marking comprises a computer generated numerical grading to selected indicia of interest.
13. The method of claim 12, wherein said marking comprises a digitized audio record, with information relating to the selected indicia of interest.
14. The method of claim 12, wherein said review is effected by the steps of:
(a) recalling the computer generated image from the computer storage medium;
(b) placing the slide on the movable slide stage of a microscope, operatively linked with a computer, by correlation means, to correlatively exhibit, on viewing means, an area of the computer generated image corresponding to a microscope viewing area of the slide;
(c) moving the stage, with concomitant slide movement, until the microscope viewing area is fixed on a predetermined starting location point;
(d) instructing the computer, operatively linked to said movable stage, to start to correlate microscope viewing area to corresponding indicia on the computer generated image;
(e) moving the stage, with concomitant specimen and slide movement, away from the starting location point, with correlation of microscope viewing area with indicia on the computer generated image, whereby correlated marked indicia are directly viewable with the microscope.
(a) recalling the computer generated image from the computer storage medium;
(b) placing the slide on the movable slide stage of a microscope, operatively linked with a computer, by correlation means, to correlatively exhibit, on viewing means, an area of the computer generated image corresponding to a microscope viewing area of the slide;
(c) moving the stage, with concomitant slide movement, until the microscope viewing area is fixed on a predetermined starting location point;
(d) instructing the computer, operatively linked to said movable stage, to start to correlate microscope viewing area to corresponding indicia on the computer generated image;
(e) moving the stage, with concomitant specimen and slide movement, away from the starting location point, with correlation of microscope viewing area with indicia on the computer generated image, whereby correlated marked indicia are directly viewable with the microscope.
15. The method of claim 14, wherein one or more of the marked indicia are individually marked with a digitized audio record, with information relating to the selected indicia; and said audio record is retrievable when the correlated marked indicia are directly viewable with the microscope.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/089,243 | 1993-07-09 | ||
| US08/089,243 US5587833A (en) | 1993-07-09 | 1993-07-09 | Computerized microscope specimen encoder |
| PCT/US1994/007616 WO1995002204A1 (en) | 1993-07-09 | 1994-07-08 | Computerized microscope specimen encoder |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2166464A1 CA2166464A1 (en) | 1995-01-19 |
| CA2166464C true CA2166464C (en) | 2002-01-01 |
Family
ID=22216524
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002166464A Expired - Fee Related CA2166464C (en) | 1993-07-09 | 1994-07-08 | Computerized microscope specimen encoder |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US5790308A (en) |
| CA (1) | CA2166464C (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4136017B2 (en) * | 1996-09-19 | 2008-08-20 | シスメックス株式会社 | Particle analyzer |
| US5895915A (en) * | 1997-07-24 | 1999-04-20 | General Scanning, Inc. | Bi-directional scanning system with a pixel clock system |
| AU769499B2 (en) * | 1999-10-29 | 2004-01-29 | Cytyc Corporation | Apparatus and methods for verifying the location of areas of interest within a sample in an imaging system |
| US7006674B1 (en) | 1999-10-29 | 2006-02-28 | Cytyc Corporation | Apparatus and methods for verifying the location of areas of interest within a sample in an imaging system |
| US7369304B2 (en) * | 1999-10-29 | 2008-05-06 | Cytyc Corporation | Cytological autofocusing imaging systems and methods |
| US7027628B1 (en) | 2000-11-14 | 2006-04-11 | The United States Of America As Represented By The Department Of Health And Human Services | Automated microscopic image acquisition, compositing, and display |
| US20020149628A1 (en) * | 2000-12-22 | 2002-10-17 | Smith Jeffrey C. | Positioning an item in three dimensions via a graphical representation |
| US6972754B2 (en) * | 2002-06-27 | 2005-12-06 | Topaz Systems, Inc. | Touchpad stylus having isolated low-mass contact element |
| US7216081B1 (en) * | 2003-03-27 | 2007-05-08 | Psyche Systems Corporation | Interactive process and system for screening cytological specimens |
| JP4976387B2 (en) * | 2005-06-13 | 2012-07-18 | トライパス イメージング インコーポレイテッド | System and method for re-searching the position of an object in a sample on a slide using a microscope image acquisition device |
| DE102005046244B4 (en) * | 2005-09-28 | 2014-12-18 | Leica Microsystems Cms Gmbh | Device for microscope stage adjustment and microscope with such a device |
| GB2449312B (en) * | 2007-05-18 | 2012-03-14 | Malvern Instr Ltd | Method and apparatus for dispersing a sample of particulate material |
| EP2196840A4 (en) * | 2007-09-03 | 2013-01-16 | Nikon Corp | Microscope device and program |
| CA2709707C (en) * | 2007-12-27 | 2016-03-29 | Cytyc Corporation | Apparatus for single-handed control of microscope functions |
| WO2011038402A2 (en) * | 2009-09-28 | 2011-03-31 | Bryan Dangott | Apparatus, system, and method for simulating physical movement of a digital image |
| US11822067B2 (en) * | 2019-06-27 | 2023-11-21 | Medipan Gmbh | XYZ microscope stage with a vertically translatable carriage |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE3330476A1 (en) * | 1983-08-24 | 1985-03-07 | Fa. Carl Zeiss, 7920 Heidenheim | ARRANGEMENT FOR CONTROLLING A MOVEMENT |
| US4769698A (en) * | 1985-10-04 | 1988-09-06 | National Biomedical Research Foundation | Interactive microscopic image display system and method |
| JPS63167313A (en) * | 1986-12-27 | 1988-07-11 | Hitachi Ltd | Automatic focus control method |
| JPH0245734A (en) * | 1988-08-05 | 1990-02-15 | Mitsubishi Heavy Ind Ltd | Automatic structure analytic processor |
| US5073851A (en) * | 1990-02-21 | 1991-12-17 | Apple Computer, Inc. | Apparatus and method for improved caching in a computer system |
| JP2925647B2 (en) * | 1990-04-16 | 1999-07-28 | オリンパス光学工業株式会社 | Microscope magnification changer |
| US5345538A (en) * | 1992-01-27 | 1994-09-06 | Krishna Narayannan | Voice activated control apparatus |
| US5521984A (en) * | 1993-06-10 | 1996-05-28 | Verification Technologies, Inc. | System for registration, identification and verification of items utilizing unique intrinsic features |
| US5587833A (en) * | 1993-07-09 | 1996-12-24 | Compucyte Corporation | Computerized microscope specimen encoder |
-
1994
- 1994-07-08 CA CA002166464A patent/CA2166464C/en not_active Expired - Fee Related
-
1996
- 1996-12-23 US US08/777,945 patent/US5790308A/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CA2166464A1 (en) | 1995-01-19 |
| US5790308A (en) | 1998-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5587833A (en) | Computerized microscope specimen encoder | |
| CA2166464C (en) | Computerized microscope specimen encoder | |
| US5793969A (en) | Network review and analysis of computer encoded slides | |
| Dumitru | A new computer-automated microscope stage system for fission-track analysis | |
| US5581487A (en) | Method and apparatus for microscopic screening of cytological samples | |
| US7856131B2 (en) | Method and apparatus for internet, intranet, and local viewing of virtual microscope slides | |
| CN101959463B (en) | Twin-monitor electronic display system | |
| US7146372B2 (en) | Method and apparatus for creating a virtual microscope slide | |
| JP5132867B2 (en) | Method and apparatus for forming and using virtual microscope slide, and program | |
| US8067245B2 (en) | Automated microscope for blood cell analysis | |
| JP2019049751A (en) | Fully automatic rapid microscope slide scanner | |
| Demichelis et al. | The virtual case: a new method to completely digitize cytological and histological slides | |
| US7009600B2 (en) | Data processing system display screen including an image alteration area | |
| US20050117816A1 (en) | Virtual microscope-device and method | |
| US5228112A (en) | Inspection control system and method | |
| US20100128967A1 (en) | Hands-free Inspection Systems | |
| JP4785347B2 (en) | Specimen image display method and specimen image display program | |
| JPS61137120A (en) | Slide glass | |
| CA2183081C (en) | Improved method and apparatus for microscopic screening of cytological samples | |
| Okazaki et al. | Development of high-resolution optical scanning fluorescence microscopy | |
| FR2549676A1 (en) | Method and device for computer-aided determination of the drilling coordinates of printed-circuit plans. | |
| Albe et al. | Virtual microscopy: a new effective tool in the laboratory | |
| Robinson | Personal computers attract lab software | |
| JPH06325717A (en) | Electron beam analyzing device | |
| Capowski et al. | The History of Quantitative Neuroanatomy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |