US20080100844A1 - Defect detection through image comparison using relative measures - Google Patents
Defect detection through image comparison using relative measures Download PDFInfo
- Publication number
- US20080100844A1 US20080100844A1 US11/590,650 US59065006A US2008100844A1 US 20080100844 A1 US20080100844 A1 US 20080100844A1 US 59065006 A US59065006 A US 59065006A US 2008100844 A1 US2008100844 A1 US 2008100844A1
- Authority
- US
- United States
- Prior art keywords
- image
- inspection
- pixel
- pixels
- set forth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/956—Inspecting patterns on the surface of objects
- G01N21/95607—Inspecting patterns on the surface of objects using a comparative method
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30148—Semiconductor; IC; Wafer
Definitions
- devices are fabricated by a number of processes to produce precisely-defined structures of an ever-decreasing size. Even the slightest structural defect can ruin a semiconductor device, and so to avoid losses of time and effort, detection of defects is critical before a defective device is mass-produced or further processes are performed on a defective wafer.
- Various inspection tools may be utilized, including those in which a view of a wafer (or other device or object) is compared to a reference image showing the wafer in a defect-free state.
- a reference image or images may be used, such as views of portions of the same wafer that (ideally speaking) contain the same structural features, for example.
- an inspection image I x,y may be obtained for comparison to a reference image R x,y .
- Defects may be detected by subtracting the images (I x,y ⁇ R x,y ) and using various algorithms to determine the existence (or non-existence) of defects by evaluating the subtraction image. See, for example, U.S. patent application Ser. No. 10/345,097, filed Jun. 15, 2003, which is hereby incorporated by reference for all purposes herein.
- Methods of inspecting an object such as a semiconductor wafer can include determining the similarity of pattern shapes between an inspection image and a reference image. Shapes may be compared by assigning relative values to pixels in each image based on their neighboring pixels and then comparing relative values in area(s) of the inspection image to relative values in corresponding area(s) of the reference image. Comparing shapes rather than gray levels alone advantageously reduces the false alarm rate. For example, false alarms due to gray level differences in non-defective areas caused by process variation or change in the image conditions can be reduced since the shape of the area is considered.
- a method of detecting defects can include obtaining an inspection image depicting at least a part of an object, such as a semiconductor wafer, reticle, or other object.
- the image may be obtained using an optical inspection system.
- the method may further include obtaining a reference image representing the same part of the object shown in the inspection image as said part would appear in a substantially-defectless state.
- the reference image may comprise an image of another part of the object or an aggregate of inspection images, for example.
- the method may further comprise comparing at least a portion of the inspection image to a corresponding portion of the reference image.
- Comparing may include determining the degree of similarity between the portion of the inspection image and the portion of the reference image by comparing relative values of one or more pixels in the inspection image to relative values of one or more corresponding pixels in the reference image and flagging the compared portions based on comparing the degree of similarity to a threshold value. If shapes in the areas in the inspection image and reference image are similar, the relative values will also be similar. However, if the shapes are different, the relative values will differ.
- the relative values may comprise ordinal ranks of a pixel relative to its neighboring pixels. Determining the degree of similarity can include applying a comparison metric to the ordinal ranks to determine how close ranks in the inspection image are to ranks in the reference image for the same area.
- the ordinal ranks may be determined by ranking the relative brightness of a pixel as compared to pixels in a neighborhood of varying size. For instance, the pixel's 4-neighborhood, 8-neighborhood, or larger neighborhoods may be used. Neighboring pixels may be adjacent or non-adjacent.
- Any suitable comparison metric may be used to compare the ordinal ranks in the inspection image to the ordinal ranks in the reference image.
- Regular Distance Metrics and Hamming Distance metrics may be utilized.
- Metrics based on permutations may be suitable, as well.
- a permutation-based distance metric may define a permutation of the ranks in the inspection image and a permutation of the ranks in the reference image.
- the reference permutation may be composed with the inspection permutation to define a composition permutation, which may then be compared to a unity permutation of the same length. The degree of difference between the inspection and reference permutations can be determined based on the distance between the composition permutation and the unity permutation.
- Reference images may be obtained in any suitable manner. For example, a plurality of images depicting the same structural elements as shown in the inspection image may be accumulated or otherwise combined to generate a reference image.
- the images Prior to comparing the inspection and reference images through use of relative values, the images may be compared in a preliminary image comparison using any suitable technique(s) to identify one or more defect candidates.
- the areas including the defect candidates may then be compared using relative measures, which may advantageously reduce computational requirements.
- the preliminary image comparison may include a gray level comparison.
- entire inspection images may be compared to entire reference images using relative measures.
- one or more defects may be detected based on comparing relative values in the inspection image and the reference image. After identification, the defect(s) can be classified, including comparing the assigned relative values for the portion of the image comprising the at least one defect(s) to relative values in one or more defect reference images.
- Another exemplary comparison methodology based on relative measures uses directional vectors based on slopes or slants between pixels.
- the directional slope between a pixel and its neighbors may first be determined in each image. Then, the directional slopes for the pixel or pixels in the inspection image may be compared to the directional slopes for the corresponding pixel or pixels in the reference image to determine the degree to which the directional slopes match.
- Directional slopes between pixels may be determined based on comparing the magnitude of difference in gray level between the pixels and the sign of the difference.
- the slope may be determined based on a threshold value, with no slope indicated if the magnitude does not meet the threshold.
- the threshold may be constant, user-specified, or adaptive.
- the slope may be defined as increasing, decreasing, or undetermined (i.e. neither increasing or decreasing).
- the slope may be defined using more or fewer degrees of description.
- the slopes may be defined as increasing or not-increasing, with the latter case including both decreasing and undetermined slopes.
- a method of detecting defects can include obtaining an inspection image and a corresponding reference image of an object, such as a semiconductor wafer. At least one suspected defect in the inspection image may be identified through a preliminary image comparison. For each suspected defect, an area surrounding the defect in the inspection image and a corresponding area in the reference image may be selected. For each pixel in each selected area, slope values for the pixel relative to its surrounding pixels may be established. Each pixel may be replaced by a pixel slope correlation value representing the amount of correlation between the reference and inspection images.
- the reference image and inspection image may be compared by a gray level comparison.
- Each pixel of the subtraction image from that comparison may be divided by a factor, with the resulting image added to the pixel slope correlation image to obtain a total comparison image.
- a sum operator may be applied to the total comparison image.
- the average of the five highest values in the area after the sum operator has been applied may be compared to determine if the average exceeds a threshold value. For example, the area may be indicated as containing a defect, or may be highlighted for further analysis and/or processing if the threshold is exceeded.
- An electro-optical inspection system can include a light source configured to illuminate an object, an imager operative to obtain an image of the object, and at least one processing unit.
- the processing unit may be configured to carry out steps including obtaining an inspection image of the object, accessing a reference image depicting the same structural features of the object as they would appear in a substantially-defectless state, assigning relative values to pixels in the inspection image and to corresponding pixels in the reference image, comparing relative values for pixels in the inspection image to relative values for pixels in the reference image, and indicating an area as containing a suspected defect based on the comparison results.
- the system may be further configured to combine images depicting like structural features of the object and store the combination as a reference image.
- Relative values may be assigned by ranking pixels based on relative brightness.
- Relative values may be assigned by assigning directional slope indicator values based on the direction of the change of brightness between pixels.
- FIG. 2 is a flowchart showing exemplary steps that may be included in a method of detecting defects using slope comparisons
- FIG. 3 depicts exemplary portions of an inspection image and a reference image
- FIG. 4 shows exemplary windows which may be used in comparisons of an exemplary image
- FIG. 5 is a flowchart showing exemplary steps in a method of defect detection
- FIG. 6 is a block diagram showing the operation of an exemplary defect inspection system.
- the present subject matter generally pertains to determining the presence or absence of a defect by comparing the shapes depicted in a reference and inspection image. For instance, relative values indicating the relationship(s) between pixels within an inspection image may be compared to relative values of corresponding pixels in a reference image. Based on comparing the relative values, the degree of similarity or dissimilarity in the shapes depicted in the inspection and reference images may be assessed. If shapes are too dissimilar, a defect may be present.
- relative values are discussed herein, other relative values may be suitable for use based on the teachings contained herein.
- specific types of inspection tools, modes, and inspection objects are also discussed herein, but for purposes of example only.
- the objects inspected may include not only semiconductor wafers, but also other objects of any size, shape, or configuration.
- FIG. 1 is a flow chart illustrating exemplary steps in an inspection process that includes comparison of relative values between images.
- an inspection image I x,y depicting at least a portion of an object may be obtained using an optical inspection tool.
- x and y refer to row and column coordinates, respectively, within an image.
- the discussion herein uses rectangular coordinates and rectangular images for purposes of example only; one of skill in the art will appreciate that other coordinate systems and/or arrangements of pixels may be utilized.
- Any suitable tool may be used to obtain one or more inspection images or portions thereof, for example, a Negevtech 302 wafer inspection tool, commercially available from Negevtech Ltd., 12 Hamada Street, Rehovot Israel 76703, operating in bright-field, dark-field, or other illumination mode.
- a reference image R x,y is obtained, with the reference image depicting the same structural features shown in the inspection image as such features would appear in a substantially-defectless state.
- the reference image may be accessed from a file or memory included in the inspection tool or accessible by the tool.
- the reference image may be generated by the inspection tool based on combining images depicting portions of an object that are (ideally, at least) identical. For instance, in a semiconductor wafer, images of identical dies may be combined, averaged, or otherwise accumulated during the inspection process to provide a reference image. Alternatively, an image of an adjacent or nearby feature of the object (such as an adjacent die of a semiconductor wafer) may be used. The particular form through which the reference image is obtained is relatively unimportant.
- the images are preferably aligned using any suitable technique, such as by the nearest neighbor method, bilinear filtering, or same-smear filtering, such as described in U.S. patent application Ser. No. 11/068,711.
- a comparison metric is applied to the ordinal ranks in I and R to define an ordinal comparison image.
- Each pixel location in the ordinal comparison image corresponds to the comparison results for an ordinal comparison between the reference image and the inspection image “centered” on that pixel (although as will be noted below, comparisons do not need to have the pixel in question at the actual center).
- pixels in the ordinal comparison image may be evaluated against one or more thresholds to determine whether or not further action is required.
- a non threshold-based comparison may be applied as well. For example, a specified number of pixels in the comparison image with the highest values (relative to other pixels in the comparison image) may be noted or flagged.
- FIG. 3 depicts gray levels in an exemplary inspection image I x,y and an exemplary corresponding reference image R x,y .
- This example shows a 3 ⁇ 3 window; however, one of ordinary skill in the art will appreciate that the size and arrangement of sets of pixels may be varied.
- FIG. 3 also shows the result of applying an ordinal ranking operator to each image.
- I x,y ord and R x,y ord represent ordinal rankings of the pixels by gray levels from lowest to highest. However, other ordinal rankings may be used, such as highest to lowest.
- pixels with the same or close gray levels may receive the same rank.
- the ordinal rankings may be determined by any suitable algorithm.
- the rankings may be determined using a threshold that may be predetermined or adaptive based on the gray levels within the window or throughout the image.
- the rankings may be linear or non-linear.
- the rankings may be based upon the gray levels alone or may be determined after one or more operations have been performed, such as filtering or smoothing. Rankings may be based on factors other than gray levels, as well.
- ordinal ranks have been obtained for I and R
- the shapes of the images may be compared by comparing the ordinal ranks.
- comparison of ordinal ranks may be performed using hardware, software, or any suitable combination thereof. For instance, Regular Distance Metrics of the form
- Equation (1) the distance between the ordinal ranks of I 1 x,y and R 1 x,y is 34.
- Equation (3) gives a distance of 7 between the ranks for I x,y and R x,y .
- a permutation-based distance measure may also be suitable for comparing ordinal ranks. Permutation based distance measurements are explained in more detail in “Ordinal Measures for Image Correspondence” by Dinkar N. Bhat and Shree K. Nayaer in IEEE Transactions on Pattern Analysis and Machine Intelligence, April 1998 (Vol. 20, No. 4).
- the rank data for I x,y and R x,y may be considered as two permutations, ⁇ inspected and ⁇ reference .
- the rank permutations are:
- ⁇ reference ⁇ 9,6,7,5,4,8,1,3,2 ⁇ (Eq. 5).
- a composition permutation, S is defined by composing ⁇ reference and the inverse permutation of ⁇ inspected .
- S is the unity permutation (S perfect match ) having the same length as ⁇ inspected and ⁇ reference .
- S perfect match the unity permutation (S perfect match ) having the same length as ⁇ inspected and ⁇ reference .
- the degree of variation between the permutations (and thus the degree of difference in shape between the images) may be measured.
- a distance measure D m may be defined as follows
- the comparison result for I and R may be derived from the maximal value of Dm, for example, using Eq. 10:
- ⁇ ⁇ 0.5, which indicates a relatively large change between the images.
- Other results may be obtained based on Dm and used for determining the presence or absence of defects. For instance, the average value of D m may be calculated.
- FIGS. 4A 4 B, and 4 C illustrate examples of how various windows may be defined.
- an image I 3 is a 3 ⁇ 6 array of pixels. Included in I 3 are pixels A, B, C, and D.
- FIG. 4A illustrates three exemplary windows W 1 , W 2 , and W 3 which may be utilized in an embodiment of object inspection in which a running window operator is used. W 1 is centered on pixel A, W 2 is centered on pixel B, and W 3 is centered on pixel C.
- ordinal ranks in I 3 and a corresponding reference image may be applied, and one or more distance metrics may be used to determine the degree of similarity between I 3 and its reference image.
- Window operators may additionally or alternatively comprise different shapes.
- FIG. 4C depicts five different exemplary window operators which may be used in various alternative embodiments of the present subject matter.
- “P” represents the pixel under consideration (i.e. the “center” of the window, although the pixel under consideration need not be in the center of the window) while “N” represents the neighboring pixels used to determine ordinal ranks, directional slopes, or other relative indicators of intensity.
- O 1 uses the 8-neighborhood of P
- O 2 uses the 4-neighborhood of P
- O 3 uses a single neighbor.
- O 4 and O 5 depict examples of the use of neighboring pixels that are not all adjacent to P.
- the type and size of windows that are used in the inspection process may be varied by one of ordinary skill in the art based on balancing factors such as cost, speed, performance, and accuracy.
- the accuracy and speed is a complex function of the algorithm, window size, and window method (i.e. jumping versus running). For instance, generally speaking, using running windows results in heavier computation but more accurate results than using jumping windows.
- the operator may be calculated only once using the data in the entire image area that is under consideration. While this method may sacrifice a certain degree of accuracy, it may be advantageous in that it is also relatively faster than both running and jumping windows.
- FIG. 2 is a flowchart depicting exemplary steps in an alternative inspection process that includes comparison of another type of relative values between images.
- the relative values are directional vectors (i.e. slopes or slants) between pixels.
- a directional slope operator is applied to pixels in I x,y and R x,y .
- the comparison metric is used to determine the degree of similarity between directional slopes and create a slope correlation image.
- the pixels in the slope correlation image may be compared to one or more thresholds, for example, to identify defects or areas for further consideration. Of course, non-threshold-based identification could be used, as well.
- the directional vectors may be defined by comparing gray levels of each pixel to one or more of its neighbors. For instance, in one embodiment, each pixel is compared to each of its 8-neighbors. In alternative embodiments, more or fewer neighbors may be compared. For example, comparing a pixel to its 4-neighbors may be less computationally intense.
- the exemplary images I 1 x,y and R 1 x,y will be again considered, this time in the context of determining directional vectors.
- Various window shapes, types, and configurations may be used in the comparison of directional slopes, including any of the windows or variants thereof discussed above in conjunction with FIGS. 4A , 4 B, and 4 C.
- the directional vector operator may define various relationships between the pixels.
- the vector will be described as undetermined if the magnitude of the difference between gray levels does not exceed a given threshold (in this example, the magnitude of the difference must exceed 10 gray levels).
- the vector will be described as increasing if the gray level of the neighbor of the pixel in question is less the gray level of the pixel in question.
- the vector will be described as decreasing if the neighbor has a higher gray level.
- determining directional vectors for I 1 2,2 and R 1 2,2 yields the following vectors and comparison results.
- the comparison sum result for pixel (2,2) is 4, since the comparison is different for N, NW, SE, and SW.
- This value may be used to generate a slope correlation image C x,y , where each pixel (x,y) in C corresponds to the comparison sum result based on comparing the directional vectors for the pixel (x,y) in I and R.
- C 2,2 4.
- directional vectors may be defined for more or fewer neighbors, such as only considering pixels in the N, S, E, and W directions, or by including both the immediate neighbors of a pixel along with further neighbors.
- vectors may be defined as “increasing” and “not-increasing” only, where “not-increasing” would include both decreasing and undetermined cases.
- the degree of the increase or decrease may be indicated, such as defining vectors as “increasing,” “strongly increasing,” “decreasing,” “strongly decreasing,” “undetermined,” etc.
- the threshold may be preset or adaptive based on the gray levels in the particular image for which directional vectors are being assigned.
- relative values such as ordinal ranks or directional vectors may allow for more accurate image comparison results in an optical inspection tool. For example, an inspection image and a reference image may be compared to one another on a pixel-by-pixel basis using relative values and, based on the comparison results, a defect may be indicated.
- Methods and systems for optical inspection may utilize relative values for a portion of the inspection process in combination with more conventional comparisons. For example, a comparison such as
- the increased accuracy from using relative-value-based comparisons comes at the cost of heavy computations, which could result in a slower and/or more expensive inspection tool. Therefore, the comparisons using relative values may be utilized as part of an inspection process that uses less computationally-intense methods to first identify suspect areas.
- an inspection tool may identify areas of an image that contain defect candidates based on I ⁇ R.
- areas without suspected defects could be subjected to analysis using relative values, but such analysis could be a less-intense version of that used on areas with defect candidates.
- areas containing defect candidates could be subjected to analysis using increasing, decreasing, and undefined vectors based on 8 neighbors, while areas without defect candidates could be subjected to analysis using increasing and not-increasing vectors based on only 4 neighboring pixels.
- Relative values may also be used in further operations in an inspection system.
- One exemplary operation uses comparisons of ordinal ranks to sort or classify detected defects.
- an inspection tool could identify one or more defects using any suitable detection methodology or combinations thereof, including gray level comparisons and/or relative values. Then, pixels in areas of images containing the defects that have been identified could be assigned relative values. If the defect detection process utilizes relative values, of course, the previously-calculated relative values could be used. The relative values for the defect images could then be compared to relative values for one or more defect reference images in order to identify the type of defect(s) that have been detected.
- the defect reference images may be processed using relative values in the same manner for the other reference images as set forth above.
- the defect images may be pre-processed and maintained as sets of relative values for ready comparison.
- pre-processed relative values may be used for the other reference images above, as well.
- a 10 ⁇ 10 window from an inspection image and a reference image are obtained using an optical inspection tool.
- the window from the inspection image obtained at 110 may be an area indicated as containing a suspected defect.
- the window may be a sub-image of an inspection image that is being processed using a plurality of 10 ⁇ 10 windows in sequence.
- an adaptive threshold for the inspected image is calculated based on gray levels in the image, while at step 126 an adaptive threshold is calculated for the reference image based on gray levels therein.
- directional vectors i.e. slants
- directional vectors are calculated for each pixel in the 10 ⁇ 10 inspected window using the adaptive threshold.
- directional vectors are calculated for each pixel in the 10 ⁇ 10 reference window using the reference window adaptive threshold.
- the slants for each pixel relative to each of its neighbors in the inspection image are compared to corresponding slants in the reference image to define a pixel slope correlation image.
- the original inspection image and reference image are compared conventionally, for example, by subtraction. Furthermore, at step 146 , the difference image (or other conventional output image) is divided by a factor.
- the pixel slope correlation image is added to the scaled difference image to obtain a total defect image.
- a 3 ⁇ 3 sum operator is applied to the total defect image.
- the area is flagged as containing a suspected defect if the average of the five highest values (after applying the sum operator) exceeds a given threshold.
- FIG. 6 is a block diagram illustrating a microscopic object inspection system constructed and operative in accordance with the subject matter discussed herein. Although illustrated as distinct blocks, the various illustrated components may be combined into or further divided into more or fewer physical or logical units than are illustrated in FIG. 6 . Each of the illustrated components may be implemented using hardware and software components suitably configured and interfaced.
- An electro-optical imager 900 such as that used in a Negevtech 302 wafer inspection tool, commercially available from Negevtech Ltd., 12 Hamada Street, Rehovot Israel 76703, generates a plurality of images of structural features of one or more objects to be inspected.
- the tool may operate in bright-field, dark-field, orthogonal dark field, or other modes and obtain images of several semiconductor wafers (or portions thereof).
- the inspection system also includes image pre-processing unit 910 .
- Pre-processing unit may include software and hardware configured to sort and align corresponding images of inspected objects.
- pre-processing unit 910 may be configured to align images of identical portions of inspected objects to one another.
- Other pre-processing operations may include adjusting or enhancing the brightness, contrast, or other properties of images.
- Image pre-processing unit may also be configured to divide images into portions for piecemeal detection and further operations.
- Reference image generation unit 920 comprises hardware and software components configured to generate one or more reference images to be used in determining the presence or absence of defects.
- Reference image generation unit may, for example, obtain the median from a plurality of images provided by image pre-processing unit 910 , with the images depicting the same structural features of an object.
- reference image generation unit may utilize other data sources in addition to or instead of other inspection images.
- reference images may be derived from data including physical characteristics of the object being inspected.
- a defect candidate identifier 930 is operative to compare an image to be inspected to a corresponding reference image.
- the comparison may be made on a die-to-die or a cell-to-cell basis such as is described in U.S. patent application Ser. No. 11/069,712.
- comparisons may be based on identifying the maximal differences in pixel intensities between the images.
- the reference image that is used may be derived from the combination of many images depicting ideally-identical structural features to those depicted in the inspection image.
- the defect candidate identification unit may perform a number of different operations before determining the existence of a possible defect.
- One or more defect candidates may then be identified to a relative value based comparison unit 940 .
- the identification may include data, for example, pixel coordinates, identifying where in the image the defect candidate occurs.
- the relative value based comparison unit 940 may then evaluate differences between the inspection and reference images based on ordinal values, directional vectors, and/or other relative measurements for an area of pixels surrounding the defect candidate(s).
- relative value based comparison unit may include logic and programming designed to assign ordinal values to pixels in the inspection and reference images and determine defects based on comparisons of ordinal ranks as discussed above.
- unit 940 may use one or more embodiments of the directional vector methods discussed above.
- Unit 940 may then provide defect data for further use in the inspection process.
- the defect data can include, for example, the relative value comparison results and the location of the defect candidate.
- the defect data may be compared to a threshold, and if such threshold is met or exceeded, the defect may be flagged or otherwise noted for further analysis and processing.
Abstract
Description
- In the semiconductor industry, devices are fabricated by a number of processes to produce precisely-defined structures of an ever-decreasing size. Even the slightest structural defect can ruin a semiconductor device, and so to avoid losses of time and effort, detection of defects is critical before a defective device is mass-produced or further processes are performed on a defective wafer. Various inspection tools may be utilized, including those in which a view of a wafer (or other device or object) is compared to a reference image showing the wafer in a defect-free state. A reference image or images may be used, such as views of portions of the same wafer that (ideally speaking) contain the same structural features, for example.
- Many optical inspection tools perform defect detection based on comparing gray levels between images. For instance, an inspection image Ix,y may be obtained for comparison to a reference image Rx,y. Defects may be detected by subtracting the images (Ix,y−Rx,y) and using various algorithms to determine the existence (or non-existence) of defects by evaluating the subtraction image. See, for example, U.S. patent application Ser. No. 10/345,097, filed Jun. 15, 2003, which is hereby incorporated by reference for all purposes herein.
- Other comparison formulas have been discussed in varying degrees of detail. For instance, in “Golden Template Comparison” by William A. Silver (Sensors, October 1990), the use of a correction function on the inspection image, along with another function performed on the subtraction image is discussed. U.S. Pat. No. 4,579,455 discusses an inspection system that includes summing neighboring pixels to aid in determining the presence or absence of a defect.
- However, there is a need for improvement in various applications to improve the detection of defects while also avoiding or eliminating false alarms. For instance, using dark-field imaging on patterned dies may lead to false alarms when gray level comparisons are used alone. For example, differences in the slopes of edges, wafer layer widths, and/or slight defocusing of the image may cause significant differences between reference and inspection image gray levels even though no defect is present.
- Methods of inspecting an object such as a semiconductor wafer can include determining the similarity of pattern shapes between an inspection image and a reference image. Shapes may be compared by assigning relative values to pixels in each image based on their neighboring pixels and then comparing relative values in area(s) of the inspection image to relative values in corresponding area(s) of the reference image. Comparing shapes rather than gray levels alone advantageously reduces the false alarm rate. For example, false alarms due to gray level differences in non-defective areas caused by process variation or change in the image conditions can be reduced since the shape of the area is considered.
- A method of detecting defects can include obtaining an inspection image depicting at least a part of an object, such as a semiconductor wafer, reticle, or other object. The image may be obtained using an optical inspection system. The method may further include obtaining a reference image representing the same part of the object shown in the inspection image as said part would appear in a substantially-defectless state. For instance, the reference image may comprise an image of another part of the object or an aggregate of inspection images, for example. The method may further comprise comparing at least a portion of the inspection image to a corresponding portion of the reference image.
- Comparing may include determining the degree of similarity between the portion of the inspection image and the portion of the reference image by comparing relative values of one or more pixels in the inspection image to relative values of one or more corresponding pixels in the reference image and flagging the compared portions based on comparing the degree of similarity to a threshold value. If shapes in the areas in the inspection image and reference image are similar, the relative values will also be similar. However, if the shapes are different, the relative values will differ.
- For example, the relative values may comprise ordinal ranks of a pixel relative to its neighboring pixels. Determining the degree of similarity can include applying a comparison metric to the ordinal ranks to determine how close ranks in the inspection image are to ranks in the reference image for the same area. The ordinal ranks may be determined by ranking the relative brightness of a pixel as compared to pixels in a neighborhood of varying size. For instance, the pixel's 4-neighborhood, 8-neighborhood, or larger neighborhoods may be used. Neighboring pixels may be adjacent or non-adjacent.
- Any suitable comparison metric may be used to compare the ordinal ranks in the inspection image to the ordinal ranks in the reference image. For instance, Regular Distance Metrics and Hamming Distance metrics may be utilized. Metrics based on permutations may be suitable, as well. A permutation-based distance metric may define a permutation of the ranks in the inspection image and a permutation of the ranks in the reference image. The reference permutation may be composed with the inspection permutation to define a composition permutation, which may then be compared to a unity permutation of the same length. The degree of difference between the inspection and reference permutations can be determined based on the distance between the composition permutation and the unity permutation.
- Reference images may be obtained in any suitable manner. For example, a plurality of images depicting the same structural elements as shown in the inspection image may be accumulated or otherwise combined to generate a reference image.
- Prior to comparing the inspection and reference images through use of relative values, the images may be compared in a preliminary image comparison using any suitable technique(s) to identify one or more defect candidates. The areas including the defect candidates may then be compared using relative measures, which may advantageously reduce computational requirements. For instance, the preliminary image comparison may include a gray level comparison. Alternatively, entire inspection images may be compared to entire reference images using relative measures.
- In some embodiments, one or more defects may be detected based on comparing relative values in the inspection image and the reference image. After identification, the defect(s) can be classified, including comparing the assigned relative values for the portion of the image comprising the at least one defect(s) to relative values in one or more defect reference images.
- Another exemplary comparison methodology based on relative measures uses directional vectors based on slopes or slants between pixels. When comparing a reference and inspection image, the directional slope between a pixel and its neighbors may first be determined in each image. Then, the directional slopes for the pixel or pixels in the inspection image may be compared to the directional slopes for the corresponding pixel or pixels in the reference image to determine the degree to which the directional slopes match.
- Directional slopes between pixels may be determined based on comparing the magnitude of difference in gray level between the pixels and the sign of the difference. The slope may be determined based on a threshold value, with no slope indicated if the magnitude does not meet the threshold. The threshold may be constant, user-specified, or adaptive. For instance, the slope may be defined as increasing, decreasing, or undetermined (i.e. neither increasing or decreasing). Alternatively, the slope may be defined using more or fewer degrees of description. For instance, to conserve computing resources, the slopes may be defined as increasing or not-increasing, with the latter case including both decreasing and undetermined slopes.
- A method of detecting defects can include obtaining an inspection image and a corresponding reference image of an object, such as a semiconductor wafer. At least one suspected defect in the inspection image may be identified through a preliminary image comparison. For each suspected defect, an area surrounding the defect in the inspection image and a corresponding area in the reference image may be selected. For each pixel in each selected area, slope values for the pixel relative to its surrounding pixels may be established. Each pixel may be replaced by a pixel slope correlation value representing the amount of correlation between the reference and inspection images.
- The reference image and inspection image may be compared by a gray level comparison. Each pixel of the subtraction image from that comparison may be divided by a factor, with the resulting image added to the pixel slope correlation image to obtain a total comparison image. A sum operator may be applied to the total comparison image. The average of the five highest values in the area after the sum operator has been applied may be compared to determine if the average exceeds a threshold value. For example, the area may be indicated as containing a defect, or may be highlighted for further analysis and/or processing if the threshold is exceeded.
- An electro-optical inspection system can include a light source configured to illuminate an object, an imager operative to obtain an image of the object, and at least one processing unit. The processing unit may be configured to carry out steps including obtaining an inspection image of the object, accessing a reference image depicting the same structural features of the object as they would appear in a substantially-defectless state, assigning relative values to pixels in the inspection image and to corresponding pixels in the reference image, comparing relative values for pixels in the inspection image to relative values for pixels in the reference image, and indicating an area as containing a suspected defect based on the comparison results.
- The system may be further configured to combine images depicting like structural features of the object and store the combination as a reference image. Relative values may be assigned by ranking pixels based on relative brightness. Relative values may be assigned by assigning directional slope indicator values based on the direction of the change of brightness between pixels.
- A full and enabling disclosure, including the best mode of practicing the appended claims, directed to one of ordinary skill in the art, is set forth more particularly in the remainder of the specification, which makes reference to the appended figures, in which:
-
FIG. 1 is a flowchart showing exemplary steps that may be included in a method of detecting defects using ordinal ranks; -
FIG. 2 is a flowchart showing exemplary steps that may be included in a method of detecting defects using slope comparisons; -
FIG. 3 depicts exemplary portions of an inspection image and a reference image; -
FIG. 4 shows exemplary windows which may be used in comparisons of an exemplary image; -
FIG. 5 is a flowchart showing exemplary steps in a method of defect detection; -
FIG. 6 is a block diagram showing the operation of an exemplary defect inspection system. - Use of like reference numerals in different features is intended to illustrate like or analogous components.
- Reference will now be made in detail to various and alternative exemplary embodiments and to the accompanying drawings, with like numerals representing substantially identical structural elements. Each example is provided by way of explanation, and not as a limitation. In fact, it will be apparent to those skilled in the art that modifications and variations can be made without departing from the scope or spirit of the disclosure and claims. For instance, features illustrated or described as part of one embodiment may be used on another embodiment to yield a still further embodiment. Thus, it is intended that the instant disclosure includes modifications and variations as come within the scope of the appended claims and their equivalents.
- As noted above, the present subject matter generally pertains to determining the presence or absence of a defect by comparing the shapes depicted in a reference and inspection image. For instance, relative values indicating the relationship(s) between pixels within an inspection image may be compared to relative values of corresponding pixels in a reference image. Based on comparing the relative values, the degree of similarity or dissimilarity in the shapes depicted in the inspection and reference images may be assessed. If shapes are too dissimilar, a defect may be present. Although specific examples of relative values are discussed herein, other relative values may be suitable for use based on the teachings contained herein. Similarly, specific types of inspection tools, modes, and inspection objects are also discussed herein, but for purposes of example only. For instance, the objects inspected may include not only semiconductor wafers, but also other objects of any size, shape, or configuration.
-
FIG. 1 is a flow chart illustrating exemplary steps in an inspection process that includes comparison of relative values between images. At 10, an inspection image Ix,y depicting at least a portion of an object may be obtained using an optical inspection tool. In the examples used herein, x and y refer to row and column coordinates, respectively, within an image. For instance, I3,7 refers to the pixel in image I where x=3 and y=7. The discussion herein uses rectangular coordinates and rectangular images for purposes of example only; one of skill in the art will appreciate that other coordinate systems and/or arrangements of pixels may be utilized. - Any suitable tool may be used to obtain one or more inspection images or portions thereof, for example, a Negevtech 302 wafer inspection tool, commercially available from Negevtech Ltd., 12 Hamada Street, Rehovot Israel 76703, operating in bright-field, dark-field, or other illumination mode. At 20, a reference image Rx,y is obtained, with the reference image depicting the same structural features shown in the inspection image as such features would appear in a substantially-defectless state.
- For example, the reference image may be accessed from a file or memory included in the inspection tool or accessible by the tool. The reference image may be generated by the inspection tool based on combining images depicting portions of an object that are (ideally, at least) identical. For instance, in a semiconductor wafer, images of identical dies may be combined, averaged, or otherwise accumulated during the inspection process to provide a reference image. Alternatively, an image of an adjacent or nearby feature of the object (such as an adjacent die of a semiconductor wafer) may be used. The particular form through which the reference image is obtained is relatively unimportant.
- Although not shown in the figure, one of skill in the art will appreciate that, as a preliminary step prior to comparing I and R, the images are preferably aligned using any suitable technique, such as by the nearest neighbor method, bilinear filtering, or same-smear filtering, such as described in U.S. patent application Ser. No. 11/068,711.
- At
step 30, relative values are applied to at least some of the pixels in the inspection image and at least some of the corresponding pixels in the reference image. In the example ofFIG. 1 , an operator is used to rank pixels in I and R relative to neighboring pixels. For instance, pixels in neighborhoods of varying sizes may be ranked. Depending upon the particular operator that is used, the ranked pixels may not necessarily be adjacent. - At
step 40, a comparison metric is applied to the ordinal ranks in I and R to define an ordinal comparison image. Each pixel location in the ordinal comparison image corresponds to the comparison results for an ordinal comparison between the reference image and the inspection image “centered” on that pixel (although as will be noted below, comparisons do not need to have the pixel in question at the actual center). Then, atstep 50, pixels in the ordinal comparison image may be evaluated against one or more thresholds to determine whether or not further action is required. A non threshold-based comparison may be applied as well. For example, a specified number of pixels in the comparison image with the highest values (relative to other pixels in the comparison image) may be noted or flagged. - The particulars of applying the ordinal ranks operator and comparison metric will now be discussed in more detail in conjunction with
FIG. 3 .FIG. 3 depicts gray levels in an exemplary inspection image Ix,y and an exemplary corresponding reference image Rx,y. This example shows a 3×3 window; however, one of ordinary skill in the art will appreciate that the size and arrangement of sets of pixels may be varied.FIG. 3 also shows the result of applying an ordinal ranking operator to each image. In this example, Ix,y ord and Rx,y ord, represent ordinal rankings of the pixels by gray levels from lowest to highest. However, other ordinal rankings may be used, such as highest to lowest. In some embodiments, pixels with the same or close gray levels may receive the same rank. - The ordinal rankings may be determined by any suitable algorithm. For example, the rankings may be determined using a threshold that may be predetermined or adaptive based on the gray levels within the window or throughout the image. The rankings may be linear or non-linear. Furthermore, the rankings may be based upon the gray levels alone or may be determined after one or more operations have been performed, such as filtering or smoothing. Rankings may be based on factors other than gray levels, as well.
- Once ordinal ranks have been obtained for I and R, the shapes of the images may be compared by comparing the ordinal ranks. As is the case with obtaining ordinal ranks, comparison of ordinal ranks may be performed using hardware, software, or any suitable combination thereof. For instance, Regular Distance Metrics of the form
-
- may be suitable. Using Equation (1) and the exemplary images in
FIG. 3 , the distance between the ordinal ranks of I1 x,y and R1 x,y is 34. - Hamming Distance Metrics may also be suitable, generally following the form
-
- Equation (3) gives a distance of 7 between the ranks for Ix,y and Rx,y.
- A permutation-based distance measure may also be suitable for comparing ordinal ranks. Permutation based distance measurements are explained in more detail in “Ordinal Measures for Image Correspondence” by Dinkar N. Bhat and Shree K. Nayaer in IEEE Transactions on Pattern Analysis and Machine Intelligence, April 1998 (Vol. 20, No. 4).
- The rank data for Ix,y and Rx,y may be considered as two permutations, Πinspected and πreference. For the example of
FIG. 3 , the rank permutations are: -
πinspected={1,2,3,5,4,7,6,9,8} (Eq. 4); and -
πreference={9,6,7,5,4,8,1,3,2} (Eq. 5). - A composition permutation, S, is defined by composing πreference and the inverse permutation of πinspected. For the above examples,
-
S={9,6,7,4,5,1,8,2,3} (Eq. 6). - For a perfect match between πinspected and πreference, S is the unity permutation (Sperfect match) having the same length as πinspected and πreference. In this example:
-
Sperfect match={1,2,3,4,5,6,7,8,9} (Eq. 7). - By finding the distance between S and Sperfect match, the degree of variation between the permutations (and thus the degree of difference in shape between the images) may be measured.
- Various suitable distance measures may be used to determine the distance. For instance, the Dinkar article noted above includes a distance measure in its discussions of permutations. However, a more simplified distance measure may be suitable for use in the optical inspection context in order to conserve computational resources by reducing the intensity and number of operations which are performed. For example, a distance measure Dm may be defined as follows
-
- Using
equation 8, the distance measure between the inspection and reference permutations is: -
Dm={1,2,3,3,3,2,2,1,0} (Eq. 9). - The comparison result for I and R may be derived from the maximal value of Dm, for example, using Eq. 10:
-
- In the example of
FIG. 3 , κ=−0.5, which indicates a relatively large change between the images. Other results may be obtained based on Dm and used for determining the presence or absence of defects. For instance, the average value of Dm may be calculated. - The above examples discussed the use of ordinal measures and distance metrics generally with regard to an exemplary 3×3 pixel window. One of skill in the art will recognize that there are a wide variety of available options in defining windows for the purposes of optical inspection. Furthermore, it will be apparent that the window does not need to be rectangular or symmetric. It will be still further apparent that the window need not have a particular predetermined shape and may have any number of pixels. The methods and systems disclosed herein may utilize pixels that are connected, not connected, or may utilize combinations of connected and not-connected pixels.
-
FIGS. 4A 4B, and 4C illustrate examples of how various windows may be defined. InFIG. 4A , an image I3 is a 3×6 array of pixels. Included in I3 are pixels A, B, C, and D.FIG. 4A illustrates three exemplary windows W1, W2, and W3 which may be utilized in an embodiment of object inspection in which a running window operator is used. W1 is centered on pixel A, W2 is centered on pixel B, and W3 is centered on pixel C. For each window, ordinal ranks in I3 and a corresponding reference image may be applied, and one or more distance metrics may be used to determine the degree of similarity between I3 and its reference image. - However, one of ordinary skill in the art will appreciate that use of a running-window operator may be computationally intense. Accordingly, a jumping-window operator may be used. As shown in 4B, only two windows (W1 and W4) are defined, but all of pixels A, B, C, and D are included.
- Window operators may additionally or alternatively comprise different shapes. For example,
FIG. 4C depicts five different exemplary window operators which may be used in various alternative embodiments of the present subject matter. In these examples, “P” represents the pixel under consideration (i.e. the “center” of the window, although the pixel under consideration need not be in the center of the window) while “N” represents the neighboring pixels used to determine ordinal ranks, directional slopes, or other relative indicators of intensity. For example, O1 uses the 8-neighborhood of P, O2 uses the 4-neighborhood of P, and O3 uses a single neighbor. O4 and O5 depict examples of the use of neighboring pixels that are not all adjacent to P. One of skill in the art will recognize that further variation, alteration, and selection of pixels for use in window operators is entirely within the spirit and scope of the present subject matter. For instance, other variations could include, but are not limited to, changing the number of neighboring pixels beyond what is shown in these examples and/or using combinations of some adjacent and some non-adjacent pixels. - The type and size of windows that are used in the inspection process may be varied by one of ordinary skill in the art based on balancing factors such as cost, speed, performance, and accuracy. The accuracy and speed is a complex function of the algorithm, window size, and window method (i.e. jumping versus running). For instance, generally speaking, using running windows results in heavier computation but more accurate results than using jumping windows.
- As a further alternative, the operator may be calculated only once using the data in the entire image area that is under consideration. While this method may sacrifice a certain degree of accuracy, it may be advantageous in that it is also relatively faster than both running and jumping windows.
- As noted above, other types of relative values may be used as the comparison basis.
FIG. 2 is a flowchart depicting exemplary steps in an alternative inspection process that includes comparison of another type of relative values between images. In the example ofFIG. 2 , the relative values are directional vectors (i.e. slopes or slants) between pixels. After obtaining an inspection and reference image atsteps step 30A a directional slope operator is applied to pixels in Ix,y and Rx,y. Atstep 40A, the comparison metric is used to determine the degree of similarity between directional slopes and create a slope correlation image. Atstep 50A, the pixels in the slope correlation image may be compared to one or more thresholds, for example, to identify defects or areas for further consideration. Of course, non-threshold-based identification could be used, as well. - The directional vectors may be defined by comparing gray levels of each pixel to one or more of its neighbors. For instance, in one embodiment, each pixel is compared to each of its 8-neighbors. In alternative embodiments, more or fewer neighbors may be compared. For example, comparing a pixel to its 4-neighbors may be less computationally intense. Returning to
FIG. 3 , the exemplary images I1 x,y and R1 x,y will be again considered, this time in the context of determining directional vectors. Various window shapes, types, and configurations may be used in the comparison of directional slopes, including any of the windows or variants thereof discussed above in conjunction withFIGS. 4A , 4B, and 4C. - A directional vector operator may be applied to I1 and R1 to determine the slopes between pixels within each image. For this example, slopes of the 8-neighbors of the pixel located at x=2, y=2 in each image (i.e. I1 2,2 and R1 2,2) will be discussed. The directional vector operator may define various relationships between the pixels.
- In this example, the vector will be described as undetermined if the magnitude of the difference between gray levels does not exceed a given threshold (in this example, the magnitude of the difference must exceed 10 gray levels). For differences that exceed the threshold, the vector will be described as increasing if the gray level of the neighbor of the pixel in question is less the gray level of the pixel in question. The vector will be described as decreasing if the neighbor has a higher gray level. After directional vectors have been defined, the vectors may be compared. An exemplary comparison ruleset is set forth below.
-
TABLE 1 Exemplary Rules for Comparison Between I and R Inspected Reference Comparison Increasing Increasing 0 Increasing Undetermined 0 Increasing Decreasing 1 Undetermined Increasing 0 Undetermined Undetermined 0 Undetermined Decreasing 0 Decreasing Increasing 1 Decreasing Undetermined 0 Decreasing Decreasing 0 - Using the exemplary rules in set forth above, determining directional vectors for I1 2,2 and R1 2,2 yields the following vectors and comparison results.
- Under the exemplary rules used here, a perfect match would result in a total comparison sum of 0, while a complete mis-match results in a total comparison sum of 8. Here, the comparison sum result for pixel (2,2) is 4, since the comparison is different for N, NW, SE, and SW.
- This value may be used to generate a slope correlation image Cx,y, where each pixel (x,y) in C corresponds to the comparison sum result based on comparing the directional vectors for the pixel (x,y) in I and R. For example, C2,2=4.
- One of skill in the art will appreciate that the rules for defining the directional vectors as well as the comparison results may be varied in order to fine-tune the inspection process. For instance, directional vectors may be defined for more or fewer neighbors, such as only considering pixels in the N, S, E, and W directions, or by including both the immediate neighbors of a pixel along with further neighbors.
- Furthermore, it is possible to use more or fewer characterizations of the directional vectors. For example, vectors may be defined as “increasing” and “not-increasing” only, where “not-increasing” would include both decreasing and undetermined cases. As a further example, the degree of the increase or decrease may be indicated, such as defining vectors as “increasing,” “strongly increasing,” “decreasing,” “strongly decreasing,” “undetermined,” etc.
- Still further variations may be obtained through defining the threshold and calculations used to characterize the vectors. For instance, the threshold may be preset or adaptive based on the gray levels in the particular image for which directional vectors are being assigned.
- As discussed above, use of relative values such as ordinal ranks or directional vectors may allow for more accurate image comparison results in an optical inspection tool. For example, an inspection image and a reference image may be compared to one another on a pixel-by-pixel basis using relative values and, based on the comparison results, a defect may be indicated.
- Methods and systems for optical inspection may utilize relative values for a portion of the inspection process in combination with more conventional comparisons. For example, a comparison such as |I−R| may be performed to obtain a difference image which is then scaled by a factor. A comparison based on relative values, such as using ordinal ranks or directional vectors may be performed on the original images and the relative-value-based output scaled by a second factor. The total comparison may be the sum of the scaled difference image and the scaled relative-value-based output image.
- In certain contexts, the increased accuracy from using relative-value-based comparisons comes at the cost of heavy computations, which could result in a slower and/or more expensive inspection tool. Therefore, the comparisons using relative values may be utilized as part of an inspection process that uses less computationally-intense methods to first identify suspect areas.
- For example, an inspection tool may identify areas of an image that contain defect candidates based on I−R. U.S. patent application Ser. No. 11/069,712, filed Feb. 25, 2005, which is hereby incorporated by reference herein in its entirety, discusses identifying areas containing suspected defects based on calculations including a comparison of gray levels in I to gray levels in R. Such a method could be used to identify defect candidates, and the area or areas in the image containing defect candidates could be subjected to analysis using relative values. Such analysis could be skipped for areas that do not contain suspected defects.
- Alternatively, areas without suspected defects could be subjected to analysis using relative values, but such analysis could be a less-intense version of that used on areas with defect candidates. For example, in a system using directional vectors, the areas containing defect candidates could be subjected to analysis using increasing, decreasing, and undefined vectors based on 8 neighbors, while areas without defect candidates could be subjected to analysis using increasing and not-increasing vectors based on only 4 neighboring pixels.
- Relative values, whether ordinal ranks, directional slopes, or another type, may also be used in further operations in an inspection system. One exemplary operation uses comparisons of ordinal ranks to sort or classify detected defects. For instance, an inspection tool could identify one or more defects using any suitable detection methodology or combinations thereof, including gray level comparisons and/or relative values. Then, pixels in areas of images containing the defects that have been identified could be assigned relative values. If the defect detection process utilizes relative values, of course, the previously-calculated relative values could be used. The relative values for the defect images could then be compared to relative values for one or more defect reference images in order to identify the type of defect(s) that have been detected. The defect reference images may be processed using relative values in the same manner for the other reference images as set forth above. Alternatively, however, if the same defect reference images are used for multiple comparisons, the defect images may be pre-processed and maintained as sets of relative values for ready comparison. One of skill in the art will recognize that pre-processed relative values may be used for the other reference images above, as well.
- An exemplary inspection process utilizing both conventional and relative-value-based analysis is depicted in
FIG. 5 . Atsteps - At
step 116, an adaptive threshold for the inspected image is calculated based on gray levels in the image, while atstep 126 an adaptive threshold is calculated for the reference image based on gray levels therein. Atstep 130, directional vectors (i.e. slants) are calculated for each pixel in the 10×10 inspected window using the adaptive threshold. Atstep 136, directional vectors (i.e. slants) are calculated for each pixel in the 10×10 reference window using the reference window adaptive threshold. - At
step 140, the slants for each pixel relative to each of its neighbors in the inspection image are compared to corresponding slants in the reference image to define a pixel slope correlation image. Atstep 146, the original inspection image and reference image are compared conventionally, for example, by subtraction. Furthermore, atstep 146, the difference image (or other conventional output image) is divided by a factor. - At
step 147, the pixel slope correlation image is added to the scaled difference image to obtain a total defect image. Atstep 148, a 3×3 sum operator is applied to the total defect image. Atstep 150, the area is flagged as containing a suspected defect if the average of the five highest values (after applying the sum operator) exceeds a given threshold. - One of skill in the art will appreciate that variations, substitutions, and other alterations of the steps discussed in conjunction with
FIG. 5 are possible. For instance, ordinal values and a comparison metric may be used in addition to or instead of directional slopes. Furthermore, although a 10×10 window is discussed, larger, smaller, and/or differently-shaped windows may be utilized. Similarly, instead of a 3×3 sum operator, a sum operator of a different size or another type of spatial or other operator may be used. Although the conventional comparison that is discussed is a subtraction operation, other image comparison methods may be substituted. The output of the conventional comparison may be scaled and/or subjected to further processing before being combined with the output of the relative-value based comparison. -
FIG. 6 is a block diagram illustrating a microscopic object inspection system constructed and operative in accordance with the subject matter discussed herein. Although illustrated as distinct blocks, the various illustrated components may be combined into or further divided into more or fewer physical or logical units than are illustrated inFIG. 6 . Each of the illustrated components may be implemented using hardware and software components suitably configured and interfaced. - An electro-
optical imager 900 such as that used in a Negevtech 302 wafer inspection tool, commercially available from Negevtech Ltd., 12 Hamada Street, Rehovot Israel 76703, generates a plurality of images of structural features of one or more objects to be inspected. For instance, the tool may operate in bright-field, dark-field, orthogonal dark field, or other modes and obtain images of several semiconductor wafers (or portions thereof). - The inspection system also includes
image pre-processing unit 910. Pre-processing unit may include software and hardware configured to sort and align corresponding images of inspected objects. Forexample pre-processing unit 910 may be configured to align images of identical portions of inspected objects to one another. Other pre-processing operations may include adjusting or enhancing the brightness, contrast, or other properties of images. Image pre-processing unit may also be configured to divide images into portions for piecemeal detection and further operations. - Reference
image generation unit 920 comprises hardware and software components configured to generate one or more reference images to be used in determining the presence or absence of defects. Reference image generation unit may, for example, obtain the median from a plurality of images provided byimage pre-processing unit 910, with the images depicting the same structural features of an object. However, reference image generation unit may utilize other data sources in addition to or instead of other inspection images. For example, reference images may be derived from data including physical characteristics of the object being inspected. - A
defect candidate identifier 930 is operative to compare an image to be inspected to a corresponding reference image. For example, the comparison may be made on a die-to-die or a cell-to-cell basis such as is described in U.S. patent application Ser. No. 11/069,712. In some embodiments, comparisons may be based on identifying the maximal differences in pixel intensities between the images. However, other modes of comparison and/or bases for comparison may be used. For example, as noted above, the reference image that is used may be derived from the combination of many images depicting ideally-identical structural features to those depicted in the inspection image. The defect candidate identification unit may perform a number of different operations before determining the existence of a possible defect. - One or more defect candidates may then be identified to a relative value based
comparison unit 940. The identification may include data, for example, pixel coordinates, identifying where in the image the defect candidate occurs. The relative value basedcomparison unit 940 may then evaluate differences between the inspection and reference images based on ordinal values, directional vectors, and/or other relative measurements for an area of pixels surrounding the defect candidate(s). - For example, relative value based comparison unit may include logic and programming designed to assign ordinal values to pixels in the inspection and reference images and determine defects based on comparisons of ordinal ranks as discussed above. Alternatively,
unit 940 may use one or more embodiments of the directional vector methods discussed above.Unit 940 may then provide defect data for further use in the inspection process. The defect data can include, for example, the relative value comparison results and the location of the defect candidate. For example, the defect data may be compared to a threshold, and if such threshold is met or exceeded, the defect may be flagged or otherwise noted for further analysis and processing. - One of ordinary skill in the art will appreciate that the methods described herein may be utilized with other types and arrangements of inspection and other tools. The various image processing steps and processes may be implemented using software, hardware, and combinations thereof. For example, certain steps may be implemented in programmable logic or other hardware in the inspection tool, with other steps implemented using software algorithms.
- The various computer systems discussed herein are not limited to any particular hardware architecture or configuration. Any suitable programming, scripting, or other type of language or combinations of languages may be used to implement the teachings contained herein.
- It is appreciated by persons skilled in the art that what has been particularly shown and described above is not meant to be limiting, but instead serves to show and teach various exemplary implementations of the present subject matter. As set forth in the attached claims, the scope of the present invention includes both combinations and sub-combinations of various features discussed herein, along with such variations and modifications as would occur to a person of skill in the art.
Claims (26)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/590,650 US7369236B1 (en) | 2006-10-31 | 2006-10-31 | Defect detection through image comparison using relative measures |
IL186554A IL186554A0 (en) | 2006-10-31 | 2007-10-10 | Defect detection through image comparison using relative measures |
US11/958,731 US7916286B2 (en) | 2006-10-31 | 2007-12-18 | Defect detection through image comparison using relative measures |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/590,650 US7369236B1 (en) | 2006-10-31 | 2006-10-31 | Defect detection through image comparison using relative measures |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/958,731 Continuation US7916286B2 (en) | 2006-10-31 | 2007-12-18 | Defect detection through image comparison using relative measures |
Publications (2)
Publication Number | Publication Date |
---|---|
US20080100844A1 true US20080100844A1 (en) | 2008-05-01 |
US7369236B1 US7369236B1 (en) | 2008-05-06 |
Family
ID=39329705
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/590,650 Active US7369236B1 (en) | 2006-10-31 | 2006-10-31 | Defect detection through image comparison using relative measures |
US11/958,731 Active 2028-07-22 US7916286B2 (en) | 2006-10-31 | 2007-12-18 | Defect detection through image comparison using relative measures |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/958,731 Active 2028-07-22 US7916286B2 (en) | 2006-10-31 | 2007-12-18 | Defect detection through image comparison using relative measures |
Country Status (2)
Country | Link |
---|---|
US (2) | US7369236B1 (en) |
IL (1) | IL186554A0 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010094025A2 (en) * | 2009-02-16 | 2010-08-19 | Kla-Tencor Corporation | Use of design information and defect image information in defect classification |
US20110201135A1 (en) * | 2006-07-31 | 2011-08-18 | Globalfoundries Inc. | Method of Reducing Contamination by Providing a Removable Polymer Protection Film During Microstructure Processing |
US8106355B1 (en) | 2008-06-27 | 2012-01-31 | Kla-Tencor Corporation | Automated inspection using cell-cell subtraction perpendicular to stage motion direction |
WO2017161132A1 (en) * | 2016-03-17 | 2017-09-21 | Kla-Tencor Corporation | System, method and computer program product for identifying fabricated component defects using a local adaptive threshold |
WO2018089459A1 (en) * | 2016-11-10 | 2018-05-17 | Kla-Tencor Corporation | High sensitivity repeater defect detection |
WO2019223274A1 (en) * | 2018-05-22 | 2019-11-28 | Midea Group Co., Ltd. | Methods and systems for improved quality inspection |
CN111103317A (en) * | 2018-10-26 | 2020-05-05 | 台湾积体电路制造股份有限公司 | System and method for scanning wafer |
CN113039432A (en) * | 2018-11-18 | 2021-06-25 | 因斯佩克托艾姆威有限责任公司 | Optimizing setup phases in an automated visual inspection process |
JP7451857B2 (en) | 2020-02-13 | 2024-03-19 | 公立大学法人会津大学 | Inspection program, inspection equipment and inspection method |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7729529B2 (en) * | 2004-12-07 | 2010-06-01 | Kla-Tencor Technologies Corp. | Computer-implemented methods for detecting and/or sorting defects in a design pattern of a reticle |
US7369236B1 (en) * | 2006-10-31 | 2008-05-06 | Negevtech, Ltd. | Defect detection through image comparison using relative measures |
US7855088B2 (en) * | 2006-12-21 | 2010-12-21 | Texas Instruments Incorporated | Method for manufacturing integrated circuits by guardbanding die regions |
US8073240B2 (en) * | 2007-05-07 | 2011-12-06 | Kla-Tencor Corp. | Computer-implemented methods, computer-readable media, and systems for identifying one or more optical modes of an inspection system as candidates for use in inspection of a layer of a wafer |
US8107758B2 (en) * | 2008-04-16 | 2012-01-31 | Microsoft Corporation | Block based image processing |
JP4941422B2 (en) * | 2008-07-14 | 2012-05-30 | パナソニック株式会社 | Component mounting system |
US9768082B2 (en) | 2009-02-13 | 2017-09-19 | Hermes Microvision Inc. | Method and machine for examining wafers |
US8108805B2 (en) * | 2010-03-26 | 2012-01-31 | Tokyo Electron Limited | Simplified micro-bridging and roughness analysis |
KR20120068128A (en) * | 2010-12-17 | 2012-06-27 | 삼성전자주식회사 | Method of detecting defect in pattern and apparatus for performing the method |
JP2012251785A (en) * | 2011-05-31 | 2012-12-20 | Nuflare Technology Inc | Inspection device and inspection method |
US20130071006A1 (en) * | 2011-09-19 | 2013-03-21 | International Business Machines Corporation | Image Analysis of Processor Device Features |
TWI489420B (en) * | 2012-02-29 | 2015-06-21 | Chroma Ate Inc | Method for detecting surface patterns of a sample |
US9766187B2 (en) * | 2014-08-27 | 2017-09-19 | Kla-Tencor Corp. | Repeater detection |
US9766186B2 (en) * | 2014-08-27 | 2017-09-19 | Kla-Tencor Corp. | Array mode repeater detection |
US9613294B2 (en) * | 2015-03-19 | 2017-04-04 | Intel Corporation | Control of computer vision pre-processing based on image matching using structural similarity |
EP3371657B9 (en) | 2015-11-05 | 2021-12-15 | Carl Zeiss SMT GmbH | Method and device for characterizing a wafer patterned using at least one lithography step |
DE102016213925A1 (en) | 2016-07-28 | 2018-02-01 | Carl Zeiss Smt Gmbh | Method and device for characterizing a wafer structured by at least one lithography step |
US9927375B2 (en) * | 2015-12-21 | 2018-03-27 | Applied Materials Israel Ltd. | System and method for printability based inspection |
US11429806B2 (en) * | 2018-11-09 | 2022-08-30 | Canon Virginia, Inc. | Devices, systems, and methods for anomaly detection |
US11416982B2 (en) * | 2019-10-01 | 2022-08-16 | KLA Corp. | Controlling a process for inspection of a specimen |
CN114943855A (en) * | 2021-02-09 | 2022-08-26 | 富泰华工业(深圳)有限公司 | Image classification labeling method and device, electronic equipment and storage medium |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4579455A (en) * | 1983-05-09 | 1986-04-01 | Kla Instruments Corporation | Photomask inspection apparatus and method with improved defect detection |
US4809341A (en) * | 1986-07-18 | 1989-02-28 | Fujitsu Limited | Test method and apparatus for a reticle or mask pattern used in semiconductor device fabrication |
US5146509A (en) * | 1989-08-30 | 1992-09-08 | Hitachi, Ltd. | Method of inspecting defects in circuit pattern and system for carrying out the method |
US5767974A (en) * | 1995-02-24 | 1998-06-16 | Mitsubishi Denki Kabushiki Kaisha | Apparatus and method for identifying photomask pattern defects |
US5850467A (en) * | 1990-11-05 | 1998-12-15 | Fujitsu Limited | Image data inspecting method and apparatus providing for equal sizing of first and second image data to be compared |
US5943437A (en) * | 1995-10-09 | 1999-08-24 | Kabushiki Kaisha Kobe Seiko Sho | Method and apparatus for classifying a defect on a semiconductor wafer |
US6072897A (en) * | 1997-09-18 | 2000-06-06 | Applied Materials, Inc. | Dimension error detection in object |
US6466314B1 (en) * | 1998-09-17 | 2002-10-15 | Applied Materials, Inc. | Reticle design inspection system |
US20040146295A1 (en) * | 2003-01-15 | 2004-07-29 | Negevtech Ltd. | System for detection of wafer defects |
US20060193507A1 (en) * | 2005-02-28 | 2006-08-31 | Negevtech Ltd. | Method and apparatus for detecting defects in wafers |
US20060193506A1 (en) * | 2005-02-28 | 2006-08-31 | Negevtech Ltd. | Method and apparatus for detecting defects in wafers including alignment of the wafer images so as to induce the same smear in all images |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3587846T2 (en) * | 1984-12-26 | 1994-10-06 | Hitachi Ltd | Method and device for checking the geometry of multilayer patterns for integrated circuit structures. |
US4845558A (en) * | 1987-12-03 | 1989-07-04 | Kla Instruments Corporation | Method and apparatus for detecting defects in repeated microminiature patterns |
IL102659A (en) * | 1992-07-27 | 1997-07-13 | Orbot Instr Ltd | Apparatus and method for comparing and aligning two digital representations of an image |
JPH0763691A (en) * | 1993-08-24 | 1995-03-10 | Toshiba Corp | Method and apparatus for inspection of pattern defect |
DE69634089T2 (en) * | 1995-10-02 | 2005-12-08 | Kla-Tencor Corp., San Jose | IMPROVING THE ORIENTATION OF INSPECTION SYSTEMS BEFORE IMAGE RECORDING |
US6148114A (en) * | 1996-11-27 | 2000-11-14 | Ultrapointe Corporation | Ring dilation and erosion techniques for digital image processing |
WO1998059213A1 (en) * | 1997-06-25 | 1998-12-30 | Matsushita Electric Works, Ltd. | Pattern inspecting method and pattern inspecting device |
JP3907874B2 (en) * | 1999-08-02 | 2007-04-18 | 松下電器産業株式会社 | Defect inspection method |
US7155052B2 (en) * | 2002-06-10 | 2006-12-26 | Tokyo Seimitsu (Israel) Ltd | Method for pattern inspection |
US7369236B1 (en) * | 2006-10-31 | 2008-05-06 | Negevtech, Ltd. | Defect detection through image comparison using relative measures |
-
2006
- 2006-10-31 US US11/590,650 patent/US7369236B1/en active Active
-
2007
- 2007-10-10 IL IL186554A patent/IL186554A0/en unknown
- 2007-12-18 US US11/958,731 patent/US7916286B2/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4579455A (en) * | 1983-05-09 | 1986-04-01 | Kla Instruments Corporation | Photomask inspection apparatus and method with improved defect detection |
US4809341A (en) * | 1986-07-18 | 1989-02-28 | Fujitsu Limited | Test method and apparatus for a reticle or mask pattern used in semiconductor device fabrication |
US5146509A (en) * | 1989-08-30 | 1992-09-08 | Hitachi, Ltd. | Method of inspecting defects in circuit pattern and system for carrying out the method |
US5850467A (en) * | 1990-11-05 | 1998-12-15 | Fujitsu Limited | Image data inspecting method and apparatus providing for equal sizing of first and second image data to be compared |
US5767974A (en) * | 1995-02-24 | 1998-06-16 | Mitsubishi Denki Kabushiki Kaisha | Apparatus and method for identifying photomask pattern defects |
US5943437A (en) * | 1995-10-09 | 1999-08-24 | Kabushiki Kaisha Kobe Seiko Sho | Method and apparatus for classifying a defect on a semiconductor wafer |
US6072897A (en) * | 1997-09-18 | 2000-06-06 | Applied Materials, Inc. | Dimension error detection in object |
US6466314B1 (en) * | 1998-09-17 | 2002-10-15 | Applied Materials, Inc. | Reticle design inspection system |
US20040146295A1 (en) * | 2003-01-15 | 2004-07-29 | Negevtech Ltd. | System for detection of wafer defects |
US20060193507A1 (en) * | 2005-02-28 | 2006-08-31 | Negevtech Ltd. | Method and apparatus for detecting defects in wafers |
US20060193506A1 (en) * | 2005-02-28 | 2006-08-31 | Negevtech Ltd. | Method and apparatus for detecting defects in wafers including alignment of the wafer images so as to induce the same smear in all images |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110201135A1 (en) * | 2006-07-31 | 2011-08-18 | Globalfoundries Inc. | Method of Reducing Contamination by Providing a Removable Polymer Protection Film During Microstructure Processing |
US8216927B2 (en) * | 2006-07-31 | 2012-07-10 | Globalfoundries Inc. | Method of reducing contamination by providing a removable polymer protection film during microstructure processing |
US8106355B1 (en) | 2008-06-27 | 2012-01-31 | Kla-Tencor Corporation | Automated inspection using cell-cell subtraction perpendicular to stage motion direction |
WO2010094025A2 (en) * | 2009-02-16 | 2010-08-19 | Kla-Tencor Corporation | Use of design information and defect image information in defect classification |
US20100208979A1 (en) * | 2009-02-16 | 2010-08-19 | Kla-Tencor Corporation | Use of design information and defect image information in defect classification |
WO2010094025A3 (en) * | 2009-02-16 | 2010-11-18 | Kla-Tencor Corporation | Use of design information and defect image information in defect classification |
US8175373B2 (en) | 2009-02-16 | 2012-05-08 | Kla-Tencor Corporation | Use of design information and defect image information in defect classification |
CN109074644A (en) * | 2016-03-17 | 2018-12-21 | 科磊股份有限公司 | For using system, method and the computer program product of local auto-adaptive threshold value identification manufacture component defect |
US10043265B2 (en) | 2016-03-17 | 2018-08-07 | Kla-Tencor Corporation | System, method and computer program product for identifying fabricated component defects using a local adaptive threshold |
WO2017161132A1 (en) * | 2016-03-17 | 2017-09-21 | Kla-Tencor Corporation | System, method and computer program product for identifying fabricated component defects using a local adaptive threshold |
KR102295269B1 (en) * | 2016-11-10 | 2021-08-27 | 케이엘에이 코포레이션 | High-sensitivity repeater fault detection |
KR20190069597A (en) * | 2016-11-10 | 2019-06-19 | 케이엘에이-텐코 코포레이션 | Highly sensitive repeater fault detection |
CN109964115A (en) * | 2016-11-10 | 2019-07-02 | 科磊股份有限公司 | High sensitive duplicate keys defects detection |
US10395358B2 (en) | 2016-11-10 | 2019-08-27 | Kla-Tencor Corp. | High sensitivity repeater defect detection |
WO2018089459A1 (en) * | 2016-11-10 | 2018-05-17 | Kla-Tencor Corporation | High sensitivity repeater defect detection |
WO2019223274A1 (en) * | 2018-05-22 | 2019-11-28 | Midea Group Co., Ltd. | Methods and systems for improved quality inspection |
US10706525B2 (en) | 2018-05-22 | 2020-07-07 | Midea Group Co. Ltd. | Methods and systems for improved quality inspection |
US11037289B2 (en) * | 2018-10-26 | 2021-06-15 | Taiwan Semiconductor Manufacturing Company Ltd. | Method and system for scanning wafer |
CN111103317A (en) * | 2018-10-26 | 2020-05-05 | 台湾积体电路制造股份有限公司 | System and method for scanning wafer |
US20210304397A1 (en) * | 2018-10-26 | 2021-09-30 | Taiwan Semiconductor Manufacturing Company Ltd. | Method and system for scanning wafer |
US11783469B2 (en) * | 2018-10-26 | 2023-10-10 | Taiwan Semiconductor Manufacturing Company Ltd. | Method and system for scanning wafer |
CN113039432A (en) * | 2018-11-18 | 2021-06-25 | 因斯佩克托艾姆威有限责任公司 | Optimizing setup phases in an automated visual inspection process |
JP7451857B2 (en) | 2020-02-13 | 2024-03-19 | 公立大学法人会津大学 | Inspection program, inspection equipment and inspection method |
Also Published As
Publication number | Publication date |
---|---|
US7916286B2 (en) | 2011-03-29 |
US20080101686A1 (en) | 2008-05-01 |
US7369236B1 (en) | 2008-05-06 |
IL186554A0 (en) | 2008-01-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7369236B1 (en) | Defect detection through image comparison using relative measures | |
JP5624326B2 (en) | Method for accurately identifying the edge of an inspection area for an array area formed on a wafer, and a method for binning detected defects in an array area formed on a wafer | |
JP6358351B1 (en) | Surface defect inspection method and surface defect inspection apparatus | |
US7200258B2 (en) | Method for selecting reference images, method and apparatus for inspecting patterns on wafers, and method for dividing a wafer into application regions | |
US9355208B2 (en) | Detecting defects on a wafer | |
KR102110634B1 (en) | Wafer inspection using free-form care areas | |
KR101934313B1 (en) | System, method and computer program product for detection of defects within inspection images | |
US10600175B2 (en) | Dynamic care areas for defect detection | |
KR100972149B1 (en) | Multi-detector defect detection system and a method for detecting defects | |
KR101674698B1 (en) | Detecting defects on a wafer | |
US8331651B2 (en) | Method and apparatus for inspecting defect of pattern formed on semiconductor device | |
US20070053580A1 (en) | Image defect inspection apparatus, image defect inspection system, defect classifying apparatus, and image defect inspection method | |
US20080024798A1 (en) | System and method for measuring thin film thickness variations and for compensating for the variations | |
US7492942B2 (en) | Image defect inspection method, image defect inspection apparatus, and appearance inspection apparatus | |
TWI533383B (en) | Design-based inspection using repeating structures | |
US7869643B2 (en) | Advanced cell-to-cell inspection | |
KR20110048528A (en) | Computer-implemented methods for inspecting and / or sorting wafers | |
JP4711570B2 (en) | Pattern inspection method and inspection apparatus | |
TWI778258B (en) | Methods, systems, and non-transitory computer readable medium of defect detection | |
US8055057B2 (en) | Method for detecting defects in a substrate having a semiconductor device thereon | |
CN114764770A (en) | Wafer detection method, device, equipment and storage medium | |
CN116543247A (en) | Data set manufacturing method and verification system based on photometric stereo surface reconstruction | |
US20230206417A1 (en) | Detection of defects using a computationally efficient segmentation approach | |
JP7475901B2 (en) | Method and system for detecting defects on a test piece | |
JP2001210690A (en) | Macroscopic inspecting apparatus for semiconductor wafer |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NEGEVTECH, LTD., ISRAEL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SALI, EREZ;COHEN, OREN;REEL/FRAME:018813/0163 Effective date: 20070115 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: KREOS CAPITAL II LIMITED Free format text: SECURITY AGREEMENT;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:021109/0971 Effective date: 20080330 Owner name: PLENUS II, L.P., ISRAEL Free format text: SECURITY AGREEMENT;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:021118/0061 Effective date: 20080330 Owner name: PLENUS II (D.C.M), ISRAEL Free format text: SECURITY AGREEMENT;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:021118/0061 Effective date: 20080330 Owner name: PLENUS II, L.P.,ISRAEL Free format text: SECURITY AGREEMENT;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:021118/0061 Effective date: 20080330 Owner name: PLENUS II (D.C.M),ISRAEL Free format text: SECURITY AGREEMENT;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:021118/0061 Effective date: 20080330 |
|
AS | Assignment |
Owner name: APPLIED MATERIALS SOUTH EAST ASIA PTE. LTD., SINGA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:022878/0815 Effective date: 20090611 Owner name: APPLIED MATERIALS SOUTH EAST ASIA PTE. LTD.,SINGAP Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NEGEVTECH LTD.;REEL/FRAME:022878/0815 Effective date: 20090611 |
|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |