US20070091323A1 - Pick and place machine with improved component pick image processing - Google Patents
Pick and place machine with improved component pick image processing Download PDFInfo
- Publication number
- US20070091323A1 US20070091323A1 US11/521,066 US52106606A US2007091323A1 US 20070091323 A1 US20070091323 A1 US 20070091323A1 US 52106606 A US52106606 A US 52106606A US 2007091323 A1 US2007091323 A1 US 2007091323A1
- Authority
- US
- United States
- Prior art keywords
- pick
- image
- component
- nozzle
- place machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
- H05K13/00—Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
- H05K13/04—Mounting of components, e.g. of leadless components
- H05K13/0404—Pick-and-place heads or apparatus, e.g. with jaws
- H05K13/0408—Incorporating a pick-up tool
- H05K13/0409—Sucking devices
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
- H05K13/00—Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
- H05K13/08—Monitoring manufacture of assemblages
- H05K13/081—Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines
- H05K13/0812—Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines the monitoring devices being integrated in the mounting machine, e.g. for monitoring components, leads, component placement
Definitions
- Pick and place machines are generally used to manufacture electronic circuit boards.
- a blank printed circuit board is usually supplied to the pick and place machine, which then picks electronic components from component feeders, and places such components upon the board.
- the components are held upon the board temporarily by solder paste, or other adhesive until a subsequent step in which the solder paste is melted, or the adhesive is fully cured.
- Picking up a component requires the placement head to be positioned over the pick up point for the target component. Once the nozzle is so positioned, it is lowered to a point just above the component and a vacuum is applied through the nozzle which sucks the component up and temporarily attaches it to the end of the nozzle.
- Each component is positioned at its pick point by a component feeder mechanism.
- Typical feeder mechanisms include tape feeders, vibratory feeders and tray feeders. Once a component is picked up by the nozzle, the feeder mechanism must move another component into the pick position. If the component pick operation is not successful, defective work pieces are produced. Defects on work pieces that are known to be caused by bad pick operations are tombstoned components, missing components, wrong components, wrong component polarity, and misplaced components. Further, defects are also caused by operators loading feeders into incorrect positions; allowing feeders to run out of components; defective or broken feeders, component tapes and/or nozzles; incorrectly programmed nozzle pick heights; and incorrectly positioned components.
- Providing a method of assessing the effectiveness of a pick operation without slowing machine throughput, and without adding significant hardware to the pick and place machine, would allow pick and place machine operation to more accurately identify pick errors, and ensure that such errors do not generate defective workpieces. Additionally, identifying pick errors before they create defective work pieces (such as entire circuit boards) would vastly simplify rework since the pick and place machine can simply discard the erroneously picked component and pick another one. In contrast, if the erroneously picked component is actually placed upon the workpiece, the error may not be discovered until after final soldering or adhesive curing is complete. Given that a particular workpiece, such as a circuit board, may contain hundreds or even thousands of individual components, the workpiece itself could be relatively costly, and require relatively costly manual rework in order to ensure that the entire workpiece is not lost.
- a pick and place machine includes a sensor disposed to acquire an image of a nozzle before a pick operation, and one or more images after the pick operation. Image analytics based upon these images reveal important characteristics that can be used to classify the pick operation.
- a plurality of after-pick images are acquired at different poses (angular orientations).
- FIG. 1 is a diagrammatic view of an exemplary Cartesian pick and place machine with which embodiments of the present invention are applicable.
- FIG. 2 is a diagrammatic view of an exemplary rotary turret pick and place machine with which embodiments of the present invention are applicable.
- FIG. 3 is a diagrammatic view of an image acquisition system disposed to acquire one or more images relative to a pick operation in accordance with an embodiment of the present invention.
- FIG. 4 is a diagrammatic view of a sensor for sensing component hose upon a pick and place machine nozzle in accordance with an embodiment of the present invention.
- FIG. 5 is a diagrammatic view of a compact component sensor in accordance with another embodiment of the present invention.
- FIG. 6 is a diagrammatic view of sensor in accordance with another embodiment of the present invention.
- FIG. 7 is a diagrammatic view of a representative before-pick image in accordance with an embodiment of the present invention.
- FIG. 8 is a diagrammatic view of an image acquired after a component has been picked up by nozzle in accordance with an embodiment of the present invention.
- FIG. 9 is a diagrammatic view of a before-pick nozzle image being used to generate a template in accordance with an embodiment of the present invention.
- FIG. 10 is a diagrammatic view of a template being used with after-pick image in accordance with an embodiment of the present invention.
- FIG. 11 is a diagrammatic view of a difference image derived by subtracting the before-image from the co-registered after-image.
- FIG. 12 is a diagrammatic view illustrating an extracted vertical center as well as left and right most component points in accordance with an embodiment of the present invention.
- FIG. 13 is a chart of offsets of leads from vertical center for various components.
- FIG. 14 is a diagrammatic view of a non-focused before-pick image acquired in accordance with an embodiment of the present invention.
- FIG. 15 is a diagrammatic view of a blurred after-pick image acquired in accordance with an embodiment of the present invention.
- FIG. 16 is a diagrammatic view of a blurred before-pick nozzle image being used to generate a template in accordance with an embodiment of the present invention.
- FIG. 17 is a diagrammatic view illustrating a template being used to identify a nozzle in an after-pick image in accordance with an embodiment of the present invention.
- FIG. 18 is a diagrammatic view of a blurred difference image derived by subtracting a blurred before-pick image from a co-registered blurred after-pick image.
- FIG. 19 is a diagrammatic view of an image containing a blob related to the image of the picked component, in accordance with an embodiment of the present invention.
- FIG. 20 is a diagrammatic view of an image constructing a rectangle about a blob in order measure a characteristic of the blob.
- FIG. 21 is a graph illustrating the way in which the orientation of the major axis in degrees varies for different poses (angular orientations) of a component on a nozzle.
- FIG. 22 is a graph illustrating the way in which the blob height varies for different poses (angular orientations) of a component on a nozzle.
- FIG. 23 is a graph illustrating the way in which the aspect ratio varies for different poses (angular orientations) of a component on a nozzle.
- FIG. 24 is a diagrammatic view of a series of images, each depicting a non-focused shadow image of a component disposed upon a nozzle at a different angular orientation, in accordance with an embodiment of the present invention.
- FIG. 25 is a diagrammatic view of a series of images showing a component retained upon a nozzle in a plurality of different poses.
- FIGS. 26A, 26B and 26 C are diagrammatic views illustrating various metrics such as height (H), width (W), and angle of major axis orientation (theta- ⁇ ).
- FIGS. 27-29 are graphs illustrating how various component metrics such as apparent component tip ( FIG. 27 ), apparent relative component height ( FIG. 28 ), and apparent component aspect ratio ( FIG. 29 ) vary with different component poses.
- FIG. 30 is a flow diagram of a method of characterizing a pick operation of a pick and place machine in accordance with an embodiment of the present invention.
- FIG. 1 is a diagrammatic view of an exemplary Cartesian pick and place machine 201 with which embodiments of the present invention are applicable.
- Pick and place machine 201 receives a workpiece, such as circuit board 203 , via transport system or conveyor 202 .
- a placement head 206 then obtains one or more electrical components to be mounted upon workpiece 203 from component feeders (not shown) and moves in x, y and z directions, relative to workpiece 203 , to place the component in the proper orientation at the proper location upon workpiece 203 .
- Placement head 206 may include sensor 205 that is disposed to view one or more components held by respective one or more nozzle, from a substantially side view as placement head 206 moves the component(s) from pickup locations to placement locations.
- Sensor 205 allows placement machine 201 to view components held by nozzles 208 , 210 , 212 such that pick efficacy can be determined prior to mounting the component(s) upon workpiece 203 .
- Other pick and place machines may employ a placement head that moves over a stationary camera to image the component.
- Placement head 206 may also include a downwardly looking camera 209 , which is generally used to locate fiducial marks upon workpiece 203 such that the relative location of placement head 206 with respect to workpiece 203 can be readily calculated.
- FIG. 2 is a diagrammatic view of an exemplary rotary turret pick and place machine 10 with which embodiments of the present invention are applicable.
- Machine 10 includes some components that are similar to machine 201 and like components are numbered similarly.
- workpiece 203 is loaded via a conveyor onto an x-y stage (not shown).
- Attached to main turret 20 are placement heads 210 that are disposed at regular angular intervals around the rotating turret.
- turret 20 indexes an angular distance equal to the angular distance between adjacent placement nozzles 210 .
- a placement nozzle 210 obtains a component 304 (shown in FIG. 3 ) from a component feeder 14 at a defined pick point 16 .
- another nozzle 210 places a component 304 onto the workpiece 203 at a preprogrammed placement location 106 .
- upward looking camera 30 acquires and image of another component 304 , which may provide alignment information for that component. This alignment information is used by pick and place machine 10 to position workpiece 203 when placement nozzle 210 is positioned several steps later to place component 104 .
- turret 20 indexes to the next angular position and workpiece 203 is repositioned in x-y direction(s) to move the placement location to position which corresponds to the placement location 106 .
- FIG. 3 is a diagrammatic view of image acquisition system 300 disposed to acquire one or more images relative to a pick operation in accordance with an embodiment of the present invention.
- Image acquisition system 300 preferably includes an electronic camera 308 that may include a suitable charge couple device, or complimentary metal oxide semiconductor device.
- System 300 is disposed to view component 304 when component 304 is held by nozzle 210 .
- Image acquisition system 300 may have an optical axis that is arranged to view component 304 from a non-zero angle with respect to horizontal.
- embodiments of the present invention can be practiced wherein image acquisition system 300 does, in fact, view component 304 using an optical axis having a zero angle with respect to the horizontal.
- System 300 also preferably includes an illuminator 310 that generates illumination 312 , which illumination 312 is redirected by illumination optics 314 .
- Redirected illumination 316 passes through the area proximate component 304 when component 304 is retained on nozzle 210 .
- Imaging optics 318 is disposed to redirect and focus the illumination upon image acquisition system 300 .
- the utilization of illumination optics 314 and imaging optics 318 allows image acquisition system 300 to obtain a backlit substantially side elevation view of component 304 , even though component 304 is maintained at an angle that is different than the optical imaging axis of image acquisition system 300 .
- Image acquisition system 300 obtains an image of nozzle 210 prior to nozzle 210 picking component 304 from component feeder 14 . Then, after component 304 has been picked by nozzle 210 , image acquisition system 300 obtains one or more post-pick images. A comparison of the before and after-pick images provides important information relative to the effectiveness of the pick operation.
- FIG. 4 is a diagrammatic view of a sensor for sensing components on a pick and place machine nozzle in accordance with an embodiment of the present invention.
- Sensor 401 includes illumination source 400 disposed to generate diverging illumination 402 which illumination 402 enters collimating optics 404 and is transformed into collimated illumination 406 . As collimated illumination 406 impinges upon component 304 , some of the illumination is blocked generating component shadow 408 . Component shadow 408 is detected by area detector 410 .
- Area detector 410 is coupled to a suitable signal processor 411 or image processor to process the image or images acquired of the shadow component 304 .
- Processor 411 can be a suitable microprocessor disposed within sensor 401 , or processor 411 could be a remote processor, such as a microprocessor disposed within the pick and place machine.
- processor 411 By processing the image(s), various measures of component 304 can be determined, including apparent height, width and angle. One or more of these measures facilitate the determination of the quality of the pick operation. If component 304 meets “good pick” criteria, component 304 will be placed on the printed circuit board.
- FIG. 5 is a diagrammatic view of a compact component sensor in accordance with another embodiment of the present invention. While processor 411 is not shown in FIG. 5 , such illustration is provided in order to contrast the differences in the embodiments illustrated in FIG. 4 and 5 , and sensor 412 would indeed employ an image processor, such as processor 411 .
- Sensor 412 includes source 400 and detector 410 , but does not include any imaging or illumination optics. Shadow 408 of component 304 continues to diverge, and is considered, an unfocused shadow. Notwithstanding the fact that shadow 408 is unfocused, image processing is still able to render a number of important measurements with respect to the pick effectiveness.
- FIG. 6 is a diagrammatic view of sensor 420 in accordance with another embodiment of the present invention. While processor 411 is not shown in FIG. 6 , such illustration is provided in order to contrast the differences in the embodiments illustrated in FIG. 4, 5 and 6 , and sensor 420 would indeed employ an image processor, such as processor 411 .
- Sensor 420 includes illuminator 422 that is an area source of back light for component 304 on nozzle 210 .
- Sensor 420 also includes optical element 424 disposed between component 304 and detector 410 . Element 424 provides a focused shadow image of component 304 upon detector 410 .
- the sensor embodiments illustrated in FIGS. 4-6 generally provide a very compact sensor design.
- This compact design allows the sensor to be easily incorporated onto a moving placement head, such as a placement head of a Cartesian pick and place machine.
- a moving placement head such as a placement head of a Cartesian pick and place machine.
- area array detectors to obtain shadows of components held by nozzles of a pick and place machine can provide a number of important metrics with respect to the effectiveness of the pick operation.
- Various types of image processing can be used on one or more such shadow images.
- FIG. 7 is a diagrammatic view of a representative before-pick image 430 of nozzle. 210 .
- nozzle 210 presents a shadow image indicated by cross hatching 432 .
- the distal end 434 of nozzle 210 is shown having aperture 436 through which a vacuum is typically applied.
- FIG. 8 is a diagrammatic view of an image 438 acquired after a component 304 has been picked up by nozzle 210 .
- Component 304 is illustrated as a standard SOT 23 component, but may be any component. Additionally, the image of component 304 is a shadow image. The vacuum applied through aperture 436 adheres component 304 to distal end 434 of nozzle 210 .
- FIG. 9 is a diagrammatic view of nozzle 210 in image 430 being used to generate template 440 .
- the use of template 440 is important for subsequent correlation to after-pick images.
- the manner in which the nozzle pattern is extracted from before-pick image 430 can be done in any suitable way using known techniques, or later developed techniques.
- FIG. 10 illustrates template 440 being used with after-pick image 438 .
- Template 440 is used in a correlation search to identify nozzle 210 in the after-pick image.
- One way in which this correlation can be done is using a known normalized gray-scale correlation (NGC) based correlation search.
- NGC normalized gray-scale correlation
- blobs are preferably labeled using a simple region growing technique and all but the largest blob (presumably the component) are suppressed.
- the non-suppressed blob corresponds to the picked component.
- a minimum enclosing rectangle is computed for this largest blob and the left and right most coordinates of the blob are noted.
- the extracted component's vertical center is also calculated.
- Rectangle 443 illustrating the extracted vertical center as well as left and right most points are illustrated in FIG. 12 . If the vertical coordinate (Y) of either the left most or the right most part pixel falls in the component's vertical half closer to the nozzle, then it is concluded that the component has been picked upside down.
- a digital signal processor such as processor 411 , is programmed with these simple operations. Specifically, let L y be the vertical (Y) coordinate of the left most pixel of the extracted component; let R y be the vertical (Y) coordinate of the right most pixel of the extracted component; and let C y by the vertical (Y) center of the extracted component. Then, let left offset equal L y -C y . Additionally, let right offset equal R y -C y .
- FIG. 13 is a chart of offsets of leads from vertical center for various components.
- FIG. 13 illustrates flipped pick identification using lead vertical offsets from the component's vertical center.
- the correctly placed parts are generally in the positive X and Y axes, while incorrectly placed parts are in the negative ⁇ X and ⁇ Y axes.
- image analysis for component shadows on a nozzle of a pick and place machine provide a number of advantages. Specifically, co-registration of before and after-pick images based on the nozzle pattern provides accurate, robust and reliable registration methods. Additionally, NGC-based searching is very suitable for digital signal processing. Further, image processing operations are simple enough to be programmed into commercially available digital signal processors. Further still, significant information can be extracted from even a single view in order to successfully identify an incorrect pick (such as an upside down pick). Moreover, the image processing operations are simple enough so that the required measurements can be computed quickly to meet the need of real-time operation.
- FIG. 14 is a diagrammatic view of non-focused before-pick image 450 .
- Image 450 shows blurred nozzle 452 .
- FIG. 15 shows after-pick image 454 depicting component 456 disposed upon nozzle 452 .
- FIG. 16 illustrates a template 458 , similar to template 440 illustrated in FIG. 9 , which template 458 is used to isolate nozzle 452 in after-pick images.
- FIG. 17 illustrates template 458 being used to identify nozzle 456 in the after-pick image 454 .
- Various methods exist to co-register two images such as correlating the entire image, correlating specific sections on both sides of the nozzle, et cetera.
- image analysis utilize the before-pick image and extract the nozzle pattern therefrom in order to use the extracted nozzle pattern as a template in an NGC-based correlation search.
- Difference image 460 (illustrated in FIG. 18 ) is derived by subtracting before-pick image 450 from the co-registered after-pick image 454 .
- Difference image 460 will contain some artifacts (caused by the shadow casting scheme).
- the artifacts are preferably suppressed by an automatic thresholding technique such as that described above with respect to the Otsu paper. Further still, it is preferred that a morphological closing operation be applied to the threshold image to improve connectivity within blobs.
- the blobs are preferably labeled using a simple region growing technique and all but the largest blob are suppressed. The remaining blob corresponds to the picked component.
- a minimum enclosing rectangle is computed for this largest blob and features such as component height (vertical extent) and component width (horizontal extent), and aspect ratio (height/width) are computed.
- moments of inertia about the x, y and XY-axis are computed and the orientation of the major axis is derived from these three moments.
- part offset from the nozzle center is also computed.
- FIG. 19 is a diagrammatic view of image 462 containing blob 464 related to the image of the picked component. Further, FIG. 20 shows image 466 having rectangle 468 constructed about blob 464 in order to determine moments of inertia, et cetera.
- the measurements that can be performed based upon the component image include apparent component height, aspect ratio (height/width) and orientation of the major axes. These measurements, alone and in certain combinations, are capable of characterizing a given pick as good or bad. To successfully use the apparent height and aspect ratio to classify a pick, some a-priori knowledge of the component may be necessary. However, the orientation of the major axes measurement alone may be sufficient to classify a pick provided in established threshold of allowable orientations is known.
- measurements from more than one view, or angular orientation of the component upon the nozzle may be necessary to unambiguously classify a pick. If a-priori knowledge of the component is not available, then it is still possible to classify a pick as good or bad from measurements made from a number of views, such as three views. These three views are spaced at appropriate intervals, for example 45° apart. Comparing the apparent component heights and widths based upon each view for the three views, a component pick can be classified as good or bad.
- the rules to classify a pick based on apparent component height are:
- Rule 2 If rule 1 fails, then compare the component height of the first view against the minimum component widths of the second and third views. If the component height of the first view is greater than the above minimum, then it is bad pick.
- Rule 3 If both rules 1 and 2 fail, then the pick has a high probability of being good.
- FIG. 21 is a chart illustrating the way in which the orientation of the major axis varies for different poses (angular orientations) of a component on a nozzle.
- a component on the nozzle is rotated through 16 different shadow poses, a component that has been properly picked will have very little variability.
- various pick errors such as billboarding, corner picks, and tombstoning, generate drastically varying orientations of major axis values as the various shadow poses are acquired.
- FIGS. 22 and 23 also indicate that a good pick can also be determined from a number of poses using different metrics, such as blob height ( FIG. 22 ) and aspect ratio ( FIG. 23 ).
- FIG. 24 shows a series of images 470 , 472 , 474 each depicting a non-focused shadow image of a 10 component 304 disposed upon a nozzle 210 at a different angular orientation (pose). It is known for pick and place machines to have a rotatable nozzle such that the angular orientation of the component can be adjusted to correctly place the component in is its proper orientation upon the workpiece.
- a plurality of after-pick shadow images are acquired with each image being acquired while the part is in a different pose.
- the image analytics described above can be performed on one or all of the after-pick shadow images and the extracted metrics can be compared for each of the poses. A component that has been properly picked, will have significantly less variance in the various extracted metrics than an erroneously picked component.
- FIG. 25 is a diagrammatic view of a series of images 476 , 478 , 480 showing component 304 retained upon nozzle 210 in a plurality of different poses.
- FIG. 25 differs from FIG. 24 in that the images of FIG. 25 are focused shadow images.
- FIG. 25 illustrates a condition known as a corner pick where a corner of component 304 is lodged in the vacuum aperture.
- FIG. 25 also illustrates that in various poses, or angular ordinations, the corner picked component 304 presents drastically different profiles.
- FIGS. 27-29 illustrate various component metrics: apparent component tip; apparent relative component height; and apparent component aspect ratio; respectively, and a variety of different component poses. As evident in FIGS. 27-29 , a component that has been correctly picked will exhibit the lowest variability in these variance metrics as the pose varies. Accordingly, the variance of one or more metrics can be compared to a pre-selected threshold to simply determine whether the component has been picked effectively.
- FIG. 30 is a flow diagram of a method of characterizing a pick operation of a pick and place machine in accordance with an embodiment of the present invention.
- Method 500 begins at block 502 where a sensor, such as sensor 205 , is used to obtain a before-pick image of a nozzle of the pick and place machine.
- the nozzle pattern in the before-pick image is used to generate a template.
- one or more after-pick images are acquired.
- blocks 504 and 506 can be executed in any order, including simultaneously.
- the template is generated, it is used to identify the nozzle in the after-pick image(s), as indicated at block 508 .
- the before-pick image and the after-pick image(s) are correlated, preferably using an NGC-based correlation.
- a difference image is generated at block 511 by subtracting the before-pick image from the correlated after-pick image(s).
- the difference image(s) are preferably thresholded using known thresholding techniques.
- a morphological closing operation is preferably applied to the thresholded difference image.
- the blobs are preferably labeled using a simple region growing technique and all but the largest blob are suppressed.
- one or more metrics are calculated based on the difference image.
- the metrics are used to characterize the pick operation as either good or bad.
- Method 500 can be used for both focused shadows and non-focused shadows.
- Embodiments of the present invention allow relatively simple image acquisition systems to be used with commercially available digital signal processors to provide accurate pick characterizations in real-time during operation of the pick and place machine. This results in reduced occurrence of placement of erroneously picked components, and reduction of rework required to remedy such problems.
Abstract
Description
- The present application is based on and claims the benefit of U.S. provisional patent application Ser. No. 60/717,127, filed Sep. 14, 2005, the content of which is hereby incorporated by reference in its entirety.
- A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever.
- Pick and place machines are generally used to manufacture electronic circuit boards. A blank printed circuit board is usually supplied to the pick and place machine, which then picks electronic components from component feeders, and places such components upon the board. The components are held upon the board temporarily by solder paste, or other adhesive until a subsequent step in which the solder paste is melted, or the adhesive is fully cured.
- Pick and place machine operation is challenging. Since machine speed corresponds with throughput, the faster the pick and place machine runs, the less costly the manufactured board will be. Additionally, placement accuracy is extremely important. Many electrical components, such as chip capacitors and chip resistors are relatively small and must be accurately placed on equally small placement locations. Other components, while larger, have a significant number of leads or conductors that are spaced from one another at a relatively fine pitch. Such components must also be accurately placed to ensure that each lead is placed upon the proper pad. Thus, not only must the machine operate extremely fast, but it must also place components extremely accurately.
- Picking up a component requires the placement head to be positioned over the pick up point for the target component. Once the nozzle is so positioned, it is lowered to a point just above the component and a vacuum is applied through the nozzle which sucks the component up and temporarily attaches it to the end of the nozzle. Each component is positioned at its pick point by a component feeder mechanism. Typical feeder mechanisms include tape feeders, vibratory feeders and tray feeders. Once a component is picked up by the nozzle, the feeder mechanism must move another component into the pick position. If the component pick operation is not successful, defective work pieces are produced. Defects on work pieces that are known to be caused by bad pick operations are tombstoned components, missing components, wrong components, wrong component polarity, and misplaced components. Further, defects are also caused by operators loading feeders into incorrect positions; allowing feeders to run out of components; defective or broken feeders, component tapes and/or nozzles; incorrectly programmed nozzle pick heights; and incorrectly positioned components.
- Providing a method of assessing the effectiveness of a pick operation without slowing machine throughput, and without adding significant hardware to the pick and place machine, would allow pick and place machine operation to more accurately identify pick errors, and ensure that such errors do not generate defective workpieces. Additionally, identifying pick errors before they create defective work pieces (such as entire circuit boards) would vastly simplify rework since the pick and place machine can simply discard the erroneously picked component and pick another one. In contrast, if the erroneously picked component is actually placed upon the workpiece, the error may not be discovered until after final soldering or adhesive curing is complete. Given that a particular workpiece, such as a circuit board, may contain hundreds or even thousands of individual components, the workpiece itself could be relatively costly, and require relatively costly manual rework in order to ensure that the entire workpiece is not lost.
- A pick and place machine includes a sensor disposed to acquire an image of a nozzle before a pick operation, and one or more images after the pick operation. Image analytics based upon these images reveal important characteristics that can be used to classify the pick operation. In some embodiments, a plurality of after-pick images are acquired at different poses (angular orientations).
-
FIG. 1 is a diagrammatic view of an exemplary Cartesian pick and place machine with which embodiments of the present invention are applicable. -
FIG. 2 is a diagrammatic view of an exemplary rotary turret pick and place machine with which embodiments of the present invention are applicable. -
FIG. 3 is a diagrammatic view of an image acquisition system disposed to acquire one or more images relative to a pick operation in accordance with an embodiment of the present invention. -
FIG. 4 is a diagrammatic view of a sensor for sensing component hose upon a pick and place machine nozzle in accordance with an embodiment of the present invention. -
FIG. 5 is a diagrammatic view of a compact component sensor in accordance with another embodiment of the present invention. -
FIG. 6 is a diagrammatic view of sensor in accordance with another embodiment of the present invention. -
FIG. 7 is a diagrammatic view of a representative before-pick image in accordance with an embodiment of the present invention. -
FIG. 8 is a diagrammatic view of an image acquired after a component has been picked up by nozzle in accordance with an embodiment of the present invention. -
FIG. 9 is a diagrammatic view of a before-pick nozzle image being used to generate a template in accordance with an embodiment of the present invention. -
FIG. 10 is a diagrammatic view of a template being used with after-pick image in accordance with an embodiment of the present invention. -
FIG. 11 is a diagrammatic view of a difference image derived by subtracting the before-image from the co-registered after-image. -
FIG. 12 is a diagrammatic view illustrating an extracted vertical center as well as left and right most component points in accordance with an embodiment of the present invention. -
FIG. 13 is a chart of offsets of leads from vertical center for various components. -
FIG. 14 is a diagrammatic view of a non-focused before-pick image acquired in accordance with an embodiment of the present invention. -
FIG. 15 is a diagrammatic view of a blurred after-pick image acquired in accordance with an embodiment of the present invention. -
FIG. 16 is a diagrammatic view of a blurred before-pick nozzle image being used to generate a template in accordance with an embodiment of the present invention. -
FIG. 17 is a diagrammatic view illustrating a template being used to identify a nozzle in an after-pick image in accordance with an embodiment of the present invention. -
FIG. 18 is a diagrammatic view of a blurred difference image derived by subtracting a blurred before-pick image from a co-registered blurred after-pick image. -
FIG. 19 is a diagrammatic view of an image containing a blob related to the image of the picked component, in accordance with an embodiment of the present invention. -
FIG. 20 is a diagrammatic view of an image constructing a rectangle about a blob in order measure a characteristic of the blob. -
FIG. 21 is a graph illustrating the way in which the orientation of the major axis in degrees varies for different poses (angular orientations) of a component on a nozzle. -
FIG. 22 is a graph illustrating the way in which the blob height varies for different poses (angular orientations) of a component on a nozzle. -
FIG. 23 is a graph illustrating the way in which the aspect ratio varies for different poses (angular orientations) of a component on a nozzle. -
FIG. 24 is a diagrammatic view of a series of images, each depicting a non-focused shadow image of a component disposed upon a nozzle at a different angular orientation, in accordance with an embodiment of the present invention. -
FIG. 25 is a diagrammatic view of a series of images showing a component retained upon a nozzle in a plurality of different poses. -
FIGS. 26A, 26B and 26C are diagrammatic views illustrating various metrics such as height (H), width (W), and angle of major axis orientation (theta-θ). -
FIGS. 27-29 are graphs illustrating how various component metrics such as apparent component tip (FIG. 27 ), apparent relative component height (FIG. 28 ), and apparent component aspect ratio (FIG. 29 ) vary with different component poses. -
FIG. 30 is a flow diagram of a method of characterizing a pick operation of a pick and place machine in accordance with an embodiment of the present invention. -
FIG. 1 is a diagrammatic view of an exemplary Cartesian pick andplace machine 201 with which embodiments of the present invention are applicable. Pick andplace machine 201 receives a workpiece, such ascircuit board 203, via transport system orconveyor 202. Aplacement head 206 then obtains one or more electrical components to be mounted uponworkpiece 203 from component feeders (not shown) and moves in x, y and z directions, relative toworkpiece 203, to place the component in the proper orientation at the proper location uponworkpiece 203.Placement head 206 may includesensor 205 that is disposed to view one or more components held by respective one or more nozzle, from a substantially side view asplacement head 206 moves the component(s) from pickup locations to placement locations.Sensor 205 allowsplacement machine 201 to view components held bynozzles workpiece 203. Other pick and place machines may employ a placement head that moves over a stationary camera to image the component.Placement head 206 may also include a downwardly lookingcamera 209, which is generally used to locate fiducial marks uponworkpiece 203 such that the relative location ofplacement head 206 with respect toworkpiece 203 can be readily calculated. -
FIG. 2 is a diagrammatic view of an exemplary rotary turret pick andplace machine 10 with which embodiments of the present invention are applicable.Machine 10 includes some components that are similar tomachine 201 and like components are numbered similarly. For turret pick andplace machine 10,workpiece 203 is loaded via a conveyor onto an x-y stage (not shown). Attached tomain turret 20 are placement heads 210 that are disposed at regular angular intervals around the rotating turret. During each pick and placement cycle,turret 20 indexes an angular distance equal to the angular distance betweenadjacent placement nozzles 210. Afterturret 20 rotates into position andworkpiece 203 is positioned by the x-y stage, aplacement nozzle 210 obtains a component 304 (shown inFIG. 3 ) from acomponent feeder 14 at a definedpick point 16. During this same interval, anothernozzle 210 places acomponent 304 onto theworkpiece 203 at apreprogrammed placement location 106. Additionally, whileturret 20 pauses for the pick and place operation, upward lookingcamera 30 acquires and image of anothercomponent 304, which may provide alignment information for that component. This alignment information is used by pick andplace machine 10 to positionworkpiece 203 whenplacement nozzle 210 is positioned several steps later to place component 104. After the pick and place cycle is complete,turret 20 indexes to the next angular position andworkpiece 203 is repositioned in x-y direction(s) to move the placement location to position which corresponds to theplacement location 106. -
FIG. 3 is a diagrammatic view ofimage acquisition system 300 disposed to acquire one or more images relative to a pick operation in accordance with an embodiment of the present invention.Image acquisition system 300 preferably includes anelectronic camera 308 that may include a suitable charge couple device, or complimentary metal oxide semiconductor device.System 300 is disposed to viewcomponent 304 whencomponent 304 is held bynozzle 210.Image acquisition system 300 may have an optical axis that is arranged to viewcomponent 304 from a non-zero angle with respect to horizontal. However, embodiments of the present invention can be practiced whereinimage acquisition system 300 does, in fact,view component 304 using an optical axis having a zero angle with respect to the horizontal.System 300 also preferably includes anilluminator 310 that generatesillumination 312, whichillumination 312 is redirected byillumination optics 314. Redirectedillumination 316 passes through the areaproximate component 304 whencomponent 304 is retained onnozzle 210.Imaging optics 318 is disposed to redirect and focus the illumination uponimage acquisition system 300. The utilization ofillumination optics 314 andimaging optics 318 allowsimage acquisition system 300 to obtain a backlit substantially side elevation view ofcomponent 304, even thoughcomponent 304 is maintained at an angle that is different than the optical imaging axis ofimage acquisition system 300.Image acquisition system 300 obtains an image ofnozzle 210 prior tonozzle 210picking component 304 fromcomponent feeder 14. Then, aftercomponent 304 has been picked bynozzle 210,image acquisition system 300 obtains one or more post-pick images. A comparison of the before and after-pick images provides important information relative to the effectiveness of the pick operation. -
FIG. 4 is a diagrammatic view of a sensor for sensing components on a pick and place machine nozzle in accordance with an embodiment of the present invention.Sensor 401 includesillumination source 400 disposed to generate divergingillumination 402 whichillumination 402 enterscollimating optics 404 and is transformed into collimatedillumination 406. As collimatedillumination 406 impinges uponcomponent 304, some of the illumination is blocked generatingcomponent shadow 408.Component shadow 408 is detected byarea detector 410.Area detector 410 is coupled to a suitable signal processor 411 or image processor to process the image or images acquired of theshadow component 304. Processor 411 can be a suitable microprocessor disposed withinsensor 401, or processor 411 could be a remote processor, such as a microprocessor disposed within the pick and place machine. By processing the image(s), various measures ofcomponent 304 can be determined, including apparent height, width and angle. One or more of these measures facilitate the determination of the quality of the pick operation. Ifcomponent 304 meets “good pick” criteria,component 304 will be placed on the printed circuit board. -
FIG. 5 is a diagrammatic view of a compact component sensor in accordance with another embodiment of the present invention. While processor 411 is not shown inFIG. 5 , such illustration is provided in order to contrast the differences in the embodiments illustrated inFIG. 4 and 5, andsensor 412 would indeed employ an image processor, such as processor 411.Sensor 412 includessource 400 anddetector 410, but does not include any imaging or illumination optics. Shadow 408 ofcomponent 304 continues to diverge, and is considered, an unfocused shadow. Notwithstanding the fact thatshadow 408 is unfocused, image processing is still able to render a number of important measurements with respect to the pick effectiveness. -
FIG. 6 is a diagrammatic view ofsensor 420 in accordance with another embodiment of the present invention. While processor 411 is not shown inFIG. 6 , such illustration is provided in order to contrast the differences in the embodiments illustrated inFIG. 4, 5 and 6, andsensor 420 would indeed employ an image processor, such as processor 411.Sensor 420 includesilluminator 422 that is an area source of back light forcomponent 304 onnozzle 210.Sensor 420 also includesoptical element 424 disposed betweencomponent 304 anddetector 410.Element 424 provides a focused shadow image ofcomponent 304 upondetector 410. - The sensor embodiments illustrated in
FIGS. 4-6 generally provide a very compact sensor design. This compact design, in turn, allows the sensor to be easily incorporated onto a moving placement head, such as a placement head of a Cartesian pick and place machine. Using area array detectors to obtain shadows of components held by nozzles of a pick and place machine can provide a number of important metrics with respect to the effectiveness of the pick operation. Various types of image processing can be used on one or more such shadow images. -
FIG. 7 is a diagrammatic view of a representative before-pick image 430 of nozzle. 210. As can be seen,nozzle 210 presents a shadow image indicated by cross hatching 432. Thedistal end 434 ofnozzle 210 is shown havingaperture 436 through which a vacuum is typically applied. Oncecomponent 304 is picked up bynozzle 210, thecomponent 304 is retained upondistal end 434 ofnozzle 210. -
FIG. 8 is a diagrammatic view of animage 438 acquired after acomponent 304 has been picked up bynozzle 210.Component 304 is illustrated as a standard SOT23 component, but may be any component. Additionally, the image ofcomponent 304 is a shadow image. The vacuum applied throughaperture 436 adherescomponent 304 todistal end 434 ofnozzle 210. -
FIG. 9 is a diagrammatic view ofnozzle 210 inimage 430 being used to generatetemplate 440. The use oftemplate 440 is important for subsequent correlation to after-pick images. The manner in which the nozzle pattern is extracted from before-pick image 430 can be done in any suitable way using known techniques, or later developed techniques. -
FIG. 10 illustratestemplate 440 being used with after-pick image 438.Template 440 is used in a correlation search to identifynozzle 210 in the after-pick image. One way in which this correlation can be done is using a known normalized gray-scale correlation (NGC) based correlation search. Oncenozzle 210 has been identified in the after-pick image, difference image 442 (shown inFIG. 11 ) is derived by subtracting the before-image, pixel by pixel, from the co-registered after-image. The difference image will generally contain the pickedcomponent 304 as well as some artifacts (caused by the shadow casting scheme). These artifacts are preferably suppressed by using an automatic thresholding technique, such as that disclosed in the paper entitled, “A Threshold Selection Method for Gray Level Histogram.” N. Otsu 1979, IEEE Transactions on Systems, Man and Cybernetics, SMC-9(1). Additionally, a morphological closing operation can be applied to the thresholded image to improve connectivity within blobs. The blobs are preferably labeled using a simple region growing technique and all but the largest blob (presumably the component) are suppressed. The non-suppressed blob corresponds to the picked component. A minimum enclosing rectangle is computed for this largest blob and the left and right most coordinates of the blob are noted. The extracted component's vertical center is also calculated.Rectangle 443 illustrating the extracted vertical center as well as left and right most points are illustrated inFIG. 12 . If the vertical coordinate (Y) of either the left most or the right most part pixel falls in the component's vertical half closer to the nozzle, then it is concluded that the component has been picked upside down. A digital signal processor, such as processor 411, is programmed with these simple operations. Specifically, let Ly be the vertical (Y) coordinate of the left most pixel of the extracted component; let Ry be the vertical (Y) coordinate of the right most pixel of the extracted component; and let Cy by the vertical (Y) center of the extracted component. Then, let left offset equal Ly-Cy. Additionally, let right offset equal Ry-Cy. Assuming that (0,0) is the left top corner, and the component is below the nozzle in the captured view, then if left offset is greater than 0 or right offset is greater than 0, conclude thatcomponent 304 has been picked upside down. Otherwise conclude thatcomponent 304 has been correctly picked. Note, these processing steps can be applied to both focused shadows as well as non-focused shadows. -
FIG. 13 is a chart of offsets of leads from vertical center for various components.FIG. 13 illustrates flipped pick identification using lead vertical offsets from the component's vertical center. As illustrated inFIG. 13 , the correctly placed parts are generally in the positive X and Y axes, while incorrectly placed parts are in the negative −X and −Y axes. - The above example of image analysis for component shadows on a nozzle of a pick and place machine provide a number of advantages. Specifically, co-registration of before and after-pick images based on the nozzle pattern provides accurate, robust and reliable registration methods. Additionally, NGC-based searching is very suitable for digital signal processing. Further, image processing operations are simple enough to be programmed into commercially available digital signal processors. Further still, significant information can be extracted from even a single view in order to successfully identify an incorrect pick (such as an upside down pick). Moreover, the image processing operations are simple enough so that the required measurements can be computed quickly to meet the need of real-time operation.
-
FIG. 14 is a diagrammatic view of non-focused before-pick image 450.Image 450 showsblurred nozzle 452.FIG. 15 shows after-pick image 454 depictingcomponent 456 disposed uponnozzle 452.FIG. 16 illustrates atemplate 458, similar totemplate 440 illustrated inFIG. 9 , whichtemplate 458 is used to isolatenozzle 452 in after-pick images. -
FIG. 17 illustratestemplate 458 being used to identifynozzle 456 in the after-pick image 454. Various methods exist to co-register two images, such as correlating the entire image, correlating specific sections on both sides of the nozzle, et cetera. However, it is preferred that image analysis utilize the before-pick image and extract the nozzle pattern therefrom in order to use the extracted nozzle pattern as a template in an NGC-based correlation search. Difference image 460 (illustrated inFIG. 18 ) is derived by subtracting before-pick image 450 from the co-registered after-pick image 454.Difference image 460 will contain some artifacts (caused by the shadow casting scheme). The artifacts are preferably suppressed by an automatic thresholding technique such as that described above with respect to the Otsu paper. Further still, it is preferred that a morphological closing operation be applied to the threshold image to improve connectivity within blobs. - As described above, the blobs are preferably labeled using a simple region growing technique and all but the largest blob are suppressed. The remaining blob corresponds to the picked component. A minimum enclosing rectangle is computed for this largest blob and features such as component height (vertical extent) and component width (horizontal extent), and aspect ratio (height/width) are computed. Additionally, moments of inertia about the x, y and XY-axis are computed and the orientation of the major axis is derived from these three moments. Additionally, from the X-centers of the part and the nozzle, part offset from the nozzle center is also computed. These simple operations are easily programmed into a digital signal processor, such as commercially available digital signal processors.
-
FIG. 19 is a diagrammatic view ofimage 462 containingblob 464 related to the image of the picked component. Further,FIG. 20 showsimage 466 havingrectangle 468 constructed aboutblob 464 in order to determine moments of inertia, et cetera. The measurements that can be performed based upon the component image include apparent component height, aspect ratio (height/width) and orientation of the major axes. These measurements, alone and in certain combinations, are capable of characterizing a given pick as good or bad. To successfully use the apparent height and aspect ratio to classify a pick, some a-priori knowledge of the component may be necessary. However, the orientation of the major axes measurement alone may be sufficient to classify a pick provided in established threshold of allowable orientations is known. However, measurements from more than one view, or angular orientation of the component upon the nozzle may be necessary to unambiguously classify a pick. If a-priori knowledge of the component is not available, then it is still possible to classify a pick as good or bad from measurements made from a number of views, such as three views. These three views are spaced at appropriate intervals, for example 45° apart. Comparing the apparent component heights and widths based upon each view for the three views, a component pick can be classified as good or bad. The rules to classify a pick based on apparent component height are: - Rule 1: If the component height is greater than the component width from the measurement made from the first view then it is considered a bad pick.
- Rule 2: If
rule 1 fails, then compare the component height of the first view against the minimum component widths of the second and third views. If the component height of the first view is greater than the above minimum, then it is bad pick. - Rule 3: If both
rules - Note, these processing steps can be applied to both the non-focused shadows as well as focused shadows with back lighting. Thus, this analysis can be employed not only for the images illustrated with respect to
FIGS. 16-20 , but also those illustrated inFIGS. 9-15 . -
FIG. 21 is a chart illustrating the way in which the orientation of the major axis varies for different poses (angular orientations) of a component on a nozzle. As illustrated inFIG. 21 , as a component on the nozzle is rotated through 16 different shadow poses, a component that has been properly picked will have very little variability. In distinct contrast, various pick errors, such as billboarding, corner picks, and tombstoning, generate drastically varying orientations of major axis values as the various shadow poses are acquired.FIGS. 22 and 23 also indicate that a good pick can also be determined from a number of poses using different metrics, such as blob height (FIG. 22 ) and aspect ratio (FIG. 23 ). -
FIG. 24 shows a series ofimages component 304 disposed upon anozzle 210 at a different angular orientation (pose). It is known for pick and place machines to have a rotatable nozzle such that the angular orientation of the component can be adjusted to correctly place the component in is its proper orientation upon the workpiece. In accordance with an embodiment of the present invention, a plurality of after-pick shadow images are acquired with each image being acquired while the part is in a different pose. The image analytics described above can be performed on one or all of the after-pick shadow images and the extracted metrics can be compared for each of the poses. A component that has been properly picked, will have significantly less variance in the various extracted metrics than an erroneously picked component. -
FIG. 25 is a diagrammatic view of a series ofimages showing component 304 retained uponnozzle 210 in a plurality of different poses.FIG. 25 differs fromFIG. 24 in that the images ofFIG. 25 are focused shadow images.FIG. 25 illustrates a condition known as a corner pick where a corner ofcomponent 304 is lodged in the vacuum aperture.FIG. 25 also illustrates that in various poses, or angular ordinations, the corner pickedcomponent 304 presents drastically different profiles. Thus, as set forth above, the employment of various image analytics upon two or more successively acquired after-pick shadow images, whether focused or not, can easily provide important information with respect to the efficacy of the pick operation.FIGS. 26A, 26B and 26C illustrate various metrics such as height (H), width (W), and angle of major axis orientation (theta-θ).FIGS. 27-29 illustrate various component metrics: apparent component tip; apparent relative component height; and apparent component aspect ratio; respectively, and a variety of different component poses. As evident inFIGS. 27-29 , a component that has been correctly picked will exhibit the lowest variability in these variance metrics as the pose varies. Accordingly, the variance of one or more metrics can be compared to a pre-selected threshold to simply determine whether the component has been picked effectively. -
FIG. 30 is a flow diagram of a method of characterizing a pick operation of a pick and place machine in accordance with an embodiment of the present invention.Method 500 begins atblock 502 where a sensor, such assensor 205, is used to obtain a before-pick image of a nozzle of the pick and place machine. As indicated atblock 504, the nozzle pattern in the before-pick image is used to generate a template. Atblock 506, one or more after-pick images are acquired. As indicated inFIG. 30 , blocks 504 and 506 can be executed in any order, including simultaneously. Once the template is generated, it is used to identify the nozzle in the after-pick image(s), as indicated atblock 508. Atblock 510, the before-pick image and the after-pick image(s) are correlated, preferably using an NGC-based correlation. A difference image is generated atblock 511 by subtracting the before-pick image from the correlated after-pick image(s). Atoptional block 512 the difference image(s) are preferably thresholded using known thresholding techniques. Atoptional block 514, a morphological closing operation is preferably applied to the thresholded difference image. Atblock 514, it is also preferred that the blobs are preferably labeled using a simple region growing technique and all but the largest blob are suppressed. Atblock 516, one or more metrics are calculated based on the difference image. Atblock 518, the metrics are used to characterize the pick operation as either good or bad.Method 500 can be used for both focused shadows and non-focused shadows. - Embodiments of the present invention allow relatively simple image acquisition systems to be used with commercially available digital signal processors to provide accurate pick characterizations in real-time during operation of the pick and place machine. This results in reduced occurrence of placement of erroneously picked components, and reduction of rework required to remedy such problems.
- Although the present invention has been described with reference to preferred embodiments, workers skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the invention.
Claims (31)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/521,066 US7545514B2 (en) | 2005-09-14 | 2006-09-14 | Pick and place machine with improved component pick image processing |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US71712705P | 2005-09-14 | 2005-09-14 | |
US11/521,066 US7545514B2 (en) | 2005-09-14 | 2006-09-14 | Pick and place machine with improved component pick image processing |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070091323A1 true US20070091323A1 (en) | 2007-04-26 |
US7545514B2 US7545514B2 (en) | 2009-06-09 |
Family
ID=37649746
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/521,066 Expired - Fee Related US7545514B2 (en) | 2005-09-14 | 2006-09-14 | Pick and place machine with improved component pick image processing |
Country Status (4)
Country | Link |
---|---|
US (1) | US7545514B2 (en) |
JP (1) | JP4896136B2 (en) |
DE (1) | DE112006002473T5 (en) |
WO (1) | WO2007033349A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090242457A1 (en) * | 2008-03-31 | 2009-10-01 | Accu-Assembly Incorporated | Electronic component orientation for assembly to circuit boards |
US10448551B2 (en) | 2015-05-25 | 2019-10-15 | Fuji Corporation | Component mounter |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7746481B2 (en) | 2007-03-20 | 2010-06-29 | Cyberoptics Corporation | Method for measuring center of rotation of a nozzle of a pick and place machine using a collimated laser beam |
US8068664B2 (en) * | 2007-06-05 | 2011-11-29 | Cyberoptics Corporation | Component sensor for pick and place machine using improved shadow imaging |
DE112008001925T5 (en) * | 2007-08-28 | 2010-07-15 | Panasonic Corp., Kadoma | Component placement device |
KR20120046494A (en) * | 2010-11-02 | 2012-05-10 | 삼성테크윈 주식회사 | Apparatus and method for inspecting pick-up of chip |
KR101695245B1 (en) * | 2011-05-31 | 2017-01-11 | 한화테크윈 주식회사 | Apparatus for mounting a electronic device and method for photographing the electronic device |
JP5721222B2 (en) * | 2011-05-31 | 2015-05-20 | 三星テクウィン株式会社Samsung Techwin Co., Ltd | Electronic component mounting equipment |
US9791466B2 (en) | 2011-07-21 | 2017-10-17 | Brooks Automation, Inc. | Method and device for compensation for dimensional variations in low temperature sample group holders |
TWI493201B (en) | 2012-11-09 | 2015-07-21 | Ind Tech Res Inst | Method and system for pins detection and insertion of electrical component |
US10517199B2 (en) | 2015-12-17 | 2019-12-24 | Assembléon B.V. | Methods of positioning a component in a desired position on a board, pick and place machines, and sensors for such pick and place machines |
US10438339B1 (en) | 2016-09-12 | 2019-10-08 | Apple Inc. | Optical verification system and methods of verifying micro device transfer |
US10620608B2 (en) | 2017-03-07 | 2020-04-14 | Raytheon Company | Collet contrast disk |
US11412650B2 (en) * | 2017-09-28 | 2022-08-09 | Universal Instruments Corporation | Lead tip illumination device, system, and method |
KR102368227B1 (en) * | 2019-08-23 | 2022-02-28 | 한화정밀기계 주식회사 | Method and computer program for determining defective part and Chip Mounter |
Citations (97)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3814845A (en) * | 1973-03-01 | 1974-06-04 | Bell Telephone Labor Inc | Object positioning |
US4281342A (en) * | 1978-03-29 | 1981-07-28 | Hitachi, Ltd. | Mark detecting system using image pickup device |
US4776088A (en) * | 1987-11-12 | 1988-10-11 | The United States Of America As Represented By The United States Department Of Energy | Placement accuracy gauge for electrical components and method of using same |
US4809430A (en) * | 1986-06-12 | 1989-03-07 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for mounting electronic parts |
US4825091A (en) * | 1987-02-05 | 1989-04-25 | Carl-Zeiss-Stiftung | Optoelectronic distance sensor with visible pilot beam |
US4914513A (en) * | 1988-08-02 | 1990-04-03 | Srtechnologies, Inc. | Multi-vision component alignment system |
US4989082A (en) * | 1988-07-29 | 1991-01-29 | Westinghouse Electric Corp. | Image processing system for comparing a test article with a master article to determine that an object is correctly located on the test article |
US4999785A (en) * | 1989-01-12 | 1991-03-12 | Robotic Vision Systems, Inc. | Method and apparatus for evaluating defects of an object |
US5003692A (en) * | 1989-05-17 | 1991-04-02 | Matsushita Electric Industrial Co., Ltd. | Electric component mounting method |
US5023916A (en) * | 1989-08-28 | 1991-06-11 | Hewlett-Packard Company | Method for inspecting the leads of electrical components on surface mount printed circuit boards |
US5060366A (en) * | 1989-09-05 | 1991-10-29 | Fuji Machine Mfg. Co., Ltd. | Electronic component mounting apparatus |
US5105149A (en) * | 1989-07-17 | 1992-04-14 | Matsushita Electric Industrial Co., Ltd. | Apparatus for inspecting electronic devices mounted on a circuit board |
US5129725A (en) * | 1986-11-04 | 1992-07-14 | Canon Kabushiki Kaisha | Method of optically detecting position of object and position detecting apparatus using the method |
US5134665A (en) * | 1990-03-08 | 1992-07-28 | Mitsubishi Denki Kabushiki Kaisha | Apparatus and method of inspecting solder printing |
US5194791A (en) * | 1990-07-19 | 1993-03-16 | Mcdonnell Douglas Corporation | Compliant stereo vision target |
US5235316A (en) * | 1991-12-20 | 1993-08-10 | Qualizza Gregory K | Vehicle collision avoidance system |
US5237622A (en) * | 1991-12-04 | 1993-08-17 | Micron Technology, Inc. | Semiconductor pick-and-place machine automatic calibration apparatus |
US5249349A (en) * | 1991-01-24 | 1993-10-05 | Matsushita Electric Works, Ltd. | Parts mounting device |
US5278634A (en) * | 1991-02-22 | 1994-01-11 | Cyberoptics Corporation | High precision component alignment sensor system |
US5298977A (en) * | 1991-10-16 | 1994-03-29 | Matsushita Electric Industrial Co., Ltd. | Visual inspection method for part mounted on printed circuit board |
US5336935A (en) * | 1989-11-17 | 1994-08-09 | Matsushita Electric Industrial Co., Ltd. | Electronic parts mounting apparatus |
US5377405A (en) * | 1992-07-01 | 1995-01-03 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components and an apparatus therefor |
US5383270A (en) * | 1992-06-05 | 1995-01-24 | Yamahahatsudoki Kabushiki Kaisha | Method for mounting component chips and apparatus therefor |
US5384956A (en) * | 1992-07-01 | 1995-01-31 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components |
US5392360A (en) * | 1993-04-28 | 1995-02-21 | International Business Machines Corporation | Method and apparatus for inspection of matched substrate heatsink and hat assemblies |
US5450204A (en) * | 1992-03-30 | 1995-09-12 | Sharp Kabushiki Kaisha | Inspecting device for inspecting printed state of cream solder |
US5461480A (en) * | 1993-06-14 | 1995-10-24 | Yamaha Hatsudoki Kabushiki Kaisha | Parts recognizing device for mounting machine |
US5495424A (en) * | 1990-04-18 | 1996-02-27 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for inspecting solder portions |
US5541834A (en) * | 1993-10-15 | 1996-07-30 | Sanyo Electric Co., Ltd. | Control system for component mounting apparatus |
US5550583A (en) * | 1994-10-03 | 1996-08-27 | Lucent Technologies Inc. | Inspection apparatus and method |
US5598345A (en) * | 1990-11-29 | 1997-01-28 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for inspecting solder portions |
US5619328A (en) * | 1993-12-27 | 1997-04-08 | Yamaha Hatsudoki Kabushiki Kaisha | Component mounter and recognition method |
US5627913A (en) * | 1990-08-27 | 1997-05-06 | Sierra Research And Technology, Inc. | Placement system using a split imaging system coaxially coupled to a component pickup means |
US5660519A (en) * | 1992-07-01 | 1997-08-26 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components and an apparatus therefor |
US5719952A (en) * | 1994-01-19 | 1998-02-17 | International Business Machines Corporation | Inspection system for cross-sectional imaging |
US5724722A (en) * | 1995-02-02 | 1998-03-10 | Yamaha Matsudoki Kabushiki Kaisha | Part state detecting device for mounter |
US5739846A (en) * | 1996-02-05 | 1998-04-14 | Universal Instruments Corporation | Method of inspecting component placement accuracy for each first selected circuit board to be assembled of a batch |
US5745241A (en) * | 1994-11-11 | 1998-04-28 | Yamaha Hatsudoki Kabushiki Kaisha | Method of recognizing cylindrical part |
US5749142A (en) * | 1994-10-19 | 1998-05-12 | Yamaha Hatsudoki Kabushiki Kaisha | Method and device for adjusting nozzle height for recognition in surface mounter |
US5754677A (en) * | 1994-10-25 | 1998-05-19 | Fuji Machine Mfg. Co., Ltd. | Image processing apparatus |
US5878151A (en) * | 1996-10-31 | 1999-03-02 | Combustion Engineering, Inc. | Moving object tracking |
US5900940A (en) * | 1995-11-28 | 1999-05-04 | Yamaha Hatsudoki Kabushiki Kaisha | Position detector for chip mounter |
US5903353A (en) * | 1996-12-24 | 1999-05-11 | Teradyne, Inc. | Method and apparatus for inspecting component placement and solder connection in printed circuit board manufacture |
US5908282A (en) * | 1992-08-07 | 1999-06-01 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components and apparatus therefor |
US5912984A (en) * | 1996-12-19 | 1999-06-15 | Cognex Corporation | Method and apparatus for in-line solder paste inspection |
US5949681A (en) * | 1996-03-15 | 1999-09-07 | Fuji Machine Mfg. Co., Ltd. | Electronic-component supplying apparatus |
US5956149A (en) * | 1996-04-26 | 1999-09-21 | Yamaha Hatsudoki Kabushiki Kaisha | Method for determining reference position |
US6027019A (en) * | 1997-09-10 | 2000-02-22 | Kou; Yuen-Foo Michael | Component feeder configuration monitoring |
US6047084A (en) * | 1997-11-18 | 2000-04-04 | Motorola, Inc. | Method for determining accuracy of a circuit assembly process and machine employing the same |
US6195165B1 (en) * | 1998-08-04 | 2001-02-27 | Cyberoptics Corporation | Enhanced sensor |
US6198529B1 (en) * | 1999-04-30 | 2001-03-06 | International Business Machines Corporation | Automated inspection system for metallic surfaces |
US6223425B1 (en) * | 1997-12-18 | 2001-05-01 | Fuji Machine Mfg. Co., Ltd. | Circuit-component supplying system |
US6286202B1 (en) * | 1997-02-04 | 2001-09-11 | Fuji Machine Mfg. Co., Ltd. | System for mounting a plurality of circuit components on a circuit substrate |
US6334840B1 (en) * | 1998-02-02 | 2002-01-01 | Fuji Machine Mfg. Co., Ltd. | Electric-component transferring apparatus, and method and apparatus for exchanging component holders therein |
US20020014003A1 (en) * | 1998-05-19 | 2002-02-07 | Fuji Machine Mfg. Co., Ltd. | Method and system for mounting electric components |
US20020031279A1 (en) * | 2000-09-13 | 2002-03-14 | Fuji Machine Mfg. Co., Ltd. | Suction nozzle, method of detecting hold position of electric component, methods of detecting bending and angular position of suction pipe, and electric-component handling device |
US20020053133A1 (en) * | 2000-06-01 | 2002-05-09 | Fuji Machine Mfg. Co., Ltd. | Electric-component mounting apparatus |
US20020069395A1 (en) * | 2000-12-04 | 2002-06-06 | Hiroaki Fujiwara | Method and apparatus of checking mount quality of circuit board |
US6408090B1 (en) * | 1998-09-28 | 2002-06-18 | Siemens Production And Logistics System Aktiengesellschaft | Method for position recognition of components equipped on a substrate in an automatic equipping unit |
US20020078580A1 (en) * | 2000-12-08 | 2002-06-27 | Haugen Paul R. | Automated system with improved height sensing |
US20020099466A1 (en) * | 1999-07-13 | 2002-07-25 | William Diggin | Circuit Production method |
US20020112064A1 (en) * | 2001-02-15 | 2002-08-15 | Roger Eastvold | Customer support network |
US20020124391A1 (en) * | 2001-03-06 | 2002-09-12 | Fuji Machine Mfg. Co., Ltd. | Apparatus for assisting operator in performing manual operations in connection with component feeders |
US20020133940A1 (en) * | 2001-03-26 | 2002-09-26 | Fuji Machine Mfg. Co., Ltd | Electric-component supplying method and device, and electric-component mounting method and system |
US6506614B1 (en) * | 2002-01-29 | 2003-01-14 | Tyco Electronics Corporation | Method of locating and placing eye point features of a semiconductor die on a substrate |
US20030027363A1 (en) * | 2001-07-23 | 2003-02-06 | Fuji Machine Mfg. Co., Ltd. | Circuit-substrate working system and electronic-circuit fabricating process |
US20030029033A1 (en) * | 2001-08-08 | 2003-02-13 | Matsushita Electric Industrial Co., Ltd. | Apparatus and method for mounting electronic parts |
US6538244B1 (en) * | 1999-11-03 | 2003-03-25 | Cyberoptics Corporation | Pick and place machine with improved vision system including a linescan sensor |
US6549647B1 (en) * | 2000-01-07 | 2003-04-15 | Cyberoptics Corporation | Inspection system with vibration resistant video capture |
US20030098426A1 (en) * | 2001-11-27 | 2003-05-29 | Kabushiki Kaisha Shinkawa | Wire bonding method and apparatus |
US20030110610A1 (en) * | 2001-11-13 | 2003-06-19 | Duquette David W. | Pick and place machine with component placement inspection |
US20030111494A1 (en) * | 2001-10-26 | 2003-06-19 | Sequenom, Inc. | Method and apparatus for high-throughput sample handling process line |
US6583884B2 (en) * | 1998-11-03 | 2003-06-24 | Cyberoptics Corporation | Tomographic reconstruction of electronic components from shadow image sensor data |
US20030159515A1 (en) * | 2002-02-27 | 2003-08-28 | Yukihiro Tonomura | Machines having drive member and method for diagnosing the same |
US6616263B2 (en) * | 2001-10-31 | 2003-09-09 | Hewlett-Packard Development Company, L.P. | Image forming apparatus having position monitor |
US6622054B1 (en) * | 1998-10-06 | 2003-09-16 | Hitachi, Ltd. | Method monitoring a quality of electronic circuits and its manufacturing condition and system for it |
US6681151B1 (en) * | 2000-12-15 | 2004-01-20 | Cognex Technology And Investment Corporation | System and method for servoing robots based upon workpieces with fiducial marks using machine vision |
US6738505B1 (en) * | 1999-05-04 | 2004-05-18 | Speedline Technologies, Inc. | Method and apparatus for detecting solder paste deposits on substrates |
US20040094594A1 (en) * | 2001-03-30 | 2004-05-20 | Thomas Liebeke | Device and method for feeding taped electrical components |
US6744499B2 (en) * | 2000-06-07 | 2004-06-01 | Cyberoptics Corporation | Calibration methods for placement machines incorporating on-head linescan sensing |
US6748649B2 (en) * | 1996-12-25 | 2004-06-15 | Matsushita Electric Industrial Co., Ltd. | Method of operating a component holding head |
US20040119987A1 (en) * | 2001-01-22 | 2004-06-24 | Madsen David D. | Multiple source alignment sensor with improved optics |
US6762847B2 (en) * | 2001-01-22 | 2004-07-13 | Cyberoptics Corporation | Laser align sensor with sequencing light sources |
US6778878B1 (en) * | 2000-11-27 | 2004-08-17 | Accu-Assembly Incorporated | Monitoring electronic component holders |
US20040163243A1 (en) * | 2003-02-25 | 2004-08-26 | Kazuhiko Noda | Electronic component placement machine and electronic component placement method |
US20040186616A1 (en) * | 2000-10-23 | 2004-09-23 | Bowe Bell + Howell Postal Systems Company | Flats bundle collator |
US6891967B2 (en) * | 1999-05-04 | 2005-05-10 | Speedline Technologies, Inc. | Systems and methods for detecting defects in printed solder paste |
US20050115060A1 (en) * | 2002-04-01 | 2005-06-02 | Toshihiro Kondo | Working system for substrate |
US20050117797A1 (en) * | 2003-11-04 | 2005-06-02 | Gaida John D. | Pick and place machine with improved component placement inspection |
US20050123187A1 (en) * | 2003-11-07 | 2005-06-09 | Bushman Thomas W. | Pick and place machine with improved workpiece inspection |
US20050125993A1 (en) * | 2003-11-07 | 2005-06-16 | Madsen David D. | Pick and place machine with improved setup and operation procedure |
US20050161498A1 (en) * | 2002-03-08 | 2005-07-28 | Valor Denmark A/S | Feeder verification with a camera |
US20050210832A1 (en) * | 2002-04-23 | 2005-09-29 | I.M.A. Industria Macchine Automatiche S.P.A. | Method for carrying out a size change over in a packaging machine |
US20060016066A1 (en) * | 2004-07-21 | 2006-01-26 | Cyberoptics Corporation | Pick and place machine with improved inspection |
US20060075631A1 (en) * | 2004-10-05 | 2006-04-13 | Case Steven K | Pick and place machine with improved component pick up inspection |
US7029224B2 (en) * | 2002-03-12 | 2006-04-18 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for transferring a thin plate |
US20060174480A1 (en) * | 2005-02-08 | 2006-08-10 | Fuji Machine Mfg. Co., Ltd. | Inspection method and apparatus for mounted electronic components |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4978224A (en) | 1987-07-14 | 1990-12-18 | Sharp Kabushiki Kaisha | Method of and apparatus for inspecting mounting of chip components |
US5589942A (en) | 1990-04-05 | 1996-12-31 | Intelligent Automation Systems | Real time three dimensional sensing system |
US5235407A (en) | 1990-08-27 | 1993-08-10 | Sierra Research And Technology, Inc. | System for placement and mounting of fine pitch integrated circuit devices |
JP2554431B2 (en) | 1992-11-05 | 1996-11-13 | ヤマハ発動機株式会社 | Mounting device component suction state detection device |
JP2816787B2 (en) | 1992-11-09 | 1998-10-27 | ヤマハ発動機株式会社 | Suction nozzle control device for mounting machine |
JP3189500B2 (en) | 1993-06-25 | 2001-07-16 | 松下電器産業株式会社 | Apparatus and method for inspecting appearance of electronic components |
JPH07193397A (en) | 1993-12-27 | 1995-07-28 | Yamaha Motor Co Ltd | Suction point correction device of mounting device |
JPH07235800A (en) * | 1994-02-24 | 1995-09-05 | Citizen Watch Co Ltd | Part carrying device and part carrying method |
US5835133A (en) | 1996-01-23 | 1998-11-10 | Silicon Graphics, Inc. | Optical system for single camera stereo video |
US5969820A (en) | 1996-06-13 | 1999-10-19 | Canon Kabushiki Kaisha | Surface position detecting system and exposure apparatus using the same |
US5982927A (en) | 1996-12-19 | 1999-11-09 | Cognex Corporation | Methods and apparatuses for in-line solder paste inspection |
US6081338A (en) * | 1998-03-26 | 2000-06-27 | Siemens Aktiengesellschaft | Method and apparatus for optically checking an electrical component at an equipping head |
US6801652B1 (en) | 1998-09-29 | 2004-10-05 | Siemens Aktiengesellschaft | Method for checking the presentation of components to an automatic onserting unit |
JP4302234B2 (en) * | 1999-06-02 | 2009-07-22 | ヤマハ発動機株式会社 | Mounting parts inspection device |
US6332536B2 (en) | 1999-11-03 | 2001-12-25 | Solectron Corporation | Component tape including a printed component count |
US6385842B1 (en) * | 2000-01-14 | 2002-05-14 | Delaware Capital Formation, Inc. | Tube feeder having a zone on which components can pivot |
US20020143423A1 (en) | 2000-07-06 | 2002-10-03 | Robert Huber | Scheduling system for an electronics manufacturing plant |
US6966235B1 (en) | 2000-10-06 | 2005-11-22 | Paton Eric N | Remote monitoring of critical parameters for calibration of manufacturing equipment and facilities |
US7220095B2 (en) | 2001-05-24 | 2007-05-22 | Lyndaker David W | Self-threading component tape feeder |
JP2003008295A (en) * | 2001-06-25 | 2003-01-10 | Matsushita Electric Ind Co Ltd | Method for mounting electronic component and electronic component mounter |
US20030225547A1 (en) | 2002-05-30 | 2003-12-04 | International Business Machines Corporation | Wireless feeder verification system |
JP4255115B2 (en) * | 2003-06-04 | 2009-04-15 | 富士機械製造株式会社 | Captured image processing apparatus and captured image processing method for electronic component mounter |
WO2006125102A1 (en) * | 2005-05-19 | 2006-11-23 | Cyberoptics Corporation | Method and apparatus for evaluating a component pick action in an electronics assembly machine |
-
2006
- 2006-09-14 WO PCT/US2006/035954 patent/WO2007033349A1/en active Application Filing
- 2006-09-14 US US11/521,066 patent/US7545514B2/en not_active Expired - Fee Related
- 2006-09-14 DE DE112006002473T patent/DE112006002473T5/en not_active Withdrawn
- 2006-09-14 JP JP2008531344A patent/JP4896136B2/en not_active Expired - Fee Related
Patent Citations (99)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3814845A (en) * | 1973-03-01 | 1974-06-04 | Bell Telephone Labor Inc | Object positioning |
US4281342A (en) * | 1978-03-29 | 1981-07-28 | Hitachi, Ltd. | Mark detecting system using image pickup device |
US4809430A (en) * | 1986-06-12 | 1989-03-07 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for mounting electronic parts |
US5129725A (en) * | 1986-11-04 | 1992-07-14 | Canon Kabushiki Kaisha | Method of optically detecting position of object and position detecting apparatus using the method |
US4825091A (en) * | 1987-02-05 | 1989-04-25 | Carl-Zeiss-Stiftung | Optoelectronic distance sensor with visible pilot beam |
US4776088A (en) * | 1987-11-12 | 1988-10-11 | The United States Of America As Represented By The United States Department Of Energy | Placement accuracy gauge for electrical components and method of using same |
US4989082A (en) * | 1988-07-29 | 1991-01-29 | Westinghouse Electric Corp. | Image processing system for comparing a test article with a master article to determine that an object is correctly located on the test article |
US4914513A (en) * | 1988-08-02 | 1990-04-03 | Srtechnologies, Inc. | Multi-vision component alignment system |
US4999785A (en) * | 1989-01-12 | 1991-03-12 | Robotic Vision Systems, Inc. | Method and apparatus for evaluating defects of an object |
US5003692A (en) * | 1989-05-17 | 1991-04-02 | Matsushita Electric Industrial Co., Ltd. | Electric component mounting method |
US5105149A (en) * | 1989-07-17 | 1992-04-14 | Matsushita Electric Industrial Co., Ltd. | Apparatus for inspecting electronic devices mounted on a circuit board |
US5023916A (en) * | 1989-08-28 | 1991-06-11 | Hewlett-Packard Company | Method for inspecting the leads of electrical components on surface mount printed circuit boards |
US5060366A (en) * | 1989-09-05 | 1991-10-29 | Fuji Machine Mfg. Co., Ltd. | Electronic component mounting apparatus |
US5336935A (en) * | 1989-11-17 | 1994-08-09 | Matsushita Electric Industrial Co., Ltd. | Electronic parts mounting apparatus |
US5134665A (en) * | 1990-03-08 | 1992-07-28 | Mitsubishi Denki Kabushiki Kaisha | Apparatus and method of inspecting solder printing |
US5495424A (en) * | 1990-04-18 | 1996-02-27 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for inspecting solder portions |
US5194791A (en) * | 1990-07-19 | 1993-03-16 | Mcdonnell Douglas Corporation | Compliant stereo vision target |
US5627913A (en) * | 1990-08-27 | 1997-05-06 | Sierra Research And Technology, Inc. | Placement system using a split imaging system coaxially coupled to a component pickup means |
US5598345A (en) * | 1990-11-29 | 1997-01-28 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for inspecting solder portions |
US5249349A (en) * | 1991-01-24 | 1993-10-05 | Matsushita Electric Works, Ltd. | Parts mounting device |
US5278634A (en) * | 1991-02-22 | 1994-01-11 | Cyberoptics Corporation | High precision component alignment sensor system |
US5298977A (en) * | 1991-10-16 | 1994-03-29 | Matsushita Electric Industrial Co., Ltd. | Visual inspection method for part mounted on printed circuit board |
US5237622A (en) * | 1991-12-04 | 1993-08-17 | Micron Technology, Inc. | Semiconductor pick-and-place machine automatic calibration apparatus |
US5235316A (en) * | 1991-12-20 | 1993-08-10 | Qualizza Gregory K | Vehicle collision avoidance system |
US5450204A (en) * | 1992-03-30 | 1995-09-12 | Sharp Kabushiki Kaisha | Inspecting device for inspecting printed state of cream solder |
US5383270A (en) * | 1992-06-05 | 1995-01-24 | Yamahahatsudoki Kabushiki Kaisha | Method for mounting component chips and apparatus therefor |
US5384956A (en) * | 1992-07-01 | 1995-01-31 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components |
US5377405A (en) * | 1992-07-01 | 1995-01-03 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components and an apparatus therefor |
US5660519A (en) * | 1992-07-01 | 1997-08-26 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components and an apparatus therefor |
US5908282A (en) * | 1992-08-07 | 1999-06-01 | Yamaha Hatsudoki Kabushiki Kaisha | Method for mounting components and apparatus therefor |
US5392360A (en) * | 1993-04-28 | 1995-02-21 | International Business Machines Corporation | Method and apparatus for inspection of matched substrate heatsink and hat assemblies |
US5461480A (en) * | 1993-06-14 | 1995-10-24 | Yamaha Hatsudoki Kabushiki Kaisha | Parts recognizing device for mounting machine |
US5541834A (en) * | 1993-10-15 | 1996-07-30 | Sanyo Electric Co., Ltd. | Control system for component mounting apparatus |
US5619328A (en) * | 1993-12-27 | 1997-04-08 | Yamaha Hatsudoki Kabushiki Kaisha | Component mounter and recognition method |
US5719952A (en) * | 1994-01-19 | 1998-02-17 | International Business Machines Corporation | Inspection system for cross-sectional imaging |
US5550583A (en) * | 1994-10-03 | 1996-08-27 | Lucent Technologies Inc. | Inspection apparatus and method |
US5749142A (en) * | 1994-10-19 | 1998-05-12 | Yamaha Hatsudoki Kabushiki Kaisha | Method and device for adjusting nozzle height for recognition in surface mounter |
US5754677A (en) * | 1994-10-25 | 1998-05-19 | Fuji Machine Mfg. Co., Ltd. | Image processing apparatus |
US5745241A (en) * | 1994-11-11 | 1998-04-28 | Yamaha Hatsudoki Kabushiki Kaisha | Method of recognizing cylindrical part |
US5724722A (en) * | 1995-02-02 | 1998-03-10 | Yamaha Matsudoki Kabushiki Kaisha | Part state detecting device for mounter |
US5900940A (en) * | 1995-11-28 | 1999-05-04 | Yamaha Hatsudoki Kabushiki Kaisha | Position detector for chip mounter |
US5739846A (en) * | 1996-02-05 | 1998-04-14 | Universal Instruments Corporation | Method of inspecting component placement accuracy for each first selected circuit board to be assembled of a batch |
US5949681A (en) * | 1996-03-15 | 1999-09-07 | Fuji Machine Mfg. Co., Ltd. | Electronic-component supplying apparatus |
US5956149A (en) * | 1996-04-26 | 1999-09-21 | Yamaha Hatsudoki Kabushiki Kaisha | Method for determining reference position |
US5878151A (en) * | 1996-10-31 | 1999-03-02 | Combustion Engineering, Inc. | Moving object tracking |
US5912984A (en) * | 1996-12-19 | 1999-06-15 | Cognex Corporation | Method and apparatus for in-line solder paste inspection |
US5903353A (en) * | 1996-12-24 | 1999-05-11 | Teradyne, Inc. | Method and apparatus for inspecting component placement and solder connection in printed circuit board manufacture |
US6748649B2 (en) * | 1996-12-25 | 2004-06-15 | Matsushita Electric Industrial Co., Ltd. | Method of operating a component holding head |
US6286202B1 (en) * | 1997-02-04 | 2001-09-11 | Fuji Machine Mfg. Co., Ltd. | System for mounting a plurality of circuit components on a circuit substrate |
US6027019A (en) * | 1997-09-10 | 2000-02-22 | Kou; Yuen-Foo Michael | Component feeder configuration monitoring |
US6047084A (en) * | 1997-11-18 | 2000-04-04 | Motorola, Inc. | Method for determining accuracy of a circuit assembly process and machine employing the same |
US6223425B1 (en) * | 1997-12-18 | 2001-05-01 | Fuji Machine Mfg. Co., Ltd. | Circuit-component supplying system |
US6334840B1 (en) * | 1998-02-02 | 2002-01-01 | Fuji Machine Mfg. Co., Ltd. | Electric-component transferring apparatus, and method and apparatus for exchanging component holders therein |
US20020014003A1 (en) * | 1998-05-19 | 2002-02-07 | Fuji Machine Mfg. Co., Ltd. | Method and system for mounting electric components |
US6195165B1 (en) * | 1998-08-04 | 2001-02-27 | Cyberoptics Corporation | Enhanced sensor |
US6408090B1 (en) * | 1998-09-28 | 2002-06-18 | Siemens Production And Logistics System Aktiengesellschaft | Method for position recognition of components equipped on a substrate in an automatic equipping unit |
US6622054B1 (en) * | 1998-10-06 | 2003-09-16 | Hitachi, Ltd. | Method monitoring a quality of electronic circuits and its manufacturing condition and system for it |
US6583884B2 (en) * | 1998-11-03 | 2003-06-24 | Cyberoptics Corporation | Tomographic reconstruction of electronic components from shadow image sensor data |
US6198529B1 (en) * | 1999-04-30 | 2001-03-06 | International Business Machines Corporation | Automated inspection system for metallic surfaces |
US6738505B1 (en) * | 1999-05-04 | 2004-05-18 | Speedline Technologies, Inc. | Method and apparatus for detecting solder paste deposits on substrates |
US6891967B2 (en) * | 1999-05-04 | 2005-05-10 | Speedline Technologies, Inc. | Systems and methods for detecting defects in printed solder paste |
US20020099466A1 (en) * | 1999-07-13 | 2002-07-25 | William Diggin | Circuit Production method |
US6538244B1 (en) * | 1999-11-03 | 2003-03-25 | Cyberoptics Corporation | Pick and place machine with improved vision system including a linescan sensor |
US6549647B1 (en) * | 2000-01-07 | 2003-04-15 | Cyberoptics Corporation | Inspection system with vibration resistant video capture |
US20020053133A1 (en) * | 2000-06-01 | 2002-05-09 | Fuji Machine Mfg. Co., Ltd. | Electric-component mounting apparatus |
US6744499B2 (en) * | 2000-06-07 | 2004-06-01 | Cyberoptics Corporation | Calibration methods for placement machines incorporating on-head linescan sensing |
US20020031279A1 (en) * | 2000-09-13 | 2002-03-14 | Fuji Machine Mfg. Co., Ltd. | Suction nozzle, method of detecting hold position of electric component, methods of detecting bending and angular position of suction pipe, and electric-component handling device |
US20040186616A1 (en) * | 2000-10-23 | 2004-09-23 | Bowe Bell + Howell Postal Systems Company | Flats bundle collator |
US6778878B1 (en) * | 2000-11-27 | 2004-08-17 | Accu-Assembly Incorporated | Monitoring electronic component holders |
US20020069395A1 (en) * | 2000-12-04 | 2002-06-06 | Hiroaki Fujiwara | Method and apparatus of checking mount quality of circuit board |
US20020078580A1 (en) * | 2000-12-08 | 2002-06-27 | Haugen Paul R. | Automated system with improved height sensing |
US6681151B1 (en) * | 2000-12-15 | 2004-01-20 | Cognex Technology And Investment Corporation | System and method for servoing robots based upon workpieces with fiducial marks using machine vision |
US20040119987A1 (en) * | 2001-01-22 | 2004-06-24 | Madsen David D. | Multiple source alignment sensor with improved optics |
US6762847B2 (en) * | 2001-01-22 | 2004-07-13 | Cyberoptics Corporation | Laser align sensor with sequencing light sources |
US20020112064A1 (en) * | 2001-02-15 | 2002-08-15 | Roger Eastvold | Customer support network |
US20020124391A1 (en) * | 2001-03-06 | 2002-09-12 | Fuji Machine Mfg. Co., Ltd. | Apparatus for assisting operator in performing manual operations in connection with component feeders |
US20020133940A1 (en) * | 2001-03-26 | 2002-09-26 | Fuji Machine Mfg. Co., Ltd | Electric-component supplying method and device, and electric-component mounting method and system |
US20040094594A1 (en) * | 2001-03-30 | 2004-05-20 | Thomas Liebeke | Device and method for feeding taped electrical components |
US20030027363A1 (en) * | 2001-07-23 | 2003-02-06 | Fuji Machine Mfg. Co., Ltd. | Circuit-substrate working system and electronic-circuit fabricating process |
US20030029033A1 (en) * | 2001-08-08 | 2003-02-13 | Matsushita Electric Industrial Co., Ltd. | Apparatus and method for mounting electronic parts |
US20030111494A1 (en) * | 2001-10-26 | 2003-06-19 | Sequenom, Inc. | Method and apparatus for high-throughput sample handling process line |
US6616263B2 (en) * | 2001-10-31 | 2003-09-09 | Hewlett-Packard Development Company, L.P. | Image forming apparatus having position monitor |
US20030110610A1 (en) * | 2001-11-13 | 2003-06-19 | Duquette David W. | Pick and place machine with component placement inspection |
US7239399B2 (en) * | 2001-11-13 | 2007-07-03 | Cyberoptics Corporation | Pick and place machine with component placement inspection |
US20030098426A1 (en) * | 2001-11-27 | 2003-05-29 | Kabushiki Kaisha Shinkawa | Wire bonding method and apparatus |
US6506614B1 (en) * | 2002-01-29 | 2003-01-14 | Tyco Electronics Corporation | Method of locating and placing eye point features of a semiconductor die on a substrate |
US20030159515A1 (en) * | 2002-02-27 | 2003-08-28 | Yukihiro Tonomura | Machines having drive member and method for diagnosing the same |
US20050161498A1 (en) * | 2002-03-08 | 2005-07-28 | Valor Denmark A/S | Feeder verification with a camera |
US7083082B2 (en) * | 2002-03-08 | 2006-08-01 | Valor Denmark A/S | Feeder verification with a camera |
US7029224B2 (en) * | 2002-03-12 | 2006-04-18 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for transferring a thin plate |
US20050115060A1 (en) * | 2002-04-01 | 2005-06-02 | Toshihiro Kondo | Working system for substrate |
US20050210832A1 (en) * | 2002-04-23 | 2005-09-29 | I.M.A. Industria Macchine Automatiche S.P.A. | Method for carrying out a size change over in a packaging machine |
US20040163243A1 (en) * | 2003-02-25 | 2004-08-26 | Kazuhiko Noda | Electronic component placement machine and electronic component placement method |
US20050117797A1 (en) * | 2003-11-04 | 2005-06-02 | Gaida John D. | Pick and place machine with improved component placement inspection |
US20050125993A1 (en) * | 2003-11-07 | 2005-06-16 | Madsen David D. | Pick and place machine with improved setup and operation procedure |
US20050123187A1 (en) * | 2003-11-07 | 2005-06-09 | Bushman Thomas W. | Pick and place machine with improved workpiece inspection |
US20060016066A1 (en) * | 2004-07-21 | 2006-01-26 | Cyberoptics Corporation | Pick and place machine with improved inspection |
US20060075631A1 (en) * | 2004-10-05 | 2006-04-13 | Case Steven K | Pick and place machine with improved component pick up inspection |
US20060174480A1 (en) * | 2005-02-08 | 2006-08-10 | Fuji Machine Mfg. Co., Ltd. | Inspection method and apparatus for mounted electronic components |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090242457A1 (en) * | 2008-03-31 | 2009-10-01 | Accu-Assembly Incorporated | Electronic component orientation for assembly to circuit boards |
US10448551B2 (en) | 2015-05-25 | 2019-10-15 | Fuji Corporation | Component mounter |
Also Published As
Publication number | Publication date |
---|---|
US7545514B2 (en) | 2009-06-09 |
JP2009508361A (en) | 2009-02-26 |
DE112006002473T5 (en) | 2008-08-14 |
WO2007033349A1 (en) | 2007-03-22 |
JP4896136B2 (en) | 2012-03-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7545514B2 (en) | Pick and place machine with improved component pick image processing | |
US20060075631A1 (en) | Pick and place machine with improved component pick up inspection | |
US7706595B2 (en) | Pick and place machine with workpiece motion inspection | |
US6396942B1 (en) | Method and apparatus for locating ball grid array packages from two-dimensional image data | |
US20090135251A1 (en) | Method and apparatus for evaluating a component pick action in an electronics assembly machine | |
US7813559B2 (en) | Image analysis for pick and place machines with in situ component placement inspection | |
US6496270B1 (en) | Method and system for automatically generating reference height data for use in a three-dimensional inspection system | |
US20070130755A1 (en) | Electronics assembly machine with embedded solder paste inspection | |
JP4946668B2 (en) | Substrate position detection device and substrate position detection method | |
JP5421763B2 (en) | Inspection apparatus and inspection method | |
US20050117797A1 (en) | Pick and place machine with improved component placement inspection | |
JP2010261955A (en) | Head loading component alignment using many area array type image detectors | |
JP2008130771A (en) | Component recognition method | |
KR102641333B1 (en) | Die bonding apparatus and manufacturing method of semiconductor device | |
JP2000013097A (en) | Part mounting system | |
JP2017034202A (en) | Inspection device, mounting device, inspection method and program | |
JP2539015B2 (en) | Pellet bonding method and device | |
JP3725993B2 (en) | Electronic component mounting circuit board inspection method and apparatus | |
WO2006125102A1 (en) | Method and apparatus for evaluating a component pick action in an electronics assembly machine | |
JPH11101750A (en) | Detection of foreign matter | |
JPH11266100A (en) | Recognition method and device of electronic component | |
JP6231397B2 (en) | Component recognition device, component transfer device, and component mounting device | |
JP2001217599A (en) | Surface mounting component attaching device and electronic component detecting method thereof | |
JP2001189600A (en) | Method for mounting electronic parts | |
JPH05136600A (en) | Electronic component recognition device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CYBEROPTICS CORPORATION, MINNESOTA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MANICKAM, SWAMINATHAN;KONICEK, JOHN P.;DUQUETTE, DAVID W.;AND OTHERS;REEL/FRAME:018765/0721;SIGNING DATES FROM 20061121 TO 20070103 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20210609 |