WO2002040940A1 - Apparatus and method for determining the three-dimensional shape of an object - Google Patents

Apparatus and method for determining the three-dimensional shape of an object Download PDF

Info

Publication number
WO2002040940A1
WO2002040940A1 PCT/NL2001/000818 NL0100818W WO0240940A1 WO 2002040940 A1 WO2002040940 A1 WO 2002040940A1 NL 0100818 W NL0100818 W NL 0100818W WO 0240940 A1 WO0240940 A1 WO 0240940A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
image
detector
light source
spots
Prior art date
Application number
PCT/NL2001/000818
Other languages
French (fr)
Inventor
Pieter Wilhelmus Verbeek
Bernadus Conrad Hubertus Antonius Meens
Ian Theodore Young
Original Assignee
Technische Universiteit Delft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Technische Universiteit Delft filed Critical Technische Universiteit Delft
Priority to AU2002223156A priority Critical patent/AU2002223156A1/en
Publication of WO2002040940A1 publication Critical patent/WO2002040940A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2513Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/521Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light

Definitions

  • the invention relates to an apparatus and method for determining a three-dimensional shape of an object from a two-dimensional image, wherein a light pattern is projected on the object and an image is formed of the illuminated object.
  • a light source is used for illuminating the object and a camera for forming an image of the illuminated object .
  • Fig. 2A shows a front view of a mask that can be used for forming the parallel light beams.
  • the apertures 10 in the mask 2 are grouped such that the relating line sections Ul, U2, as it were overlap yet do not intersect in the image plane 8 of the camera; this is shown in Figure 2B. This allows the pixels 9 in the image plane 8 to be distinguished from each other.
  • said line sections Ul, U2 correspond with a variation in the position of the respective object spot 5 of the object 3 between the boundaries 6 and 7.
  • Fig. 2B shows that these line sections are determined and do not cross or intersect. This affords the possibility to directly use the position of the pixel 9 formed in the image plane 8 of the camera that corresponds with the object point 5, for the determination of the position taken up by this object point 5 in the space.
  • the position is determined on the basis of the position that the pixel 9 occupies in the image plane 8 of the camera on the respective line Ul, U2, after which said position is subsequently used for deriving for each object point 5 the spatial location where the respective light beam meets the object 3.
  • This spatial location in relation with the boundaries 6 and 7 within which the object 3 is located, is unambiguously determined by the spot that the pixel 9 occupies on the line U1-U2.
  • the system and the method are also very well suited to be used with more than one camera in order to obtain a greater accuracy when determining the shape of the object.

Abstract

The invention relates to an apparatus for determining a three-dimensional shape of an object from a two-dimensional image, comprising a light source for illuminating the object, and a detector for forming an image of the illuminated object, wherein the light source emits a pattern of substantially needle-like light beams that are directed at the object, and wherein the detector forms an image of spots of light of the object thus illuminated by the light beams, and a processor is connected to the detector for reconstructing the shape of the object from the image of spots of light detected by the detector. The detector and the light source have a fixed position in relation to one another, the object is located between predetermined boundaries, and a mask is placed between the light source and the object for the formation of light rays, the mask being provided with an aperture pattern that is placed such that when the object is moved between the predetermined boundaries, the individual spots of the light spot image observed by the detector move along non-intersecting line sections.

Description

Apparatus and method for determining the three-dimensional shape of an object
The invention relates to an apparatus and method for determining a three-dimensional shape of an object from a two-dimensional image, wherein a light pattern is projected on the object and an image is formed of the illuminated object.
To this end usually a light source is used for illuminating the object and a camera for forming an image of the illuminated object .
Such a method is known from the article "One-Shot Active 3D Shape Acquisition" by the authors M. Proesmans, L. van Gool and A. Oosterlinck, 13th International Conference on Pattern Recognition, Vienna, August 25-29, 1996, Vol. Ill, pp. 336-340. In this known method a pattern of squares is projected on the object, and a relatively complicated algorithm is necessary to be able to reconstruct the original shape of the illuminated object from the image pattern observed by the camera. There is a need for such a reconstruction system for the purpose of, among other things, quality control of surfaces of products of the agricultural industry and the metal and car industry, for the purpose of dimensional stability control of products, and for the purpose of automatic recognition of faces, which is useful for the security sector and for forensic applications.
It is observed, that from US-A-5, 003, 166 a system is known for remote determination with regard to an object, using an image projected on the object. By means of a camera, this image and the deformation occurring therein is determined and processed in the distance determination. The subject of this publication is therefore not connected with the present invention.
From DE-A-43 04 815 an apparatus is known for determining a three-dimensional shape of an object from a two-dimensional image, which apparatus comprises a light
Figure imgf000004_0001
ω ω t to μ> μ> in o cπ o cπ o Ul
Figure imgf000005_0001
produces a pixel 9. This pixel 9 lies in the image plane 8 on a line section Ul, U2, whose extreme boundaries are determined by the actual boundaries 6 and 7 within which the object 3 is located. The invention produces, among other things, a solution for the problem that when there are several light beams illuminating the object 3, the ability to distinguish between the various pixels 9 in the image plane 8 of the camera threatens to become lost . Fig. 2A shows a front view of a mask that can be used for forming the parallel light beams. The apertures 10 in the mask 2 are grouped such that the relating line sections Ul, U2, as it were overlap yet do not intersect in the image plane 8 of the camera; this is shown in Figure 2B. This allows the pixels 9 in the image plane 8 to be distinguished from each other. As explained above, said line sections Ul, U2 correspond with a variation in the position of the respective object spot 5 of the object 3 between the boundaries 6 and 7. Fig. 2B shows that these line sections are determined and do not cross or intersect. This affords the possibility to directly use the position of the pixel 9 formed in the image plane 8 of the camera that corresponds with the object point 5, for the determination of the position taken up by this object point 5 in the space. For each object point 5 of the object 3 illuminated via the mask 1 by the light source 2, the position is determined on the basis of the position that the pixel 9 occupies in the image plane 8 of the camera on the respective line Ul, U2, after which said position is subsequently used for deriving for each object point 5 the spatial location where the respective light beam meets the object 3. This spatial location in relation with the boundaries 6 and 7 within which the object 3 is located, is unambiguously determined by the spot that the pixel 9 occupies on the line U1-U2. A simple calculation therefore allows said spatial location to. be derived from the location of the pixel 9 on the line section U1-U2. It is then possible to use for all light spots of the image plane 8 the spatial location of the respective object points 5 pertaining thereto and determined as described above in an integral compilation for the determination of the form of the object 3.
Incidentally, it is remarked that according to the invention the system and the method are also very well suited to be used with more than one camera in order to obtain a greater accuracy when determining the shape of the object.

Claims

ω w to to H M
C71 o cπ o Cπ O cπ
Figure imgf000008_0001
for each individual spot of the light spot image the position it takes in the line section pertaining to that spot, and subsequently deriving therefrom for each position the spatial location where the respective light beam meets the object, after which for all spots of the light spot image the respective spatial locations are compiled for the determination of the shape of the object.
PCT/NL2001/000818 2000-11-15 2001-11-12 Apparatus and method for determining the three-dimensional shape of an object WO2002040940A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002223156A AU2002223156A1 (en) 2000-11-15 2001-11-12 Apparatus and method for determining the three-dimensional shape of an object

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL1016617 2000-11-15
NL1016617A NL1016617C2 (en) 2000-11-15 2000-11-15 Device and method for determining a three-dimensional shape of an object.

Publications (1)

Publication Number Publication Date
WO2002040940A1 true WO2002040940A1 (en) 2002-05-23

Family

ID=19772395

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NL2001/000818 WO2002040940A1 (en) 2000-11-15 2001-11-12 Apparatus and method for determining the three-dimensional shape of an object

Country Status (3)

Country Link
AU (1) AU2002223156A1 (en)
NL (1) NL1016617C2 (en)
WO (1) WO2002040940A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2842591A1 (en) * 2002-07-16 2004-01-23 Ecole Nale Sup Artes Metiers DEVICE FOR MEASURING VARIATIONS IN THE RELIEF OF AN OBJECT
WO2004044523A1 (en) * 2002-11-11 2004-05-27 Qinetiq Limited Structured light projector
EP1431708A2 (en) 2002-12-20 2004-06-23 Delphi Technologies, Inc. Object surface characterization using optical triangulation and a single camera
US7459670B2 (en) 2002-11-11 2008-12-02 Qinetiq Limited Proximity sensor based on projection of structured light
US7589825B2 (en) 2002-11-11 2009-09-15 Qinetiq Limited Ranging apparatus
US8090194B2 (en) 2006-11-21 2012-01-03 Mantis Vision Ltd. 3D geometric modeling and motion capture using both single and dual imaging
US8538166B2 (en) 2006-11-21 2013-09-17 Mantisvision Ltd. 3D geometric modeling and 3D video content creation

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4802759A (en) * 1986-08-11 1989-02-07 Goro Matsumoto Three-dimensional shape measuring apparatus
US5003166A (en) * 1989-11-07 1991-03-26 Massachusetts Institute Of Technology Multidimensional range mapping with pattern projection and cross correlation
WO1991009564A1 (en) * 1989-12-22 1991-07-11 Phoenix Laser Systems, Inc. Ophthalmic diagnostic apparatus and method
DE4304815A1 (en) * 1993-02-17 1994-08-18 Leitz Mestechnik Gmbh Optical sensor

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4802759A (en) * 1986-08-11 1989-02-07 Goro Matsumoto Three-dimensional shape measuring apparatus
US5003166A (en) * 1989-11-07 1991-03-26 Massachusetts Institute Of Technology Multidimensional range mapping with pattern projection and cross correlation
WO1991009564A1 (en) * 1989-12-22 1991-07-11 Phoenix Laser Systems, Inc. Ophthalmic diagnostic apparatus and method
DE4304815A1 (en) * 1993-02-17 1994-08-18 Leitz Mestechnik Gmbh Optical sensor

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004017020A1 (en) * 2002-07-16 2004-02-26 Ecole Nationale Superieure De Mecanique Et D'aerotechnique Device for measuring the relief variations of an object
FR2842591A1 (en) * 2002-07-16 2004-01-23 Ecole Nale Sup Artes Metiers DEVICE FOR MEASURING VARIATIONS IN THE RELIEF OF AN OBJECT
US7459670B2 (en) 2002-11-11 2008-12-02 Qinetiq Limited Proximity sensor based on projection of structured light
WO2004044523A1 (en) * 2002-11-11 2004-05-27 Qinetiq Limited Structured light projector
US7589825B2 (en) 2002-11-11 2009-09-15 Qinetiq Limited Ranging apparatus
EP1431708A2 (en) 2002-12-20 2004-06-23 Delphi Technologies, Inc. Object surface characterization using optical triangulation and a single camera
EP1431708A3 (en) * 2002-12-20 2007-12-19 Delphi Technologies, Inc. Object surface characterization using optical triangulation and a single camera
US8090194B2 (en) 2006-11-21 2012-01-03 Mantis Vision Ltd. 3D geometric modeling and motion capture using both single and dual imaging
US8208719B2 (en) 2006-11-21 2012-06-26 Mantis Vision Ltd. 3D geometric modeling and motion capture using both single and dual imaging
US8538166B2 (en) 2006-11-21 2013-09-17 Mantisvision Ltd. 3D geometric modeling and 3D video content creation
US9367952B2 (en) 2006-11-21 2016-06-14 Mantisvision Ltd. 3D geometric modeling and 3D video content creation
US10140753B2 (en) 2006-11-21 2018-11-27 Mantis Vision Ltd. 3D geometric modeling and 3D video content creation
US10902668B2 (en) 2006-11-21 2021-01-26 Mantisvision Ltd. 3D geometric modeling and 3D video content creation

Also Published As

Publication number Publication date
AU2002223156A1 (en) 2002-05-27
NL1016617C2 (en) 2002-05-16

Similar Documents

Publication Publication Date Title
JP5132832B1 (en) Measuring apparatus and information processing apparatus
US7876455B2 (en) Three-dimensional shape measuring method and apparatus for the same
US8761495B2 (en) Distance-varying illumination and imaging techniques for depth mapping
JP6426968B2 (en) INFORMATION PROCESSING APPARATUS AND METHOD THEREOF
EP3421189B1 (en) Method for monitoring a machine
US6868194B2 (en) Method for the extraction of image features caused by structure light using image reconstruction
US8032327B2 (en) Auto-referenced sensing method for three-dimensional scanning
JP3919825B2 (en) Apparatus and method for recognizing and determining the position of an animal part
US9050158B2 (en) Method for acquiring three-dimensional images
WO2008062407B1 (en) 3d geometric modeling and 3d video content creation
EP2319019A1 (en) Method and system for providing a digital model of an object
EP3195256B1 (en) Method and apparatus for identifying structural elements of a projected structural pattern in camera images
US7302109B2 (en) Method and system for image processing for structured light profiling of a part
WO2002040940A1 (en) Apparatus and method for determining the three-dimensional shape of an object
JP2001523827A (en) Three-dimensional imaging by triangulation using dual-wavelength light
WO2019238505A1 (en) Method for determining the path of a measurement beam of an interferometric measuring device, and measuring device for interferometric measurement of an object under measurement
US7136171B2 (en) Method for the extraction of image features caused by structure light using template information
Massot-Campos et al. Structured light and stereo vision for underwater 3D reconstruction
DE102019103519A1 (en) Device for determining dimensional and / or geometric properties of a measurement object
JP6061631B2 (en) Measuring device, information processing device, measuring method, information processing method, and program
CZ2011607A3 (en) Particle beam microscope and method for operating such particle beam microscope
Urquhart et al. Toward real-time dynamic close-range photogrammetry
Fantin et al. Measurement and stitching of regular cloud of points
Domey et al. 3-D Sensing for Robot Vision
JPWO2016157349A1 (en) Shape measuring method and apparatus

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP