CN100538264C - The optical imagery distance measuring equipment of single aperture multiple imaging - Google Patents

The optical imagery distance measuring equipment of single aperture multiple imaging Download PDF

Info

Publication number
CN100538264C
CN100538264C CNB2006101184309A CN200610118430A CN100538264C CN 100538264 C CN100538264 C CN 100538264C CN B2006101184309 A CNB2006101184309 A CN B2006101184309A CN 200610118430 A CN200610118430 A CN 200610118430A CN 100538264 C CN100538264 C CN 100538264C
Authority
CN
China
Prior art keywords
microprism
imaging
array
multiple imaging
aperture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2006101184309A
Other languages
Chinese (zh)
Other versions
CN1959341A (en
Inventor
阳庆国
刘立人
栾竹
刘德安
孙建锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Institute of Optics and Fine Mechanics of CAS
Original Assignee
Shanghai Institute of Optics and Fine Mechanics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Institute of Optics and Fine Mechanics of CAS filed Critical Shanghai Institute of Optics and Fine Mechanics of CAS
Priority to CNB2006101184309A priority Critical patent/CN100538264C/en
Publication of CN1959341A publication Critical patent/CN1959341A/en
Application granted granted Critical
Publication of CN100538264C publication Critical patent/CN100538264C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A kind of optical imagery distance measuring equipment of single aperture multiple imaging, it is characterized in that constituting: comprise imaging main lens, multiple imaging element, field lens and photodetector successively with optical axis ground, the output termination Digital Image Processor of this photodetector, described imaging main lens and multiple imaging element are close together, described Digital Image Processor is used to handle the digital picture by the photodetector sampling, extracts the data processing software of the depth information of object.The present invention only needs the single imaging, can obtain complete imaging, and the system architecture compactness, is easy to assembling, does not need complicated camera location and demarcation, and location algorithm is simple, can obtain the depth information of object apace.

Description

The optical imagery distance measuring equipment of single aperture multiple imaging
Technical field
The present invention relates to the depth information of body surface, is a kind of optical imagery distance measuring equipment of single aperture multiple imaging of the depth information that is used for measuring the visual field body surface, promptly puts the distance between the viewpoint on the body surface.The range information that obtains can be used for the reconstruction of object dimensional pattern, target signature identification, and automotive vehicle, robot navigation etc.
Background technology
The imaging process of ordinary optical imaging system generally is the mapping of three-dimensional article space to the two-dimensional image space, has often lost the depth information of scenery in the imaging process.And the depth information that obtains image is that each point is very important to the distance of viewpoint in a lot of the application on the body surface.Passive type range recovery method commonly used has the monocular stereoscopic approach of stereoscopic vision method, optical differential method, microlens array and aperture coding chromatography imaging method etc.The stereoscopic vision method is by in two of space placements or many cameras same target object being made a video recording in different viewpoints.Because the viewpoint difference exists parallax between the image that is become, promptly the picture point of same object point is distributed on the diverse location of each camera as receiving plane.If can from every width of cloth anaglyph, find the corresponding picture point of same object point, just can calculate the distance of object point then for how much according to triangle.But this method needs the accurate location and complexity demarcation of camera, and owing to seek the coupling extremely calculating of complexity in a large number that the picture of same object point is an image between image, has therefore limited its range of application.
In order to solve the inherent difficulty that exists in the stereoscopic vision method, people have proposed the method for optical differential.Formerly technology [1] is (referring to RANGE ESTIMATION BY OPTICALDIFFERENTIATION, Farid H and E.P.Simoncelli, J.Opt.Soc.Am.A, Vol.15, No.7,1998) proposed to utilize two optical masks to carry out the method for estimating distance of optical differential in.The mask function of the wherein mask plates in the optical mask is the mask differential of function form of another mask plates, therefore do not need space camera placed apart just can obtain the anaglyph of scenery, and the method can solve the coupling difficult problem of image, but, therefore increased the complexity of system owing to need two mask plates to obtain two width of cloth images.
Formerly technology [2] is (referring to OPTICAL RANGING APPARATUS, Edward H.Adelson, United States Patent, Patent Number:5076687, Date of Patent:Dec.31,1991) proposed a kind of optical distance measurement apparatus of full light camera in, it utilizes the main lens imaging, places the three-dimensional structure that a microlens array is used to write down incident light then before photodetector array.Each lenticule is all represented a macroscopical pixel, and it can write down by the distribution of light behind the main lens.The image formation by rays that by different piece on the aperture plane is different points of view is on the different subpixel of macroscopical pixel, Digital Image Processor extracts from the combination picture of single width by rule and comes from different points of view scenery subimage, just can calculate the depth information that estimates scenery by simple stereo-picture registration Algorithm then.Owing to adopt single lens imaging, avoid complicated camera location and demarcation problem, secondly by pre-filtering, can reduce the coupling difficulty between image greatly.But also there is bigger shortcoming in this method, the difficulty of aliging between the most outstanding is microlens array and the photodetector array, and alignment error can cause bigger picture depth evaluated error.Come pre-filtering owing to need add scatter plate before lens imaging in addition, therefore whole imaging system is incomplete.
Another three-D imaging method that does not need camera calibration and Stereo Matching Algorithm is the aperture coding method of space camera.Technology [3] (a kind of three-D imaging method of the three-dimensional based on the coded aperture imaging principle formerly, Lang Haitao, Liu Li people, Global Suntech state, optics journal, Vol.26, No.1, pp34-38,2006) proposed to utilize the aperture coding method that camera array is arranged Scenery Imaging according to certain coded system, utilize corresponding decoding algorithm then, recover the three-dimensional distance information of scenery.This method needs a plurality of cameras to object imaging simultaneously, and camera array need be arranged according to the aperture coded system, has taken bigger space, is unfavorable for miniaturization, and is integrated.
Summary of the invention
The technical problem to be solved in the present invention is to overcome the shortcoming of above-mentioned prior art, a kind of optical imagery distance measuring equipment based on the single aperture multiple imaging is provided, this device has been inherited some advantages of above-mentioned technology formerly and has been overcome their shortcoming, and characteristics are only to need a single imaging, and promptly imaging is complete.The system architecture compactness is easy to assembling, does not need complicated camera location and demarcation, and location algorithm is simply quick.
Technical solution of the present invention is:
A kind of optical imagery distance measuring equipment of single aperture multiple imaging, it is characterized in that constituting: comprise imaging main lens, multiple imaging element, field lens and photodetector successively with optical axis ground, the output termination Digital Image Processor of this photodetector, described imaging main lens and multiple imaging element are close together, described Digital Image Processor is used to handle the digital picture by the photodetector sampling, extracts the data processing software of the depth information of object.
Described single aperture multiple imaging is meant that utilization produces the picture of object in several same field ranges simultaneously in single pore diameter range.But the picture of single width is not separately to receive, but receives as detector as the last whole quilt of a combination picture.The method that the present invention produces multiple image is to utilize the deviation of microprism array to divide the wavefront modulating action of light action or light wave modulation template array or both acting in conjunction that combines.When light wave carries the object three-dimensional information and incides pupil plane, be subjected to different deviations or modulation in the different piece of pupil plane, by the light beam and all independent at last together single imaging of imaging main lens of each microprism or light wave modulation template.Because the each several part light beam is subjected to different the change on the pupil plane, therefore exists difference between the single image that is become.The embodiment of object dimensional information in multiple image just of this species diversity.
The effect of described field lens is to be used for dwindling optical imagery; Because the branch light action of microprism array, optical imagery generally is distributed on the image planes than in the big regional extent, the common photoelectric image detector can't receive at all, therefore need to add a field lens in the light path between imaging len and image planes detector, optical imagery is narrowed down to the size of the effective image planes detection area of photodetector.
Described Digital Image Processor is a special digital processing chip, and built-in scenery depth extraction algorithm carries out data processing to digital picture.Result of calculation deposits the chip memory cell in or delivers to other images and shows or control module.
Described imaging main lens is made of a biconvex lens, and described multiple imaging element is close to after the imaging main lens.
Described imaging main lens is made of two relative plano-convex lenss in plane, and described multiple imaging element is placed between two plano-convex lenss being close to.
Described multiple imaging element is a microprism array, or light wave modulation template array, or is formed by microprism array and light wave modulation template array combination, and integrally places on the pupil plane of imaging system.
Described this microprism array is arranged evenly at locational one dimension of a series of grids or two-dimentional microprism array according to certain rule by a plurality of microprisms.
Described microprism array is a circular array, or rectangular array.
Described microprism array is regularly arranged distribution, promptly on pupil plane, place microprism according to fixing in advance spacing arrangement, and the drift angle of each single microprism is determined according to the parameter of imaging system and the position of microprism, is non-overlapping regularly arranged to ensure each single microprism between the single picture that is become on the image planes.
Described microprism array is by aperture coded system arranged distribution, promptly according to aperture coded imaging principle, arrange the arrangement of microprism according to the aperture coded system, spacing between each microprism is given by coding function, the drift angle of each single microprism is determined according to the position of imaging system parameter and microprism, forms the aperture coded image as being superimposed at last to ensure the list that each single microprism is become on image planes.
Described light wave modulation template array is arranged evenly at locational one dimension of a series of grids or two-dimentional wavefront modulator element array according to rule by a plurality of wavefront modulator elements, and this light wave modulation template array integrally is placed on the pupil plane.
Technique effect of the present invention:
The present invention compares with above-mentioned technology formerly, maximum characteristics are: the principle of utilizing the single aperture multiple imaging, a multiple imaging element is placed in employing in the position of the main lens of pressing close to optical imaging system, as microprism array or light wave modulation template array or both combinations, be used for single multiple imaging to same visual field object.Multiple imaging process middle ground has write down the depth information of object in multiple image, solved shortcoming of the prior art, only need the single imaging, can obtain complete imaging, and the system architecture compactness, be easy to assembling, do not need complicated camera location and demarcation, location algorithm is simple, can obtain the depth information of object apace.
Description of drawings
Fig. 1 is the structural representation of the optical imagery distance measuring equipment of single aperture multiple imaging of the present invention.
The imaging main lens apparatus structure synoptic diagram that Fig. 2 constitutes for two plano-convex lenss of the present invention.
Fig. 3 is made of the apparatus structure synoptic diagram of multiple imaging element microprism array and light wave modulation template array for the present invention.
Fig. 4 is the single eye stereo vision principle schematic of microprism array.
Fig. 5 is the geometry image-forming principle synoptic diagram of lens.
Fig. 6 is regularly arranged microprism array synoptic diagram.
The distribution schematic diagram of each subimage on image planes when Fig. 7 is regularly arranged for microprism array.
The microprism array synoptic diagram that Fig. 8 arranges for the aperture coding.
The distribution schematic diagram of each subimage on image planes when Fig. 9 is aperture coding arrangement for microprism array.
Figure 10 is the Digital Image Processing process flow diagram that utilizes correlation filtering method reconstruction of three-dimensional tomographic map.
Embodiment
The invention will be further described below in conjunction with embodiment and accompanying drawing, but should not limit protection scope of the present invention with this.
See also Fig. 1 earlier, Fig. 1 is the structural representation of the optical imagery distance measuring equipment of single aperture multiple imaging of the present invention.It is the structural representation of the device of the embodiment of the invention 1.As seen from the figure, the formation of the optical imagery distance measuring equipment of single aperture multiple imaging of the present invention is: comprise imaging main lens 2, multiple imaging element 3, field lens 4 and photodetector 5 successively with optical axis ground, the output termination Digital Image Processor 6 of this photodetector 5, described imaging main lens 2 is close together with multiple imaging element 3, described Digital Image Processor 6 is used to handle the digital picture by photodetector 5 samplings, extracts the depth information of object.
One multiple imaging element 3 is used to produce the multiple optics image, and the multiple optics combination picture that field lens 4 is used to dwindle is to be fit to the receiving area size of photodetector, and a photodetector 5 is as CCD reception optical imagery and with its digitizing.One Digital Image Processor 6 is used for the digital picture that computing photodetector 5 is sampled and received as microprocessor, therefrom extracts the depth information of object.
Described imaging main lens 2 mainly is responsible for optical imagery.The imaging main lens can be formed by one or more combination of lensess, if having only lens, then the multiple imaging element directly is close to the back that is placed on lens.A kind of method preferably is as shown in Figure 2, multiple imaging element 3 is clamped between the imaging len of two plano-convex lenss formations, can guarantee that like this multiple imaging element 3 is on the pupil plane of optical system.
Described multiple imaging element, as shown in Figure 3, both combine and constitute by microprism array 31 or light wave modulation template array 32 or they.Their final purpose all is in order to form the multiple imaging to same scenery.The multiple imaging process is one step completed, and is mutually independently between each single imaging, also is differentiated.
Described microprism array 31 is arranged evenly at locational one dimension of a series of grids or two-dimensional array according to certain rule by a plurality of microprisms 311.Whole array plane is positioned on the pupil plane of imaging system.If diaphragm shape circle, microprism array also is limited in the circular iris scope, and shown in Fig. 6 a, if pupil is a rectangle, microprism array promptly is a rectangular array, shown in Fig. 6 b.Rectangular array is than easier design of circular array and processing.Microprism array 31 can be regularly arranged distribution, so-called regularly arranged, promptly on pupil plane, place microprism according to fixing in advance spacing arrangement, and the drift angle of every single microprism also is to determine according to the parameter of imaging system and the position of microprism, purpose is to be non-overlapping regularly arranged in order to make between each single width picture on the image planes, as shown in Figure 7.Described microprism array also can be by certain aperture coded system arranged distribution, so-called aperture coding is arranged, promptly according to aperture coded imaging principle, arrange the arrangement of microprism according to certain aperture coded system, as shown in Figure 8, spacing between the microprism is given by coding function, and the drift angle of every single microprism equally also is to determine according to the position of imaging system parameter and microprism, and purpose is to form the aperture coded image in order to make that each single image is superimposed at last on the image planes.
The drift angle of the every single microprism 311 of described microprism array 31, promptly the inclined degree of every single microprism is to determine that according to concrete imaging needs it is relevant with the position of microprism on pupil plane.The drift angle of microprism is big more, and its deviation to light is also big more, and for the less microprism of inclined degree, the deflection angle δ of its generation has following approximation relation with vertex angle theta
δ≈tanδ≈(n-1)θ (1)
Wherein n is the refractive index of microprism.
Described light wave modulation template array 32 is arranged evenly at locational one dimension of a series of grids or two-dimentional wavefront modulator element array according to rule by a plurality of wavefront modulator elements 321.Light wave modulation template array 32 whole being also placed on the pupil plane.Therefore the light wave that incides the pupil plane different piece is subjected to different modulation, thereby the light wave that carries the object three-dimensional information is recorded in the different modulated light waves, and the three-dimensional information that just can recover object by suitable demodulation method comes.Light wave modulator element 321 can adopt net amplitude type modulator, and as optical differential method [referring to technology 1 formerly], the modulating function of a part of modulator element is the differential form of other a part of modulating function.Also can adopt pure phase bit-type modulator, as a part of modulator element is that positive quadratic phase is modulated as convex lens, another part is modulated as concavees lens for negative quadratic phase, thereby make the light wave incide the out of phase template produce out of focus in various degree, utilize the method for out of focus transport function just can recover the depth information of image.And the complex amplitude type modulator that adopts both combinations.In addition, light modulator can also adopt the grating pair light wave of different cycles to modulate.
Embodiment 1
Present embodiment is based on the picture depth recovery technology of single eye stereo vision.Recover picture depth, must obtain anaglyph earlier, promptly observe the resulting image of same object from each different points of view.The multiple imaging mode of this device provides under single aperture imaging (monocular), obtains the method for several anaglyphs.Based on the principle of present embodiment, only used microprism array 31 as multiple imaging element 3.As shown in Figure 3, be clipped in microprism array 31 between the imaging main lenss that two plano- convex lenss 21 and 22 constitute and have the effect of deviation divided beams, the drift angle of each microprism 311 in the microprism array 31 is different, feasible light beam by each microprism 311 no longer focuses on some imagings, but focusing by divided separately, each microprism 311 and lens 21,22 are combined into an independent imaging system, similarly be on aperture plane, to have arranged the number camera identical with the microprism number, but the position difference of each camera, also will become the picture of different points of view, anaglyph that Here it is to the object in the visual field 1.The depth information that has comprised body surface in the anaglyph.This embodiment does not need light wave modulation template array 32, so each modulator element 321 can replace sub-aperture diaphragm 321 strict each microprism 311 of alignment with the sub-aperture diaphragm of hollow.The image-forming principle of this embodiment supposes that object point 7 focuses on picture receiving plane 8 as shown in Figure 4, and shown in Fig. 2 (a), no matter this object point moves forward or backward so, it is as all being into the speckle picture on the receiving plane 8, shown in Fig. 2 (b) and Fig. 2 (c).Under image planes, indicated the light distribution of the picture of some thing 7 among Fig. 4, according to geometrical optics, for focusing on situation, what obtain on the image planes 8 is the number bright luminous point identical with microprism, and the out of focus situation, the light distribution on the image planes 8 then is the hot spot of a series of dimnesses.Shape is similar with the shared pupil area of each microprism.In addition, for different far and near object points, each speckle picture position on image planes 8 is different.For the microprism array of regular distribution, the picture hot spot of nearly object point is to the outer side shifting of picture centre, and microprism 311 is more by the outside of pupil, and this image drift is big more; On the contrary, the picture hot spot of object point far away is then to the medial movement of picture centre, and is same, and microprism 311 is more by the outside of pupil, and this image drift is big more; Therefore the moving direction of analyzing the distribution of this light intensity and speckle just can determine the distance of object point quantitatively.Thisly utilize single aperture imaging, and extract the parallax subimage of aperture plane diverse location, the method that the pixel displacement amount between subimage analyzed then obtains scene depth information is exactly the single eye stereo vision distance-finding method.
Displacement between anaglyph can be provided by the lens imaging system geometric relationship with the degree of depth of scenery.As shown in Figure 5, being set as the main lens focal length is f, is s as receiving plane to the distance of aperture plane, and side-play amount is a Δ on the aperture plane v(v), the skew on the image planes is a Δ r(r), then object distance d can be provided by following formula:
d ( r ) = f | Δ v ( v ) | | Δ r ( r ) | | Δ v ( v ) | s - f | Δ v ( v ) | + f | Δ r ( r ) | - - - ( 2 )
In the actual calculation, the offset of aperture plane v(v) be exactly that the coordinate of each microprism on aperture plane is poor, and the image planes offset r(r) be parallax amount for the pixel-shift amount between anaglyph.
The structure of microprism array:
The arrangement mode of the microprism array 31 of this embodiment is regularly arranged, and promptly microprism 311 is placed on a series of grid positions with fixed intervals, the center position optical axis of grid laterally and the i.e. coordinate of microprism 311 for this reason of fore-and-aft distance.Fig. 6 (a) expression be the microprism array of the diaphragm 9 of optical system 9 * 9 when being shaped as circle; Fig. 6 (b) expression be 9 * 9 the microprism array that diaphragm 9 is shaped as rectangle.This embodiment is except requiring prism array 31 by regularly arranged, and the drift angle of its each microprism 311 also has certain rule.Therefore single eye stereo vision requires can not be overlapping between every width of cloth parallax subimage, requires enough to separate on as receiving plane 8 between each microprism 311 and the subimage that the combination of lenses subsystem is become.Fig. 7 represents is totally 5 * 5 number of sub images 81 situation of just separating on image planes 8, and 81 of each number of sub images do not have overlapping.Suppose that every width of cloth subimage size is w x* w y, then under this requires, in the microprism array 31 the (p, q) drift angle of (array center's sequence number is (0,0)) individual microprism should satisfy:
θ p = pw x s ( n - 1 ) p = 0 , ± 1 , ± 2 , . . . ± P θ q = qw y s ( n - 1 ) q = 0 , ± 1 , ± 2 , . . . ± Q - - - ( 3 )
The drift angle of every microprism 311 in pupil plane towards central optical axis one side.The 2P * 2Q that adds up to as if microprism then can obtain same number of parallax subimage.If microprism array 31 has only the inclination angle of a horizontal or vertical direction, then obtain the anaglyph on the corresponding direction only.This is feasible to the situation of only depositing the scenery that change in depth is arranged in one direction.
Digital image processing method:
As shown in Figure 1, field lens 4 narrows down to optical imagery on the picture receiving plane of photodetector 5, optical signalling be converted into electrical signal and through A send into Digital Image Processor 6 after the D conversion.Next step work is the depth information that extracts image from these digital pictures.Here be to utilize existing method to carry out data processing, simply be described below: need that at first the combination picture that obtains is carried out subimage and cut apart, because image zero lap and regularly arranged, so cutting procedure is simpler; Secondly need carry out some images to subimage anticipates (as high-pass filtering etc.) and to filter most picture noises, strengthens picture quality; At last the anaglyph after handling is carried out depth extraction calculating with suitable apart from estimation algorithm,, can adopt simple stereo-picture registration Algorithm [seeing also technology 2 formerly] based on this apparatus features.Adopt least square method, the parallax amount between anaglyph can be calculated with following formula
| Δ r ( r ) | = Σ r ∈ A [ ▿ v I ( r ; v ) ] T ▿ r I ( r ; v ) Σ r ∈ A [ ▿ r I ( r ; v ) ] T ▿ r I ( r ; v ) - - - ( 4 )
Here The presentation video gray scale is to the gradient of viewpoint (microprism coordinate); Because the number of microprism 311 is limited in the actual device, therefore can only be approximate with discrete differential gradient between the parallax subimage, it is the difference quantification between each subimage.
Figure C200610118430D00114
What represent is the gradient of parallax subimage to the image space coordinate, because the discretize of digital picture, so it also is the difference gradient of gradation of image to image coordinate.Summation in the formula is that image is averaged in the neighborhood A of pixel r, to increase computation's reliability, generally gets the image-region piece of 5 * 5 to 9 * 9 sizes.Can obtain the degree of depth pattern of object through the parallax amount substitution (2) that obtains after (4) calculating.
Provide a concrete parameter of the imaging system of present embodiment below: the imaging len effective focal length is 50mm, and diaphragm diameter is 25mm, and field lens 4 is 25mm apart from the distance of imaging len 2, and photodetector CCD5 is placed on 6mm place on the back focal plane of field lens 4.The CCD pixel resolution is 512 * 480, and microprism array 31 sizes are 5 * 5 square array, can obtain 25 width of cloth parallax subimages so altogether.The resolution of every single width subimage probably is 100 * 100, and the shared grid area of every microprism 311 is 11.79 * 11.79mm 2, the microprism medium refraction index is 1.5, microprism laterally be provided with identically with inclination angle longitudinally, the 0th the ± 1 inclination angle is 6.32 ° for the inclination angle is zero flat board, the ± 2 inclination angles are 12.64 °
Embodiment 2
Present embodiment is based on optical aperture coding three-dimensional imaging technology.Concrete method be to microprism array 31 according to the certain way arrangement of encoding, constitute one two value array.Digital " 0 " in the encoding array is represented light tight herein, and a microprism 311 is placed in numeral " 1 " expression herein, and the drift angle of each microprism 311 is still relevant with its position in array.Because the branch light action of microprism array 31, a point source is through after coding prism array 31 and imaging len 2 imagings, and the light distribution on the image planes is the spot array with the proportional convergent-divergent of encoding array.The still imaging separately of combination subsystem of each microprism 311 and main imaging len 2, each number of sub images coded image of being superimposed and constituting on as receiving plane at last.According to the character of linear translation invariant system, coded image I (r) is each layer geometric image that object becomes
Figure C200610118430D00121
With the projection on image planes of coded aperture function C ( d i d i + s + r ) The stack of convolution.
I ( r ) = Σ i = 1 N O ( - s d i r ) * C ( d i d i + s r )
= O ( - s d m r ) * C ( d m d m + s r ) - - - ( 5 )
+ Σ i = 1 N O ( - s d i r ) * C ( d i d i + s r ) ( i ≠ m )
If will be from coded image decoding and rebuilding scenery d mThe image of layer is as long as decoding filter function D (r) should satisfy
C ( d m d m + s r ) * D ( d m d m + s r ) → δ - - - ( 6 )
Therefore according to the principle of coded aperture three-dimensional imaging technology, adopt suitable coding-decoding functions, comprise the depth information of body surface just can from coded image, obtaining the object dimensional tomographic map.
The structure of microprism array:
The arrangement mode of the microprism array 31 of present embodiment is that the aperture coding is arranged, promptly according to a certain specific encoding array, as pseudo-random code array, even redundant array or nonredundant thinned array, arrange the position of microprism 311 on pupil plane, the grid that in the coding function is numerical value " 1 " is placed microprism 311, and the grid of digital " 0 " is the blocked area.Fig. 8 (a) expression be that the diaphragm 9 of optical system is shaped as circular 9 * 9 microprism random coded array; Fig. 8 (b) expression be 9 * 9 the microprism random coded array that diaphragm 9 is shaped as rectangle.This embodiment is arranged by the aperture coding except requiring prism array 31, and the drift angle of its each microprism 311 also has certain rule.Suppose single encoded cellar area in the microprism encoding array, promptly single microprism 311 shared region areas are l x* l y, then in the microprism encoding array 31 (p, q) drift angle of (array center's sequence number is (0,0)) individual microprism should satisfy:
θ p = k pl x f ( n - 1 ) θ q = k ql y f ( n - 1 ) - - - ( 7 )
Wherein, k is the scaling coefficient.(p q) is the sequence number of microprism in encoding array.If total total M microprism then can obtain superimposed with same number of subimage and coded image that form.Fig. 9 represents is the coded image after 81 stacks of totally 5 * 5 width of cloth subimages on the image planes 8.
Digital Image Processing:
There are many methods of from coded image, recovering the 3-D view of the original, mainly contain the liftering method, the Wiener filtering method, the deconvolution method, global optimization method and correlation filtering method, how much back projections add [consulting technology 3 formerly] such as condition judgment methods, diverse ways has different relative merits.Can select as the case may be.Present embodiment is that example introduces how to handle the coded digital image simply with the correlation filtering method here.The Digital Image Processing process flow diagram as shown in figure 10, at first select the matching and decoding function or lose the matching and decoding function according to microprism encoding array function, the matching and decoding function is exactly the encoding array function, and losing the matching and decoding function then is that numerical value in the coding function " 0 " is changed into " 1 " (flow process 11).Select magnification for decoding functions afterwards; Calculating magnification must first given object distance, can roughly estimate the vertical depth range of object in the space according to anticipatory knowledge earlier; The a series of depth value of the selection of discretize in this scope, the magnification (flow process 12) of calculating imaging system.Next according to given magnification convergent-divergent after decoding functions and coded digital figure make related operation (flow process 13).The image that obtains comprises the image information of object and the picture noise that decoding not exclusively brings.Next step is exactly with the noise (flow process 14) in the suitable denoise algorithm removal image.For uniform ground unrest simply subtraction cut picture noise, and can adopt the method for iteration filtering to get rid of for the noise of complexity.Calculate the effective coverage of subject image and the degree of depth (flow process 15) of this one deck of record object afterwards.Repeat flow process 12-flow process 16, the picture on all degree of depth levels of object is all decoded to come out.Last work is to utilize the tomography image that all these decodings obtain image fusion technology to be fused into the 3 D stereo reconstructed image of object, obtains object degree of depth pattern (flow process 17) simultaneously.

Claims (4)

1, a kind of optical imagery distance measuring equipment of single aperture multiple imaging, it is characterized in that: comprise imaging main lens (2) successively with optical axis ground, multiple imaging element (3), field lens (4) and photodetector (5), the output termination Digital Image Processor (6) of this photodetector (5), described imaging main lens (2) is close together with multiple imaging element (3), described Digital Image Processor (6) has the digital picture that is used for handling by photodetector (5) sampling, extract the data processing software of the depth information of object, described multiple imaging element (3) is microprism array (31), and integrally place on the pupil plane of imaging system, described microprism array (31) is arranged evenly at locational one dimension of a series of grids or two-dimentional microprism array according to certain rule by a plurality of microprisms (311):
Promptly on pupil plane, place microprism (311) according to fixing in advance spacing arrangement, and the drift angle of each single microprism (311) is determined according to the parameter of imaging system and the position of microprism, is non-overlapping regularly arranged to ensure each single microprism (311) between the single picture that is become on the image planes;
Or described microprism array (31) is by aperture coded system arranged distribution, promptly according to aperture coded imaging principle, arrange the arrangement of microprism (311) according to the aperture coded system, spacing between each microprism (311) is given by coding function, the drift angle of each single microprism (311) is determined according to the position of imaging system parameter and microprism, forms the aperture coded image as being superimposed at last to ensure the list that each single microprism (311) is become on image planes.
2, the optical imagery distance measuring equipment of single aperture multiple imaging according to claim 1 is characterized in that described imaging main lens (2) is made of a biconvex lens, and described multiple imaging element (3) is close to imaging main lens (2) afterwards.
3, the optical imagery distance measuring equipment of single aperture multiple imaging according to claim 1, it is characterized in that described imaging main lens (2) is made of two relative plano-convex lenss (21,22) in plane, described multiple imaging element (3) is placed between two plano-convex lenss (21,22) of being close to.
4, the optical imagery distance measuring equipment of single aperture multiple imaging according to claim 1 is characterized in that described microprism array (31) is a circular array, or rectangular array.
CNB2006101184309A 2006-11-17 2006-11-17 The optical imagery distance measuring equipment of single aperture multiple imaging Expired - Fee Related CN100538264C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006101184309A CN100538264C (en) 2006-11-17 2006-11-17 The optical imagery distance measuring equipment of single aperture multiple imaging

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006101184309A CN100538264C (en) 2006-11-17 2006-11-17 The optical imagery distance measuring equipment of single aperture multiple imaging

Publications (2)

Publication Number Publication Date
CN1959341A CN1959341A (en) 2007-05-09
CN100538264C true CN100538264C (en) 2009-09-09

Family

ID=38071151

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006101184309A Expired - Fee Related CN100538264C (en) 2006-11-17 2006-11-17 The optical imagery distance measuring equipment of single aperture multiple imaging

Country Status (1)

Country Link
CN (1) CN100538264C (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130201297A1 (en) * 2012-02-07 2013-08-08 Alcatel-Lucent Usa Inc. Lensless compressive image acquisition
CN102891956A (en) * 2012-09-25 2013-01-23 北京理工大学 Method for designing compression imaging system based on coded aperture lens array
CN103033166B (en) * 2012-12-13 2015-06-10 南京航空航天大学 Target ranging method based on synthetic aperture focused images
CN103491296B (en) * 2013-07-30 2016-05-25 宁波迪吉特电子科技发展有限公司 A kind of implementation method of high-speed camera
CN103411563B (en) * 2013-09-06 2016-01-13 南开大学 A kind of acquisition methods of three-dimensional information and system
CN104864849B (en) 2014-02-24 2017-12-26 电信科学技术研究院 Vision navigation method and device and robot
CN104035098A (en) * 2014-06-19 2014-09-10 仲炳华 Light-diffusing-type light distance measuring instrument
EP3182697A1 (en) * 2015-12-15 2017-06-21 Thomson Licensing A method and apparatus for correcting vignetting effect caused on an image captured by lightfield cameras
CN107741644A (en) * 2017-11-21 2018-02-27 杭州加速云信息技术有限公司 A kind of imaging device for different visual angles imaging
US10609361B2 (en) * 2018-06-29 2020-03-31 Semiconductor Components Industries, Llc Imaging systems with depth detection
CN110873869B (en) * 2018-08-31 2022-03-11 北京小米移动软件有限公司 Proximity sensor, display screen display body and terminal
CN109859127A (en) * 2019-01-17 2019-06-07 哈尔滨工业大学 Object phase recovery technology based on code aperture

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4488795A (en) * 1982-09-13 1984-12-18 Winnek Douglas Fredwill Camera for three-dimensional portraiture
US5076687A (en) * 1990-08-28 1991-12-31 Massachusetts Institute Of Technology Optical ranging apparatus
US5703677A (en) * 1995-11-14 1997-12-30 The Trustees Of The University Of Pennsylvania Single lens range imaging method and apparatus
CN201043890Y (en) * 2006-11-17 2008-04-02 中国科学院上海光学精密机械研究所 Single-bore diameter and multi-imaging optical imaging range unit

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4488795A (en) * 1982-09-13 1984-12-18 Winnek Douglas Fredwill Camera for three-dimensional portraiture
US5076687A (en) * 1990-08-28 1991-12-31 Massachusetts Institute Of Technology Optical ranging apparatus
US5703677A (en) * 1995-11-14 1997-12-30 The Trustees Of The University Of Pennsylvania Single lens range imaging method and apparatus
CN201043890Y (en) * 2006-11-17 2008-04-02 中国科学院上海光学精密机械研究所 Single-bore diameter and multi-imaging optical imaging range unit

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
一种基于编码孔径成像原理的三维成像方法. 郎海涛,刘立人,阳庆国.光学学报,第26卷第1期. 2006 *
图像深度估计的光学微分方法. 阳庆国,刘立人,郎海涛.光学学报,第25卷第9期. 2005 *
机器视觉中的微分测距方法研究. 阳庆国,刘立人,郎海涛,朱勇建,鲁伟.激光与光电子学进展,第43卷第4期. 2006 *

Also Published As

Publication number Publication date
CN1959341A (en) 2007-05-09

Similar Documents

Publication Publication Date Title
CN201043890Y (en) Single-bore diameter and multi-imaging optical imaging range unit
CN100538264C (en) The optical imagery distance measuring equipment of single aperture multiple imaging
US7612870B2 (en) Single-lens aperture-coded camera for three dimensional imaging in small volumes
Adelson et al. Single lens stereo with a plenoptic camera
CN103471715B (en) A kind of light path combined type light field spectrum imaging method and device altogether
Cho et al. Three-dimensional optical sensing and visualization using integral imaging
CN101426085B (en) Imaging arrangements and methods therefor
US8290358B1 (en) Methods and apparatus for light-field imaging
KR20190076998A (en) Apparatus and method for obtaining distance information from a view
US20080279446A1 (en) System and technique for retrieving depth information about a surface by projecting a composite image of modulated light patterns
US20060209193A1 (en) Aperture coded camera for three dimensional imaging
CN101794461B (en) Three-dimensional modeling method and system
CN103363924A (en) Compressing three-dimension calculation ghost imaging system and method
JP2009300268A (en) Three-dimensional information detection device
CN104463949A (en) Rapid three-dimensional reconstruction method and system based on light field digit refocusing
CN102203551A (en) Method and system for providing three-dimensional and range inter-planar estimation
KR20090107536A (en) Method and apparatus for quantitative 3-d imaging
CN102461186A (en) Stereoscopic image capturing method, system and camera
CN102997891A (en) Device and method for measuring scene depth
CN103582846A (en) Depth estimation imaging device
CN109883391A (en) Monocular distance measuring method based on microlens array digital imagery
CN102088617B (en) A three-dimensional imaging apparatus and a method of generating a three-dimensional image of an object
KR20180054622A (en) Apparatus and method for calibrating optical acquisition system
JP2011182237A (en) Compound-eye imaging device, and image processing method in the same
CN103033166B (en) Target ranging method based on synthetic aperture focused images

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090909

Termination date: 20121117