CN103037236A - Image processing method and apparatus - Google Patents
Image processing method and apparatus Download PDFInfo
- Publication number
- CN103037236A CN103037236A CN2012102999961A CN201210299996A CN103037236A CN 103037236 A CN103037236 A CN 103037236A CN 2012102999961 A CN2012102999961 A CN 2012102999961A CN 201210299996 A CN201210299996 A CN 201210299996A CN 103037236 A CN103037236 A CN 103037236A
- Authority
- CN
- China
- Prior art keywords
- image processing
- parallax information
- pixel
- image data
- input image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The present invention provides image processing method and apparatus based on parallax error information, wherein the image processing method comprises the steps of obtaining parallax error information, and executing image processing operation on input image data according to the parallax error information, in order to generate output image data. According to the technical scheme, the image processing method and apparatus can perform image processing on the input image data through using the parallax error information, thereby enabling the output image data to have better visual effect.
Description
Technical field
The present invention relates in particular to a kind of image processing method based on parallax information and relevant apparatus relevant for a kind of image processing techniques.
Background technology
Along with the development of Display Technique, the user pursues third dimension by force more and more real image shows, rather than high-quality image.Have two kinds in the prior art 3D(three-dimensional be provided) technology that shows of video.A kind of is to use a 3D display unit, this 3D display unit and glasses (such as, shutter glasses (shutter glasses)) the cooperation use, another kind is directly to use the 3D display unit, this 3D display unit need not used glasses.No matter which kind of technology has been used, and the main theory that 3D rendering shows is to make left eye and right eye see different images, so that the different images that brain will be seen from two eyes is as a 3D rendering.Traditional 3D shows that design directly shows original left-eye image and eye image, and the left-eye image that this is original and eye image are provided by a 3D video source.Yet before original left-eye image and eye image were presented on the 3D display unit, if original left-eye image and right eye figure are processed, to strengthen the 3D visual effect, the user can have better 3D visual experience.
Generally speaking, in order to watch this 3D rendering, the user need to have the 3D video play device, such as a 3D TV.If the user has typical 2D (two-dimensional) display unit, 2D TV for example, even video input is provided by a 3D video source, the user also can only obtain the 2D visual experience.For example, the left-eye image or the eye image that are only provided by the 3D video source are presented on the 2D TV.Traditional 2D shows that the original left-eye image/eye image that is provided by the 3D video source directly is provided in design.Similar, if in the original left-eye image/eye image that is provided by the 3D video source before the 2D TV shows, this original left-eye image/eye image is processed to strengthen the 2D visual effect, the user can have better 2D visual experience.
So, a kind of new image processing method case of demand, output image is processed and produced to this image processing method case to this 2D/3D display unit, to strengthen the 2D/3D visual effect, so that the user has better 2D/3D visual experience by input picture being carried out image.
Summary of the invention
The invention provides a kind of image processing method based on parallax information and device, to solve the problems of the technologies described above.
An aspect of of the present present invention provides a kind of image processing method, and this image processing method comprises: obtain parallax information; And according to this parallax information input image data is carried out an image processing operations, to produce output image data.
The present invention provides a kind of image processing apparatus on the other hand, and this image processing apparatus comprises: a parallax information Acquisition Circuit and an image processing circuit, this parallax information Acquisition Circuit are used for obtaining parallax information.This image processing circuit and this parallax information Acquisition Circuit couple, and are used for processing input image data according to this parallax information, to produce output image data.
Above-mentioned image processing method and image processing apparatus are processed by using parallax information that input image data is carried out image, so that the output image data that produces can bring better visual effect.
Description of drawings
The schematic diagram of the image processing apparatus that Fig. 1 provides for one embodiment of the invention;
Fig. 2 is the schematic diagram of the first embodiment of the parallax information Acquisition Circuit among Fig. 1;
Fig. 3 is the schematic diagram of the second embodiment of the parallax information Acquisition Circuit among Fig. 1;
Fig. 4 is a kind of schematic diagram that produces parallax information;
Fig. 5 is the another kind of schematic diagram that produces parallax information;
The schematic diagram based on the first embodiment of the image processing operations of parallax that Fig. 6 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the second embodiment of the image processing operations of parallax that Fig. 7 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 3rd embodiment of the image processing operations of parallax that Fig. 8 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 4th embodiment of the image processing operations of parallax that Fig. 9 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 5th embodiment of the image processing operations of parallax that Figure 10 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 6th embodiment of the image processing operations of parallax that Figure 11 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 7th embodiment of the image processing operations of parallax that Figure 12 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 8th embodiment of the image processing operations of parallax that Figure 13 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 9th embodiment of the image processing operations of parallax that Figure 14 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the tenth embodiment of the image processing operations of parallax that Figure 15 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 11 embodiment of the image processing operations of parallax that Figure 16 is that image processing circuit 104 is carried out among Fig. 1.
Embodiment
Employed particular term refers to specific element in embodiment and the claims.One skilled in the art will appreciate that the manufacturer can use different names to an element.The application does not adopt different names to distinguish element with element, but distinguishes element with the difference of interelement function.In following embodiment and claim, term " comprises " and " comprising " is an open restriction, should be understood as that " including but not limited to ".Term " couples " and should be understood to directly or indirectly be electrically connected.Accordingly, if a device is electrically connected to another device, this connection can be a directly electrical connection, also can be by adopting one of other devices or connection indirectly to be electrically connected.
Main concept of the present invention be receive multi-view image (such as, comprise the stereo-picture that a plurality of images are right, wherein, each image is to having a left-eye image and an eye image), and strengthen an image that has received according to other images that receive.Specifically, the present invention proposes by reference parallax information (disparity information) input picture is carried out the image processing, thereby produce the output image of the picture quality with enhancing.According to parallax information, with one or more image process/the adjustment scheme adjusts the pixel in the input picture.By this way, when output image was presented on the display unit, the user had better visual experience.Following implementation details of the present invention will be described.
Fig. 1 is according to the image processing apparatus schematic diagram shown in one embodiment of the invention, this exemplary image processing apparatus 100 includes but not limited to: a parallax information Acquisition Circuit (disparity information acquisition circuit) 102, one image processing circuit, 104, one receiving circuits 106 and an output circuit 108.This parallax information Acquisition Circuit 102 is used for obtaining parallax information DI.This receiving circuit 106 is used for receiving multi-view image IMG
0-IMG
N, and for example provide input image data IMG_IN(, an input picture in the multi-view image of this reception) to image processing circuit 104.Image processing circuit 104 couples with parallax information Acquisition Circuit 102 and receiving circuit 106, and be used for processing input image data IMG_IN according to parallax information DI, and for example produce accordingly output image data IMG_OUT(, by the output image of processing one or more enhancing that an input picture obtains).Output circuit 108 couples with image processing circuit 104, and plays to a display unit 101 for sending output image data IMG_OUT.Briefly, image processing circuit 104 decides how to adjust the picture quality of this input image data IMG_IN to obtain to strengthen with reference to parallax information DI.
Fig. 2 is the schematic diagram of the first embodiment of parallax information Acquisition Circuit 102 among Fig. 1.As shown in the figure, this parallax information Acquisition Circuit 102 is parts of receiving interface (receiving interface) 202.So this parallax information DI that is provided by an external device (ED) (not shown) with disparity computation ability is provided this parallax information Acquisition Circuit 102, and provide the parallax information DI of this reception to arrive this image processing circuit 104.For example, this parallax information DI can comprise the difference vector (disparity vectors) of corresponding a plurality of pixels, as shown in Figure 2.Yet the record format of this parallax information DI is only for reference, is not limitation of the present invention.That is to say, this parallax information DI can use any can by the form of image processing circuit 104 understanding/support record.So by reference parallax information DI, this image processing circuit 104 can easier be known a parallax value of each pixel that will process.
Fig. 3 is the schematic diagram of the second embodiment of parallax information Acquisition Circuit 102 among Fig. 1.As shown in the figure, receiving circuit 106 also is couple to this parallax information Acquisition Circuit 102.So this parallax information Acquisition Circuit 102 obtains this parallax information DI by processing image, this image is the multi-view image IMG that receiving system 106 receives
0-IMG
NIn image.In other words, this parallax information Acquisition Circuit 102 disposes the disparity computation ability, and is used for computed image treatment circuit 104 needed parallax information DI.
Desirable parallax information can by from two or more the more the visual angle image calculate.Consider such a case, multi-view image IMG
0-IMG
NComprise a left-eye image and an eye image.For example, use different video cameras to catch simultaneously a left-eye image and an eye image.This parallax information Acquisition Circuit 102 is processed the image pair that comprises a left-eye image and an eye image, to obtain parallax information DI.Please refer to Fig. 4, Fig. 4 one produces an exemplary schematic diagram of parallax information.One among image I MG_1 and the IMG_2 is left-eye image, another eye image.Step 402, pixel among the parallax information Acquisition Circuit 102 movement images IMG_1 and the pixel among the image I MG_2, and determine parallax according to the pixel displacement (pixel displacement) of the pixel that is complementary of in image I MG_1 and IMG_2, finding respectively.Wherein, certain pixel in image does not have the pixel of coupling among possible image I MG_1 and the IMG_2 in another image in image I MG_1 and IMG_2.Step 404(optional step), definite pixel parallax that does not have the pixel of coupling for example, is carried out interpolation (interpolation) based on the parallax value of a plurality of neighbor pixels.In step 402, perhaps after step 402 and the step 404, parallax information Acquisition Circuit 102 has obtained the hypothetical parallax information that follow-up image processing circuit 104 needs, at least one image among image processing circuit 104 follow-up uses this hypothetical parallax information processing image I MG_1 and the IMG_2.
Consider another kind of situation, multi-view image IMG
0-IMG
NComprise the image more than two.For example, single camera is at the image of the corresponding different visual angle of different time point shootings.So three of the visual angle that 102 processing of parallax information Acquisition Circuit are corresponding different with epigraph (comprising three images), to obtain parallax information DI.Please refer to Fig. 5, Fig. 5 shows another example that parallax information produces.For clear and succinct, Fig. 5 only illustrates three image I MG_1, IMG_2 and IMG_3.Wherein, the visual angle that image I MG_1, IMG_2 and IMG_3 are corresponding different, such as, visual angle, left side image, middle visual angle image (middle view), and visual angle, the right image.In this embodiment, step 502, parallax information Acquisition Circuit 102 compares the pixel among the pixel among the image I MG_1 and the image I MG_2, determines parallax according to the pixel displacement of the pixel that is complementary among image I MG_1 and the image I MG_2.As mentioned above, a certain pixel in image does not have matched pixel in another image among possible image I MG_1 and the IMG_2 in image I MG_1 and IMG_2.Step 504(optional step), determine not have the pixel parallax of matched pixel, for example, with reference to the parallax information by using image I MG_2 and IMG_3 to find.After step 502 or step 502 and step 504, parallax information Acquisition Circuit 102 has obtained the hypothetical parallax information that follow-up image processing circuit 104 needs, at least one image among this hypothetical parallax information processing image I of image processing circuit 104 follow-up uses MG_1, IMG_2 and the IMG_3.
In above Fig. 4 and embodiment shown in Figure 5, only usage space information is determined parallax information, and this spatial information is by utilizing the different visual angles image to obtain.Optionally, also can utilize temporal information (temporal information) to determine that parallax information, this temporal information are to obtain by the different images that utilizes same view angle.In an optional design, use a plurality of multi-view images to determine temporal information and spatial information, determine parallax information according to this temporal information and spatial information, realize obtaining the order ground of parallax information with this.
After receiving the parallax information that is produced by parallax information Acquisition Circuit 102, image processing circuit 104 is processed input image data IMG_IN according to parallax information DI, to produce output image data IMG_OUT.Suppose that display unit 101 is 2D display unit, and obtain multi-view image IMG from a 3D video input
0-IMG
N, the image processing circuit 104 among Fig. 1 produces accordingly one or more 2D output image and plays to be used for 2D to display unit 101 for an image of processing according to parallax information DI among Fig. 4 image I MG_1 and the IMG_2.For example, according to an image among parallax information DI processing image I MG_1 and the IMG_2, can obtain the GIF image (animated GIF image) of animation, and it is presented on the 2D display unit, export to the user thereby present a similar 3D rendering.Similar, about exemplary disparity computation example shown in Figure 5, image processing circuit 104 is used for processing a image among Fig. 5 image I MG_1 and the IMG_2 according to parallax information DI, and produces accordingly one or more 2D output image and play to be used for 2D to display unit 101.One in direct demonstration stereo-picture/multi-view image to this traditional design of 2D display unit, and the image of this image processing apparatus 100 by one or more enhancing of output can strengthen 2D picture quality to this display unit 101.As follows, with the several examples of Description Image treatment circuit 104 execution based on the image processing operations of parallax.
The first embodiment based on the image processing operations of parallax that Fig. 6 shows that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used for the parallax value of wanting processed pixel P for example according to parallax information DI() obtain a target kernel filters (target kernel filter) 602, then by an adjustment unit (a for example multiplier (multiplier) 604) this target kernel filters is applied to one or more pixel of input image data IMG_IN.In this embodiment, the size of target kernel filters is 5x5.So graphics processing unit 104 is for example wanted the parallax value of processed this pixel P with reference to parallax information DI(), calculate the coefficient (coefficient) of target kernel filters 602.Then, 5 * 5 interval 606 of input image data IMG_IN interior pixels are used target kernel filters 602, wherein, the center in 5 * 5 intervals 606 is to want processed pixel P.Target kernel filters 602 definite pixel values are distributed to the pixel P of output image data IMG_OUT.
Need to prove, the size of target kernel filters 602 is not limited to 5 * 5.In practice, the size of target kernel filters 602 is adjustable, and it relies on actual design and considers/need.In other words, the size of target kernel filters 602 is M * M, and wherein, M is any positive integer.For example, the size of target kernel filters 602 is 3 * 3, and to satisfy the needs of an application, the size of target kernel filters 602 is 7 * 7, to satisfy the needs of Another application.
In an exemplary design, can be sharp filtering device (sharpness filter) by the target kernel filters 602 that can be used for a certain pixel of image processing circuit 104 dynamic calculation.So when image information DI indication wanted processed pixel P to have a larger parallax value, image processing circuit 104 produced a more clearly filtering output.
In another exemplary design, can be fuzzy filter (blur filter) by the target kernel filters 602 of image processing circuit 104 dynamic calculation.So when image information DI indication wanted processed pixel P to have the difference of neglecting, image processing circuit 104 produced a relatively fuzzyyer filtering output.
The second embodiment based on the image processing operations of parallax that Fig. 7 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used for the parallax value of wanting processed pixel P for example according to the parallax information DI(of each pixel) obtain to be used for the target kernel filters (target kernel filter) 703 of this pixel, then by multiplier (multiplier) 604 this target kernel filters is applied to one or more pixel of input image data IMG_IN.Fig. 6 and main difference embodiment illustrated in fig. 7 are: the image processing circuit 104 among Fig. 7 is configured further to comprise a plurality of predefined kernel filters 701_1,701_2 ... 701_N and a selected cell 702.Selected cell 702 is used for selecting predefined kernel filters 701_1,701_2 with reference to parallax information DI (parallax value of pixel P that for example will be processed) ... one among the 701_N as the target kernel filters.Similarly, as shown in Figure 7, each predefined kernel filters 701_1,701_2 ... the size of 701_N is 5 * 5.So target kernel filters 702 is used to the pixel in 5 * 5 intervals 606, wherein, pixel P is the center in this 5 * 5 interval 606.Then, target kernel filters 703 definite pixel values will be assigned to the pixel P among the output image data IMG_OUT.
Need to prove each predefined kernel filters 701_1,701_2 ... the size of 701_N is not limited to 5 * 5.In practice, the size of predefined kernel filters is adjustable, and it relies on actual design and considers/need.In other words, each predefined kernel filters 701_1,701_2 ... the size of 701_N is M * M, and wherein, M is any positive integer.For example, each predefined kernel filters 701_1,701_2 ... the size of 701_N is 3 * 3, to satisfy the needs of an application, each predefined kernel filters 701_1,701_2 ... the size of 701_N is 7 * 7, to satisfy the needs of Another application.
In an exemplary design, predefined kernel filters 701_1,701_2 ... 701_N can be the sharp filtering device (sharpness filter) with different sharpening grades.So when image information DI indication wanted processed pixel P to have a larger parallax value, image processing circuit 104 produced a more clearly filtering output.
In another exemplary design, predefined kernel filters 701_1,701_2 ... 701_N can be the fuzzy filter (blur filter) with different fuzzy class.So, to want processed pixel P when image information DI indication and have one when neglecting difference, image processing circuit 104 produces a relatively fuzzyyer filtering output.
In another exemplary design, predefined kernel filters 701_1,701_2 ... 701_N can comprise sharp filtering device and fuzzy filter, and wherein, the sharp filtering utensil has different sharpening grades, and fuzzy filter has different fuzzy class.So parallax value determined for pixel P to be processed, which sharp filtering device or fuzzy filter will be selected as the target kernel filters.
The 3rd embodiment based on the image processing operations of parallax that Fig. 8 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used to each pixel of input image data IMG_IN is carried out the color adjustment.Specifically, each pixel comprises a plurality of color component value, the corresponding a plurality of different Color Channels of these a plurality of color component value (such as, red (R), green (G) and blue (B) passage).In this embodiment, image processing circuit 104 can comprise a plurality of adjustment units 801,802 and 803 that are configured in different color channels, and optionally adjust at least one in a plurality of color component value with reference to parallax information DI (parallax value of pixel P that for example, be processed).Then, adjustment unit 801,802 and 803 color component value of determining are distributed to the pixel P among the output image data IMG_OUT.
The 4th embodiment based on the image processing operations of parallax that Fig. 9 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used to each pixel of input image data IMG_IN is carried out saturation (saturation) adjustment and brightness (brightness) adjustment.Specifically, each pixel among the input image data IMG_IN comprises a plurality of color component value, a plurality of different Color Channel in corresponding the first color space of these a plurality of color component value difference (such as, red (R), green (G) and blue (B) passage).In this embodiment, image processing circuit 104 can comprise a plurality of adjustment units 901,902,903, and a plurality of converting unit (converting units) 904,905.Converting unit 904 be used for the corresponding different color channels of the first color space (such as, red (R), green (G) and blue (B) passage) color component value be transformed into corresponding a plurality of different Color Channels in the second color space (such as, Y, U and V passage) color component value.Adjustment unit 901-903 is configured on the different Color Channel of the second color space, and optionally adjusts at least one in a plurality of color component value with reference to parallax information DI (parallax value of pixel P that for example, be processed).Then, converting unit 905 is transformed into the color component value in the first color space with adjustment unit 901,902 and 903 color component value that produce.To be assigned to the pixel P among the output image data IMG_OUT by adjustment unit 901,902 and 903 color component value definite and that be converted unit 905 conversions.
In an exemplary design, this image processing circuit 104 can be used for adjusting the saturation (saturation) of pixel P.So, when parallax information DI indicates pixel P to be processed to have larger parallax value, this image processing circuit 104 is by carrying out the saturation that the saturation adjustment increases pixel P in the second color space, and/or, have less parallax value when parallax information DI indicates pixel P to be processed, this image processing circuit 104 is by carrying out the saturation that the saturation adjustment reduces pixel P in the second color space.Specifically, larger for the parallax information of a certain pixel of this input image data, the saturation of this pixel after then adjusting is larger; Parallax information for a certain pixel of this input image data is less, and the saturation of this pixel after then adjusting is less.Such as, can pre-configured parallax information and the mapping table of saturation coefficient, in this table, parallax information is larger, and then the saturation coefficient is larger, parallax information is less, then the saturation coefficient is less, and image processing circuit 104 finds its corresponding saturation coefficient according to the parallax information of certain pixel, the saturation coefficient that finds and the former saturation of this pixel are multiplied each other, obtain the saturation of this pixel in the output image data.Perhaps, when for the parallax information of certain pixel during greater than the first predetermined value, image processing operations increases the saturation of this pixel, specifically can be, this image processing circuit 104 is by carrying out the saturation that the saturation adjustment increases pixel P in the second color space; When for the parallax information of certain pixel during less than the second predetermined value, this image processing operations reduces the saturation of this pixel, specifically can be that this image processing circuit 104 is by carrying out the saturation that the saturation adjustment reduces pixel P in the second color space.Wherein, the first predetermined value can be greater than or equal to the second predetermined value.
In another exemplary design, this image processing circuit 104 can be for the brightness (brightness) of adjusting pixel P/intensity (intensity).So, when indicating pixel P to be processed, parallax information DI has larger parallax value, this image processing circuit 104 is by carrying out the brightness that the brightness/intensity adjustment increases pixel P in the second color space, and/or, when parallax information DI indicated pixel P to be processed to have to neglect difference, this image processing circuit 104 was by carrying out the brightness that the brightness/intensity adjustment reduces pixel P in the second color space.Specifically, larger for the parallax information of a certain pixel of this input image data, the brightness of this pixel after then adjusting is larger; Parallax information for a certain pixel of this input image data is less, and the brightness of this pixel after then adjusting is less.Such as, can pre-configured parallax information and the mapping table of luminance factor, in this table, parallax information is larger, and then luminance factor is larger, parallax information is less, then luminance factor is less, and image processing circuit 104 finds its corresponding luminance factor according to the parallax information of certain pixel, the luminance factor that finds and the former brightness of this pixel are multiplied each other, obtain the brightness of this pixel in the output image data.Perhaps, when for the parallax information of certain pixel during greater than the first predetermined value, image processing operations increases the brightness of this pixel, specifically can be, this image processing circuit 104 is by carrying out the brightness that brightness adjustment increases pixel P in the second color space; When for the parallax information of certain pixel during less than the second predetermined value, this image processing operations reduces the brightness of this pixel, specifically can be that this image processing circuit 104 is by carrying out the brightness that brightness adjustment reduces pixel P in the second color space.Wherein, the first predetermined value can be greater than or equal to the second predetermined value.
The 5th embodiment based on the image processing operations of parallax that Figure 10 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 comprises a contrast adjustment unit 1002, and this contrast adjustment unit 1002 is used for according to parallax information DI, and the pixel among the input image data IMG_IN is carried out contrast (contrast) adjustment.When parallax information DI has indicated when wanting processed pixel to have larger parallax value, contrast adjustment unit 1002 has increased the contrast of pixel P, and/or, when parallax information DI has indicated when wanting processed pixel to have to neglect difference, contrast adjustment unit 1002 has reduced the contrast of pixel P.Specifically, larger for the parallax information of a certain pixel of this input image data, the contrast of this pixel after then adjusting is larger; Parallax information for a certain pixel of this input image data is less, and the contrast of this pixel after then adjusting is less.Such as, can pre-configured parallax information and the mapping table of contrast rating, in this table, parallax information is larger, and then contrast rating is larger, parallax information is less, then contrast rating is less, and contrast adjustment unit 1002 finds its corresponding contrast rating according to the parallax information of certain pixel, the contrast rating that finds and the former contrast of this pixel are multiplied each other, obtain the contrast of this pixel in the output image data.Perhaps, when for the parallax information of certain pixel during greater than the first predetermined value, image processing operations increases the contrast of this pixel, and when for the parallax information of certain pixel during less than the second predetermined value, this image processing operations reduces the contrast of this pixel.Wherein, the first predetermined value can be greater than or equal to the second predetermined value.
The 6th embodiment based on the image processing operations of parallax that Figure 11 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used the gamma curve adjustment according to parallax information DI to each pixel among the input image data IMG_IN.In this embodiment, image processing circuit 104 is according to parallax information DI, obtain a target gamma curve 1103 for pixel P, and use an adjustment unit (such as, multiplier (multiplier) 1104) that this target gamma curve 1103 is applied to this pixel P.More particularly, image processing circuit 104 further comprises a plurality of predefined gamma curve 1101_1,1101_2 ... 1101_N and a selected cell 1102.Selected cell 1102 with reference to parallax information DI(such as, the parallax value of pixel P to be processed) select predefined gamma curve 1101_1,1101_2 ... one among the 1101_N as target gamma curve 1103.Then, will distribute to pixel P among the output image data IMG_OUT by the pixel values that target gamma curve 1103 is determined.
The 7th embodiment based on the image processing operations of parallax that Figure 12 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 comprises a tone (tone) map unit 1202, and this tone mapping unit 1202 is used for carrying out the dynamic range adjustment according to parallax information DI.More particularly, when parallax information DI has indicated when wanting processed pixel to have larger parallax value, tone mapping unit 1202 has increased the dynamic range of pixel P, and/or, when parallax information DI has indicated when wanting processed pixel to have to neglect difference, tone mapping unit 1202 has reduced the dynamic range of pixel P.For example, when tone mapping unit 1202 uses a high dynamic range, the pixel value in a particular pixel values scope will be mapped to the pixel value in the relatively large pixel value scope; When tone mapping unit 1202 uses one during than low-dynamic range, the pixel value in this particular pixel values scope will be mapped to the pixel value in the pixel value scope of a less.Wherein, when this parallax information during greater than the first predetermined value, this image processing operations increases by a dynamic range, and when this parallax information during less than the second predetermined value, this image processing operations reduces this dynamic range; Wherein the first predetermined value is greater than or equal to the second predetermined value.This dynamic range can represent the color gamut of pixel.Perhaps, this parallax information is larger, and the dynamic range of the target tone mapping that obtains is larger; This parallax information is less, and the dynamic range of the target tone mapping that obtains is less.
The 8th embodiment based on the image processing operations of parallax that Figure 13 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 comes each pixel among the mobile input image data IMG_IN with reference to parallax information DI.In this embodiment, image processing circuit 104 comprises a computing unit 1302 and a pixel mobile unit 1304.This computing unit 1302 according to parallax information DI(for example is used for the parallax value of pixel P) and the mobile range of the first parameter S 1 of expression moving range pixel P of determining to want processed.For example, this moving range is limited by minimum mobile range M_MIN and maximum mobile range M_MAX, wherein, if the corresponding minimum parallax value V_MIN(V=V_MIN of minimum mobile range M_MIN then M=M_MIN), and if the corresponding maximum disparity value V_MAX(V=V_MAX of maximum mobile range M_MAX then M=M_MAX).So, when the parallax value of the pixel P that is placed on position (X1, Y1) is that V(V_MIN<V<V_MAX), then the mobile range M of pixel P can determine by using following equation:
So when parallax information DI has indicated pixel P to have larger parallax value V, computing unit 1302 will make mobile range M increase, and/or when parallax information DI has indicated pixel P to have to neglect difference V, computing unit 1302 will make mobile range M diminish.That is to say, larger for the parallax information of a certain pixel of this input image data, then the mobile range of this pixel is larger; Parallax information for a certain pixel of this input image data is less, and then the mobile range of this pixel is less.
One optionally in the design, if the corresponding maximum disparity value V_MAX(V=V_MAX of minimum mobile range M_MIN then M=M_MIN), and if the corresponding minimum parallax value V_MIN(V=V_MIN of maximum mobile range M_MAX then M=M_MAX).So the mobile range M of pixel P can determine by following equation:
So when parallax information DI has indicated pixel P to have larger parallax value V, computing unit 1302 will make mobile range M less, and/or when parallax information DI has indicated pixel P to have to neglect difference V, computing unit 1302 will make mobile range M larger.That is to say, less for the parallax information of a certain pixel of this input image data, then the mobile range of this pixel is larger; Parallax information for a certain pixel of this input image data is larger, and then the mobile range of this pixel is less.
Pixel mobile unit 1304 couples with computing unit 1302, and is used for coming mobile pixel P according to the second parameter S 2 of mobile range M and an expression moving direction.As shown in figure 13, the pixel P that defines in output image data IMG_OUT is placed on position (X2, Y2), home position (X1, the Y1) difference that defines among itself and the input image data IMG_IN.In order to ensure each pixel in output image by pixel value of appropriate distribution, a feasible execution mode of pixel mobile unit 1304 is by according to mobile range information and moving direction information the pixel value in the input picture being carried out search/interpolation (search/interpolate), coming the pixel value of pixel in definite output image sequentially with a specific order (such as raster scan order (raster scan order)).For example, when determining to be placed on the position (X2 that defines among the output image data IMG_OUT, during the pixel value of pixel Y2), pixel mobile unit 1304 is with reference to mobile range M and by the moving direction of the second parameter S 2 expression, know and be placed on position (X1, Y1) pixel value of the pixel P on should be configured to be placed on the pixel value of the pixel on the position (X2, Y2).The purpose of the pixel P that has realized mobile position (X1, Y1) placement in input picture position (X2, Y2) in the output image.Consider a kind of situation, pixel mobile unit 1304 fails directly to find in input picture pixel value that the pixel value of the specific pixel in this output image is set, and this pixel mobile unit 1304 can calculate/determine the pixel value that algorithm is determined this specific pixel in this output image by interpolation or other.By this way, even one or more pixel in the input picture can be moved to new position in output image, can guarantee that also each pixel in the output image has pixel value.
Need to prove, the first parameter S 1 and the second parameter S 2 can be inputted by user-interactive (user interactive input) or the predefine parameter arranges.That is to say, moving range and moving direction can be by pre-defined or be controlled by the user.
The 9th embodiment based on the image processing operations of parallax that Figure 14 illustrates that image processing circuit among Fig. 1 104 carries out.Image processing circuit 104 uses gain adjustment according to parallax information DI to each pixel among the input image data IMG_IN.In this embodiment, image processing circuit 104 comprises that a yield value determines circuit 1402 and an adjustment unit 1404.This yield value determine circuit 1402 be used for reference to parallax information DI (such as, the parallax value of processed pixel P) come to determine yield value G for this pixel P.Adjustment unit 1404 is couple to yield value determining unit 1402, is used for yield value G is applied to pixel P, to adjust the pixel value of this pixel P.For example, adjustment unit 1404 realized by a multiplier, and the multiplied result of the pixel value of pixel P and yield value G is distributed to pixel P among the output image data IMG_OUT.
The tenth embodiment based on the image processing operations of parallax that Figure 15 illustrates that image processing circuit among Fig. 1 104 carries out.Graphics processing unit 104 uses skew to adjust (offset adjustment) according to parallax information DI to each pixel among the input image data IMG_IN.In this embodiment, image processing circuit 104 comprises a deviant determining unit 1502 and an adjustment unit 1504.This deviant determining unit 1502 be used for reference to parallax information DI (such as, the parallax value of processed pixel P) determine the deviant D of this pixel P.Adjustment unit 1504 is couple to deviant determining unit 1502, is used for deviant D is applied to pixel P, to adjust the pixel value of this pixel P.For example, utilize an adder (adder) to realize adjustment unit 1504, the addition result of the pixel value of pixel P and deviant D is distributed to the pixel P of output image data IMG_OUT.
The 11 embodiment based on the image processing operations of parallax that Figure 16 illustrates that image processing circuit among Fig. 1 104 carries out.Image processing circuit 104 comprises image object unit for scaling (image object scaling unit) 1602, and this image object unit for scaling is used for according to parallax information DI the image object of input image data IMG_IN being carried out convergent-divergent.So according to parallax information DI, the picture size of the image object in the output image of corresponding output image data IMG_OUT can be greater than or less than the picture size of identical image object in the input picture of corresponding input image data IMG_IN.For example, input picture comprises two image object OBJ1 and OBJ2.Have and neglect when poor when parallax information DI indicating image object OBJ1 has larger parallax and image object OBJ2, image object unit for scaling 1602 enlarges image object OBJ1 and downscaled images object OBJ2, so that the image object OBJ1 ' in the output image has a picture size that increases, the image object OBJ2 ' in the output image has a picture size that reduces.Briefly, because the size/resolution of the input picture of corresponding input image data IMG_IN is identical with the size/resolution of the output image of corresponding output image data IMG_OUT, according to the parallax situation of each image object that obtains from parallax information DI, the image object in the input picture will be emphasized or go to emphasize by image object unit for scaling 1602 in output image.
Need to prove, the above-mentioned exemplary executive mode based on the image processing operations of parallax of being carried out by the image processing circuit 104 among Fig. 1 of mentioning also can not need to take pixel as the basis.Optionally, the above-mentioned exemplary executive mode based on the image processing operations of parallax of being carried out by the image processing circuit 104 among Fig. 1 of mentioning can be adjusted take piece as the basis.For example, can with reference to the mean value of the parallax value of a middle pixel, determine the adjustment that the pixel value of all pixels in this piece is done.Simply be summarised as, so long as adjust input picture according to parallax information, just belong in the spiritual category of the present invention.
Consider another kind of situation, display unit 101 is 3D display unit, and obtains multi-view image IMG from a 3D video input
0-IMG
NCarried out by image processing circuit 104, can be with reference to parallax information DI based on the exemplary executive mode of the image processing operations of parallax, adjust in left-eye image and the eye image one or two, to strengthen the 3D display quality.
Although the present invention discloses as above with preferred embodiment; so it is not to limit the present invention, any those skilled in the art, without departing from the spirit and scope of the present invention; when can doing a little change and retouching, so protection scope of the present invention is when being as the criterion with claims.
Claims (52)
1. an image processing method is characterized in that, comprising:
Obtain parallax information; And
According to this parallax information input image data is carried out an image processing operations, to produce output image data.
2. image processing method according to claim 1 is characterized in that, further comprises:
Receive multi-view image;
The acquisition parallax information comprises:
Process this multi-view image, to obtain this parallax information.
3. image processing method according to claim 1 is characterized in that, further comprises:
Receive multi-view image, wherein in this multi-view image is as this input image data.
4. image processing method according to claim 3 is characterized in that, this multi-view image is from a 3D video input, and comprises a pair of image, and this comprises a left-eye image and an eye image to image, and this image processing method further comprises:
Export this output image data to a 2D display unit.
5. image processing method according to claim 1 is characterized in that, the step of carrying out this image processing operations comprises:
Obtain a target kernel filters according to this parallax information; And one or more pixel that this target kernel filters is applied to this input image data.
6. image processing method according to claim 5 is characterized in that, obtains this target kernel filters and comprises:
With reference to this parallax information, calculate the coefficient of this target kernel filters.
7. image processing method according to claim 5 is characterized in that, obtains this target kernel filters and comprises:
With reference to this parallax information, select in a plurality of predefined kernel filters one as this target kernel filters.
8. image processing method according to claim 5 is characterized in that, this target kernel filters is a sharp filtering device, and perhaps, this target kernel filters is a fuzzy filter.
9. image processing method according to claim 8 is characterized in that,
When this target kernel filters was the sharp filtering device, the parallax value that this parallax information represents was larger, and the filtering output that image processing operations produces is clearer.
10. image processing method according to claim 8 is characterized in that, when this target kernel filters was fuzzy filter, the parallax value that this parallax information represents was less, and the filtering output that image processing operations produces is fuzzyyer.
11. image processing method according to claim 1 wherein, is carried out this image processing operations and is comprised: carry out the color adjustment according to this parallax information.
12. image processing method according to claim 11 is characterized in that, this color adjustment is used for the saturation of one or more pixel of this input image data of adjustment.
13. image processing method according to claim 12, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases this saturation, when this parallax information during less than the second predetermined value, this image processing operations reduces this saturation;
Perhaps,
Parallax information is larger, and the saturation after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the saturation after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the saturation coefficient of the pixel in the input image data is larger;
Parallax information is less, and then the saturation coefficient of the pixel in the input image data is less;
Wherein, the saturation after this pixel adjustment in this input image data is that the former saturation of this pixel in saturation coefficient and this input image data multiplies each other.
14. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, adjust the brightness of one or more pixel of this input image data.
15. image processing method according to claim 14 is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases this brightness, and when this parallax information during less than the second predetermined value, this image processing operations reduces this brightness;
Perhaps,
Parallax information is larger, and the brightness after then the pixel in the input image data being adjusted is larger; Parallax information is less, and the brightness after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the luminance factor of the pixel in the input image data is larger;
Parallax information is less, and then the luminance factor of the pixel in the input image data is less;
Wherein, the brightness after this pixel adjustment in this input image data is that the former brightness of this pixel in luminance factor and this input image data is multiplied each other.
16. image processing method according to claim 1 is characterized in that, the carries out image processing operation comprises: according to this parallax information, adjust the contrast of one or more pixel of this input image data.
17. image processing method according to claim 16, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases this contrast, when this parallax information during less than the second predetermined value, this image processing operations reduces this contrast;
Perhaps,
Parallax information is larger, and the contrast after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the contrast after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the contrast rating of the pixel in the input image data is larger;
Parallax information is less, and then the contrast rating of the pixel in the input image data is less;
Wherein, the contrast after this pixel adjustment in this input image data is that the former contrast of this pixel in contrast rating and this input image data multiplies each other.
18. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, obtain a target gamma curve; And one or more pixel that this target gamma curve is applied to this input image data.
19. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, obtain a target tone mapping; And one or more pixel that this target tone mapping is applied to this input image data.
20. image processing method according to claim 19 is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases by a dynamic range, perhaps, when this parallax information during less than the second predetermined value, this image processing operations reduces this dynamic range;
Perhaps,
This parallax information is larger, and the dynamic range of the target tone mapping that obtains is larger; This parallax information is less, and the dynamic range of the target tone mapping that obtains is less.
21. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, one or more pixel of mobile this input image data.
22. image processing method according to claim 21 is characterized in that, one or more pixel of mobile this input image data comprises: according to this parallax information and one first parameter that represents a moving range, determine mobile range; And, according to this mobile range and one second parameter that represents a moving direction, one or more pixel of mobile this input picture.
23. image processing method according to claim 22, it is characterized in that, the step of one or more pixel of mobile this input image data comprises: by receiving user-interactive input or with reference to predefined parameter setting, this first parameter and the second parameter being set.
24. image processing method according to claim 22 is characterized in that,
Parallax information is larger, and then the mobile range of pixel is larger; Parallax information is less, and then the mobile range of pixel is less;
Perhaps,
Parallax information is larger, and then the mobile range of pixel is less; Parallax information is less, and then the mobile range of pixel is larger.
25. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, determine a yield value; And one or more pixel that this yield value is applied to this input image data.
26. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, determine a deviant; And one or more pixel that this deviant is applied to this input image data.
27. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, at least one image object in this input image data is carried out convergent-divergent.
28. an image processing apparatus is characterized in that, comprising:
One parallax information Acquisition Circuit is used for obtaining parallax information; And
One image processing circuit couples with this parallax information Acquisition Circuit, and is used for processing input image data according to this parallax information, to produce output image data.
29. image processing apparatus according to claim 28 is characterized in that, further comprises:
One receiving circuit couples with this parallax information Acquisition Circuit, is used for receiving multi-view image;
Wherein, this parallax information Acquisition Circuit obtains this parallax information by processing this multi-view image;
Perhaps,
One receiving circuit couples with this image processing circuit, and is used for receiving multi-view image, and wherein, an image in this multi-view image is as this input image data.
30. image processing apparatus according to claim 29 is characterized in that, this multi-view image is from a 3D video input, and comprises a pair of image, and this comprises a left-eye image and an eye image to image, and this image processing apparatus further comprises:
One output circuit is couple to this image processing circuit, is used for this output image data of output to a 2D display unit.
31. image processing apparatus according to claim 28, it is characterized in that, this image processing circuit has a target kernel filters, this target kernel filters is to obtain according to this parallax information, and this image processing circuit is applied to one or more pixel in this input image data with this target kernel filters.
32. image processing apparatus according to claim 31 is characterized in that,
This image processing circuit calculates the coefficient of this target kernel filters with reference to this parallax information;
Perhaps, this image processing circuit comprises:
A plurality of predefined kernel filters; And
One selected cell is used for reference to this parallax information, selects in these a plurality of predefined kernel filters one as this target kernel filters.
33. image processing apparatus according to claim 31 is characterized in that, this target kernel filters is a sharp filtering device, and perhaps this target kernel filters is a fuzzy filter.
34. image processing apparatus according to claim 33 is characterized in that, when this target kernel filters was the sharp filtering device, the parallax value that this parallax information represents was larger, and the filtering output that this image processing circuit produces is clearer.
35. image processing apparatus according to claim 33 is characterized in that, when this target kernel filters was fuzzy filter, the parallax value that this parallax information represents was less, and the filtering output that this image processing circuit produces is fuzzyyer.
36. image processing apparatus according to claim 28 is characterized in that, this image processing circuit is carried out the color adjustment according to this parallax information.
37. image processing apparatus according to claim 36 is characterized in that, this color adjustment is used for the saturation of one or more pixel of adjustment input image data.
38. described image processing apparatus according to claim 37, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing circuit increases this saturation, when this parallax information during less than the second predetermined value, this image processing circuit reduces this saturation;
Perhaps,
Parallax information is larger, and the saturation after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the saturation after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the saturation coefficient of the pixel in the input image data is larger;
Parallax information is less, and then the saturation coefficient of the pixel in the input image data is less;
Wherein, the saturation after this pixel adjustment in this input image data is that the former saturation of this pixel in saturation coefficient and this input image data multiplies each other.
39. image processing apparatus according to claim 28 is characterized in that, this image processing circuit is adjusted the brightness of one or more pixel in the input image data according to this parallax information.
40. described image processing apparatus is characterized in that according to claim 39, when this parallax information during greater than the first predetermined value, this image processing circuit increases this brightness, and when this parallax information during less than the second predetermined value, this image processing circuit reduces this brightness;
Perhaps,
Parallax information is larger, and the brightness after then the pixel in the input image data being adjusted is larger; Parallax information is less, and the brightness after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the luminance factor of the pixel in the input image data is larger;
Parallax information is less, and then the luminance factor of the pixel in the input image data is less;
Wherein, the brightness after this pixel adjustment in this input image data is that the former brightness of this pixel in luminance factor and this input image data is multiplied each other.
41. image processing apparatus according to claim 28 is characterized in that, this image processing circuit is used for adjusting according to this parallax information the contrast of one or more pixel of this input image data.
42. described image processing apparatus according to claim 41, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing circuit increases this contrast, when this parallax information during less than the second predetermined value, this image processing circuit reduces this contrast;
Perhaps,
Parallax information is larger, and the contrast after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the contrast after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the contrast rating of the pixel in the input image data is larger;
Parallax information is less, and then the contrast rating of the pixel in the input image data is less;
Wherein, the contrast after this pixel adjustment in this input image data is that the former contrast of this pixel in contrast rating and this input image data multiplies each other.
43. image processing apparatus according to claim 28 is characterized in that, this image processing circuit obtains a target gamma curve according to this parallax information, and this target gamma curve is applied to one or more pixel in this input image data.
44. image processing apparatus according to claim 28 is characterized in that, this image processing circuit obtains a target tone mapping according to this parallax information, and this target tone mapping is applied to one or more pixel in this input image data.
45. described image processing apparatus according to claim 44, it is characterized in that, when parallax information during greater than the first predetermined value, this image processing circuit increases by a dynamic range, when parallax information during less than the second predetermined value, this image processing circuit reduces this dynamic range;
Perhaps,
This parallax information is larger, and the dynamic range of the target tone mapping that obtains is larger; This parallax information is less, and the dynamic range of the target tone mapping that obtains is less.
46. image processing apparatus according to claim 28 is characterized in that, this image processing circuit moves one or more pixel in this input image data according to this parallax information.
47. described image processing apparatus is characterized in that according to claim 46, this image processing circuit comprises:
One computing unit is used for the first parameter according to this parallax information and an expression moving range, determines mobile range; And
One pixel mobile unit couples with this computing unit, and be used for according to this mobile range and
The second parameter of one expression moving direction, one or more pixel in mobile this input image data.
48. described image processing apparatus is characterized in that according to claim 47, this first parameter and the second parameter arrange set by user-interactive input or a predefined parameter.
49. described image processing apparatus is characterized in that according to claim 46, parallax information is larger, and then the mobile range of pixel is larger; Parallax information is less, and then the mobile range of pixel is less;
Perhaps,
Parallax information is larger, and then the mobile range of pixel is less; Parallax information is less, and then the mobile range of pixel is larger.
50. image processing apparatus according to claim 28 is characterized in that, this image processing circuit comprises:
One yield value determining unit is used for determining a yield value according to this parallax information; And
One adjustment unit couples with this yield value determining unit, is used for this yield value is applied to one or more pixel of this input image data.
51. image processing apparatus according to claim 28 is characterized in that, this image processing circuit comprises:
One deviant determining unit is used for determining a deviant according to this parallax information;
One adjustment unit couples with this deviant determining unit, and is used for this deviant is applied to one or more pixel of this input image data.
52. image processing apparatus according to claim 28 is characterized in that, this image processing circuit carries out convergent-divergent according to this parallax information at least one image object in this input image data.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161256250P | 2011-08-22 | 2011-08-22 | |
US61/256,250 | 2011-08-22 | ||
US13/423,266 | 2012-03-18 | ||
US13/423,266 US20130050420A1 (en) | 2011-08-22 | 2012-03-18 | Method and apparatus for performing image processing according to disparity information |
Publications (1)
Publication Number | Publication Date |
---|---|
CN103037236A true CN103037236A (en) | 2013-04-10 |
Family
ID=48023653
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2012102999961A Pending CN103037236A (en) | 2011-08-22 | 2012-08-21 | Image processing method and apparatus |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103037236A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104754316A (en) * | 2013-12-31 | 2015-07-01 | 展讯通信(上海)有限公司 | 3D imaging method and device and imaging system |
CN105100769A (en) * | 2014-05-05 | 2015-11-25 | 浙江大学 | Visual effect image or video pair, and generating method and device thereof |
CN107431754A (en) * | 2015-03-10 | 2017-12-01 | 佳能株式会社 | Image processing method, image processing apparatus and picture pick-up device |
WO2022228368A1 (en) * | 2021-04-30 | 2022-11-03 | 华为技术有限公司 | Image processing method, device and system |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6445833B1 (en) * | 1996-07-18 | 2002-09-03 | Sanyo Electric Co., Ltd | Device and method for converting two-dimensional video into three-dimensional video |
CN1643939A (en) * | 2002-03-27 | 2005-07-20 | 三洋电机株式会社 | Method and apparatus for processing three-dimensional images |
CN1956554A (en) * | 2005-09-03 | 2007-05-02 | 三星电子株式会社 | Apparatus and method for processing 3d picture |
CN1987929A (en) * | 2006-12-27 | 2007-06-27 | 浙江大学 | Non-linear brightness correcting method based on accumulative histogram |
CN101184252A (en) * | 2006-11-14 | 2008-05-21 | 三星电子株式会社 | Method for adjusting disparity in three-dimensional image and three-dimensional imaging device thereof |
CN101472190A (en) * | 2007-12-28 | 2009-07-01 | 深圳华为通信技术有限公司 | Multi-visual angle filming and image processing apparatus, system and method as well as decode processing method |
CN101567082A (en) * | 2009-06-04 | 2009-10-28 | 福州华映视讯有限公司 | Image processing method and device thereof |
CN101841728A (en) * | 2003-04-17 | 2010-09-22 | 夏普株式会社 | 3-dimensional image processing apparatus |
US20110119708A1 (en) * | 2009-11-13 | 2011-05-19 | Samsung Electronics Co., Ltd. | Method and apparatus for generating multimedia stream for 3-dimensional reproduction of additional video reproduction information, and method and apparatus for receiving multimedia stream for 3-dimensional reproduction of additional video reproduction information |
US20110129144A1 (en) * | 2009-11-27 | 2011-06-02 | Sony Corporation | Image processing apparatus, image processing method and program |
CN102104786A (en) * | 2009-12-14 | 2011-06-22 | 索尼公司 | Image processing device, image processing method and program |
WO2011099314A1 (en) * | 2010-02-12 | 2011-08-18 | ソニー株式会社 | Image processing device, image processing method, and program |
-
2012
- 2012-08-21 CN CN2012102999961A patent/CN103037236A/en active Pending
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6445833B1 (en) * | 1996-07-18 | 2002-09-03 | Sanyo Electric Co., Ltd | Device and method for converting two-dimensional video into three-dimensional video |
CN1643939A (en) * | 2002-03-27 | 2005-07-20 | 三洋电机株式会社 | Method and apparatus for processing three-dimensional images |
CN101841728A (en) * | 2003-04-17 | 2010-09-22 | 夏普株式会社 | 3-dimensional image processing apparatus |
CN1956554A (en) * | 2005-09-03 | 2007-05-02 | 三星电子株式会社 | Apparatus and method for processing 3d picture |
CN101184252A (en) * | 2006-11-14 | 2008-05-21 | 三星电子株式会社 | Method for adjusting disparity in three-dimensional image and three-dimensional imaging device thereof |
CN1987929A (en) * | 2006-12-27 | 2007-06-27 | 浙江大学 | Non-linear brightness correcting method based on accumulative histogram |
CN101472190A (en) * | 2007-12-28 | 2009-07-01 | 深圳华为通信技术有限公司 | Multi-visual angle filming and image processing apparatus, system and method as well as decode processing method |
CN101567082A (en) * | 2009-06-04 | 2009-10-28 | 福州华映视讯有限公司 | Image processing method and device thereof |
US20110119708A1 (en) * | 2009-11-13 | 2011-05-19 | Samsung Electronics Co., Ltd. | Method and apparatus for generating multimedia stream for 3-dimensional reproduction of additional video reproduction information, and method and apparatus for receiving multimedia stream for 3-dimensional reproduction of additional video reproduction information |
US20110129144A1 (en) * | 2009-11-27 | 2011-06-02 | Sony Corporation | Image processing apparatus, image processing method and program |
CN102104786A (en) * | 2009-12-14 | 2011-06-22 | 索尼公司 | Image processing device, image processing method and program |
WO2011099314A1 (en) * | 2010-02-12 | 2011-08-18 | ソニー株式会社 | Image processing device, image processing method, and program |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104754316A (en) * | 2013-12-31 | 2015-07-01 | 展讯通信(上海)有限公司 | 3D imaging method and device and imaging system |
CN104754316B (en) * | 2013-12-31 | 2019-01-11 | 展讯通信(上海)有限公司 | A kind of 3D imaging method, device and imaging system |
CN105100769A (en) * | 2014-05-05 | 2015-11-25 | 浙江大学 | Visual effect image or video pair, and generating method and device thereof |
CN105100769B (en) * | 2014-05-05 | 2018-08-28 | 浙江大学 | The generation method and device of a kind of visual effect image or video pair |
CN107431754A (en) * | 2015-03-10 | 2017-12-01 | 佳能株式会社 | Image processing method, image processing apparatus and picture pick-up device |
US10545311B2 (en) | 2015-03-10 | 2020-01-28 | Canon Kabushiki Kaisha | Image processing method, image processing device, and image pickup apparatus |
CN107431754B (en) * | 2015-03-10 | 2020-11-03 | 佳能株式会社 | Image processing method, image processing apparatus, and image pickup apparatus |
WO2022228368A1 (en) * | 2021-04-30 | 2022-11-03 | 华为技术有限公司 | Image processing method, device and system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10356375B2 (en) | Display device, image processing device and image processing method, and computer program | |
US8866884B2 (en) | Image processing apparatus, image processing method and program | |
US9525858B2 (en) | Depth or disparity map upscaling | |
JP6094863B2 (en) | Image processing apparatus, image processing method, program, integrated circuit | |
US9172939B2 (en) | System and method for adjusting perceived depth of stereoscopic images | |
WO2012046270A1 (en) | Generation of depth data based on spatial light pattern | |
EP2469870A2 (en) | Image processing device, image processing method, and program | |
US20140333739A1 (en) | 3d image display device and method | |
RU2010123652A (en) | SYSTEM AND METHOD FOR VISUALIZING STEREO IMAGES AND MULTI-VIEW IMAGES FOR CONTROL THE PERCEPTION OF DEPTH OF A STEREOSCOPIC IMAGE CREATED BY A TV RECEIVER | |
US20130141550A1 (en) | Method, apparatus and computer program for selecting a stereoscopic imaging viewpoint pair | |
EP3818695B1 (en) | Method and system for forming extended focal planes for large viewpoint changes | |
KR101674568B1 (en) | Image converting device and three dimensional image display device including the same | |
CN103037236A (en) | Image processing method and apparatus | |
CN105791793A (en) | Image processing method and electronic device | |
JP5878586B2 (en) | Image color adjustment method and electronic apparatus therefor | |
JP2015012429A (en) | Image processing apparatus, image processing method, and image processing program | |
US20120121163A1 (en) | 3d display apparatus and method for extracting depth of 3d image thereof | |
US20130050420A1 (en) | Method and apparatus for performing image processing according to disparity information | |
US20120170841A1 (en) | Image processing apparatus and method | |
KR101632514B1 (en) | Method and apparatus for upsampling depth image | |
US11012605B2 (en) | Image processing device, image processing method, and program for generating a focused image | |
US10063845B2 (en) | Guided 3D display adaptation | |
US9888222B2 (en) | Method and device for generating stereoscopic video pair | |
JP2013546281A (en) | Image processing apparatus using energy value, image processing method thereof, and display method | |
JP2016103797A (en) | Image processing device, image processing method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130410 |