CN103037236A - Image processing method and apparatus - Google Patents

Image processing method and apparatus Download PDF

Info

Publication number
CN103037236A
CN103037236A CN2012102999961A CN201210299996A CN103037236A CN 103037236 A CN103037236 A CN 103037236A CN 2012102999961 A CN2012102999961 A CN 2012102999961A CN 201210299996 A CN201210299996 A CN 201210299996A CN 103037236 A CN103037236 A CN 103037236A
Authority
CN
China
Prior art keywords
image processing
parallax information
pixel
image data
input image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012102999961A
Other languages
Chinese (zh)
Inventor
陈鼎匀
何镇在
朱启诚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MediaTek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/423,266 external-priority patent/US20130050420A1/en
Application filed by MediaTek Inc filed Critical MediaTek Inc
Publication of CN103037236A publication Critical patent/CN103037236A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)

Abstract

The present invention provides image processing method and apparatus based on parallax error information, wherein the image processing method comprises the steps of obtaining parallax error information, and executing image processing operation on input image data according to the parallax error information, in order to generate output image data. According to the technical scheme, the image processing method and apparatus can perform image processing on the input image data through using the parallax error information, thereby enabling the output image data to have better visual effect.

Description

Image processing method and device
Technical field
The present invention relates in particular to a kind of image processing method based on parallax information and relevant apparatus relevant for a kind of image processing techniques.
Background technology
Along with the development of Display Technique, the user pursues third dimension by force more and more real image shows, rather than high-quality image.Have two kinds in the prior art 3D(three-dimensional be provided) technology that shows of video.A kind of is to use a 3D display unit, this 3D display unit and glasses (such as, shutter glasses (shutter glasses)) the cooperation use, another kind is directly to use the 3D display unit, this 3D display unit need not used glasses.No matter which kind of technology has been used, and the main theory that 3D rendering shows is to make left eye and right eye see different images, so that the different images that brain will be seen from two eyes is as a 3D rendering.Traditional 3D shows that design directly shows original left-eye image and eye image, and the left-eye image that this is original and eye image are provided by a 3D video source.Yet before original left-eye image and eye image were presented on the 3D display unit, if original left-eye image and right eye figure are processed, to strengthen the 3D visual effect, the user can have better 3D visual experience.
Generally speaking, in order to watch this 3D rendering, the user need to have the 3D video play device, such as a 3D TV.If the user has typical 2D (two-dimensional) display unit, 2D TV for example, even video input is provided by a 3D video source, the user also can only obtain the 2D visual experience.For example, the left-eye image or the eye image that are only provided by the 3D video source are presented on the 2D TV.Traditional 2D shows that the original left-eye image/eye image that is provided by the 3D video source directly is provided in design.Similar, if in the original left-eye image/eye image that is provided by the 3D video source before the 2D TV shows, this original left-eye image/eye image is processed to strengthen the 2D visual effect, the user can have better 2D visual experience.
So, a kind of new image processing method case of demand, output image is processed and produced to this image processing method case to this 2D/3D display unit, to strengthen the 2D/3D visual effect, so that the user has better 2D/3D visual experience by input picture being carried out image.
Summary of the invention
The invention provides a kind of image processing method based on parallax information and device, to solve the problems of the technologies described above.
An aspect of of the present present invention provides a kind of image processing method, and this image processing method comprises: obtain parallax information; And according to this parallax information input image data is carried out an image processing operations, to produce output image data.
The present invention provides a kind of image processing apparatus on the other hand, and this image processing apparatus comprises: a parallax information Acquisition Circuit and an image processing circuit, this parallax information Acquisition Circuit are used for obtaining parallax information.This image processing circuit and this parallax information Acquisition Circuit couple, and are used for processing input image data according to this parallax information, to produce output image data.
Above-mentioned image processing method and image processing apparatus are processed by using parallax information that input image data is carried out image, so that the output image data that produces can bring better visual effect.
Description of drawings
The schematic diagram of the image processing apparatus that Fig. 1 provides for one embodiment of the invention;
Fig. 2 is the schematic diagram of the first embodiment of the parallax information Acquisition Circuit among Fig. 1;
Fig. 3 is the schematic diagram of the second embodiment of the parallax information Acquisition Circuit among Fig. 1;
Fig. 4 is a kind of schematic diagram that produces parallax information;
Fig. 5 is the another kind of schematic diagram that produces parallax information;
The schematic diagram based on the first embodiment of the image processing operations of parallax that Fig. 6 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the second embodiment of the image processing operations of parallax that Fig. 7 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 3rd embodiment of the image processing operations of parallax that Fig. 8 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 4th embodiment of the image processing operations of parallax that Fig. 9 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 5th embodiment of the image processing operations of parallax that Figure 10 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 6th embodiment of the image processing operations of parallax that Figure 11 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 7th embodiment of the image processing operations of parallax that Figure 12 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 8th embodiment of the image processing operations of parallax that Figure 13 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 9th embodiment of the image processing operations of parallax that Figure 14 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the tenth embodiment of the image processing operations of parallax that Figure 15 is that image processing circuit 104 is carried out among Fig. 1;
The schematic diagram based on the 11 embodiment of the image processing operations of parallax that Figure 16 is that image processing circuit 104 is carried out among Fig. 1.
Embodiment
Employed particular term refers to specific element in embodiment and the claims.One skilled in the art will appreciate that the manufacturer can use different names to an element.The application does not adopt different names to distinguish element with element, but distinguishes element with the difference of interelement function.In following embodiment and claim, term " comprises " and " comprising " is an open restriction, should be understood as that " including but not limited to ".Term " couples " and should be understood to directly or indirectly be electrically connected.Accordingly, if a device is electrically connected to another device, this connection can be a directly electrical connection, also can be by adopting one of other devices or connection indirectly to be electrically connected.
Main concept of the present invention be receive multi-view image (such as, comprise the stereo-picture that a plurality of images are right, wherein, each image is to having a left-eye image and an eye image), and strengthen an image that has received according to other images that receive.Specifically, the present invention proposes by reference parallax information (disparity information) input picture is carried out the image processing, thereby produce the output image of the picture quality with enhancing.According to parallax information, with one or more image process/the adjustment scheme adjusts the pixel in the input picture.By this way, when output image was presented on the display unit, the user had better visual experience.Following implementation details of the present invention will be described.
Fig. 1 is according to the image processing apparatus schematic diagram shown in one embodiment of the invention, this exemplary image processing apparatus 100 includes but not limited to: a parallax information Acquisition Circuit (disparity information acquisition circuit) 102, one image processing circuit, 104, one receiving circuits 106 and an output circuit 108.This parallax information Acquisition Circuit 102 is used for obtaining parallax information DI.This receiving circuit 106 is used for receiving multi-view image IMG 0-IMG N, and for example provide input image data IMG_IN(, an input picture in the multi-view image of this reception) to image processing circuit 104.Image processing circuit 104 couples with parallax information Acquisition Circuit 102 and receiving circuit 106, and be used for processing input image data IMG_IN according to parallax information DI, and for example produce accordingly output image data IMG_OUT(, by the output image of processing one or more enhancing that an input picture obtains).Output circuit 108 couples with image processing circuit 104, and plays to a display unit 101 for sending output image data IMG_OUT.Briefly, image processing circuit 104 decides how to adjust the picture quality of this input image data IMG_IN to obtain to strengthen with reference to parallax information DI.
Fig. 2 is the schematic diagram of the first embodiment of parallax information Acquisition Circuit 102 among Fig. 1.As shown in the figure, this parallax information Acquisition Circuit 102 is parts of receiving interface (receiving interface) 202.So this parallax information DI that is provided by an external device (ED) (not shown) with disparity computation ability is provided this parallax information Acquisition Circuit 102, and provide the parallax information DI of this reception to arrive this image processing circuit 104.For example, this parallax information DI can comprise the difference vector (disparity vectors) of corresponding a plurality of pixels, as shown in Figure 2.Yet the record format of this parallax information DI is only for reference, is not limitation of the present invention.That is to say, this parallax information DI can use any can by the form of image processing circuit 104 understanding/support record.So by reference parallax information DI, this image processing circuit 104 can easier be known a parallax value of each pixel that will process.
Fig. 3 is the schematic diagram of the second embodiment of parallax information Acquisition Circuit 102 among Fig. 1.As shown in the figure, receiving circuit 106 also is couple to this parallax information Acquisition Circuit 102.So this parallax information Acquisition Circuit 102 obtains this parallax information DI by processing image, this image is the multi-view image IMG that receiving system 106 receives 0-IMG NIn image.In other words, this parallax information Acquisition Circuit 102 disposes the disparity computation ability, and is used for computed image treatment circuit 104 needed parallax information DI.
Desirable parallax information can by from two or more the more the visual angle image calculate.Consider such a case, multi-view image IMG 0-IMG NComprise a left-eye image and an eye image.For example, use different video cameras to catch simultaneously a left-eye image and an eye image.This parallax information Acquisition Circuit 102 is processed the image pair that comprises a left-eye image and an eye image, to obtain parallax information DI.Please refer to Fig. 4, Fig. 4 one produces an exemplary schematic diagram of parallax information.One among image I MG_1 and the IMG_2 is left-eye image, another eye image.Step 402, pixel among the parallax information Acquisition Circuit 102 movement images IMG_1 and the pixel among the image I MG_2, and determine parallax according to the pixel displacement (pixel displacement) of the pixel that is complementary of in image I MG_1 and IMG_2, finding respectively.Wherein, certain pixel in image does not have the pixel of coupling among possible image I MG_1 and the IMG_2 in another image in image I MG_1 and IMG_2.Step 404(optional step), definite pixel parallax that does not have the pixel of coupling for example, is carried out interpolation (interpolation) based on the parallax value of a plurality of neighbor pixels.In step 402, perhaps after step 402 and the step 404, parallax information Acquisition Circuit 102 has obtained the hypothetical parallax information that follow-up image processing circuit 104 needs, at least one image among image processing circuit 104 follow-up uses this hypothetical parallax information processing image I MG_1 and the IMG_2.
Consider another kind of situation, multi-view image IMG 0-IMG NComprise the image more than two.For example, single camera is at the image of the corresponding different visual angle of different time point shootings.So three of the visual angle that 102 processing of parallax information Acquisition Circuit are corresponding different with epigraph (comprising three images), to obtain parallax information DI.Please refer to Fig. 5, Fig. 5 shows another example that parallax information produces.For clear and succinct, Fig. 5 only illustrates three image I MG_1, IMG_2 and IMG_3.Wherein, the visual angle that image I MG_1, IMG_2 and IMG_3 are corresponding different, such as, visual angle, left side image, middle visual angle image (middle view), and visual angle, the right image.In this embodiment, step 502, parallax information Acquisition Circuit 102 compares the pixel among the pixel among the image I MG_1 and the image I MG_2, determines parallax according to the pixel displacement of the pixel that is complementary among image I MG_1 and the image I MG_2.As mentioned above, a certain pixel in image does not have matched pixel in another image among possible image I MG_1 and the IMG_2 in image I MG_1 and IMG_2.Step 504(optional step), determine not have the pixel parallax of matched pixel, for example, with reference to the parallax information by using image I MG_2 and IMG_3 to find.After step 502 or step 502 and step 504, parallax information Acquisition Circuit 102 has obtained the hypothetical parallax information that follow-up image processing circuit 104 needs, at least one image among this hypothetical parallax information processing image I of image processing circuit 104 follow-up uses MG_1, IMG_2 and the IMG_3.
In above Fig. 4 and embodiment shown in Figure 5, only usage space information is determined parallax information, and this spatial information is by utilizing the different visual angles image to obtain.Optionally, also can utilize temporal information (temporal information) to determine that parallax information, this temporal information are to obtain by the different images that utilizes same view angle.In an optional design, use a plurality of multi-view images to determine temporal information and spatial information, determine parallax information according to this temporal information and spatial information, realize obtaining the order ground of parallax information with this.
After receiving the parallax information that is produced by parallax information Acquisition Circuit 102, image processing circuit 104 is processed input image data IMG_IN according to parallax information DI, to produce output image data IMG_OUT.Suppose that display unit 101 is 2D display unit, and obtain multi-view image IMG from a 3D video input 0-IMG N, the image processing circuit 104 among Fig. 1 produces accordingly one or more 2D output image and plays to be used for 2D to display unit 101 for an image of processing according to parallax information DI among Fig. 4 image I MG_1 and the IMG_2.For example, according to an image among parallax information DI processing image I MG_1 and the IMG_2, can obtain the GIF image (animated GIF image) of animation, and it is presented on the 2D display unit, export to the user thereby present a similar 3D rendering.Similar, about exemplary disparity computation example shown in Figure 5, image processing circuit 104 is used for processing a image among Fig. 5 image I MG_1 and the IMG_2 according to parallax information DI, and produces accordingly one or more 2D output image and play to be used for 2D to display unit 101.One in direct demonstration stereo-picture/multi-view image to this traditional design of 2D display unit, and the image of this image processing apparatus 100 by one or more enhancing of output can strengthen 2D picture quality to this display unit 101.As follows, with the several examples of Description Image treatment circuit 104 execution based on the image processing operations of parallax.
The first embodiment based on the image processing operations of parallax that Fig. 6 shows that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used for the parallax value of wanting processed pixel P for example according to parallax information DI() obtain a target kernel filters (target kernel filter) 602, then by an adjustment unit (a for example multiplier (multiplier) 604) this target kernel filters is applied to one or more pixel of input image data IMG_IN.In this embodiment, the size of target kernel filters is 5x5.So graphics processing unit 104 is for example wanted the parallax value of processed this pixel P with reference to parallax information DI(), calculate the coefficient (coefficient) of target kernel filters 602.Then, 5 * 5 interval 606 of input image data IMG_IN interior pixels are used target kernel filters 602, wherein, the center in 5 * 5 intervals 606 is to want processed pixel P.Target kernel filters 602 definite pixel values are distributed to the pixel P of output image data IMG_OUT.
Need to prove, the size of target kernel filters 602 is not limited to 5 * 5.In practice, the size of target kernel filters 602 is adjustable, and it relies on actual design and considers/need.In other words, the size of target kernel filters 602 is M * M, and wherein, M is any positive integer.For example, the size of target kernel filters 602 is 3 * 3, and to satisfy the needs of an application, the size of target kernel filters 602 is 7 * 7, to satisfy the needs of Another application.
In an exemplary design, can be sharp filtering device (sharpness filter) by the target kernel filters 602 that can be used for a certain pixel of image processing circuit 104 dynamic calculation.So when image information DI indication wanted processed pixel P to have a larger parallax value, image processing circuit 104 produced a more clearly filtering output.
In another exemplary design, can be fuzzy filter (blur filter) by the target kernel filters 602 of image processing circuit 104 dynamic calculation.So when image information DI indication wanted processed pixel P to have the difference of neglecting, image processing circuit 104 produced a relatively fuzzyyer filtering output.
The second embodiment based on the image processing operations of parallax that Fig. 7 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used for the parallax value of wanting processed pixel P for example according to the parallax information DI(of each pixel) obtain to be used for the target kernel filters (target kernel filter) 703 of this pixel, then by multiplier (multiplier) 604 this target kernel filters is applied to one or more pixel of input image data IMG_IN.Fig. 6 and main difference embodiment illustrated in fig. 7 are: the image processing circuit 104 among Fig. 7 is configured further to comprise a plurality of predefined kernel filters 701_1,701_2 ... 701_N and a selected cell 702.Selected cell 702 is used for selecting predefined kernel filters 701_1,701_2 with reference to parallax information DI (parallax value of pixel P that for example will be processed) ... one among the 701_N as the target kernel filters.Similarly, as shown in Figure 7, each predefined kernel filters 701_1,701_2 ... the size of 701_N is 5 * 5.So target kernel filters 702 is used to the pixel in 5 * 5 intervals 606, wherein, pixel P is the center in this 5 * 5 interval 606.Then, target kernel filters 703 definite pixel values will be assigned to the pixel P among the output image data IMG_OUT.
Need to prove each predefined kernel filters 701_1,701_2 ... the size of 701_N is not limited to 5 * 5.In practice, the size of predefined kernel filters is adjustable, and it relies on actual design and considers/need.In other words, each predefined kernel filters 701_1,701_2 ... the size of 701_N is M * M, and wherein, M is any positive integer.For example, each predefined kernel filters 701_1,701_2 ... the size of 701_N is 3 * 3, to satisfy the needs of an application, each predefined kernel filters 701_1,701_2 ... the size of 701_N is 7 * 7, to satisfy the needs of Another application.
In an exemplary design, predefined kernel filters 701_1,701_2 ... 701_N can be the sharp filtering device (sharpness filter) with different sharpening grades.So when image information DI indication wanted processed pixel P to have a larger parallax value, image processing circuit 104 produced a more clearly filtering output.
In another exemplary design, predefined kernel filters 701_1,701_2 ... 701_N can be the fuzzy filter (blur filter) with different fuzzy class.So, to want processed pixel P when image information DI indication and have one when neglecting difference, image processing circuit 104 produces a relatively fuzzyyer filtering output.
In another exemplary design, predefined kernel filters 701_1,701_2 ... 701_N can comprise sharp filtering device and fuzzy filter, and wherein, the sharp filtering utensil has different sharpening grades, and fuzzy filter has different fuzzy class.So parallax value determined for pixel P to be processed, which sharp filtering device or fuzzy filter will be selected as the target kernel filters.
The 3rd embodiment based on the image processing operations of parallax that Fig. 8 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used to each pixel of input image data IMG_IN is carried out the color adjustment.Specifically, each pixel comprises a plurality of color component value, the corresponding a plurality of different Color Channels of these a plurality of color component value (such as, red (R), green (G) and blue (B) passage).In this embodiment, image processing circuit 104 can comprise a plurality of adjustment units 801,802 and 803 that are configured in different color channels, and optionally adjust at least one in a plurality of color component value with reference to parallax information DI (parallax value of pixel P that for example, be processed).Then, adjustment unit 801,802 and 803 color component value of determining are distributed to the pixel P among the output image data IMG_OUT.
The 4th embodiment based on the image processing operations of parallax that Fig. 9 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used to each pixel of input image data IMG_IN is carried out saturation (saturation) adjustment and brightness (brightness) adjustment.Specifically, each pixel among the input image data IMG_IN comprises a plurality of color component value, a plurality of different Color Channel in corresponding the first color space of these a plurality of color component value difference (such as, red (R), green (G) and blue (B) passage).In this embodiment, image processing circuit 104 can comprise a plurality of adjustment units 901,902,903, and a plurality of converting unit (converting units) 904,905.Converting unit 904 be used for the corresponding different color channels of the first color space (such as, red (R), green (G) and blue (B) passage) color component value be transformed into corresponding a plurality of different Color Channels in the second color space (such as, Y, U and V passage) color component value.Adjustment unit 901-903 is configured on the different Color Channel of the second color space, and optionally adjusts at least one in a plurality of color component value with reference to parallax information DI (parallax value of pixel P that for example, be processed).Then, converting unit 905 is transformed into the color component value in the first color space with adjustment unit 901,902 and 903 color component value that produce.To be assigned to the pixel P among the output image data IMG_OUT by adjustment unit 901,902 and 903 color component value definite and that be converted unit 905 conversions.
In an exemplary design, this image processing circuit 104 can be used for adjusting the saturation (saturation) of pixel P.So, when parallax information DI indicates pixel P to be processed to have larger parallax value, this image processing circuit 104 is by carrying out the saturation that the saturation adjustment increases pixel P in the second color space, and/or, have less parallax value when parallax information DI indicates pixel P to be processed, this image processing circuit 104 is by carrying out the saturation that the saturation adjustment reduces pixel P in the second color space.Specifically, larger for the parallax information of a certain pixel of this input image data, the saturation of this pixel after then adjusting is larger; Parallax information for a certain pixel of this input image data is less, and the saturation of this pixel after then adjusting is less.Such as, can pre-configured parallax information and the mapping table of saturation coefficient, in this table, parallax information is larger, and then the saturation coefficient is larger, parallax information is less, then the saturation coefficient is less, and image processing circuit 104 finds its corresponding saturation coefficient according to the parallax information of certain pixel, the saturation coefficient that finds and the former saturation of this pixel are multiplied each other, obtain the saturation of this pixel in the output image data.Perhaps, when for the parallax information of certain pixel during greater than the first predetermined value, image processing operations increases the saturation of this pixel, specifically can be, this image processing circuit 104 is by carrying out the saturation that the saturation adjustment increases pixel P in the second color space; When for the parallax information of certain pixel during less than the second predetermined value, this image processing operations reduces the saturation of this pixel, specifically can be that this image processing circuit 104 is by carrying out the saturation that the saturation adjustment reduces pixel P in the second color space.Wherein, the first predetermined value can be greater than or equal to the second predetermined value.
In another exemplary design, this image processing circuit 104 can be for the brightness (brightness) of adjusting pixel P/intensity (intensity).So, when indicating pixel P to be processed, parallax information DI has larger parallax value, this image processing circuit 104 is by carrying out the brightness that the brightness/intensity adjustment increases pixel P in the second color space, and/or, when parallax information DI indicated pixel P to be processed to have to neglect difference, this image processing circuit 104 was by carrying out the brightness that the brightness/intensity adjustment reduces pixel P in the second color space.Specifically, larger for the parallax information of a certain pixel of this input image data, the brightness of this pixel after then adjusting is larger; Parallax information for a certain pixel of this input image data is less, and the brightness of this pixel after then adjusting is less.Such as, can pre-configured parallax information and the mapping table of luminance factor, in this table, parallax information is larger, and then luminance factor is larger, parallax information is less, then luminance factor is less, and image processing circuit 104 finds its corresponding luminance factor according to the parallax information of certain pixel, the luminance factor that finds and the former brightness of this pixel are multiplied each other, obtain the brightness of this pixel in the output image data.Perhaps, when for the parallax information of certain pixel during greater than the first predetermined value, image processing operations increases the brightness of this pixel, specifically can be, this image processing circuit 104 is by carrying out the brightness that brightness adjustment increases pixel P in the second color space; When for the parallax information of certain pixel during less than the second predetermined value, this image processing operations reduces the brightness of this pixel, specifically can be that this image processing circuit 104 is by carrying out the brightness that brightness adjustment reduces pixel P in the second color space.Wherein, the first predetermined value can be greater than or equal to the second predetermined value.
The 5th embodiment based on the image processing operations of parallax that Figure 10 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 comprises a contrast adjustment unit 1002, and this contrast adjustment unit 1002 is used for according to parallax information DI, and the pixel among the input image data IMG_IN is carried out contrast (contrast) adjustment.When parallax information DI has indicated when wanting processed pixel to have larger parallax value, contrast adjustment unit 1002 has increased the contrast of pixel P, and/or, when parallax information DI has indicated when wanting processed pixel to have to neglect difference, contrast adjustment unit 1002 has reduced the contrast of pixel P.Specifically, larger for the parallax information of a certain pixel of this input image data, the contrast of this pixel after then adjusting is larger; Parallax information for a certain pixel of this input image data is less, and the contrast of this pixel after then adjusting is less.Such as, can pre-configured parallax information and the mapping table of contrast rating, in this table, parallax information is larger, and then contrast rating is larger, parallax information is less, then contrast rating is less, and contrast adjustment unit 1002 finds its corresponding contrast rating according to the parallax information of certain pixel, the contrast rating that finds and the former contrast of this pixel are multiplied each other, obtain the contrast of this pixel in the output image data.Perhaps, when for the parallax information of certain pixel during greater than the first predetermined value, image processing operations increases the contrast of this pixel, and when for the parallax information of certain pixel during less than the second predetermined value, this image processing operations reduces the contrast of this pixel.Wherein, the first predetermined value can be greater than or equal to the second predetermined value.
The 6th embodiment based on the image processing operations of parallax that Figure 11 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 is used the gamma curve adjustment according to parallax information DI to each pixel among the input image data IMG_IN.In this embodiment, image processing circuit 104 is according to parallax information DI, obtain a target gamma curve 1103 for pixel P, and use an adjustment unit (such as, multiplier (multiplier) 1104) that this target gamma curve 1103 is applied to this pixel P.More particularly, image processing circuit 104 further comprises a plurality of predefined gamma curve 1101_1,1101_2 ... 1101_N and a selected cell 1102.Selected cell 1102 with reference to parallax information DI(such as, the parallax value of pixel P to be processed) select predefined gamma curve 1101_1,1101_2 ... one among the 1101_N as target gamma curve 1103.Then, will distribute to pixel P among the output image data IMG_OUT by the pixel values that target gamma curve 1103 is determined.
The 7th embodiment based on the image processing operations of parallax that Figure 12 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 comprises a tone (tone) map unit 1202, and this tone mapping unit 1202 is used for carrying out the dynamic range adjustment according to parallax information DI.More particularly, when parallax information DI has indicated when wanting processed pixel to have larger parallax value, tone mapping unit 1202 has increased the dynamic range of pixel P, and/or, when parallax information DI has indicated when wanting processed pixel to have to neglect difference, tone mapping unit 1202 has reduced the dynamic range of pixel P.For example, when tone mapping unit 1202 uses a high dynamic range, the pixel value in a particular pixel values scope will be mapped to the pixel value in the relatively large pixel value scope; When tone mapping unit 1202 uses one during than low-dynamic range, the pixel value in this particular pixel values scope will be mapped to the pixel value in the pixel value scope of a less.Wherein, when this parallax information during greater than the first predetermined value, this image processing operations increases by a dynamic range, and when this parallax information during less than the second predetermined value, this image processing operations reduces this dynamic range; Wherein the first predetermined value is greater than or equal to the second predetermined value.This dynamic range can represent the color gamut of pixel.Perhaps, this parallax information is larger, and the dynamic range of the target tone mapping that obtains is larger; This parallax information is less, and the dynamic range of the target tone mapping that obtains is less.
The 8th embodiment based on the image processing operations of parallax that Figure 13 illustrates that image processing circuit among Fig. 1 104 carries out.This image processing circuit 104 comes each pixel among the mobile input image data IMG_IN with reference to parallax information DI.In this embodiment, image processing circuit 104 comprises a computing unit 1302 and a pixel mobile unit 1304.This computing unit 1302 according to parallax information DI(for example is used for the parallax value of pixel P) and the mobile range of the first parameter S 1 of expression moving range pixel P of determining to want processed.For example, this moving range is limited by minimum mobile range M_MIN and maximum mobile range M_MAX, wherein, if the corresponding minimum parallax value V_MIN(V=V_MIN of minimum mobile range M_MIN then M=M_MIN), and if the corresponding maximum disparity value V_MAX(V=V_MAX of maximum mobile range M_MAX then M=M_MAX).So, when the parallax value of the pixel P that is placed on position (X1, Y1) is that V(V_MIN<V<V_MAX), then the mobile range M of pixel P can determine by using following equation:
M - M _ MIN V - V _ MIN = M _ MAX - M _ MIN V _ MAX - V _ MIN - - - ( 1 )
So when parallax information DI has indicated pixel P to have larger parallax value V, computing unit 1302 will make mobile range M increase, and/or when parallax information DI has indicated pixel P to have to neglect difference V, computing unit 1302 will make mobile range M diminish.That is to say, larger for the parallax information of a certain pixel of this input image data, then the mobile range of this pixel is larger; Parallax information for a certain pixel of this input image data is less, and then the mobile range of this pixel is less.
One optionally in the design, if the corresponding maximum disparity value V_MAX(V=V_MAX of minimum mobile range M_MIN then M=M_MIN), and if the corresponding minimum parallax value V_MIN(V=V_MIN of maximum mobile range M_MAX then M=M_MAX).So the mobile range M of pixel P can determine by following equation:
M _ MAX - M V - V _ MIN = M _ MAX - M _ MIN V _ MAX - V _ MIN - - - ( 2 )
So when parallax information DI has indicated pixel P to have larger parallax value V, computing unit 1302 will make mobile range M less, and/or when parallax information DI has indicated pixel P to have to neglect difference V, computing unit 1302 will make mobile range M larger.That is to say, less for the parallax information of a certain pixel of this input image data, then the mobile range of this pixel is larger; Parallax information for a certain pixel of this input image data is larger, and then the mobile range of this pixel is less.
Pixel mobile unit 1304 couples with computing unit 1302, and is used for coming mobile pixel P according to the second parameter S 2 of mobile range M and an expression moving direction.As shown in figure 13, the pixel P that defines in output image data IMG_OUT is placed on position (X2, Y2), home position (X1, the Y1) difference that defines among itself and the input image data IMG_IN.In order to ensure each pixel in output image by pixel value of appropriate distribution, a feasible execution mode of pixel mobile unit 1304 is by according to mobile range information and moving direction information the pixel value in the input picture being carried out search/interpolation (search/interpolate), coming the pixel value of pixel in definite output image sequentially with a specific order (such as raster scan order (raster scan order)).For example, when determining to be placed on the position (X2 that defines among the output image data IMG_OUT, during the pixel value of pixel Y2), pixel mobile unit 1304 is with reference to mobile range M and by the moving direction of the second parameter S 2 expression, know and be placed on position (X1, Y1) pixel value of the pixel P on should be configured to be placed on the pixel value of the pixel on the position (X2, Y2).The purpose of the pixel P that has realized mobile position (X1, Y1) placement in input picture position (X2, Y2) in the output image.Consider a kind of situation, pixel mobile unit 1304 fails directly to find in input picture pixel value that the pixel value of the specific pixel in this output image is set, and this pixel mobile unit 1304 can calculate/determine the pixel value that algorithm is determined this specific pixel in this output image by interpolation or other.By this way, even one or more pixel in the input picture can be moved to new position in output image, can guarantee that also each pixel in the output image has pixel value.
Need to prove, the first parameter S 1 and the second parameter S 2 can be inputted by user-interactive (user interactive input) or the predefine parameter arranges.That is to say, moving range and moving direction can be by pre-defined or be controlled by the user.
The 9th embodiment based on the image processing operations of parallax that Figure 14 illustrates that image processing circuit among Fig. 1 104 carries out.Image processing circuit 104 uses gain adjustment according to parallax information DI to each pixel among the input image data IMG_IN.In this embodiment, image processing circuit 104 comprises that a yield value determines circuit 1402 and an adjustment unit 1404.This yield value determine circuit 1402 be used for reference to parallax information DI (such as, the parallax value of processed pixel P) come to determine yield value G for this pixel P.Adjustment unit 1404 is couple to yield value determining unit 1402, is used for yield value G is applied to pixel P, to adjust the pixel value of this pixel P.For example, adjustment unit 1404 realized by a multiplier, and the multiplied result of the pixel value of pixel P and yield value G is distributed to pixel P among the output image data IMG_OUT.
The tenth embodiment based on the image processing operations of parallax that Figure 15 illustrates that image processing circuit among Fig. 1 104 carries out.Graphics processing unit 104 uses skew to adjust (offset adjustment) according to parallax information DI to each pixel among the input image data IMG_IN.In this embodiment, image processing circuit 104 comprises a deviant determining unit 1502 and an adjustment unit 1504.This deviant determining unit 1502 be used for reference to parallax information DI (such as, the parallax value of processed pixel P) determine the deviant D of this pixel P.Adjustment unit 1504 is couple to deviant determining unit 1502, is used for deviant D is applied to pixel P, to adjust the pixel value of this pixel P.For example, utilize an adder (adder) to realize adjustment unit 1504, the addition result of the pixel value of pixel P and deviant D is distributed to the pixel P of output image data IMG_OUT.
The 11 embodiment based on the image processing operations of parallax that Figure 16 illustrates that image processing circuit among Fig. 1 104 carries out.Image processing circuit 104 comprises image object unit for scaling (image object scaling unit) 1602, and this image object unit for scaling is used for according to parallax information DI the image object of input image data IMG_IN being carried out convergent-divergent.So according to parallax information DI, the picture size of the image object in the output image of corresponding output image data IMG_OUT can be greater than or less than the picture size of identical image object in the input picture of corresponding input image data IMG_IN.For example, input picture comprises two image object OBJ1 and OBJ2.Have and neglect when poor when parallax information DI indicating image object OBJ1 has larger parallax and image object OBJ2, image object unit for scaling 1602 enlarges image object OBJ1 and downscaled images object OBJ2, so that the image object OBJ1 ' in the output image has a picture size that increases, the image object OBJ2 ' in the output image has a picture size that reduces.Briefly, because the size/resolution of the input picture of corresponding input image data IMG_IN is identical with the size/resolution of the output image of corresponding output image data IMG_OUT, according to the parallax situation of each image object that obtains from parallax information DI, the image object in the input picture will be emphasized or go to emphasize by image object unit for scaling 1602 in output image.
Need to prove, the above-mentioned exemplary executive mode based on the image processing operations of parallax of being carried out by the image processing circuit 104 among Fig. 1 of mentioning also can not need to take pixel as the basis.Optionally, the above-mentioned exemplary executive mode based on the image processing operations of parallax of being carried out by the image processing circuit 104 among Fig. 1 of mentioning can be adjusted take piece as the basis.For example, can with reference to the mean value of the parallax value of a middle pixel, determine the adjustment that the pixel value of all pixels in this piece is done.Simply be summarised as, so long as adjust input picture according to parallax information, just belong in the spiritual category of the present invention.
Consider another kind of situation, display unit 101 is 3D display unit, and obtains multi-view image IMG from a 3D video input 0-IMG NCarried out by image processing circuit 104, can be with reference to parallax information DI based on the exemplary executive mode of the image processing operations of parallax, adjust in left-eye image and the eye image one or two, to strengthen the 3D display quality.
Image processing circuit 104 can adopt a kind of input picture with input image data IMG_IN of above-mentioned image processing operations based on parallax.Yet this only is for illustrative purposes, is not limitation of the present invention.Consider/need based on design, image processing circuit 104 can use the combination of a plurality of image processing operations of selecting from the image processing operations based on parallax of aforementioned exemplary, has the input picture of input image data IMG_IN with processing.Briefly, use the image processing operations based on parallax of one or more aforementioned exemplary all can fall into category of the present invention.
Although the present invention discloses as above with preferred embodiment; so it is not to limit the present invention, any those skilled in the art, without departing from the spirit and scope of the present invention; when can doing a little change and retouching, so protection scope of the present invention is when being as the criterion with claims.

Claims (52)

1. an image processing method is characterized in that, comprising:
Obtain parallax information; And
According to this parallax information input image data is carried out an image processing operations, to produce output image data.
2. image processing method according to claim 1 is characterized in that, further comprises:
Receive multi-view image;
The acquisition parallax information comprises:
Process this multi-view image, to obtain this parallax information.
3. image processing method according to claim 1 is characterized in that, further comprises:
Receive multi-view image, wherein in this multi-view image is as this input image data.
4. image processing method according to claim 3 is characterized in that, this multi-view image is from a 3D video input, and comprises a pair of image, and this comprises a left-eye image and an eye image to image, and this image processing method further comprises:
Export this output image data to a 2D display unit.
5. image processing method according to claim 1 is characterized in that, the step of carrying out this image processing operations comprises:
Obtain a target kernel filters according to this parallax information; And one or more pixel that this target kernel filters is applied to this input image data.
6. image processing method according to claim 5 is characterized in that, obtains this target kernel filters and comprises:
With reference to this parallax information, calculate the coefficient of this target kernel filters.
7. image processing method according to claim 5 is characterized in that, obtains this target kernel filters and comprises:
With reference to this parallax information, select in a plurality of predefined kernel filters one as this target kernel filters.
8. image processing method according to claim 5 is characterized in that, this target kernel filters is a sharp filtering device, and perhaps, this target kernel filters is a fuzzy filter.
9. image processing method according to claim 8 is characterized in that,
When this target kernel filters was the sharp filtering device, the parallax value that this parallax information represents was larger, and the filtering output that image processing operations produces is clearer.
10. image processing method according to claim 8 is characterized in that, when this target kernel filters was fuzzy filter, the parallax value that this parallax information represents was less, and the filtering output that image processing operations produces is fuzzyyer.
11. image processing method according to claim 1 wherein, is carried out this image processing operations and is comprised: carry out the color adjustment according to this parallax information.
12. image processing method according to claim 11 is characterized in that, this color adjustment is used for the saturation of one or more pixel of this input image data of adjustment.
13. image processing method according to claim 12, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases this saturation, when this parallax information during less than the second predetermined value, this image processing operations reduces this saturation;
Perhaps,
Parallax information is larger, and the saturation after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the saturation after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the saturation coefficient of the pixel in the input image data is larger;
Parallax information is less, and then the saturation coefficient of the pixel in the input image data is less;
Wherein, the saturation after this pixel adjustment in this input image data is that the former saturation of this pixel in saturation coefficient and this input image data multiplies each other.
14. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, adjust the brightness of one or more pixel of this input image data.
15. image processing method according to claim 14 is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases this brightness, and when this parallax information during less than the second predetermined value, this image processing operations reduces this brightness;
Perhaps,
Parallax information is larger, and the brightness after then the pixel in the input image data being adjusted is larger; Parallax information is less, and the brightness after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the luminance factor of the pixel in the input image data is larger;
Parallax information is less, and then the luminance factor of the pixel in the input image data is less;
Wherein, the brightness after this pixel adjustment in this input image data is that the former brightness of this pixel in luminance factor and this input image data is multiplied each other.
16. image processing method according to claim 1 is characterized in that, the carries out image processing operation comprises: according to this parallax information, adjust the contrast of one or more pixel of this input image data.
17. image processing method according to claim 16, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases this contrast, when this parallax information during less than the second predetermined value, this image processing operations reduces this contrast;
Perhaps,
Parallax information is larger, and the contrast after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the contrast after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the contrast rating of the pixel in the input image data is larger;
Parallax information is less, and then the contrast rating of the pixel in the input image data is less;
Wherein, the contrast after this pixel adjustment in this input image data is that the former contrast of this pixel in contrast rating and this input image data multiplies each other.
18. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, obtain a target gamma curve; And one or more pixel that this target gamma curve is applied to this input image data.
19. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, obtain a target tone mapping; And one or more pixel that this target tone mapping is applied to this input image data.
20. image processing method according to claim 19 is characterized in that, when this parallax information during greater than the first predetermined value, this image processing operations increases by a dynamic range, perhaps, when this parallax information during less than the second predetermined value, this image processing operations reduces this dynamic range;
Perhaps,
This parallax information is larger, and the dynamic range of the target tone mapping that obtains is larger; This parallax information is less, and the dynamic range of the target tone mapping that obtains is less.
21. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, one or more pixel of mobile this input image data.
22. image processing method according to claim 21 is characterized in that, one or more pixel of mobile this input image data comprises: according to this parallax information and one first parameter that represents a moving range, determine mobile range; And, according to this mobile range and one second parameter that represents a moving direction, one or more pixel of mobile this input picture.
23. image processing method according to claim 22, it is characterized in that, the step of one or more pixel of mobile this input image data comprises: by receiving user-interactive input or with reference to predefined parameter setting, this first parameter and the second parameter being set.
24. image processing method according to claim 22 is characterized in that,
Parallax information is larger, and then the mobile range of pixel is larger; Parallax information is less, and then the mobile range of pixel is less;
Perhaps,
Parallax information is larger, and then the mobile range of pixel is less; Parallax information is less, and then the mobile range of pixel is larger.
25. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, determine a yield value; And one or more pixel that this yield value is applied to this input image data.
26. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, determine a deviant; And one or more pixel that this deviant is applied to this input image data.
27. image processing method according to claim 1 is characterized in that, carries out this image processing operations and comprises: according to this parallax information, at least one image object in this input image data is carried out convergent-divergent.
28. an image processing apparatus is characterized in that, comprising:
One parallax information Acquisition Circuit is used for obtaining parallax information; And
One image processing circuit couples with this parallax information Acquisition Circuit, and is used for processing input image data according to this parallax information, to produce output image data.
29. image processing apparatus according to claim 28 is characterized in that, further comprises:
One receiving circuit couples with this parallax information Acquisition Circuit, is used for receiving multi-view image;
Wherein, this parallax information Acquisition Circuit obtains this parallax information by processing this multi-view image;
Perhaps,
One receiving circuit couples with this image processing circuit, and is used for receiving multi-view image, and wherein, an image in this multi-view image is as this input image data.
30. image processing apparatus according to claim 29 is characterized in that, this multi-view image is from a 3D video input, and comprises a pair of image, and this comprises a left-eye image and an eye image to image, and this image processing apparatus further comprises:
One output circuit is couple to this image processing circuit, is used for this output image data of output to a 2D display unit.
31. image processing apparatus according to claim 28, it is characterized in that, this image processing circuit has a target kernel filters, this target kernel filters is to obtain according to this parallax information, and this image processing circuit is applied to one or more pixel in this input image data with this target kernel filters.
32. image processing apparatus according to claim 31 is characterized in that,
This image processing circuit calculates the coefficient of this target kernel filters with reference to this parallax information;
Perhaps, this image processing circuit comprises:
A plurality of predefined kernel filters; And
One selected cell is used for reference to this parallax information, selects in these a plurality of predefined kernel filters one as this target kernel filters.
33. image processing apparatus according to claim 31 is characterized in that, this target kernel filters is a sharp filtering device, and perhaps this target kernel filters is a fuzzy filter.
34. image processing apparatus according to claim 33 is characterized in that, when this target kernel filters was the sharp filtering device, the parallax value that this parallax information represents was larger, and the filtering output that this image processing circuit produces is clearer.
35. image processing apparatus according to claim 33 is characterized in that, when this target kernel filters was fuzzy filter, the parallax value that this parallax information represents was less, and the filtering output that this image processing circuit produces is fuzzyyer.
36. image processing apparatus according to claim 28 is characterized in that, this image processing circuit is carried out the color adjustment according to this parallax information.
37. image processing apparatus according to claim 36 is characterized in that, this color adjustment is used for the saturation of one or more pixel of adjustment input image data.
38. described image processing apparatus according to claim 37, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing circuit increases this saturation, when this parallax information during less than the second predetermined value, this image processing circuit reduces this saturation;
Perhaps,
Parallax information is larger, and the saturation after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the saturation after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the saturation coefficient of the pixel in the input image data is larger;
Parallax information is less, and then the saturation coefficient of the pixel in the input image data is less;
Wherein, the saturation after this pixel adjustment in this input image data is that the former saturation of this pixel in saturation coefficient and this input image data multiplies each other.
39. image processing apparatus according to claim 28 is characterized in that, this image processing circuit is adjusted the brightness of one or more pixel in the input image data according to this parallax information.
40. described image processing apparatus is characterized in that according to claim 39, when this parallax information during greater than the first predetermined value, this image processing circuit increases this brightness, and when this parallax information during less than the second predetermined value, this image processing circuit reduces this brightness;
Perhaps,
Parallax information is larger, and the brightness after then the pixel in the input image data being adjusted is larger; Parallax information is less, and the brightness after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the luminance factor of the pixel in the input image data is larger;
Parallax information is less, and then the luminance factor of the pixel in the input image data is less;
Wherein, the brightness after this pixel adjustment in this input image data is that the former brightness of this pixel in luminance factor and this input image data is multiplied each other.
41. image processing apparatus according to claim 28 is characterized in that, this image processing circuit is used for adjusting according to this parallax information the contrast of one or more pixel of this input image data.
42. described image processing apparatus according to claim 41, it is characterized in that, when this parallax information during greater than the first predetermined value, this image processing circuit increases this contrast, when this parallax information during less than the second predetermined value, this image processing circuit reduces this contrast;
Perhaps,
Parallax information is larger, and the contrast after then the pixel in the input image data being adjusted is larger;
Parallax information is less, and the contrast after then the pixel in the input image data being adjusted is less;
Perhaps,
Parallax information is larger, and then the contrast rating of the pixel in the input image data is larger;
Parallax information is less, and then the contrast rating of the pixel in the input image data is less;
Wherein, the contrast after this pixel adjustment in this input image data is that the former contrast of this pixel in contrast rating and this input image data multiplies each other.
43. image processing apparatus according to claim 28 is characterized in that, this image processing circuit obtains a target gamma curve according to this parallax information, and this target gamma curve is applied to one or more pixel in this input image data.
44. image processing apparatus according to claim 28 is characterized in that, this image processing circuit obtains a target tone mapping according to this parallax information, and this target tone mapping is applied to one or more pixel in this input image data.
45. described image processing apparatus according to claim 44, it is characterized in that, when parallax information during greater than the first predetermined value, this image processing circuit increases by a dynamic range, when parallax information during less than the second predetermined value, this image processing circuit reduces this dynamic range;
Perhaps,
This parallax information is larger, and the dynamic range of the target tone mapping that obtains is larger; This parallax information is less, and the dynamic range of the target tone mapping that obtains is less.
46. image processing apparatus according to claim 28 is characterized in that, this image processing circuit moves one or more pixel in this input image data according to this parallax information.
47. described image processing apparatus is characterized in that according to claim 46, this image processing circuit comprises:
One computing unit is used for the first parameter according to this parallax information and an expression moving range, determines mobile range; And
One pixel mobile unit couples with this computing unit, and be used for according to this mobile range and
The second parameter of one expression moving direction, one or more pixel in mobile this input image data.
48. described image processing apparatus is characterized in that according to claim 47, this first parameter and the second parameter arrange set by user-interactive input or a predefined parameter.
49. described image processing apparatus is characterized in that according to claim 46, parallax information is larger, and then the mobile range of pixel is larger; Parallax information is less, and then the mobile range of pixel is less;
Perhaps,
Parallax information is larger, and then the mobile range of pixel is less; Parallax information is less, and then the mobile range of pixel is larger.
50. image processing apparatus according to claim 28 is characterized in that, this image processing circuit comprises:
One yield value determining unit is used for determining a yield value according to this parallax information; And
One adjustment unit couples with this yield value determining unit, is used for this yield value is applied to one or more pixel of this input image data.
51. image processing apparatus according to claim 28 is characterized in that, this image processing circuit comprises:
One deviant determining unit is used for determining a deviant according to this parallax information;
One adjustment unit couples with this deviant determining unit, and is used for this deviant is applied to one or more pixel of this input image data.
52. image processing apparatus according to claim 28 is characterized in that, this image processing circuit carries out convergent-divergent according to this parallax information at least one image object in this input image data.
CN2012102999961A 2011-08-22 2012-08-21 Image processing method and apparatus Pending CN103037236A (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201161256250P 2011-08-22 2011-08-22
US61/256,250 2011-08-22
US13/423,266 2012-03-18
US13/423,266 US20130050420A1 (en) 2011-08-22 2012-03-18 Method and apparatus for performing image processing according to disparity information

Publications (1)

Publication Number Publication Date
CN103037236A true CN103037236A (en) 2013-04-10

Family

ID=48023653

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012102999961A Pending CN103037236A (en) 2011-08-22 2012-08-21 Image processing method and apparatus

Country Status (1)

Country Link
CN (1) CN103037236A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754316A (en) * 2013-12-31 2015-07-01 展讯通信(上海)有限公司 3D imaging method and device and imaging system
CN105100769A (en) * 2014-05-05 2015-11-25 浙江大学 Visual effect image or video pair, and generating method and device thereof
CN107431754A (en) * 2015-03-10 2017-12-01 佳能株式会社 Image processing method, image processing apparatus and picture pick-up device
WO2022228368A1 (en) * 2021-04-30 2022-11-03 华为技术有限公司 Image processing method, device and system

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6445833B1 (en) * 1996-07-18 2002-09-03 Sanyo Electric Co., Ltd Device and method for converting two-dimensional video into three-dimensional video
CN1643939A (en) * 2002-03-27 2005-07-20 三洋电机株式会社 Method and apparatus for processing three-dimensional images
CN1956554A (en) * 2005-09-03 2007-05-02 三星电子株式会社 Apparatus and method for processing 3d picture
CN1987929A (en) * 2006-12-27 2007-06-27 浙江大学 Non-linear brightness correcting method based on accumulative histogram
CN101184252A (en) * 2006-11-14 2008-05-21 三星电子株式会社 Method for adjusting disparity in three-dimensional image and three-dimensional imaging device thereof
CN101472190A (en) * 2007-12-28 2009-07-01 深圳华为通信技术有限公司 Multi-visual angle filming and image processing apparatus, system and method as well as decode processing method
CN101567082A (en) * 2009-06-04 2009-10-28 福州华映视讯有限公司 Image processing method and device thereof
CN101841728A (en) * 2003-04-17 2010-09-22 夏普株式会社 3-dimensional image processing apparatus
US20110119708A1 (en) * 2009-11-13 2011-05-19 Samsung Electronics Co., Ltd. Method and apparatus for generating multimedia stream for 3-dimensional reproduction of additional video reproduction information, and method and apparatus for receiving multimedia stream for 3-dimensional reproduction of additional video reproduction information
US20110129144A1 (en) * 2009-11-27 2011-06-02 Sony Corporation Image processing apparatus, image processing method and program
CN102104786A (en) * 2009-12-14 2011-06-22 索尼公司 Image processing device, image processing method and program
WO2011099314A1 (en) * 2010-02-12 2011-08-18 ソニー株式会社 Image processing device, image processing method, and program

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6445833B1 (en) * 1996-07-18 2002-09-03 Sanyo Electric Co., Ltd Device and method for converting two-dimensional video into three-dimensional video
CN1643939A (en) * 2002-03-27 2005-07-20 三洋电机株式会社 Method and apparatus for processing three-dimensional images
CN101841728A (en) * 2003-04-17 2010-09-22 夏普株式会社 3-dimensional image processing apparatus
CN1956554A (en) * 2005-09-03 2007-05-02 三星电子株式会社 Apparatus and method for processing 3d picture
CN101184252A (en) * 2006-11-14 2008-05-21 三星电子株式会社 Method for adjusting disparity in three-dimensional image and three-dimensional imaging device thereof
CN1987929A (en) * 2006-12-27 2007-06-27 浙江大学 Non-linear brightness correcting method based on accumulative histogram
CN101472190A (en) * 2007-12-28 2009-07-01 深圳华为通信技术有限公司 Multi-visual angle filming and image processing apparatus, system and method as well as decode processing method
CN101567082A (en) * 2009-06-04 2009-10-28 福州华映视讯有限公司 Image processing method and device thereof
US20110119708A1 (en) * 2009-11-13 2011-05-19 Samsung Electronics Co., Ltd. Method and apparatus for generating multimedia stream for 3-dimensional reproduction of additional video reproduction information, and method and apparatus for receiving multimedia stream for 3-dimensional reproduction of additional video reproduction information
US20110129144A1 (en) * 2009-11-27 2011-06-02 Sony Corporation Image processing apparatus, image processing method and program
CN102104786A (en) * 2009-12-14 2011-06-22 索尼公司 Image processing device, image processing method and program
WO2011099314A1 (en) * 2010-02-12 2011-08-18 ソニー株式会社 Image processing device, image processing method, and program

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754316A (en) * 2013-12-31 2015-07-01 展讯通信(上海)有限公司 3D imaging method and device and imaging system
CN104754316B (en) * 2013-12-31 2019-01-11 展讯通信(上海)有限公司 A kind of 3D imaging method, device and imaging system
CN105100769A (en) * 2014-05-05 2015-11-25 浙江大学 Visual effect image or video pair, and generating method and device thereof
CN105100769B (en) * 2014-05-05 2018-08-28 浙江大学 The generation method and device of a kind of visual effect image or video pair
CN107431754A (en) * 2015-03-10 2017-12-01 佳能株式会社 Image processing method, image processing apparatus and picture pick-up device
US10545311B2 (en) 2015-03-10 2020-01-28 Canon Kabushiki Kaisha Image processing method, image processing device, and image pickup apparatus
CN107431754B (en) * 2015-03-10 2020-11-03 佳能株式会社 Image processing method, image processing apparatus, and image pickup apparatus
WO2022228368A1 (en) * 2021-04-30 2022-11-03 华为技术有限公司 Image processing method, device and system

Similar Documents

Publication Publication Date Title
US10356375B2 (en) Display device, image processing device and image processing method, and computer program
US8866884B2 (en) Image processing apparatus, image processing method and program
US9525858B2 (en) Depth or disparity map upscaling
JP6094863B2 (en) Image processing apparatus, image processing method, program, integrated circuit
US9172939B2 (en) System and method for adjusting perceived depth of stereoscopic images
WO2012046270A1 (en) Generation of depth data based on spatial light pattern
EP2469870A2 (en) Image processing device, image processing method, and program
US20140333739A1 (en) 3d image display device and method
RU2010123652A (en) SYSTEM AND METHOD FOR VISUALIZING STEREO IMAGES AND MULTI-VIEW IMAGES FOR CONTROL THE PERCEPTION OF DEPTH OF A STEREOSCOPIC IMAGE CREATED BY A TV RECEIVER
US20130141550A1 (en) Method, apparatus and computer program for selecting a stereoscopic imaging viewpoint pair
EP3818695B1 (en) Method and system for forming extended focal planes for large viewpoint changes
KR101674568B1 (en) Image converting device and three dimensional image display device including the same
CN103037236A (en) Image processing method and apparatus
CN105791793A (en) Image processing method and electronic device
JP5878586B2 (en) Image color adjustment method and electronic apparatus therefor
JP2015012429A (en) Image processing apparatus, image processing method, and image processing program
US20120121163A1 (en) 3d display apparatus and method for extracting depth of 3d image thereof
US20130050420A1 (en) Method and apparatus for performing image processing according to disparity information
US20120170841A1 (en) Image processing apparatus and method
KR101632514B1 (en) Method and apparatus for upsampling depth image
US11012605B2 (en) Image processing device, image processing method, and program for generating a focused image
US10063845B2 (en) Guided 3D display adaptation
US9888222B2 (en) Method and device for generating stereoscopic video pair
JP2013546281A (en) Image processing apparatus using energy value, image processing method thereof, and display method
JP2016103797A (en) Image processing device, image processing method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130410