Summary of the invention
Technical problem to be solved by this invention is to provide a kind of long-range rendering method and system; When solving the visual angle tilt problem that exists; Realized the hiding setting of local video camera, and still had image to appear, do not influenced the long-range display effect that appears in the stowed position of video camera.
One aspect of the present invention provides a kind of telepresence system; Comprise: video dispenser, main screen, patch screen and local video camera; Said main screen links to each other with said video dispenser respectively with said patch screen, and said local video camera links to each other with said video dispenser or said patch screen; Said main screen is provided with at least one hole; Said local video camera is arranged on the described hole place; And be positioned at a non-side of watching face of said main screen, said patch screen is embedded in described hole, blocks said local video camera and makes said local video camera watch a side invisible to said main screen;
Said video dispenser is used for image to be displayed is divided into master image and patch image, sends said master image to said main screen, sends said patch image to said patch screen;
Said main screen is used to receive said master image, and presents said master image;
Said patch screen is used to receive said patch image, and presents said patch image;
Said local video camera is used for showing at said patch screen two frame gaps of said patch image, sees through said patch screen and takes local image.
Said local video camera is used for showing at said patch screen two frame gaps of said patch image, sees through said patch screen and takes local image, specifically comprises:
Said local video camera is under controlling with the synchronous pulse signal of said patch screen; When said patch screen finishes to begin to take local image when a certain frame of said patch image shows,, the said patch image next frame of said patch screen beginning stops to take local image when showing.
Alternatively, said pulse signal is provided by said video dispenser or said patch screen.
Further, said system also comprises: calibrator, and an end of said calibrator links to each other with said video dispenser, and the other end links to each other with said patch screen;
Said calibrator is used for according to preset calibration value said patch image being calibrated, and the image after will calibrating is sent to said patch screen.
Further, said telepresence system also comprises: calibration camera, be used for before display image, and take the tinctorial pattern image that said main screen and said patch screen demonstrates, as the color difference image of reflection image display effect, import said calibrator;
The aberration of master image and said patch image described in the more said color difference image of said calibrator; And according to comparative result; Adjust the primary colours color range of said master image and/or said patch image; Minimum until master image described in the said color difference image of taking with the aberration of said patch image, get aberration primary colours color range hour for presetting calibration value;
Wherein, said tinctorial pattern image comprises a kind of primary colours at least, is divided into master image and patch image through said video dispenser, is sent to said main screen and said patch screen respectively and appears.
Alternatively, said patch screen is organic electric laser display.
Alternatively, said patch screen can watch the surface of a side can watch the surperficial equal of a side with said main screen.
Alternatively; Adopt the background that is provided with shelter when taking said image to be displayed; Position, size and shape that said shelter is provided with; When said image to be displayed was shown, the edge of edge of shelter described in the said image to be displayed and said patch screen aligned, to block the piece between said patch screen and the said main screen.
On the other hand, the present invention also provides a kind of long-range rendering method, is applicable to a kind of telepresence system; This telepresence system comprises: main screen, and patch screen and local video camera, said main screen is provided with at least one hole; Said local video camera is arranged on the described hole place; And be positioned at a non-side of watching face of said main screen, said patch screen is embedded in described hole, blocks said local video camera and makes said local video camera watch a side invisible to said main screen; Said long-range rendering method comprises:
Image to be displayed is divided into master image and patch image, and sends said master image, send said patch image to said patch screen to said main screen;
Said main screen receives said master image, and presents said master image;
Said patch screen receives said patch image, and presents said patch image;
Said local video camera sees through said patch screen and takes local image at two frame gaps of the said patch image of said patch screen demonstration.
Said local video camera sees through said patch screen and takes local image at two frame gaps of the said patch image of said patch screen demonstration, is specially:
Said local video camera is under controlling with the synchronous pulse signal of said patch screen; When said patch screen finishes to begin to take local image when a certain frame of said patch image shows,, the said patch image next frame of said patch screen beginning stops to take local image when showing.
Further, said image to be displayed is divided into after master image and the patch image, saidly sends said master image, before said patch screen sends said patch image, also comprise to said main screen:
Based on preset calibration value, said patch image is calibrated the aberration when showing to reduce said main screen and said patch screen.
Further, said basis is preset calibration value, before said patch image is calibrated, also comprises:
The mutatis mutandis tinctorial pattern image segmentation of high-ranking officers becomes master image and patch image, and is sent to said main screen respectively and shields with said patch and appear, and said tinctorial pattern image comprises a kind of primary colours at least;
Take the tinctorial pattern image that said main screen and said patch screen demonstrates, as the color difference image of reflection image display effect;
The aberration of master image described in the more said color difference image and said patch image; And according to comparative result; Adjust the primary colours color range of said patch image; Minimum until master image described in the said color difference image of taking with the aberration of said patch image, get aberration primary colours color range hour for presetting calibration value.
The present invention provides a kind of long-range rendering method and system, on main screen, hole is set, and embeds the patch screen; Again local video camera is hidden in after the patch screen; During demonstration: earlier image to be displayed is divided into master image and patch image, master image is presented on the main screen, then presents the patch image on the patch screen; Be presented on master image on the main screen and go up the patch image that shows with the patch screen and be together to form complete image, thereby accomplish the image demonstration.Because of of the block effect of patch screen to local video camera, watch a side at main screen, local video camera is invisible; And showing gap when display image (not) of two two field pictures at patch screen, local video camera can see through the patch screen and take local image, because the persistence of vision phenomenon of human eye; The user it seems like same complete display screen; What see is the stabilized image of flicker free, discovers less than video camera, and therefore technical scheme according to the invention has realized the hiding setting of local video camera; And the stowed position at video camera still has image to appear; Do not influence the long-range display effect that appears, solved the long-range visual angle tilt problem that current communication two party exists that is simultaneously, realized " eye is to eye " in the long-distance video communication process.
Embodiment
The embodiment of the invention provides a kind of long-range rendering method and system, when realizing that the large-screen eye appears eye, has also realized the hiding setting of local video camera, and has still had image to appear in the stowed position of video camera, does not influence the long-range display effect that appears.
Below in conjunction with accompanying drawing the embodiment of the invention is described in detail.Embodiment described herein is only in order to explaining the present invention, and is not used in qualification the present invention.
Embodiment one
The embodiment of the invention provides a kind of telepresence system; As shown in Figure 1, this system comprises: video dispenser 11, main screen 13; Patch screen 14; And local video camera 15, main screen 13 links to each other with video dispenser 11 respectively with patch screen 14, and local video camera 15 links to each other with video dispenser 11 or patch screen 13;
With reference to Fig. 3 and Fig. 4; Main screen 13 is provided with at least one hole, and local video camera 15 is arranged on the described hole place, and is positioned at a non-side of watching face of main screen 13; Patch screen 14 is embedded in described hole, blocks local video camera 15 and makes 15 pairs of main screens 13 of local video camera watch a side invisible;
Video dispenser 11 is used for image to be displayed is divided into master image and patch image, sends said master image to main screen 13, sends said patch image to patch screen 14;
Main screen 13 is used to receive said master image, and presents said master image;
Patch screen 14 is used to receive said patch image, and presents said patch image;
Local video camera 15 is used under controlling with the synchronous pulse signal of said patch screen, at two frame gaps of patch screen 14 demonstration patch images, seeing through the local image of patch screen 14 shootings.
The said telepresence system of present embodiment comprises at least one local video camera 15, and the main quantity of hole on 13 and the quantity of patch screen 14 of shielding, then the quantity with local video camera 15 is identical accordingly.
When local video camera 15 has only one, as shown in Figure 3, generally dig a hole, so that local video camera 15 and patch screen 14 to be set at the middle position of main screen 13.In the practical implementation, local video camera 15 or patch shield 14 quantity and the position are set, and main quantity, position of shielding hole on 13, can design according to actual needs, and present embodiment does not limit this.
The described telepresence system of present embodiment, on main screen, embedding has patch screen, local video camera then to be hidden in after the patch screen; See through the patch screen and take local image, solved the existing long-range visual angle tilt problem that current communication two party exists that is, realized " eye is to eye " in the long-distance video communication process; And the user discovers less than video camera; Realized the hiding setting of video camera, and still had remote image to appear, do not influenced display effect in the stowed position of video camera.
Particularly; As shown in Figure 2, the main screen 13 in the present embodiment is preferably projector 12 and projection screen, but does not get rid of the display screen that allows to be provided with hole on other process conditions; When main screen 13 is projector 12 and projection screen; Video dispenser 11 links to each other with projector, and projector accepts the master image that video dispenser 11 sends, and is presented on the projection screen; Said patch screen 14 is preferably transparent display; For example organic electric laser display (Organic Light Emitting Diode; OLED) or transparent LCD; But equally do not get rid of other displaying scheme yet, need only this displaying scheme and can realize the hiding setting of local video camera, and allow local video camera to get final product through the local image of patch screen 14 shootings.
About 1~12 millimeter of the thickness of existing transparent display is more or less the same with the thickness of main screen 13, therefore can adopt the above-mentioned mounting means that transparent display is embedded main screen 13; And thinner at master's screen 13, transparent display is in particular cases thicker, can transparent display disperseed to install, and only guarantee that the display screen of transparent display embeds the hole of master's screen 13; The two watch the surperficial equal of a side, and other module and the parts of transparent display then can select to be installed in other place voluntarily; Perhaps, can (suspension) be set on wall, on wall, dig a hole then leading screen 13; Local video camera 15 is set in the hole, again transparent display is embedded this hole, also perhaps; After main screen 13, support is set, installation transparent display and local video camera 15 on support, no matter any mounting means; Be to improve display effect, all should guarantee that surface that transparent display can watch a side shields 13 and can watch the surperficial equal of a side, the two slitless connection with main.
Be used for image to be displayed is divided into the video dispenser 11 of master image and patch image; Can realize by the mode that software adds essential common hardware, can certainly realize through hardware, in the practical implementation; Video dispenser 11 may be separately formed device; For example realize, also can be integrated in projector 12 or patch screen 14, realize by the hardware in projector 12 or the patch screen 14 through single-chip microcomputer with programing function.
The described telepresence system of present embodiment, borehole embeds the patch screen on main screen, and local video camera then is hidden in after the patch screen; Two frame gaps at the demonstration patch image of patch screen; See through the patch screen and take local image, solved the existing long-range visual angle tilt problem that current communication two party exists that is, realized " eye is to eye " in the long-distance video communication process; And the user discovers less than video camera; Realized the hiding setting of video camera, and still had remote image to appear, do not influenced display effect in the stowed position of video camera.
Wherein, Local video camera 15 is used for taking local image at two frame gaps of patch screen 14 demonstration patch images; Particularly; Local video camera 15 when patch screen 14 finishes to begin to take local image when a certain frame of patch images shows, stops to take local image shielding 14 synchronous pulse signals controls down with patch when the 14 beginning patch image next frames demonstrations of patch screen.
In the practical implementation; Alternatively; Can shield 14 generations and patch through video dispenser 11 or patch and shield 14 synchronous pulse signals; Control the opening and closing (when patch screen 14 is transparent display, promptly generating synchronization pulse) of local video camera 15 shutters, be controlled at patch in order to time for exposure and shield demonstration two frame gaps that show patch image two frames local video camera 15 through transparent display.
Particularly; Shielding under the control of 14 synchronous pulse signals with patch; Local video camera 15 can all be taken once after patch shields each frame end of 14 demonstration patch images, also can be some frames (for example per 5 frames) of playing the patch images at patch screen 14, just takes once.
Those skilled in the art are prone to find out; The shutter control signal producing method is various, and therefore only enumerate a kind of example: the signal of patch image itself is superimposed with synchronizing signal, obtains this synchronizing signal through filtering; Postpone through delayer again; The signal that obtains promptly can be used as shutter control signal, is used to control closing/opening of local video camera 15 electronic shutters, and the concrete value of retardation should make the patch screen finish to open when a certain frame of patch image shows the shutter of local video camera 15; Close the shutter of local video camera 15 when patch screen beginning patch image next frame shows, stop to take local image.
Exemplarily, the corresponding relation that a kind of shutter control signal and transparent display display brightness change is as shown in Figure 5, wherein, when a certain frame of patch screen end patch image shows, shutter opening; When patch screen beginning patch image next frame shows, shutter close.Take local image manipulation as for the once local video camera of beginning behind several frames of patch screen demonstration patch image, the embodiment of the invention is not done concrete qualification, can set based on actual needs.During local video camera 15 shutter openings, allow local video camera 15 to take local image; During the transparent display display image, the electronic shutter of local video camera 15 is in closed condition.Transparent display and local video camera 15 hocket and show and shooting; But the refreshing frequency of transparent display is 50Hz or 60Hz; Because the persistence of vision phenomenon of human eye, the user can see the stabilized image of flicker free, and local video camera 15 is taken acquisition continuous video image.
When said main screen 13 was the projection screen of projector, alternatively, said projection screen was preceding throwing curtain, perhaps rear-projection curtain, perhaps optics curtain.Any projection screen no matter, local video camera 15 all is arranged on the non-side of watching face of projection screen.As shown in Figure 4, if projection screen is the rear-projection curtain, local video camera 15 is positioned at homonymy with projector 12, when local video camera 15 then is set, notes also to projector 12 and reserves projecting light path.
Embodiment two
As shown in Figure 6, the embodiment of the invention also provides another telepresence system, is different from embodiment one said telepresence system, and this system also comprises: calibrator 16, and an end of calibrator 16 links to each other with video dispenser 11, and the other end links to each other with patch screen 14;
Calibrator 16 comprises calibration module 161, and calibration module 161 is used for according to preset calibration value the patch image being calibrated, and the image after will calibrating is sent to patch screen 14.
Patch screen 14 in the present embodiment is different display systems with main screen 13; Even if show same picture signal, also can there be difference at aspects such as color, brightness and contrasts, image display effect is inconsistent; There is tangible piece in boundary at the two; Therefore in order to reduce aberration, improve display effect, need earlier master image and/or patch image to be calibrated.
For ease of understanding; Main screen 13 projection screens with projector 12 in the present embodiment are example; Patch screen 14 is an example with the transparent display, but should note embodiment described herein as just a kind of enforcement example in order to explaining the present invention, and be not used in qualification the present invention.
Telepresence system in the present embodiment, calibration module 161 be based on preset calibration value, and image to the patch screen 14 after the calibration is calibrated and exported to the patch image; Certainly, calibration module 161 also can be calibrated master image, and the main screen 13 of master image input after the calibration appears, and when main screen 13 is the projection screen of projector 12, then imports projector 12, and this moment, calibrator 16 linked to each other with video dispenser 11 with projector 12 respectively; Perhaps, also can calibrate master image and patch image simultaneously, unification is calibrated to a certain standard value, imports projector 12 respectively and shows with patch screen 14.
Telepresence system in the present embodiment; Earlier the master image or the patch image of the output of video dispenser are calibrated demonstration again; Even result's master image shows through different display systems with the patch image; But there is not aberration when being combined into complete image, the piece between imperceptible patch screen of user and main screen, thus improved display effect.
Wherein, local video camera sees through the patch screen and takes local image at two frame gaps of patch screen demonstration patch image, is specially:
Said local video camera is under controlling with the synchronous pulse signal of patch screen; When the patch screen finishes to begin to take local image when a certain frame of patch image shows; When patch screen beginning patch image next frame shows, stop to take local image, specifically see described in the embodiment one.
Further, as shown in Figure 7, the said system that appears of present embodiment also comprises: calibration camera 17; Be used for before display image; Take main screen 13 and the patch screen 14 tinctorial pattern images that demonstrate, as the color difference image of reflection image display effect, input calibrator 16; Calibrator 16 also is used for the aberration of more said color difference image master image and patch image; And based on the primary colours color range of comparative result adjustment patch image; The aberration of master image and patch image is minimum in the color difference image that calibration camera 17 is taken, and gets aberration primary colours color range hour for presetting calibration value;
Wherein, said tinctorial pattern image comprises a kind of primary colours at least, and the tinctorial pattern image is divided into master image and patch image through video dispenser 11, is sent to main screen 13 respectively and appears with patch screen 14.
In the present embodiment; Calibrator 16 also comprises calibration value generation module 162; Calibration value generation module 162 cooperatively interacts with calibration camera 17, video dispenser 11 and generates preset calibration value automatically; Face the calibration value setting up procedure of telepresence system down, and the course of normal operation of telepresence system is described in detail.
Present display mostly is to have adopted the RGB color standard, and the variation through red (R), green (G), blue (B) being planted primary colours and their stacks each other obtain color miscellaneous, and RGB represents three primary colours of red, green, blue.Use this three kinds of colors, their intensity level is changed in 0~255 scope,, just can on screen, reappear shades of colour according to different mixed.For example, shiny red uses R value 246, G value 20 and B value 50.
Telepresence system is operated in calibration value and is provided with under the pattern, and the input of video dispenser 11 switches to the tinctorial pattern image, and is specific as follows:
21, calibration value generation module 162 generates the tinctorial pattern image, and input video dispenser 11 resolves into master image and patch image; Shield on 14 with patch at main screen 13 respectively and show that for ease of understanding, the tinctorial pattern image is an example to include only a kind of primary colours; As include only redness (R value 255, G value 0, B value 0);
22, main screen 13 of calibration camera 17 shootings and patch screen 14 obtain color difference image, feed back to calibration value generation module 162;
23, the aberration of master image and patch image in the calibration value generation module 162 comparison colours difference images, and according to comparative result, the primary colours color range of adjustment patch image for example color range adds/subtracts 1, generates new tinctorial pattern image, input video dispenser 11;
24, repeat above-mentioned steps 21~23, master image is minimum with the aberration of patch image in the color difference image of taking, and gets aberration primary colours color range hour for presetting calibration value.
For example, the redness of (R value 255, G value 0, B value 0) in the patch image; After step 21~24 adjustment, color range is adjusted into R value 245, and G value 0 is during B value 0; The aberration of master image and patch image is minimum, and display effect is consistent relatively, differs minimum; Then preset calibration value be (R value 245, G value 0, B value 0) perhaps-10.
Because of all there is a preset calibration value in each color ranges of corresponding each primary colours; So the preset calibration value of primary colours is usually with the stored in form of match colors function or match colors table; For ease of searching, this match colors function or the available look-up table of match colors table and piecewise linearity difference are described.
After pre-setting calibration value, telepresence system is closed calibration value pattern is set, and gets under the normal mode of operation:
The calibration value generation module 162 and the calibration camera 17 of calibrator are closed;
The input of video dispenser 11 switches to remote image;
Remote image resolves into master image and patch image through video dispenser 11; Master image shows that the patch image is then imported calibration module 161 on main screen, calibration module 161 is according to preset calibration value; Particularly; Calibration module 161 uses look-up table and piecewise linear interpolation to carry out color matching, obtains correcting image, and correcting image is given patch screen 14 and shown; Make the patch image that demonstrates consistent, do not have aberration when being combined into complete image with main master image display effect of shielding on 13, the imperceptible piece of user, thus improved display effect.For example, the redness of (R value 255, G value 0, B value 0) becomes R value 245, G value 0, B value 0 after calibration module 161 calibrations.
For ease of narration and understanding, above-mentioned tinctorial pattern image includes only a kind of primary colours of color range, and in fact, the tinctorial pattern image can comprise three primary colors simultaneously, and the color range of each primary colours can change in 0~255 scope, also can generate the preset calibration value of each primary colours when therefore calibrating simultaneously.
As shown in Figure 8, wherein alternatively, if in the dead ahead of main screen 13 and patch screen speculum 18 is set, then local video camera 15 is the instead calibration camera, is used to take color difference image, and need not be provided with calibration camera this moment.
Further; Alternatively, the background that adopts when taking said image to be displayed is provided with shelter, said shelter position, size and shape be set; When said image to be displayed is shown; The edge of edge of shelter described in the said image to be displayed and said patch screen aligns, and to block the piece between said patch screen and the said main screen, further reduces the influence of different display aberration to display effect.
Different display systems is because of also existing difference at aspects such as color, brightness and contrasts, even if show same picture signal; Image display effect is also inconsistent, can have tangible piece at the boundary of the two, therefore needs in advance one of them to be calibrated; The adjustment picture signal; Do not have aberration when making the image sets that demonstrates synthesize complete image, the piece between the display screen of the imperceptible different display systems of user is to improve display effect.
Embodiment three
The present invention also provides a kind of long-range rendering method, and is as shown in Figure 9, and this method is applicable to a kind of telepresence system; This telepresence system comprises: main screen, and patch screen and local video camera, said main screen is provided with at least one hole; Said local video camera is arranged on the described hole place; And be positioned at a non-side of watching face of said main screen, said patch screen is embedded in described hole, blocks said local video camera and makes said local video camera watch a side invisible to said main screen; Particular location is with reference to Fig. 3 and shown in Figure 4; Said long-range rendering method comprises:
Step 101, image to be displayed is divided into master image and patch image;
Step 102, send said master image, send said patch image to said patch screen to said main screen;
Master image described in this step is presented on the main screen; Described patch image is presented on the patch screen; And the master image on the main screen is together to form complete image with patch image on the patch screen, so step 101 is when cutting apart, and the size of patch image should guarantee to be paved with just whole patch and shield.
Step 103, said main screen receive said master image, and present said master image; Said patch screen receives said patch image, and presents said patch image;
Step 104, said local video camera shield two frame gaps that show said patch image at said patch, see through said patch screen and take local image.
The described long-range rendering method of present embodiment, borehole embeds the patch screen on main screen, and local video camera then is hidden in after the patch screen; Demonstration gap at the patch screen; See through the patch screen and take local image, solved the existing long-range visual angle tilt problem that current communication two party exists that is, realized " eye is to eye " in the long-distance video communication process; And the user discovers less than video camera; Realized the hiding setting of video camera, and still had remote image to appear, do not influenced display effect in the stowed position of video camera.
Further, shown in figure 10, said long-range rendering method in step 101 (corresponding step 201) afterwards, step 102 (corresponding step 203) also comprises before:
Step 202, the preset calibration value of basis are calibrated said patch image, the aberration when shielding demonstration to reduce said main screen and said patch.
Long-range rendering method in the present embodiment; The patch image is calibrated demonstration more earlier; Even the result shows through different display systems; But there are not aberration in master image and patch image when being combined into complete image, the piece between imperceptible patch screen of user and main screen, thus improved display effect.
Further, before the step 202, also comprise: calibration value is set in advance, shown in figure 11, specifically comprise:
301, the mutatis mutandis tinctorial pattern image segmentation of high-ranking officers becomes master image and patch image, and is sent to main screen respectively and shields with patch and appear, and said tinctorial pattern image comprises a kind of primary colours at least;
302, take the tinctorial pattern image that main screen and patch screen demonstrate, as the color difference image of reflection image display effect;
303, the aberration of master image and patch image in the comparison colours difference image; And according to comparative result; The primary colours color range of adjustment patch image, master image is minimum with the aberration of patch image in the color difference image of taking, and gets aberration primary colours color range hour for presetting calibration value.
The described long-range rendering method of present embodiment; Borehole embeds the patch screen on main screen; Local video camera then is hidden in after the patch screen, has realized long-range the appearing of " eye is to eye ", has realized the hiding setting of video camera simultaneously; And the stowed position at video camera still has remote image to appear, and does not influence display effect; And the said method of present embodiment calibrate afterwards earlier through image and shows, make patch shield and the master to shield display effect consistent, the piece between the imperceptible different display systems of user has improved display effect.
The described technical characterictic of the embodiment of the invention under the situation of not conflicting, can be used in combination arbitrarily each other.
Through the description of above execution mode, the those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential common hardware, can certainly pass through hardware, but the former is better execution mode under a lot of situation.Based on such understanding; The part that technical scheme of the present invention contributes to prior art in essence in other words can be come out with the embodied of software product, and this computer software product is stored in the storage medium that can read, like the floppy disk of computer; Hard disk or CD etc.; Comprise some instructions with so that computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
The above; Be merely embodiment of the present invention, but protection scope of the present invention is not limited thereto, any technical staff who is familiar with the present technique field is in the technical scope that the present invention discloses; Can expect easily changing or replacement, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion by said protection range with claim.