Summary of the invention
Technical problem to be solved by this invention is to provide a kind of remote presentation method and system, while solving the visual angle tilt problem existed, achieve the hiding setting of local video camera, and still have image to present in the stowed position of video camera, do not affect the long-range display effect presented.
One aspect of the present invention provides a kind of telepresence system, comprise: Video segmentation device, main screen, patch screen and local video camera, described main screen is connected with described Video segmentation device respectively with described patch screen, and described local video camera shields with described Video segmentation device or described patch and is connected; Described main screen is provided with at least one hole, described local video camera is arranged on described hole place, and being positioned at the side in the non-viewing face of described main screen, described patch screen is embedded in described hole, blocks described local video camera and makes described local video camera invisible to described main screen viewing side;
Described Video segmentation device is used for image to be displayed to be divided into master image and patch image, sends described master image to described main screen, sends described patch image to described patch screen;
Described main screen for receiving described master image, and presents described master image;
Described patch screen for receiving described patch image, and presents described patch image;
Described local video camera is used for two frame gaps showing described patch image in described patch screen display, through the local image of described patch screen shooting.
Described local video camera is used for two frame gaps showing described patch image in described patch screen display, through the local image of described patch screen shooting, specifically comprises:
Described local video camera is shielding under synchronous pulse signal controls with described patch, start to take local image when described patch screen terminates the display of described patch image a certain frame, stop the local image of shooting when described patch screen starts the display of described patch image next frame.
Alternatively, described pulse signal is shielded by described Video segmentation device or described patch provides.
Further, described system also comprises: calibrator, and one end of described calibrator is connected with described Video segmentation device, and the other end shields with described patch and is connected;
Described calibrator is used for, according to presetting calibration value, calibrating described patch image, and the image after calibration is sent to described patch screen.
Further, described telepresence system also comprises: calibration camera, for before display image, takes the tinctorial pattern image shown in described main screen and described patch screen display, as the color difference image of reflection image display effect, inputs described calibrator;
The aberration of master image and described patch image described in the more described color difference image of described calibrator, and according to comparative result, adjust the primary colours color range of described master image and/or described patch image, until the aberration of master image and described patch image is minimum described in the described color difference image of shooting, get aberration minimum time primary colours color range be default calibration value;
Wherein, described tinctorial pattern image at least comprises a kind of primary colours, is divided into master image and patch image through described Video segmentation device, be sent to respectively described main screen and described patch screen present.
Alternatively, described patch screen is Organic Electricity laser writer.
Alternatively, can to watch the surface of side equal with the surface that described main screen can watch side for described patch screen.
Alternatively, the background being provided with shelter is adopted when taking described image to be displayed, the position that described shelter is arranged, size and shape, when described image to be displayed is shown, the edge that the edge of shelter described in described image to be displayed and described patch shield aligns, to block the piece between described patch screen and described main screen.
On the other hand, the present invention also provides a kind of remote presentation method, be applicable to a kind of telepresence system, this telepresence system comprises: main screen, and patch screen and local video camera, described main screen is provided with at least one hole, described local video camera is arranged on described hole place, and being positioned at the side in the non-viewing face of described main screen, described patch screen is embedded in described hole, blocks described local video camera and makes described local video camera invisible to described main screen viewing side; Described remote presentation method comprises:
Image to be displayed is divided into master image and patch image, and sends described master image to described main screen, send described patch image to described patch screen;
Described main screen receives described master image, and presents described master image;
Described patch screen receives described patch image, and presents described patch image;
Described local video camera shows two frame gaps of described patch image in described patch screen display, through the local image of described patch screen shooting.
Described local video camera shows two frame gaps of described patch image in described patch screen display, through the local image of described patch screen shooting, is specially:
Described local video camera is shielding under synchronous pulse signal controls with described patch, start to take local image when described patch screen terminates the display of described patch image a certain frame, stop the local image of shooting when described patch screen starts the display of described patch image next frame.
Further, described image to be displayed is divided into master image and patch image after, describedly send described master image to described main screen, before sending described patch image to described patch screen, also comprise:
According to default calibration value, described patch image is calibrated, to reduce aberration when described main screen and described patch screen display are shown.
Further, described basis presets calibration value, before calibrating, also comprises described patch image:
The mutatis mutandis tinctorial pattern Iamge Segmentation of high-ranking officers becomes master image and patch image, and is sent to described main screen respectively and described patch screen presents, and described tinctorial pattern image at least comprises a kind of primary colours;
Take the tinctorial pattern image shown in described main screen and described patch screen display, as the color difference image of reflection image display effect;
The aberration of master image described in more described color difference image and described patch image, and according to comparative result, adjust the primary colours color range of described patch image, until the aberration of master image and described patch image is minimum described in the described color difference image of shooting, get aberration minimum time primary colours color range be default calibration value.
The invention provides a kind of remote presentation method and system, main screen arranges hole, embedding patch shields, after more local video camera being hidden in patch screen, during display: first image to be displayed is divided into master image and patch image, master image is presented in main screen, patch screen then presents patch image, the patch image being presented on master image in main screen and patch screen display is together to form complete image, thus completes image display.Because patch screen blocks effect to local video camera, in main screen viewing side, local video camera is invisible, and the gap (when not showing image) of two two field pictures is shown in patch screen display, local video camera can pass through the local image of patch screen shooting, due to the visual persistence phenomenon of human eye, user it seems as same complete display screen, it is seen that the stabilized image of flicker free, discover less than video camera, therefore technical scheme of the present invention achieves the hiding setting of local video camera, and still have image to present in the stowed position of video camera, do not affect the long-range display effect presented, solve the long-range visual angle tilt problem existed in current communication two party simultaneously, achieve " eye is to eye " in long-distance video communication process.
Embodiment
The embodiment of the present invention provides a kind of remote presentation method and system, is realizing while large-screen eye presents eye, also achieving the hiding setting of local video camera, and still having image to present in the stowed position of video camera, do not affect the long-range display effect presented.
Below in conjunction with accompanying drawing, the embodiment of the present invention is described in detail.Embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
Embodiment one
The embodiment of the present invention provides a kind of telepresence system, as shown in Figure 1, this system comprises: Video segmentation device 11, main screen 13, patch screen 14, and local video camera 15, main screen 13 is connected with Video segmentation device 11 respectively with patch screen 14, and local video camera 15 shields 13 with Video segmentation device 11 or patch and is connected;
With reference to Fig. 3 and Fig. 4, main screen 13 is provided with at least one hole, local video camera 15 is arranged on described hole place, and is positioned at the side in the non-viewing face of main screen 13, patch screen 14 is embedded in described hole, and blocking local video camera 15, to make local video camera 15 pairs of main screens 13 watch side invisible;
Video segmentation device 11, for image to be displayed being divided into master image and patch image, sends described master image to main screen 13, sends described patch image to patch screen 14;
Main screen 13 for receiving described master image, and presents described master image;
Patch screen 14 for receiving described patch image, and presents described patch image;
Local video camera 15, for shielding under synchronous pulse signal controls with described patch, at two frame gaps of patch screen 14 display patch images, takes local image through patch screen 14.
Telepresence system described in the present embodiment comprises at least one local video camera 15, and the quantity of the quantity of hole and patch screen 14 in main screen 13, then identical with the quantity of local video camera 15 accordingly.
When local video camera 15 only has one, as shown in Figure 3, generally dig a hole at the middle position of main screen 13, to arrange local video camera 15 and patch screen 14.In concrete enforcement, the quantity of local video camera 15 or patch screen 14 and setting position, and the quantity of hole, position in main screen 13, can design according to actual needs, the present embodiment is not construed as limiting this.
Telepresence system described in the present embodiment, main screen is embedded with patch screen, after local video camera is then hidden in patch screen, through the local image of patch screen shooting, solve the existing long-range visual angle tilt problem existed in current communication two party, achieve " eye is to eye " in long-distance video communication process, and user discovers less than video camera, achieve video camera and hide setting, and still have remote image to present in the stowed position of video camera, do not affect display effect.
Particularly, as shown in Figure 2, main screen 13 in the present embodiment is preferably projector 12 and projection screen, but do not get rid of the display screen other process conditions allowing to arrange hole, when main screen 13 be projector 12 and projection screen time, Video segmentation device 11 is connected with projector, and projector accepts the master image that Video segmentation device 11 sends, and is presented on projection screen; Described patch screen 14 is preferably transparent display, such as Organic Electricity laser writer (Organic Light Emitting Diode, or transparent liquid crystal display OLED), but equally do not get rid of other displaying scheme yet, as long as this displaying scheme can realize local video camera hide setting, and allow local video camera through the local image of patch screen 14 shooting.
The thickness of existing transparent display about 1 ~ 12 millimeter, is more or less the same with the thickness of main screen 13, therefore can adopt above-mentioned mounting means transparent display being embedded main screen 13, and it is thinner in main screen 13, transparent display is in particular cases thicker, transparent display dispersion can be installed, only ensure that the display screen of transparent display embeds the hole of main screen 13, the surface of the side watched of the two is equal, and other module of transparent display and parts, then can select voluntarily to be arranged on other place, or, main screen 13 can be arranged (suspension) on wall, then dig a hole on wall, local video camera 15 is set in hole, again transparent display is embedded this hole, also or, after main screen 13, support is set, support is installed transparent display and local video camera 15, no matter any mounting means, for improving display effect, all should ensure that transparent display can watch the surface of side equal with the surface that main screen 13 can watch side, the two slitless connection.
For image to be displayed being divided into the Video segmentation device 11 of master image and patch image, the mode that can add required common hardware by software realizes, hardware implementing can certainly be passed through, in concrete enforcement, Video segmentation device 11 may be separately formed device, single-chip microcomputer such as by having programing function realizes, and also accessible site is at projector 12 or patch screen 14, realizes by the hardware in projector 12 or patch screen 14.
Telepresence system described in the present embodiment, in main screen, borehole embeds patch screen, after local video camera is then hidden in patch screen, at two frame gaps of the display patch image of patch screen, through the local image of patch screen shooting, solve the existing long-range visual angle tilt problem existed in current communication two party, achieve " eye is to eye " in long-distance video communication process, and user discovers less than video camera, achieve video camera and hide setting, and still have remote image to present in the stowed position of video camera, do not affect display effect.
Wherein, local video camera 15 is for taking local image at two frame gaps of patch screen 14 display patch image, particularly, local video camera 15 is shielding under 14 synchronous pulse signals control with patch, start to take local image when patch screen 14 terminates the display of patch image a certain frame, stop the local image of shooting when patch screen 14 starts the display of patch image next frame.
In concrete enforcement, alternatively, generate by Video segmentation device 11 or patch screen 14 and shield 14 synchronous pulse signals with patch, control the opening and closing of local video camera 15 shutter (when patch screen 14 is for transparent display, namely synchronization pulse is generated by transparent display), in order to be controlled display two frame gap showing patch image two frame in patch screen display the time for exposure of local video camera 15.
Particularly, shielding under 14 synchronous pulse signals control with patch, local video camera 15 all can be taken once after patch shields each frame end of 14 display patch images, and also can be the some frames (such as every 5 frames) playing patch image at patch screen 14, just shooting once.
Those skilled in the art easily find out, shutter control signal producing method is various, therefore a kind of example is only enumerated: the signal of patch image itself is superimposed with synchronizing signal, this synchronizing signal is obtained by filtering, postponed by delayer again, namely the signal obtained can be used as shutter control signal, for controlling the closedown/unlatching of local video camera 15 electronic shutter, the shutter of local video camera 15 is opened when the concrete value of retardation should make patch shield the display of end patch image a certain frame, the shutter of local video camera 15 is closed when patch screen starts the display of patch image next frame, stop the local image of shooting.
Exemplarily, the corresponding relation that a kind of shutter control signal and transparent display display brightness change as shown in Figure 5, wherein, when patch screen terminates a certain frame display of patch image, shutter opening; When patch screen starts the display of patch image next frame, shutter close.Start once local video camera after showing a few frame of patch image as patch screen display and take local image manipulation, the embodiment of the present invention does not do concrete restriction, can set according to actual needs.During local video camera 15 shutter opening, local video camera 15 is allowed to take local image; During transparent display display image, the electronic shutter of local video camera 15 is in closed condition.Transparent display and local video camera 15 hocket and show and shooting, but the refreshing frequency of transparent display is 50Hz or 60Hz, due to the visual persistence phenomenon of human eye, user can see the stabilized image of flicker free, and acquisition continuous print video image taken by local video camera 15.
When described main screen 13 is the projection screen of projector, alternatively, described projection screen is front throwing curtain, or back-projection screen, or optics curtain.No matter any projection screen, local video camera 15 is all arranged on the side in projection screen non-viewing face.As shown in Figure 4, if projection screen is back-projection screen, local video camera 15 and projector 12 are positioned at homonymy, then, when arranging local video camera 15, note also as projector 12 reserves projecting light path.
Embodiment two
As shown in Figure 6, the embodiment of the present invention also provides another telepresence system, is different from telepresence system described in embodiment one, and this system also comprises: calibrator 16, and one end of calibrator 16 is connected with Video segmentation device 11, and the other end and patch shield 14 and be connected;
Calibrator 16 comprises calibration module 161, and calibration module 161, for according to presetting calibration value, is calibrated patch image, and the image after calibration is sent to patch screen 14.
Patch screen 14 in the present embodiment is different display systems from main screen 13, even if show same picture signal, also difference can be there is in color, brightness and contrast etc., image display effect is inconsistent, obvious piece is there is at the boundary of the two, therefore in order to reduce aberration, improving display effect, needing first to calibrate master image and/or patch image.
For ease of understanding, main screen 13 in the present embodiment is for the projection screen of projector 12, patch screen 14 for transparent display, but should notice that embodiment described herein implements example in order to explain the present invention as just one, is not intended to limit the present invention.
Telepresence system in the present embodiment, calibration module 161, according to default calibration value, is calibrated patch image and exports the image after calibrating to patch screen 14; Certainly, calibration module 161 also can be calibrated master image, and the master image input main screen 13 after calibration presents, and when main screen 13 is the projection screen of projector 12, then input projector 12, now calibrator 16 is connected with Video segmentation device 11 with projector 12 respectively; Or also can calibrate master image and patch image, unification is calibrated to a certain standard value simultaneously, input projector 12 and patch screen 14 show respectively.
Telepresence system in the present embodiment, the master image first exported Video segmentation device or patch image are calibrated and are shown, even if result master image and patch image are shown by different display systems, but there is not aberration when being combined into complete image, piece between the imperceptible patch screen of user and main screen, thus improve display effect.
Wherein, local video camera shows two frame gaps of patch image in patch screen display, through the local image of patch screen shooting, is specially:
Described local video camera is shielding under synchronous pulse signal controls with patch, start to take local image when patch screen terminates the display of patch image a certain frame, stop the local image of shooting when patch screen starts the display of patch image next frame, specifically see described in embodiment one.
Further, as shown in Figure 7, present system described in the present embodiment also to comprise: calibration camera 17, for before display image, the tinctorial pattern image that shooting main screen 13 and patch screen 14 demonstrate, as the color difference image of reflection image display effect, input calibrator 16; Calibrator 16 is also for the aberration of master image and patch image in more described color difference image, and the primary colours color range of patch image is adjusted according to comparative result, until the aberration of master image and patch image is minimum in the color difference image taken of calibration camera 17, get aberration minimum time primary colours color range for presetting calibration value;
Wherein, described tinctorial pattern image at least comprises a kind of primary colours, and tinctorial pattern image is divided into master image and patch image through Video segmentation device 11, is sent to main screen 13 respectively and patch screen 14 presents.
In the present embodiment, calibrator 16 also comprises calibration value generation module 162, calibration value generation module 162 and calibration camera 17, Video segmentation device 11 cooperatively interact automatically to generate and preset calibration value, below to the calibration value setting up procedure of telepresence system, and the course of normal operation of telepresence system is described in detail.
Current display is mostly have employed RGB color standard, obtain color miscellaneous by planting the change of primary colours and their superpositions each other to red (R), green (G), blue (B), RGB represents red, green, blue three primary colours.Use this three kinds of colors, their intensity level is changed in 0 ~ 255 scope, according to the mixing of different ratios, just can reappear shades of colour on screen.Such as, shiny red uses R value 246, G value 20 and B value 50.
Telepresence system is operated under calibration value arranges pattern, and the input of Video segmentation device 11 is switched to tinctorial pattern image, specific as follows:
21, calibration value generation module 162 generates tinctorial pattern image, input video dispenser 11, resolve into master image and patch image, display in main screen 13 and patch screen 14 respectively, for ease of understand, tinctorial pattern image to only include a kind of primary colours, as only included redness (R value 255, G value 0, B value 0);
22, calibration camera 17 takes main screen 13 and patch screen 14 obtains color difference image, feeds back to calibration value generation module 162;
23, calibration value generation module 162 compares the aberration of master image and patch image in color difference image, and according to comparative result, the primary colours color range such as color range plus/minus 1 of adjustment patch image, generates new tinctorial pattern image, input video dispenser 11;
24, repeat above-mentioned steps 21 ~ 23, until the aberration of master image and patch image is minimum in the color difference image of shooting, get aberration minimum time primary colours color range be default calibration value.
Such as, (R value 255, G value 0 in patch image, B value 0) redness, according to step 21 ~ 24 adjust after, color range is adjusted to R value 245, G value 0, during B value 0, the aberration of master image and patch image is minimum, and display effect is relatively consistent, differ minimum, then presetting calibration value is (R value 245, G value 0, B value 0) or-10.
Every color stage because of each primary colours corresponding all exists one and presets calibration value, so the default calibration value of primary colours stores with the form of Color Matching Functions or match colors table usually, for ease of searching, this Color Matching Functions or match colors table can describe by look-up table and piecewise linearity difference.
After pre-setting calibration value, telepresence system is closed calibration value and is arranged pattern, under entering normal mode of operation:
Calibration value generation module 162 and the calibration camera 17 of calibrator are closed;
The input of Video segmentation device 11 switches to remote image;
Remote image resolves into master image and patch image through Video segmentation device 11, master image is in main screen display, patch image then inputs calibration module 161, calibration module 161 is according to default calibration value, particularly, calibration module 161 uses look-up table and piecewise linear interpolation to carry out color matching, obtains correcting image, and correcting image gives patch screen 14 display; Make the patch image that demonstrates consistent with the master image display effect in main screen 13, there is not aberration when being combined into complete image, the imperceptible piece of user, thus improve display effect.Such as, the redness of (R value 255, G value 0, B value 0), after calibration module 161 is calibrated, becomes R value 245, G value 0, B value 0.
For ease of describing and understanding, above-mentioned tinctorial pattern image only includes a kind of primary colours of color range, and in fact, tinctorial pattern image can comprise three primary colors simultaneously, and the color range of each primary colours can change in 0 ~ 255 scope, therefore also can generate the default calibration value of each primary colours during calibration simultaneously.
As shown in Figure 8, wherein alternatively, if arrange speculum 18 in the dead ahead of main screen 13 and patch screen, then local video camera 15 can replace calibration camera, for taking color difference image, does not now need to arrange calibration camera.
Further, alternatively, the background adopted when taking described image to be displayed is provided with shelter, the setting position of described shelter, size and shape, when described image to be displayed is shown, the edge that the edge of shelter described in described image to be displayed and described patch shield aligns, and to block the piece between described patch screen and described main screen, reduces different display aberration further to the impact of display effect.
Different display systems, because also can difference be there is in color, brightness and contrast etc., even if show same picture signal, image display effect is also inconsistent, can there is obvious piece, therefore need to calibrate one of them in advance at the boundary of the two, adjustment picture signal, make to there is not aberration during the image sets synthesis complete image demonstrated, the piece between the display screen of the imperceptible different display system of user, to improve display effect.
Embodiment three
The present invention also provides a kind of remote presentation method, as shown in Figure 9, the method is applicable to a kind of telepresence system, this telepresence system comprises: main screen, and patch screen and local video camera, described main screen is provided with at least one hole, described local video camera is arranged on described hole place, and being positioned at the side in the non-viewing face of described main screen, described patch screen is embedded in described hole, blocks described local video camera and makes described local video camera invisible to described main screen viewing side; Particular location is with reference to shown in Fig. 3 and Fig. 4; Described remote presentation method comprises:
Step 101, image to be displayed is divided into master image and patch image;
Step 102, send described master image to described main screen, send described patch image to described patch screen;
Master image described in this step is presented in main screen, described patch image is presented on patch screen, and the master image in main screen and the patch image on patch screen are together to form complete image, when therefore step 101 is split, the size of patch image should ensure just to be paved with whole patch screen.
Step 103, described main screen receive described master image, and present described master image; Described patch screen receives described patch image, and presents described patch image;
Step 104, described local video camera show two frame gaps of described patch image in described patch screen display, through the local image of described patch screen shooting.
Remote presentation method described in the present embodiment, in main screen, borehole embeds patch screen, after local video camera is then hidden in patch screen, in the display gap of patch screen, through the local image of patch screen shooting, solve the existing long-range visual angle tilt problem existed in current communication two party, achieve " eye is to eye " in long-distance video communication process, and user discovers less than video camera, achieve the hiding setting of video camera, and still have remote image to present in the stowed position of video camera, do not affect display effect.
Further, as shown in Figure 10, described remote presentation method, after step 101 (corresponding step 201), before step 102 (corresponding step 203), also comprises:
Step 202, according to presetting calibration value, described patch image to be calibrated, to reduce aberration when described main screen and described patch screen display are shown.
Remote presentation method in the present embodiment, patch image is first calibrated and shows again, even if result is shown by different display systems, but when being combined into complete image there is not aberration in master image and patch image, piece between the imperceptible patch screen of user and main screen, thus improve display effect.
Further, before step 202, also comprise: pre-set calibration value, as shown in figure 11, specifically comprise:
301, the tinctorial pattern Iamge Segmentation that high-ranking officers are mutatis mutandis becomes master image and patch image, and be sent to respectively main screen and patch screen present, described tinctorial pattern image at least comprises a kind of primary colours;
302, main screen and the tinctorial pattern image shown in patch screen display is taken, as the color difference image of reflection image display effect;
303, the aberration of master image and patch image in color difference image is compared, and according to comparative result, the primary colours color range of adjustment patch image, until master image is minimum with the aberration of patch image in the color difference image of shooting, get aberration minimum time primary colours color range be default calibration value.
Remote presentation method described in the present embodiment, in main screen, borehole embeds patch screen, after local video camera is then hidden in patch screen, achieve the long-range of " eye is to eye " to present, achieve the hiding setting of video camera simultaneously, and still have remote image to present in the stowed position of video camera, do not affect display effect; And method described in the present embodiment first calibrates rear display by image, patch is shielded consistent with main screen display effect, the piece between the imperceptible different display system of user, improves display effect.
Technical characteristic described in the embodiment of the present invention, when not conflicting, can combinationally use arbitrarily mutually.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add required common hardware by software and realize, and can certainly pass through hardware, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in the storage medium that can read, as the floppy disk of computer, hard disk or CD etc., comprise some instructions and perform method described in each embodiment of the present invention in order to make a computer equipment (can be personal computer, server, or the network equipment etc.).
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with the protection range of claim.