CN101374220B - Method and system for conveying video picture - Google Patents

Method and system for conveying video picture Download PDF

Info

Publication number
CN101374220B
CN101374220B CN2007101475239A CN200710147523A CN101374220B CN 101374220 B CN101374220 B CN 101374220B CN 2007101475239 A CN2007101475239 A CN 2007101475239A CN 200710147523 A CN200710147523 A CN 200710147523A CN 101374220 B CN101374220 B CN 101374220B
Authority
CN
China
Prior art keywords
video pictures
face
data
user
vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2007101475239A
Other languages
Chinese (zh)
Other versions
CN101374220A (en
Inventor
艾斯拉夫
林嘉庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sunplus Technology Co Ltd
Original Assignee
Sunplus Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sunplus Technology Co Ltd filed Critical Sunplus Technology Co Ltd
Priority to CN2007101475239A priority Critical patent/CN101374220B/en
Publication of CN101374220A publication Critical patent/CN101374220A/en
Application granted granted Critical
Publication of CN101374220B publication Critical patent/CN101374220B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to a video image transmitting method and a system. A transmitting terminal only detects and transmits a motion vector corresponding to the change section of the face of a user to a receiving terminal after transmitting a first video image to the receiving terminal, and the motion vector is integrated with the first video image by the receiving terminal to recover the entire video image. Accordingly, the method can effectively reduce the requirement for the network bandwidth and maintain the video quality.

Description

Video pictures transfer approach and system
Technical field
The present invention relates to a kind of video pictures transfer approach and system, particularly a kind of motion-vector that calculates face area in the video pictures that utilizes is in order to the transfer approach and the system of transmission and reconstruction video picture.
Background technology
Along with the progress of wireless communication technique and developing rapidly of broadband system, people in wireless communication networks except linking up with sound and literal, also because the increase of network bandwidth, when jumbo data such as sending and receiving picture, music or video, can be subjected to the restriction on the network transfer speeds hardly again.Just because of this, video calling also becomes the new trend of instant messaging gradually.Be different from traditional talking mode, video calling can not only carry out the interchange on the sound, can also see each other expression and action in whole communication process.
Video pictures mainly is that (International TelecommunicationUnion, ITU) the 3G-324M communication standard that service is formulated at video communication transmits with International Telecommunications Union at present.Based on the static coding scheme H.263 the 3G-324M communication standard is, fixing output bit rate only is provided, and needs to use certain coding parameter.Such mode not only lacks flexibility, and also can't adapt to the demand of full duplex video call system fully.
For instance, when transmitting the bit stream of a video pictures via wireless communication networks, may limit or noise channel and face the puzzlement of transmission data because of frequency range, if video pictures is with the frequency range of the higher quality foundation as coding before transmission, so when network because congested or other situations make present network bandwidth be lower than when encoding the frequency range of institute's reference at that time, it is quite important that effective video Quality Control Mechanism just becomes.Yet, in the 3G-324M communication standard, do not make the related mechanism of any grid of reference flow as yet at present with the control of video quality.Even if therefore under the quite congested situation of network, the video transmission end is when encoding action to video pictures, still can not control its bit rate, therefore may be because frequency range be limited situations such as generation data deficiency, video pictures delay, and then influence the quality of video calling.
Summary of the invention
The purpose of this invention is to provide a kind of video pictures transfer approach, transmitting terminal is transmitting first video pictures to receiving terminal, the data that then only transmits the part that there is change in user face is to receiving terminal, the part that will be changed by receiving terminal is integrated into first video pictures again, saves the purpose that transmits the required network bandwidth of video pictures to reach.
A further object of the present invention provides a kind of video pictures transfer system, transmit first video pictures to receiving system at conveyer, can judge according to network quality and should directly transmit new video pictures, or only transmit the part that there is change in user face, integrate the reduction video pictures by receiving system again, effectively to utilize network bandwidth and to keep good video quality.
Based on above-mentioned and other purpose, the present invention proposes a kind of video pictures transfer approach, be suitable for seeing through wireless communication networks and transmit many video pictures to receiving terminal by transmitting terminal, the method comprises the following steps: at first, captures first video pictures by transmitting terminal from above-mentioned video pictures and is sent to receiving terminal.User's face area of first video pictures of detecting, and be recorded as face's data.Then with first video pictures and face's data transmission to receiving terminal.Capture next video pictures, and calculate the motion-vector of user's face area in next video pictures, send receiving terminal to.According to face's data and motion-vector, calculate the picture data in user's face area in the video pictures by receiving terminal, in conjunction with next video pictures of background frame data reducing of first video pictures.Then repeat above-mentioned steps, the motion-vector that continues acquisition and transmit next video pictures is up to except that first video pictures, till the motion-vector of other each video pictures all transmits and finishes.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein user's face area system is by outwards the expand rectangular block of the area minimum that forms of the profile of user face.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein face's data comprises the coordinate data in user's face area upper left corner and the length and width data of user's face area, and the background frame data then is the data beyond user's face area in the video pictures.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein, more comprise the network quality of detecting wireless communication network, and judge whether network quality is higher than preset value transmitting video pictures and face's data to receiving terminal.If network quality is higher than this preset value, all video pictures that then direct transmission is captured are to receiving terminal; If network quality is lower than preset value, then capture next video pictures, and the motion-vector of user's face area sends receiving terminal in the calculating video pictures.
From another viewpoint, the present invention proposes a kind of video pictures transfer approach in addition, be suitable for seeing through wireless communication networks and transmit many video pictures to receiving terminal by transmitting terminal, the method comprises the following steps: at first, is captured first video pictures and be sent to receiving terminal from above-mentioned video pictures by transmitting terminal.Next detect the face area of user in first video pictures, and be recorded as face's data, and face's center line of decision user, be recorded as face's center line data.With first video pictures, face's data and face's center line data transmission to receiving terminal.Then, next video pictures of acquisition from above-mentioned video pictures, cutting apart user's face area by face's center line of user is two half of zones, calculates the motion-vector in one of them half of zone and sends receiving terminal to.Receiving terminal is according to face's data and motion-vector, calculate the picture data in corresponding half of zone in the corresponding video pictures, again according to face's center line data and motion-vector, extrapolate the picture data of second half edge regions, and, reduce next video pictures in conjunction with the background frame data of first video pictures.Repeat the motion-vector that above-mentioned steps continues acquisition and transmits next video pictures, up to except that first video pictures, till the motion-vector of other each video pictures all transmits and finishes.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein user's face area system outwards expands the rectangular block of the area minimum that forms by the profile of user face.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein determine the method for face's center line to comprise to find out two eye distances from center line, and the center line of corners of the mouth distance one of them or its combination of center line, nose position, eyebrow distance, and face's center line data for example comprises the coordinate data of face's center line two-end-point and mid point.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein half of zone comprise with face's center line cut apart left side face area that user's face area produced or right-hand part face area one of them.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein transmitting video pictures, face's data and face's center line data to receiving terminal, also comprise and measure on user's face area the corresponding focal length of several reference points respectively and be sent to receiving terminal, in order to reference as the action of detecting the user, and then this face's data of uniform zoom.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein also comprise that the transmission end calculates the anglec of rotation according to focal length to the receiving terminal transmitting video pictures, face's data and face's center line data, and the anglec of rotation is sent to receiving terminal, receiving terminal is according to this anglec of rotation then, the picture datas in two half of zones of convergent-divergent.Wherein, the background frame data is the data in the zone beyond user's face area in the video pictures.
According to the described video pictures transfer approach of preferred embodiment of the present invention, wherein to receiving terminal, also comprise the network quality of detecting wireless communication network, and judge whether network quality is higher than preset value in transmission video pictures, face's data and face's center line data.If network quality is higher than preset value, the video pictures that then direct transmission is captured is to receiving terminal; If network quality is lower than preset value, then capture next video pictures, cutting apart user's face area by face's center line is two half of zones, calculates the motion-vector in one of them half of zone and sends receiving terminal to.
From another viewpoint, the present invention proposes a kind of video pictures transfer system, and this system comprises conveyer and receiving system.Wherein, conveyer has comprised image acquisition module, face's detecting module, processing unit, has reached the image transport module.Image acquisition module is in order to capture many video pictures.Face's detecting module is connected to image acquisition module, is used for detecting user's face area of first video pictures of above-mentioned video pictures, and is recorded as face's data.Processing unit is connected to image acquisition module and face's detecting module, is used for calculating by the corresponding motion-vector of other video pictures user face area.The image transport module is connected to processing unit, is used for seeing through first video pictures of wireless communication networks output, face's data, reaches above-mentioned motion-vector.Receiving system has then comprised image receiver module and image integrate module.Wherein the image receiver module is used to receive first video pictures, face's data and the above-mentioned motion-vector that the image transport module by conveyer is transmitted.The image integrate module is connected to the image receiver module, and according to first video pictures, face's data and above-mentioned motion-vector, calculate the picture data of user's face area in the corresponding video pictures, and in conjunction with the background frame data of first video pictures, the reduction video pictures.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein conveyer also comprises face's center line detecting module, is connected to face's detecting module and processing unit.Be used to detect face's center line of user's face area, and be recorded as face's center line data, face's center line data then is sent to the image receiver module via the image transport module.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein processing unit comprises that also cutting apart user's face area by face's center line is two half of zones, calculate one of them corresponding half of motion-vector in half of zone, more half of motion-vector is sent to the image receiver module of receiving system via the image transport module.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein the image integrate module also comprises according to face's data and half of motion-vector, calculate the picture data in half of zone in the corresponding video pictures, again according to face's center line data and half of motion-vector, calculate the picture data of second half edge regions, and in conjunction with the background frame data of first video pictures, and then reduction video pictures.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein face's detecting module also comprises the displacement detection unit, be used to measure the corresponding focal length of a plurality of reference points on user's face area, and see through the image transport module above-mentioned focal length is sent to receiving system, with uniform zoom face data in view of the above.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein face's detecting module more comprises the rotation detecting unit, be used to measure the corresponding focal length of each reference point on user's face area, and calculate the anglec of rotation according to above-mentioned focometer, see through the image transport module again and transmit the anglec of rotation, with the picture data in the half of zone of convergent-divergent in view of the above to receiving system.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein conveyer also comprises network quality discrimination module, network quality in order to the discrimination wireless communication networks, directly to transmit video pictures according to the network quality decision, or only transmit first video pictures, face's data, motion-vector and face's center line data, and then the picture data of integrating half of zone reduces video pictures.
According to the described video pictures transfer system of preferred embodiment of the present invention, wherein conveyer and receiving system comprise mobile phone, personal digital assistant mobile phone, and intelligent mobile phone one of them.
The present invention is when transmitting one group of video pictures, at first make transmitting terminal transmit a complete video pictures to receiving terminal, in the video pictures of next acquisition, the part of detecting and the change of record user face area, send it to receiving terminal, by receiving terminal the face area of change is integrated into previous video pictures again and reduces the whole video picture, with demand that reaches effective minimizing network bandwidth and the purpose of keeping video quality.
For above-mentioned and other purposes, feature and advantage of the present invention can be become apparent, the present invention cited below particularly preferred embodiment, and in conjunction with the accompanying drawings, be described in detail below.
Description of drawings
Fig. 1 is the flow chart of the video pictures transfer approach of the embodiment of the invention one.
Fig. 2 is the video pictures of transmitting terminal acquisition.
Fig. 3 is another video pictures of transmitting terminal acquisition.
Fig. 4 is the flow chart of the video pictures transfer approach of the embodiment of the invention two.
Fig. 5 is user's face area schematic diagram.
Fig. 6 is the block diagram of the video pictures transfer system of the embodiment of the invention three.
Embodiment
In order to make content of the present invention more clear, technical scheme of the present invention is described in detail below in conjunction with drawings and Examples.
The video image of keeping high-res and smoothness is one of necessary condition of guaranteeing video quality, be subjected to the deficiency of the frequency range of wireless communication networks for fear of Video service, and the restriction of coding techniques and produce harmful effects such as picture is discontinuous, picture delay, how to be apt to transmit one of the technology that must pay attention to when video information (for example image, sound) just becomes the development Video service with network bandwidth.
In general, video pictures mainly can be divided into two parts of user's face area and background area, when network congestion makes that frequency range is limited, replace whole video pictures of transmission with the user's face area picture that transmits outbalance and often change, not only can reduce the demand of frequency range, also can not cause too much negative influence simultaneously Video service.The present invention is a kind of video pictures transfer approach and the system that develops based on above-mentioned notion.
Fig. 1 is the flow chart of the video pictures transfer approach of the embodiment of the invention one.Consult Fig. 1, present embodiment is suitable for seeing through for example third generation wireless communication networks by a transmitting terminal, transmits one group of video pictures to receiving terminal, at first, captures first video pictures (step 110) in the above-mentioned video pictures by the transmitting terminal of video pictures.Wherein, capture the video pictures that comes out and mainly can be divided into two parts of user's face area and background area.
Then, utilize for example human face detection (Face Detection) technology, detect user's face area of first video pictures, and it is recorded as face's data (step 120).In the present embodiment, user's face area for example is that the profile with user face is a benchmark, the rectangular block of the minimum area that outwards expands and obtain, the upper left corner coordinate data of rectangular block and length and width thereof then write down face's data of user's face area for this reason.In video pictures, the part except user's face area all will be regarded as the background area of this video pictures, and the information of these background areas will be recorded as the background frame data.
After handling first video pictures, transmitting terminal just can see through wireless communication networks, with first video pictures and face's data transmission of noting before to receiving terminal (step 130).Then, in step 140, transmitting terminal will continue acquisition, and next opens video pictures, calculates the motion-vector of user's face area in the video pictures and sends receiving terminal to.
When receiving terminal is received the motion-vector that is sent by transmitting terminal, promptly can calculate the picture data of user's face area in the present video pictures with reference to previous first video pictures that receives.And then the picture data of this face area combined with background frame data in first video pictures, to restore complete video pictures (step 150).
In order to make the concrete steps of more clearly describing video pictures transfer approach of the present invention, below illustrate for an embodiment again.Fig. 2 is first video pictures 210 that is captured by transmitting terminal, transmitting terminal is behind this video pictures 210 of acquisition, promptly detect the user's face area 220 in the video pictures 210, and record is corresponding to face's data (coordinate (x that for example comprises the top left corner apex L of user's face area 220 of user's face area 220, y), and the length m of user's face area 220 and width n), just give receiving terminal afterwards with video pictures 210 and above-mentioned face data transmission.
Next that transmitting terminal captured opened video pictures then as shown in Figure 3, please consult Fig. 2 and Fig. 3 simultaneously, in the present embodiment, transmitting terminal is behind this video pictures 310 of acquisition, promptly can be according to face's data of precedence record, only calculate the motion-vector (in the present embodiment, only comprising the motion-vector in user's face zone 330) of user's face area 320 in the video pictures 310, and this motion-vector is sent to receiving terminal.
After receiving terminal is received motion-vector, can utilize the coordinate (x of the top left corner apex L of user's face area 220 among Fig. 2, y), face's data such as the length m of user's face area 220 and width n, find out the picture data of face area in the video pictures 210, in conjunction with the motion-vector of video pictures 310, produce the picture data of user's face area of video pictures 310.And then, restore complete video pictures 310 at last with the picture data and the background frame in the video pictures 210 (picture except the user's face area 220) data conformity of this user's face area.
Please get back to the step 160 of Fig. 1, transmitting terminal will capture video pictures unceasingly, and calculate motion-vector and send receiving terminal to.Receiving terminal can reduce every video pictures with said method simultaneously, up to all video pictures all transmit finish till.
What deserves to be mentioned is, in the present embodiment, transmitting terminal can judge that whether the network quality of present wireless communication networks is greater than a preset value (for example 64Kb/s) before step 140, when network quality during greater than preset value, representative has enough frequency ranges, and just the video pictures that directly will capture afterwards is sent to receiving terminal; When network quality during less than preset value, execution in step 140 and transmit video pictures again with said method.
Embodiment three
Fig. 4 is the flow chart of the video pictures transfer approach of the embodiment of the invention three.In the present embodiment, except change motion-vector partly replaces whole video pictures of transmission in corresponding user's face area to transmit, also further symmetry according to user's face area, only transmit the motion-vector in the half of zone of face and bring in the reduction video pictures to reception, its detailed step is as follows:
In step 410, capture first video pictures by transmitting terminal.Then in step 420, detect the user's face area in first video pictures, and be recorded as face's data.Wherein, user's face area for example can be outwards to expand and the rectangular block of the minimum area that obtains with user's face mask, and the upper left corner coordinate data of rectangular block and the length and width of rectangular block thereof then can be in order to represent face's data of this user's face area.Part in the video pictures except user's face area all can be considered as the background area of this video pictures, and the information of these background areas will be recorded as the background frame data.
In step 430, determine face's center line of user by receiving terminal, and be recorded as face's center line data.The method of decision face center line for example comprise find out two eye distances from center line, and the center line of corners of the mouth distance of center line, nose position, eyebrow distance, in addition, also can combinations thereof decide face's midline position of user.And face's center line data for example comprises the coordinate data of the mid point of two end points of face's center line and face's center line.
Next in step 440, then be first video pictures, face's data and the face's center line data that to capture, see through wireless communication networks and send receiving terminal to.Wherein wireless communication networks has for example comprised third generation wireless communication networks.
Shown in step 450, transmitting terminal captures next video pictures, in this video pictures, user's face area is divided into left side face area and these two half of zones of right-hand part face area by face's center line of user, transmitting terminal only calculates the motion-vector in one of them half of zone, and sends this motion-vector to receiving terminal.
Receiving terminal will be by integrating the picture data in face's information and the half of zone of motion-vector reduction after receiving above-mentioned data, and the while also contrast face's center line data, and according to the symmetry of face, restore the picture data of second half edge regions.After treating the picture data reduction in these two half of zones, can be incorporated into the background frame data of precedence record, with reduction whole video picture (step 460).
For instance, in user's face area 510 shown in Figure 5, motion-vector mv is the motion-vector corresponding to the right-hand part face area.Receiving terminal after receiving motion-vector mv, according to face's data (for example the coordinate of the top left corner apex L of user's face area 510 (x, y), length m, and width n) calculate the picture data of right-hand part face area.Then, extrapolate motion-vector mv ' corresponding to the left side face area according to face's center line data.
In an application example, if the coordinate of the mid point M of face's center line is made as (0,0), so as shown in Figure 5, the value as the motion-vector mv of corresponding right-hand part face area is that (i is in the time of j), can extrapolate corresponding left side face area motion-vector value for (i, j).According to this principle, receiving terminal just can calculate the picture data of left side face area, and reduces whole user face picture, merges promptly reducible whole video pictures at last again with the background frame data.
Shown in step 470, transmitting terminal will capture video pictures unceasingly at last, and calculate the motion-vector in corresponding half of zone and send receiving terminal to.Receiving terminal can reduce every video pictures with said method, up to all video pictures all transmit finish till.
In another embodiment of the present invention, transmitting terminal can be detected user's action by the focal length of measuring several reference points on user's face area.Transmitting terminal is after sending these focal lengths to receiving terminal, and receiving terminal is just according to the whole face of the convergent-divergent of these focal length equal proportions data.Transmitting terminal finds that when focal length measurement focal length shortens for example, just represents that the user has the action that moves forward to produce, and receiving terminal just can amplify whole face data in view of the above, with corresponding user's action.
In addition, transmitting terminal also can be calculated an anglec of rotation by the focometer of measuring several reference points on user's face area, calculates the action that the user rotates.Transmitting terminal sends to receiving terminal with this anglec of rotation, and receiving terminal also can carry out the action of convergent-divergent with the reflection user to two half of regional picture datas according to this anglec of rotation.Detailed says, when user's face turned right, receiving terminal can be by the direction of face's center line towards the profile of right-hand part face area, equal proportion dwindle its picture data, and by the direction of face's center line towards the profile of left side face area, equal proportion is amplified its picture data.Wherein, the mode with the focal length calculating anglec of rotation can not need special qualification at present embodiment.
What deserves to be mentioned is that before the step 450 of Fig. 4, transmitting terminal can judge that whether the network quality of present wireless communication networks is greater than a preset value (for example 64Kb/s).When network quality during greater than preset value, representative has enough frequency ranges, and just the video pictures that directly will capture afterwards is sent to receiving terminal; When network quality during less than preset value, execution in step 450 and transmit video pictures again with said method, and increase the elasticity on the displaying video picture.
Below reintroduce a practical video picture transfer system, it can be in order to realize above-mentioned video pictures transfer approach.Fig. 6 is the block diagram of the video pictures transfer system of preferred embodiment of the present invention.In video pictures transfer system 600, comprised conveyer 610 and receiving system 620, this conveyer 610 or receiving system 620 for example are electronic communication equipments such as mobile phone, personal digital assistant mobile phone, or intelligent mobile phone.
Conveyer 610 has comprised image acquisition module 611, face's detecting module 612, face's center line detecting module 613, processing unit 614, has reached image transport module 615.Wherein image acquisition module 611 is in order to the acquisition video pictures, and face's detecting module 612 is used to detect the user's face area by in the video pictures of image acquisition module 611 acquisitions, and is recorded as face's data; Face's center line detecting module 613 is in order to the face's center line on the detecting user face area, and is recorded as face's center line data; Processing unit 614 is connected to image acquisition module 611, face's detecting module 612 and face's center line detecting module 613, and it can be divided into two half of zones with user's face area according to face's center line, and calculates the motion-vector in one of them half of zone; 615 of image transport modules are to be connected to face's detecting module 612, face's center line detecting module 613 and processing unit 614, and see through relevant information needed such as wireless communication networks 630 transmission video pictures, face's data, motion-vector and face's center line data.
In receiving system 620, comprise image receiver module 621, image integrate module 622, reached image display module 623.Wherein image receiver module 621 is used for seeing through video pictures, face data, motion-vector and the face center line data of wireless communication networks 630 receptions by image transport module 615 transmission of conveyer 610; And image integrate module 622 is according to face's data and motion-vector, calculate the picture data in half of zone in the corresponding video pictures, again according to face's center line data and motion-vector, calculate the picture data of second half edge regions according to symmetry, and in conjunction with the background frame data of video pictures, with the reduction video pictures; 623 of image display modules are used to show the video pictures that is reduced by image integrate module 622.
In the present embodiment, face's detecting module 612 has also comprised displacement detection unit (not shown), be used to measure the focal length of a plurality of reference points on user's face area, and see through image transport module 615 above-mentioned focal length is sent to receiving system 620, the image integrate module 622 in the receiving system 620 is focal length uniform zoom face data in view of the above just.In addition, face's detecting module 612 also can comprise rotation detecting unit (not shown), be used to measure the focal length of several reference points on user's face area, and calculate the anglec of rotation according to above-mentioned focometer, see through image transport module 615 again and transmit the anglecs of rotation to receiving system 620, and by the image integrate module 622 in the receiving system 620 respectively according to the picture datas in two half of zones of this anglec of rotation convergent-divergent.
In addition, conveyer 610 has also comprised network quality discrimination module (not shown), it is connected to image transport module 615, the network quality that is used for the discrimination wireless communication networks, and according to network quality decision transmission mode, for example directly transmit video pictures, or only transmit motion-vector and face's center line data to receiving system 620 and integrate the picture datas in two half of zones with the reduction video pictures.Whether above-mentioned judgement can be higher than a preset value by judging this network quality, if be higher than described preset value, directly transmit described video pictures, if be lower than described preset value, then only transmit described motion-vector and described face center line data to receiving system 620 and integrate the picture data in described half of zone and reduce described video pictures.
In sum, video pictures transfer approach of the present invention and system utilize the person's of the being to use face area that often changes in the video pictures, and the characteristic that the background area seldom changes, after transmitting terminal is sent first video pictures, then only transmit the motion-vector of reflection user face area change part, the complete video pictures that replaces required transmission originally, and motion-vector is integrated into the background frame data of the video pictures of receiving for the first time by receiving terminal, to reduce whole video pictures.With respect to transmitting whole video pictures, transmit motion-vector and can significantly reduce the frequency range demand, also can keep the quality and the fluency of video pictures simultaneously.
Though the present invention discloses as above with preferred embodiment; but this is not in order to limit the present invention; any those of ordinary skill in the art; without departing from the spirit and scope of the present invention; when can making various corresponding changes and distortion according to the present invention, but these corresponding change and distortion all should belong to the protection range of the appended claim of the present invention.

Claims (14)

1. a video pictures transfer approach is used for seeing through a wireless communication networks and transmits a plural number video pictures, it is characterized in that this method comprises the following steps:
A. from described video pictures, capture first video pictures by a transmitting terminal;
B. detect user's face area of described first video pictures, and be recorded as face's data;
C. transmit described first video pictures and this face's data to receiving terminal;
D. capture next video pictures, and calculate a motion-vector of user's face area in next video pictures, send described receiving terminal to;
E. described receiving terminal is according to described face data and described motion-vector, calculate described next open the picture data in user's face area in video pictures, and in conjunction with the background frame data of described first video pictures, reduce described next video pictures; And
F. repeating step d and e open in the video pictures except that first video pictures, till the motion-vector of other each video pictures all transmits and finishes up to described plural number.
2. the method for claim 1 is characterized in that,
Face's data among the described step b also comprises: by face's center line data of user's face center line decision;
Described motion-vector in the described steps d is for after being cut apart described user's face area and be two half of zones by face's center line of described user, one of them motion-vector of described two half of zones;
Picture data in the calculating user face area among the described step e comprises: described receiving terminal is according to described face data and described motion-vector, calculate the picture data in corresponding described half of zone in the corresponding video pictures, according to face's center line data and described motion-vector in the described face data, calculate the picture data in another described half of zone again.
3. video pictures transfer approach as claimed in claim 1 or 2 is characterized in that, described user's face area is outwards an expand rectangular block of the area minimum that forms of the profile by user face.
4. video pictures transfer approach as claimed in claim 3 is characterized in that, described face data comprises the coordinate data in described user's face area upper left corner and the length and width data of described user's face area.
5. video pictures transfer approach as claimed in claim 1 or 2 is characterized in that, described background frame data is the data beyond user's face area described in this video pictures.
6. video pictures transfer approach as claimed in claim 1 or 2 is characterized in that, after step c, also comprises before the steps d:
Detect the network quality of described wireless communication networks, and judge whether this network quality is higher than a preset value;
If be higher than described preset value, the video pictures that then direct transmission is captured is to described receiving terminal;
If be lower than described preset value, carry out steps d.
7. video pictures transfer approach as claimed in claim 2 is characterized in that, described face center line data be find out two eye distances from center line, and the center line of corners of the mouth distance one of them or its combination of center line, nose position, eyebrow distance.
8. video pictures transfer approach as claimed in claim 1 or 2 is characterized in that, also comprises after step c:
Described transmitting terminal is measured on described user's face area the corresponding focal length of a plurality of reference points respectively and is sent to described receiving terminal;
Described step e further comprises: described receiving terminal is according to described focal length, the described face of uniform zoom data.
9. video pictures transfer approach as claimed in claim 1 or 2 is characterized in that, also comprises after step c:
Described transmitting terminal is measured the corresponding focal length of a plurality of reference points on described user's face area respectively, calculates an anglec of rotation according to described focal length, and is sent to described receiving terminal; And
Step e also comprises: described receiving terminal is according to the described anglec of rotation, the picture data in the described face area of convergent-divergent.
10. a video pictures transfer system is characterized in that, comprising:
One conveyer comprises:
One image acquisition module is opened video pictures in order to capture plural number;
One face's detecting module is connected to described image acquisition module, is used for detecting user's face area that described plural number is opened first video pictures of video pictures, and is recorded as face's data;
One processing unit is connected to described image acquisition module and described face detecting module, is used to calculate described plural number and opens the corresponding motion-vector of the face area of user described in the video pictures;
One image transport module is connected to described processing unit, is used for seeing through a wireless communication networks
Export described first video pictures, described face data and described motion-vector;
One receiving system comprises:
One image receiver module is used to receive described first video pictures, described face data and the described motion-vector that is transmitted by described image transport module; And
One image integrate module, be connected to described image receiver module, according to described first video pictures, described face data and described motion-vector, calculate the picture data of user's face area described in the corresponding video pictures, and in conjunction with the background frame data of described first video pictures, and then reduce corresponding video pictures.
11. video pictures transfer system as claimed in claim 10 is characterized in that,
Described conveyer also comprises: face's center line detecting module, be connected to described face detecting module and described processing unit, be used to detect face's center line of user's face area of described first video pictures, and being recorded as face's center line data, described face center line data then is sent to described image receiver module via described image transport module;
Described processing unit calculates the corresponding motion-vector of user's face area and is specially: separating described user's face area by described face center line is two half of zones, calculates one of them corresponding half of motion-vector of described half of zone;
The picture data that described image integrate module calculates user's face area described in the corresponding video pictures is specially: according to described face data and described half of motion-vector, calculate the picture data in half of zone described in the corresponding video pictures, according to described face center line data and described half of motion-vector, calculate the picture data in another described half of zone again.
12., it is characterized in that described face detecting module also comprises as claim 10 or 11 described video pictures transfer systems:
One displacement detection unit is used to measure the corresponding focal length of a plurality of reference points on described user's face area, and through described image transport module described a plurality of focal lengths is sent to described receiving system, in order to the described face of uniform zoom data.
13., it is characterized in that described face detecting module also comprises as claim 10 or 11 described video pictures transfer systems:
One rotation detecting unit, be used to measure the corresponding focal length of a plurality of reference points on described user's face area, and calculate an anglec of rotation according to described a plurality of focal lengths, see through described image transport module again and transmit the described anglec of rotation to described receiving system, in order to the picture data of the described face area of convergent-divergent.
14. video pictures transfer system as claimed in claim 11 is characterized in that, described conveyer also comprises:
One network quality discrimination module, be connected to described image transport module, network quality in order to the described wireless communication networks of discrimination, and judge whether this network quality is higher than a preset value, if be higher than described preset value, directly transmit video pictures, if be lower than described preset value, then only transmit described first video pictures, described face data, described motion-vector and described face center line data, and then the picture data of integrating described half of zone reduces video pictures.
CN2007101475239A 2007-08-23 2007-08-23 Method and system for conveying video picture Expired - Fee Related CN101374220B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2007101475239A CN101374220B (en) 2007-08-23 2007-08-23 Method and system for conveying video picture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2007101475239A CN101374220B (en) 2007-08-23 2007-08-23 Method and system for conveying video picture

Publications (2)

Publication Number Publication Date
CN101374220A CN101374220A (en) 2009-02-25
CN101374220B true CN101374220B (en) 2010-06-16

Family

ID=40448117

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101475239A Expired - Fee Related CN101374220B (en) 2007-08-23 2007-08-23 Method and system for conveying video picture

Country Status (1)

Country Link
CN (1) CN101374220B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101706814B (en) * 2009-11-27 2012-06-20 北京汉邦高科数字技术股份有限公司 Motion vector based file storage overlay method
US8320644B2 (en) * 2010-06-15 2012-11-27 Apple Inc. Object detection metadata
US9813666B2 (en) 2012-05-29 2017-11-07 Qualcomm Incorporated Video transmission and reconstruction
CN104618721B (en) * 2015-01-28 2018-01-26 山东大学 The ELF magnetic field human face video coding-decoding method of feature based modeling
CN108900427B (en) * 2018-06-13 2019-04-23 盐城师范学院 Digital content delivery system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0720385A2 (en) * 1994-12-27 1996-07-03 Sharp Kabushiki Kaisha Video encoder with motion area extraction
CN1364033A (en) * 2000-11-28 2002-08-14 国枝博昭 High performance code compressed system for dynamic image data
CN1522073A (en) * 2003-02-10 2004-08-18 ���ǵ�����ʽ���� Video encoder capable of differentially encoding image of speaker during visual call and method for compressing video signal
CN1774065A (en) * 2004-11-09 2006-05-17 日本电气株式会社 Videophone

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0720385A2 (en) * 1994-12-27 1996-07-03 Sharp Kabushiki Kaisha Video encoder with motion area extraction
CN1364033A (en) * 2000-11-28 2002-08-14 国枝博昭 High performance code compressed system for dynamic image data
CN1522073A (en) * 2003-02-10 2004-08-18 ���ǵ�����ʽ���� Video encoder capable of differentially encoding image of speaker during visual call and method for compressing video signal
CN1774065A (en) * 2004-11-09 2006-05-17 日本电气株式会社 Videophone

Also Published As

Publication number Publication date
CN101374220A (en) 2009-02-25

Similar Documents

Publication Publication Date Title
CN101374220B (en) Method and system for conveying video picture
CN102647590A (en) Image compression method and device
US6801642B2 (en) Method and apparatus for limiting storage or transmission of visual information
KR100411372B1 (en) A video information adjustment device, a video information transmission device, and a video information reception device
CN104618195B (en) Bandwidth estimation method and apparatus
CN101119491B (en) Method and apparatus for video telephone in portable terminal
EP1175034A2 (en) A packet data transmission system with adaptive packet size
EP3185480B1 (en) Method and apparatus for processing network jitter, and terminal device
CN111818295B (en) Image acquisition method and device
CN106534211A (en) Data transmission method and electronic equipment
CN111131817A (en) Screen sharing method, device, storage medium and screen sharing system
US20070126861A1 (en) Apparatus and method for connecting video call in mobile terminal
JP2018198406A (en) Surveillance camera system and image processing apparatus
US20060002686A1 (en) Reproducing method, apparatus, and computer-readable recording medium
CN1947428B (en) Method of and system for video fast update
JP5274750B2 (en) Communication terminal and display method thereof
KR101487771B1 (en) Method and apparatus for recovery video informaion in portable communication system
Liu et al. Providing unequal reliability for transmitting layered video streams over wireless networks by multi-ARQ schemes
JP2959178B2 (en) Video signal transmission device
CN101316153B (en) Method and device for buffering data packets transmitted via plesiochronous communication
KR100763308B1 (en) Apparatus and method for taking moving picture in portable terminal
JP2008113226A (en) Communication apparatus and communication method
JP4120824B2 (en) Facsimile communication device
JPH10126755A (en) Video telephone system/video conference terminal equipment, ring multi-point video telephone system/video conference system using the equipment and communication control method
JP3614712B2 (en) Video camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100616

Termination date: 20160823