CN104902017A - Remote interaction method of multi-screen synchronous display supporting QoS - Google Patents
Remote interaction method of multi-screen synchronous display supporting QoS Download PDFInfo
- Publication number
- CN104902017A CN104902017A CN201510258579.6A CN201510258579A CN104902017A CN 104902017 A CN104902017 A CN 104902017A CN 201510258579 A CN201510258579 A CN 201510258579A CN 104902017 A CN104902017 A CN 104902017A
- Authority
- CN
- China
- Prior art keywords
- user side
- viewing area
- interactive
- request
- synchronization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a remote interaction method of multi-screen synchronous display supporting QoS. The remote interaction method comprises steps of establishing an interaction platform of synchronous display; sharing file source data bags of synchronous interaction; entering a synchronous interaction interface; performing synchronous interaction; exiting the synchronous interaction interface; and canceling the interaction platform. According to the invention, the file source data bags are firstly shared to the interaction platform, so a user end should load the file source data bags containing larger data amount in advance, and then can enter the synchronous interaction interface to perform synchronous interaction with other user ends. During the synchronous interaction process, instruction information containing smaller data amount and file source update logs are mainly transported and interaction of multi-screen synchronous and precise procedures is achieved.
Description
Technical field
The present invention relates to a kind of synchronization interactive technical field, specifically refer to a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting.
Background technology
The interactive mainly IP based network of current multi-screen synchronous and after adopting the whole screen of periodic refreshing screenshotss transfer to that the mode of far-end carries out, no matter screen has no change all to carry out the transmission of whole screen shots, a large amount of Installed System Memory and CPU usage in the Internet resources that the method consumption is a large amount of and occupied terminal equipment.And IP network is the network of a kind of " doing one's best ", it is not provided services on the Internet quality Q oS(Quality of Service) pledge system, when the needs simultaneously multiple business such as transmission of video, audio frequency, data, limit by the network bandwidth and speed, can cause excessive time delay, block phenomenons such as timing, the effect of synchronization interactive is not ideal enough.In order to ensure network service quality, strengthen the experience of user, a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting is proposed, adopt the segment transmissions of data and the transfer of data that reduces in synchronization interactive process, ensure the simultaneous display of multi-screen and the accurately smooth Interactive Experience of user side.
Summary of the invention
The object of the present invention is to provide a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting, adopt the segment transmissions of data and the transfer of data that reduces in synchronization interactive process, ensure the simultaneous display of multi-screen and the accurately smooth Interactive Experience of user side.
The present invention is achieved through the following technical solutions: a kind ofly support the remote interaction method that the multi-screen synchronous of QoS shows, and comprises the following steps:
Step S100: the interaction platform setting up simultaneous display;
Step S200: the file source data bag sharing synchronization interactive;
Step IF110: whether the webserver is constantly searched for has new access request or new request of exiting to occur, if having, jump procedure IF210, if without, continue to perform step S200;
Step IF210: after access request or request of exiting process, judge the numerical value of user side sum N in interaction platform, N is nonnegative integer, if N=0, directly jump procedure S600, if N=1, jump procedure S500, if N >=2, performs step S300;
Step S300: enter synchronization interactive interface;
Step S400: synchronization interactive;
Step IF120: whether the webserver is constantly searched for has new access request or new request of exiting to occur, if having, jump procedure IF220, if without, continue to perform step S400;
Step IF220: after access request or request of exiting process, judges the numerical value of user side sum N in interaction platform, if N=0, and directly jump procedure S600, if N=1, jump procedure S500, if N >=2, continues to perform step S300;
Step S500: exit synchronization interactive interface, and jump procedure S200;
Step S600: cancel interaction platform;
Described step S100: any one user side sends interactive request by means of No. ID unique in the interaction platform obtained after succeeding in registration to the webserver, sets up interaction platform and waits for adding of other users; User side in described interaction platform is connected by the webserver, and by the data in webserver called data server;
Described step S200: automatically generate the Shared Folders in a subsidiary default document source and be stored in data server in interaction platform, having there is Shared Folders does not then repeat newly-built, any one user side in interaction platform adopts the large Data Transport Protocol preset, download for other users from the memory module upload file source material bag to Shared Folders of this locality, or download file source material bag carries out this locality storage to the memory module of this locality from Shared Folders; Data server constantly sends to the user side in interaction platform and calls file source information, user side sends feedback daily record to data server and whether stores up-to-date complete file source data bag to detect in local memory module, the user side not completing download continues to load until complete download or exit download, the user side having completed download stops downloading, and realizes sharing of file source data bag; Described file source data handbag draws together file source and file source Update log, and file source, file source Update log include the command information in the multi-medium data in multimedia file, the figure layer data in layer file, command file and the time script flow in associated with; Described time script flow refers to that synchronization module carries out synchronization association and the data recorded in xml format according to the timestamp stream of interaction platform timed sending to multi-medium data, figure layer data, command information;
Described step S300: the user side completing the download of file source data bag enters synchronization interactive interface, call file source data bag and load the fixing interactive viewing area of length-width ratio, the data of the user side having loaded interactive viewing area only in transaction file source material bag, complete after up-to-date interactive viewing area loads and perform step S400; Described interactive viewing area comprises the instruction list on the broadcast layer of lower floor, the transparent layer on upper strata and backstage, in broadcast layer loading multimedia data when loading interactive viewing area, transparent layer is set up with upper left summit be the origin of coordinates, horizontal direction is for X-axis and the vertical direction coordinate system that is Y-axis load figure layer data, in instruction list load instructions information; In described coordinate system, each coordinate points is coordinate pixel;
Described step S400: any one user side in interaction platform carries out operation to be made to change in interactive viewing area in the interactive viewing area of this locality, the change of interactive viewing area is converted into by instruction, word, the command information of ordered series of numbers composition, command information is sent to data server by local terminal coding packing, be sent to other-end after being called by the webserver again to decode, decoded command information is carried out changing rear classification and is loaded on broadcast layer or transparent layer by other-end, and carry out synchronous calibration by synchronization module the interactive viewing area of multiple user side is synchronously changed, realize the interactive operation of multi-screen,
Described step S500: when only having a user side in synchronization interactive interface, cannot carry out synchronization interactive and exit from synchronization interactive interface;
Described step S600: when not having user side in interaction platform, this interaction platform is cancelled automatically.
Described step S100, step S200, step S300, step S400, step S500, step S600 are main flow; Described step IF110, step IF210, step IF120, step IF220 intert the secondary flow process of constantly carrying out condition judgment in main flow.
The first, in the present invention any one user side by authentication can set up a provisional interaction platform for simultaneous display by network and in interaction platform with other user side opening relationships; User side in interaction platform is first shared the file source data bag of synchronization interactive and is carried out just entering synchronization interactive interface after this locality stores, and the multi-screen synchronous interaction under synchronization interactive interface mainly relies on the transmission of the small data file such as command information, Update log to carry out.Method involved in the present invention is by the large data files such as audio frequency, video originally needing to carry out transmitting in synchronization interactive process and support that the user side that the default file of synchronization interactive shares in interaction platform with the form of file source data bag loads in advance, reduce the transmission of data in synchronization interactive process, save the Internet resources in synchronization interactive process, avoid network congestion and the time delay caused or packet loss, support QoS network service quality pledge system, ensure simultaneous display and the accurate smooth Interactive Experience of user side of multi-screen.
On the one hand, although the user side being in different network environments exists larger difference when load document source material bag, in synchronization interactive process, the data volume due to transmission is less and be not easy to be subject to network environment influence, thus has the experience of good synchronization interactive.
On the other hand, because the large data files such as audio frequency, video can load in advance, break through the restriction of the network bandwidth and transmission speed, the resource such as high quality audio, video can be shared, promote Consumer's Experience further.
Second, interaction platform in the present invention is open, relative to enclosed interaction platform, the user side satisfied condition can freely add or exit and not affect the synchronization interactive of other user sides, for all user sides in interaction platform have built more comfortable experience environment.Meanwhile, the user side newly added, by realizing after load document source material bag and adding the synchronous of user side synchronization interactive interface, ensures the effect of synchronization interactive.
3rd, that avoids data in the present invention repeats transmission as far as possible, as as described in step S200, if user side has loaded up-to-date file source data Bao Ze completely without the need to repeated downloads, if user side has loaded the partial data in up-to-date file source data bag, only download missing data without the need to downloading repeating data, reduce the transmission of data in network with this, save Internet resources, improve the efficiency of data sharing.Described file source data handbag draws together file source, file source Update log, file source is basic data bag, and file source Update log is the packet of multi-medium data when temporally to stab in stream recording synchronism interactive process synchronization interactive each time, figure layer data, change that command information occurs separately and three's incidence relation.As long as the user side in synchronization interactive interface loads up-to-date file source Update log can realize synchronization interactive.
4th, in order to adapt to the terminal equipment of different user end in the present invention, as as described in step S300, only on the display of terminal equipment, load the fixing interactive viewing area of a length-width ratio, user side can wake up according to actual conditions, hide, drag, amplify, reduce interactive viewing area.Interactive viewing area in the present invention, relative to full frame loading, has two main advantages: one be user side display on reserve part privacy zone, user friendly other operation; Although two is that size different but length-width ratio in interactive viewing area is fixed, is equivalent to zoom in or out in proportion, reduces the amount of calculation of data in simultaneous display process, improve the speed of service further and ensure the real-time smoothness of synchronization interactive process.
5th, interactive viewing area is divided into the broadcast layer of lower floor, the transparent layer on upper strata and the instruction list on backstage by the present invention, broadcast layer is mainly used in play multimedia file, transparent layer is equivalent to electronic whiteboard and is mainly used in the operation of the layer files such as annotations and comments, and instruction list is mainly used in the Background scheduling of instruction.Call instruction can realize different input equipment to the broadcast state of multimedia file, the control of playing progress rate and to the editor etc. annotating and commenting on form in layer file.Therefore, the operation such as the annotations and comments in transparent layer does not affect the broadcasting of multimedia file, and the backstage that is invoked at of instruction does not affect display effect.
6th, GET or the POST requests such as the present invention constantly searches for access request, exits request in interaction platform, synchronization request, control request process in time, fast response time, strengthen Consumer's Experience.
Further, described step S400 specifically refers to following steps:
Step S410: any one user side becomes control end, other user sides become participation end, and only control end has operating rights;
Step S420: whether the synchronization module of control end monitors local input unit has action, if without, be failure to actuate, if having, send synchronization request to the webserver and perform step S430 after synchronization request is authorized;
Step S430: the synchronization module of control end judges whether interactive viewing area changes, if without, be failure to actuate, if having, change corresponding for interactive viewing area be converted to command information and generate corresponding file source Update log, then jump procedure S440;
Step S440: command information, file source Update log are encoded by control end and packed, adopt the small data transmission agreement preset to be sent to data server, be added into Shared Folders by data server and carry out upgrading and to preserve and the participation end be forwarded in interaction platform is decoded;
Step S450: decoded command information carries out synchronism output in the interactive viewing area participating in end;
Step S460: after this synchronization interactive completes, again jump procedure S410 and realize interaction.
Any one user side entering interactive viewing area in the present invention can become control end and operate, if but have multiple user side to carry out processing ease to cause interference simultaneously, especially, when user side quantity is more, multi-user holds operation simultaneously can increase system operations amount and to cause system to be run quickly routed.In order to reduce the computational burden of system, only having a control end to have operating rights in section at one time in limits synchronization interactive process of the present invention but the control end of different time sections can freely switch, realizing in order with this, interactive efficiently.
Further, described step S410 specifically comprises the following steps:
Step S411: in interaction platform, each user side sorts by the time sequencing adding interaction platform, and control thread and formation control thread list by webserver Match in sequence; Described control thread is divided into online, enliven, vacancy three kinds of states, the control thread shared by user side entering synchronization interactive interface is presence, the online control thread having operating rights is active state, the control thread shared by user side exiting synchronization interactive interface is open position, the control thread foremost that acquiescence is in line states is active state, the user side that the control thread of active state is corresponding is control end, and the user side that the control thread of presence is corresponding is held for participating in;
Step S412: when the webserver receives and exits request, agree to that the user side sending the request of exiting exits synchronization interactive interface, corresponding control thread becomes open position from presence and waits for redistributing of the webserver, generate control thread change daily record to preserve, the control thread order that other user sides are corresponding and position do not change simultaneously;
Step S413: when the webserver receives access request, agree to that the user side sending access request adds synchronization interactive interface, transfer control thread change daily record to retrieve the control thread that whether there is open position in existing control thread list simultaneously, if have, the control thread of any one open position is dispensed to this user side, if without, a newly-built control thread is dispensed to this user side;
Step S414: whether the webserver is constantly searched for new control request, if having, jump procedure S415, if without, be failure to actuate;
Step S415: any one participates in end and sends to the webserver request of control, to request forward be controlled to current control end by the webserver, if current control end is agreed to, current control end power out of hand and become and participate in end and this participation end sending the request of control obtains control and becomes control end, if current control end is not agreed to, control constant and this control request and lost efficacy.
Relate to the method that control end is selected and switched in the present invention, under satisfied reality uses the prerequisite of needs, reduce the treating capacity of data as far as possible.
Further, in described step S430, the change of interactive viewing area comprises the change of coordinate pixel and corresponding color value thereof in the change of multimedia file broadcast state, playing progress rate in broadcast layer or transparent layer; Described step S430 specifically comprises the following steps:
Step S431: control end judges the change whether having corresponding local mouse action in interactive viewing area, if without, perform step S432, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S432: control end judges the change whether having corresponding local touch screen operation in interactive viewing area, if without, perform step S433, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S433: control end judges the change whether having corresponding local keyboard operation in interactive viewing area, if without, perform step S434, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S434: control end judges the change whether having respective local audio acquisition module to operate in interactive viewing area, if without, perform step S435, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S435: control end judges the change whether having corresponding local video acquisition module to operate in interactive viewing area, if without, be failure to actuate, if having, change corresponding for interactive viewing area be converted to jump procedure S440 after command information.
Change in the present invention in the interactive viewing area of control end is by occasions listen, and change in the interactive viewing area of control end is relevant to the action of multiple input unit.The present invention is that the action of different input unit sets different priority and the monitoring that according to priority circulates successively, to reduce the double counting of data, to improve the efficiency of monitoring.
Further, described step S450 specifically comprises the following steps:
Step S451: the size of the interactive viewing area of control end compares with the size participating in the interactive viewing area of holding and obtains ratio;
Step S452: the change that control end mouse action is corresponding is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S453: the change that control end touch screen operation is corresponding is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S454: change corresponding to control end keyboard operation is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S455: the change of control end audio collection module operation correspondence is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S456: the change of control end video acquisition module operation correspondence is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S457: after having exported, the synchronization module participating in end sends synchronous calibration request to the webserver;
Step S458: after synchronous calibration request is passed through, time script flow up-to-date in webserver calling data server is forwarded to and participates in end;
Step S459: after the synchronization module participating in holding receives time script flow, resolves time script flow and carries out synchronous calibration.
After listening to the change in the interactive viewing area of control end in the present invention, as as described in step S451, first obtain the interactive viewing area of control end and the ratio participating in holding interactive viewing area size, for another example described in step S452, step S453, step S454, step S455, step S456, according to priority obtain the action of different input unit respectively and call corresponding command information and export, last as described in step S457, step S458, step S459, also carry out synchronous calibration after each step synchronization interactive completes, synchronously experience more accurately for user provides.
Further, described step S453 specifically comprises the following steps:
Step S4531: obtain on control end touch-screen and be positioned at the track streaked interactive viewing area;
Step S4532: the track obtained in step S4531 is converted into a series of sampled point, the coordinate contrasted on local transparent print layer obtains the coordinate figure of all sampled points;
Step S4533: the color value that in obtaining step S4532, sampled point is corresponding;
Step S4534: according to the sequencing of sampled point, is undertaken coordinate figure and color value associating rear and forming ordered series of numbers;
Step S4535: according to the coordinate figure in the interactive viewing area of the ratio calculation sampled point that obtains in step S451 this participations corresponding end and the color value that associates of respective coordinates value is constant and obtain new ordered series of numbers, coordinate figure in new ordered series of numbers and the color value associated are exported to and participates in the interactive viewing area of end, realize the synchronization interactive of track.
After listening to the change in the interactive viewing area of control end in the present invention, as as described in step S451, first obtain the interactive viewing area of control end and the ratio participating in holding interactive viewing area size, for another example described in step S452, step S453, step S454, step S455, step S456, according to priority obtain the action of different input unit respectively and call corresponding command information and export, last as described in step S457, step S458, step S459, also carry out synchronous calibration after each group synchronization interactive completes, synchronously experience more accurately for user provides.
In the present invention, user side can carry out the annotations and comments comprising the editor such as word, figure in transparent layer, annotations and comments are not carry out remote synchronization by the picture of screenshotss, but editor's action of annotations and comments be converted to the command information that is made up of instruction, word, ordered series of numbers and transmit with Java form, for the picture transfer of a large amount of screenshotss, the data volume of command information transmission is little many, little by network environment influence, unobstructed transfer of data can be ensured.
Described word comprises Chinese character, English character, numerical character, sign character, existing Chinese character, English character, numerical character, sign character can directly be called, the character conversion of figure or other None-identifieds is a series of coordinate pixel, the changes such as the change reflection figure of coordinate pixel attribute, the coordinate pixel of attribute change is sampled point.The attribute of described coordinate pixel comprises the color value that coordinate figure associates with coordinate figure therewith, forms an item in ordered series of numbers with the coordinate figure of decimal representation with the color value of hexadecimal representation after associating.The attribute of a series of sampled point forms ordered series of numbers.
Further, after described step S459 specifically refers to that the synchronization module participating in end resolves time script flow, obtain control end and participate in holding the time difference responding latest command information, if the time difference, in the threshold values of setting, is failure to actuate, if the time difference exceeds the threshold values of setting, carry out synchroballistic, complete synchronous calibration.
Allow in synchronization interactive process, between different user end, to there is certain response time in the present invention poor, but in order to improve the accuracy of multi-screen synchronous, start synchroballistic when the response time difference of unique user end exceeds the threshold values of setting, complete synchronous calibration, keep the accurate synchronization of multi-screen.
Further, the large Data Transport Protocol preset in described step S200 adopts RTP/RTCP agreement; In described step S440, described default small data transmission agreement adopts ICP/IP protocol.
The large data files such as sound intermediate frequency of the present invention, video adopt RTP/RTCP agreement to transmit after Software Coding, H.264 algorithm compress; Command information, control thread change the small data file such as daily record, file source Update log and adopt ICP/IP protocol to transmit.Described RTP(Realtime Transport Protocol) be RTP; Described RTCP(Realtime Transport Control Protocol) be RTCP Real-time Transport Control Protocol; Described RTP/RTCP agreement is applied transport layer protocol, RTP and RTCP with the use of, efficiency of transmission optimization can be made effectively to feed back with minimum expense, therefore be particularly suitable for the real time data in transport network.Described TCP(Transmission Control Protocol) be transmission control protocol; Described IP(Internet Protocol) be network interconnection agreement; Described ICP/IP protocol is made up of the IP agreement of network layer and the Transmission Control Protocol of transport layer, does not rely on any specific computer hardware or operating system, provides reliable transfer of data.Described RTP/RTCP agreement, ICP/IP protocol are prior art and improvement of the present invention does not lie in this yet, therefore repeats no more.
Further, described step IF110 specifically comprises the following steps:
Step IF111: whether the webserver is constantly searched for new access request, if having, performs step IF112, if without, jump procedure IF113;
Step IF112: the access request completing the user side that file source data bag is downloaded is passed through, the access request not completing the user side that file source data bag is downloaded is refused, the numerical value of N is recalculated after processing access request, if this batch of access request is by p, the numerical value of N increases p, performs step IF113 after completing the calculating of N;
Step IF113: whether the webserver is constantly searched for have and new exited request, if having, performs step IF114, if without, continue to perform step S200;
Step IF114: the request of exiting is passed through, recalculates the numerical value of N after processing the request of exiting, if this batch exits request by q, the numerical value of N reduces q, performs step IF210 after completing the calculating of N;
Described step IF120 specifically comprises the following steps:
Step IF121: whether the webserver is constantly searched for new access request, if having, performs step IF122, if without, jump procedure IF123;
Step IF122: the access request completing the user side that file source data bag is downloaded is passed through, the access request not completing the user side that file source data bag is downloaded is refused, the numerical value of N is recalculated after processing access request, if this batch of access request is by r, the numerical value of N increases r, performs step IF123 after completing the calculating of N;
Step IF123: whether the webserver is constantly searched for have and new exited request, if having, performs step IF124, if without, continue to perform step S400;
Step IF124: the request of exiting is passed through, recalculates the numerical value of N after processing the request of exiting, if this batch exits request by s, the numerical value of N reduces s, performs step IF220 after completing the calculating of N.
In the present invention, the webserver is constantly searched for access request or exits request, and the priority of access request is higher than exiting request, so first process access request reprocessing exits request.
Further, described multimedia file comprises audio file, video file, electronic book documentary, electronic courseware file, photo files, OFFICE office document.
In the present invention, broadcast layer can load dissimilar multimedia file to adapt to actual needs.
The present invention compared with prior art, has the following advantages and beneficial effect:
(1) the present invention supports that the file source resource bag of synchronization interactive is shared the qualified user side of confession to the Shared Folders of interaction platform in advance and carried out this locality storage, synchronization interactive mainly relies on the transmission of the small data file such as command information, Update log to carry out, data segment transmission and then the transfer of data reduced in synchronization interactive process, reduce synchronization interactive process to the dependence of network environment, support QoS network service quality pledge system, ensure simultaneous display and the accurate smooth Interactive Experience of user side of multi-screen.
(2) the present invention supports open interaction platform, for all user sides in interaction platform have built more comfortable experience environment.
(3) the present invention adopts different data processing methods in synchronization interactive process, reduces the occupation rate of Internet resources and Installed System Memory as much as possible, promotes Consumer's Experience further.
Accompanying drawing explanation
Fig. 1 is main flow figure of the present invention.
Embodiment
Below in conjunction with embodiment, the present invention is described in further detail, but embodiments of the present invention are not limited thereto.
Embodiment 1:
The a kind of of the present embodiment supports the remote interaction method that the multi-screen synchronous of QoS shows, and as shown in Figure 1, is mainly achieved through the following technical solutions: comprise the following steps:
Step S100: the interaction platform setting up simultaneous display;
Step S200: the file source data bag sharing synchronization interactive;
Step IF110: whether the webserver is constantly searched for has new access request or new request of exiting to occur, if having, jump procedure IF210, if without, continue to perform step S200;
Step IF210: after access request or request of exiting process, judge the numerical value of user side sum N in interaction platform, N is nonnegative integer, if N=0, directly jump procedure S600, if N=1, jump procedure S500, if N >=2, performs step S300;
Step S300: enter synchronization interactive interface;
Step S400: synchronization interactive;
Step IF120: whether the webserver is constantly searched for has new access request or new request of exiting to occur, if having, jump procedure IF220, if without, continue to perform step S400;
Step IF220: after access request or request of exiting process, judges the numerical value of user side sum N in interaction platform, if N=0, and directly jump procedure S600, if N=1, jump procedure S500, if N >=2, continues to perform step S300;
Step S500: exit synchronization interactive interface, and jump procedure S200;
Step S600: cancel interaction platform;
Described step S100: any one user side sends interactive request by means of No. ID unique in the interaction platform obtained after succeeding in registration to the webserver, sets up interaction platform and waits for adding of other users; User side in described interaction platform is connected by the webserver, and by the data in webserver called data server;
Described step S200: automatically generate the Shared Folders in a subsidiary default document source and be stored in data server in interaction platform, having there is Shared Folders does not then repeat newly-built, any one user side in interaction platform adopts the large Data Transport Protocol preset, download for other users from the memory module upload file source material bag to Shared Folders of this locality, or download file source material bag carries out this locality storage to the memory module of this locality from Shared Folders; Data server constantly sends to the user side in interaction platform and calls file source information, user side sends feedback daily record to data server and whether stores up-to-date complete file source data bag to detect in local memory module, the user side not completing download continues to load until complete download or exit download, the user side having completed download stops downloading, and realizes sharing of file source data bag; Described file source data handbag draws together file source and file source Update log, and file source, file source Update log include the command information in the multi-medium data in multimedia file, the figure layer data in layer file, command file and the time script flow in associated with; Described time script flow refers to that synchronization module carries out synchronization association and the data recorded in xml format according to the timestamp stream of interaction platform timed sending to multi-medium data, figure layer data, command information;
Described step S300: the user side completing the download of file source data bag enters synchronization interactive interface, call file source data bag and load the fixing interactive viewing area of length-width ratio, the data of the user side having loaded interactive viewing area only in transaction file source material bag, complete after up-to-date interactive viewing area loads and perform step S400; Described interactive viewing area comprises the instruction list on the broadcast layer of lower floor, the transparent layer on upper strata and backstage, in broadcast layer loading multimedia data when loading interactive viewing area, transparent layer is set up with upper left summit be the origin of coordinates, horizontal direction is for X-axis and the vertical direction coordinate system that is Y-axis load figure layer data, in instruction list load instructions information; In described coordinate system, each coordinate points is coordinate pixel;
Described step S400: any one user side in interaction platform carries out operation to be made to change in interactive viewing area in the interactive viewing area of this locality, the change of interactive viewing area is converted into by instruction, word, the command information of ordered series of numbers composition, command information is sent to data server by local terminal coding packing, be sent to other-end after being called by the webserver again to decode, decoded command information is carried out changing rear classification and is loaded on broadcast layer or transparent layer by other-end, and carry out synchronous calibration by synchronization module the interactive viewing area of multiple user side is synchronously changed, realize the interactive operation of multi-screen,
Described step S500: when only having a user side in synchronization interactive interface, cannot carry out synchronization interactive and exit from synchronization interactive interface;
Described step S600: when not having user side in interaction platform, this interaction platform is cancelled automatically.
Embodiment 2:
The present embodiment comprises the following steps:
Step S100:A user side sends interactive request by means of No. ID unique in the interaction platform obtained after succeeding in registration to the webserver, sets up interaction platform and waits for adding of other users;
Step S200: automatically generate the Shared Folders in a subsidiary default document source in interaction platform and be stored in data server, party A-subscriber holds and adopts RTP/RTCP agreement to download for other users from the memory module upload file source material bag to Shared Folders of this locality;
Step IF111: the webserver access request that section receives party B-subscriber's end at one time, C user side, D user side, E user side send, jump procedure IF112;
Step IF112: data server detects that party A-subscriber holds, stored complete file source data bag in the local memory module of BYong Huduan, C user side, D user side; E user side just at download file source material bag, so by the access request of party B-subscriber's end, C user side, D user side, the access request of refusal E user side, now p=3, N=4, performs step IF113;
Step IF113: the webserver search D user side send exit request, perform step IF114;
Step IF114: the request of exiting is passed through, now q=1, N=3, perform step IF210;
Step IF210: now N=3 meets the condition of N >=2, performs step S300;
Step S300:A user side, BYong Huduan, C user side enter synchronization interactive interface, and party A-subscriber holds and loads the interactive viewing area of A, and party B-subscriber holds and loads the interactive viewing area of B, and C user side loads the interactive viewing area of C, and interactive viewing area has loaded rear execution step S400;
Step S400: concrete steps are as follows:
Step S410:A user side becomes control end and has operating rights, and BYong Huduan, C user side becomes participation end;
The synchronization module of step S420:A user side does not hear local input unit action, continue to perform step S420, until the synchronization module of party A-subscriber's end listens to local input unit action, party A-subscriber's end sends synchronization request to the webserver and perform step S430 after synchronization request is authorized;
The synchronization module of step S430:A user side does not find that the interactive viewing area of A changes, continue to perform step S430, until the synchronization module of party A-subscriber's end finds that the interactive viewing area of A changes, change corresponding for interactive for A viewing area is converted to command information and spanned file source Update log, then jump procedure S440;
Step S440: command information, 1# file source Update log hold coding packing by party A-subscriber, adopt ICP/IP protocol to be sent to data server, by data server be added into Shared Folders carry out renewals preserve and be forwarded to party B-subscriber's end respectively, C user side decodes;
Step S450:B user side by decoded command information synchronism output to the interactive viewing area of B, simultaneously C user side by decoded command information synchronism output to the interactive viewing area of C;
Step IF121: the webserver access request that section receives D user side at one time, E user side sends, performs step IF122;
Step IF122: data server detects D user side, complete file source data bag has been stored in the local memory module of E user side, the file source data bag of D user side not only described in complete download the present embodiment step S200 is also newly downloaded 1# file source Update log described in the present embodiment step S440, E user side breakpoint has renewed the also newly downloaded 1# file source Update log described in the present embodiment step S440 of file source data bag described in the present embodiment step S200, therefore D user side, E user side passes through access request, now p=2, N=5, perform step IF123,
Step IF123: what the webserver searched that party A-subscriber holds transmission exits request, performs step IF124;
Step IF124: the request of exiting is passed through, now q=1, N=4, perform step IF220;
Step IF220: now N=4 meets the condition of N >=2, performs step S300;
Step S300:D user side, E user side enter synchronization interactive interface, and party A-subscriber's end exits synchronization interactive interface,
D user side loads the interactive viewing area of D, and E user side loads the interactive viewing area of E, and respective interactive viewing area has loaded rear execution step S400;
Step S400: concrete steps are as follows:
Step S410:B user side according to condition becomes control end automatically, but E user side sends the request of control, party B-subscriber hold agree to its control request after E user side become control end and have operating rights, BYong Huduan, C user side, D user side become and participate in end;
The synchronization module of step S420:E user side does not hear local input unit action, continue to perform step S420, until the synchronization module of E user side listens to local input unit action, E user side sends synchronization request to the webserver and perform step S430 after synchronization request is authorized;
The synchronization module of step S430:E user side does not find that the interactive viewing area of E changes, continue to perform step S430, until the synchronization module of E user side finds that the interactive viewing area of E changes, change corresponding for interactive for E viewing area is converted to command information and spanned file source Update log, then jump procedure S440;
Step S440: command information, 2# file source Update log are encoded by E user side and packed, adopt ICP/IP protocol to be sent to data server, by data server be added into Shared Folders carry out renewals preservation and be forwarded to party B-subscriber's end respectively, C user side, D user side decode;
Step S450:B user side by decoded command information synchronism output to the interactive viewing area of B, C user side by decoded command information synchronism output to the interactive viewing area of C, simultaneously D user side by decoded command information synchronism output to the interactive viewing area of D; Now, the synchronization module of C user side detects that synchronization time difference exceeds the threshold values of setting, after sending synchronous calibration request to the webserver, synchronous calibration request by and carry out synchronous calibration by the time script flow in 2# file source Update log in webserver calling data server;
Step S460: after this synchronization interactive completes, again jump procedure S410 and realize interaction;
Step IF121: whether the webserver is constantly searched for new access request, does not receive new access request, jump procedure IF123;
Step IF123: the webserver receives party B-subscriber's end, C user side, E user side send exits request, performs step IF124;
Step IF124: the request of exiting is passed through, BYong Huduan, C user side, E user side exit synchronization interactive interface, now s=3, N=1, perform step IF220;
Step IF220: now N=1 meets the condition of N=1, jump procedure S500;
Step S500:D user side exits synchronization interactive interface, and jump procedure S200;
The file source data bag described in the present embodiment step S200 has been stored in the memory module of step S200:D user side this locality, and the 1# file source Update log described in the present embodiment step S440,2# file source Update log, without the need to repeated downloads;
Step IF111: the webserver does not receive new access request, jump procedure IF113;
Step IF113: what the webserver received that D user side sends exits request, performs step IF114;
The request of exiting of step IF114:D user side is passed through, now q=1, N=0, performs step IF210;
Step IF210: now N=0 meets the condition of N=0, direct jump procedure S600;
Step S600: do not have user side in interaction platform, this interaction platform temporarily set up automatically is cancelled and removes all data in Shared Folders.
Other parts of the present embodiment are identical with embodiment 1, therefore repeat no more.
The above is only preferred embodiment of the present invention, and not do any pro forma restriction to the present invention, every any simple modification, equivalent variations done above embodiment according to technical spirit of the present invention, all falls within protection scope of the present invention.
Claims (10)
1. support to it is characterized in that the remote interaction method that the multi-screen synchronous of QoS shows comprising the following steps:
Step S100: the interaction platform setting up simultaneous display;
Step S200: the file source data bag sharing synchronization interactive;
Step IF110: whether the webserver is constantly searched for has new access request or new request of exiting to occur, if having, jump procedure IF210, if without, continue to perform step S200;
Step IF210: after access request or request of exiting process, judge the numerical value of user side sum N in interaction platform, N is nonnegative integer, if N=0, directly jump procedure S600, if N=1, jump procedure S500, if N >=2, performs step S300;
Step S300: enter synchronization interactive interface;
Step S400: synchronization interactive;
Step IF120: whether the webserver is constantly searched for has new access request or new request of exiting to occur, if having, jump procedure IF220, if without, continue to perform step S400;
Step IF220: after access request or request of exiting process, judges the numerical value of user side sum N in interaction platform, if N=0, and directly jump procedure S600, if N=1, jump procedure S500, if N >=2, continues to perform step S300;
Step S500: exit synchronization interactive interface, and jump procedure S200;
Step S600: cancel interaction platform;
Described step S100: any one user side sends interactive request by means of No. ID unique in the interaction platform obtained after succeeding in registration to the webserver, sets up interaction platform and waits for adding of other users; User side in described interaction platform is connected by the webserver, and by the data in webserver called data server;
Described step S200: automatically generate the Shared Folders in a subsidiary default document source and be stored in data server in interaction platform, having there is Shared Folders does not then repeat newly-built, any one user side in interaction platform adopts the large Data Transport Protocol preset, download for other users from the memory module upload file source material bag to Shared Folders of this locality, or download file source material bag carries out this locality storage to the memory module of this locality from Shared Folders; Data server constantly sends to the user side in interaction platform and calls file source information, user side sends feedback daily record to data server and whether stores up-to-date complete file source data bag to detect in local memory module, the user side not completing download continues to load until complete download or exit download, the user side having completed download stops downloading, and realizes sharing of file source data bag; Described file source data handbag draws together file source and file source Update log, and file source, file source Update log include the command information in the multi-medium data in multimedia file, the figure layer data in layer file, command file and the time script flow in associated with; Described time script flow refers to that synchronization module carries out synchronization association and the data recorded in xml format according to the timestamp stream of interaction platform timed sending to multi-medium data, figure layer data, command information;
Described step S300: the user side completing the download of file source data bag enters synchronization interactive interface, call file source data bag and load the fixing interactive viewing area of length-width ratio, the data of the user side having loaded interactive viewing area only in transaction file source material bag, complete after up-to-date interactive viewing area loads and perform step S400; Described interactive viewing area comprises the instruction list on the broadcast layer of lower floor, the transparent layer on upper strata and backstage, in broadcast layer loading multimedia data when loading interactive viewing area, transparent layer is set up with upper left summit be the origin of coordinates, horizontal direction is for X-axis and the vertical direction coordinate system that is Y-axis load figure layer data, in instruction list load instructions information; In described coordinate system, each coordinate points is coordinate pixel;
Described step S400: any one user side in interaction platform carries out operation to be made to change in interactive viewing area in the interactive viewing area of this locality, the change of interactive viewing area is converted into by instruction, word, the command information of ordered series of numbers composition, command information is sent to data server by local terminal coding packing, be sent to other-end after being called by the webserver again to decode, decoded command information is carried out changing rear classification and is loaded on broadcast layer or transparent layer by other-end, and carry out synchronous calibration by synchronization module the interactive viewing area of multiple user side is synchronously changed, realize the interactive operation of multi-screen,
Described step S500: when only having a user side in synchronization interactive interface, cannot carry out synchronization interactive and exit from synchronization interactive interface;
Described step S600: when not having user side in interaction platform, this interaction platform is cancelled automatically.
2. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 1, is characterized in that: described step S400 specifically refers to following steps:
Step S410: any one user side becomes control end, other user sides become participation end, and only control end has operating rights;
Step S420: whether the synchronization module of control end monitors local input unit has action, if without, be failure to actuate, if having, send synchronization request to the webserver and perform step S430 after synchronization request is authorized;
Step S430: the synchronization module of control end judges whether interactive viewing area changes, if without, be failure to actuate, if having, change corresponding for interactive viewing area be converted to command information and generate corresponding file source Update log, then jump procedure S440;
Step S440: command information, file source Update log are encoded by control end and packed, adopt the small data transmission agreement preset to be sent to data server, be added into Shared Folders by data server and carry out upgrading and to preserve and the participation end be forwarded in interaction platform is decoded;
Step S450: decoded command information carries out synchronism output in the interactive viewing area participating in end;
Step S460: after this synchronization interactive completes, again jump procedure S410 and realize interaction.
3. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 2, is characterized in that: described step S410 specifically comprises the following steps:
Step S411: in interaction platform, each user side sorts by the time sequencing adding interaction platform, and control thread and formation control thread list by webserver Match in sequence; Described control thread is divided into online, enliven, vacancy three kinds of states, the control thread shared by user side entering synchronization interactive interface is presence, the online control thread having operating rights is active state, the control thread shared by user side exiting synchronization interactive interface is open position, the control thread foremost that acquiescence is in line states is active state, the user side that the control thread of active state is corresponding is control end, and the user side that the control thread of presence is corresponding is held for participating in;
Step S412: when the webserver receives and exits request, agree to that the user side sending the request of exiting exits synchronization interactive interface, corresponding control thread becomes open position from presence and waits for redistributing of the webserver, generate control thread change daily record to preserve, the control thread order that other user sides are corresponding and position do not change simultaneously;
Step S413: when the webserver receives access request, agree to that the user side sending access request adds synchronization interactive interface, transfer control thread change daily record to retrieve the control thread that whether there is open position in existing control thread list simultaneously, if have, the control thread of any one open position is dispensed to this user side, if without, a newly-built control thread is dispensed to this user side;
Step S414: whether the webserver is constantly searched for new control request, if having, jump procedure S415, if without, be failure to actuate;
Step S415: any one participates in end and sends to the webserver request of control, to request forward be controlled to current control end by the webserver, if current control end is agreed to, current control end power out of hand and become and participate in end and this participation end sending the request of control obtains control and becomes control end, if current control end is not agreed to, control constant and this control request and lost efficacy.
4. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 2, it is characterized in that: in described step S430, the change of interactive viewing area comprises the change of coordinate pixel and corresponding color value thereof in the change of multimedia file broadcast state, playing progress rate in broadcast layer or transparent layer; Described step S430 specifically comprises the following steps:
Step S431: control end judges the change whether having corresponding local mouse action in interactive viewing area, if without, perform step S432, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S432: control end judges the change whether having corresponding local touch screen operation in interactive viewing area, if without, perform step S433, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S433: control end judges the change whether having corresponding local keyboard operation in interactive viewing area, if without, perform step S434, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S434: control end judges the change whether having respective local audio acquisition module to operate in interactive viewing area, if without, perform step S435, if having, change corresponding for interactive viewing area is converted to jump procedure S440 after command information;
Step S435: control end judges the change whether having corresponding local video acquisition module to operate in interactive viewing area, if without, be failure to actuate, if having, change corresponding for interactive viewing area be converted to jump procedure S440 after command information.
5. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 4, is characterized in that: described step S450 specifically comprises the following steps:
Step S451: the size of the interactive viewing area of control end compares with the size participating in the interactive viewing area of holding and obtains ratio;
Step S452: the change that control end mouse action is corresponding is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S453: the change that control end touch screen operation is corresponding is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S454: change corresponding to control end keyboard operation is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S455: the change of control end audio collection module operation correspondence is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S456: the change of control end video acquisition module operation correspondence is called and participated in the local command information of end and mate laggard line output in conjunction with the ratio obtained in described step S451;
Step S457: after having exported, the synchronization module participating in end sends synchronous calibration request to the webserver;
Step S458: after synchronous calibration request is passed through, time script flow up-to-date in webserver calling data server is forwarded to and participates in end;
Step S459: after the synchronization module participating in holding receives time script flow, resolves time script flow and carries out synchronous calibration.
6. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 5, is characterized in that: described step S453 specifically comprises the following steps:
Step S4531: obtain on control end touch-screen and be positioned at the track streaked interactive viewing area;
Step S4532: the track obtained in step S4531 is converted into a series of sampled point, the coordinate contrasted on local transparent print layer obtains the coordinate figure of all sampled points;
Step S4533: the color value that in obtaining step S4532, sampled point is corresponding;
Step S4534: according to the sequencing of sampled point, is undertaken coordinate figure and color value associating rear and forming ordered series of numbers;
Step S4535: according to the coordinate figure in the interactive viewing area of the ratio calculation sampled point that obtains in step S451 this participations corresponding end and the color value that associates of respective coordinates value is constant and obtain new ordered series of numbers, coordinate figure in new ordered series of numbers and the color value associated are exported to and participates in the interactive viewing area of end, realize the synchronization interactive of track.
7. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 5, it is characterized in that: after described step S459 specifically refers to that the synchronization module participating in end resolves time script flow, obtain control end and participate in holding the time difference responding latest command information, if the time difference, in the threshold values of setting, is failure to actuate, if the time difference exceeds the threshold values of setting, carry out synchroballistic, complete synchronous calibration.
8. a kind of remote interaction method that the multi-screen synchronous of QoS shows of supporting according to claim 2, is characterized in that: the large Data Transport Protocol preset in described step S200 adopts RTP/RTCP agreement; In described step S440, described default small data transmission agreement adopts ICP/IP protocol.
9. a kind of according to claim 1-8 any one supports the remote interaction method that the multi-screen synchronous of QoS shows, and it is characterized in that: described step IF110 specifically comprises the following steps:
Step IF111: whether the webserver is constantly searched for new access request, if having, performs step IF112, if without, jump procedure IF113;
Step IF112: the access request completing the user side that file source data bag is downloaded is passed through, the access request not completing the user side that file source data bag is downloaded is refused, the numerical value of N is recalculated after processing access request, if this batch of access request is by p, the numerical value of N increases p, performs step IF113 after completing the calculating of N;
Step IF113: whether the webserver is constantly searched for have and new exited request, if having, performs step IF114, if without, continue to perform step S200;
Step IF114: the request of exiting is passed through, recalculates the numerical value of N after processing the request of exiting, if this batch exits request by q, the numerical value of N reduces q, performs step IF210 after completing the calculating of N;
Described step IF120 specifically comprises the following steps:
Step IF121: whether the webserver is constantly searched for new access request, if having, performs step IF122, if without, jump procedure IF123;
Step IF122: the access request completing the user side that file source data bag is downloaded is passed through, the access request not completing the user side that file source data bag is downloaded is refused, the numerical value of N is recalculated after processing access request, if this batch of access request is by r, the numerical value of N increases r, performs step IF123 after completing the calculating of N;
Step IF123: whether the webserver is constantly searched for have and new exited request, if having, performs step IF124, if without, continue to perform step S400;
Step IF124: the request of exiting is passed through, recalculates the numerical value of N after processing the request of exiting, if this batch exits request by s, the numerical value of N reduces s, performs step IF220 after completing the calculating of N.
10. a kind of according to claim 1-8 any one supports the remote interaction method that the multi-screen synchronous of QoS shows, and it is characterized in that: described multimedia file comprises audio file, video file, electronic book documentary, electronic courseware file, photo files, OFFICE office document.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510258579.6A CN104902017B (en) | 2015-05-20 | 2015-05-20 | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510258579.6A CN104902017B (en) | 2015-05-20 | 2015-05-20 | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104902017A true CN104902017A (en) | 2015-09-09 |
| CN104902017B CN104902017B (en) | 2018-05-15 |
Family
ID=54034413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510258579.6A Expired - Fee Related CN104902017B (en) | 2015-05-20 | 2015-05-20 | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104902017B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105407176A (en) * | 2015-12-21 | 2016-03-16 | Tcl集团股份有限公司 | Data sharing method and system, and server side |
| CN105979336A (en) * | 2015-12-03 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Startup advertisement processing method and device |
| CN106303650A (en) * | 2016-08-31 | 2017-01-04 | 成都炫境科技有限公司 | Audio video synchronization display packing |
| CN106610763A (en) * | 2015-10-26 | 2017-05-03 | 阿里巴巴集团控股有限公司 | Method and device for synchronization of user operations across screen |
| CN107992255A (en) * | 2017-12-01 | 2018-05-04 | 珠海格力电器股份有限公司 | A kind of method and server for generating image |
| CN108958858A (en) * | 2018-05-24 | 2018-12-07 | 北京长城华冠汽车科技股份有限公司 | The page synchronization method of graphic user interface |
| CN110020305A (en) * | 2017-11-29 | 2019-07-16 | 腾讯科技（武汉）有限公司 | Webpage loading method, device, computer equipment and storage medium |
| CN110784340A (en) * | 2019-10-09 | 2020-02-11 | 无线生活(北京)信息技术有限公司 | Configuration information updating method and device |
| CN111679881A (en) * | 2020-06-09 | 2020-09-18 | 腾讯科技（深圳）有限公司 | File processing method and device, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010032182A1 (en) * | 1998-12-08 | 2001-10-18 | Srihari Kumar | Interactive bill payment center |
| CN103248712A (en) * | 2013-05-24 | 2013-08-14 | 杭州东信北邮信息技术有限公司 | Simultaneous broadcasting management method and system of multi-media electronic screen |
| CN104158900A (en) * | 2014-08-25 | 2014-11-19 | 焦点科技股份有限公司 | Method and system for synchronizing courseware through iPad controlling |
| CN104184739A (en) * | 2014-09-01 | 2014-12-03 | 陈小鹏 | Class synchronization system based on wireless network |
-
2015
- 2015-05-20 CN CN201510258579.6A patent/CN104902017B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010032182A1 (en) * | 1998-12-08 | 2001-10-18 | Srihari Kumar | Interactive bill payment center |
| CN103248712A (en) * | 2013-05-24 | 2013-08-14 | 杭州东信北邮信息技术有限公司 | Simultaneous broadcasting management method and system of multi-media electronic screen |
| CN104158900A (en) * | 2014-08-25 | 2014-11-19 | 焦点科技股份有限公司 | Method and system for synchronizing courseware through iPad controlling |
| CN104184739A (en) * | 2014-09-01 | 2014-12-03 | 陈小鹏 | Class synchronization system based on wireless network |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106610763A (en) * | 2015-10-26 | 2017-05-03 | 阿里巴巴集团控股有限公司 | Method and device for synchronization of user operations across screen |
| CN105979336A (en) * | 2015-12-03 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Startup advertisement processing method and device |
| CN105407176A (en) * | 2015-12-21 | 2016-03-16 | Tcl集团股份有限公司 | Data sharing method and system, and server side |
| CN106303650A (en) * | 2016-08-31 | 2017-01-04 | 成都炫境科技有限公司 | Audio video synchronization display packing |
| CN110020305A (en) * | 2017-11-29 | 2019-07-16 | 腾讯科技（武汉）有限公司 | Webpage loading method, device, computer equipment and storage medium |
| CN107992255A (en) * | 2017-12-01 | 2018-05-04 | 珠海格力电器股份有限公司 | A kind of method and server for generating image |
| CN107992255B (en) * | 2017-12-01 | 2020-11-20 | 珠海格力电器股份有限公司 | Method for generating image and server |
| CN108958858A (en) * | 2018-05-24 | 2018-12-07 | 北京长城华冠汽车科技股份有限公司 | The page synchronization method of graphic user interface |
| CN110784340A (en) * | 2019-10-09 | 2020-02-11 | 无线生活(北京)信息技术有限公司 | Configuration information updating method and device |
| CN110784340B (en) * | 2019-10-09 | 2022-07-12 | 无线生活(北京)信息技术有限公司 | Configuration information updating method and device |
| CN111679881A (en) * | 2020-06-09 | 2020-09-18 | 腾讯科技（深圳）有限公司 | File processing method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104902017B (en) | 2018-05-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104902017A (en) | Remote interaction method of multi-screen synchronous display supporting QoS | |
| WO2021057120A1 (en) | Data transmission method, device and computer storage medium | |
| CN104253814B (en) | A kind of Streaming Media processing method, server and browser | |
| CN110765744A (en) | Multi-person collaborative document editing method and system | |
| CN109600388A (en) | Data transmission method, device, computer-readable medium and electronic equipment | |
| CN103348657B (en) | Flow media playing method, equipment and system | |
| WO2019242054A1 (en) | Method and system for synchronous annotation of screen content between multiple devices | |
| CN105072507A (en) | Method and system for transmitting multimedia data | |
| CN104079597A (en) | Transfer method of media stream and user equipment | |
| CN102185856A (en) | Team organizing video method, device and system used in team organizing game | |
| CN109889922B (en) | Method, device, equipment and storage medium for forwarding streaming media data | |
| US10575065B2 (en) | Message sending method and device, code stream processing method and device | |
| US11431770B2 (en) | Method, system, apparatus, and electronic device for managing data streams in a multi-user instant messaging system | |
| CN106791908B (en) | A kind of live video stream storage method for supporting cloud platform to use double buffering | |
| CN101815073A (en) | Embedded Bluetooth-Ethernet server | |
| CN114584808B (en) | Video stream acquisition method, device, system, equipment and medium | |
| JP2011186810A (en) | Device, method and program for distributing load | |
| US20150113047A1 (en) | Rules-based multipoint routing of real-time information using client-server architecture | |
| CN110517163A (en) | A kind of distribution network feeder group analyzing method | |
| CN109474643A (en) | Data analysis method, device, equipment and storage medium | |
| US11720244B2 (en) | Online conference tools for meeting-assisted content editing and posting content on a meeting board | |
| JP2023031248A (en) | Edge computing network, data transmission method, apparatus, device, and storage medium | |
| CN105282477A (en) | Multiparty video data fusion realization method, device, system and fusion server | |
| CN108616760A (en) | A kind of live broadcasting method, server, main broadcaster end and user terminal based on browser | |
| CN106210867A (en) | A kind of method and apparatus of data sharing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Tong Xiang Inventor before: He Yunchuan Inventor before: Kang Gangqiang |
|
| CB03 | Change of inventor or designer information | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180413 Address after: 510000 self compiled A, 603 building, business building, 118 Whampoa Avenue West Road, Tianhe District, Guangzhou, Guangdong Applicant after: Guangzhou Xun Information Technology Co., Ltd. Address before: 610000 No. 1, No. 9, No. 9, No. 160, Jianshe South Road, Chengdu, Sichuan, Chenghua District Applicant before: SICHUAN JINGTIAN AIREN SCIENCE & TECHNOLOGY CO., LTD. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180515 Termination date: 20200520 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |