WO2016197859A1

WO2016197859A1 - Method and device for synchronously broadcasting multimedia data

Info

Publication number: WO2016197859A1
Application number: PCT/CN2016/084596
Authority: WO
Inventors: 於聪; 陶媛; 严飞军; 裘钰钢; 金琼瑶; 黄种堃
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2015-06-11
Filing date: 2016-06-03
Publication date: 2016-12-15
Also published as: CN106303648A

Abstract

Disclosed in the present application are a method and device for synchronously broadcasting multimedia data. The method comprises: in a session involving at least two terminals, acquiring, by an initiator terminal, a resource identifier of multimedia data; sending the resource identifier to all receiver terminals in the same session; and after acquiring the multimedia data according to the resource identifier, sending, by the initiator terminal, a synchronous-broadcast notification to each of the receiver terminals, so that all of the terminals involved in the session synchronously broadcast the multimedia data. The method ameliorates a problem in the conventional art in which each terminal involved in a session plays the multimedia data independently, thereby effectively improving synchronization of multimedia data broadcasting and enhancing interactivity during multimedia data sharing, facilitating interaction during the multimedia data sharing.

Description

Method and device for synchronously playing multimedia data

The present application claims priority to Chinese Patent Application Serial No. No. No. No. No. No. No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No

Technical field

The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for synchronously playing multimedia data.

Background technique

With the development of information technology, mobile terminals have become an important tool for users to communicate. The user uses the mobile terminal, in addition to the short message communication and the telephone communication through the telecommunication carrier network, the user can also use the communication application (Application, APP) installed in the mobile terminal to communicate through the Internet, thereby Communication is more and more convenient.

Currently, especially for communication applications with rich functions, a user can use a communication application to establish a separate session with other users (the separate session consists of instant messaging messages exchanged between two users), a group session (described A group session consists of instant messaging messages exchanged between multiple users in a user group. These communication methods can not only realize the interaction of various communication messages such as text, voice, video, etc., but also share multimedia information such as video and audio in different sessions.

However, when the user shares the multimedia data (such as video data and audio data) by using the above communication method, other users participating in the session can only browse the content of the multimedia data in the terminal used by the user, because the user browses each time. The time is not uniform. If some users want to discuss and exchange a certain piece of content of the multimedia data, they can only wait for other users to browse the content, or let other users browse the content through progress adjustment. Obviously, when sharing multimedia data in such a way, the convenience of interaction is poor.

Summary of the invention

The embodiment of the present invention provides a method and an apparatus for synchronously playing multimedia data, which are used to solve the problem that the communication method in the prior art is inconvenient in interaction when performing multimedia data sharing.

A method for synchronously playing multimedia data provided by an embodiment of the present application includes:

In a session in which at least two terminals participate, the initiator terminal acquires a resource identifier of the multimedia data;

Sending the resource identifier to all receiver terminals in the same session;

After acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.

A method for synchronously playing multimedia data according to an embodiment of the present application includes:

In a session in which at least two terminals participate, the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal;

Obtaining the multimedia data to be played according to the resource identifier;

Receiving a synchronous play notification sent by the initiator terminal;

The multimedia data is played according to the synchronous play notification.

A method for synchronously playing multimedia data is provided by the embodiment of the present application, including:

In a session in which at least two terminals participate, the server receives the resource identifier sent by the initiator terminal;

Distributing the resource identifier to all receiver terminals in the same session;

Receiving a synchronous play notification sent by the initiator terminal, and distributing it to all receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.

An embodiment of the present application provides an apparatus for synchronously playing multimedia data, including:

An obtaining module, configured to acquire a resource identifier of the multimedia data;

a sending module, configured to send the resource identifier to all receiver terminals in the same session;

The synchronization notification module is configured to send a synchronization play notification to each of the receiver terminals after the multimedia data is acquired according to the resource identifier, so that all the terminals participating in the session play the multimedia data synchronously.

An embodiment of the present application further provides an apparatus for synchronously playing multimedia data, including:

a receiving module, configured to receive, by the receiving terminal, a resource identifier of the multimedia data sent by the initiator terminal;

An acquiring module, configured to acquire, according to the resource identifier, the multimedia data to be played;

a notification receiving module, configured to receive a synchronization play notification sent by the initiator terminal;

And a synchronous play module, configured to play the multimedia data according to the synchronous play notification.

The embodiment of the present application further provides an apparatus for synchronously playing multimedia data, including:

a receiving module, configured to receive, by a server, a resource identifier sent by the initiator terminal;

a distribution module, configured to distribute the resource identifier to all receiver terminals in the same session;

The synchronization notification module is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.

An embodiment of the present invention provides a method and an apparatus for synchronously playing multimedia data. In this method, an initiator terminal in the same session sends the resource identifier corresponding to the acquired multimedia data to other terminals in the session. And, the initiator terminal further sends a synchronization play notification to each receiver terminal to notify all terminals to play the multimedia data at the same time. Therefore, all the terminals in the session realize synchronous play for the multimedia data, which changes the defect that the terminals participating in the session can only play the multimedia data by itself, which not only effectively improves the multimedia data. The synchronism of playback also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawing:

FIG. 1 is a flowchart of synchronously playing multimedia data according to an embodiment of the present application;

2 is a schematic diagram of an interface in a terminal in an actual application scenario according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a play control after entering a full screen mode in an actual application scenario according to an embodiment of the present disclosure;

4 is a process of synchronously playing multimedia data in a receiver terminal according to an embodiment of the present application;

FIG. 5 is a flowchart of synchronously playing multimedia data in a server according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in an initiator terminal according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in a receiver terminal according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in a server according to an embodiment of the present disclosure.

detailed description

The technical solutions of the present application will be clearly and completely described in the following with reference to the specific embodiments of the present application and the corresponding drawings. It is apparent that the described embodiments are only a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

FIG. 1 is a process of synchronously playing multimedia data according to an embodiment of the present disclosure, which specifically includes the following steps:

S101: In a session in which at least two terminals participate, the initiator terminal acquires a resource identifier of the multimedia data.

The terminal described in the embodiment of the present application includes but is not limited to: a mobile phone, a tablet computer, a smart watch, etc. Mobile terminal. A session can be established between different terminals, such as a separate session or a group session. Users who use different terminals can send instant messaging messages to each other through the session. Obviously, the establishment of a session requires at least two different terminals, that is, the number of terminals participating in the session is at least two.

The implementation of the session may be based on providing a corresponding session service in an operating system of the terminal, or providing a session service based on an application having a session function installed in the terminal. This does not constitute a limitation on the present application.

When a certain user in the session wants to share a certain multimedia data and play and browse for other users in the session, then the terminal used by the user will acquire the resource identifier of the corresponding multimedia data, and The resource identifier is distributed to other terminals in the session for subsequent simultaneous playback.

The resource identifier may be a Uniform Resource Locator (URL).

S102. Send the resource identifier to all receiver terminals in the same session.

The resource identifier reflects the storage location of the multimedia data. Through the resource identifier, each terminal can obtain the substantial content of the multimedia data.

S103. After acquiring the multimedia data to be played according to the resource identifier, the initiator terminal sends a synchronization play notification to each receiver terminal, so that all terminals participating in the session synchronize the multimedia data. Play.

Considering the actual application, different receiver terminals may have a certain time difference when acquiring multimedia data. If the receiver terminal starts to play immediately after acquiring the multimedia data, it will cause different receiver terminals to play. There is a certain time difference in the progress of the content, so that synchronous playback cannot be achieved. Therefore, for the foregoing step S103, after acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminal, specifically, the initiator terminal receives the receiver. After the resource acquisition notification fed back by the terminal, the synchronization play notification is sent to the receiver terminal.

The resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.

It should be noted that, in the present application, for the synchronous play of multimedia data, all the receiver terminals in the session are not required to participate in the synchronous play, and as long as one receiver terminal participates, synchronous play with the initiator terminal can be performed. . That is to say, only when the at least one receiving terminal acquires the corresponding multimedia data according to the resource identifier, it will play synchronously with the initiator terminal (when the receiving party acquires the multimedia data, then the initiator terminal is waiting) status). Therefore, in the above content, the receiver terminal that feeds back the resource acquisition notification is the receiver terminal (the number is at least one) that acquires the multimedia data. Here, an extension is required. If the receiver terminal participating in the synchronous play is not all the receiver terminals, then in the subsequent process, the other is not involved. The receiving terminal that plays synchronously can also join the synchronous playing at any time. At this time, the newly added receiving terminal will play synchronously according to the current playing progress.

Therefore, it can be considered that by synchronously playing the notification, a unified playback time is agreed between different terminals, and the time difference generated by acquiring the multimedia data can be eliminated, and synchronous play can be realized.

Each receiving terminal in the embodiment of the present application obtains the multimedia data according to the received resource identifier, and only after receiving the synchronous play notification sent by the initiator terminal, The notification is played synchronously, and the multimedia data is played synchronously.

Different from the prior art, in the prior art, after the receiver terminal receives the resource identifier of the multimedia data, if the user wants to view and browse the multimedia content corresponding to the resource identifier, generally, only the terminal in the terminal can be used. The player either accesses the corresponding page according to the resource identifier and performs separate viewing. That is to say, for each terminal in the session, the progress and playing state of other terminals in the session are not known, that is, the interaction is low.

In the embodiment of the present application, the initiator terminal initiates synchronous play to other terminals in the session, so that all terminals in the session simultaneously play the content in the multimedia data.

Through the above steps, the initiator terminal in the same session sends the resource identifier corresponding to the acquired multimedia data to other terminals in the session, and the initiator terminal also sends synchronous play to each receiver terminal. Notification to notify all terminals to play the multimedia data at the same time. Therefore, all the terminals in the session realize synchronous play for the multimedia data, which changes the defect that the terminals participating in the session can only play the multimedia data by itself, which not only effectively improves the multimedia data. The synchronism of playback also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.

In the embodiment of the present application, for the initiator terminal and the receiver terminal, the playing state may be changed during the synchronous play of the multimedia data, and the instant messaging during the playing process may also be implemented. These situations will be described in detail below.

First, the scene in which the playback status changes during playback

In the embodiment of the present application, the initiator terminal or the receiver terminal may use the play control to play the multimedia data when the multimedia data is played, wherein the play control may load the current session displayed by the terminal. In the interface. For example, as shown in FIG. 2, the upper part of the current session interface of the initiator terminal loads the play control, and the corresponding multimedia data is played in the play control (in FIG. 2, the current play control is in a pause state), of course. In the initiator terminal, the play control is operable.

That is to say, the initiator terminal can perform a control operation in the play control, such as: click pause, then, in the play control of other receiver terminals, the multimedia data is also paused. Obviously, since the initiator terminal receives the corresponding control operation, the playback state during the synchronous playback has changed.

Specifically, for the foregoing methods S101 to S103 shown in FIG. 1 in the embodiment of the present application, the method further includes: the initiator terminal receiving a play control operation for the play control, according to the play control operation, Adjusting a play status of the multimedia data, generating adjustment information according to the adjusted play status, and distributing the adjustment information to each receiver terminal in the same session, so that each receiver terminal adjusts synchronously according to the adjustment information The playback status of the respective multimedia data.

The play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.

It should be noted that, when the play control operation includes a play progress operation, adjusting a play status of the multimedia data according to the play control operation, specifically: adjusting playback of the multimedia data according to the play progress operation schedule. On the basis of the adjustment, the adjustment information is generated according to the adjusted playing state, specifically: determining a playing time corresponding to the adjusted playing progress, and generating the progress adjusting information according to the playing time.

It can be seen that, in this scenario, only the initiator terminal has the right to control and adjust the play of the multimedia data, and other receiver terminals in the same session only perform corresponding control adjustment according to the control information sent by the initiator terminal. The method can avoid the chaos phenomenon that the different terminals can control and adjust the playing of the multimedia data in the session.

Second, the scene of playing the card in the play process

During playback, due to network transmission problems or frame data corruption of the multimedia data itself, playback jams may occur. Taking the initiator terminal as an example, if the initiator terminal appears to be stuck in the process of playing multimedia data, and the playback of the other recipient terminals is normal, the playback progress of the initiator terminal is compared with other receiver terminals. The playback progress is inconsistent, and there is no guarantee that the playback will be synchronized.

Considering the actual application, the initiator terminal implements a session connection with other recipient terminals through the server. In the embodiment of the present application, the initiator terminal sends a synchronization play notification to the receiver terminals, specifically: the initiator terminal sends a synchronization play notification to the receiver terminals through a server, and synchronizes the broadcast notification. Contains a unified playback start time. This indicates that the server has been informed of the unified playback start time of all terminals participating in the session.

Therefore, in order to ensure that the playback of all the terminals is synchronized and is not affected by the stagnation phenomenon, in the embodiment of the present application, the method S101 to S103 described in FIG. 1 further includes: the initiator terminal monitors the playback. When it is stuck, Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the initiator terminal according to the card correction request, where the initiator terminal loads the current play time. Multimedia data is played.

That is, the terminal in which the card is present can obtain the normal playback progress (the progress of the unstacking) to the server, so that the terminal will load the normal playback progress and eliminate the influence of the jam.

Third, the scene of transmitting voice messages during playback

All terminals in the same session can perform real-time communication in real time, such as voice message communication and text message communication, even in the process of playing multimedia data. Still as shown in FIG. 2, the lower half of the interface in FIG. 2 is an instant messaging message display area, which provides instant messaging for users using different terminals.

For the scenario, in the embodiment of the present application, the method S101-S103 as described in FIG. 1 further includes: when the initiator terminal receives the voice message input during the playing process, the current playing terminal is closed. The audio of the multimedia data is recorded, and the input voice message is recorded, the voice message is sent to each receiver terminal in the same session, and the audio of the currently played multimedia data is re-opened.

Obviously, the above process is a process in which the originating terminal initiates a voice message. In practical applications, the multimedia data contains corresponding audio data, that is, in the process of playing the multimedia data, the corresponding sound is played, then, in this case, when the voice is directly recorded, The sound of the multimedia data is simultaneously recorded, which affects the clarity of the voice message. Therefore, in this scenario, when the voice message is input, the initiator terminal turns off the audio (mute) of the multimedia data, and this can ensure the clarity of the voice message entered.

When the initiator terminal sends the voice message, it indicates that the current input process has ended, so the initiator terminal resumes the playing of the audio, so that the user can hear the sound of the multimedia data again.

In another mode in the scenario, the process in which the originating terminal receives voice messages of other recipient terminals. In order to ensure that the user can clearly hear the voice message while playing the multimedia data audio, it is necessary to adjust the volume of the audio of the current multimedia data. That is, in the embodiment of the present application, the method S101 to S103 as described in FIG. 1 further includes: the initiator terminal receiving the voice message sent by the receiver terminal, and the multimedia device currently being played. The volume of the audio of the data is reduced to a preset volume threshold, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.

Fourth, the scene of transmitting instant messaging messages during playback

In the interface shown in FIG. 2, the visible play control is only displayed on the upper part of the current interface, and the lower part of the interface is used to display instant messaging messages. And if the playback controls are displayed in full screen, then, in order to ensure the The instant messaging can be performed normally. Therefore, in the embodiment of the present application, the method S101 to S103 as described in FIG. 1 further includes: when the playback control enters the full-screen playback mode, in the current playback interface. Setting a session display area, the initiator terminal displays the instant messaging message sent by itself and the received instant messaging message sent by each receiver terminal according to the chronological order of each instant message In the session display area.

Specifically, as shown in FIG. 3, the play control enters the full-screen play mode. At this time, at the lower left of the current interface, a session display area is displayed, and in the session display area, according to the time sequence of each instant message, the next The top display of each instant messaging message, that is, the latest instant messaging message is displayed at the bottom of the session display area, and with the appearance of other latest messages, the instant messaging message will gradually move up and eventually move out of the session display area. .

Of course, it should be noted that the session display area may be displayed in a floating layer, a floating control, or the like, and in order to ensure the user's viewing experience, the session display and the instant messaging message displayed therein are set to be translucent. Or other transparency.

The foregoing content is based on the initiator terminal. For the receiver terminal, as shown in FIG. 4, the embodiment of the present application further provides a method for synchronously playing multimedia data, where the method includes:

S401. In a session in which at least two terminals participate, the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal.

S402. Acquire the multimedia data according to the resource identifier.

S403. Receive a synchronization play notification sent by the initiator terminal.

S404. Play the multimedia data according to the synchronous play notification.

In the above manner, all the receiver terminals in the same session acquire the corresponding multimedia data according to the resource identifier of the multimedia data sent by the initiator terminal, and participate in the session according to the synchronization play notification sent by the initiator terminal. All the terminals in the middle play synchronous playback of the multimedia data. It not only effectively improves the synchronization for multimedia data playback, but also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.

In the method, similar to the scenario of the initiator terminal, specifically:

The method S401 to S404 shown in FIG. 4 further includes: after the receiver terminal acquires the multimedia data to be played according to the resource identifier, and returns a resource acquisition notification to the initiator terminal; The resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.

That is, after receiving the multimedia data, each receiving terminal may feed back a resource acquisition notification to the initiator terminal, so that the initiator terminal can learn the acquisition status of different receiver terminals, thereby performing the same Step play.

For the scene in which the playback state changes during playback, after the initiator terminal adjusts the play status of the multimedia data according to the play control operation, and generates the adjustment information to be sent to the receiver terminal, the method further includes The receiving terminal receives the adjustment information sent by the initiator terminal, and synchronously adjusts the playing state of the respective multimedia data according to the adjustment information, where the adjustment information is used to play, pause, and Adjust at least one of the playback progress and the stop playback state.

The receiving terminal receives the synchronization playing notification sent by the initiator terminal by using the server, and the method further includes: when the receiving terminal monitors the playing card, to the The server sends a card correction request, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the multimedia data corresponding to the current play time. Play.

For the scenario of transmitting a voice message during the playing, the method further includes: when the receiving terminal receives the voice input operation during the playing, turning off the audio of the currently played multimedia data, and recording the input voice message, The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.

In another mode of the scenario, the method further includes: the receiving terminal receiving the voice message sent by the other terminal, and reducing the volume of the audio of the currently played multimedia data to a preset volume threshold. And playing the received voice message, and when the voice message is played, resuming the volume of the audio of the currently played multimedia data.

For the scenario in which the instant messaging message is transmitted during the playback process, the receiving terminal loads the playback control to play the multimedia data in the currently displayed session interface, and the method further includes: when the playback control enters full-screen playback In the mode, the session display area is set in the current play interface, and the receiving terminal sends the instant messaging message sent by itself and the received instant messaging message sent by the initiator terminal according to the time sequence of each instant message. In order, the instant messaging message is displayed in the session display area.

The foregoing content is based on the receiver terminal, and the specific content of the different scenarios is similar to that of the sender terminal, and therefore is not described herein again.

In the embodiment of the present application, in addition to the initiator terminal and the receiver terminal, the server also participates in the process of session establishment and multimedia data playback. Therefore, in the embodiment of the present application, as shown in FIG. 5, A method for synchronously playing multimedia data, the method specifically includes:

S501. In a session in which at least two terminals participate, the server receives the resource identifier sent by the initiator terminal.

S502. Distribute the resource identifier to all receiver terminals in the same session.

S503. Receive a synchronization play notification sent by the initiator terminal, and distribute it to all receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.

As can be seen from the above, the server participates in the process of implementing synchronous play in the session. In addition, it should be noted that the methods S501 to S503 as described in FIG. 5 further include: the server monitoring the occurrence of a jam in each terminal during the synchronous playback.

Specifically, the server monitors the occurrence of the card in the synchronous play process, specifically: the server records the initial play progress of each terminal for synchronous play, and the system time corresponding to the start play progress, and sends the system time to the terminal. The process queries the request and receives the feedback of each terminal. In the case that the adjustment information corresponding to the playback progress operation is not received, the time difference between the current playback progress and the initial playback progress according to the feedback, and the system corresponding to the current time The time difference between the time and the system time corresponding to the initial playback progress is monitored for the stuck.

It should be noted that the synchronously played multimedia data (such as video) does not necessarily start from the first frame of data. For example, in practical applications, the playback control may have the function of “skip the title”, thus The initial playback progress of the multimedia data is no longer from the first frame data, so for the server, it is necessary to record the initial playback progress during the synchronous playback. In order to time the playback progress, the server also records the system time corresponding to the initial playback progress.

In the actual application scenario, the server periodically sends a progress query request to all terminals participating in the session to query the playback progress in each terminal.

For example, in a session in which multiple terminals participate, a certain video is played synchronously, assuming that the initial playback progress of the video recorded by the server is “00:30” (that is, the video starts playing from the 30th second), Also, the system time at the start of playback is "12:00:00". The server sends a progress query request to each terminal every 20 seconds.

Suppose the server receives the playback progress of a certain terminal feedback at "12:00:20", the current playback progress is "00:48", then, for the terminal, between the current playback progress and the initial playback progress The time difference is 18 seconds. However, the time difference between the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress is 20 seconds, which indicates that the playback progress of the terminal is stuck for 2 seconds, so that the server can determine The terminal is stuck.

It can be seen from the above example that when the time difference between the current playback progress of the feedback and the initial playback progress is inconsistent with the time difference between the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress, the The playback of the terminal has appeared.

In order to eliminate the stagnation, in one mode in the embodiment of the present application, in the case where a stagnation occurs, the method The method further includes: after detecting that the terminal has a jam, the server feeds back the synchronized play progress of the current time to the terminal that appears to be stuck according to the recorded synchronized play progress, so that the terminal that appears to be stuck loads the synchronization at the current time. Play progress.

Of course, the above content is that the server actively monitors whether each terminal has a jam, and in another mode in the embodiment of the present application, the terminal itself monitors the occurrence of the stuck, and sends the server to the server after the occurrence of the jam. The card correction request, at this time, the server receives the card correction request sent by the terminal, and feeds back the synchronized play progress of the current time to the terminal according to the recorded synchronized play progress, so that the terminal loads the synchronization at the current time. Play progress.

The above content is the adjustment of the card to the card in the case that the adjustment information corresponding to the playback progress operation is not received, and if the initiator terminal adjusts the play status of the video, the server receives the adjustment sent by the initiator terminal. And updating the synchronized play progress of the record according to the adjustment information.

The adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.

At this time, if the server receives the terminal sending a card correction request, the server obtains the current playback progress of the initiator terminal, and feeds the obtained playback progress to the receiver terminal that sends the card correction request. That is, the playback progress of all terminals is consistent with the initiator terminal.

So far, the specific process and manner of realizing synchronous playback of multimedia data between the initiator terminal, the receiver terminal, and the server are respectively described in the embodiments of the present application. Considering the actual application, the initiator terminal and the receiver terminal may be in the same local area network environment (and the multimedia data is stored locally on the initiator terminal). In such a scenario, the process of synchronously playing the multimedia data may be performed. It does not depend on the server, but the initiator terminal and the receiver terminal, and realizes synchronous playback under the transmission of the network device (such as a wireless router).

Specifically, in the established session, the initiator terminal sends a notification message to each receiver terminal through the local area network to notify each receiver terminal to acquire the multimedia data locally stored by the initiator terminal, and obtain the multimedia data at the receiver terminal. After the multimedia data, the synchronous play notification is sent to the receiver terminal, so that all the terminals participating in the session play the multimedia data synchronously.

In this scenario, the initiator terminal controls the synchronous play (including: start synchronous play, pause during synchronous play, play, progress adjustment, etc.), and the initiator terminal still sends the corresponding receiver to the corresponding receiver in the manner of adjusting information. The terminal causes the receiver terminal to synchronously control the synchronous play according to the adjustment information.

Specifically, the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data, and when the initiator terminal receives a play control operation for the play control, Adjusting a play status of the multimedia data according to the play control operation, generating adjustment information according to the adjusted play status, and distributing the adjustment information to each receiver terminal in the same session through a local area network, so that each The receiving terminal synchronously adjusts the playing state of the respective multimedia data according to the adjustment information.

Similarly, in the process of the synchronous play, both the initiator terminal and the receiver terminal can transmit the voice message and the instant message, and the specific process is similar to the above content, and details are not described herein again.

In addition, in this scenario, the sender terminal performs cardon monitoring and repair. specifically:

For the monitoring of the card, the initiator terminal records the initial playing progress of the synchronous play, and the system time corresponding to the initial playing progress, sends a progress query request to the receiving terminal, and receives the receiving terminal Feedback, in the case that the playback progress operation is not received, according to the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress The time difference is monitored for Caton.

For the repair of the Caton, after detecting that the receiving terminal is stuck, the initiator terminal feeds back the synchronized playing progress of the current moment through the local area network to the receiving terminal of the occurrence of the Caton according to the recorded synchronized playing progress. So that the receiving terminal of the stuck one loads the synchronized playing progress of the current moment.

If the originating terminal itself has a stuck, the originating terminal obtains the synchronized playing progress of the receiving terminal at the current moment from the receiving party through the local area network, and loads the synchronized playing progress of the current moment.

It can be seen from the above that the process of synchronous play between the initiator terminal and the receiver terminal does not depend on the server, and all of them transmit and communicate through the local area network and realize synchronous play.

The above is the method for synchronously playing multimedia data provided by the embodiment of the present application. Based on the same idea, the embodiment of the present application provides a device for synchronously playing multimedia data, which is set in the initiator terminal, as shown in FIG. 6 .

In FIG. 6, the apparatus for synchronously playing multimedia data includes:

The obtaining module 601 is configured to obtain a resource identifier of the multimedia data.

The sending module 602 is configured to send the resource identifier to all receiver terminals in the same session.

The synchronization notification module 603 is configured to send a synchronization play notification to each receiver terminal after the multimedia data is acquired according to the resource identifier, so that all terminals participating in the session play the multimedia data synchronously.

The resource identifier includes: a URL.

Specifically, the synchronization notification module 603 is specifically configured to receive resource feedback fed back by each receiver terminal. After the notification, a synchronous play notification is sent to each of the recipient terminals.

In a scenario in which the playing state changes during playback, the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data. In this scenario, the device further includes: a play control module 604, configured to receive, by the initiator terminal, a play control operation for the play control, and adjust a play state of the multimedia data according to the play control operation, According to the adjusted playing state, the adjustment information is generated, and the adjustment information is distributed to each receiving terminal in the same session, so that each receiving terminal synchronously adjusts the playing state of the respective multimedia data according to the adjustment information.

More specifically, the play control module 604 is specifically configured to adjust a play progress of the multimedia data according to the play progress operation, and determine a play time corresponding to the adjusted play progress, according to the play time. The progress adjustment information is generated.

In a scenario in which a play-up occurs during playback, the synchronization notification module 603 is specifically configured to send a synchronous play notification to the receiver terminals by using a server. In this scenario, the device further includes: a card processing module 605, configured to send a card correction request to the server when the play card is detected, so that the server displays the current play time according to the card correction request. The corresponding multimedia data is sent to the initiator terminal, and the initiator terminal loads the multimedia data corresponding to the current playing time for playing.

In the scenario of transmitting a voice message during the playing process, the device further includes: a voice message module 606, configured to: when receiving the voice message input during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message sends the voice message to each receiver terminal in the same session, and re-opens the audio of the currently played multimedia data.

In another mode of the scenario, the voice message module 606 is further configured to receive a voice message sent by the receiver terminal, and reduce the volume of the audio of the currently played multimedia data to a preset volume. The threshold value is played, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.

In a scenario in which an instant messaging message is transmitted during playback, the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data. In this scenario, the device further includes: an instant messaging message module 607, configured to play the current playback when the playback control enters the full-screen playback mode. Setting a session display area in the interface, the initiator terminal sends the instant messaging message sent by itself, and the received instant messaging message sent by each receiving terminal to the instant messaging message according to the chronological order of each instant messaging message. Displayed in the session display area.

The embodiment of the present application further provides an apparatus for synchronously playing multimedia data, which is disposed in a receiver terminal. As shown in FIG. 7, in FIG. 7, the apparatus includes:

The receiving module 701 is configured to: in a session in which at least two terminals participate, the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal.

The obtaining module 702 is configured to obtain the multimedia data to be played according to the resource identifier.

The notification receiving module 703 is configured to receive a synchronization play notification sent by the initiator terminal.

The synchronous play module 704 is configured to play the multimedia data according to the synchronous play notification.

In the embodiment of the present application, the acquiring module 702 is further configured to: after obtaining the multimedia data to be played according to the resource identifier, feed back a resource acquisition notification to the initiator terminal.

In a scenario in which a play state changes during playback, the initiator terminal adjusts a play state of the multimedia data according to a play control operation, and generates adjustment information to be sent to the receiver terminal, where the device further includes The play control module 705 is configured to receive, by the receiver terminal, adjustment information sent by the initiator terminal, and synchronously adjust a play state of the respective multimedia data according to the adjustment information.

In a scenario in which a play-up occurs during playback, the receiver terminal receives a synchronization play notification sent by the initiator terminal by using a server, and the device further includes: a card-and-click processing module 706, configured to monitor a play-back time Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the current play time. Play corresponding to multimedia data.

In the scenario of transmitting a voice message during the playing process, the device further includes: a voice message module 707, configured to: when receiving the voice input operation during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.

As a manner in the scenario, the voice message module 707 is further configured to receive the language sent by other terminals. a voice message, reducing the volume of the audio of the currently played multimedia data to a preset volume threshold, and playing the received voice message, and restoring the currently played after the voice message is played. The volume of the audio of the multimedia data.

In the scenario of transmitting an instant messaging message during the playing process, the device further includes: an instant messaging message module 708, configured to set a session display area in the current playing interface when the playing control enters the full-screen playing mode, and receive The instant messaging message sent by the party terminal itself, and the received instant messaging message sent by the initiator terminal, display the instant messaging message in the session display area according to the chronological order of each instant messaging message.

The embodiment of the present application further provides an apparatus for synchronously playing multimedia data, which is disposed in a server. As shown in FIG. 8, the apparatus includes:

The receiving module 801 is configured to: in a session in which at least two terminals participate, the server receives the resource identifier sent by the initiator terminal.

The distribution module 802 is configured to distribute the resource identifier to all receiver terminals in the same session.

The synchronization notification module 803 is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.

The apparatus further includes a monitoring module 804 for monitoring the occurrence of a jam in each terminal during the synchronous playback.

The monitoring module 804 is specifically configured to record a starting play progress of each terminal for synchronous play, and a system time corresponding to the initial play progress, send a progress query request to each terminal, and receive feedback of each terminal, and not receive In the case of the adjustment information corresponding to the playback progress operation, according to the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress. Time difference, monitoring Caton.

The device further includes: a card correction module 805, configured to: when the terminal is detected to be stuck, according to the recorded synchronized playback progress, feed the synchronized playback progress of the current moment to the terminal where the card is present, so that the occurrence of the stuck The terminal loads the synchronized play progress of the current moment.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory. Memory is an example of a computer readable medium.

Computer readable media includes both permanent and non-persistent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.

It is also to be understood that the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, Other elements not explicitly listed, or elements that are inherent to such a process, method, commodity, or equipment. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device including the element.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The above description is only an embodiment of the present application and is not intended to limit the application. Various changes and modifications can be made to the present application by those skilled in the art. Any modifications, equivalents, improvements, etc. made within the spirit and scope of the present application are intended to be included within the scope of the appended claims.

Claims

A method for synchronously playing multimedia data, the method comprising:

In a session in which at least two terminals participate, the initiator terminal acquires a resource identifier of the multimedia data;

Sending the resource identifier to all receiver terminals in the same session;

After acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.
The method according to claim 1, wherein, after the obtaining the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminals, which specifically includes:

After receiving the resource acquisition notification fed back by the receiver terminal, the initiator terminal sends a synchronization play notification to the receiver terminal, where the resource acquisition notification indicates that the receiver terminal has successfully acquired the resource identifier. Multimedia data.
The method according to claim 1, wherein the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data;

The method further includes:

The initiator terminal receives a play control operation for the play control;

Adjusting a play status of the multimedia data according to the play control operation;

The adjustment information is generated according to the adjusted playing state;

Distributing the adjustment information to each receiver terminal in the same session, so that each receiver terminal synchronously adjusts the play status of the respective multimedia data according to the adjustment information;

The play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
The method of claim 3, wherein when the play control operation comprises a play progress operation, adjusting the play status of the multimedia data according to the play control operation comprises:

Adjusting a playback progress of the multimedia data according to the playback progress operation;

The adjustment information is generated according to the adjusted playing state, and specifically includes:

Determining the playback time corresponding to the adjusted playback progress;

The progress adjustment information is generated according to the play time.
The method of claim 1, wherein the initiator terminal sends a synchronization play notification to the receiver terminals, which specifically includes:

The initiator terminal sends a synchronous play notification to the receiver terminals through a server.
The method of claim 5, wherein the method further comprises:

When the initiator terminal monitors the playing card, the device sends a card correction request to the server, so that the server sends the multimedia data corresponding to the current playing time to the initiator terminal according to the card correction request;

The initiator terminal loads the current playing time corresponding to the multimedia data for playing.
The method of claim 1 wherein the method further comprises:

When the initiator terminal receives the voice message input during the playing process, the audio of the currently played multimedia data is turned off, and the input voice message is recorded;

The voice message is sent to each recipient terminal in the same session, and the audio of the currently played multimedia data is re-opened.
The method of claim 1 wherein the method further comprises:

The initiator terminal receives a voice message sent by the receiver terminal;

Lowering the volume of the audio of the currently played multimedia data to a preset volume threshold, and playing the received voice message;

After the voice message is played, the volume of the audio of the currently played multimedia data is restored.
The method according to claim 1, wherein the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data;

The method further includes:

When the play control enters the full-screen play mode, the session display area is set in the current play interface;

The initiator terminal displays the instant messaging message sent by itself and the received instant messaging message sent by each receiving terminal in the chronological order of each instant messaging message, and displays the instant messaging message in the session display area. in.
A method for synchronously playing multimedia data, the method comprising:

In a session in which at least two terminals participate, the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal;

Obtaining the multimedia data to be played according to the resource identifier;

Receiving a synchronous play notification sent by the initiator terminal;

The multimedia data is played according to the synchronous play notification.
The method of claim 10, wherein the method further comprises:

After the receiver terminal acquires the multimedia data to be played according to the resource identifier, the receiver terminal initiates the The party terminal feedbacks the resource acquisition notification; wherein the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
The method according to claim 10, wherein after the initiator terminal adjusts a play status of the multimedia data according to a play control operation, and generates adjustment information to be sent to the receiver terminal, the method further include:

Receiving, by the receiver terminal, adjustment information sent by the initiator terminal;

And synchronously adjusting a playing state of the respective multimedia data according to the adjustment information;

The adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.
The method according to claim 10, wherein the receiving terminal receives a synchronous play notification sent by the initiator terminal through a server;

The method further includes:

When the receiving terminal monitors the playing card, the device sends a card correction request to the server, so that the server sends the multimedia data corresponding to the current playing time to the receiver terminal according to the card correction request;

The receiving terminal loads the current playing time corresponding to the multimedia data for playing.
The method of claim 10, wherein the method further comprises:

Receiving, by the receiving terminal, the audio of the currently played multimedia data, and recording the input voice message, when receiving the voice input operation during the playing process;

The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
The method of claim 10, wherein the method further comprises:

Receiving, by the receiver terminal, a voice message sent by another terminal;

Lowering the volume of the audio of the currently played multimedia data to a preset volume threshold, and playing the received voice message;

After the voice message is played, the volume of the audio of the currently played multimedia data is restored.
The method according to claim 10, wherein the receiver terminal loads a play control in the currently displayed session interface to play the multimedia data;

The method further includes:

When the play control enters the full-screen play mode, the session display area is set in the current play interface;

The receiving terminal displays the instant messaging message sent by itself and the received instant messaging message sent by the initiator terminal according to the chronological order of each instant messaging message, and displays the instant messaging message on the session display. In the district.
A method for synchronously playing multimedia data, the method comprising:

In a session in which at least two terminals participate, the server receives the resource identifier sent by the initiator terminal;

Distributing the resource identifier to all receiver terminals in the same session;

Receiving a synchronous play notification sent by the initiator terminal, and distributing it to all receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.
The method of claim 17 wherein the method further comprises:

The server monitors the occurrence of a jam in each terminal during synchronous playback.
The method according to claim 18, wherein the server monitors the occurrence of a jam during the synchronous playback, and specifically includes:

The server records a starting play progress of each terminal for synchronous play, and a system time corresponding to the initial play progress;

Sending a progress query request to each terminal, and receiving feedback from each terminal;

In the case that the adjustment information corresponding to the playback progress operation is not received, the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress The time difference between them is monitored.
The method of claim 18, wherein the method further comprises:

After detecting that the terminal is stuck, the server feeds back the synchronized play progress of the current time to the terminal where the card is present according to the recorded synchronized play progress, so that the terminal that appears to be stuck loads the synchronized play progress of the current time.
An apparatus for synchronously playing multimedia data, characterized in that the apparatus comprises:

An obtaining module, configured to acquire a resource identifier of the multimedia data;

a sending module, configured to send the resource identifier to all receiver terminals in the same session;

The synchronization notification module is configured to send a synchronization play notification to each of the receiver terminals after the multimedia data is acquired according to the resource identifier, so that all the terminals participating in the session play the multimedia data synchronously.
The device according to claim 21, wherein the synchronization notification module is configured to: after receiving the resource acquisition notification fed back by the receiver terminal, send a synchronization play notification to the receiver terminal;

The resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
The device according to claim 21, wherein in the currently displayed session interface, the initiator terminal loads an operable play control to play the multimedia data;

The device further includes: a play control module, configured to receive, by the initiator terminal, a play control operation for the play control, and adjust a play status of the multimedia data according to the play control operation, according to the adjusted play status And generating the adjustment information, and distributing the adjustment information to each receiver terminal in the same session, so that each receiver terminal synchronously adjusts the play status of the respective multimedia data according to the adjustment information;

The play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
The device of claim 23, wherein the playback control module is configured to adjust a playback progress of the multimedia data according to the playback progress operation;

And determining a play time corresponding to the adjusted play progress, and generating the progress adjustment information according to the play time.
The device according to claim 21, wherein the synchronization notification module is specifically configured to send a synchronization play notification to the recipient terminals through a server.
The device according to claim 25, wherein said device further comprises: a carton processing module, configured to: when the play jam is detected, send a jam correction request to the server, such that the server is based on the card The correction request sends the multimedia data corresponding to the current play time to the initiator terminal, and the initiator terminal loads the multimedia data corresponding to the current play time for playing.
The device according to claim 21, wherein the device further comprises: a voice message module, configured to: when receiving the voice message input during the playing, turn off the audio of the currently played multimedia data, and record the input. The voice message sends the voice message to each receiver terminal in the same session, and re-opens the audio of the currently played multimedia data.
The device according to claim 21, wherein the voice message module is further configured to receive a voice message sent by the receiver terminal, and reduce the volume of the audio of the currently played multimedia data to a preset The volume threshold is played, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.
The device according to claim 21, wherein in the currently displayed session interface, the initiator terminal loads an operable play control to play the multimedia data;

The device further includes: an instant messaging message module, configured to: when the play control enters the full-screen play mode, set a session display area in the current play interface, the initiator terminal sends an instant message to itself, and receives The instant messaging messages sent by the respective receiving terminal terminals are displayed in the session display area according to the chronological order of the instant messaging messages.
An apparatus for synchronously playing multimedia data, characterized in that the apparatus comprises:

a receiving module, configured to receive, by the receiving terminal, a resource identifier of the multimedia data sent by the initiator terminal;

An acquiring module, configured to acquire, according to the resource identifier, the multimedia data to be played;

a notification receiving module, configured to receive a synchronization play notification sent by the initiator terminal;

And a synchronous play module, configured to play the multimedia data according to the synchronous play notification.
The device according to claim 30, wherein the acquiring module is further configured to: after acquiring the multimedia data to be played according to the resource identifier, feed back a resource acquisition notification to the initiator terminal;

The resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
The apparatus according to claim 30, wherein said initiator terminal adjusts a play status of said multimedia data according to a play control operation, and generates adjustment information to be transmitted to said receiver terminal, said device further comprising a playback control module, configured to receive, by the receiver terminal, adjustment information sent by the initiator terminal, and synchronously adjust a play status of the respective multimedia data according to the adjustment information;

The adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.
The device according to claim 30, wherein the receiver terminal receives the synchronization play notification sent by the initiator terminal by using a server; the device further includes: a card processing module, configured to monitor the play card time Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the current play time. Play corresponding to multimedia data.
The device according to claim 30, further comprising: a voice message module, configured to receive audio of the currently played multimedia data and record input when receiving a voice input operation during playback The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
The device according to claim 30, wherein said voice message module is further configured to receive The voice message sent by the terminal reduces the volume of the currently played multimedia data to a preset volume threshold, and plays the received voice message. When the voice message is played, the current voice is restored. The volume of the audio of the multimedia data played.
The device according to claim 30, wherein the device further comprises: an instant messaging message module, configured to: when the play control enters the full-screen play mode, set a session display area in the current play interface, and receive The instant messaging message sent by the party terminal itself, and the received instant messaging message sent by the initiator terminal, display the instant messaging message in the session display area according to the chronological order of each instant messaging message.
An apparatus for synchronously playing multimedia data, characterized in that the apparatus comprises:

a receiving module, configured to receive, by a server, a resource identifier sent by the initiator terminal;

a distribution module, configured to distribute the resource identifier to all receiver terminals in the same session;

The synchronization notification module is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.
The apparatus according to claim 37, wherein said apparatus further comprises: a monitoring module for monitoring the occurrence of a jam in each terminal during the synchronized playback.
The device according to claim 38, wherein the monitoring module is specifically configured to record a starting playback progress of each terminal for synchronous play, and a system time corresponding to the initial playback progress, and send a progress query to each terminal. Requesting, and receiving feedback from each terminal, in the case that the adjustment information corresponding to the playback progress operation is not received, the time difference between the current playback progress and the initial playback progress of the feedback, and the system time corresponding to the current playback progress The time difference between the system times corresponding to the initial playback progress is monitored for the stuck.
The device according to claim 38, wherein the device further comprises: a card correction module, configured to: when the terminal is detected to be stuck, according to the recorded synchronized playback progress, the synchronous playback progress feedback of the current time The terminal that appears to be stuck, so that the terminal that appears to be stuck loads the synchronized playback progress of the current moment.