US20040260827A1 - Stream switching based on gradual decoder refresh - Google Patents
Stream switching based on gradual decoder refresh Download PDFInfo
- Publication number
- US20040260827A1 US20040260827A1 US10/601,320 US60132003A US2004260827A1 US 20040260827 A1 US20040260827 A1 US 20040260827A1 US 60132003 A US60132003 A US 60132003A US 2004260827 A1 US2004260827 A1 US 2004260827A1
- Authority
- US
- United States
- Prior art keywords
- switching
- bitstream
- bitstreams
- stream
- streaming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/752—Media network packet handling adapting media to network capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
Definitions
- the present invention relates generally to video streaming and, more particularly, to stream adaptation in accordance with changing transmission conditions.
- Stream adaptation is either multi-encoding based or transcoding based.
- the server stores the same video content in a plurality of encoded streams of different forms or with different parameters, and the transmitted data in the encoded streams may be switched between different streams.
- the server contains a transcoder to transcode a stream to different forms or with different parameters.
- the switched-to bitstream must contain switching points, such that the client-side decoder can still receive image data of acceptable decoding quality after switching.
- Switching points can be random access points or non-random access points.
- SP/SI pictures can be used for stream switching at non-random access points. Random access points, however, are natural switching points.
- Random access refers to the ability of the decoder to start decoding a stream at a point in the stream other than the beginning of the stream, and to recover an exact or approximate representation of the decoded pictures.
- a random access point is a switching point where decoding of any following coded picture can be initiated.
- a random access point and a recovery point characterize a random access operation. All decoded pictures located at or subsequent to a recovery point in the output order are correct or approximately correct in content. If the random access point is the same as the recovery point, the random access operation is Instantaneous Decoder Refresh (IDR), otherwise it is Gradual Decoder Refresh (GDR). IDR points in a video stream can be used in fast forward and random access, but they can also be used for error resiliency and recovery. IDR is also used in bitrate adaptation by stream switching, especially on the server side.
- IDR Instantaneous Decoder Refresh
- GDR Gradual Decoder Refresh
- IDR pictures are pictures that are coded without any reference to other pictures, and all the pictures following and IDR picture in decoding order are coded without reference to any earlier picture than the IDR picture in decoding order, whereas GDR can be implemented using the technique called isolated regions as described later in this document.
- the picture at a GDR random access point is called a GDR picture.
- Random access points render it possible to seek operations in locally stored video streams.
- servers can respond to seek requests by transmitting data starting from the random access point that is closest to the requested destination of the seek operation.
- Switching between coded streams of different bit-rates is a method that is used commonly in unicast streaming for the Internet to match the transmitted bitrate to the expected network throughput and to avoid congestion in the network. Switching to another stream is possible at a random access point.
- random access points enable tuning in to a broadcast or multicast.
- a random access point can be coded as a response to a scene cut in the source sequence or as a response to an intra picture update request.
- MPEG-4 Part 12 specifies ISO (International Organization for Standardization) base media file format. It is designed to contain timed media information for a presentation in a flexible, extensible format that facilitates interchange, management, editing, and presentation of the media. This presentation may be ‘local’ to the system containing the presentation, or may be carried out via a network or other stream delivery mechanism.
- the file structure is object-oriented in that a file can be decomposed into constituent objects, and the structure of the objects can be inferred directly from their type.
- the file format is designed to be independent of any particular network protocol while enabling efficient support for them in general.
- ISO base media file format is used as the basis for MP4 file format (MPEG-4 Part 14) and AVC (Advanced Video Coding) file format (MPEG-4 Part 15).
- AVC file format specifies how AVC content is stored in an ISO base media file format. It is normally used in the context of a specification, such as the MP4 file format, derived from ISO base media file format that permits the use of AVC video.
- SP/SI pictures are stored in switching picture tracks, which are tracks separate from the track that is being switched from and the track being switched to.
- Switching picture tracks can be identified by the existence of a specific required track reference in that track.
- a switching picture is an alternative to the sample in the destination track that has exactly the same decoding time.
- Each IDR random access point corresponds to a sync sample indicated in the Sync Sample Box.
- the design of Sync Sample Box is specified in the ISO base media file format as follows: Definition Box Type: ‘stss’ Container: Sample Table Box (‘stbl’) Mandatory: No Quantity: Zero or one
- This box provides a compact marking of the random access points within the stream.
- the table is arranged in strictly increasing order of sample number. If the sync sample box is not present, every sample is a random access point.
- [0015] version is an integer that specifies the version of the box.
- entry_count is an integer that gives the number of entries in the following table. If entry_count is zero, there are no random access points within the stream and the following table is empty.
- sample_number gives the numbers of the samples that are random access points in the stream.
- the isolated regions technique provides an elegant solution for many applications, such as GDR (gradual decoder refresh) (JVT-C074), error resiliency and recovery (JVT-C073), region-of-interest coding and prioritization, picture-in-picture functionality, and coding of masked video scene transitions (JVT-C075).
- GDR gradient decoder refresh
- JVT-C073 error resiliency and recovery
- JVT-C073 region-of-interest coding and prioritization
- picture-in-picture functionality picture-in-picture functionality
- coding of masked video scene transitions JVT-C075
- An isolated region in a picture can contain any macroblock and a picture can contain zero or one isolated region, or more isolated regions that do not overlap.
- a leftover region is the area of the picture that is not covered by any isolated region of a picture.
- all predictive coding within the same coded or decoded picture, herein referred to as in-picture prediction is disabled across its boundaries.
- a leftover region may be predicted from isolated regions of the same picture.
- a coded isolated region can be decoded without the presence of any other isolated or leftover region of the same coded picture. It may be necessary to decode all isolated regions of a picture before the leftover region. An isolated region or a leftover region contains at least one slice.
- Pictures, whose isolated regions are predicted from each other, are grouped into an isolated-region picture group.
- An isolated region can be coupled with a corresponding isolated region in each earlier picture within the same isolated-region picture group.
- An isolated region can be inter-predicted from the corresponding isolated region within the same isolated-region picture group.
- inter prediction of an isolated region from other isolated regions is disallowed.
- a leftover region may be inter-predicted from any isolated region.
- the shape, location, and size of coupled isolated regions may evolve from picture to picture in an isolated-region picture group.
- Coding of isolated regions can be realized in the JVT codec based on slice groups.
- Each GDR random access point is characterized by a recovery point Supplemental Enhancement Information (SEI) message.
- SEI Supplemental Enhancement Information
- the JVT coding standard supports SP/SI pictures. It is known that in stream switching involving only P-slices, the decoder will not have the correct decoded reference frames required in image reconstruction. By inserting an I-slice at regular intervals in the coded sequence to create switching points can solve this problem. However, an I-splice is likely to contain much more coded data than a P-slice. As such, a peak in the coded birate is resulted at each switching point. SP-slices and SI-slices are designed to support switching without the increased bitrate penalty of I-slices.
- An SP/SI picture is encoded in such a way that another SP/SI picture using different reference pictures can have exactly the same reconstructed picture.
- SP/SI pictures can be applied for bitstream switching, splicing, random access, fast forward, fast backward and error resilience/recovery. For example, let us assume that there are two bitstreams, bs 1 and bs 2 , of different bitrates, originated from the same video sequence. In bs 1 , an SP picture (s 1 ) is coded, and another SP picture (s 2 ) is coded at the same location in bs 2 . In bs 1 , an additional SP picture (s 12 ) is coded having exactly the same reconstructed picture as s 2 .
- s 12 and s 2 use different reference pictures (from bs 1 and bs 2 , respectively).
- switching from bs 1 to bs 2 can be carried out by transmitting s 12 instead of s 1 in the switching location. Since s 12 has exactly the same reconstruction as s 2 , reconstructed pictures after switching are error-free.
- FIG. 1 depicts a transmitting system 10 , which includes a server 20 capable of receiving a plurality of streams from a transcoder or multi-stream generator or storage device 12 .
- the streaming server 20 comprises a stream selector 22 to select one of the encoded streams 1 to n.
- the selected encoded stream is divided into packets by a packetizer 24 and coded in a channel coder 26 for transmission.
- the server generally selects the best possible encoded stream for transmission.
- a streaming client device 40 comprises a channel decoder 42 , a de-packetizer 44 and a decoder 46 for providing decoded video signals to a display 48 for display, as shown in FIG. 2.
- the streaming client device can send a request signal to the server to request switching of the stream.
- FIG. 3 shows the connection between a streaming server 20 and a streaming client 40 through a network 60 .
- a random access point is any picture from which decoding can be initiated. At such an access point, all decoded pictures at, or subsequent to, a recovery point are correct or approximately correct in content. It should be noted that the phrase “correct in content” as used in this disclosure means that the decoded slice or picture is exactly the same as when the decoding is started from the beginning of the stream, and the phrase “approximately correct in content” means that the decoded slice or picture is approximately the same as when the decoding is started from the beginning of the bitstream. As shown in FIG. 4 a , the recovery point is the same as the switching point, and the pictures with correct or approximately correct in content start at the switching point. As such, the random access operation is referred to as Instantaneous Decoder Refresh (IDR). With IDR random access points, only an I slice or an SI slice can be used for stream switching.
- IDR Instantaneous Decoder Refresh
- a Gradual Decoder Refresh (GDR) random access point can contain any kind of slices (I, P, SI, SP). As shown in FIG. 4 b , however, the content in the picture is correct or approximately correct starting from a picture following the switching point in the output order. The pictures between the recovery point and the switching point may be visually annoying or otherwise unacceptable for viewing.
- GDR Gradual Decoder Refresh
- AVC file format An example of the file format is AVC file format, which is important for a server file containing streaming content with GDR based video coding to support stream switching.
- AVC contents stored in the AVC file format a GDR switching point can only be identified when an access unit contains a recovery point SEI message, and the syntax element changing_slice_group_idc is equal to 1 or 2, as specified in the JVT coding standard. This method requires that each AVC access unit is checked to see whether there is a recovery point SEI message and whether changing_slice_group_idc is equal to 1 or2.
- the present invention provides an efficient signal method and device for GDR switching points in file format. Furthermore, information on how the GDR is encoded using isolated regions is also signaled so as to achieve faster stream switching. With the signaling method of present invention, GDR switching points can be identified as easily as other switching points, such as IDR and SP/SI switching points. In addition, the server can select to transmit only the isolated region for the access units from the GDR switching point to the recover point, inclusive, to achieve faster GDR switching and reduced bitrate.
- the method is characterized by
- the recovery point is different from the switching point.
- the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and the provided information is further indicative of the isolated region.
- the stream switching can be initiated by a server device or requested by a client device in a streaming network based on transmission conditions between the server device and the client device.
- the signaling method is used in a transmission utilizing Real-time Transport Protocol (RTP), and wherein a Session Description Protocol (SDP) is used to convey information indicative of characteristics of the first and second bitstreams.
- RTP Real-time Transport Protocol
- SDP Session Description Protocol
- a streaming server device capable of switching streams among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching.
- the streaming server device is characterized by
- [0042] means for providing in the bitstreams information indicative of the switching point, so as to allow the stream selector to select the second bitstream for transmission based on the provided information, wherein the recovery point is different from the switching point.
- a streaming system capable of switching stream among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching.
- the streaming system is characterized by
- At least one streaming server for transmitting one of the bitstreams to the streaming client so as to allow the streaming client to reconstruct the video frames based on the transmitted bitstream, wherein the streaming server comprises:
- a stream selector for selecting the first bitstream for transmission and for further selecting the second bitstream
- [0047] means for providing in the bitstreams information indicative of the switching point so as to allow the stream selector to select the second bitstream based on the provided information, wherein the recovery point is different from the switching point.
- the streaming system is further characterized by
- a video encoder to convert a video input signal into the video data
- [0050] means, responsive to the video data, for encoding the video data into the plurality of bitstreams.
- a software program for use in a streaming system for stream switching among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching.
- the computer program is characterized by
- a code for indicating said switching point in information provided in the bitstreams so as to allow a streaming server to carrying out the stream switching based on the provided information, wherein the recovery point is different from the switching point.
- FIG. 1 is a block diagram illustrating a streaming server that supports stream switching.
- FIG. 2 is a block diagram illustrating a streaming client.
- FIG. 3 is a schematic representation of a streaming system.
- FIG. 4 a is a schematic representation illustrating stream switching using an instantaneous decoder refresh picture.
- FIG. 4 b is a schematic representation illustrating stream switching using a gradual decoder refresh picture.
- FIG. 5 is a block diagram illustrating a sync sample box.
- FIG. 6 is a block diagram illustrating a sync sample information box, according to the present invention.
- FIG. 7 is a schematic representation illustrating a streaming system, according to the present invention.
- information on the switchable GDR pictures is included in a sync sample information box (ssif) that is contained in the sync sample box so as to indicate the access points. Furthermore, the slice groups need to be associated to the isolated region and to the leftover region in the ssif. Using this information, the decoder can use the GDR picture to correctly switch streams. Using GDR pictures in switching, the information of pictures in the switching points can be transmitted faster than that for IDR pictures, because the leftover region in a GDR picture does not need to be sent. Though using GDR pictures for switching the users may see only part of the picture area at beginning, they could be happier if they can see something as soon as possible. In addition, the leftover region in a picture from the GDR switching point to the recovery point, inclusively, does not need to be sent. As such, reduced transmission rate is achieved.
- each random access point is a switching point. It should be noted that all random access points, including both IDR random access points (IDR access units) and GDR random access points (access units containing recovery point SEI messages with the syntax element changing_slice_group_idc equal to 1 or 2), are marked in Sync Sample Box.
- a Sync Sample Information Box (contained in sync sample box) is defined as follows: Definition Box Type: ‘ssif’ Container: Sync Sample Box (‘stss’) Mandatory: No Quantity: Zero or one
- This box provides information of the random access points within the stream.
- the information includes whether a random access point is a GDR or an IDR random access point. If the random access point is a GDR point, the information also includes which slice group is the isolated region and which slice group is the leftover region. If the sync sample box does not contain a sync sample information box, all the sync samples marked by the sync sample box are IDR random access points.
- random_access_point_idc
- [0070] 1 indicates that the isolated region is covered by slice group 0 while the leftover region is covered by slice group 1 ;
- [0071] 2 indicates that the isolated region is covered by slice group 1 while the leftover region is covered by slice group 0 ;
- FIG. 5 An exemplary Sync Sample Box is shown in FIG. 5 and an exemplary Sync Sample Information Box is shown in FIG. 6.
- a computer program is used in the streaming system to provide information on the switchable GDR pictures in a Sync Sample Information Box that is contained in a Sync Sample Box.
- the information includes the switching points.
- the computer program also specifies the slice groups that are associated to the isolation region and to the leftover region.
- Such a computer program is denoted by reference numeral 16 , as shown in FIG. 7.
- the computer program 16 is part of a video coder 14 , which provides encoded video input signal and GDR related information to the multi-stream transcoder/generator 12 .
- the stream server 20 is capable of selecting one of the encoded streams for transmission, based on the dynamic network conditions in the network 60 .
- the streaming server 20 may initiate stream switching in that the streaming server chooses another encoded stream, according with the GDR related information provided in the Sync Sample Information Box.
- the streaming client 40 may send a request signal to the streaming server 20 , requesting a different transmitted stream if the streaming client 40 detects a change in the transmission conditions in the network 60 .
- the GDR signaling method can be used in video data transmission using Real-time Transport Protocol (RTP), and a Session Description Protocol (SDP) can be used to convey information indicative of the characteristics of bitstreams in stream switching.
- RTP Real-time Transport Protocol
- SDP Session Description Protocol
- RTP provides end-to-end network transport functions suitable for applications transmitting real-time data, such as audio, video or simulation data, over multicast or unicast network services.
- RTP does not address resource reservation and does not guarantee quality-of-service (QoS) for real-time services.
- the data transport is augmented by a control protocol (RTCP) to allow monitoring of the data delivery in a manner scalable to large multicast networks, and to provide minimal control and identification functionality.
- RTCP control protocol
- RTP and RTCP are designed to be independent of the underlying transport and network layers.
- the protocol supports the use of RTP-level translators and mixers.
- the Session Description Protocol is intended for describing multimedia sessions for the purposes of session announcement, session invitation, and other forms of multimedia session initiation. SDP can be used, for example, by the server to notify the client what bitrate alternatives of a bistream is available.
- the GDR signaling method is applicable to the video coding standard ITU-T H.264 (also known as MPEG-4 Part 10 or AVC)developed by Joint Video Team (JVT).
- JVT Joint Video Team
- the application of the present invention is not limited to the above-mentioned JVT coding standard.
- the present invention may also be applied to other video coding standards and devices.
Abstract
A signaling method and device for use in stream switching in which GDR random access points are used. In order to indicate the GDR switching points in the bitstreams, a Sync Sample Information Box, which is contained in a Sync Sample Box, is used to provide information of such GDR switching points. The information also includes which slice group is the isolated region and which slice group is the leftover region. The signaling method can be used in video data transmission using Real-time Transport Protocol (RTP), and a Session Description Protocol (SDP) can be used to convey information indicative of the characteristics of the bitstreams.
Description
- The present invention relates generally to video streaming and, more particularly, to stream adaptation in accordance with changing transmission conditions.
- In video streaming or video-on-demand services, because of the dynamic network conditions, the end-to-end transmission characteristics between the server and the client may change frequently. For example, the transmission bitrate may be reduced. To maintain the continuity of the streaming session and to maximize the Quality of Service, the server should adapt the transmitted stream to the changing transmission conditions. This process is called stream adaptation.
- Stream adaptation is either multi-encoding based or transcoding based. In multi-encoding based stream adaptation, the server stores the same video content in a plurality of encoded streams of different forms or with different parameters, and the transmitted data in the encoded streams may be switched between different streams. In transcoding based stream adaptation, the server contains a transcoder to transcode a stream to different forms or with different parameters.
- To enable switching from one bitstream to another, the switched-to bitstream must contain switching points, such that the client-side decoder can still receive image data of acceptable decoding quality after switching. Switching points can be random access points or non-random access points. SP/SI pictures can be used for stream switching at non-random access points. Random access points, however, are natural switching points.
- Random access refers to the ability of the decoder to start decoding a stream at a point in the stream other than the beginning of the stream, and to recover an exact or approximate representation of the decoded pictures. Thus, a random access point is a switching point where decoding of any following coded picture can be initiated.
- A random access point and a recovery point characterize a random access operation. All decoded pictures located at or subsequent to a recovery point in the output order are correct or approximately correct in content. If the random access point is the same as the recovery point, the random access operation is Instantaneous Decoder Refresh (IDR), otherwise it is Gradual Decoder Refresh (GDR). IDR points in a video stream can be used in fast forward and random access, but they can also be used for error resiliency and recovery. IDR is also used in bitrate adaptation by stream switching, especially on the server side.
- IDR pictures are pictures that are coded without any reference to other pictures, and all the pictures following and IDR picture in decoding order are coded without reference to any earlier picture than the IDR picture in decoding order, whereas GDR can be implemented using the technique called isolated regions as described later in this document. The picture at a GDR random access point is called a GDR picture.
- Random access points render it possible to seek operations in locally stored video streams. In video on-demand streaming, servers can respond to seek requests by transmitting data starting from the random access point that is closest to the requested destination of the seek operation. Switching between coded streams of different bit-rates is a method that is used commonly in unicast streaming for the Internet to match the transmitted bitrate to the expected network throughput and to avoid congestion in the network. Switching to another stream is possible at a random access point. Furthermore, random access points enable tuning in to a broadcast or multicast. In addition, a random access point can be coded as a response to a scene cut in the source sequence or as a response to an intra picture update request.
- File Format
- MPEG-4
Part 12 specifies ISO (International Organization for Standardization) base media file format. It is designed to contain timed media information for a presentation in a flexible, extensible format that facilitates interchange, management, editing, and presentation of the media. This presentation may be ‘local’ to the system containing the presentation, or may be carried out via a network or other stream delivery mechanism. The file structure is object-oriented in that a file can be decomposed into constituent objects, and the structure of the objects can be inferred directly from their type. The file format is designed to be independent of any particular network protocol while enabling efficient support for them in general. ISO base media file format is used as the basis for MP4 file format (MPEG-4 Part 14) and AVC (Advanced Video Coding) file format (MPEG-4 Part 15). AVC file format specifies how AVC content is stored in an ISO base media file format. It is normally used in the context of a specification, such as the MP4 file format, derived from ISO base media file format that permits the use of AVC video. - In the current design of AVC file format, SP/SI pictures are stored in switching picture tracks, which are tracks separate from the track that is being switched from and the track being switched to. Switching picture tracks can be identified by the existence of a specific required track reference in that track. A switching picture is an alternative to the sample in the destination track that has exactly the same decoding time.
- Each IDR random access point corresponds to a sync sample indicated in the Sync Sample Box. The design of Sync Sample Box is specified in the ISO base media file format as follows:
Definition Box Type: ‘stss’ Container: Sample Table Box (‘stbl’) Mandatory: No Quantity: Zero or one - This box provides a compact marking of the random access points within the stream. The table is arranged in strictly increasing order of sample number. If the sync sample box is not present, every sample is a random access point.
Syntax aligned(8) class SyncSampleBox extends FullBox(‘stss’, version = 0, 0) { unsigned int(32) entry_count; int i; for (i=0; i < entry_count; i++) { unsigned int(32) sample_number; } } - Semantics
- version is an integer that specifies the version of the box.
- entry_count is an integer that gives the number of entries in the following table. If entry_count is zero, there are no random access points within the stream and the following table is empty.
- sample_number gives the numbers of the samples that are random access points in the stream.
- Isolated Regions
- The isolated regions technique provides an elegant solution for many applications, such as GDR (gradual decoder refresh) (JVT-C074), error resiliency and recovery (JVT-C073), region-of-interest coding and prioritization, picture-in-picture functionality, and coding of masked video scene transitions (JVT-C075). With GDR being based on isolated regions, media channel switching for receivers, bitstream switching for the server, and allowing newcomers for multicast streaming will be as easy as instantaneous random access with smoother bitrate.
- An isolated region in a picture can contain any macroblock and a picture can contain zero or one isolated region, or more isolated regions that do not overlap. A leftover region is the area of the picture that is not covered by any isolated region of a picture. When coding an isolated region, all predictive coding within the same coded or decoded picture, herein referred to as in-picture prediction, is disabled across its boundaries. A leftover region may be predicted from isolated regions of the same picture.
- A coded isolated region can be decoded without the presence of any other isolated or leftover region of the same coded picture. It may be necessary to decode all isolated regions of a picture before the leftover region. An isolated region or a leftover region contains at least one slice.
- Pictures, whose isolated regions are predicted from each other, are grouped into an isolated-region picture group. An isolated region can be coupled with a corresponding isolated region in each earlier picture within the same isolated-region picture group. An isolated region can be inter-predicted from the corresponding isolated region within the same isolated-region picture group. However, inter prediction of an isolated region from other isolated regions is disallowed. In contrast, a leftover region may be inter-predicted from any isolated region. The shape, location, and size of coupled isolated regions may evolve from picture to picture in an isolated-region picture group.
- Coding of isolated regions can be realized in the JVT codec based on slice groups. Each GDR random access point is characterized by a recovery point Supplemental Enhancement Information (SEI) message.
- SP/SI Pictures
- The JVT coding standard supports SP/SI pictures. It is known that in stream switching involving only P-slices, the decoder will not have the correct decoded reference frames required in image reconstruction. By inserting an I-slice at regular intervals in the coded sequence to create switching points can solve this problem. However, an I-splice is likely to contain much more coded data than a P-slice. As such, a peak in the coded birate is resulted at each switching point. SP-slices and SI-slices are designed to support switching without the increased bitrate penalty of I-slices.
- An SP/SI picture is encoded in such a way that another SP/SI picture using different reference pictures can have exactly the same reconstructed picture. SP/SI pictures can be applied for bitstream switching, splicing, random access, fast forward, fast backward and error resilience/recovery. For example, let us assume that there are two bitstreams, bs1 and bs2, of different bitrates, originated from the same video sequence. In bs1, an SP picture (s1) is coded, and another SP picture (s2) is coded at the same location in bs2. In bs1, an additional SP picture (s12) is coded having exactly the same reconstructed picture as s2. s12 and s2 use different reference pictures (from bs1 and bs2, respectively). Thus, switching from bs1 to bs2 can be carried out by transmitting s12 instead of s1 in the switching location. Since s12 has exactly the same reconstruction as s2, reconstructed pictures after switching are error-free.
- Streaming System
- As mentioned earlier, in multi-encoding based stream adaptation, the server stores in a plurality of encoded streams the same video content, but only one of the encoded streams is selected for transmission. FIG. 1 depicts a transmitting
system 10, which includes aserver 20 capable of receiving a plurality of streams from a transcoder or multi-stream generator orstorage device 12. As shown, the streamingserver 20 comprises astream selector 22 to select one of the encodedstreams 1 to n. The selected encoded stream is divided into packets by apacketizer 24 and coded in achannel coder 26 for transmission. To maintain continuity of the streaming session and to maximize the Quality of Service, the server generally selects the best possible encoded stream for transmission. When the transmission condition changes, the server may have to increase or reduce the bitrate, for example. Accordingly, the stream selector switches streams by selecting a different encoded stream at a switching point. At the client side, however, the decoder can simply decode whatever transmission data it receives. Basically, astreaming client device 40 comprises achannel decoder 42, a de-packetizer 44 and adecoder 46 for providing decoded video signals to adisplay 48 for display, as shown in FIG. 2. However, in a streaming system that supports client-driven stream adaptation, the streaming client device can send a request signal to the server to request switching of the stream. The streaming system is shown in FIG. 3, which shows the connection between a streamingserver 20 and astreaming client 40 through anetwork 60. - Instantaneous/Gradual Decoder Refresh
- As mentioned earlier, a random access point is any picture from which decoding can be initiated. At such an access point, all decoded pictures at, or subsequent to, a recovery point are correct or approximately correct in content. It should be noted that the phrase “correct in content” as used in this disclosure means that the decoded slice or picture is exactly the same as when the decoding is started from the beginning of the stream, and the phrase “approximately correct in content” means that the decoded slice or picture is approximately the same as when the decoding is started from the beginning of the bitstream. As shown in FIG. 4a, the recovery point is the same as the switching point, and the pictures with correct or approximately correct in content start at the switching point. As such, the random access operation is referred to as Instantaneous Decoder Refresh (IDR). With IDR random access points, only an I slice or an SI slice can be used for stream switching.
- In contrast, a Gradual Decoder Refresh (GDR) random access point can contain any kind of slices (I, P, SI, SP). As shown in FIG. 4b, however, the content in the picture is correct or approximately correct starting from a picture following the switching point in the output order. The pictures between the recovery point and the switching point may be visually annoying or otherwise unacceptable for viewing.
- Currently, an efficient method to signal GDR switching points to be used in file format is lacking. An example of the file format is AVC file format, which is important for a server file containing streaming content with GDR based video coding to support stream switching. For AVC contents stored in the AVC file format, a GDR switching point can only be identified when an access unit contains a recovery point SEI message, and the syntax element changing_slice_group_idc is equal to 1 or 2, as specified in the JVT coding standard. This method requires that each AVC access unit is checked to see whether there is a recovery point SEI message and whether changing_slice_group_idc is equal to 1 or2.
- The present invention provides an efficient signal method and device for GDR switching points in file format. Furthermore, information on how the GDR is encoded using isolated regions is also signaled so as to achieve faster stream switching. With the signaling method of present invention, GDR switching points can be identified as easily as other switching points, such as IDR and SP/SI switching points. In addition, the server can select to transmit only the isolated region for the access units from the GDR switching point to the recover point, inclusive, to achieve faster GDR switching and reduced bitrate.
- Thus, according to the first aspect of the present invention, there is provided a signaling method for use in stream switching among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching. The method is characterized by
- providing in the bitstreams information indicative of the switching point so that said stream switching can be carried out based on the provided information, wherein
- the recovery point is different from the switching point.
- Furthermore, the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and the provided information is further indicative of the isolated region.
- The stream switching can be initiated by a server device or requested by a client device in a streaming network based on transmission conditions between the server device and the client device.
- The signaling method is used in a transmission utilizing Real-time Transport Protocol (RTP), and wherein a Session Description Protocol (SDP) is used to convey information indicative of characteristics of the first and second bitstreams.
- According to the second aspect of the present invention, there is provided a streaming server device capable of switching streams among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching. The streaming server device is characterized by
- a stream selector for selecting the first bitstream for transmission; and
- means for providing in the bitstreams information indicative of the switching point, so as to allow the stream selector to select the second bitstream for transmission based on the provided information, wherein the recovery point is different from the switching point.
- According to the third aspect of the present invention, there is provided a streaming system capable of switching stream among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching. The streaming system is characterized by
- at least one streaming client; and
- at least one streaming server for transmitting one of the bitstreams to the streaming client so as to allow the streaming client to reconstruct the video frames based on the transmitted bitstream, wherein the streaming server comprises:
- a stream selector for selecting the first bitstream for transmission and for further selecting the second bitstream, and
- means for providing in the bitstreams information indicative of the switching point so as to allow the stream selector to select the second bitstream based on the provided information, wherein the recovery point is different from the switching point.
- The streaming system is further characterized by
- a video encoder to convert a video input signal into the video data; and
- means, responsive to the video data, for encoding the video data into the plurality of bitstreams.
- According to the fourth aspect of the present invention, there is provided a software program for use in a streaming system for stream switching among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching. The computer program is characterized by
- a code for determining said switching point; and
- a code for indicating said switching point in information provided in the bitstreams, so as to allow a streaming server to carrying out the stream switching based on the provided information, wherein the recovery point is different from the switching point.
- The present invention will become apparent upon reading the description taken in conjunction with FIGS.5 to 7.
- FIG. 1 is a block diagram illustrating a streaming server that supports stream switching.
- FIG. 2 is a block diagram illustrating a streaming client.
- FIG. 3 is a schematic representation of a streaming system.
- FIG. 4a is a schematic representation illustrating stream switching using an instantaneous decoder refresh picture.
- FIG. 4b is a schematic representation illustrating stream switching using a gradual decoder refresh picture.
- FIG. 5 is a block diagram illustrating a sync sample box.
- FIG. 6 is a block diagram illustrating a sync sample information box, according to the present invention.
- FIG. 7 is a schematic representation illustrating a streaming system, according to the present invention.
- According to the present invention, information on the switchable GDR pictures is included in a sync sample information box (ssif) that is contained in the sync sample box so as to indicate the access points. Furthermore, the slice groups need to be associated to the isolated region and to the leftover region in the ssif. Using this information, the decoder can use the GDR picture to correctly switch streams. Using GDR pictures in switching, the information of pictures in the switching points can be transmitted faster than that for IDR pictures, because the leftover region in a GDR picture does not need to be sent. Though using GDR pictures for switching the users may see only part of the picture area at beginning, they could be happier if they can see something as soon as possible. In addition, the leftover region in a picture from the GDR switching point to the recovery point, inclusively, does not need to be sent. As such, reduced transmission rate is achieved.
- The implementation of the present invention in AVC file format is characterized in that each random access point is a switching point. It should be noted that all random access points, including both IDR random access points (IDR access units) and GDR random access points (access units containing recovery point SEI messages with the syntax element changing_slice_group_idc equal to 1 or 2), are marked in Sync Sample Box. In addition, a Sync Sample Information Box (contained in sync sample box) is defined as follows:
Definition Box Type: ‘ssif’ Container: Sync Sample Box (‘stss’) Mandatory: No Quantity: Zero or one - This box provides information of the random access points within the stream. The information includes whether a random access point is a GDR or an IDR random access point. If the random access point is a GDR point, the information also includes which slice group is the isolated region and which slice group is the leftover region. If the sync sample box does not contain a sync sample information box, all the sync samples marked by the sync sample box are IDR random access points.
Syntax aligned(8) class SyncSampleInformationBox extends FullBox(‘ssif’, version = 0, 0) { int i; for (i=0; i < entry_count; i++) { unsigned int(2) random_access_point_idc; bit (6) reserved = ‘111111’b; } } - Semantics
- version is an integer that specifies the version of this box.
- random_access_point_idc :
- 0 indicates that the random access point is not a IDR random access point;
- 1 indicates that the isolated region is covered by slice group0 while the leftover region is covered by
slice group 1; - 2 indicates that the isolated region is covered by
slice group 1 while the leftover region is covered by slice group 0; - 3 is not allowed.
- With the signaling method, according to the present invention, all switching points can be explicitly marked so that the stream server does not need to parse each picture to find the switching points. If there are no GDR switching points, the Sync Sample Information Box (contained in the Sync Sample Box) does not need to be used.
- An exemplary Sync Sample Box is shown in FIG. 5 and an exemplary Sync Sample Information Box is shown in FIG. 6.
- According to the present invention, a computer program is used in the streaming system to provide information on the switchable GDR pictures in a Sync Sample Information Box that is contained in a Sync Sample Box. The information includes the switching points. In addition, the computer program also specifies the slice groups that are associated to the isolation region and to the leftover region. Such a computer program is denoted by reference numeral16, as shown in FIG. 7. The computer program 16 is part of a video coder 14, which provides encoded video input signal and GDR related information to the multi-stream transcoder/
generator 12. Thestream server 20 is capable of selecting one of the encoded streams for transmission, based on the dynamic network conditions in thenetwork 60. If the end-to-end transmission characteristics between the streamingserver 20 and the streamingclient 40 have changed, the streamingserver 20 may initiate stream switching in that the streaming server chooses another encoded stream, according with the GDR related information provided in the Sync Sample Information Box. Alternatively, the streamingclient 40 may send a request signal to the streamingserver 20, requesting a different transmitted stream if the streamingclient 40 detects a change in the transmission conditions in thenetwork 60. - The GDR signaling method, according to the present invention, can be used in video data transmission using Real-time Transport Protocol (RTP), and a Session Description Protocol (SDP) can be used to convey information indicative of the characteristics of bitstreams in stream switching. As it is known, RTP provides end-to-end network transport functions suitable for applications transmitting real-time data, such as audio, video or simulation data, over multicast or unicast network services. RTP does not address resource reservation and does not guarantee quality-of-service (QoS) for real-time services. The data transport is augmented by a control protocol (RTCP) to allow monitoring of the data delivery in a manner scalable to large multicast networks, and to provide minimal control and identification functionality. RTP and RTCP are designed to be independent of the underlying transport and network layers. The protocol supports the use of RTP-level translators and mixers. The Session Description Protocol is intended for describing multimedia sessions for the purposes of session announcement, session invitation, and other forms of multimedia session initiation. SDP can be used, for example, by the server to notify the client what bitrate alternatives of a bistream is available.
- The GDR signaling method, according to the present invention, is applicable to the video coding standard ITU-T H.264 (also known as MPEG-4
Part 10 or AVC)developed by Joint Video Team (JVT). However, the application of the present invention is not limited to the above-mentioned JVT coding standard. The present invention may also be applied to other video coding standards and devices. - Thus, although the invention has been described with respect to a preferred embodiment thereof, it will be understood by those skilled in the art that the foregoing and various other changes, omissions and deviations in the form and detail thereof may be made without departing from the scope of this invention.
Claims (24)
1. A signaling method for use in stream switching among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching, said method characterized by
providing in the bitstreams information indicative of the switching point so that said stream switching can be carried out based on the provided information, wherein
the recovery point is different from the switching point.
2. The signaling method of claim 1 , wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, said method characterized in that the provided information is further indicative of the isolated region.
3. The signaling method of claim 1 , wherein the bitstreams are conveyed from a server device to a client device in a streaming network, said method characterized in that said stream switching is initiated by the server device.
4. The signaling method of claim 1 , wherein the bitstreams are conveyed from a server device to a client device in a streaming network, said method characterized in that said stream switching is requested by the client device.
5. The signaling method of claim 1 , wherein the signaling method is used in a transmission utilizing Real-time Transport Protocol (RTP).
6. The signaling method of claim 5 , wherein a Session Description Protocol (SDP) is used to convey information indicative of characteristics of the first and second bitstreams.
7. The signaling method of claim 1 , wherein said stream switching is carried out in transmission of the video data based on transmission conditions between a server device and a client device in a streaming network.
8. A streaming server device capable of switching streams among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching, said streaming server device characterized by
a stream selector for selecting the first bitstream for transmission; and
means for providing in the bitstreams information indicative of the switching point, so as to allow the stream selector to select the second bitstream for transmission based on the provided information, wherein the recovery point is different from the switching point.
9. The streaming server device of claim 8 , wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is further indicative of the isolated region.
10. The streaming server device of claim 8 , wherein the provided information is used in data transmission utilizing Real-time Transport Protocol (RTP).
11. The streaming server device of claim 10 , wherein a Session Description Protocol (SDP) is used to convey information indicative of characteristics of the first and second bitstreams.
12. The streaming server device of claim 8 , wherein said stream selector selects the second bitstream for stream switching based on transmission conditions between the streaming server device and a client device in a streaming network.
13. A streaming system capable of switching stream among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching, said streaming system characterized by
at least one streaming client; and
at least one streaming server for transmitting one of the bitstreams to the streaming client so as to allow the streaming client to reconstruct the video frames based on the transmitted bitstream, wherein the streaming server comprises:
a stream selector for selecting the first bitstream for transmission and for further selecting the second bitstream, and
means for providing in the bitstreams information indicative of the switching point so as to allow the stream selector to select the second bitstream based on the provided information, wherein the recovery point is different from the switching point.
14. The streaming system of claim 13 , wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is further indicative of the isolated region.
15. The streaming system of claim 13 , wherein said stream switching is initiated by the streaming server.
16. The streaming system of claim 13 , wherein said stream switching is requested by the streaming client.
17. The streaming system of claim 13 , wherein the provided information is used in data transmission utilizing Real-time Transport Protocol (RTP).
18. The streaming system of claim 17 , wherein a Session Description Protocol (SDP) is used to convey information indicative of characteristics of the first and second bitstreams.
19. The streaming system of claim 13 , wherein said stream selects the second bitstream for stream switching based on transmission conditions between the streaming server and the streaming client.
20. The streaming system of claim 13 , further characterized by
a video encoder to convert a video input signal into the video data; and
means, responsive to the video data, for encoding the video data into the plurality of bitstreams.
21. A software program for use in a streaming system for stream switching among a plurality of bitstreams, the bitstreams containing video data indicative of a plurality of video frames for each bitstream, wherein the bitstreams comprise at least one switching point so as to allow switching from a first bitstream to a second bitstream at said switching point, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching, said computer program characterized by
a code for determining said switching point; and
a code for indicating said switching point in information provided in the bitstreams, so as to allow a streaming server to carrying out the stream switching based on the provided information, wherein the recovery point is different from the switching point.
22. The software program of claim 21 , wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is further indicative of the isolated region.
23. The software program of claim 21 , wherein the provided information is used in data transmission utilizing Real-time Transport Protocol (RTP).
24. The software program of claim 23 , wherein a Session Description Protocol (SDP) is used to convey information indicative of characteristics of the first and second bitstreams.
Priority Applications (15)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/601,320 US20040260827A1 (en) | 2003-06-19 | 2003-06-19 | Stream switching based on gradual decoder refresh |
MXPA05013542A MXPA05013542A (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refreash. |
CNB038269317A CN100414956C (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refresh |
KR1020057024300A KR100734408B1 (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refresh |
JP2005500713A JP2006527927A (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refresh |
CA2529889A CA2529889C (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refresh |
PCT/IB2003/002787 WO2004112374A1 (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refreash |
RU2006101400/09A RU2328086C2 (en) | 2003-06-19 | 2003-07-11 | Data flow commutation based on gradual recovery during decoding |
BRPI0318357-2A BR0318357A (en) | 2003-06-19 | 2003-07-11 | method for signaling flow switching between a plurality of bit streams, streaming server device, streming system, and computer program |
EP03817249A EP1639804A4 (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refreash |
AU2003246988A AU2003246988B2 (en) | 2003-06-19 | 2003-07-11 | Stream switching based on gradual decoder refreash |
US10/848,966 US7552227B2 (en) | 2003-06-19 | 2004-05-19 | Stream switching based on gradual decoder refresh |
MYPI20042145A MY140364A (en) | 2003-06-19 | 2004-06-03 | Stream switching based on gradual decoder refresh |
TW93117574A TWI256245B (en) | 2003-06-19 | 2004-06-18 | Stream switching based on gradual decoder refresh |
JP2009026345A JP2009105970A (en) | 2003-06-19 | 2009-02-06 | Stream switching based on gradual decoder refresh |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/601,320 US20040260827A1 (en) | 2003-06-19 | 2003-06-19 | Stream switching based on gradual decoder refresh |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/848,966 Continuation-In-Part US7552227B2 (en) | 2003-06-19 | 2004-05-19 | Stream switching based on gradual decoder refresh |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040260827A1 true US20040260827A1 (en) | 2004-12-23 |
Family
ID=33517947
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/601,320 Abandoned US20040260827A1 (en) | 2003-06-19 | 2003-06-19 | Stream switching based on gradual decoder refresh |
US10/848,966 Active 2026-02-14 US7552227B2 (en) | 2003-06-19 | 2004-05-19 | Stream switching based on gradual decoder refresh |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/848,966 Active 2026-02-14 US7552227B2 (en) | 2003-06-19 | 2004-05-19 | Stream switching based on gradual decoder refresh |
Country Status (12)
Country | Link |
---|---|
US (2) | US20040260827A1 (en) |
EP (1) | EP1639804A4 (en) |
JP (2) | JP2006527927A (en) |
KR (1) | KR100734408B1 (en) |
CN (1) | CN100414956C (en) |
AU (1) | AU2003246988B2 (en) |
BR (1) | BR0318357A (en) |
CA (1) | CA2529889C (en) |
MX (1) | MXPA05013542A (en) |
MY (1) | MY140364A (en) |
RU (1) | RU2328086C2 (en) |
WO (1) | WO2004112374A1 (en) |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060242669A1 (en) * | 2005-04-20 | 2006-10-26 | Jupiter Systems | Display node for use in an audiovisual signal routing and distribution system |
EP1758400A2 (en) * | 2005-08-25 | 2007-02-28 | Samsung Electronics Co.,Ltd. | Mobile communication terminal and method for reproducing digital broadcasting |
US20070168534A1 (en) * | 2005-12-16 | 2007-07-19 | Nokia Corp. | Codec and session parameter change |
EP1966915A2 (en) * | 2005-12-29 | 2008-09-10 | Nokia Corporation | Tune-in time reduction |
WO2008129500A2 (en) * | 2007-04-24 | 2008-10-30 | Nokia Corporation | System and method for implementing fast tune-in with intra-coded redundant pictures |
EP2036350A1 (en) * | 2006-06-19 | 2009-03-18 | Telefonaktiebolaget LM Ericsson (PUBL) | Media channel management |
US20110060814A1 (en) * | 2003-06-25 | 2011-03-10 | Toyota Jidosha Kabushiki Kaisha | Content delivery system |
WO2012047060A2 (en) | 2010-10-08 | 2012-04-12 | Samsung Electronics Co., Ltd. | Method and apparatus for improving quality of service in a multimedia streaming service |
WO2014107721A1 (en) * | 2013-01-07 | 2014-07-10 | Qualcomm Incorporated | Gradual decoding refresh with temporal scalability support in video coding |
JP2015526959A (en) * | 2012-06-28 | 2015-09-10 | アルカテル−ルーセント | Adaptive streaming aware node, encoder and client that enable smooth quality transition |
US9549011B2 (en) | 2005-04-20 | 2017-01-17 | Infocus Corporation | Interconnection mechanism for multiple data streams |
US10104448B2 (en) | 2010-10-01 | 2018-10-16 | Saturn Licensing Llc | Receiving apparatus, receiving method, and program |
WO2020185957A1 (en) * | 2019-03-11 | 2020-09-17 | Futurewei Technologies, Inc. | Gradual decoding refresh in video coding |
US10905470B2 (en) | 2014-10-09 | 2021-02-02 | Spinal Developments Pty Ltd | Spinal alignment and securement |
CN112565224A (en) * | 2020-11-26 | 2021-03-26 | 北京经纬恒润科技股份有限公司 | Video processing method and device |
US11265606B2 (en) | 2010-10-01 | 2022-03-01 | Saturn Licensing, Llc | Reception apparatus, reception method, and program |
US11470138B2 (en) | 2004-04-30 | 2022-10-11 | DISH Technologies L.L.C. | Apparatus, system, and method for multi-bitrate content streaming |
US11956471B2 (en) | 2019-12-19 | 2024-04-09 | Telefonaktiebolaget Lm Ericsson (Publ) | Normative indication of recovery point |
Families Citing this family (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040260827A1 (en) * | 2003-06-19 | 2004-12-23 | Nokia Corporation | Stream switching based on gradual decoder refresh |
US7522667B2 (en) * | 2005-02-24 | 2009-04-21 | Freescale Semiconductor, Inc. | Method and apparatus for dynamic determination of frames required to build a complete picture in an MPEG video stream |
US8670437B2 (en) | 2005-09-27 | 2014-03-11 | Qualcomm Incorporated | Methods and apparatus for service acquisition |
US8229983B2 (en) | 2005-09-27 | 2012-07-24 | Qualcomm Incorporated | Channel switch frame |
DE602006051050C5 (en) * | 2005-10-11 | 2022-10-27 | Nokia Technologies Oy | SYSTEM AND METHOD FOR EFFICIENT SCALABLE STREAM ADAPTATION |
WO2008061164A2 (en) | 2006-11-14 | 2008-05-22 | Qualcomm Incorporated | Systems and methods for channel switching |
JP2010510725A (en) | 2006-11-15 | 2010-04-02 | クゥアルコム・インコーポレイテッド | Application system and method using channel switching frame |
ES2586406T3 (en) * | 2007-04-12 | 2016-10-14 | Thomson Licensing | Tiling in encoding and decoding video |
US8396082B2 (en) | 2007-06-05 | 2013-03-12 | Core Wireless Licensing S.A.R.L. | Time-interleaved simulcast for tune-in reduction |
CN101321284B (en) | 2007-06-10 | 2012-01-04 | 华为技术有限公司 | Encoding/decoding method, equipment and system |
US7987285B2 (en) | 2007-07-10 | 2011-07-26 | Bytemobile, Inc. | Adaptive bitrate management for streaming media over packet networks |
US8266251B2 (en) * | 2007-07-30 | 2012-09-11 | Nec Corporation | Communication terminal, distribution system, method for conversion and program |
WO2009017084A1 (en) * | 2007-07-30 | 2009-02-05 | Nec Corporation | Conversion device, distribution system, distribution method, and program |
US8325800B2 (en) | 2008-05-07 | 2012-12-04 | Microsoft Corporation | Encoding streaming media as a high bit rate layer, a low bit rate layer, and one or more intermediate bit rate layers |
US8379851B2 (en) | 2008-05-12 | 2013-02-19 | Microsoft Corporation | Optimized client side rate control and indexed file layout for streaming media |
US7925774B2 (en) | 2008-05-30 | 2011-04-12 | Microsoft Corporation | Media streaming using an index file |
WO2010000288A1 (en) | 2008-07-03 | 2010-01-07 | Telefonaktiebolaget Lm Ericsson (Publ) | Fast channel switching in tv broadcast systems |
US8265140B2 (en) | 2008-09-30 | 2012-09-11 | Microsoft Corporation | Fine-grained client-side control of scalable media delivery |
KR101676059B1 (en) | 2009-01-26 | 2016-11-14 | 톰슨 라이센싱 | Frame packing for video coding |
US8948241B2 (en) * | 2009-08-07 | 2015-02-03 | Qualcomm Incorporated | Signaling characteristics of an MVC operation point |
KR101828096B1 (en) | 2010-01-29 | 2018-02-09 | 톰슨 라이센싱 | Block-based interleaving |
US8908103B2 (en) | 2010-10-01 | 2014-12-09 | Sony Corporation | Content supplying apparatus, content supplying method, content reproduction apparatus, content reproduction method, program and content viewing system |
US8964056B2 (en) | 2011-06-30 | 2015-02-24 | Cisco Technology, Inc. | Encoder-supervised imaging for video cameras |
TWI578765B (en) | 2011-07-02 | 2017-04-11 | 三星電子股份有限公司 | Video decoding method |
WO2014002385A1 (en) * | 2012-06-25 | 2014-01-03 | 日本電気株式会社 | Video encoding/decoding device, method, and program |
CN108965883B (en) * | 2012-06-28 | 2022-08-30 | 阿克西斯股份公司 | System and method for encoding video content using virtual intra frames |
JP6045222B2 (en) * | 2012-06-28 | 2016-12-14 | 株式会社Nttドコモ | Moving picture predictive decoding apparatus, method and program |
US9491457B2 (en) | 2012-09-28 | 2016-11-08 | Qualcomm Incorporated | Signaling of regions of interest and gradual decoding refresh in video coding |
US9521389B2 (en) | 2013-03-06 | 2016-12-13 | Qualcomm Incorporated | Derived disparity vector in 3D video coding |
US9667990B2 (en) | 2013-05-31 | 2017-05-30 | Qualcomm Incorporated | Parallel derived disparity vector for 3D video coding with neighbor-based disparity vector derivation |
CN105765978B (en) | 2013-10-11 | 2019-01-29 | 韩国电子通信研究院 | Method for encoding/decoding image and the device using it |
WO2015053525A1 (en) * | 2013-10-11 | 2015-04-16 | 한국전자통신연구원 | Method for encoding/decoding image and device using same |
JP2016005043A (en) * | 2014-06-13 | 2016-01-12 | 株式会社リコー | Information processing device and program |
US11171999B2 (en) * | 2016-07-21 | 2021-11-09 | Qualcomm Incorporated | Methods and apparatus for use of compact concurrent codecs in multimedia communications |
WO2021002303A1 (en) * | 2019-07-03 | 2021-01-07 | ソニー株式会社 | Information processing device, information processing method, playback processing device, and playback processing method |
WO2021044974A1 (en) * | 2019-09-06 | 2021-03-11 | 株式会社ソニー・インタラクティブエンタテインメント | Transmission device, reception device, transmission method, reception method, and program |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5361096A (en) * | 1991-02-27 | 1994-11-01 | Nec Corporation | Method and apparatus for multiplex transmission of video signals in a plurality of channels with refresh control utilizing intraframe coding |
US5778143A (en) * | 1993-01-13 | 1998-07-07 | Hitachi America, Ltd. | Method and apparatus for the selection of data for use in VTR trick playback operation in a system using progressive picture refresh |
US6134243A (en) * | 1998-01-15 | 2000-10-17 | Apple Computer, Inc. | Method and apparatus for media data transmission |
US20010029548A1 (en) * | 2000-04-08 | 2001-10-11 | Geetha Srikantan | Method and apparatus for handling events received at a server socket |
US6304295B1 (en) * | 1998-09-18 | 2001-10-16 | Sarnoff Corporation | Region-based refresh strategy for video compression |
US20010038649A1 (en) * | 2000-03-29 | 2001-11-08 | Makoto Hagai | Decoder, decoding method, multiplexer, and multiplexing method |
US20020016969A1 (en) * | 2000-02-03 | 2002-02-07 | International Business Machines Corporation | Media on demand system and method |
US6434195B1 (en) * | 1998-11-20 | 2002-08-13 | General Instrument Corporaiton | Splicing of video data in progressively refreshed video streams |
US20020147980A1 (en) * | 2001-04-09 | 2002-10-10 | Nec Corporation | Contents distribution system, contents distribution method thereof and contents distribution program thereof |
US6473903B2 (en) * | 1996-12-30 | 2002-10-29 | Koninklijke Philips Electronics N.V. | Method and system for implementing interactive broadcast programs and commercials |
US20030067872A1 (en) * | 2001-09-17 | 2003-04-10 | Pulsent Corporation | Flow control method for quality streaming of audio/video/media over packet networks |
US6570922B1 (en) * | 1998-11-24 | 2003-05-27 | General Instrument Corporation | Rate control for an MPEG transcoder without a priori knowledge of picture type |
US6831949B1 (en) * | 1997-07-18 | 2004-12-14 | British Broadcasting Corporation | Switching compressed video bitstreams |
US20050021814A1 (en) * | 2003-06-19 | 2005-01-27 | Nokia Corporation | Stream switching based on gradual decoder refresh |
US6940904B2 (en) * | 2001-05-29 | 2005-09-06 | Broadcom Corporation | Artifact-free displaying of MPEG-2 video in the progressive-refresh mode |
US7046910B2 (en) * | 1998-11-20 | 2006-05-16 | General Instrument Corporation | Methods and apparatus for transcoding progressive I-slice refreshed MPEG data streams to enable trick play mode features on a television appliance |
US7133451B2 (en) * | 2001-03-05 | 2006-11-07 | Intervideo, Inc. | Systems and methods for refreshing macroblocks |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20010056374A (en) * | 1999-12-15 | 2001-07-04 | 박종섭 | Multiple video decoding apparatus |
EP1547382A4 (en) * | 2002-07-16 | 2013-10-30 | Nokia Corp | A method for random access and gradual picture refresh in video coding |
-
2003
- 2003-06-19 US US10/601,320 patent/US20040260827A1/en not_active Abandoned
- 2003-07-11 WO PCT/IB2003/002787 patent/WO2004112374A1/en active Application Filing
- 2003-07-11 CA CA2529889A patent/CA2529889C/en not_active Expired - Fee Related
- 2003-07-11 RU RU2006101400/09A patent/RU2328086C2/en active
- 2003-07-11 CN CNB038269317A patent/CN100414956C/en not_active Expired - Lifetime
- 2003-07-11 EP EP03817249A patent/EP1639804A4/en not_active Withdrawn
- 2003-07-11 JP JP2005500713A patent/JP2006527927A/en not_active Withdrawn
- 2003-07-11 AU AU2003246988A patent/AU2003246988B2/en not_active Expired
- 2003-07-11 BR BRPI0318357-2A patent/BR0318357A/en not_active IP Right Cessation
- 2003-07-11 KR KR1020057024300A patent/KR100734408B1/en active IP Right Grant
- 2003-07-11 MX MXPA05013542A patent/MXPA05013542A/en active IP Right Grant
-
2004
- 2004-05-19 US US10/848,966 patent/US7552227B2/en active Active
- 2004-06-03 MY MYPI20042145A patent/MY140364A/en unknown
-
2009
- 2009-02-06 JP JP2009026345A patent/JP2009105970A/en active Pending
Patent Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5361096A (en) * | 1991-02-27 | 1994-11-01 | Nec Corporation | Method and apparatus for multiplex transmission of video signals in a plurality of channels with refresh control utilizing intraframe coding |
US5778143A (en) * | 1993-01-13 | 1998-07-07 | Hitachi America, Ltd. | Method and apparatus for the selection of data for use in VTR trick playback operation in a system using progressive picture refresh |
US6473903B2 (en) * | 1996-12-30 | 2002-10-29 | Koninklijke Philips Electronics N.V. | Method and system for implementing interactive broadcast programs and commercials |
US6831949B1 (en) * | 1997-07-18 | 2004-12-14 | British Broadcasting Corporation | Switching compressed video bitstreams |
US6134243A (en) * | 1998-01-15 | 2000-10-17 | Apple Computer, Inc. | Method and apparatus for media data transmission |
US6304295B1 (en) * | 1998-09-18 | 2001-10-16 | Sarnoff Corporation | Region-based refresh strategy for video compression |
US6434195B1 (en) * | 1998-11-20 | 2002-08-13 | General Instrument Corporaiton | Splicing of video data in progressively refreshed video streams |
US7046910B2 (en) * | 1998-11-20 | 2006-05-16 | General Instrument Corporation | Methods and apparatus for transcoding progressive I-slice refreshed MPEG data streams to enable trick play mode features on a television appliance |
US6570922B1 (en) * | 1998-11-24 | 2003-05-27 | General Instrument Corporation | Rate control for an MPEG transcoder without a priori knowledge of picture type |
US20020016969A1 (en) * | 2000-02-03 | 2002-02-07 | International Business Machines Corporation | Media on demand system and method |
US20010038649A1 (en) * | 2000-03-29 | 2001-11-08 | Makoto Hagai | Decoder, decoding method, multiplexer, and multiplexing method |
US20010029548A1 (en) * | 2000-04-08 | 2001-10-11 | Geetha Srikantan | Method and apparatus for handling events received at a server socket |
US7133451B2 (en) * | 2001-03-05 | 2006-11-07 | Intervideo, Inc. | Systems and methods for refreshing macroblocks |
US20020147980A1 (en) * | 2001-04-09 | 2002-10-10 | Nec Corporation | Contents distribution system, contents distribution method thereof and contents distribution program thereof |
US6940904B2 (en) * | 2001-05-29 | 2005-09-06 | Broadcom Corporation | Artifact-free displaying of MPEG-2 video in the progressive-refresh mode |
US20030067872A1 (en) * | 2001-09-17 | 2003-04-10 | Pulsent Corporation | Flow control method for quality streaming of audio/video/media over packet networks |
US20050021814A1 (en) * | 2003-06-19 | 2005-01-27 | Nokia Corporation | Stream switching based on gradual decoder refresh |
Cited By (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110060814A1 (en) * | 2003-06-25 | 2011-03-10 | Toyota Jidosha Kabushiki Kaisha | Content delivery system |
US9100447B2 (en) * | 2003-06-25 | 2015-08-04 | Toyota Jidosha Kabushiki Kaisha | Content delivery system |
US11677798B2 (en) | 2004-04-30 | 2023-06-13 | DISH Technologies L.L.C. | Apparatus, system, and method for multi-bitrate content streaming |
US11470138B2 (en) | 2004-04-30 | 2022-10-11 | DISH Technologies L.L.C. | Apparatus, system, and method for multi-bitrate content streaming |
US10469553B2 (en) | 2005-04-20 | 2019-11-05 | Jupiter Systems, Llc | Interconnection mechanism for multiple data streams |
US20060242669A1 (en) * | 2005-04-20 | 2006-10-26 | Jupiter Systems | Display node for use in an audiovisual signal routing and distribution system |
US9549011B2 (en) | 2005-04-20 | 2017-01-17 | Infocus Corporation | Interconnection mechanism for multiple data streams |
EP1758400A3 (en) * | 2005-08-25 | 2008-07-30 | Samsung Electronics Co.,Ltd. | Mobile communication terminal and method for reproducing digital broadcasting |
EP1758400A2 (en) * | 2005-08-25 | 2007-02-28 | Samsung Electronics Co.,Ltd. | Mobile communication terminal and method for reproducing digital broadcasting |
WO2007069009A3 (en) * | 2005-12-16 | 2007-09-27 | Nokia Corp | Codec and session parameter change |
US20070168534A1 (en) * | 2005-12-16 | 2007-07-19 | Nokia Corp. | Codec and session parameter change |
EP1966915A2 (en) * | 2005-12-29 | 2008-09-10 | Nokia Corporation | Tune-in time reduction |
EP1966915A4 (en) * | 2005-12-29 | 2012-03-28 | Nokia Corp | Tune-in time reduction |
EP2036350A1 (en) * | 2006-06-19 | 2009-03-18 | Telefonaktiebolaget LM Ericsson (PUBL) | Media channel management |
EP2036350A4 (en) * | 2006-06-19 | 2010-05-05 | Ericsson Telefon Ab L M | Media channel management |
US20080267287A1 (en) * | 2007-04-24 | 2008-10-30 | Nokia Corporation | System and method for implementing fast tune-in with intra-coded redundant pictures |
WO2008129500A3 (en) * | 2007-04-24 | 2009-11-05 | Nokia Corporation | System and method for implementing fast tune-in with intra-coded redundant pictures |
WO2008129500A2 (en) * | 2007-04-24 | 2008-10-30 | Nokia Corporation | System and method for implementing fast tune-in with intra-coded redundant pictures |
US11265606B2 (en) | 2010-10-01 | 2022-03-01 | Saturn Licensing, Llc | Reception apparatus, reception method, and program |
US10104448B2 (en) | 2010-10-01 | 2018-10-16 | Saturn Licensing Llc | Receiving apparatus, receiving method, and program |
WO2012047060A2 (en) | 2010-10-08 | 2012-04-12 | Samsung Electronics Co., Ltd. | Method and apparatus for improving quality of service in a multimedia streaming service |
EP2625846A4 (en) * | 2010-10-08 | 2014-06-25 | Samsung Electronics Co Ltd | Method and apparatus for improving quality of service in a multimedia streaming service |
EP2625846A2 (en) * | 2010-10-08 | 2013-08-14 | Samsung Electronics Co., Ltd | Method and apparatus for improving quality of service in a multimedia streaming service |
JP2015526959A (en) * | 2012-06-28 | 2015-09-10 | アルカテル−ルーセント | Adaptive streaming aware node, encoder and client that enable smooth quality transition |
US9398293B2 (en) | 2013-01-07 | 2016-07-19 | Qualcomm Incorporated | Gradual decoding refresh with temporal scalability support in video coding |
US9571847B2 (en) | 2013-01-07 | 2017-02-14 | Qualcomm Incorporated | Gradual decoding refresh with temporal scalability support in video coding |
WO2014107721A1 (en) * | 2013-01-07 | 2014-07-10 | Qualcomm Incorporated | Gradual decoding refresh with temporal scalability support in video coding |
CN104904216A (en) * | 2013-01-07 | 2015-09-09 | 高通股份有限公司 | Gradual decoding refresh with temporal scalability support in video coding |
US10905470B2 (en) | 2014-10-09 | 2021-02-02 | Spinal Developments Pty Ltd | Spinal alignment and securement |
US11856189B2 (en) | 2019-03-11 | 2023-12-26 | Huawei Technologies Co., Ltd. | Gradual decoding refresh in video coding |
US11632545B2 (en) * | 2019-03-11 | 2023-04-18 | Huawei Technologies Co., Ltd. | Gradual decoding refresh in video coding |
WO2020185957A1 (en) * | 2019-03-11 | 2020-09-17 | Futurewei Technologies, Inc. | Gradual decoding refresh in video coding |
US11917134B2 (en) | 2019-03-11 | 2024-02-27 | Huawei Technologies Co., Ltd. | Gradual decoding refresh in video coding |
US11956471B2 (en) | 2019-12-19 | 2024-04-09 | Telefonaktiebolaget Lm Ericsson (Publ) | Normative indication of recovery point |
CN112565224A (en) * | 2020-11-26 | 2021-03-26 | 北京经纬恒润科技股份有限公司 | Video processing method and device |
Also Published As
Publication number | Publication date |
---|---|
JP2006527927A (en) | 2006-12-07 |
US20050021814A1 (en) | 2005-01-27 |
AU2003246988A1 (en) | 2005-01-04 |
CA2529889A1 (en) | 2004-12-23 |
CA2529889C (en) | 2010-09-28 |
RU2328086C2 (en) | 2008-06-27 |
MY140364A (en) | 2009-12-31 |
KR100734408B1 (en) | 2007-07-03 |
WO2004112374A1 (en) | 2004-12-23 |
MXPA05013542A (en) | 2006-03-09 |
CN100414956C (en) | 2008-08-27 |
CN1820494A (en) | 2006-08-16 |
US7552227B2 (en) | 2009-06-23 |
AU2003246988B2 (en) | 2009-11-19 |
KR20060024425A (en) | 2006-03-16 |
EP1639804A4 (en) | 2009-08-26 |
BR0318357A (en) | 2006-07-25 |
EP1639804A1 (en) | 2006-03-29 |
JP2009105970A (en) | 2009-05-14 |
RU2006101400A (en) | 2006-06-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7552227B2 (en) | Stream switching based on gradual decoder refresh | |
US11330279B2 (en) | Apparatus, a method and a computer program for video coding and decoding | |
US10397295B2 (en) | Processing continuous multi-period content | |
US9332254B2 (en) | Coding, storage and signalling of scalability information | |
Schierl et al. | System layer integration of high efficiency video coding | |
AU2005242601B2 (en) | Multiple interoperability points for scalable media coding and transmission | |
US11665219B2 (en) | Processing media data using a generic descriptor for file format boxes | |
US11438647B2 (en) | Signaling missing sections of media data for network streaming in a manifest file | |
KR20130023382A (en) | Signaling random access points for streaming video data | |
EP2627082A2 (en) | Method for transmitting a scalable http stream for natural reproduction upon the occurrence of expression-switching during http streaming | |
KR101421390B1 (en) | Signaling video samples for trick mode video representations | |
EP3504878B1 (en) | System level signaling of sei tracks for media data streaming | |
KR101656193B1 (en) | MMT-based Broadcasting System and Method for UHD Video Streaming over Heterogeneous Networks | |
US11863767B2 (en) | Transporting HEIF-formatted images over real-time transport protocol | |
US20240098307A1 (en) | Automatic generation of video content in response to network interruption | |
JP2024511948A (en) | Transporting HEIF formatted images over real-time transport protocol |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NOKIA CORPORATION, FINLAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WANG, YE-KUI;REEL/FRAME:014528/0986 Effective date: 20030901 |
|
STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |