US20080068993A1 - Method and an apparatus for data streaming - Google Patents
Method and an apparatus for data streaming Download PDFInfo
- Publication number
- US20080068993A1 US20080068993A1 US11/896,610 US89661007A US2008068993A1 US 20080068993 A1 US20080068993 A1 US 20080068993A1 US 89661007 A US89661007 A US 89661007A US 2008068993 A1 US2008068993 A1 US 2008068993A1
- Authority
- US
- United States
- Prior art keywords
- data
- sub
- sets
- payload data
- payload
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
Abstract
An apparatus and a method for data streaming, as well as a combination, of an apparatus for data streaming and a plurality of user devices, are presented. The apparatus is adapted to receive media data in the form of a plurality of payload data sets from at least one data source and a plurality of streaming requests from a plurality of user devices, the apparatus comprising a memory unit adapted to store the payload data sets, and a streaming unit adapted to stream the payload data sets according to the streaming requests, the streaming unit is adapted to receive a first sub-set of a payload data set from the memory unit. The streaming unit is adapted to receive from the memory unit a first sub-set of a control data set, which first control data sub-set comprises data corresponding to a location in the memory unit of a second sub-set of the payload data set.
Description
- This application is a new U.S. utility application claiming priority to U.S. Provisional Patent Application No. 60/842,940, filed 8 Sep. 2006, and GB 0700313.0, filed 9 Jan. 2007, the entire contents of each of which are incorporated by reference.
- The present invention relates to an apparatus and a method for data streaming, as well as a combination, of an apparatus for data streaming and a plurality of user devices.
- Streaming is conventionally performed on data with video, sound or multimedia content, and enables the playback of such data without the need to download the entire resource file in advance of playback. This means that such data has to be sent at a pace corresponding, at least on average, to the pace at which it is to be presented. In many streaming applications, users, e.g. video viewers, have display devices, e.g. television sets or personal computers, that are connectable, e.g. via an IP-network, to a server in which media data is stored.
- In the case of videos, each user can request individually a video stored in the server to be displayed, so that the video is displayed to the user immediately upon streaming from the server, i.e. without storage at the display device of the entire video. The stream is normally compressed or coded, for example by MPEG-2, and the display device is adapted to decode it.
- Where streaming is to be carried out among a large number of users, with individual data in each stream, conventional storage and computation units, including hard drives, provides a limited capacity, and therefore the number of users that can be served with the use of such equipment is very low compared to the total amount of media consumers.
- EP0698982A2 discloses describes a method in which video/multimedia content is stored in switches or routers of a network in the format of network packets, linked with links fields. This means that the video/multimedia content has to be formatted before being stored, and before formatting the video/multimedia content, an amount of network specific information has to be given. For example, a network protocol has to be chosen before formatting and storing of the video/multimedia content. If the such network specific information, e.g. the network protocol, can vary in dependence on users and requests, which is in practice a common case, several versions of a specific video/multimedia content have to be stored, each with individual network specific information. This requires a large amount of storage space, which makes the system complicated and expensive.
- US2003/0095783A1 discloses a system in which protocol stacks are generated in hardware as streams are sent to networks. Among other things, the system presented does not support trick-play modes, such as fast forward or reverse video playback modes, in a capacity efficient manner.
- U.S. Pat. No. 6,067,108 discloses a streaming device in which an address table is used during streaming to access a memory for media data. The need to repeatedly read, during data streaming, in the address table adds time to the streaming process, which limits the overall capacity of the device.
- Embodiments of the invention provide an apparatus and method that increase the capacity of data streaming, e.g., for user numbers, request numbers, and/or both.
- An embodiment of the invention provides an apparatus for data streaming, adapted to receive media data in the form of a plurality of payload data sets from at least one data source and a plurality of streaming requests from a plurality of user devices, the apparatus comprising
-
- a memory unit adapted to store the payload data sets, and
- a streaming unit adapted to stream the payload data sets according to the streaming requests,
- the streaming unit being adapted to receive from the memory unit sub-sets of a first payload data set, and
- the streaming unit being adapted to receive from the memory unit control data sub-sets, each comprising data corresponding to a location in the memory unit of a sub-set of the first payload data.
Since the streaming unit receives from the memory unit, along with the sub-sets of payload data, sub-sets control data, each giving a location in the memory unit of a further sub-set of payload data, there is no necessity for repeatedly read, during data streaming, in a separate information source, such as an address table. Thus, since a memory location of further media data is given from the memory unit along with media data portions, memory location information retrieval from a separate source is eliminated. This reduces the number of steps performed in the cyclic streaming operations, which in turn reduced time spent on each stream, so that more streams can be provided, i.e. more users can be served by the apparatus, according to an embodiment of the invention.
- The invention provides an apparatus with a low level of complexity, which reduces overall costs for an administrator of streaming services. Since memory location information retrieval from a separate source is eliminated, maintenance costs are reduced.
- Preferably, the streaming unit is adapted to receive from the memory unit a first sub-set of the first payload data set, and a first sub-set of the control data set, which first control data sub-set comprises data corresponding to a location in the memory unit of a second sub-set of the first payload data set. Preferably, the first sub-set of the payload data set and the first sub-set of the control data set are stored at the same location in the memory unit. Preferably, the memory unit comprises a plurality of memory sectors, and wherein the payload data set and the control data set is arranged in pairs of payload data sub-sets and control data sub-sets, each pair being stored in a respective of the memory sectors. Preferably, each of at least some of the control data sub-sets in the pairs of payload data sub-sets and control data sub-sets comprises data corresponding to a location of a memory sector of another pair. Preferably, the apparatus comprises a control unit adapted to pre-process the payload data sets before being stored. Preferably, the control unit is adapted to divide a payload data set into a plurality of payload data sub-sets, and create for each of at least some of the payload data sub-sets a control data sub-set, each comprising data corresponding to a location in the memory unit of another payload data sub-set.
- Embodiments of the invention may also comprise an apparatus for data streaming, adapted to receive media data in the form of a plurality of payload data sets from at least one data source before being stored in a memory unit, to divide a payload data set into a plurality of payload data sub-sets, and to create for each of at least some of the payload data sub-sets a control data sub-set to be stored in the memory unit, each control data sub-set comprising data corresponding to a location in the memory unit of another payload data sub-set.
- Embodiments of the invention may also comprise a combination of an apparatus according to any of the claims 1-8, and a plurality of user devices, from which the apparatus is adapted to receive the plurality of streaming requests. Preferably, the user devices are audio/video devices. Preferably, the audio/video devices are at least one of set-top boxes, personal video recorders, or personal computers.
- Embodiments of the invention may also comprise a method for data streaming, comprising receiving media data in the form of a plurality of payload data sets from at least one data source and a plurality of streaming requests from a plurality of user devices, the method further comprising storing the payload data sets in a memory unit, streaming the payload data sets according to the streaming requests, receiving from the memory unit sub-sets of a first payload data set, and receiving from the memory unit control data sub-sets, each comprising data corresponding to a location in the memory unit of a sub-set of the first payload data. Preferably, the method comprises receiving from the memory unit a first sub-set of the first payload data set, and a first sub-set of the control data set, which first control data sub-set comprises data corresponding to a location in the memory unit of a second sub-set of the first payload data set. Preferably, the first sub-set of the payload data set and the first sub-set of the control data set are stored at the same location in the memory unit. Preferably, the memory unit comprises a plurality of memory sectors, and wherein the payload data set and the control data set is arranged in pairs of payload data sub-sets and control data sub-sets, each pair being stored in a respective of the memory sectors. Preferably, each of at least some of the control data sub-sets in the pairs of payload data sub-sets and control data sub-sets comprises data corresponding to a location of a memory sector of another pair. Preferably, the method comprises pre-processing the payload data sets before being stored. Preferably, the method comprises dividing a payload data set into a plurality of payload data sub-sets, and creating for each of at least some of the payload data sub-sets a control data sub-set, each comprising data corresponding to a location in the memory unit of another payload data sub-set.
- Embodiments of the invention may also comprise a method for data streaming, comprising receiving media data in the form of a plurality of payload data sets from at least one data source before being stored in a memory unit, dividing a payload data set into a plurality of payload data sub-sets, and creating for each of at least some of the payload data sub-sets a control data sub-set to be stored in the memory unit, each control data sub-set comprising data corresponding to a location in the memory unit of another payload data sub-set.
- Embodiments of the invention may also comprise an apparatus, comprising media data receiver configured to receive media data from a data source, media data analyzer configured to analyze the media data and to locate a plurality of identification data groups within the media data and create control data corresponding to locations of the identification data groups; and a data uploader configured to enable streaming of the media data to at least one user device under control of the control data. Preferably, the apparatus comprises a memory unit, operably connected to the data uploader, configured to store the media data and the control data.
- Embodiments of the invention may also comprise a method, comprising receiving media data from a data source, analyzing the media data to locate a plurality of identification data groups, creating control data corresponding to locations of the identification data groups, and streaming the media data to at least one user device under control of the control data.
- Embodiments of the invention may also comprise a data structure, comprising a first data element configured to represent portions of media data; and a second data element configured to represent control data corresponding to selected memory locations of other portions of the media data whereby a streaming unit uses the control data from the second data element to stream the other portions of the media data to a user device.
- Below, embodiments of the invention will be described closer with reference to the drawing, in which
-
FIG. 1 is a block diagram of a data network and devices connected thereto including a data streaming device according to one embodiment of the invention, -
FIG. 2 block diagram of the data streaming device inFIG. 1 , -
FIG. 3 is an illustration of data sets in the data streaming device inFIG. 2 , -
FIG. 4 is a block diagram of a part of the data streaming device inFIG. 2 , -
FIG. 5 is an illustration of data sub-sets handled by the part depicted inFIG. 4 , -
FIG. 6 is a block diagram of memory sectors in a memory unit in the data streaming device inFIG. 2 , -
FIG. 7 is a block diagram of a data network and devices connected thereto including a data streaming device according to an alternative embodiment of the invention, -
FIG. 8 is a block diagram depicting an arrangement in a network system according to a special aspect of the invention, -
FIG. 9 is a diagram showing correlation between data stream request frequency and band width requirements, and -
FIG. 10 is a diagram showing correlation between payload data sets and data stream request frequency. -
FIG. 1 depicts schematically a system with an apparatus for data streaming, herein also referred to as adata streaming device 1 for data streaming, connectable to a data network 2, e.g., in the form of an IP-network. The network can alternatively be any kind of network, global or local, suitable for transporting data. Here data refers to information in a form that can be used by a computer, router or any other component of a communications system, and it can include text, numbers, sounds, pictures, and combinations thereof. - A plurality of
user devices user devices - An embodiment of the
data streaming device 1 comprises astreaming unit 3, acontrol unit 6, andmemory unit 7, being connected to each other in a manner described closer below. As also described closer below, an embodiment of thecontrol unit 6 comprises a processor (CPU) and a solid state memory, and is adapted to process data according to software programs, including pre-processing of media data, here also referred to as media payload data, or payload data. Thememory unit 7 may be a solid state memory unit adapted to store media payload data. Thestreaming unit 3 is adapted to read in thememory unit 7, edit and schedule data to be streamed, and send data streams to theuser devices - Reference is made to
FIG. 2 . In this embodiment, thestreaming unit 3 of thedata streaming device 1 comprises anetworking unit 4, adapted to send and receive data to and from, respectively, the network 2, via anetwork interface 4 a. Thestreaming unit 3 also comprises anediting unit 5 connected to thenetworking unit 4 by a suitable bus B54. Theediting unit 5 is connected to thememory unit 7 by a bus B75. Theediting unit 5 and thenetworking unit 4 are connected to the control unit by a respective bus B65, B64, such as a PCI (Peripheral Component Interconnect) bus. - In an embodiment of the invention, the
networking unit 4 and theediting unit 5 may be hard wired (i.e. hard-coded) with each of them comprising a programmed logic device in the form of a field programmable gate array (FPGA). Alternatively, any other suitable type of programmed logic device, or customized hardware can be used, such as CPLD (Complex Programmable Logic Device), ASIC (Application Specific Integrated Circuit) or gate array. - The
memory unit 7 is adapted to store a plurality of sets of payload data, e.g., in the form of multimedia sequences, for example movies, music files, and/or advertisements. More generally, the payload data can be any form of media data, whether audio, visual, text or code, provided separately or in any combination. Also, a set of payload data, herein also referred to as a payload data set, can provide data for a time limited media display, or be received from a continuous flow of data, for example in the form of a transmission from a TV station. In an embodiment of the invention, thememory unit 7 comprises a solid state memory in the form of a plurality of interconnected so-called flash memory units, i.e. in-circuit programmable non-volatile memories segmented into memory sectors, and is described closer below. Instead of flash memory, any other suitable type of memory can be used, for example a DRAM or an SRAM. - Using a solid state memory creates several advantages over conventional hard-drives in streaming applications. An important limiting factor with conventional hard drives is that they provide a speed of information handling (i.e., extraction from storage) that is too low for large scale streaming application, due to, among other things, physical constraints of moving parts. Also, hard drives have a dependability which is less than desired for a good quality of service to users of data streaming services. In addition, hard drives have a high power consumption. In contrast to hard drives, certain solid state memories, specially flash memories, provide a speed of information handling which is more suitable for large scale streaming applications, due to the absence of moving parts, a significantly improved dependability, and a much lower power consumption.
- The sets of payload data can be received by the
data streaming device 1 from a data source in the form of aremote server 8 via the network 2 and thenetwork interface 4 a. Referring toFIGS. 2 and 3 , more specifically, thenetworking unit 4 is adapted to receivepayload data sets network interface 4 a. It should be noted that, besides aserver 8, thestreaming device 1 can be adapted to receive the payload data sets from any type of data storing and/or transmitting device. Also, in the embodiment presented inFIG. 1 , the same network 2 is utilized for all network transmissions involving thestreaming device 1. Alternatively, separate networks can be used for receiving data from theremote server 8 and for sending data to theuser devices streaming device 1 can alternatively be provided with more than onenetwork interface 4 a. Embodiments of thenetworking unit 4 may be hard coded to detect the incoming traffic ofpayload data sets 9 a, and, in response to such detection, forward it to thecontrol unit 6, which is adapted to store it temporarily in a control unit storage means 6 a, which can be provided in the form of a RAM-memory, for example. It should be noted that the network 2 does not necessarily need to connect both theremote server 8 and theuser devices - The
control unit 6 is adapted to pre-process sets of payload data, according to an embodiment of the invention. Referring toFIG. 3 , thecontrol unit 6 is adapted to divide, in the pre-processing, each set ofpayload data payload sub-sets payload data sub-sets memory unit 7. Therefore, apart from the sequence of data within the payload, the division of the payload data into sub-sets need not depend upon the arrangement of payload data in view of the playback thereof. For example, in the case of the payload data being a video, depending on the size of the memory sectors, each sub-set 91 a of payload data can include data for a sequence of video frames, or only a part of such a frame. - The
control unit 6 may be adapted to create, in the pre-processing of thepayload data control unit 6 is adapted to create, in the pre-processing of eachpayload data set payload data sub-sets - Referring to
FIG. 3 , each set of control data is typically provided in the form ofcontrol data sub-sets memory unit 7. - In an embodiment of the invention, the
control unit 6 is adapted to locate, in the pre-processing, a plurality of identification data groups within apayload data set control data sub-sets user devices control unit 6, software is used to identify the I-frames to obtain the linking structures of the control data set, according to an embodiment of the invention. Alternatively, a hardware mechanism may be employed that performs a similar function. - It should be noted that the determination of locations of identification data groups can be performed on any media data, whether it is video, audio or of some other type, being in a format such that it contains such data groups, or data sequences, that have a function corresponding to that of the I-frames in the MPEG-2 format, i.e., serving to identify a portion of the media content without referring to other media data.
- The
control unit 6 is adapted to send, upon pre-processing, the pairs ofpayload data sub-sets 91 a andcontrol data sub-sets 101 a to theediting unit 5, which is adapted to forward them for storage in respective memory sectors of thememory unit 7. More specifically, referring toFIGS. 2 and 4 , (FIG. 4 being a block diagram depicting functions of the editing unit 5), thecontrol unit 6 is adapted to send the payload data and the control data via the bus B65 to theediting unit 5, which is adapted to forward it to thememory unit 7 via the bus B75, as indicated by thearrow 14 inFIG. 4 . - Alternatively, the
control unit 6 can be adapted to send the payload data and control data directly to thememory unit 7, for example via a bus (not shown) between the twounits - In this manner, a large number of payload data sets can be received by the
data streaming device 1, pre-processed by thecontrol unit 6, and stored in thememory unit 7. - Reference is made to
FIG. 1 . Thedata streaming device 1 is adapted to receive streaming requests, herein also referred to simply as requests, via the network 2 from a plurality of user devices. It should be noted that the data streaming device according to a preferred embodiment of the invention is, when used in practice, able to store, e.g., with a storage capacity of 1.5 TBytes, a large amount of payload data sets, e.g. corresponding to 460-1000 hours of video content, and to work simultaneously with requests from up to 10000 user devices. Here, for reasons of simplicity of the presentation, only a first and asecond user device FIG. 1 . - Referring to
FIG. 2 , thenetworking unit 4 is adapted to receive, via thenetwork interface 4 a, fromuser devices payload data control unit 6, to be treated by auser request unit 6 b, which is adapted to read the requests according to a protocol for media streaming requests, such as RTSP (Real Time Streaming Protocol). Theuser request unit 6 b is adapted to process the requests, each including the identity of therespective user device payload data editing unit 5. Theuser request unit 6 b is also adapted to extract from the requests sets of request data, each including the identity of the network protocol used for the respective request, and a network address of therespective user device user request unit 6 b is further adapted to send the extracted sets of request data to thenetworking unit 4 to be stored in networking unit storage means in the form of aRAM memory 401. - It should be mentioned that alternatively, the
streaming unit 3 can be hard-coded to process requests, so as for the requests to be adapted to a streaming device internal language format. - Referring to an embodiment of the invention shown in
FIG. 4 , theediting unit 5 comprises auser status memory 506, herein also referred to as astate device 506, adapted to receive, as indicated by the arrow A3, from thecontrol unit 6 information corresponding to user requests, received by thestreaming device 1 as described above. Specifically, theuser status memory 506 is adapted to receive the requests including the identities of theuser devices user devices user devices payload data sets user status memory 506. - Alternatively, the
user status memory 506 can be provided as a unit, for example including a data table, separate from thestreaming unit 3 and thecontrol unit 6. - Further, the
editing unit 5 comprises a first and asecond multiplexer memory unit 7control data sub-sets FIG. 3 ), as indicated by the arrows C3 inFIG. 4 , according to an embodiment of the invention. Theediting unit 5 may also comprise atrimming device 505, adapted to receive from thememory unit 7payload data sub-sets FIG. 3 ), as indicated by the arrow B3 inFIG. 4 , as well as apacing device 504 and ascheduling device 507, described further below. - As stated, the sets of
payload data user devices FIG. 5 shows an embodiment of the invention with threepayload data sub-sets normal viewing speed 1X, and “trick-play modes”. The trick-play modes can include fast forward modes and fast reverse modes. In one embodiment there is a first, second, third and fourth fast forward mode FF1, FF2, FF3, FF4, each providing an individual playback speed, and a first, second, third and fourth fast reverse mode RW1, RW2, RW3, RW4, each providing an individual playback speed. Each payload data sub-set 91 a, 92 a, 93 a contains a number of picture frames F1, F2, F3 . . . FN. At normal playback speed of thevideo 1X, the linking structure provides for all frames within apayload data sub-set FIG. 5 by the arrows A4. - At a higher playback speeds FF1, FF2, FF3, FF4, RW1, RW2, RW3, RW4, the linking structure indicates which of the frames are to be streamed, according to an embodiment of the invention. For example, after a frame which is not the last in a payload data sub-set, a frame in another payload data sub-set can be streamed, as indicated in
FIG. 5 by the arrows B4. Also, the subsequent frame can be included in a payload data sub-set which does not follow immediately in a normal viewing playback mode, as indicated inFIG. 5 by the arrow C4. - As stated above, according to an embodiment of the invention, in compressed videos and at higher playback speeds only frames that do not include references to previous frames for their composition (I-frames) are streamed. In one embodiment, at the first fast forward mode FF1 and the first fast reverse mode RW1 every I-frame is streamed to the user devices, and at the second fast forward mode FF2 and the second fast reverse mode RW2 every I-frame is streamed to the user devices, and so on.
- In addition, the
streaming device 1 can be adapted to receive a playback request for a pause mode, i.e. the presentation of a video being frozen so that a non-moving image is shown. Thereby, thestreaming unit 3 can be adapted to stream repeatedly the same I-frame to the user device in question. Alternatively, theuser device - The size of the
payload data sub-sets memory unit 7, according to an embodiment of the invention. If the size of each of these memory sectors is relatively small, e.g. 16 kB, the data composing a frame in a video, for example an I-frame according to the MPEG-2 format, can be larger than the memory sector size. (Typically the data for an I-frame can be 64 kB or more.) In such a case, the frame data will simply use two or more memory sectors, and the linking structure of the control data set will provide a proper sequence of the memory sectors storing parts of the same frame. An advantage with providing relatively small memory sectors is that in trick-play modes, compared to a case with relatively large memory sectors, the amount of data cut away by theediting unit 5, as described closer below, will be less. - As described further below, the control data sub-sets also provides addresses to memory sectors in the
memory unit 7 storing subsequent sub-sets of payload data, depending on the playback mode requested. - Referring to
FIGS. 4 and 5 , in an embodiment of the invention, theediting unit 5 is adapted to, upon receiving the data corresponding to the identity of auser device payload data first sub-set first sub-set control unit 6 is adapted to store the address in thememory unit 7 of thefirst subset payload data set control unit 6 is further adapted to, upon a user request for apayload data set memory unit 7 address of thefirst subset user status memory 506 is adapted to receive the first memory unit address and to forward it to thepacing device 504, which is adapted to send a request to thememory unit 7 for retrieving thefirst sub-set first sub-set - The
trimming device 505 is adapted to receive from thememory unit 7payload data subsets pacing device 504. The first andsecond multiplexers control data sub-sets pacing device 504, according to an embodiment of the invention. Theuser status memory 506 is adapted to receive periodically from thepacing device 504 data, as indicated by the arrow J4 inFIG. 4 , corresponding to information regarding the user device, i.e. stream, for which a read request is currently being sent to thememory unit 7. Theuser status memory 506 may comprise a plurality of rows, each corresponding to one stream according to a user request P11 a, P11 b, and controls themultiplexers user status memory 506 is adapted to send, in response to the stream identity information J4 from thepacing device 504 control signals, indicated by the arrows K4, L4 inFIG. 4 , so as to adjust the setting of the multiplexers to the playback mode (1X, FF1, . . . ) of the stream currently being served. - Thus, according to an embodiment of the invention, the
first multiplexer 501 is adapted to receivecontrol data sub-sets user status memory 506 concerning the requested playback mode P11 a, P11 b, extract an edit portion of each sub-set 101 a of control data, which edit portion gives linking information for the requested playback mode P11 a, P11 b. As indicated by the arrow D4 inFIG. 4 , the edit portions of thecontrol data sub-sets trimming device 505, so that a data sequence according to the linking structure of the respective edit portion of thecontrol data sub-sets output buffer output memory 503. - The
output memory 503 is preferably a large solid state memory, which in practice can be a 512 MB DRAM, or alternatively some other kind of random access memory, e.g. SRAM, according to an embodiment of the invention. Theoutput memory 503 is arranged so as to provide a plurality ofoutput buffers user devices user status memory 506, theoutput memory 503 is adapted to receive periodically from thepacing device 504 data, as indicated by the arrow M4 inFIG. 4 , corresponding to information regarding the user device, i.e. stream, for which a read request is currently being sent to thememory unit 7. Based on this information, anoutput buffer trimming device 505. - The
second multiplexer 502 is also adapted to receive thecontrol data sub-sets 101 a, 110 b, and to extract, in dependence of the user status memory control, a edit portion of each control data sub-set 101 a, 101 b, according to an embodiment of the invention. As described further below, each extracted edit portion gives the address in thememory unit 7 of a subsequent payload data sub-set 92 a, 92 b. As indicated by the arrow E4 inFIG. 4 , each edit portion of thecontrol data sub-sets pacing device 504. - Alternatively, it is possible to replace the first and
second multiplexer trimming device 505 as well as thepacing device 504. - In the example here, there is one data path from the
memory unit 7 to theediting unit 5, so that sub-sets of data are read for one of the individual user device streams at the time in a manner serving the individual user device streams in a cyclic manner, (see further below). However, in practice, several parallel data streams could be provided from thememory unit 7 to theediting unit 5. - The
scheduling device 507 is adapted to determine the timing of data outputs from theoutput memory 503. As indicated by the line F4 inFIG. 4 , thescheduling device 507 is adapted to read from data traffic from the output buffers 503 a, 503 b of theoutput memory 503 information based on which a bit-rate or a pace, at which the respectivepayload data sets output buffer 503 a to anotheroutput buffer 503 b. - The
scheduling device 507 is adapted to control the data traffic from the output buffers 503 a, 503 b to thenetworking unit 4, as indicated by the arrow G4 inFIG. 4 , in dependence on the bit-rate information for each stream. The data from each output buffer are sent in stream portions, the size of which is adapted to network requirements (e.g. in the order of 1,5 kB). More specifically, thescheduling device 507 is adapted to determine a bite-rate based on time codes in the payload data stream, as mentioned above. The stream in question is sent based on this determined bit-rate, and when a further time code is detected, the determined bit-rate is compared to time information from a clock, and thescheduling device 507 is adapted to adjust, based on this comparison, the timing of data sent in the stream. If it is determined that a stream portion of data from oneoutput buffer scheduling device 507 makes a similar determination concerning the anotheroutput buffer respective output buffets networking unit 4. - In addition, or alternatively, such determination of the bit-rate information or display pace information can be done at the above-described pre-processing of the payload data set 9 a, 9 b, in the
control unit 6, and included in the control data set corresponding to the payload data set 9 a, 9 b. - The
network unit 4 is adapted to receive stream portions from therespective output buffers respective output buffer network unit 4 is further adapted to send the data packets to theuser devices network interface 4 a. Thus, network data packets are created as the data is streamed by thestreaming device 1. - Reference is made to
FIGS. 4 and 5 . According to an embodiment of the invention, in a similar manner to the cyclic sequence of determinations performed by thescheduling device 507 whether to send stream portions of data from therespective output buffets networking unit 4, thepacing device 504 is adapted to make a cyclic sequence of determinations regarding the data streams whether to send further read requests to thememory unit 7, and works in this respect as a scheduler for read instructions to thememory unit 7. As indicated inFIG. 4 , eachoutput buffer specific output buffer pacing device 504 is adapted to compare the amount of data temporarily stored in the output buffer to the respective threshold level WMa, WMb, and to request more data from thememory unit 7 if the amount of data stored is below the respective threshold level WMa, WMb. Thereby, as indicated by the arrow H4 inFIG. 4 , based on the memory sector addresses in thecontrol data sub-sets pacing device 504 sends to thememory unit 7 read requests for furtherpayload data sub-sets 92 a, 92 b and a furthercontrol data sub-sets 102 a, 102 b.Subsequent sub-sets trimming device 505 and themultiplexers respective output buffer - It should be noted that the threshold levels WMa, WMb can be set individually and differently for the output buffers 503 a, 503 b, or to be the same for a group of output buffers or for all output buffers.
- During steaming of payload data, the
networking unit 4 can receive a request from a user device for an alternative playback mode. Thestreaming device 1 is adapted to change the playback mode setting P11 a for auser device user device networking unit 4 receives, via thenetwork interface 4 a, from auser device networking unit 4 is adapted to forward the request to thecontrol unit 6, which is adapted to treat the request in a manner corresponding to what has been described above. Thecontrol unit 6 is adapted to send the request to theediting unit 5. In theediting unit 5, theuser status memory 506 receives the request including the identity of theuser device - Referring to
FIGS. 4 and 5 , in trick-play modes, similarly to what has been described above, theediting unit 5 is adapted to retrieve, upon read instructions (H4) from thepacing device 504,payload data sub-sets control data sub-sets trimming device 505 is adapted to receive and temporarily store thepayload data sub-sets first multiplexer 501 is adapted to receivecontrol data sub-sets FIG. 6 ). As indicated by the arrow D4 inFIG. 4 , the edit portions of thecontrol data sub-sets trimming device 505, so that a data sequence according to the linking structure of the respective edit portions is sent to therespective output buffers output memory 503. - Thus, referring to
FIGS. 4 and 5 , upon reception in thetrimming device 505 of apayload data sub-set 92 a, 92 b, the linking structure provided by an edit portion of the control data sub-set 101 a, 101 b, which edit portion corresponds to the requested trick-play mode P11 a, P11 b, is used to extract a trimmed portion of the payload data sub-set 92 a, 92 b to be sent to theoutput buffer - In fast trick-play modes of videos, preferably the linking structure of the control data sub-set is such that only full image data frames, i.e. frames that do not include references to previous frames for their composition, e.g. I-frames in MPEG-2, are sent to the output buffers 503 a, 503 b. In compressed videos and at higher playback speeds only so called I-frames (intra coded frames), i.e., are streamed, according to an embodiment of the invention. At the pre-processing of the video in the
control unit 6, a software is used to identify the I-frames to obtain the linking structures of the control data set, as described closer below. - As understood from the presentation above, according to an embodiment of the invention, a trick-play linking structure of a control data set provides for a separate addressing sequence in the
memory unit 7, followed upon read instructions by thepacing unit 504, so that memory sectors that would have been included in a normal viewing speed play mode might be “skipped”. - At trick-play modes, the
scheduling device 507 is adapted to determine the timing of the outputs from therespective output buffer normal viewing speeds 1X, in turn determined from time codes as described above. Thus, at a trick-play mode, a payload data set will be streamed to a user device at a bit-rate being the same as that at which it is streamed at a normalviewing speed mode 1X. Alternatively, the bit-rate at trick-play modes can be predetermined individually for the payload data sets, or for groups of payload data sets, or collectively for all payload data sets. - Reference is made to
FIG. 6 , showing an example of how memory sector locations in thememory unit 7 are accessed, according to an embodiment of the invention. Three pairs ofpayload data sub-sets control data sub-sets third memory sectors memory unit 7. In all memory sectors, the memory space available for payload data and control data is the same, in this example 16000 bytes and 1000 bytes, respectively. - Assuming that the playback mode of the current user device request is normal viewing speed (1X), after having retrieved data from the
first memory sector 71, theediting unit 5 determines from the first edit portion (1X) of the first control data sub-set 101 a the memory address (17001) of the start of thenext memory sector 72. Theediting unit 5 also determines from the first edit portion (1X) of the first control data sub-set 101 a that the offset from the start of the secondpayload data subset 92 a is 0 bytes and the length within thesubset 92 a of the data to be streamed is 16000 bytes, which means that theoutput buffer 503 a (FIG. 4 ) for the stream in question will receive all data in the secondpayload data subset 92 a. - Assuming differently that the playback mode of the current user device request is the first fast forward mode FF1, after having retrieved data from the
first memory sector 71, theediting unit 5 determines from a second edit portion (FF1) of the first control data sub-set 101 a the memory address (17001) of the start of thenext memory sector 72. Theediting unit 5 also determines from the second edit portion (FF1) of the first control data sub-set 101 a that the offset from the start of the secondpayload data subset 92 a is 6000 bytes and the length within thesubset 92 a of the data to be streamed is 5000 bytes, which means that theoutput buffer 503 a (FIG. 4 ) for the stream in question will receive all data in the interval [A, B] inFIG. 6 . - Alternatively, assuming that the playback mode of the current user device request is the second fast forward mode FF2, after having retrieved data from the
first memory sector 71, theediting unit 5 determines from the third edit portion (FF2) of the first control data sub-set 101 a the memory address (34001) of the start of thenext memory sector 73, which means that amemory sector 72 read in normal viewing speed playback mode (1X) is skipped. Theediting unit 5 also determines from the third edit portion (FF2) of the first control data sub-set 101 a that the offset from the start of the thirdpayload data subset 93 a is 8000 bytes and the length within thesubset 93 a of the data to be streamed is 4000 bytes, which means that theoutput buffer 503 a (FIG. 4 ) for the stream in question will receive all data in the interval [C, D] inFIG. 6 . - The
editing unit 5 and thememory unit 7 are arranged so that at each data retrieval step, the respectivecontrol data subsets respective memory sector - To illustrate the memory access sequence in a reverse playback mode, according to an embodiment of the invention,
FIG. 6 shows an edit portion of a thirdcontrol data subset 103 a giving local linking information for the first fast reverse playback mode RW1. After having retrieved data from thethird memory sector 73, theediting unit 5 determines from the edit portion (RW1) of the third control data sub-set 103 a the memory address (17001) of the start of thenext memory sector 72, which would have preceded thethird sector 73 in normal viewing playback mode streaming. The offset value (6000) and the length value (5000) are used in a manner corresponding to what has been described above with reference toFIG. 6 concerning forward playback modes. - In the example presented with reference to
FIG. 6 , the edit portions of thecontrol data sub-sets next memory sector next memory sector next memory sector next memory sector - Having described the streaming device above, an example of a method in the
streaming device 1 will be described, according to an embodiment of the invention. - Referring to
FIGS. 2 and 3 , a first set ofpayload data 9 a, for example a first motion picture video, is received by thenetworking unit 4 via thenetwork interface 4 a. Thenetworking unit 4 detects the incoming traffic of the first set ofpayload data 9 a and forwards it to thecontrol unit 6. - Referring to
FIG. 3 , in the pre-processing, the first set ofpayload data 9 a is divided into a plurality ofsub-sets 91 a, and a first set of control data, in the form ofsub-sets 101 a of control data, is created, including data for linking thesub-sets 91 a of payload data, or parts thereof. Upon pre-processing, the pairs ofpayload data sub-sets 91 a andcontrol data sub-sets 101 a are sent to theediting unit 5, and then stored in respective memory sectors of thememory unit 7. - Further, a second set of
payload data 9 b is received by thenetworking unit 4, and forwarded to thecontrol unit 6 to be pre-processed as described above. Thus, referring toFIG. 3 , the second set ofpayload data 9 b is divided into a plurality ofsub-sets 91 b, and a second set of control data in the form ofsub-sets 101 b of control data is created, and the pairs ofpayload data sub-sets 91 a andcontrol data sub-sets memory unit 7. - The
networking unit 4 receives, via thenetwork interface 4 a, from afirst user device 11 a a first request, including a playback mode request, for the first set ofpayload data 9 a. Thenetworking unit 4 forwards the first request to thecontrol unit 6, to be adapted to a streaming device internal language format, and the first request send to theediting unit 5. Thecontrol unit 6 extracts from the first request a first request data set, including the identity of the network protocol used for the first request, and a network address of theuser device 11 a, and sends the first request data set to thenetworking unit 4 to be stored in theRAM memory 401. - In this example the
networking unit 4 also receives from thesecond user device 11 b a first request, including a playback mode request, for the second set ofpayload data 9 b, whereupon the first request, including the identity of thesecond user device 11 b, the second set ofpayload data 9 b and the playback mode request, is forwarded to thecontrol unit 6, which extracts a first set of request data to be stored in theRAM memory 401, in the same manner as outlined above. - The
user status memory 506 receives, as indicated by the arrow A3 inFIG. 4 , from thecontrol unit 6 data corresponding to the identity of thefirst user device 11 a, the playback mode request P11 a, as well as a memory unit address of thefirst subset 91 a of the first payload data set 9 a, provided as described above, which data is stored in theuser status memory 506. Theuser status memory 506 forwards the memory unit address to thepacing device 504, which sends a request to thememory unit 7 for retrieving thefirst sub-set 91 a of the first payload data set 9 a, as well as thefirst sub-set 101 a of the first control data set. Similarly, theuser status memory 506 receives data corresponding to the identity of thesecond user device 11 b, the playback mode request P11 b, as well as a memory unit address of thefirst subset 91 b of the secondpayload data set 9 b, provided as described above, which data is stored in theuser status memory 506. Theuser status memory 506 forwards the memory unit address to thepacing device 504, which sends a request to thememory unit 7 for retrieving thefirst sub-set 91 b of the secondpayload data set 9 b, as well as thefirst sub-set 101 b of the second control data set. - In this example, initially, the playback mode request P11 a of the
first user device 11 a is a request for a normal viewing speed (1X) of the video. Thefirst sub-set 91 a of payload data is sent to thetrimming device 505, where it is temporarily stored. Thefirst multiplexer 501 receives a first control data sub-set 101 a, and extracts, in dependence on the control of theuser status memory 506 concerning the requested playback mode P11 a, a first edit portion of the first control data sub-set 101 a, which first edit portion gives linking information for the requested normal viewing speed (1X). As indicated by the arrow D4 inFIG. 4 , the first edit portion of the first control data sub-set 101 a is used to read in thetrimming device 505, so that the full sequence of data of the firstpayload data subset 91 a is stored in afirst output buffer 503 a of theoutput memory 503. - The
second multiplexer 502 also receives the first control data sub-set 101 a, and extracts, in dependence of the user status memory control, a first edit portion of the first control data sub-set 101 a, which first edit portion gives the address in thememory unit 7 of asecond sub-set 92 a of the first payload data set 9 a. The first edit portion of the first control data sub-set 101 a is received by thepacing device 504. Based on the playback mode request P11 b of thesecond user device 11 b, and a first edit portion of afirst sub-set 101 b of a second set of control data, afirst subset 91 b of payload data is stored in asecond output buffer 503 b. - In a manner described above, the
scheduling device 507 determines first bit-rate information, or first display pace information, based on information in the first set ofpayload data 9 a, and corresponding to a pace at which the first set ofpayload data 9 a is to be displayed in thefirst user device 9 a. Data from thefirst output buffer 503 a is sent based on the first bit-rate information, and when a further time code in the first payload data set 91 a is detected, the first bit-rate information is compared to time information from the clock, and based on this comparison thescheduling device 507 adjusts the timing of data sent from thefirst output buffer 503 a. If it is determined that a stream portion of data from thefirst output buffer 503 a should not be sent, thescheduling device 507 makes a similar determination concerning thesecond output buffer 503 b, performing a cyclic sequence of determinations whether to send stream portions of data from therespective output buffets networking unit 4. - After reception of a stream portion of data from the
first output buffer 503 a, in thenetworking unit 4 a data packet is created based on the stream portion of data and the first set of request data stored in the networking unit storage means 401, and the data packet is sent to the to thefirst user device 11 a via thenetwork interface 4 a. Similarly, after reception of a stream portion of data from thesecond output buffer 503 b, in thenetworking unit 4 a data packet is created based on the stream portion of data and the second set of request data stored in the networking unit storage means 401, and the data packet is sent to the to thesecond user device 11 b via thenetwork interface 4 a. - As indicated by the arrow H4 in
FIG. 4 , in dependence, as described above, on the data level in therespective output buffer first sub-set 101 a of the first set of control data, thepacing device 504 sends to the memory unit 7 a read request for asecond sub-set 92 a of thefirst set 9 a of payload data and asecond sub-set 102 a of the first set of control data. Thesesub-sets trimming device 505 and themultiplexers output memory 503, in a manner corresponding to what has been described above. - After starting of the data streaming to the
first user device 11 a, thefirst user device 11 a requests the second fast forwarding speed of the video FF2, and the playback mode setting P11 a for thefirst user 11 a in theuser status memory 506 will be changed. More specifically, thenetworking unit 4 receives, via thenetwork interface 4 a, from thefirst user device 11 a a second request, including a playback mode request for the second fast forward mode FF2. Thenetworking unit 4 forwards the second request to thecontrol unit 6, to be treated by theuser request unit 6 b, and send to theediting unit 5. In theediting unit 5, theuser status memory 506 receives the second request including the identity of thefirst user device 11 a, which is stored in theuser status memory 506. - Referring also to
FIG. 5 , using the same denomination for the data sub-sets as in the example above, upon a read instruction H4 from thepacing device 504, theediting unit 5 retrieves afirst sub-set 91 a of the first set ofpayload data 9 a, as well as afirst sub-set 101 a of the first set of control data. Thefirst sub-set 91 a of payload data is sent to thetrimming device 505, where it is temporarily stored. - The first control data sub-set 101 a is received by the
first multiplexer 501, which in dependence of the requested playback mode P11 a, extracts a third edit portion of thefirst sub-set 101 a of control data, which third edit portion gives linking information for the requested fast forward viewing speed (FF2), (see also below with reference toFIG. 6 ). As indicated by the arrow D4 inFIG. 4 , the third edit portion (FF2) of thefirst sub-set 101 a of control data is used to read in thetrimming device 505, so that a data sequence according to the linking structure of the third edit portion (FF2) is sent to thefirst output buffer 503 a of theoutput memory 503. Thus, referring toFIGS. 4 and 5 , upon reception in thetrimming device 505 of asecond sub-set 92 a of the first set ofpayload data 9 a, the linking structure provided by the third edit portion (FF2), indicated by the arrow B4 inFIG. 5 , is used to extract a trimmed portion of the asecond sub-set 92 a of the first set ofpayload data 9 a to be sent to thefirst output buffer 503 a. Parts of the first set ofpayload data 9 a excluded in the trimming device by the linking structure are simply deleted from the stream. - It should be mentioned that embodiments of the invention allow a stream at fast speed playback modes to be “tailored” according to desires of a service operator. For example, the linking structure can be made so that commercials are shown at normal viewing speed, although fast speed has been requested by the user. More specifically, the fast speed linking structure (e.g. for FF3) can be made to coincide with a normal speed linking structure (1X), or a slower fast speed linking structure (e.g. for FF2).
- The data streaming device according to the invention can in practice be provided in a large number of embodiments, varying from what has been described in the example above. For example, any of the functional units of the
streaming device 1, such as thestreaming unit 3, theediting unit 5, thenetworking unit 4, thememory unit 7 or thecontrol unit 6, can be provided as a plurality of logically interconnected devices. Further, theediting unit 5 and thenetworking unit 4 can be provided as a physically integrated unit. In a further embodiment, thememory unit 7 can be provided as two or more separate units. One such memory sub-unit can be adapted to store payload data sets, and another memory unit can be adapted to store control data sets, both sub-units being accessed by thestreaming unit 3 during data streaming. - Further, the
control unit 6 can be provided in a separate apparatus, for example a computer, which could be located remotely from thestreaming unit 3 and thememory unit 7, and connectable thereto via a network. Specially, referring toFIG. 7 , in an alternative embodiment, the control unit comprises two sub-units, one of which, here referred to as arequest device 602 is provided at thestreaming unit 3 and is adapted to receive and process user device requests as described above. The other sub-unit, herein referred to as apre-processing unit 601, could be located remotely from other streaming device components and be adapted to perform the above described pre-processing of media data. - According to a special embodiment, the
streaming unit 3 is adapted to encrypt apayload data set user devices FIG. 2 , the control unit comprises an encryptionkey storage unit 6 c adapted to store the at least one encryption key K101, K102. The encryptionkey storage unit 6 c could be in any suitable form, for example a RAM, and alternatively provided as a unit separate from thecontrol unit 6, but accessible to the latter. The encryptionkey storage unit 6 c stores encryption keys K101, K102, and data mapping each encryption key K101, K102 to apayload data set user device user devices - The control unit is adapted to determine, when receiving a streaming request, whether the payload data set 9 a, 9 b requested is to be encrypted when streamed. The control unit is also adapted to determine, if it is determined that the requested payload data set is to be encrypted, whether the
user device user device - If it is determined that the
user device control unit 6 is adapted to send the encryption key K101, K102 to thenetworking unit 4, which is adapted to store it, for example in the request data set corresponding to the streaming request, (see above). Thenetworking unit 4 is further adapted to, when receiving from theediting unit 5 the stream portions, (see above), of the payload data set 9 a, 9 b to be encrypted, to encrypt the stream portions using the encryption key K101, K102, before creating the respective network packets. - Each encryption key K101, K102 can be mapped to one user device K101, K102 or a group of user devices. Thus, this embodiment provides for session-based encryption during streaming, which can be very useful to operators of streaming services.
- In data streaming applications, it is desirable to obtain a maximum efficiency in the use of the data transport networks. In particular, the use of bandwidth available should be as efficient as possible.
- In order to increase, in data streaming applications, the efficiency of network utilisation, one aspect of the invention provides an arrangement, one embodiment of which is described here with reference to
FIGS. 8 and 9 .FIG. 8 is a simplified depiction of a network system comprising one network 2. In practice, the system could comprise any number of networks and any type, such as IP (Internet Protocol), ATM (Asynchronous Transfer Mode), or Ethernet based networks, or a network guided by any other protocol, or a combination of any of different network types. - Connectable to the network are a number of
data streaming devices memory unit payload data sets memory unit streaming unit 3 in therespective streaming device streaming units 3 are adapted to stream thepayload data sets user devices 11, also connectable to the network 2. - The network comprises a plurality of nodes N1, N2, in the form of first and second nodes, the second nodes N2 being positioned more centrally in the network 2 than the first nodes N1.
FIG. 8 shows three first nodes N1 and one second node N2.First streaming devices 1001 with respectivefirst memory units 701 are connected to a respective of the first nodes N1, and asecond streaming device 1002 with asecond memory unit 702 is connected to a second node N2. Thus, thesecond memory unit 702 is positioned more centrally in the network 2 than thefirst memory units 701. -
FIG. 9 is a diagram showing the bandwidth BW requirements for streaming a payload data set in dependence on the data stream request frequency RF for the payload data set, i.e. the popularity of the payload data set. It can be seen that the bandwidth BW requirements increases with the data stream request frequency RF. - Connectable to the network 2 is an administration device ADM, in the form of a server, adapted to periodically determine the stream request frequency RF for a plurality of payload data sets stored in the
memory units first memory units 701 or in thesecond memory unit 702. If the stream request frequency RF for the payload data set is above a first request frequency threshold value RFT1, seeFIG. 9 , the payload data set is stored in each of the threefirst memory units 701. If the stream request frequency RF for the payload data set is below the first request frequency threshold value RFT1, the payload data set is stored in thesecond memory unit 702. - Thus, a degree of distribution in the network system, i.e. more or less centralised, of each memory unit is based at least partly on the stream request frequency RF of the payloads in the respective memory unit. Thereby, a very good balance between bandwidth usage and storage usage is accomplished resulting in a high efficiency in the usage of components in the network system.
- Referring to
FIG. 10 , alternatively, or in addition, the administration device ADM can be adapted to distribute the payload data sets between thefirst memory units 701 and thesecond memory unit 702 such that the bandwidth utilisation in the network 2 for streaming payload data sets stored in thefirst memory units 701 is higher than the bandwidth utilisation in the network system for streaming payload data sets stored in thesecond memory unit 702. Thereby, the payload data sets stored in the memory units can be divided into two groups. (In alternative embodiments more than two payload data set groups can be introduced.) A first group comprises the payload data sets (inFIG. 10 payload data sets 1-10) having the highest request frequency. A second group comprises payload data sets (inFIG. 10 payload data sets 11-25) having request frequencies all lower than the request frequency of any payload data set in the first group. - Referring to
FIGS. 8 and 10 , according to this embodiment, all payload data sets in the first group will be stored in thefirst memory units 701, and all payload data sets in the second group will be stored in thesecond memory unit 702. If the administration device ADM determines that the request frequency pattern changes, so that the request frequency of a first payload data set in the first group is lower than the request frequency of a second payload data set in the second group, these two payload data sets will be relocated so that second payload data set is stored in thefirst memory units 701 and the first payload data set is stored in thesecond memory unit 702. - Referring to
FIG. 8 , thesecond streaming device 1002 is connected to athird memory unit 703, which can be located remotely from thesecond streaming device 1002. The second streaming device comprises astreaming unit 3, and acontrol unit 6, as described above. Thestreaming unit 3 is adapted to stream according to user requests, under the control of thecontrol unit 6, payload data sets stored in thethird memory unit 703, as well as from thesecond memory unit 702. It should be noted that thethird memory unit 703 can be located anywhere in the network in relationship to thesecond streaming device 1002. To illustrate this, in the simplified example shown inFIG. 8 , thethird memory unit 703 can be located in an alternative location indicated by the arrow M. - The data streaming from the
third memory unit 703 is performed similarly to what has been described above, with the following essential difference: Thesecond streaming device 1002 communicates with thethird memory unit 703 via a network interface. Thestreaming unit 3 sends read requests to thethird memory unit 703 in the form of network packets. The retrievedpayload data subsets control data subsets third memory unit 703 in network packets. The received data packets can contain one or more pairs ofpayload data subsets control data subsets payload data subsets control data subsets payload data subsets control data subsets - The
third memory unit 703 can be included in the memory allocation scheme of the administration device ADM. Thus, if the stream request frequency RF for any payload data set is below a second request frequency threshold value RFT2, seeFIG. 9 , the payload data set is stored in thethird memory unit 703. - The above description of illustrated embodiments of the invention is not intended to be exhaustive or to limit the invention to the precise form disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize. The teachings provided herein of the invention can be applied to other streaming systems, not necessarily the exemplary device described above.
- The various embodiments described above can be combined to provide further embodiments. All of the above patents and applications are incorporated by reference. Aspects of the invention can be modified, if necessary, to employ the systems, circuits and concepts of the various patents and applications described above to provide yet further embodiments of the invention.
- These and other changes can be made to the invention in light of the above detailed description. In general, in the following claims, the terms used should not be construed to limit the invention to the specific embodiments disclosed in the specification and the claims, but should be construed to include all streaming media systems that operate under the claims to provide a method for separating control from streaming. Accordingly, the invention is not limited by the disclosure, but instead the scope of the invention is to be determined by the following claims.
Claims (23)
1. An apparatus for data streaming, adapted to receive media data in the form of a plurality of payload data sets from at least one data source and a plurality of streaming requests from a plurality of user devices, the apparatus comprising
a memory unit adapted to store the payload data sets, and
a streaming unit adapted to stream the payload data sets according to the streaming requests,
the streaming unit being adapted to receive from the memory unit sub-sets of a first payload data set, and
the streaming unit being adapted to receive from the memory unit control data sub-sets, each comprising data corresponding to a location in the memory unit of a sub-set of the first payload data.
2. An apparatus according to claim 1 , wherein the streaming unit is adapted to receive from the memory unit a first sub-set of the first payload data set, and a first sub-set of the control data set, which first control data sub-set comprises data corresponding to a location in the memory unit of a second sub-set of the first payload data set.
3. An apparatus according to claim 2 , wherein the first sub-set of the payload data set and the first sub-set of the control data set are stored at the same location in the memory unit.
4. An apparatus according to claim 1 , wherein the memory unit comprises a plurality of memory sectors, and wherein the payload data set and the control data set is arranged in pairs of payload data sub-sets and control data sub-sets, each pair being stored in a respective of the memory sectors.
5. An apparatus according to claim 4 , wherein each of at least some of the control data sub-sets in the pairs of payload data sub-sets and control data sub-sets comprises data corresponding to a location of a memory sector of another pair.
6. An apparatus according to claim 1 , comprising a control unit adapted to pre-process the payload data sets before being stored.
7. An apparatus according to claim 6 , wherein the control unit is adapted to divide a payload data set into a plurality of payload data sub-sets, and create for each of at least some of the payload data sub-sets a control data sub-set, each comprising data corresponding to a location in the memory unit of another payload data sub-set.
8. An apparatus for data streaming, adapted to receive media data in the form of a plurality of payload data sets from at least one data source before being stored in a memory unit, to divide a payload data set into a plurality of payload data sub-sets, and to create for each of at least some of the payload data sub-sets a control data sub-set to be stored in the memory unit, each control data sub-set comprising data corresponding to a location in the memory unit of another payload data sub-set.
9. A combination of an apparatus according to claim 1 , and a plurality of user devices, from which the apparatus is adapted to receive the plurality of streaming requests.
10. A combination according to claim 9 , wherein the user devices are audio/video devices.
11. A combination according to claim 10 , wherein the audio/video devices are at least one of set-top boxes, personal video recorders, or personal computers.
12. A method for data streaming, comprising receiving media data in the form of a plurality of payload data sets from at least one data source and a plurality of streaming requests from a plurality of user devices, the method further comprising
storing the payload data sets in a memory unit,
streaming the payload data sets according to the streaming requests,
receiving from the memory unit sub-sets of a first payload data set, and
receiving from the memory unit control data sub-sets, each comprising data corresponding to a location in the memory unit of a sub-set of the first payload data.
13. A method according to claim 12 , comprising receiving from the memory unit a first sub-set of the first payload data set, and a first sub-set of the control data set, which first control data sub-set comprises data corresponding to a location in the memory unit of a second sub-set of the first payload data set.
14. A method according to claim 13 , wherein the first sub-set of the payload data set and the first sub-set of the control data set are stored at the same location in the memory unit.
15. A method according to claim 12 , wherein the memory unit comprises a plurality of memory sectors, and wherein the payload data set and the control data set is arranged in pairs of payload data sub-sets and control data sub-sets, each pair being stored in a respective of the memory sectors.
16. A method according to claim 15 , wherein each of at least some of the control data sub-sets in the pairs of payload data sub-sets and control data sub-sets comprises data corresponding to a location of a memory sector of another pair.
17. A method according to claim 12 , comprising pre-processing the payload data sets before being stored.
18. A method according to claim 17 , comprising dividing a payload data set into a plurality of payload data sub-sets, and creating for each of at least some of the payload data sub-sets a control data sub-set, each comprising data corresponding to a location in the memory unit of another payload data sub-set.
19. A method for data streaming, comprising receiving media data in the form of a plurality of payload data sets from at least one data source before being stored in a memory unit, dividing a payload data set into a plurality of payload data sub-sets, and creating for each of at least some of the payload data sub-sets a control data sub-set to be stored in the memory unit, each control data sub-set comprising data corresponding to a location in the memory unit of another payload data sub-set.
20. An apparatus, comprising media data receiver configured to receive media data from a data source, media data analyzer configured to analyze the media data and to locate a plurality of identification data groups within the media data and create control data corresponding to locations of the identification data groups; and a data uploader configured to enable streaming of the media data to at least one user device under control of the control data.
21. The apparatus of claim 20 , further comprising memory unit, operably connected to the data uploader, configured to store the media data and the control data.
22. A method, comprising receiving media data from a data source, analyzing the media data to locate a plurality of identification data groups, creating control data corresponding to locations of the identification data groups, and streaming the media data to at least one user device under control of the control data.
23. A data structure, comprising a first data element configured to represent portions of media data; and a second data element configured to represent control data corresponding to selected memory locations of other portions of the media data whereby a streaming unit uses the control data from the second data element to stream the other portions of the media data to a user device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/896,610 US20080068993A1 (en) | 2006-09-08 | 2007-09-04 | Method and an apparatus for data streaming |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US84294006P | 2006-09-08 | 2006-09-08 | |
GB0700313A GB2441576A (en) | 2006-09-08 | 2007-01-09 | Video server using FPGA streamers with control GPU and memory wherein video data segments are chained with play, FF and rewind pointers |
GB0700313.0 | 2007-01-09 | ||
US11/896,610 US20080068993A1 (en) | 2006-09-08 | 2007-09-04 | Method and an apparatus for data streaming |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080068993A1 true US20080068993A1 (en) | 2008-03-20 |
Family
ID=39188452
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/896,610 Abandoned US20080068993A1 (en) | 2006-09-08 | 2007-09-04 | Method and an apparatus for data streaming |
Country Status (1)
Country | Link |
---|---|
US (1) | US20080068993A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080209054A1 (en) * | 2007-02-27 | 2008-08-28 | Samsung Electronics Co., Ltd. | Method and apparatus for relaying streaming data |
WO2008136758A1 (en) * | 2007-05-08 | 2008-11-13 | Edgeware Ab | A method and an apparatus for streaming data containing trick play streaming modes |
US20120059954A1 (en) * | 2010-09-02 | 2012-03-08 | Comcast Cable Communications, Llc | Providing enhanced content |
US20190132353A1 (en) * | 2017-11-02 | 2019-05-02 | International Business Machines Corporation | Service overload attack protection based on selective packet transmission |
WO2020165659A3 (en) * | 2019-02-12 | 2020-10-08 | Samsung Electronics Co., Ltd. | Systems and methods for streaming storage device content |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6016382A (en) * | 1993-03-16 | 2000-01-18 | Victor Company Of Japan, Ltd. | Method for jump-reproducing video data of moving picture coded with high efficiency |
US6067108A (en) * | 1996-12-12 | 2000-05-23 | Trw Inc. | Solid-state mass storage data stream generator |
US20030095783A1 (en) * | 2001-11-21 | 2003-05-22 | Broadbus Technologies, Inc. | Methods and apparatus for generating multiple network streams from a large scale memory buffer |
US20040098748A1 (en) * | 2002-11-20 | 2004-05-20 | Lan Bo | MPEG-4 live unicast video streaming system in wireless network with end-to-end bitrate-based congestion control |
US20050097614A1 (en) * | 2003-10-31 | 2005-05-05 | Pedlow Leo M.Jr. | Bi-directional indices for trick mode video-on-demand |
US20060271996A1 (en) * | 2005-05-31 | 2006-11-30 | Sharp Kabushiki Kaisha | System for providing service related information to content reproducing apparatus |
US20070160208A1 (en) * | 2006-01-06 | 2007-07-12 | Widevine Technologies, Inc. | Selective and persistent application level encrytion for video provided to a client |
US20080219393A1 (en) * | 2004-04-28 | 2008-09-11 | Tadamasa Toma | Moving Picture Stream Generation Apparatus, Moving Picture Coding Apparatus, Moving Picture Multiplexing Apparatus and Moving Picture Decoding Apparatus |
-
2007
- 2007-09-04 US US11/896,610 patent/US20080068993A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6016382A (en) * | 1993-03-16 | 2000-01-18 | Victor Company Of Japan, Ltd. | Method for jump-reproducing video data of moving picture coded with high efficiency |
US6067108A (en) * | 1996-12-12 | 2000-05-23 | Trw Inc. | Solid-state mass storage data stream generator |
US20030095783A1 (en) * | 2001-11-21 | 2003-05-22 | Broadbus Technologies, Inc. | Methods and apparatus for generating multiple network streams from a large scale memory buffer |
US20040098748A1 (en) * | 2002-11-20 | 2004-05-20 | Lan Bo | MPEG-4 live unicast video streaming system in wireless network with end-to-end bitrate-based congestion control |
US20050097614A1 (en) * | 2003-10-31 | 2005-05-05 | Pedlow Leo M.Jr. | Bi-directional indices for trick mode video-on-demand |
US20080219393A1 (en) * | 2004-04-28 | 2008-09-11 | Tadamasa Toma | Moving Picture Stream Generation Apparatus, Moving Picture Coding Apparatus, Moving Picture Multiplexing Apparatus and Moving Picture Decoding Apparatus |
US20060271996A1 (en) * | 2005-05-31 | 2006-11-30 | Sharp Kabushiki Kaisha | System for providing service related information to content reproducing apparatus |
US20070160208A1 (en) * | 2006-01-06 | 2007-07-12 | Widevine Technologies, Inc. | Selective and persistent application level encrytion for video provided to a client |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080209054A1 (en) * | 2007-02-27 | 2008-08-28 | Samsung Electronics Co., Ltd. | Method and apparatus for relaying streaming data |
WO2008136758A1 (en) * | 2007-05-08 | 2008-11-13 | Edgeware Ab | A method and an apparatus for streaming data containing trick play streaming modes |
US20100121970A1 (en) * | 2007-05-08 | 2010-05-13 | Edgeware Ab | method and an apparatus for streaming data containing trick play streaming modes |
US9837126B2 (en) | 2010-09-02 | 2017-12-05 | Comcast Cable Communications, Llc | Providing enhanced content |
US8234411B2 (en) * | 2010-09-02 | 2012-07-31 | Comcast Cable Communications, Llc | Providing enhanced content |
US8707349B2 (en) | 2010-09-02 | 2014-04-22 | Comcast Cable Communications, Llc | Providing enhanced content |
US20120059954A1 (en) * | 2010-09-02 | 2012-03-08 | Comcast Cable Communications, Llc | Providing enhanced content |
US10593369B2 (en) | 2010-09-02 | 2020-03-17 | Comcast Cable Communications, Llc | Providing enhanced content |
US11081143B2 (en) | 2010-09-02 | 2021-08-03 | Tivo Corporation | Providing enhanced content |
US20190132353A1 (en) * | 2017-11-02 | 2019-05-02 | International Business Machines Corporation | Service overload attack protection based on selective packet transmission |
US10666680B2 (en) | 2017-11-02 | 2020-05-26 | International Business Machines Corporation | Service overload attack protection based on selective packet transmission |
US10735459B2 (en) * | 2017-11-02 | 2020-08-04 | International Business Machines Corporation | Service overload attack protection based on selective packet transmission |
WO2020165659A3 (en) * | 2019-02-12 | 2020-10-08 | Samsung Electronics Co., Ltd. | Systems and methods for streaming storage device content |
US11379374B2 (en) | 2019-02-12 | 2022-07-05 | Samsung Electronics Co., Ltd. | Systems and methods for streaming storage device content |
US20220334975A1 (en) * | 2019-02-12 | 2022-10-20 | Samsung Electronics Co., Ltd. | Systems and methods for streaming storage device content |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8826345B2 (en) | Method and an apparatus for data streaming | |
US7613381B2 (en) | Video data processing method and video data processing apparatus | |
US8499091B2 (en) | Method and an apparatus for data recording and streaming | |
KR100492567B1 (en) | Http-based video streaming apparatus and method for a mobile communication system | |
KR101082642B1 (en) | Apparatus system and method for adaptive-rate shifting of streaming content | |
US20020064177A1 (en) | Method and apparatus for forming and utilizing a slotted mpeg transport stream | |
US11284135B2 (en) | Communication apparatus, communication data generation method, and communication data processing method | |
JP2015136060A (en) | Communication device, communication data generation method, and communication data processing method | |
EP3096524B1 (en) | Communication apparatus, communication data generation method, and communication data processing method | |
US20080068993A1 (en) | Method and an apparatus for data streaming | |
EP2064703A2 (en) | A method and an apparatus for data streaming | |
CN105900437B (en) | Communication apparatus, communication data generating method, and communication data processing method | |
EP2064884A2 (en) | A method and an apparatus for data streaming | |
WO2008028834A2 (en) | A method and an apparatus for data streaming | |
US20100121970A1 (en) | method and an apparatus for streaming data containing trick play streaming modes | |
US20080062869A1 (en) | Method and an apparatus for data streaming |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: EDGEWARE AB, SWEDEN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ROOS, JOACHIM;HENRIKSSON, KARL;HOLM, LUKAS;REEL/FRAME:020177/0472 Effective date: 20071101 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |