US20140181881A1 - System and method for internet audio/video delivery - Google Patents

System and method for internet audio/video delivery Download PDF

Info

Publication number
US20140181881A1
US20140181881A1 US14/192,082 US201414192082A US2014181881A1 US 20140181881 A1 US20140181881 A1 US 20140181881A1 US 201414192082 A US201414192082 A US 201414192082A US 2014181881 A1 US2014181881 A1 US 2014181881A1
Authority
US
United States
Prior art keywords
audio
software application
video data
messaging
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/192,082
Inventor
Max Haot
Phillip Tomasz Worthington
Mark Kornfilt
Dayananda Nanjundappa
Roger Kapsi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Livestream LLC
Original Assignee
Livestream LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Livestream LLC filed Critical Livestream LLC
Priority to US14/192,082 priority Critical patent/US20140181881A1/en
Publication of US20140181881A1 publication Critical patent/US20140181881A1/en
Priority to US15/190,555 priority patent/US20160309236A1/en
Priority to US15/888,892 priority patent/US20180227643A1/en
Priority to US16/180,418 priority patent/US20190075366A1/en
Priority to US16/697,450 priority patent/US20200099991A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6156Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6175Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8173End-user applications, e.g. Web browser, game
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Definitions

  • One embodiment of the present invention relates to a system for Internet audio/video delivery.
  • Another embodiment of the present invention relates to a method for Internet audio/video delivery.
  • audio/video content is intended to refer to audio content and/or video content (including, without limitation, still pictures and/or moving pictures).
  • audio/video data element is intended to refer to audio/video content in the form of a computer-readable data stream or file (including, without limitation, an audio file such as .midi, .wav, .mp3; a still picture file such as .jpg, .tiff, .bmp; a multimedia file such as .mov, .mpg, avi; and/or an animation such as .swf (a file created with ADOBE software).
  • a given audio/video data element e.g., a .swf file
  • FIG. 1 shows a system architecture according to one embodiment of the present invention
  • FIG. 2 shows a system architecture according to a conventional live Internet webcast
  • FIG. 3 shows a system architecture according to another embodiment of the present invention.
  • FIGS. 4A-4F show web browser screenshots according to other embodiments of the present invention.
  • the present invention relates to an online service/platform to enable anybody to launch their own 24/7 TV station on the Internet.
  • the service/platform of this embodiment enables users to create 24/7 linear channels which can include pre-recorded audio/video content organized in playlists as well as live audio/video content (like a news program, talk show, etc.).
  • the channels may be interactive as viewers may contact the producers to participate in the show (e.g., using the viewer's webcam and/or microphone).
  • Each of the channel producers may have access to a “studio” which allows each producer to control the channel in realtime, such as, for example, by mixing live cameras, creating playlists, controlling graphics like a channel bug, etc.
  • Various embodiments of the present invention thus permit one or more channels to be controlled by groups of people together in realtime.
  • the present invention relates to an architecture to enable live television/audio/video distribution.
  • various embodiments of the present invention may utilize a distribution system sending to the viewers (e.g., all the viewers) “control messages” (e.g., “play this video now”, “put this graphic there”, “switch to this live camera signal”, etc.).
  • a player component e.g., disposed on a computer associated with each viewer
  • access the content from one or more sources (e.g., from third party servers), to buffer the content, to assemble the content, to synchronize the content and to play the content seamlessly giving the impression to the viewer of a live stream playing.
  • FIG. 1 a system architecture according to one embodiment of the present invention is shown.
  • studios 101 A- 101 C are provided (while three studios are shown in this example, any desired number of such studios may be provided).
  • each of studios 101 A- 101 C may be associated with a given person acting as a producer and each of studios 101 A- 101 C may comprise software running on a computer.
  • each of studios 101 A- 101 C may comprise software (such as ADOBE Flash/Flex/ActionScript 3 software) running in a web browser.
  • each of studios 101 A- 101 C communicates with channel server 103 , which may control one or more channels (of course, any desired number of channels and/or channel servers may be utilized under the present invention). In one example, such communication may be via the Internet.
  • the communication between each of studios 101 A- 101 C and channel server 103 may comprise: (a) control messages from each of studios 101 A- 101 C to channel server 103 for use in controlling each player component 105 A- 105 C (discussed in more detail below); (b) control messages from channel server 103 to each of studios 101 A- 101 C for use in controlling each of studios 101 A- 101 C (e.g., what to display on a screen of one of the studios based upon what other producers at one or more of the other studios are doing, what to display on a screen of one of the studios based upon what is being displayed at one or more player components); and/or (c) audio/video content to be sent by channel server 103 to one or more of player components 105 A- 105 C (
  • Channel server 103 also communicates (e.g., directly via an intranet and/or indirectly via the Internet) with server persistence engine 107 and channel quality of service engine 109 .
  • player components 105 A- 105 C are controlled by channel server 103 (e.g., through control messages sent from channel server 103 via the Internet).
  • each of player components 105 A- 105 C may be associated with a given person acting as a viewer and each of player components 105 A- 105 C may comprise software running on a computer (while three player components are shown in this example, any desired number of such player components may be provided).
  • each of player components 105 A- 105 C may comprise software (such as ADOBE Flash/Flex/ActionScript 3 software) running in a web browser.
  • each player component may comprise a PC, a TV and/or a mobile device (e.g., a mobile phone or PDA).
  • each of player components 105 A- 105 C may comprise a quality of service (QOS) engine, a compositing engine and a rendering engine.
  • QOS quality of service
  • each of player components 105 A- 105 C Based upon control messages received by each of player components 105 A- 105 C from channel server 103 (wherein the messages may vary for different player components and/or the messages may be the same for different player components), each of player components 105 A- 105 C gets audio/video content from one or more of audio/video content providers 111 A- 111 C for display to each respective viewer (while three audio/video content providers are shown in this example, any desired number of such audio/video content providers may be provided). In one example, each of player components 105 A- 105 C may communicate with each of audio/video content providers 111 A- 111 C via the Internet.
  • the content may comprise video (e.g., one or more live video feeds, one or more recorded video feeds), one or more still images (e.g., jpg, png) and/or audio (e.g., one or more live audio feeds, one or more recorded video feeds, an MP3 stream).
  • video e.g., one or more live video feeds, one or more recorded video feeds
  • still images e.g., jpg, png
  • audio e.g., one or more live audio feeds, one or more recorded video feeds, an MP3 stream.
  • one or more of studios 101 A- 101 C may provide its own content (e.g., live audio/video) to one or more of player components 105 A- 105 C through channel server 103 (e.g., in a similar manner to conventional Internet television without using control messages to direct the player component to get that specific content from a content provider).
  • content e.g., live audio/video
  • channel server 103 e.g., in a similar manner to conventional Internet television without using control messages to direct the player component to get that specific content from a content provider.
  • one or more studios and/or one or more player components may comprise software running as a desktop application (e.g., which communicates with the channel server(s) and/or the content provider server(s) over the Internet).
  • a desktop application e.g., which communicates with the channel server(s) and/or the content provider server(s) over the Internet.
  • various embodiments of the present invention may operate in essentially real-time.
  • the studios may control directly and at any moment in time what each client application (each player component) displays.
  • the producer of a channel may, for example, change the text of the ticker, which will in turn send a control message to the channel server, which will propagate it to all client applications (all player components).
  • a system for distributing audio/video convent via a network comprising: a client software application, wherein the client software application runs on a client device (see, e.g., player components 105 A- 105 C of FIG. 1 ); and a messaging software application, wherein the messaging software application runs on a messaging server (see, e.g., channel server 103 of FIG.
  • the client device and the messaging server are operatively connected together via the network such that the client software application receives at least one message from the messaging software application; wherein the at least one message causes the client software application to access at least: i) a first audio/video data element and ii) a second audio/video data element; and wherein the at least one message causes the client software application to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at the client device.
  • the client device may comprise a client computer.
  • the network may comprise the Internet.
  • the client software application may access the first and second audio/video data elements via the network.
  • the client software application may access the first and second audio/video data elements from a content server (see, e.g., audio/video content providers 111 A- 111 C of FIG. 1 ).
  • the client software application may access the first audio/video data element from a first content server, the client software application may access the second audio/video data element from a second content server, and the first content server may be distinct from the second content server.
  • the client software application may access at least one of the first and second audio/video data elements by opening a data stream.
  • the client software application may access at least one of the first and second audio/video data elements by downloading.
  • a studio software application may be provided, wherein the studio software application may run on a studio computer (see, e.g., studios 101 A- 101 C of FIG. 1 ).
  • the studio computer and the messaging server may be operatively connected together via the network such that the messaging software application receives at least one message from the studio software application.
  • the at least one message received by the client software application from the messaging software application may be based at least in part upon the at least one message received by the messaging software application from the studio software application.
  • the messaging, compositing and/or rendering may be carried out in essentially real-time.
  • a system for distributing audio/video convent via a network comprising: a plurality of client software applications, wherein each of the plurality of client software applications runs on a respective one of a plurality of client devices (see, e.g., player components 105 A- 105 C of FIG. 1 ); and at least one messaging software application, wherein the messaging software application runs on a messaging server (see, e.g., channel server 103 of FIG.
  • each of the plurality of client devices is operatively connected with the messaging server via the network such that each of the plurality of client software applications receives at least one message from the messaging software application; wherein at least one of the messages cause each of the plurality of client software applications to access at least: i) a first audio/video data element and ii) a second audio/video data element; and wherein at least one of the messages cause each of the plurality of client software applications to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at each respective one of the plurality of client devices.
  • At least one message received by at least one of the plurality of client software applications may be distinct from at least one message received by at least another of the plurality of client software applications.
  • At least one message received by each of the plurality of client software applications may synchronize each of the plurality of client software applications such as to render the composited first and second audio/video data elements in essentially the same state at essentially the same time.
  • a plurality of studio software applications may be provided, wherein each of the plurality of studio software applications may run on a respective one of a plurality of studio computers (see, e.g., studios 101 A- 101 C of FIG. 1 ).
  • each of the plurality of studio computers may be operatively connected with the messaging server via the network such that the messaging software application receives at least one message from each of the plurality of studio software applications.
  • At least one message received by each of the plurality of client software applications from the messaging software application may be based at least in part upon at least one message received by the messaging software application from at least one of the plurality of studio software applications.
  • a plurality of messaging software applications may be provided, wherein each of the plurality of messaging software application may run on a respective one of a plurality of messaging servers, wherein each of the plurality of client devices may be operatively connected with at least one of the plurality of messaging servers via the network such that each of the plurality of client software applications receives at least one message from at least one of the plurality of messaging software applications, and wherein each of the plurality of studio computers may be operatively connected with at least one of the plurality of messaging servers via the network such that at least one of the plurality of messaging software applications receives at least one message from at least one of the studio software applications.
  • a method for distributing audio/video convent via a network comprising: sending to a client software application at least one message, wherein the client software application runs on a client device (see, e.g., player components 105 A- 105 C of FIG.
  • the at least one message causes the client software application to access at least: i) a first audio/video data element and ii) a second audio/video data element, and wherein the at least one message causes the client software application to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at the client device; and receiving from the client software application at least one message, wherein the at least one message received from the client software application indicates at least one of: (a) a degree of access by the client software application to at least the first audio/video data element and to the second audio/video data element; (b) a degree of completion of the compositing together at least the first audio/video data element and the second audio/video data element; and (c) a degree of completion of rendering at least the composited first and second audio/video data elements.
  • the at least one message may be received at a studio software application from the client software application, and the studio software application may run on a studio computer (see, e.g., studios 101 A- 101 C of FIG. 1 ).
  • At least one message may be received at the studio software application from the client software application via the network.
  • the at least one message may be received at the studio software application from the client software application directly.
  • the at least one message may be received at the studio software application from the client software application by passing through at least one intermediary server.
  • the steps may be carried out in the order recited.
  • FIG. 2 a system architecture according to a conventional live Internet webcast is shown.
  • production studio 200 is utilized to mix audio/video signals from sources 201 A- 202 D at mixer 203 .
  • the output of mixer 203 is feed to character generator 205 .
  • the output of character generator 205 is feed to web encoder 207 .
  • the output of web encoder 207 is feed to content delivery network 209 (which may include load balancing) and then on to viewers 211 .
  • content delivery network 209 which may include load balancing
  • FIG. 3 shows a system architecture according to an embodiment of the present invention in which each of remote producers 301 A- 301 C utilizes associated studio 303 A- 303 C to communicate via the Internet with broadcasting platform 302 in order to control what each of viewers 305 sees on an associated player component.
  • Each of the player components may receive control messages from broadcasting platform 302 , each of the player components may retrieve content from content sources 307 (e.g., as directed by the control messages), each of the player components may receive content from one or more of studios 303 A- 303 C (e.g., via broadcasting platform 302 ) and/or each of the player components may receive content from broadcasting platform 302 .
  • broadcasting platform 302 is operatively connected to the Internet to communicate with the studios, the player components and/or the content sources.
  • each of the player components (which are not separately shown in the Fig.) is operatively connected to the Internet to communicate with broadcasting platform 302 and content sources 307 .
  • the player component may include one or more of the following:
  • FIGS. 4B-4F web browser screenshots of a studio according to an embodiment of the present invention is shown.
  • FIG. 4B shows a screenshot of how the producer of a newly created channel can pick a broadcast graphics template and customize and preview (not shown) the graphics.
  • graphics may include (but not be limited to): Bug; Lower Third; Ticker; Over The Shoulder; Test Card.
  • This configuration of a channel may, in one example, be a one-time process (similar to the way that some blog publishing software may let you choose and configure templates to establish an identity when you first launch your blog).
  • FIG. 4C shows a screenshot of how the producer of a newly created channel can search the Internet for images/audio/video from within the studio.
  • the “Get Content” tab may allow users to easily type keywords and search integrated sources (e.g., AOL Video, Youtube, Google, etc.).
  • the Search results may be streamed in.
  • the user may preview any clip.
  • the user may drag the clips into the user's storyboard in preparation for a live broadcast and/or play list loop.
  • the system of this embodiment may automatically download the files, transcode the files and post the files to the servers of the system (the user may see a progress bar).
  • This FIG. 4C also shows some other example sources of audio/video content including (but not limited to): from the web; from a website; from another channel; from an online store; from the user's computer; from the user's webcam.
  • FIG. 4D shows a screenshot of how a storyboard may be used as a playlist for the auto-pilot and/or a guide to produce a live broadcast (similar to a script).
  • the producer can go into the storyboard and: re-order clips; add notes useful to him and his fellow producers; and/or add text for the presenter to say while on camera (similar to a broadcast teleprompter).
  • collaboration may be provided such that searches and/or storyboards are available in realtime to any producer logged into a given channel (e.g., if one producer adds text or re-orders a storyboard, all the other producers of that channel can seen the changes in realtime).
  • FIG. 4E shows a screenshot of “Live Studio”, where producers mix live (when the channel is in “auto-pilot” mode a playlist may be automatically followed (in one example, the auto-pilot can be seen pressing the various buttons on the studio screen)). Of course, when auto-pilot is not turned on, the producer may mix in realtime.
  • the basic process may be as follows:
  • FIG. 4F shows another screenshot of “Live Studio”.
  • the producer has now selected the cameras tab on the left.
  • the producer can see the cameras of all of the other producers logged-in for this channel.
  • a producer can simply drag any webcam on the bank and make it live.
  • viewers can call the channel.
  • a switchboard tab may allow someone from the production team to select one or more viewers and put the selected viewer(s) in the camera list for live broadcast.
  • a video mail functionality may be provided if a producer does not reply on-time to one or more calls (the viewer may be able to leave a message for future broadcast).
  • the architecture may be platform agnostic.
  • the architecture may work for cable operators, mobile operators, etc.
  • the present invention relates to a realtime shared production tool.
  • a realtime shared production tool may comprise capabilities to have producers around the world controlling (e.g., mixing, etc.) together a single video channel in realtime. This may comprise a “virtual, global TV studio”.
  • the present invention relates to interactivity with viewers.
  • viewers may call the channel (e.g., in realtime) using audio/video (e.g., using the viewer's webcam and/or microphone), be selected by a switchboard and then be put through live on the channel (if the producers so decide).
  • audio/video e.g., using the viewer's webcam and/or microphone
  • the present invention may provide a single studio for each channel.
  • the present invention may provide a plurality of studios for each channel (in one specific example, there may be a “master” studio that takes precedence over the other studios associated with a given channel; in another specific example, there may be no “master” studio, such that none of the plurality of studios associated with a given channel takes precedence over the other).
  • the new studio(s) may be synchronized with the existing studio(s).
  • a player component may comprise software (e.g., which may be run in a web browser) and the player component/browser may run on a desktop computer, a laptop computer, a PDA, a mobile phone, etc.
  • a player component may provide to the viewer no facility for a fast forward operation, a rewind operation or the like (similar to a conventional television).
  • each channel may be public or private (e.g., accessible only via invitation and/or through the use of a unername/password).
  • advertisements may be inserted into one or more channels.
  • the advertisements may be inserted on a set schedule (e.g., periodically, every 10 minutes).
  • the advertisements may be targeted based upon channel content (e.g., a channel carrying sports content gets sports-related advertising; a channel carrying fashion content gets fashion-related advertising).
  • each of the studios and/or the player components may be an online Rich Internet Application built using ADOBE Flash/Flex/ActionScript 3 and no downloads may be required; further, each of the studios and/or the player components may be MAC/PC/LINUX compatible.
  • a .swf (a file created with ADOBE Flash/Flex/ActionScript 3 software) may be utilized to allow producers to put broadcast graphics on one or more desired channels.
  • one example of the present invention may provide a live streaming protocol (including control messages) for controlling one or more player components from one or more servers (wherein at least some of the content played by the player components(s) comes from source(s) different than the server(s) providing the control messages).
  • another example of the present invention may provide for global distributed production/mixing (e.g., multiple studios at distinct remote locations providing control messages for a given channel to control one or more player components).
  • another example of the present invention may provide for quality of service (QoS) measurement and/or control.
  • QoS quality of service
  • a channel server may receive feedback from one or more player components regarding when the player component(s) are ready to play content.
  • a QoS engine may be integrated to ensure that all the player components remain in synchronization (e.g., late-arriving player components are synchronized with player components that are already being used at the time the late-arriving player components start).
  • the synchronization may utilize state information.
  • the synchronization may comprise predictive synchronization.
  • another example of the present invention may provide for interactive communication among the studio(s) and the player component(s).
  • another example of the present invention may provide users (e.g., producers) the ability to record instructions for broadcasting (see the “auto-pilot” discussed above) as one or more text files containing the necessary instructions.
  • the embodiments described herein may, of course, be implemented using any appropriate computer hardware and/or computer software.
  • computer hardware e.g., a mainframe, a mini-computer, a personal computer (“PC”), a network (e.g., an intranet and/or the Internet)
  • type of computer programming techniques e.g., object oriented programming
  • type of computer programming languages e.g., C++, Basic, AJAX, Javascript, ADOBE Flash/Flex/ActionScript 3.
  • the aforementioned examples are, of course, illustrative and not restrictive.
  • any desired number of channels (and any desired number of associated producer(s) and/or associated viewer(s)) may be provided. Further still, the various steps may be carried out in any desired order (and any desired steps may be added and/or any desired steps may be eliminated).

Abstract

One embodiment of the present invention relates to a system for Internet audio/video delivery. Another embodiment of the present invention relates to a method for Internet audio/video delivery.

Description

    RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 12/025,360, filed Feb. 4, 2008, which claims the benefit of U.S. Provisional Application Ser. No. 60/887,922, filed Feb. 2, 2007 and U.S. Provisional Application Ser. No. 60/913,402, filed Apr. 23, 2007. Each of the aforementioned applications are incorporated herein by reference in their entirety.
  • FIELD OF THE INVENTION
  • One embodiment of the present invention relates to a system for Internet audio/video delivery.
  • Another embodiment of the present invention relates to a method for Internet audio/video delivery.
  • For the purposes of describing and claiming the present invention, the term “audio/video content” is intended to refer to audio content and/or video content (including, without limitation, still pictures and/or moving pictures).
  • Further, for the purposes of describing and claiming the present invention the term “audio/video data element” is intended to refer to audio/video content in the form of a computer-readable data stream or file (including, without limitation, an audio file such as .midi, .wav, .mp3; a still picture file such as .jpg, .tiff, .bmp; a multimedia file such as .mov, .mpg, avi; and/or an animation such as .swf (a file created with ADOBE software). Of note, a given audio/video data element (e.g., a .swf file) may be a composite of other audio/video data elements.
  • BACKGROUND OF THE INVENTION
  • Two examples of patent publications related to distributing data over a computer network include the following: U.S. Patent Application Publication 2006/0259607, published Nov. 16, 2006 in the name of O'Neal et al. and U.S. Patent Application Publication 2003/0051051, published Mar. 13, 2003 in the name of O'Neal et al.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a system architecture according to one embodiment of the present invention;
  • FIG. 2 shows a system architecture according to a conventional live Internet webcast;
  • FIG. 3 shows a system architecture according to another embodiment of the present invention; and
  • FIGS. 4A-4F show web browser screenshots according to other embodiments of the present invention.
  • Among those benefits and improvements that have been disclosed, other objects and advantages of this invention will become apparent from the following description taken in conjunction with the accompanying figures. The figures constitute a part of this specification and include illustrative embodiments of the present invention and illustrate various objects and features thereof.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely illustrative of the invention that may be embodied in various forms. In addition, each of the examples given in connection with the various embodiments of the invention are intended to be illustrative, and not restrictive. Further, any trademarks, company names and the like referred to in the present application are intended to be illustrative, and not restrictive. Further still, the figures are not necessarily to scale, some features may be exaggerated to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
  • Of note, the application may contain some material that may be subject to copyright protection. A disclaimer of copyright with regard to any material owned by another party is hereby made.
  • In one embodiment the present invention relates to an online service/platform to enable anybody to launch their own 24/7 TV station on the Internet. As opposed to services like Youtube (e.g., where single video clips can be uploaded and viewed), the service/platform of this embodiment enables users to create 24/7 linear channels which can include pre-recorded audio/video content organized in playlists as well as live audio/video content (like a news program, talk show, etc.). The channels may be interactive as viewers may contact the producers to participate in the show (e.g., using the viewer's webcam and/or microphone). Each of the channel producers may have access to a “studio” which allows each producer to control the channel in realtime, such as, for example, by mixing live cameras, creating playlists, controlling graphics like a channel bug, etc. Various embodiments of the present invention thus permit one or more channels to be controlled by groups of people together in realtime.
  • In another embodiment the present invention relates to an architecture to enable live television/audio/video distribution. In this regard, whereby traditional TV broadcast is done by rendering/mixing a signal at the broadcast station which is then encoded as a finished product and transmitted to viewers as a complete video stream from a single source, various embodiments of the present invention may utilize a distribution system sending to the viewers (e.g., all the viewers) “control messages” (e.g., “play this video now”, “put this graphic there”, “switch to this live camera signal”, etc.). Based upon such control messages a player component (e.g., disposed on a computer associated with each viewer) is then responsible in this embodiment to access the content from one or more sources (e.g., from third party servers), to buffer the content, to assemble the content, to synchronize the content and to play the content seamlessly giving the impression to the viewer of a live stream playing.
  • Referring now to FIG. 1, a system architecture according to one embodiment of the present invention is shown. As seen in this FIG. 1, studios 101A-101C are provided (while three studios are shown in this example, any desired number of such studios may be provided). In one example, each of studios 101A-101C may be associated with a given person acting as a producer and each of studios 101A-101C may comprise software running on a computer. In one specific example, each of studios 101A-101C may comprise software (such as ADOBE Flash/Flex/ActionScript 3 software) running in a web browser.
  • Further, each of studios 101A-101C communicates with channel server 103, which may control one or more channels (of course, any desired number of channels and/or channel servers may be utilized under the present invention). In one example, such communication may be via the Internet. The communication between each of studios 101A-101C and channel server 103 may comprise: (a) control messages from each of studios 101A-101C to channel server 103 for use in controlling each player component 105A-105C (discussed in more detail below); (b) control messages from channel server 103 to each of studios 101A-101C for use in controlling each of studios 101A-101C (e.g., what to display on a screen of one of the studios based upon what other producers at one or more of the other studios are doing, what to display on a screen of one of the studios based upon what is being displayed at one or more player components); and/or (c) audio/video content to be sent by channel server 103 to one or more of player components 105A-105C (discussed in more detail below).
  • Channel server 103 also communicates (e.g., directly via an intranet and/or indirectly via the Internet) with server persistence engine 107 and channel quality of service engine 109. As mentioned above, player components 105A-105C are controlled by channel server 103 (e.g., through control messages sent from channel server 103 via the Internet). In one example, each of player components 105A-105C may be associated with a given person acting as a viewer and each of player components 105A-105C may comprise software running on a computer (while three player components are shown in this example, any desired number of such player components may be provided). In one specific example, each of player components 105A-105C may comprise software (such as ADOBE Flash/Flex/ActionScript 3 software) running in a web browser. In another specific example, each player component may comprise a PC, a TV and/or a mobile device (e.g., a mobile phone or PDA). In another specific example, each of player components 105A-105C may comprise a quality of service (QOS) engine, a compositing engine and a rendering engine.
  • Based upon control messages received by each of player components 105A-105C from channel server 103 (wherein the messages may vary for different player components and/or the messages may be the same for different player components), each of player components 105A-105C gets audio/video content from one or more of audio/video content providers 111A-111C for display to each respective viewer (while three audio/video content providers are shown in this example, any desired number of such audio/video content providers may be provided). In one example, each of player components 105A-105C may communicate with each of audio/video content providers 111A-111C via the Internet. In one specific example, the content may comprise video (e.g., one or more live video feeds, one or more recorded video feeds), one or more still images (e.g., jpg, png) and/or audio (e.g., one or more live audio feeds, one or more recorded video feeds, an MP3 stream).
  • In another example, one or more of studios 101A-101C may provide its own content (e.g., live audio/video) to one or more of player components 105A-105C through channel server 103 (e.g., in a similar manner to conventional Internet television without using control messages to direct the player component to get that specific content from a content provider).
  • In another example, one or more studios and/or one or more player components may comprise software running as a desktop application (e.g., which communicates with the channel server(s) and/or the content provider server(s) over the Internet).
  • In another example, various embodiments of the present invention may operate in essentially real-time. In one specific example, the studios may control directly and at any moment in time what each client application (each player component) displays. The producer of a channel may, for example, change the text of the ticker, which will in turn send a control message to the channel server, which will propagate it to all client applications (all player components).
  • In another embodiment of the present invention a system for distributing audio/video convent via a network is provided, comprising: a client software application, wherein the client software application runs on a client device (see, e.g., player components 105A-105C of FIG. 1); and a messaging software application, wherein the messaging software application runs on a messaging server (see, e.g., channel server 103 of FIG. 1); wherein the client device and the messaging server are operatively connected together via the network such that the client software application receives at least one message from the messaging software application; wherein the at least one message causes the client software application to access at least: i) a first audio/video data element and ii) a second audio/video data element; and wherein the at least one message causes the client software application to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at the client device.
  • In one example, the client device may comprise a client computer.
  • In another example, the network may comprise the Internet.
  • In another example, the client software application may access the first and second audio/video data elements via the network.
  • In another example, the client software application may access the first and second audio/video data elements from a content server (see, e.g., audio/video content providers 111A-111C of FIG. 1).
  • In another example, the client software application may access the first audio/video data element from a first content server, the client software application may access the second audio/video data element from a second content server, and the first content server may be distinct from the second content server.
  • In another example, the client software application may access at least one of the first and second audio/video data elements by opening a data stream.
  • In another example, the client software application may access at least one of the first and second audio/video data elements by downloading.
  • In another example, a studio software application may be provided, wherein the studio software application may run on a studio computer (see, e.g., studios 101A-101C of FIG. 1).
  • In another example, the studio computer and the messaging server may be operatively connected together via the network such that the messaging software application receives at least one message from the studio software application.
  • In another example, the at least one message received by the client software application from the messaging software application may be based at least in part upon the at least one message received by the messaging software application from the studio software application.
  • In another example, the messaging, compositing and/or rendering may be carried out in essentially real-time.
  • In another embodiment of the present invention a system for distributing audio/video convent via a network is provided, comprising: a plurality of client software applications, wherein each of the plurality of client software applications runs on a respective one of a plurality of client devices (see, e.g., player components 105A-105C of FIG. 1); and at least one messaging software application, wherein the messaging software application runs on a messaging server (see, e.g., channel server 103 of FIG. 1); wherein each of the plurality of client devices is operatively connected with the messaging server via the network such that each of the plurality of client software applications receives at least one message from the messaging software application; wherein at least one of the messages cause each of the plurality of client software applications to access at least: i) a first audio/video data element and ii) a second audio/video data element; and wherein at least one of the messages cause each of the plurality of client software applications to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at each respective one of the plurality of client devices.
  • In one example, at least one message received by at least one of the plurality of client software applications may be distinct from at least one message received by at least another of the plurality of client software applications.
  • In another example, at least one message received by each of the plurality of client software applications may synchronize each of the plurality of client software applications such as to render the composited first and second audio/video data elements in essentially the same state at essentially the same time.
  • In another example, a plurality of studio software applications may be provided, wherein each of the plurality of studio software applications may run on a respective one of a plurality of studio computers (see, e.g., studios 101A-101C of FIG. 1).
  • In another example, each of the plurality of studio computers may be operatively connected with the messaging server via the network such that the messaging software application receives at least one message from each of the plurality of studio software applications.
  • In another example, at least one message received by each of the plurality of client software applications from the messaging software application may be based at least in part upon at least one message received by the messaging software application from at least one of the plurality of studio software applications.
  • In another example, a plurality of messaging software applications may be provided, wherein each of the plurality of messaging software application may run on a respective one of a plurality of messaging servers, wherein each of the plurality of client devices may be operatively connected with at least one of the plurality of messaging servers via the network such that each of the plurality of client software applications receives at least one message from at least one of the plurality of messaging software applications, and wherein each of the plurality of studio computers may be operatively connected with at least one of the plurality of messaging servers via the network such that at least one of the plurality of messaging software applications receives at least one message from at least one of the studio software applications.
  • In another embodiment of the present invention a method for distributing audio/video convent via a network is provided, comprising: sending to a client software application at least one message, wherein the client software application runs on a client device (see, e.g., player components 105A-105C of FIG. 1), wherein the at least one message causes the client software application to access at least: i) a first audio/video data element and ii) a second audio/video data element, and wherein the at least one message causes the client software application to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at the client device; and receiving from the client software application at least one message, wherein the at least one message received from the client software application indicates at least one of: (a) a degree of access by the client software application to at least the first audio/video data element and to the second audio/video data element; (b) a degree of completion of the compositing together at least the first audio/video data element and the second audio/video data element; and (c) a degree of completion of rendering at least the composited first and second audio/video data elements.
  • In another example, the at least one message may be received at a studio software application from the client software application, and the studio software application may run on a studio computer (see, e.g., studios 101A-101C of FIG. 1).
  • In another example, at least one message may be received at the studio software application from the client software application via the network.
  • In another example, the at least one message may be received at the studio software application from the client software application directly.
  • In another example, the at least one message may be received at the studio software application from the client software application by passing through at least one intermediary server.
  • In another example, the steps may be carried out in the order recited.
  • Referring now to FIG. 2, a system architecture according to a conventional live Internet webcast is shown. As seen in this Fig., production studio 200 is utilized to mix audio/video signals from sources 201A-202D at mixer 203. The output of mixer 203 is feed to character generator 205. The output of character generator 205 is feed to web encoder 207. The output of web encoder 207 is feed to content delivery network 209 (which may include load balancing) and then on to viewers 211. Thus, the content is simply assembled at the source and streamed out.
  • In contrast to FIG. 2, FIG. 3 shows a system architecture according to an embodiment of the present invention in which each of remote producers 301A-301C utilizes associated studio 303A-303C to communicate via the Internet with broadcasting platform 302 in order to control what each of viewers 305 sees on an associated player component. Each of the player components may receive control messages from broadcasting platform 302, each of the player components may retrieve content from content sources 307 (e.g., as directed by the control messages), each of the player components may receive content from one or more of studios 303A-303C (e.g., via broadcasting platform 302) and/or each of the player components may receive content from broadcasting platform 302. Of note, broadcasting platform 302 is operatively connected to the Internet to communicate with the studios, the player components and/or the content sources. Similarly, each of the player components (which are not separately shown in the Fig.) is operatively connected to the Internet to communicate with broadcasting platform 302 and content sources 307.
  • Referring now to FIG. 4A, a web browser screenshot of a player component according to an embodiment of the present invention is shown. The player component may include one or more of the following:
      • Mail—send a message to one or more channel producers
      • Call—call one or more channel producers live with the viewer's webcam (a channel producer may put the calling viewers “on the air” live)
      • Chat—chat among viewers and producers
      • Guide—browse other channels available to the player component
      • Full screen
  • Referring now to FIGS. 4B-4F, web browser screenshots of a studio according to an embodiment of the present invention is shown.
  • With regard to these FIGS. 4B-4F, it is noted that use of the studio may, in one example, proceed as follows:
      • A producer logs onto a website with a channel name, a username and a password and clicks “Create New Channel”
      • The producer then selects “Configure The Channel” (see FIG. 4B), which may be a one-time process
      • The producer then selects “Get Content” (see FIG. 4C), which may comprise searching the Internet for images/audio/video from within the studio
      • The producer then selects “Create A Storyboard” (see FIG. 4D), which may comprise dragging the search results from the “Get Content” step into a storyboard within the studio
      • The producer then selects “Broadcast Live” (see FIGS. 4E and 4F), which may comprise using a live mixer or turning on an “auto-pilot”
  • More particularly, with regard to “Configure The Channel”, FIG. 4B shows a screenshot of how the producer of a newly created channel can pick a broadcast graphics template and customize and preview (not shown) the graphics. Such graphics may include (but not be limited to): Bug; Lower Third; Ticker; Over The Shoulder; Test Card. This configuration of a channel may, in one example, be a one-time process (similar to the way that some blog publishing software may let you choose and configure templates to establish an identity when you first launch your blog).
  • Further, with regard to “Get Content”, FIG. 4C shows a screenshot of how the producer of a newly created channel can search the Internet for images/audio/video from within the studio. The “Get Content” tab may allow users to easily type keywords and search integrated sources (e.g., AOL Video, Youtube, Google, etc.). The Search results may be streamed in. The user may preview any clip. The user may drag the clips into the user's storyboard in preparation for a live broadcast and/or play list loop. When the user drags the search results into a storyboard, the system of this embodiment may automatically download the files, transcode the files and post the files to the servers of the system (the user may see a progress bar). This FIG. 4C also shows some other example sources of audio/video content including (but not limited to): from the web; from a website; from another channel; from an online store; from the user's computer; from the user's webcam.
  • Further, with regard to “Create A Storyboard”, FIG. 4D shows a screenshot of how a storyboard may be used as a playlist for the auto-pilot and/or a guide to produce a live broadcast (similar to a script). In one example, the producer can go into the storyboard and: re-order clips; add notes useful to him and his fellow producers; and/or add text for the presenter to say while on camera (similar to a broadcast teleprompter). In addition, collaboration may be provided such that searches and/or storyboards are available in realtime to any producer logged into a given channel (e.g., if one producer adds text or re-orders a storyboard, all the other producers of that channel can seen the changes in realtime).
  • Further, with regard to “Broadcast Live”, FIG. 4E shows a screenshot of “Live Studio”, where producers mix live (when the channel is in “auto-pilot” mode a playlist may be automatically followed (in one example, the auto-pilot can be seen pressing the various buttons on the studio screen)). Of course, when auto-pilot is not turned on, the producer may mix in realtime.
  • In any case, in one example the basic process may be as follows:
      • The producer loads a storyboard on the left
      • The producer drags the clips into the bank for preview
      • The producer presses CUE
      • When the system is ready and the producer is ready the producer presses “Go Live”
      • The audio/video will then mix (cross fade) with the current output
      • The producer may then repeat as needed or turn on the auto-pilot as desired
  • Of note, the bottom-right of this FIG. 4E shows the following tabs:
      • Graphics—type in information (e.g., names and titles) and control how graphics transition on and off the screen
      • Sound—sound effects
      • Transitions—wipes and effects
      • Statistics—details about who is watching
      • Record—record your live show for re-broadcast
      • Chat—chat between logged-in producers (output shown at the middle top section)
  • Still referring to “Broadcast Live”, FIG. 4F shows another screenshot of “Live Studio”. As seen in this Fig., the producer has now selected the cameras tab on the left. Here the producer can see the cameras of all of the other producers logged-in for this channel. In one example, a producer can simply drag any webcam on the bank and make it live. In another example, viewers can call the channel. A switchboard tab may allow someone from the production team to select one or more viewers and put the selected viewer(s) in the camera list for live broadcast. A video mail functionality may be provided if a producer does not reply on-time to one or more calls (the viewer may be able to leave a message for future broadcast).
  • In another example, the architecture may be platform agnostic.
  • In another example, the architecture may work for cable operators, mobile operators, etc.
  • In another embodiment the present invention relates to a realtime shared production tool. In this regard, such a realtime shared production tool may comprise capabilities to have producers around the world controlling (e.g., mixing, etc.) together a single video channel in realtime. This may comprise a “virtual, global TV studio”.
  • In another embodiment the present invention relates to interactivity with viewers. In this regard, viewers may call the channel (e.g., in realtime) using audio/video (e.g., using the viewer's webcam and/or microphone), be selected by a switchboard and then be put through live on the channel (if the producers so decide).
  • In another example, the present invention may provide a single studio for each channel.
  • In another example, the present invention may provide a plurality of studios for each channel (in one specific example, there may be a “master” studio that takes precedence over the other studios associated with a given channel; in another specific example, there may be no “master” studio, such that none of the plurality of studios associated with a given channel takes precedence over the other).
  • Of note, regarding the case of a plurality of studios for each channel, as new studios become associated with a given channel, the new studio(s) may be synchronized with the existing studio(s).
  • In another example, a player component may comprise software (e.g., which may be run in a web browser) and the player component/browser may run on a desktop computer, a laptop computer, a PDA, a mobile phone, etc.
  • In another example, a player component may provide to the viewer no facility for a fast forward operation, a rewind operation or the like (similar to a conventional television).
  • In another example, each channel may be public or private (e.g., accessible only via invitation and/or through the use of a unername/password).
  • In another example, advertisements may be inserted into one or more channels. In one specific example the advertisements may be inserted on a set schedule (e.g., periodically, every 10 minutes). In another specific example, the advertisements may be targeted based upon channel content (e.g., a channel carrying sports content gets sports-related advertising; a channel carrying fashion content gets fashion-related advertising).
  • In another example, each of the studios and/or the player components may be an online Rich Internet Application built using ADOBE Flash/Flex/ActionScript 3 and no downloads may be required; further, each of the studios and/or the player components may be MAC/PC/LINUX compatible.
  • In another example, a .swf (a file created with ADOBE Flash/Flex/ActionScript 3 software) may be utilized to allow producers to put broadcast graphics on one or more desired channels.
  • As described above, one example of the present invention may provide a live streaming protocol (including control messages) for controlling one or more player components from one or more servers (wherein at least some of the content played by the player components(s) comes from source(s) different than the server(s) providing the control messages).
  • Further, as described above, another example of the present invention may provide for global distributed production/mixing (e.g., multiple studios at distinct remote locations providing control messages for a given channel to control one or more player components).
  • Further still, as described above, another example of the present invention may provide for quality of service (QoS) measurement and/or control. In one specific example, a channel server may receive feedback from one or more player components regarding when the player component(s) are ready to play content. In another example, a QoS engine may be integrated to ensure that all the player components remain in synchronization (e.g., late-arriving player components are synchronized with player components that are already being used at the time the late-arriving player components start). In another example, the synchronization may utilize state information. In another example, the synchronization may comprise predictive synchronization.
  • Further still, as described above, another example of the present invention may provide for interactive communication among the studio(s) and the player component(s).
  • Further still, as described above, another example of the present invention may provide users (e.g., producers) the ability to record instructions for broadcasting (see the “auto-pilot” discussed above) as one or more text files containing the necessary instructions.
  • Of note, the embodiments described herein may, of course, be implemented using any appropriate computer hardware and/or computer software. In this regard, those of ordinary skill in the art are well versed in the type of computer hardware that may be used (e.g., a mainframe, a mini-computer, a personal computer (“PC”), a network (e.g., an intranet and/or the Internet)), the type of computer programming techniques that may be used (e.g., object oriented programming), and the type of computer programming languages that may be used (e.g., C++, Basic, AJAX, Javascript, ADOBE Flash/Flex/ActionScript 3). The aforementioned examples are, of course, illustrative and not restrictive.
  • While a number of embodiments of the present invention have been described, it is understood that these embodiments are illustrative only, and not restrictive, and that many modifications may become apparent to those of ordinary skill in the art. For example, certain methods may have been described herein as being “computer implementable” or “computer implemented”. In this regard, it is noted that while such methods can be implemented using a computer, the methods do not necessarily have to be implemented using a computer. Also, to the extent that such methods are implemented using a computer, not every step must necessarily be implemented using a computer. Further, any desired number of studio(s), player component(s), channel server(s) and/or content provider server(s) may be associated with a given channel. Further still, any desired number of channels (and any desired number of associated producer(s) and/or associated viewer(s)) may be provided. Further still, the various steps may be carried out in any desired order (and any desired steps may be added and/or any desired steps may be eliminated).

Claims (20)

What is claimed is:
1. A system for distributing audio/video convent via a network, comprising:
a client software application, wherein the client software application runs on a client device; and
a messaging software application, wherein the messaging software application runs on a messaging server;
wherein the client device and the messaging server are operatively connected together via the network such that the client software application receives at least one message from the messaging software application;
wherein the at least one message causes the client software application to access at least: i) a first audio/video data element and ii) a second audio/video data element; and
wherein the at least one message causes the client software application to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at the client device.
2. The system of claim 1, wherein the client device comprises a client computer.
3. The system of claim 1, wherein the network comprises the Internet.
4. The system of claim 1, wherein the client software application accesses the first and second audio/video data elements via the network.
5. The system of claim 4, wherein the client software application accesses the first and second audio/video data elements from a content server.
6. The system of claim 4, wherein the client software application accesses the first audio/video data element from a first content server, wherein the client software application accesses the second audio/video data element from a second content server, and wherein the first content server is distinct from the second content server.
7. The system of claim 1, wherein the client software application accesses at least one of the first and second audio/video data elements by opening a data stream.
8. The system of claim 1, wherein the client software application accesses at least one of the first and second audio/video data elements by downloading.
9. The system of claim 1, further comprising a studio software application, wherein the studio software application runs on a studio computer.
10. The system of claim 9, wherein the studio computer and the messaging server are operatively connected together via the network such that the messaging software application receives at least one message from the studio software application.
11. The system of claim 10, wherein the at least one message received by the client software application from the messaging software application is based at least in part upon the at least one message received by the messaging software application from the studio software application.
12. The system of claim 1, wherein the messaging, compositing and rendering are carried out in essentially realtime.
13. A system for distributing audio/video convent via a network, comprising:
a plurality of client software applications, wherein each of the plurality of client software applications runs on a respective one of a plurality of client devices; and
at least one messaging software application, wherein the messaging software application runs on a messaging server;
wherein each of the plurality of client devices is operatively connected with the messaging server via the network such that each of the plurality of client software applications receives at least one message from the messaging software application;
wherein at least one of the messages cause each of the plurality of client software applications to access at least: i) a first audio/video data element and ii) a second audio/video data element; and
wherein at least one of the messages cause each of the plurality of client software applications to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at each respective one of the plurality of client devices.
14. The system of claim 13, wherein at least one message received by at least one of the plurality of client software applications is distinct from at least one message received by at least another of the plurality of client software applications.
15. The system of claim 13, wherein at least one message received by each of the plurality of client software applications synchronizes each of the plurality of client software applications such as to render the composited first and second audio/video data elements in essentially the same state at essentially the same time.
16. The system of claim 13, further comprising a plurality of studio software applications, wherein each of the plurality of studio software applications runs on a respective one of a plurality of studio computers.
17. The system of claim 16, wherein each of the plurality of studio computers is operatively connected with the messaging server via the network such that the messaging software application receives at least one message from each of the plurality of studio software applications.
18. The system of claim 17, wherein at least one message received by each of the plurality of client software applications from the messaging software application is based at least in part upon at least one message received by the messaging software application from at least one of the plurality of studio software applications.
19. The system of claim 17, further comprising a plurality of messaging software applications, wherein each of the plurality of messaging software application runs on a respective one of a plurality of messaging servers, wherein each of the plurality of client devices is operatively connected with at least one of the plurality of messaging servers via the network such that each of the plurality of client software applications receives at least one message from at least one of the plurality of messaging software applications, and wherein each of the plurality of studio computers is operatively connected with at least one of the plurality of messaging servers via the network such that at least one of the plurality of messaging software applications receives at least one message from at least one of the studio software applications.
20. A method for distributing audio/video convent via a network, comprising:
sending to a client software application at least one message, wherein the client software application runs on a client device, wherein the at least one message causes the client software application to access at least: i) a first audio/video data element and ii) a second audio/video data element, and wherein the at least one message causes the client software application to composite together at least: i) the first audio/video data element and ii) the second audio/video data element and to render at least the composited first and second audio/video data elements at the client device; and
receiving from the client software application at least one message, wherein the at least one message received from the client software application indicates at least one of: (a) a degree of access by the client software application to at least the first audio/video data element and to the second audio/video data element; (b) a degree of completion of the compositing together at least the first audio/video data element and the second audio/video data element; and (c) a degree of completion of rendering at least the composited first and second audio/video data elements.
US14/192,082 2007-02-02 2014-02-27 System and method for internet audio/video delivery Abandoned US20140181881A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US14/192,082 US20140181881A1 (en) 2007-02-02 2014-02-27 System and method for internet audio/video delivery
US15/190,555 US20160309236A1 (en) 2007-02-02 2016-06-23 System and method for internet audio/video delivery
US15/888,892 US20180227643A1 (en) 2007-02-02 2018-02-05 System and method for internet audio/video delivery
US16/180,418 US20190075366A1 (en) 2007-02-02 2018-11-05 System and method for internet audio/video delivery
US16/697,450 US20200099991A1 (en) 2007-02-02 2019-11-27 System and method for internet audio/video delivery

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US88792207P 2007-02-02 2007-02-02
US91340207P 2007-04-23 2007-04-23
US12/025,360 US8667160B1 (en) 2007-02-02 2008-02-04 System and method for internet audio/video delivery
US14/192,082 US20140181881A1 (en) 2007-02-02 2014-02-27 System and method for internet audio/video delivery

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/025,360 Continuation US8667160B1 (en) 2007-02-02 2008-02-04 System and method for internet audio/video delivery

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/190,555 Continuation US20160309236A1 (en) 2007-02-02 2016-06-23 System and method for internet audio/video delivery

Publications (1)

Publication Number Publication Date
US20140181881A1 true US20140181881A1 (en) 2014-06-26

Family

ID=50158903

Family Applications (6)

Application Number Title Priority Date Filing Date
US12/025,360 Active - Reinstated US8667160B1 (en) 2007-02-02 2008-02-04 System and method for internet audio/video delivery
US14/192,082 Abandoned US20140181881A1 (en) 2007-02-02 2014-02-27 System and method for internet audio/video delivery
US15/190,555 Abandoned US20160309236A1 (en) 2007-02-02 2016-06-23 System and method for internet audio/video delivery
US15/888,892 Abandoned US20180227643A1 (en) 2007-02-02 2018-02-05 System and method for internet audio/video delivery
US16/180,418 Abandoned US20190075366A1 (en) 2007-02-02 2018-11-05 System and method for internet audio/video delivery
US16/697,450 Abandoned US20200099991A1 (en) 2007-02-02 2019-11-27 System and method for internet audio/video delivery

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/025,360 Active - Reinstated US8667160B1 (en) 2007-02-02 2008-02-04 System and method for internet audio/video delivery

Family Applications After (4)

Application Number Title Priority Date Filing Date
US15/190,555 Abandoned US20160309236A1 (en) 2007-02-02 2016-06-23 System and method for internet audio/video delivery
US15/888,892 Abandoned US20180227643A1 (en) 2007-02-02 2018-02-05 System and method for internet audio/video delivery
US16/180,418 Abandoned US20190075366A1 (en) 2007-02-02 2018-11-05 System and method for internet audio/video delivery
US16/697,450 Abandoned US20200099991A1 (en) 2007-02-02 2019-11-27 System and method for internet audio/video delivery

Country Status (1)

Country Link
US (6) US8667160B1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180288467A1 (en) * 2017-04-03 2018-10-04 Smule, Inc. Audiovisual collaboration method with latency management for wide-area broadcast
CN109218808A (en) * 2017-06-30 2019-01-15 武汉斗鱼网络科技有限公司 A kind of method, apparatus and computer equipment of recorded video
US11310538B2 (en) * 2017-04-03 2022-04-19 Smule, Inc. Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227533B (en) * 2008-01-31 2011-09-14 华为技术有限公司 Apparatus and method for establishing audio conference connection
US10282391B2 (en) 2008-07-03 2019-05-07 Ebay Inc. Position editing tool of collage multi-media
US8893015B2 (en) 2008-07-03 2014-11-18 Ebay Inc. Multi-directional and variable speed navigation of collage multi-media
US8627192B2 (en) 2008-07-03 2014-01-07 Ebay Inc. System and methods for automatic media population of a style presentation
US8516063B2 (en) 2010-02-12 2013-08-20 Mary Anne Fletcher Mobile device streaming media application
US9129260B2 (en) * 2010-10-04 2015-09-08 Donald Kent Neary Methods and apparatus for submitting and reviewing auditions
US10291674B1 (en) * 2014-12-01 2019-05-14 CloudBoard, LLC Cloudboard news
WO2017218341A1 (en) 2016-06-17 2017-12-21 Axon Enterprise, Inc. Systems and methods for aligning event data
US11310554B2 (en) 2018-08-30 2022-04-19 Gideon Eden Processing video and audio streaming data
US20200077128A1 (en) * 2018-08-30 2020-03-05 Gideon Eden Digital streaming data systems and methods

Citations (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4466063A (en) * 1979-11-07 1984-08-14 U.S. Philips Corporation System intercommunication processor used in distributed data processing system
US5884046A (en) * 1996-10-23 1999-03-16 Pluris, Inc. Apparatus and method for sharing data and routing messages between a plurality of workstations in a local area network
US5996022A (en) * 1996-06-03 1999-11-30 Webtv Networks, Inc. Transcoding data in a proxy computer prior to transmitting the audio data to a client
US5999525A (en) * 1996-11-18 1999-12-07 Mci Communications Corporation Method for video telephony over a hybrid network
US20010042249A1 (en) * 2000-03-15 2001-11-15 Dan Knepper System and method of joining encoded video streams for continuous play
US20020097979A1 (en) * 2001-01-19 2002-07-25 Lowthert Jonathan E. Content with advertisement information segment
US20020143976A1 (en) * 2001-03-09 2002-10-03 N2Broadband, Inc. Method and system for managing and updating metadata associated with digital assets
US6466275B1 (en) * 1999-04-16 2002-10-15 Sportvision, Inc. Enhancing a video of an event at a remote location using data acquired at the event
US6487622B1 (en) * 1999-10-28 2002-11-26 Ncr Corporation Quorum arbitrator for a high availability system
US6505160B1 (en) * 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US6553404B2 (en) * 1997-08-08 2003-04-22 Prn Corporation Digital system
US20030122922A1 (en) * 2001-11-26 2003-07-03 Saffer Kevin D. Video e-mail system and associated method
US6605770B2 (en) * 2001-03-21 2003-08-12 Matsushita Electric Industrial Co., Ltd. Play list generation device, audio information provision device, audio information provision system, method, program and recording medium
US20030182315A1 (en) * 2002-03-21 2003-09-25 Daniel Plastina Methods and systems for processing playlists
US20030233650A1 (en) * 2002-06-18 2003-12-18 Microsoft Corporation Visual group interface for group connectivity
US20040017997A1 (en) * 2002-07-29 2004-01-29 Sonicblue, Inc Automated playlist generation
US20040103208A1 (en) * 2001-03-12 2004-05-27 Chung Randall M. Re-assembly of streaming files from separate connections
US20040186877A1 (en) * 2003-03-21 2004-09-23 Nokia Corporation Method and device for multimedia streaming
US20040221246A1 (en) * 2003-04-30 2004-11-04 Lsi Logic Corporation Method for use of hardware semaphores for resource release notification
US20050055716A1 (en) * 2002-04-15 2005-03-10 Universal Electronics Inc. System and method for adaptively controlling the recording of program material using a program guide
US20050108430A1 (en) * 2003-10-23 2005-05-19 Cisco Technology, Inc. Methods and devices for sharing content on a network
US20050198677A1 (en) * 1997-06-12 2005-09-08 Lewis William H. System for data management and on-demand rental and purchase of digital data products
US20050264648A1 (en) * 2004-05-25 2005-12-01 Victor Ivashin Local video loopback method for a multi-participant conference system using a back-channel video interface
US20060074750A1 (en) * 2004-10-01 2006-04-06 E-Cast, Inc. Prioritized content download for an entertainment device
US20060136597A1 (en) * 2004-12-08 2006-06-22 Nice Systems Ltd. Video streaming parameter optimization and QoS
US7114174B1 (en) * 1999-10-01 2006-09-26 Vidiator Enterprises Inc. Computer program product for transforming streaming video data
US20070061409A1 (en) * 2005-09-14 2007-03-15 Tobias Rydenhag User interface for an electronic device
US20070183741A1 (en) * 2005-04-20 2007-08-09 Videoegg, Inc. Browser based video editing
US20080016196A1 (en) * 2006-07-14 2008-01-17 Anthology Solutions, Inc. System and method for automatic storage and serving of digital content
US7428704B2 (en) * 2004-03-29 2008-09-23 Lehman Brothers Holdings Inc. Dynamic presentation generator
US7610607B1 (en) * 1999-02-19 2009-10-27 Chaincast Networks, Inc. Chaincast method and system for broadcasting information to multiple systems within the internet
US7743161B2 (en) * 2006-10-10 2010-06-22 Ortiva Wireless, Inc. Digital content buffer for adaptive streaming
US8090613B2 (en) * 2007-12-10 2012-01-03 Kalb Kenneth J System and method for real-time management and optimization of off-line advertising campaigns
US8516149B1 (en) * 2010-12-17 2013-08-20 Emc Corporation System for operating NFSv2 and NFSv3 clients with federated namespace

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7263710B1 (en) * 1999-12-31 2007-08-28 General Electric Company Medical diagnostic system with on-line real-time video training
US20060259607A1 (en) 2001-09-13 2006-11-16 Network Foundation Technologies, Llc System and method for distributing data over a computer network
US7035933B2 (en) 2001-09-13 2006-04-25 Network Foundation Technologies, Inc. System of distributing content data over a computer network and method of arranging nodes for distribution of data over a computer network
US20030233349A1 (en) * 2002-06-14 2003-12-18 Microsoft Corporation Media player system
US20060146765A1 (en) * 2003-02-19 2006-07-06 Koninklijke Philips Electronics, N.V. System for ad hoc sharing of content items between portable devices and interaction methods therefor
US20050203801A1 (en) * 2003-11-26 2005-09-15 Jared Morgenstern Method and system for collecting, sharing and tracking user or group associates content via a communications network
US20050286546A1 (en) * 2004-06-21 2005-12-29 Arianna Bassoli Synchronized media streaming between distributed peers
US7860923B2 (en) * 2004-08-18 2010-12-28 Time Warner Inc. Method and device for the wireless exchange of media content between mobile devices based on user information
US8166555B2 (en) * 2004-08-20 2012-04-24 Panasonic Corporation Content reproducing device and content preproducing method
US20060168624A1 (en) * 2004-11-22 2006-07-27 John Carney Method and system for delivering enhanced TV content
US20060168126A1 (en) * 2004-12-21 2006-07-27 Jose Costa-Requena Aggregated content listing for ad-hoc peer to peer networks
US20060143236A1 (en) * 2004-12-29 2006-06-29 Bandwidth Productions Inc. Interactive music playlist sharing system and methods
US9104669B1 (en) * 2005-03-28 2015-08-11 Advertising.Com Llc Audio/video advertising network
US7992171B2 (en) * 2006-09-06 2011-08-02 Qurio Holdings, Inc. System and method for controlled viral distribution of digital content in a social network

Patent Citations (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4466063A (en) * 1979-11-07 1984-08-14 U.S. Philips Corporation System intercommunication processor used in distributed data processing system
US6505160B1 (en) * 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US5996022A (en) * 1996-06-03 1999-11-30 Webtv Networks, Inc. Transcoding data in a proxy computer prior to transmitting the audio data to a client
US5884046A (en) * 1996-10-23 1999-03-16 Pluris, Inc. Apparatus and method for sharing data and routing messages between a plurality of workstations in a local area network
US5999525A (en) * 1996-11-18 1999-12-07 Mci Communications Corporation Method for video telephony over a hybrid network
US20050198677A1 (en) * 1997-06-12 2005-09-08 Lewis William H. System for data management and on-demand rental and purchase of digital data products
US6553404B2 (en) * 1997-08-08 2003-04-22 Prn Corporation Digital system
US7610607B1 (en) * 1999-02-19 2009-10-27 Chaincast Networks, Inc. Chaincast method and system for broadcasting information to multiple systems within the internet
US6466275B1 (en) * 1999-04-16 2002-10-15 Sportvision, Inc. Enhancing a video of an event at a remote location using data acquired at the event
US7114174B1 (en) * 1999-10-01 2006-09-26 Vidiator Enterprises Inc. Computer program product for transforming streaming video data
US6487622B1 (en) * 1999-10-28 2002-11-26 Ncr Corporation Quorum arbitrator for a high availability system
US20010042249A1 (en) * 2000-03-15 2001-11-15 Dan Knepper System and method of joining encoded video streams for continuous play
US20020097979A1 (en) * 2001-01-19 2002-07-25 Lowthert Jonathan E. Content with advertisement information segment
US7519273B2 (en) * 2001-01-19 2009-04-14 Blackarrow, Inc. Content with advertisement information segment
US20020143976A1 (en) * 2001-03-09 2002-10-03 N2Broadband, Inc. Method and system for managing and updating metadata associated with digital assets
US20040103208A1 (en) * 2001-03-12 2004-05-27 Chung Randall M. Re-assembly of streaming files from separate connections
US6605770B2 (en) * 2001-03-21 2003-08-12 Matsushita Electric Industrial Co., Ltd. Play list generation device, audio information provision device, audio information provision system, method, program and recording medium
US20030122922A1 (en) * 2001-11-26 2003-07-03 Saffer Kevin D. Video e-mail system and associated method
US20030182315A1 (en) * 2002-03-21 2003-09-25 Daniel Plastina Methods and systems for processing playlists
US20050055716A1 (en) * 2002-04-15 2005-03-10 Universal Electronics Inc. System and method for adaptively controlling the recording of program material using a program guide
US20030233650A1 (en) * 2002-06-18 2003-12-18 Microsoft Corporation Visual group interface for group connectivity
US20040017997A1 (en) * 2002-07-29 2004-01-29 Sonicblue, Inc Automated playlist generation
US20040186877A1 (en) * 2003-03-21 2004-09-23 Nokia Corporation Method and device for multimedia streaming
US20040221246A1 (en) * 2003-04-30 2004-11-04 Lsi Logic Corporation Method for use of hardware semaphores for resource release notification
US20050108430A1 (en) * 2003-10-23 2005-05-19 Cisco Technology, Inc. Methods and devices for sharing content on a network
US7428704B2 (en) * 2004-03-29 2008-09-23 Lehman Brothers Holdings Inc. Dynamic presentation generator
US20050264648A1 (en) * 2004-05-25 2005-12-01 Victor Ivashin Local video loopback method for a multi-participant conference system using a back-channel video interface
US20060074750A1 (en) * 2004-10-01 2006-04-06 E-Cast, Inc. Prioritized content download for an entertainment device
US20060136597A1 (en) * 2004-12-08 2006-06-22 Nice Systems Ltd. Video streaming parameter optimization and QoS
US20070183741A1 (en) * 2005-04-20 2007-08-09 Videoegg, Inc. Browser based video editing
US20070061409A1 (en) * 2005-09-14 2007-03-15 Tobias Rydenhag User interface for an electronic device
US20080016196A1 (en) * 2006-07-14 2008-01-17 Anthology Solutions, Inc. System and method for automatic storage and serving of digital content
US7743161B2 (en) * 2006-10-10 2010-06-22 Ortiva Wireless, Inc. Digital content buffer for adaptive streaming
US8090613B2 (en) * 2007-12-10 2012-01-03 Kalb Kenneth J System and method for real-time management and optimization of off-line advertising campaigns
US8516149B1 (en) * 2010-12-17 2013-08-20 Emc Corporation System for operating NFSv2 and NFSv3 clients with federated namespace

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180288467A1 (en) * 2017-04-03 2018-10-04 Smule, Inc. Audiovisual collaboration method with latency management for wide-area broadcast
CN110692252A (en) * 2017-04-03 2020-01-14 思妙公司 Audio-visual collaboration method with delay management for wide area broadcast
US11032602B2 (en) * 2017-04-03 2021-06-08 Smule, Inc. Audiovisual collaboration method with latency management for wide-area broadcast
US11310538B2 (en) * 2017-04-03 2022-04-19 Smule, Inc. Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics
US20230007313A1 (en) * 2017-04-03 2023-01-05 Smule, Inc. Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics
US11553235B2 (en) 2017-04-03 2023-01-10 Smule, Inc. Audiovisual collaboration method with latency management for wide-area broadcast
US11683536B2 (en) * 2017-04-03 2023-06-20 Smule, Inc. Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics
CN109218808A (en) * 2017-06-30 2019-01-15 武汉斗鱼网络科技有限公司 A kind of method, apparatus and computer equipment of recorded video

Also Published As

Publication number Publication date
US20190075366A1 (en) 2019-03-07
US20160309236A1 (en) 2016-10-20
US20200099991A1 (en) 2020-03-26
US8667160B1 (en) 2014-03-04
US20180227643A1 (en) 2018-08-09

Similar Documents

Publication Publication Date Title
US20200099991A1 (en) System and method for internet audio/video delivery
US20210174836A1 (en) Synthesizing a presentation of a multimedia event
US8112490B2 (en) System and method for providing a virtual environment with shared video on demand
US8874645B2 (en) System and method for sharing an experience with media content between multiple devices
US7996566B1 (en) Media sharing
JP5301425B2 (en) Group content presentation and system and method for organizing group communications during group content presentation
US8150918B1 (en) Client controllable server-side playlists
US11317125B2 (en) System and methods for integrated multistreaming of media with graphical overlays
US20060064644A1 (en) Short-term filmmaking event administered over an electronic communication network
US20080090590A1 (en) System and method for creating multimedia rendezvous points for mobile devices
US10757365B2 (en) System and method for providing and interacting with coordinated presentations
JP2003509928A (en) Advanced video programming system and method for providing a distributed community network
JP2015525496A (en) Real-time composite broadcasting system and method having a mechanism for adjusting a plurality of media feeds
US11457176B2 (en) System and method for providing and interacting with coordinated presentations
Chorianopoulos Content-enriched communication-supporting the social uses of TV
JP7290260B1 (en) Servers, terminals and computer programs
JP2004228707A (en) Contents providing system
Weisz Online Video as a Social Activity
Toussi Mobile vision mixer: a system for collaborative live mobile video production
WO2019036033A1 (en) System and method for providing and interacting with coordinated presentations
KR20070018472A (en) Intelligent interactive multimedia
Kim et al. Click2Movie: Personal-customized content authoring service in IPTV platform
Chorianopoulos Examining the Roles of Mobility in Social TV

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION