WO2000033197A1 - Method and apparatus for content-linking supplemental information with time-sequence data - Google Patents

Method and apparatus for content-linking supplemental information with time-sequence data Download PDF

Info

Publication number
WO2000033197A1
WO2000033197A1 PCT/SG1998/000096 SG9800096W WO0033197A1 WO 2000033197 A1 WO2000033197 A1 WO 2000033197A1 SG 9800096 W SG9800096 W SG 9800096W WO 0033197 A1 WO0033197 A1 WO 0033197A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
animation
time
video data
sequence data
Prior art date
Application number
PCT/SG1998/000096
Other languages
French (fr)
Inventor
Gurminder Singh
Vinod Vijayalekshmi Vasudevan
Original Assignee
Kent Ridge Digital Labs
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kent Ridge Digital Labs filed Critical Kent Ridge Digital Labs
Priority to AU15174/99A priority Critical patent/AU1517499A/en
Priority to PCT/SG1998/000096 priority patent/WO2000033197A1/en
Publication of WO2000033197A1 publication Critical patent/WO2000033197A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25883—Management of end-user data being end-user demographical data, e.g. age, family status or address
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2665—Gathering content from different sources, e.g. Internet and satellite
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H04N7/165—Centralised control of user terminal ; Registering at central
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application

Definitions

  • the present invention is directed to the field of delivering animation, audio and video data via broadcasting or network mechanisms, and in particular to systems for providing value-added content to animation, audio and video programming.
  • a significant disadvantage of such conventional systems is that they do not permit a service provider, who offers audio, animation and video data services, to associate additional information with the programming and provide the two without interfering with the programming production process.
  • Existing systems also fail to provide additional information with the digital media content without changing the way in which the content is produced, stored, and/or distributed.
  • a method for presenting supplemental information and/or action with time-sequence data.
  • the time-sequence data can be animation, audio, and/or video data.
  • the method includes the steps of: providing time-sequence data; separately providing supplemental information, action, or both, from the time-sequence data; and linking the supplemental information, action, or both, with the time-sequence data during playback of the time-sequence data.
  • the supplemental information and/or action is linked with the time-sequence data by a start time and a stop time, or a start time and a duration period.
  • the supplemental information and/or action can be linked with the time- sequence data by annotation information associated with the time-sequence data.
  • the supplemental information and/or action can be linked with the time- sequence data using on-the-fly content analysis of the time-sequence data during playback of the latter.
  • the supplemental information and/or action is content-linked with the time sequence data.
  • the time-sequence data can be provided by broadcast or via a network.
  • the supplemental information and/or action is preferably provided remotely via a network. It can include a displayed prompt with which a user can interact by user input and a link to a remote location.
  • the link is more preferably a universal resource locator (URL).
  • the following mechanisms can also be provided remotely via a network.
  • the time-sequence data and the supplemental information and/or action are linked by a link mechanism.
  • Two or more of the link mechanism, the time-sequence data, and the supplemental information and/or action are initially co-located at their source.
  • two or more of the link means, the time-sequence data, and the supplemental information and/or action are initially remotely located at one or more source locations.
  • an apparatus for presenting supplemental information and/or action with time-sequence data.
  • the apparatus includes: a device for providing time-sequence data; a device for separately providing supplemental information and/or action from the time-sequence data; and a device for linking the supplemental information and/or action with the time-sequence data during playback of the time-sequence data.
  • a computer program product having a computer readable medium having a computer program recorded therein for presenting supplemental information and/or action with time-sequence data.
  • the computer program includes: a module for providing time-sequence data; a module for separately providing supplemental information and/or action from the time- sequence data; and a module for linking the supplemental information and/or action with the time-sequence data during playback of the time-sequence data.
  • Fig. 1 A is a timing diagram graphically depicting a linked combination of time- sequence data and supplemental information and/or action in accordance with embodiments of the invention
  • Fig. IB is a timing diagram illustrating the linked relationship of exemplary video, animation and/or audio data and four advertisements in accordance with embodiments of the invention
  • Fig. 2 is a block diagram illustrating the functional modules of an apparatus for presenting supplemental information, action, or both, with time-sequence data in accordance with the a embodiment
  • Fig. 3 is a block diagram illustrating a variation of the apparatus according to the first embodiment shown in Fig. 2;
  • Fig. 4 is a graphical depiction of an exemplary application of the embodiments where a video is displayed on a monitor with a corresponding advertising banner;
  • Fig. 5 is a high-level flow diagram of a method of delivering supplemental information and/or action with time-sequence data in accordance with the first embodiment of the invention
  • Fig. 6 is a flow diagram of a method of providing value-added content related to at least one of animation, audio and video data, in the process of presenting the animation, audio, and/or video data to a user in accordance with a second embodiment of the invention
  • Fig. 7 is a flow diagram of a method of distributing advertisements with animation, audio and/or video data delivered for presentation by way of broadcast or streaming over a network in accordance with a third embodiment of the invention.
  • Figs. 8A-8E are detailed flow diagrams of a method of presenting advertisements in association with video or movie in accordance with a fourth embodiment of the invention.
  • Fig. 1 A is a timing diagram illustrating a linked combination 100 of time-sequence data 110 and supplemental information and/or action 120, 122, 124. Three portions 120, 122, 124 are linked for presentation with the time-sequence data. Essentially numerous forms of supplemental information and/or actions can be linked to the time-sequence data using the embodiments of the invention described herein.
  • the embodiments can also provide "actions", which in broad terms denotes any additional functionality provided to the user.
  • This can be implemented as a computer program such as a Java applet that can be executed by a computer displaying time-sequence data.
  • Exemplary actions include functionality for conducting surveys or for changing time-sequence data.
  • the embodiments enable video service providers such as cable and broadcast television service providers to add controllably and on-the-fly added- value content to their video product by tightly linking advertisements to the subject- matter content of the video product.
  • video service providers such as cable and broadcast television service providers
  • the video with content-linked supplemental information and/or actions can be readily differentiated from normal broadcast video, for example.
  • the supplemental information and/or actions are provided via a network, preferably an electronic network such as the Internet or an Intranet.
  • Fig IB is a timing diagram illustrating the linked relationship 150 between a video, animation and/or audio program 160 and four advertisements 162, 164, 166, 168.
  • Additional advertisement content may be available at a remote location on a network and be accessed by a link (e.g. URL) in the advertisement.
  • the estimation 150 includes overlapping advertisements, namely first and third advertisements 162 and 166 on the one hand and the second advertisement 164 on the other.
  • One or more of the video, animation and/or audio data, the supplemental information and/or action, and linking mechanisms or controls for linking the content data with the supplemental information and/or action can be distributed via a network. Further, they may be obtained from two or more different sources on the network.
  • a video content provider can provide the video programming via the Internet from a first source site, the supplemental information and/or action from another source site, and the linking control database from yet another site.
  • the video programming may be available locally at a user's location while the other components are delivered via a network, or vice versa.
  • FIG. 4 is a depiction of an exemplary application 400 of the embodiments where a video 420 is displayed with a corresponding advertising banner 430.
  • the video data 420 is displayed in a panel of the graphical operating system 410 (e.g. Microsoft Windows 95 or 98).
  • the exemplary portion of the video 420 is currently displaying a well-known water fountain at Sentosa Island in Singapore.
  • an advertisment 430 is presented within the same panel. It will be readily appreciated that the advertisment 430 need not be presented in the same window.
  • the advertisment 430 is presented as a banner referring to "Destination Sentosa: Experience it all... " A user can click on the banner 430 while it is displayed, and further supplemental information and/or action can be obtained. For example, an advertisement 440 about Sentosa Island (shown in the background) can be retrieved via a URL of the banner 430 to download the advertisement 440 from a site on the Internet.
  • the advertisements can be directly linked to such video content.
  • An advertiser can make direct reference in the advertisement to props in the video including articles of clothing, jewelry and accessories worn by particular actors in a scene.
  • the advertiser can also make reference to items such as furniture, wallpaper and appliances.
  • the foregoing applies to virtually anything visibly and/or audibly perceptible in the video.
  • the advertisement content-linked to the video can bring an item in the video to the viewer's attention and provide a way of making a purchase by the viewer using electronic commerce, for example.
  • the video can be streamed over an electronic network to a user's personal computer with video display capabilities.
  • the video itself can be displayed in a window in a graphical operating system such as Microsoft Windows 95 (Trade Mark) running on a conventional personal computer, laptop computer, or work station.
  • a banner or other graphical presentation containing information associating the banner with the content of the video.
  • the banner might be displayed in a separate window.
  • the banner can refer to a dress worn by an actress in the current video content as being sold by a particular advertiser.
  • the banner can obtain further information about the dress or purchase it.
  • the information obtained in this manner can be obtained remotely or in appropriate cases locally.
  • the banner displays an HTML link to a remote site to which the user's personal computer is connectable by means of the Internet. From the advertiser's remote site, further information about the dress can be obtained including how to purchase it using electronic commerce or by telephone purchase.
  • a video track can be played on a display device such as a television receiver with touch-screen functionality.
  • a set topbox associated with cable television services, for example
  • An action can be displayed via the set topbox with the video on the television receiver, whereby the relevant action can be chosen from a banner or the like displayed with the video.
  • the subject matter content of the displayed video can be a documentary about bears and include material on bears in Alaska.
  • a banner displayed in association with the video can show a message indicating that a related program about Alaska is currently available for viewing.
  • an action is carried out causing the displayed programming to change to the related program about Alaska without the user having to manually select the particular station.
  • an audio track received by a tuner/receiver provided in a personal computer can be audibly output by the personal computer.
  • supplemental information and/or action can be displayed on the personal computer.
  • the subject matter of the audio segment might involve discussion about some form of on-going audience survey, and an appropriate prompt can be displayed on the personal computer dependent upon the audio content. By clicking on the prompt, the user can interactively participate in the survey over the Internet. Numerous other applications can be envisaged by those skilled in the art in view of the disclosure of the embodiments herein.
  • the embodiments of the invention are able to strongly link supplemental information and/or actions including advertising with the content of time- sequence data including animation, audio and video. Further, the embodiments of the invention enable flexible control of the flow of the supplemental information and/or action and its content. For example, the embodiments of the invention enable flexible control of the flow of advertising in relation to an animation, audio and/or video sequence and the content of the advertising itself. Still further, the embodiments of the invention in particular applications enable close linkage of electronic commerce with the content of the time- sequence data.
  • the embodiments of the invention are able to differentiate time-sequence data from conventional broadcast time-sequence data by providing a content-based linkage with the supplemental information, action or both. Further, the embodiments provide a non-interfering mechanism for providing the supplemental information, action or both with respect to both the time-sequence data itself and the delivery mechanism used to deliver the time-sequence data. That is, no modification of the time-sequence data or its delivery mechanism is required. All existing time-sequence data can be used. For example, a video delivered on demand over a network to an end-user does not require any modification and can be sourced from a digital video disc (DVD) without change or embedding additional information prior to transmission.
  • DVD digital video disc
  • the embodiments support customised and focused content-linking of supplemental information, action, or both to the time-sequence data. This is particularly advantageous where the supplemental information, action or both relates to advertising.
  • the embodiments of the invention enable full, on-the-fly or "realtime" control over the content, sequencing and timing of the supplemental information, action, or both, delivered to the user in conjunction with the time- sequence data.
  • advertisers for example can have full and realtime control over the advertisement content. Customised advertising can therefore be supported.
  • embodiments of the invention permit a video program to be delivered via a network on demand or on a pre-scheduled basis to viewers.
  • Sponsors of the program or advertisers can buy slots, both in terms of time-length as well as the time position in the video program.
  • the sponsor or advertiser can provide HTML, XML, or other format advertisements that appear on the viewer's display device (e.g. a personal computer).
  • the sponsor or advertiser can have full control over their advertisement content, whereas the advertisement length and position can be pre-negotiated and controlled by the delivery service provide (e.g. cable service provider).
  • the sponsor or advertiser provides a URL from where their advertisement content can be retrieved or downloaded.
  • An advertisement delivered in this manner can provide a link to the sponsor's or advertiser's electronic commerce facility via a network or provide other means of conducting business.
  • the latter might include providing a phone number to call for telephone transactions or the like.
  • a call centre can be contacted using video, audio or text communication.
  • Fig. 5 is a high-level flow diagram illustrating a method of delivering supplemental information, action, or both, with time-sequence data in accordance with a first embodiment of the invention.
  • Processing commences in step 500.
  • time sequence data is provided.
  • the time-sequence data can include one or more of animation, audio and video data or programming.
  • the time-sequence data can be provided by broadcast or via a network.
  • supplemental information and/or action is provided separately from the time-sequence data. Examples of the supplemental information and/or action include a universal resource locator (URL) to a remote site via a network, an interactive program, an icon, or an advertisement banner.
  • URL universal resource locator
  • the supplemental information and/or action is linked with the time- sequence data during or immediately before playback of the time-sequence data.
  • the supplemental information and/or action is preferably provided remotely via a network.
  • the supplemental information and/or action can include a link to a remote location, and in particular, a universal resource locator (URL). It can also include a displayed prompt with which user can interact by user input.
  • URL universal resource locator
  • the supplemental information and/or action can be linked with the time-sequence data by means of a start time and a stop time, or a start time and a specified duration.
  • the supplemental information and/or action can be linked with the time- sequence data by means of annotation information associated with the time-sequence data.
  • the supplemental information and/or action can be linked with the time-sequence data, which is dependent upon on-the-fly content analysis of the time- sequence data during playback of the latter. This may be done using any of a number of known image/video/audio segmentation, recognition and analysis techniques well known to those skilled in the art.
  • the supplemental information and/or action is content-linked with the time sequence data.
  • step 508 the time-sequence data and the supplemental information and/or action is presented to an audience.
  • presentation can be implemented using a display monitor of a personal computer, a television receiver, a video monitor or the like.
  • the audio data i.e. time sequence data
  • a personal computer e.g. Web radio
  • the supplemental information and/or action can be presented on a personal computer, a video monitor, or the like.
  • the time-sequence data and the supplemental information and/or action are linked by a link. At least two of the link, the time-sequence data, and the supplemental information and/or action can be initially co-located at their source. Alternatively, two or more of the links, the time-sequence data, and the supplemental information and/or action can be initially remotely located at one or more remote source locations of the network. In step 510, processing terminates.
  • the first embodiment of the invention depicted in Fig. 5 is implemented as software or a computer program for presenting supplemental information and/or action with time-sequence data.
  • the software including a Java applet can be run on a computer such as a personal computer or workstation, or Java virtual machine, for example, well known to those skilled in the art.
  • the computer program can be recorded on a computer readable medium and used in combination with the computer as a computer program product.
  • the steps of Fig. 5 can be implemented as modules of software containing operations or instructions to implement the functionality.
  • the functionality of Fig. 5 can be implemented electronically (e.g. in an application specific integrated circuit ASIC).
  • Fig. 2 is a block diagram illustrating the functional modules of an apparatus 200 for presenting supplemental information, action, or both, with time-sequence data in accordance with the first embodiment.
  • time-sequence data including video, animation and/or audio data 210 are provided by broadcast or via an electronic network. Alternatively, the data 210 may be provided locally.
  • one or more linking mechanisms 220 is provided separately from the time-sequence data 210.
  • Two or more linking mechanisms 220 are referred to in Fig. 2 as a database (DB) of linking mechanisms.
  • the linking mechanism database can be prepared by video, animation, and/or audio content provider or the operator.
  • Supplemental information and/or action (or value added content) 230 is also provided.
  • a linking mechanism 220 is a predefined data structure containing parameters of particular supplemental information and/or action 230 for presentation with a particular portion of the time-base data 210.
  • the database 220 is database of advertisement controls, and the supplemental information and/or action 230 is one or more advertisements.
  • One or more of the video, animation and/or audio data 210, the supplemental information and/or action 230 and linking mechanisms or controls 220 for linking the content data 210 with the supplemental information and/or action 230 can be distributed via one or more communication media 260. Further, they may be obtained from two or more different sources such as two or more sites on the Internet, or the video can be delivered via a cable television network. Other combinations are possible. While single-headed arrows are depicted in Fig. 2, it will be reading appreciated from the disclosure that communication between the components of Fig. 2 may be bidirectional.
  • the time-sequence data 210, link mechanisms 220 and supplemental information and/or action 230 are provided to a playback controller and/or interpreter PCI 240.
  • the PCI 240 merges the video, animation and/or video data 210 and the supplemental information and/or action 230 for presentation on an appropriate presentation device ("display") 250.
  • the PCI240 has a cache for storing linking mechanisms 220. It also preferably has a cache for storing supplemental information and/or action 230.
  • the apparatus 200 can be implemented using a general-purpose computer or electronically.
  • advertisements slots can be both in terms of time-length as well as the time-position in the video program.
  • the advertisers can present their HTML/XML/other-formats advertisements on a viewer's display 250.
  • advertisement content can be downloaded.
  • An advertisement can provide a link to the advertiser's e-commerce facility, or provide other means of conducting business. This gives advertisers full-control over their advertisement content, while the advertisement length and position is pre-negotiated and controlled by the video service provider.
  • An example entry in the linking mechanism database or advertisement control database is:
  • the PCI 240 displays the video information 210 and starts interpreting the advertisement control 220.
  • the PCI 240 fetches the advertisement content from the specified address, which is defined in the advertisement control 220 along with the timing information.
  • the embodiment can be practiced using annotation to link the data 210 with the supplemental information and/or action 230.
  • the advertisement content is displayed using the display or presentation device 250 (or the advertisement content can also be pre-fetched).
  • the PCI 240 stops the display of the advertisement content when its duration has expired.
  • the format of the linking mechanism database or advertisement control database 220 has a format designed to be easy to produce, modify and maintain. It should also be efficient for transmission purposes and be extensible. Exemplary fields for the format are:
  • the PCI 240 executes the database of linking mechanisms or advertisement control database 220, the PCI 240 is developed hand-in-hand with the format of a linking mechanism or advertisement control. In addition, so that more features can be added to the PCI 240, the PCI 240 should be well structured and extensible.
  • the address of the link mechanism database or the advertisement control database 220 is transmitted with the initialization information.
  • Fig. 3 is a block diagram illustrating a variation 300 of the apparatus 200 shown in Fig. 2.
  • like features in Figs. 2 and 3 are identified with the same reference numerals. Only differing elements or features are identified with numerals of the format 3XX.
  • video, animation and audio 210 is provided to an on- the-fly content analyser 310 forming part of the apparatus 300.
  • the content analyser 310 is connected to the PCI 240, and preferably forms part of the PCI 240.
  • the content analyser 310 can be used to determine the linking of the supplemental information and/or action with the video, animation and/or audio data 210, either entirely on its own or in combination with the linking mechanisms 220.
  • a dashed-line arrow extends between the communication media 260 and the content analyser 310. This arrow indicates that optionally the video, animation and/or audio data 210 can be delivered directly to the content analyser 310 without passing through the PCI 240 first. This might be done where the content analyser operates completely independently or to reducing data processing via the PCI 240 to the content analyser 310.
  • Fig. 6 is a flow diagram of a method of providing value-added content related to at least one of animation, audio and video data, in the process of presenting the animation, audio, and/or video data to a user in accordance with a second embodiment of the invention.
  • Processing commences in step 600.
  • step 602 animation, audio, and/or video data or programming is delivered for presentation to a user.
  • step 604 the value-added content is provided separately from the animation, audio and/or video data.
  • the value-added content is preferably an advertisement and can include a universal resource locator (URL).
  • URL universal resource locator
  • the value-added content can include additional functionality, services and information.
  • the value-added content may include a set of instructions for performing operations on a local apparatus or a remote apparatus linked with the local apparatus by a network.
  • the local apparatus can be a personal computer or the like connected to the Internet, and the remote apparatus can be a site on the Internet.
  • a linking mechanism or structure is provided, separate from the animation, audio, and/or video data, which can link the value-added content with the animation, audio, and/or video data in a controllable and on-the-fly manner prior to presentation of the animation, audio, and/or video data and the value-added content.
  • the linking mechanism can include a start time and a stop time of the value-added content in relation to the animation, audio, and/or video data, as well as an indicator of the location of the value-added content.
  • the linking mechanism can include an annotation associated with the animation, audio, and/or video data. More preferably, the linking mechanism is dependent upon the content the animation, audio, and/or video data.
  • step 608 the animation, audio, and/or video data and the value-added content are presented to the user.
  • the value-added content can be presented separately in a device for reproducing the animation, audio and/or video data, such as a television or video monitor. Alternatively, it can be presented in or on the animation, audio and video data in a device for reproducing the animation, audio and video data. Processing terminates in step 610.
  • the process of Fig. 6 can be implemented as an apparatus and/or a computer program product.
  • Fig. 7 is a flow diagram of a method of distributing advertisements with animation, audio and/or video data delivered for presentation by way of broadcast or streaming over a network in accordance with a third embodiment of the invention.
  • Processing commences in step 700.
  • animation, audio and/or video data is delivered for presentation.
  • an advertisement related to the animation, audio and/or video data is provided separately.
  • the advertisement is capable of connecting a user with a remote location via a network by user interaction with the advertisement.
  • one or more advertisement control links are provided for linking separate advertisements with the animation, audio and/or video data.
  • the advertisement is presented to a user during presentation of the animation, audio and/or video data dependent upon the advertisement control link.
  • the method includes a step (not shown) of vending a product or service by means of electronic commerce or contacting a call centre dependent upon the advertisement. Processing terminates in step 710.
  • Figs. 8 A to 8E are a detailed flow diagram of a method of displaying advertisements in association with a movie or video in accordance with a fourth embodiment of the invention.
  • the flow diagram illustrates many specific details, however, those skilled in the art will appreciate that numerous changes can be made to the process without departing from the scope and spirit of the invention.
  • detailed steps of a process involving video or movies is set forth, the process can be readily adapted for application in relation to audio and/or animation data in view of the disclosure herein.
  • processing commences in step 800.
  • an identifier e.g. a title
  • the sources of the movie/video and the advertisement control database are determined.
  • the advertisement control database is opened.
  • a panel in a graphical computing environment e.g. Microsoft Windows 98
  • the current list of advertisements is set to null.
  • a panel is also created for displaying the movie or video. The movie preferably plays in this panel as a separate thread.
  • three separate threads are carried out preferably substantially in parallel by the operating system.
  • Fig. 8B is a flow diagram of a thread for handling incoming advertisement controls and advertisements.
  • the advertisement controls and advertisements are streamed for presentation of the advertisements to a viewer.
  • the media time of the movie is obtained from the media player.
  • a cache storing advertisement controls is updated.
  • the locations of new advertisements are obtained from the updated advertisement control data cache.
  • the advertisement cache is updated by streaming the advertisements for the current portion of the movie playing and for an additional predefined period yet to be played.
  • decision block 820 a check is made to determine if the advertisement update thread (Fig. 8C) or the movie playing thread has ended. If decision block 820 returns false (NO), processing continues at step 812. Otherwise, if decision block 820 returns true (YES), the thread terminates in step 822.
  • Fig. 8B can be readily implemented for handling the use of annotations to link the advertisements and the movie.
  • the annotations of the movie can be obtained for the currently playing portion of the movie and a few annotations read ahead for a portion(s) of the movie yet to be played.
  • the annotations in the movie are then matched with the annotations of the advertisements in the advertisement control data cache.
  • the locations of the advertisements are determined in this manner.
  • the advertisements are then streamed to update the advertisement cache.
  • Fig. 8C is a flow diagram of the process of presenting advertisements while a movie is playing.
  • the advertisements are updated.
  • step 826 the media time of the player presenting the movie is read.
  • step 828 using the media time, a start time and an end time of a current advertisement(s), a check is made to determine if any advertisements have to be removed.
  • This step can be readily modified to handle the case where annotation is used to link advertisements with the movie. This involves comparing the annotation of the movie with the annotation of the advertisement. The advertisement is to be played for the duration of the matching movie annotation.
  • Decision block 830 determines this result. If decision block 830 returns false (NO), processing continues at step 834. Otherwise, if decision block 830 returns true (YES), the advertisement being processed is removed from the advertisement panel created in step 806. Processing then continues in step 834.
  • step 834 using the media time, advertisements are selected from the advertisement cache to be made current.
  • decision block 836 a check is made to determine if any advertisements should be added for presentation. If decision block 836 returns false (NO), processing continues at decision block 840. Otherwise, if decision block 836 returns (YES), processing continues at step 838.
  • step 838 the advertisement is added to the advertisement panel created in step 806 for presentation. Processing continues at decision block 838.
  • decision block 840 a check is made to determine if the movie has ended or if the user has stopped play. If decision block 840 returns false (NO), processing continues at step 826. Otherwise, if decision block 840 returns true (YES), processing continues at step 842. In step 842, the player software application is closed or terminated and the advertisement control database is closed. Processing of this thread terminates in step 844.
  • Fig. 8D is a flow diagram of the process of playing a movie.
  • step 848 user inputs including fast forward, rewind, etc., are received and responded to by the player.
  • decision block 850 a check is made to determine if the end of the movie has been reached or it has been user terminated. If decision block 850 returns false (NO), processing continues at step 848. Otherwise, if decision block 850 returns true (YES), the thread terminates in step 852.
  • Fig. 8E is a flow diagram illustrating the processing of interactive user input in relation to a playing advertisement. Processing commences in step 870. In step 874, input can be received from a user. In step 876, the thread responds to the user input and performs an appropriate action as defined in the advertisement control database for the advertisement. In decision block 878, a check is made to determine if the advertisement has been removed from the advertisement panel. If decision block 878 returns false (NO), processing continues at step 874. Otherwise, if decision block 878 returns true (YES), the thread terminates in step 880. Thus, Figs. 8A-8E provide specific implementation details of one particular application of the fourth embodiment in relation to movie or video data.
  • the process can be practiced with readily apparent changes in view of the disclosure for processing animation and/or audio data.
  • This embodiment is able to strongly link advertising with the content of animation, audio and/or video data.
  • it enables flexible control of the flow of the advertisement and the advertisment content.
  • the process of Figs. 8A-8E provides the advertisment for presentation to a user without requiring any modification of the movie itself and the delivery mechanism used to deliver the movie.
  • the fourth embodiment enables customised and focused content- linking of advertising to the time-sequence data.
  • the foregoing embodiments of the invention disclose a method, apparatus and computer program product for linking supplementary information, actions, or both, to time-sequence data dependent upon the content of the time-sequence data.
  • the time- sequence data include animation, audio and/or video data.

Abstract

A method, apparatus and computer program product are disclosed for linking supplemental information and/or actions (120-124) on-the-fly with animation, audio and/or video data (110) for presentation, dependent upon the content of the animation, audio and/or video data (110). The supplemental information and/or actions (120-124) are preferably advertisements and means of electronic commerce linked on the fly with the animation, audio and/or video data (110). In this manner, advertisements (162-168) can be flexibly and controllably delivered in combination with the animation, audio and/or video data (160). The latter may be delivered by broadcasting or by streaming over an electronic network. The animation, audio and/or video data (210), advertisements (230) and an advertisement control database (220) containing linking mechanisms or structures are provided to a playback controller and/or interpreter (240), which can be implemented using a personal computer or a set topbox, prior to being displayed on a display or other presentation mechanism (250). The user can interact with the supplemental information and/or action (250).

Description

METHOD AND APPARATUS FOR CONTENT-LINKING SUPPLEMENTAL
INFORMATION WITH TIME-SEQUENCE DATA
FIELD OF THE INVENTION The present invention is directed to the field of delivering animation, audio and video data via broadcasting or network mechanisms, and in particular to systems for providing value-added content to animation, audio and video programming.
BACKGROUND With the rapid advent of technologies such as digital multimedia, broadband networking, video on demand, and the Internet, large volumes of audio, animation and video data or programming are readily available to the public. This programming can be delivered to an audience by a multitude of ways including broadcasting, on-demand type systems, etc. However, there are not adequate mechanisms to distinguish programming distributed in this fashion from traditional forms such as broadcast television or screened movies.
There are several known systems which offer video-on-demand and pay per-view services. These systems afford an opportunity for serving the audience with additional information about the programming. Existing mechanisms require the user to actively request any additional information. However, these mechanisms have a number of drawbacks. A first disadvantage is that a user must have adequate knowledge of their own to request any additional information. The information is not associated with the content of the programming. Still further, there is no guarantee that the user will request and view the additional information that is available. This is a major impediment, particularly in advertising.
In existing methods for normal TV broadcast situations to systems such as Synchronised Multimedia Integration Language (SMIL), Microsoft Netshow, MPEG- 4, etc., the programming is required to be created, or packaged, afresh along with the associated information into a single entity. This has a number of disadvantages including a lack of flexibility and programmable control. Further, it cannot be done on the fly. If the associated information changes, the entire package must be redone. That is, additional information cannot be changed with online digital content or broadcast material in current formats, unless there is a repackaging and/or format conversions.
Thus, a significant disadvantage of such conventional systems is that they do not permit a service provider, who offers audio, animation and video data services, to associate additional information with the programming and provide the two without interfering with the programming production process. Existing systems also fail to provide additional information with the digital media content without changing the way in which the content is produced, stored, and/or distributed.
SUMMARY The following aspects of the invention are directed to ameliorating or overcoming one or more disadvantages of conventional systems including those described above.
In accordance with a first aspect of the invention, a method is provided for presenting supplemental information and/or action with time-sequence data. The time-sequence data can be animation, audio, and/or video data. The method includes the steps of: providing time-sequence data; separately providing supplemental information, action, or both, from the time-sequence data; and linking the supplemental information, action, or both, with the time-sequence data during playback of the time-sequence data.
Preferably, the supplemental information and/or action is linked with the time-sequence data by a start time and a stop time, or a start time and a duration period. Alternatively, the supplemental information and/or action can be linked with the time- sequence data by annotation information associated with the time-sequence data. Yet further, the supplemental information and/or action can be linked with the time- sequence data using on-the-fly content analysis of the time-sequence data during playback of the latter. Preferably, the supplemental information and/or action is content-linked with the time sequence data. The time-sequence data can be provided by broadcast or via a network. The supplemental information and/or action is preferably provided remotely via a network. It can include a displayed prompt with which a user can interact by user input and a link to a remote location. The link is more preferably a universal resource locator (URL). The following mechanisms can also be provided remotely via a network.
Preferably, the time-sequence data and the supplemental information and/or action are linked by a link mechanism. Two or more of the link mechanism, the time-sequence data, and the supplemental information and/or action are initially co-located at their source. Alternatively, two or more of the link means, the time-sequence data, and the supplemental information and/or action are initially remotely located at one or more source locations.
In accordance with another aspect of the invention, an apparatus is provided for presenting supplemental information and/or action with time-sequence data. The apparatus includes: a device for providing time-sequence data; a device for separately providing supplemental information and/or action from the time-sequence data; and a device for linking the supplemental information and/or action with the time-sequence data during playback of the time-sequence data.
In accordance with yet another aspect of the invention, a computer program product is provided having a computer readable medium having a computer program recorded therein for presenting supplemental information and/or action with time-sequence data. The computer program includes: a module for providing time-sequence data; a module for separately providing supplemental information and/or action from the time- sequence data; and a module for linking the supplemental information and/or action with the time-sequence data during playback of the time-sequence data. BRDEF DESCRIPTION OF THE DRAWINGS
Embodiments of the invention are described hereinafter with reference to the drawings, in which:
Fig. 1 A is a timing diagram graphically depicting a linked combination of time- sequence data and supplemental information and/or action in accordance with embodiments of the invention;
Fig. IB is a timing diagram illustrating the linked relationship of exemplary video, animation and/or audio data and four advertisements in accordance with embodiments of the invention;
Fig. 2 is a block diagram illustrating the functional modules of an apparatus for presenting supplemental information, action, or both, with time-sequence data in accordance with the a embodiment;
Fig. 3 is a block diagram illustrating a variation of the apparatus according to the first embodiment shown in Fig. 2;
Fig. 4 is a graphical depiction of an exemplary application of the embodiments where a video is displayed on a monitor with a corresponding advertising banner;
Fig. 5 is a high-level flow diagram of a method of delivering supplemental information and/or action with time-sequence data in accordance with the first embodiment of the invention;
Fig. 6 is a flow diagram of a method of providing value-added content related to at least one of animation, audio and video data, in the process of presenting the animation, audio, and/or video data to a user in accordance with a second embodiment of the invention; Fig. 7 is a flow diagram of a method of distributing advertisements with animation, audio and/or video data delivered for presentation by way of broadcast or streaming over a network in accordance with a third embodiment of the invention; and
Figs. 8A-8E are detailed flow diagrams of a method of presenting advertisements in association with video or movie in accordance with a fourth embodiment of the invention.
DETAILED DESCRIPTION A method, apparatus and computer program product for linking supplementary information, actions, or both, to time-sequence (or "time-base) data is disclosed. The time-sequence data include animation, audio and/or video data. Fig. 1 A is a timing diagram illustrating a linked combination 100 of time-sequence data 110 and supplemental information and/or action 120, 122, 124. Three portions 120, 122, 124 are linked for presentation with the time-sequence data. Essentially numerous forms of supplemental information and/or actions can be linked to the time-sequence data using the embodiments of the invention described herein. In addition to providing supplemental information, the embodiments can also provide "actions", which in broad terms denotes any additional functionality provided to the user. This can be implemented as a computer program such as a Java applet that can be executed by a computer displaying time-sequence data. Exemplary actions include functionality for conducting surveys or for changing time-sequence data.
Amongst other things, the embodiments enable video service providers such as cable and broadcast television service providers to add controllably and on-the-fly added- value content to their video product by tightly linking advertisements to the subject- matter content of the video product. In this manner, the video with content-linked supplemental information and/or actions can be readily differentiated from normal broadcast video, for example. The same applies equally to audio and animation data. The supplemental information and/or actions are provided via a network, preferably an electronic network such as the Internet or an Intranet. Fig IB is a timing diagram illustrating the linked relationship 150 between a video, animation and/or audio program 160 and four advertisements 162, 164, 166, 168. Additional advertisement content may be available at a remote location on a network and be accessed by a link (e.g. URL) in the advertisement. As shown, the estimation 150 includes overlapping advertisements, namely first and third advertisements 162 and 166 on the one hand and the second advertisement 164 on the other. One or more of the video, animation and/or audio data, the supplemental information and/or action, and linking mechanisms or controls for linking the content data with the supplemental information and/or action can be distributed via a network. Further, they may be obtained from two or more different sources on the network. Thus, for example, a video content provider can provide the video programming via the Internet from a first source site, the supplemental information and/or action from another source site, and the linking control database from yet another site. Other combinations are possible. For example, the video programming may be available locally at a user's location while the other components are delivered via a network, or vice versa.
With reference to the example of video delivered by broadcast or a network, the embodiments of the invention enable advertisments to be tightly linked in a programmable and on-the-fly manner to the content of the video. An advertisement can be displayed as a graphical banner in combination with the video presented on a display monitor. Fig. 4 is a depiction of an exemplary application 400 of the embodiments where a video 420 is displayed with a corresponding advertising banner 430. In this example, the video data 420 is displayed in a panel of the graphical operating system 410 (e.g. Microsoft Windows 95 or 98). The exemplary portion of the video 420 is currently displaying a well-known water fountain at Sentosa Island in Singapore. In conjunction with the video 420 being presented, an advertisment 430 is presented within the same panel. It will be readily appreciated that the advertisment 430 need not be presented in the same window. The advertisment 430 is presented as a banner referring to "Destination Sentosa: Experience it all... " A user can click on the banner 430 while it is displayed, and further supplemental information and/or action can be obtained. For example, an advertisement 440 about Sentosa Island (shown in the background) can be retrieved via a URL of the banner 430 to download the advertisement 440 from a site on the Internet.
If the video is a film with actors and props, the advertisements can be directly linked to such video content. An advertiser can make direct reference in the advertisement to props in the video including articles of clothing, jewelry and accessories worn by particular actors in a scene. The advertiser can also make reference to items such as furniture, wallpaper and appliances. The foregoing applies to virtually anything visibly and/or audibly perceptible in the video. Thus, the advertisement content-linked to the video can bring an item in the video to the viewer's attention and provide a way of making a purchase by the viewer using electronic commerce, for example.
Again, the video can be streamed over an electronic network to a user's personal computer with video display capabilities. By way of example, the video itself can be displayed in a window in a graphical operating system such as Microsoft Windows 95 (Trade Mark) running on a conventional personal computer, laptop computer, or work station. Also displayed in the window can be a banner or other graphical presentation containing information associating the banner with the content of the video. Alternatively, the banner might be displayed in a separate window. By means of a textual reference, the banner can refer to a dress worn by an actress in the current video content as being sold by a particular advertiser. By appropriate interaction with the banner, the user can obtain further information about the dress or purchase it. The information obtained in this manner can be obtained remotely or in appropriate cases locally. In one embodiment, the banner displays an HTML link to a remote site to which the user's personal computer is connectable by means of the Internet. From the advertiser's remote site, further information about the dress can be obtained including how to purchase it using electronic commerce or by telephone purchase.
In yet another illustration, a video track can be played on a display device such as a television receiver with touch-screen functionality. In conjunction with the television receiver, a set topbox (associated with cable television services, for example) can be provided by which supplemental information and/or actions can be distributed. The functionality of such cable set topboxes are increasingly more sophisticated. An action can be displayed via the set topbox with the video on the television receiver, whereby the relevant action can be chosen from a banner or the like displayed with the video. For example, the subject matter content of the displayed video can be a documentary about bears and include material on bears in Alaska. Where a segment about Alaskan bears is displayed, a banner displayed in association with the video can show a message indicating that a related program about Alaska is currently available for viewing. By appropriate user interaction with the banner, such as touching an icon displayed in the banner, an action is carried out causing the displayed programming to change to the related program about Alaska without the user having to manually select the particular station.
In still another illustration, an audio track received by a tuner/receiver provided in a personal computer (e.g. Web radio) can be audibly output by the personal computer. In conjunction with the content of the audio segment, supplemental information and/or action can be displayed on the personal computer. The subject matter of the audio segment might involve discussion about some form of on-going audience survey, and an appropriate prompt can be displayed on the personal computer dependent upon the audio content. By clicking on the prompt, the user can interactively participate in the survey over the Internet. Numerous other applications can be envisaged by those skilled in the art in view of the disclosure of the embodiments herein.
The embodiments of the invention are able to strongly link supplemental information and/or actions including advertising with the content of time- sequence data including animation, audio and video. Further, the embodiments of the invention enable flexible control of the flow of the supplemental information and/or action and its content. For example, the embodiments of the invention enable flexible control of the flow of advertising in relation to an animation, audio and/or video sequence and the content of the advertising itself. Still further, the embodiments of the invention in particular applications enable close linkage of electronic commerce with the content of the time- sequence data.
The embodiments of the invention are able to differentiate time-sequence data from conventional broadcast time-sequence data by providing a content-based linkage with the supplemental information, action or both. Further, the embodiments provide a non-interfering mechanism for providing the supplemental information, action or both with respect to both the time-sequence data itself and the delivery mechanism used to deliver the time-sequence data. That is, no modification of the time-sequence data or its delivery mechanism is required. All existing time-sequence data can be used. For example, a video delivered on demand over a network to an end-user does not require any modification and can be sourced from a digital video disc (DVD) without change or embedding additional information prior to transmission. Still further, the embodiments support customised and focused content-linking of supplemental information, action, or both to the time-sequence data. This is particularly advantageous where the supplemental information, action or both relates to advertising. In addition, the embodiments of the invention enable full, on-the-fly or "realtime" control over the content, sequencing and timing of the supplemental information, action, or both, delivered to the user in conjunction with the time- sequence data. Thus, advertisers for example can have full and realtime control over the advertisement content. Customised advertising can therefore be supported.
As an example, embodiments of the invention permit a video program to be delivered via a network on demand or on a pre-scheduled basis to viewers. Sponsors of the program or advertisers can buy slots, both in terms of time-length as well as the time position in the video program. During the time slots, the sponsor or advertiser can provide HTML, XML, or other format advertisements that appear on the viewer's display device (e.g. a personal computer). The sponsor or advertiser can have full control over their advertisement content, whereas the advertisement length and position can be pre-negotiated and controlled by the delivery service provide (e.g. cable service provider). The sponsor or advertiser provides a URL from where their advertisement content can be retrieved or downloaded. An advertisement delivered in this manner can provide a link to the sponsor's or advertiser's electronic commerce facility via a network or provide other means of conducting business. The latter might include providing a phone number to call for telephone transactions or the like. Alternatively, a call centre can be contacted using video, audio or text communication.
Fig. 5 is a high-level flow diagram illustrating a method of delivering supplemental information, action, or both, with time-sequence data in accordance with a first embodiment of the invention. Processing commences in step 500. In step 502, time sequence data is provided. Again, the time-sequence data can include one or more of animation, audio and video data or programming. The time-sequence data can be provided by broadcast or via a network. In step 504, supplemental information and/or action is provided separately from the time-sequence data. Examples of the supplemental information and/or action include a universal resource locator (URL) to a remote site via a network, an interactive program, an icon, or an advertisement banner. In step 506, the supplemental information and/or action is linked with the time- sequence data during or immediately before playback of the time-sequence data. The supplemental information and/or action is preferably provided remotely via a network. The supplemental information and/or action can include a link to a remote location, and in particular, a universal resource locator (URL). It can also include a displayed prompt with which user can interact by user input.
The supplemental information and/or action can be linked with the time-sequence data by means of a start time and a stop time, or a start time and a specified duration. Alternatively, the supplemental information and/or action can be linked with the time- sequence data by means of annotation information associated with the time-sequence data. Still further, the supplemental information and/or action can be linked with the time-sequence data, which is dependent upon on-the-fly content analysis of the time- sequence data during playback of the latter. This may be done using any of a number of known image/video/audio segmentation, recognition and analysis techniques well known to those skilled in the art. Preferably, the supplemental information and/or action is content-linked with the time sequence data.
In step 508, the time-sequence data and the supplemental information and/or action is presented to an audience. In the case of video and animation information, presentation can be implemented using a display monitor of a personal computer, a television receiver, a video monitor or the like. In the case of audio information, the audio data (i.e. time sequence data) can be output by a personal computer (e.g. Web radio) or other conventional sound reproduction devices for broadcast and network streamed audio. The supplemental information and/or action can be presented on a personal computer, a video monitor, or the like.
The time-sequence data and the supplemental information and/or action are linked by a link. At least two of the link, the time-sequence data, and the supplemental information and/or action can be initially co-located at their source. Alternatively, two or more of the links, the time-sequence data, and the supplemental information and/or action can be initially remotely located at one or more remote source locations of the network. In step 510, processing terminates.
Preferably, the first embodiment of the invention depicted in Fig. 5 is implemented as software or a computer program for presenting supplemental information and/or action with time-sequence data. The software including a Java applet can be run on a computer such as a personal computer or workstation, or Java virtual machine, for example, well known to those skilled in the art. In particular, the computer program can be recorded on a computer readable medium and used in combination with the computer as a computer program product. The steps of Fig. 5 can be implemented as modules of software containing operations or instructions to implement the functionality. Alternatively, the functionality of Fig. 5 can be implemented electronically (e.g. in an application specific integrated circuit ASIC). For example, it can be embedded in a set top box for use with a video monitor or television receiver. Numerous other applications will be readily appreciated by those skilled in the art in view of the disclosure herein. The foregoing applies equally to further embodiments of the invention described hereinafter.
Fig. 2 is a block diagram illustrating the functional modules of an apparatus 200 for presenting supplemental information, action, or both, with time-sequence data in accordance with the first embodiment. Again, time-sequence data including video, animation and/or audio data 210 are provided by broadcast or via an electronic network. Alternatively, the data 210 may be provided locally. In addition, one or more linking mechanisms 220 is provided separately from the time-sequence data 210. Two or more linking mechanisms 220 are referred to in Fig. 2 as a database (DB) of linking mechanisms. The linking mechanism database can be prepared by video, animation, and/or audio content provider or the operator. Supplemental information and/or action (or value added content) 230 is also provided. This can be HTML/XML/other formats advertisements prepared and controlled by advertisers. Preferably, a linking mechanism 220 is a predefined data structure containing parameters of particular supplemental information and/or action 230 for presentation with a particular portion of the time-base data 210. Preferably, the database 220 is database of advertisement controls, and the supplemental information and/or action 230 is one or more advertisements.
One or more of the video, animation and/or audio data 210, the supplemental information and/or action 230 and linking mechanisms or controls 220 for linking the content data 210 with the supplemental information and/or action 230 can be distributed via one or more communication media 260. Further, they may be obtained from two or more different sources such as two or more sites on the Internet, or the video can be delivered via a cable television network. Other combinations are possible. While single-headed arrows are depicted in Fig. 2, it will be reading appreciated from the disclosure that communication between the components of Fig. 2 may be bidirectional. The time-sequence data 210, link mechanisms 220 and supplemental information and/or action 230 are provided to a playback controller and/or interpreter PCI 240. The PCI 240 merges the video, animation and/or video data 210 and the supplemental information and/or action 230 for presentation on an appropriate presentation device ("display") 250. Preferably, the PCI240 has a cache for storing linking mechanisms 220. It also preferably has a cache for storing supplemental information and/or action 230. Again, the apparatus 200 can be implemented using a general-purpose computer or electronically.
For example, during a video program delivered to the apparatus 200 via a network either on demand or on pre-scheduled basis to viewers, sponsors of the program or advertisers can buy advertising slots. The advertising slots can be both in terms of time-length as well as the time-position in the video program. The advertisers can present their HTML/XML/other-formats advertisements on a viewer's display 250. Using a URL, advertisement content can be downloaded. An advertisement can provide a link to the advertiser's e-commerce facility, or provide other means of conducting business. This gives advertisers full-control over their advertisement content, while the advertisement length and position is pre-negotiated and controlled by the video service provider.
Consider a video program that airs at 8:00 PM and finishes at 8:30 PM. For this program, advertisers can buy slots that are variable length in time. These slots can be displayed at fixed points in time during the broadcast of the program. An advertiser for watches might display a watch advertisement while a lead actor in the video program is wearing the watch, which the advertiser wants to sell to the viewers. At the same time, another advertiser for suits display a clothing advertisement, which might be longer or shorter than the watch advertisement. For on-demand type scenarios, the start time of the advertisements is with respect to the beginning of the program rather than in absolute time. The advertiser can get charged by the service provider based on a number of factors, including the length of the advertisement slot, the placement of an advertisement during the program, and whether or not the slot is shared with someone.
An example entry in the linking mechanism database or advertisement control database is:
Start-time: 00:05:00
End-time: 00:06:00
Address: http://www.watchesRus.com/advert/
During the broadcast, the PCI 240 displays the video information 210 and starts interpreting the advertisement control 220. At a specified start time for a particular advertisement, the PCI 240 fetches the advertisement content from the specified address, which is defined in the advertisement control 220 along with the timing information. Alternatively, the embodiment can be practiced using annotation to link the data 210 with the supplemental information and/or action 230. The advertisement content is displayed using the display or presentation device 250 (or the advertisement content can also be pre-fetched). The PCI 240 stops the display of the advertisement content when its duration has expired.
The format of the linking mechanism database or advertisement control database 220 has a format designed to be easy to produce, modify and maintain. It should also be efficient for transmission purposes and be extensible. Exemplary fields for the format are:
Period of advert display (from date - to date, which days) Start time - End time (in minutes: seconds)
Size of advert on display (in inches) Location of advert on display (lie, lrc, urc. ulc, center etc) Address of advertisement content (URL)
Since the PCI 240 executes the database of linking mechanisms or advertisement control database 220, the PCI 240 is developed hand-in-hand with the format of a linking mechanism or advertisement control. In addition, so that more features can be added to the PCI 240, the PCI 240 should be well structured and extensible.
When a video, animation and/or audio program 210 starts, the address of the link mechanism database or the advertisement control database 220 is transmitted with the initialization information.
Fig. 3 is a block diagram illustrating a variation 300 of the apparatus 200 shown in Fig. 2. For purposes of brevity, like features in Figs. 2 and 3 are identified with the same reference numerals. Only differing elements or features are identified with numerals of the format 3XX. In particular, video, animation and audio 210 is provided to an on- the-fly content analyser 310 forming part of the apparatus 300. The content analyser 310 is connected to the PCI 240, and preferably forms part of the PCI 240. The content analyser 310 can be used to determine the linking of the supplemental information and/or action with the video, animation and/or audio data 210, either entirely on its own or in combination with the linking mechanisms 220. A dashed-line arrow extends between the communication media 260 and the content analyser 310. This arrow indicates that optionally the video, animation and/or audio data 210 can be delivered directly to the content analyser 310 without passing through the PCI 240 first. This might be done where the content analyser operates completely independently or to reducing data processing via the PCI 240 to the content analyser 310.
Fig. 6 is a flow diagram of a method of providing value-added content related to at least one of animation, audio and video data, in the process of presenting the animation, audio, and/or video data to a user in accordance with a second embodiment of the invention. Processing commences in step 600. In step 602, animation, audio, and/or video data or programming is delivered for presentation to a user. In step 604, the value-added content is provided separately from the animation, audio and/or video data. The value-added content is preferably an advertisement and can include a universal resource locator (URL). However, as described above in terms of the supplemental information and/or action, the value-added content can include additional functionality, services and information. Alternatively, or in addition, the value-added content may include a set of instructions for performing operations on a local apparatus or a remote apparatus linked with the local apparatus by a network. The local apparatus can be a personal computer or the like connected to the Internet, and the remote apparatus can be a site on the Internet.
In step 606, a linking mechanism or structure is provided, separate from the animation, audio, and/or video data, which can link the value-added content with the animation, audio, and/or video data in a controllable and on-the-fly manner prior to presentation of the animation, audio, and/or video data and the value-added content. The linking mechanism can include a start time and a stop time of the value-added content in relation to the animation, audio, and/or video data, as well as an indicator of the location of the value-added content. Alternatively, the linking mechanism can include an annotation associated with the animation, audio, and/or video data. More preferably, the linking mechanism is dependent upon the content the animation, audio, and/or video data.
In step 608, the animation, audio, and/or video data and the value-added content are presented to the user. The value-added content can be presented separately in a device for reproducing the animation, audio and/or video data, such as a television or video monitor. Alternatively, it can be presented in or on the animation, audio and video data in a device for reproducing the animation, audio and video data. Processing terminates in step 610.
As described in relation to the first embodiment, the process of Fig. 6 can be implemented as an apparatus and/or a computer program product.
Fig. 7 is a flow diagram of a method of distributing advertisements with animation, audio and/or video data delivered for presentation by way of broadcast or streaming over a network in accordance with a third embodiment of the invention. Processing commences in step 700. In step 702, animation, audio and/or video data is delivered for presentation. In step 704, an advertisement related to the animation, audio and/or video data is provided separately. Preferably, the advertisement is capable of connecting a user with a remote location via a network by user interaction with the advertisement. In step 706, one or more advertisement control links are provided for linking separate advertisements with the animation, audio and/or video data. In step 708, the advertisement is presented to a user during presentation of the animation, audio and/or video data dependent upon the advertisement control link. Optionally, the method includes a step (not shown) of vending a product or service by means of electronic commerce or contacting a call centre dependent upon the advertisement. Processing terminates in step 710.
Figs. 8 A to 8E are a detailed flow diagram of a method of displaying advertisements in association with a movie or video in accordance with a fourth embodiment of the invention. The flow diagram illustrates many specific details, however, those skilled in the art will appreciate that numerous changes can be made to the process without departing from the scope and spirit of the invention. Likewise, while detailed steps of a process involving video or movies is set forth, the process can be readily adapted for application in relation to audio and/or animation data in view of the disclosure herein.
With reference to Fig. 8A, processing commences in step 800. In step 802, an identifier (e.g. a title) of a movie or video is read, and the sources of the movie/video and the advertisement control database are determined. In step 804, the advertisement control database is opened. In step 806, a panel in a graphical computing environment (e.g. Microsoft Windows 98) for displaying an advertisement is created, and the current list of advertisements is set to null. In step 808, a panel is also created for displaying the movie or video. The movie preferably plays in this panel as a separate thread. After step 808, three separate threads are carried out preferably substantially in parallel by the operating system. In Fig. 8A, the separate threads are denoted by connectors A, B and C corresponding to Figs. 8B, 8C, and 8D, respectively. Fig. 8B is a flow diagram of a thread for handling incoming advertisement controls and advertisements. The advertisement controls and advertisements are streamed for presentation of the advertisements to a viewer. In step 812, the media time of the movie is obtained from the media player. In step 814, a cache storing advertisement controls is updated. In step 816, the locations of new advertisements are obtained from the updated advertisement control data cache. In step 818, the advertisement cache is updated by streaming the advertisements for the current portion of the movie playing and for an additional predefined period yet to be played In decision block 820, a check is made to determine if the advertisement update thread (Fig. 8C) or the movie playing thread has ended. If decision block 820 returns false (NO), processing continues at step 812. Otherwise, if decision block 820 returns true (YES), the thread terminates in step 822.
The process of Fig. 8B can be readily implemented for handling the use of annotations to link the advertisements and the movie. The annotations of the movie can be obtained for the currently playing portion of the movie and a few annotations read ahead for a portion(s) of the movie yet to be played. The annotations in the movie are then matched with the annotations of the advertisements in the advertisement control data cache. The locations of the advertisements are determined in this manner. The advertisements are then streamed to update the advertisement cache.
Fig. 8C is a flow diagram of the process of presenting advertisements while a movie is playing. In particular, the advertisements are updated. In step 826, the media time of the player presenting the movie is read. In step 828, using the media time, a start time and an end time of a current advertisement(s), a check is made to determine if any advertisements have to be removed. This step can be readily modified to handle the case where annotation is used to link advertisements with the movie. This involves comparing the annotation of the movie with the annotation of the advertisement. The advertisement is to be played for the duration of the matching movie annotation. Decision block 830 determines this result. If decision block 830 returns false (NO), processing continues at step 834. Otherwise, if decision block 830 returns true (YES), the advertisement being processed is removed from the advertisement panel created in step 806. Processing then continues in step 834.
In step 834, using the media time, advertisements are selected from the advertisement cache to be made current. In decision block 836, a check is made to determine if any advertisements should be added for presentation. If decision block 836 returns false (NO), processing continues at decision block 840. Otherwise, if decision block 836 returns (YES), processing continues at step 838. In step 838, the advertisement is added to the advertisement panel created in step 806 for presentation. Processing continues at decision block 838. In decision block 840, a check is made to determine if the movie has ended or if the user has stopped play. If decision block 840 returns false (NO), processing continues at step 826. Otherwise, if decision block 840 returns true (YES), processing continues at step 842. In step 842, the player software application is closed or terminated and the advertisement control database is closed. Processing of this thread terminates in step 844.
Fig. 8D is a flow diagram of the process of playing a movie. In step 848, user inputs including fast forward, rewind, etc., are received and responded to by the player. In decision block 850, a check is made to determine if the end of the movie has been reached or it has been user terminated. If decision block 850 returns false (NO), processing continues at step 848. Otherwise, if decision block 850 returns true (YES), the thread terminates in step 852.
Fig. 8E is a flow diagram illustrating the processing of interactive user input in relation to a playing advertisement. Processing commences in step 870. In step 874, input can be received from a user. In step 876, the thread responds to the user input and performs an appropriate action as defined in the advertisement control database for the advertisement. In decision block 878, a check is made to determine if the advertisement has been removed from the advertisement panel. If decision block 878 returns false (NO), processing continues at step 874. Otherwise, if decision block 878 returns true (YES), the thread terminates in step 880. Thus, Figs. 8A-8E provide specific implementation details of one particular application of the fourth embodiment in relation to movie or video data. The process can be practiced with readily apparent changes in view of the disclosure for processing animation and/or audio data. This embodiment is able to strongly link advertising with the content of animation, audio and/or video data. In particular, it enables flexible control of the flow of the advertisement and the advertisment content. Importantly, the process of Figs. 8A-8E provides the advertisment for presentation to a user without requiring any modification of the movie itself and the delivery mechanism used to deliver the movie. The fourth embodiment enables customised and focused content- linking of advertising to the time-sequence data.
The foregoing embodiments of the invention disclose a method, apparatus and computer program product for linking supplementary information, actions, or both, to time-sequence data dependent upon the content of the time-sequence data. The time- sequence data include animation, audio and/or video data. Only a small number of embodiments have been disclosed by way of example. However, those skilled in the art will recognise that the invention can be practiced, with modification, in the light of the information contained herein without departing from the scope and spirit of the invention.

Claims

The claims defining the invention are as follows:
1. A method of presenting supplemental information, action, or both, with time-sequence data, including: providing time-sequence data; separately providing supplemental information, action, or both, from said time- sequence data; linking said supplemental information, action, or both, with said time-sequence data during playback of said time-sequence data.
2. The method according to claim 1, wherein said supplemental information, action, or both, is linked with said time-sequence data by a start time and a stop time.
3. The method according to claim 1, wherein said supplemental information, action, or both, is linked with said time-sequence data by annotation information associated with said time-sequence data.
4. The method according to any one of claims 1 to 3, wherein said supplemental information, action, or both, is content-linked with said time sequence data.
5. The method according to claim 4, wherein said supplemental information, action, or both, is linked with said time-sequence data dependent upon on-the-fly analysis of the content of said time-sequence data during playback of said time-sequence data.
6. The method according to claim 1, wherein said time-sequence data is animation, audio, and/or video data.
7. The method according to claim 1, wherein said time-sequence data is provided by broadcast.
8. The method according to claim 1, wherein said time-sequence data is provided via a network.
9. The method according to claim 1, wherein said supplemental information, action, or both, is provided remotely via a network.
10. The method according to claim 1, wherein said supplemental information, action, or both, includes a displayed prompt with which a user can interact by user input.
11. The method according to claim 1, wherein said supplemental information, action, or both, includes a link to a remote location.
12. The method according to claim 11, wherein said link is a universal resource locator (URL).
13. The method according to claim 1, wherein said time-sequence data and said supplemental information, action, or both are linked by a link means.
14. The method according to claim 13, wherein two or more of said link means, said time-sequence data, and said supplemental information, action, or both, are initially co-located at their source.
15. The method according to claim 13, wherein two or more of said link means, said time-sequence data, and said supplemental information, action, or both, are initially remotely located at one or more source locations.
16. An apparatus for presenting supplemental information, action, or both, with time-sequence data, including: means for providing time-sequence data; means for separately providing supplemental information, action, or both, from said time-sequence data; and means for linking said supplemental information, action, or both, with said time-sequence data during playback of said time-sequence data.
17. The apparatus according to claim 16, wherein said supplemental information, action, or both, is linked with said time-sequence data by a start time and a stop time.
18. The apparatus according to claim 16, wherein said supplemental information, action, or both, is linked with said time-sequence data by annotation information associated with said time-sequence data.
19. The apparatus according to any one of claims 16 to 18, wherein said supplemental information, action, or both, is content-linked with said time sequence data.
20. The apparatus according to claim 19, wherein said supplemental information, action, or both, is linked with said time-sequence data dependent upon on-the-fly analysis of the content of said time-sequence data during playback of said time-sequence data.
21. The apparatus according to claim 16, wherein said time-sequence data is animation, audio, and/or video data.
22. The apparatus according to claim 16, wherein said time-sequence data is provided by broadcast.
23. The apparatus according to claim 16, wherein said time-sequence data is provided via a network.
24. The apparatus according to claim 16, wherein said supplemental information, action, or both, is provided remotely via a network.
25. The apparatus according to claim 16, wherein said supplemental information, action, or both, includes a displayed prompt with which a user can interact by user input.
26. The apparatus according to claim 16, wherein said supplemental information, action, or both, includes a link to a remote location.
27. The apparatus according to claim 16, wherein said link is a universal resource locator (URL).
28. The apparatus according to claim 16, wherein said time-sequence data and said supplemental information, action, or both are linked by a link means.
29. The apparatus according to claim 16, wherein two or more of said link means, said time-sequence data, and said supplemental information, action, or both, are initially co-located at their source.
30. The apparatus according to claim 28, wherein two or more of said link means, said time-sequence data, and said supplemental information, action, or both, are initially remotely located at one or more source locations.
31. A computer program product having a computer readable medium having a computer program recorded therein for presenting supplemental information, action, or both, with time-sequence data, including: means for providing time-sequence data; means for separately providing supplemental information, action, or both, from said time-sequence data; and means for linking said supplemental information, action, or both, with said time-sequence data during playback of said time-sequence data.
32. The computer program product according to claim 31 , wherein said supplemental information, action, or both, is linked with said time-sequence data by a start time and a stop time.
33. The computer program product according to claim 31, wherein said supplemental information, action, or both, is linked with said time-sequence data by annotation information associated with said time-sequence data.
34. The computer program product according to any one of claims 31 to 33, wherein said supplemental information, action, or both, is content-linked with said time sequence data.
35. The computer program product according to claim 34, wherein said supplemental information, action, or both, is linked with said time-sequence data dependent upon on-the-fly analysis of the content of said time-sequence data during playback of said time-sequence data.
36. The computer program product according to claim 31 , wherein said time-sequence data is animation, audio, and/or video data.
37. The computer program product according to claim 31, wherein said time-sequence data is provided by broadcast.
38. The computer program product according to claim 31 , wherein said time-sequence data is provided via a network.
39. The computer program product according to claim 31, wherein said supplemental information, action, or both, is provided remotely via a network.
40. The computer program product according to claim 31, wherein said supplemental information, action, or both, includes a displayed prompt with which a user can interact by user input.
41. The computer program product according to claim 31, wherein said supplemental information, action, or both, includes a link to a remote location.
42. The computer program product according to claim 31 , wherein said link is a universal resource locator (URL).
43. The computer program product according to claim 31, wherein said time-sequence data and said supplemental information, action, or both are linked by a link means.
44. The computer program product according to claim 31, wherein two or more of said link means, said time-sequence data, and said supplemental information, action, or both, are initially co-located at their source.
45. The computer program product according to claim 44, wherein two or more of said link means, said time-sequence data, and said supplemental information, action, or both, are initially remotely located at one or more source locations.
46. A method of providing value-added content related to at least one of animation, audio, and video data, while said at least one of animation, audio, and video data is being presented to a user, including the steps of: delivering said at least one of animation, audio, and video data for presentation to said user;
26]
Slh providing said value-added content being separate from said at least one of animation, audio and video data; and providing linking means, separate from said at least one of animation, audio, and video data, for linking said value-added content with said at least one of animation, audio, and video data in a controllable and on-the-fly manner prior to presentation of said at least one of animation, audio, and video data and said value- added content.
47. The method according to claim 46, further including the step of presenting for said user said at least one of animation, audio, and video data and said value-added content.
48. The method according to claim 46 or 47, wherein said value-added content is an advertisement.
49. The method according to claim 46, wherein said linking means includes a start time and a stop time of said value-added content in relation to said at least one of said animation, audio, and video data.
50. The method according to claim 46, wherein said linking means
- includes an annotation associated with said at least one of said animation, audio, and video data.
51. The method according to claim 46, wherein said value-added content includes a universal resource locator (URL).
52. The method according to claim 46, wherein said value-added content includes a set of instructions for performing operations on a local apparatus or a remote apparatus linked with said local apparatus by a network.
SI !
53. The method according to claim 47, wherein said value-added content is presented separately in a device for reproducing said at least one of animation, audio and video data.
54. The method according to claim 47, wherein said value-added content is presented in or on said at least one of animation, audio and video data in a device for reproducing said at least one of animation, audio and video data.
55. The method according to claim 46, wherein said linking means is dependent upon the content said at least one of animation, audio, and video data.
56. An apparatus for providing value-added content related to at least one of animation, audio, and video data, while said at least one of animation, audio, and video data is being presented to a user, including: means for delivering said at least one of animation, audio, and video data for presentation to said user; means for providing said value-added content being separate from said at least one of animation, audio and video data; and means for providing linking means, separate from said at least one of animation, audio, and video data, for linking said value-added content with said at least one of animation, audio, and video data in a controllable and on-the-fly manner prior to presentation of said at least one of animation, audio, and video data and said value-added content.
57. The apparatus according to claim 56, further including means for presenting to said user said at least one of animation, audio, and video data and said value-added content.
58. The apparatus according to claim 56 or 57, wherein said value-added content is an advertisement.
SUBS EET (RULE 2b,
59. The apparatus according to claim 56, wherein said linking means includes a start time and a stop time of said value-added content in relation to said at least one of said animation, audio, and video data.
60. The apparatus according to claim 56, wherein said linking means includes an annotation associated with said at least one of said animation, audio, and video data.
61. The apparatus according to claim 56, wherein said value-added content includes a universal resource locator (URL).
62. The apparatus according to claim 57, wherein said value-added content includes a set of instructions for performing operations on a local apparatus or a remote apparatus linked with said local apparatus by a network.
63. The apparatus according to claim 57, wherein said value-added content is presented separately in said means for representing said at least one of animation, audio and video data.
64. The apparatus according to claim 57, wherein said value-added content is presented in or on said at least one of animation, audio and video data in said means for reproducing said at least one of animation, audio and video data.
65. The apparatus according to claim 56, wherein said linking means is dependent upon the content said at least one of animation, audio, and video data.
66. A computer program product having a computer readable medium having a computer program recorded therein for providing value-added content related to at least one of animation, audio, and video data, while said at least one of animation, audio, and video data is being presented to a user, including:
;>'-_ ._: -> means for delivering said at least one of animation, audio, and video data for presentation to said user; means for providing said value-added content being separate from said at least one of animation, audio and video data; and means for providing linking means, separate from said at least one of animation, audio, and video data, for linking said value-added content with said at least one of animation, audio, and video data in a controllable and on-the-fly manner prior to presentation of said at least one of animation, audio, and video data and said value-added content.
67. The computer program product according to claim 66, further including means for presenting to said user said at least one of animation, audio, and video data and said value-added content.
68. The computer program product according to claim 66 or 67, wherein said value-added content is an advertisement.
69. The computer program product according to claim 66, wherein said linking means includes a start time and a stop time of said value-added content in relation to said at least one of said animation, audio, and video data
70. The computer program product according to claim 66, wherein said linking means includes an annotation associated with said at least one of said animation, audio, and video data.
71. The computer program product according to claim 66, wherein said value-added content includes a universal resource locator (URL).
72. The computer program product according to claim 66, wherein said value-added content includes a set of instructions for performing operations on a local
— r- C c,! '."i3T! 'J i t bn iEET (Rui.. computer program product or a remote computer program product linked with said local computer program product by a network.
73. The computer program product according to claim 67, wherein said value-added content is presented separately in said means for presenting said at least one of animation, audio and video data.
74. The computer program product according to claim 67, wherein said value-added content is presented in or on said at least one of animation, audio and video data in said means for reproducing said at least one of animation, audio and video data.
75. The computer program product according to claim 66, wherein said linking means is dependent upon the content said at least one of animation, audio, and video data.
76. A method of distributing advertisements with animation, audio and/or video data, said animation, audio and/or video data being delivered for presentation by way of broadcast or streaming over a network, said method including the steps of: delivering said animation, audio and/or video data for presentation; delivering a separate advertisement related to said animation, audio and/or video data; providing an advertisement control link for linking said separate advertisement with said animation, audio and/or video data; and presenting for a user said advertisement during presentation of said animation, audio and/or video data dependent upon said advertisement control link.
77. The method according to claim 76, wherein said advertisement is capable of connecting a user with a remote location via a network by user interaction with said advertisement.
Figure imgf000033_0001
78. The method according to claim 77, further comprising the step of vending a product or service by means of electronic commerce or contacting a call centre dependent upon said advertisement.
79. An apparatus for distributing advertisements with animation, audio and/or video data, said animation, audio and/or video data being delivered for presentation by way of broadcast or streaming over a network, said apparatus including: means for delivering said animation, audio and/or video data for presentation; means for delivering a separate advertisement related to said animation, audio and/or video data; means for providing an advertisement control link for linking said separate advertisement with said animation, audio and/or video data; and means for presenting for a user said advertisement during presentation of said animation, audio and/or video data dependent upon said advertisement control link.
80. The apparatus according to claim 79, wherein said advertisement is capable of connecting a user with a remote location via a network by user interaction with said advertisement.
81. The apparatus according to claim 80, further comprising means for vending a product or service using electronic commerce or by contacting a call centre dependent upon said advertisement.
82. An computer program product for distributing advertisements with animation, audio and/or video data, said animation, audio and/or video data being delivered for presentation by way of broadcast or streaming over a network, said computer program product including: means for delivering said animation, audio and/or video data for presentation; means for delivering a separate advertisement related to said animation, audio and/or video data; means for providing an advertisement control link for linking said separate advertisement with said animation, audio and/or video data; and means for presenting for a user said advertisement during presentation of said animation, audio and/or video data dependent upon said advertisement control link.
83. The computer program product according to claim 82, wherein said advertisement is capable of connecting a user with a remote location via a network by user interaction with said advertisement.
84. The computer program product according to claim 83, further comprising means for vending a product or service using electronic commerce or by contacting a call centre dependent upon said advertisement.
PCT/SG1998/000096 1998-11-27 1998-11-27 Method and apparatus for content-linking supplemental information with time-sequence data WO2000033197A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU15174/99A AU1517499A (en) 1998-11-27 1998-11-27 Method and apparatus for content-linking supplemental information with time-sequence data
PCT/SG1998/000096 WO2000033197A1 (en) 1998-11-27 1998-11-27 Method and apparatus for content-linking supplemental information with time-sequence data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SG1998/000096 WO2000033197A1 (en) 1998-11-27 1998-11-27 Method and apparatus for content-linking supplemental information with time-sequence data

Publications (1)

Publication Number Publication Date
WO2000033197A1 true WO2000033197A1 (en) 2000-06-08

Family

ID=20429891

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG1998/000096 WO2000033197A1 (en) 1998-11-27 1998-11-27 Method and apparatus for content-linking supplemental information with time-sequence data

Country Status (2)

Country Link
AU (1) AU1517499A (en)
WO (1) WO2000033197A1 (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2810834A1 (en) * 2000-06-27 2001-12-28 Thomson Multimedia Sa Audio visual receiver can insert advertising in program matches user interests
WO2002009432A2 (en) * 2000-07-25 2002-01-31 Cachestream Corporation Branded channel
EP1189433A1 (en) * 2000-09-13 2002-03-20 Pace Micro Technology PLC Improvements to television system
WO2002029602A1 (en) * 2000-10-06 2002-04-11 Canon Kabushiki Kaisha Xml encoding scheme
EP1207699A2 (en) * 2000-11-17 2002-05-22 Hitachi, Ltd. A method for providing advertisement information and apparatus thereof
EP1229721A2 (en) 2001-01-31 2002-08-07 Fuji Photo Film Co., Ltd. Information displaying method and menu service method and system
WO2002091739A2 (en) * 2001-05-10 2002-11-14 International Business Machines Corporation System and method for enhancing broadcast or recorded programs with information on the world wide web
EP1315375A2 (en) * 2001-10-19 2003-05-28 Microsoft Corporation Video segment targeting using remotely issued instructions as well as local and behavior information
US7117439B2 (en) 2001-10-19 2006-10-03 Microsoft Corporation Advertising using a combination of video and banner advertisements
WO2007033262A2 (en) 2005-09-12 2007-03-22 Qualcomm Incorporated Apparatus and methods for delivering and presenting auxiliary services for customizing a channel
WO2008026195A2 (en) * 2006-08-14 2008-03-06 Alcatel Lucent An approach for associating advertising supplemental information with video programming
WO2008146217A2 (en) * 2007-05-25 2008-12-04 Nokia Corporation Network entity, terminal, computer-readable storage medium and method for providing widgets including advertisements for associated widgets
US7565506B2 (en) 2005-09-08 2009-07-21 Qualcomm Incorporated Method and apparatus for delivering content based on receivers characteristics
WO2010001372A1 (en) * 2008-06-30 2010-01-07 Alcatel Lucent Alternative mechanism to associate supplemental/advertising information with multimedia programs
EP2293564A1 (en) * 2000-10-11 2011-03-09 United Video Properties, Inc. Systems and methods for supplementing on-demand media
US8688841B2 (en) 2008-06-05 2014-04-01 Modena Enterprises, Llc System and method for content rights based on existence of a voice session
US8893179B2 (en) 2005-09-12 2014-11-18 Qualcomm Incorporated Apparatus and methods for providing and presenting customized channel information
US9569230B2 (en) 2007-05-25 2017-02-14 Nokia Technologies Oy Network entity, terminal, computer-readable storage medium and method for providing widgets including advertisements for associated widgets

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0742669A1 (en) * 1995-05-10 1996-11-13 Matsushita Electric Industrial Co., Ltd. Notification system for television receivers
US5696905A (en) * 1995-03-20 1997-12-09 International Business Machines Corporation System and method for providing merchant information and establishing links to merchants while presenting a movie
US5774664A (en) * 1996-03-08 1998-06-30 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US5778181A (en) * 1996-03-08 1998-07-07 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5696905A (en) * 1995-03-20 1997-12-09 International Business Machines Corporation System and method for providing merchant information and establishing links to merchants while presenting a movie
EP0742669A1 (en) * 1995-05-10 1996-11-13 Matsushita Electric Industrial Co., Ltd. Notification system for television receivers
US5774664A (en) * 1996-03-08 1998-06-30 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US5778181A (en) * 1996-03-08 1998-07-07 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8726307B2 (en) 2000-06-27 2014-05-13 Thomson Licensing Method for receiving and displaying thematic audio-visual programme sequences, and receiver therefor
WO2002001863A1 (en) * 2000-06-27 2002-01-03 Thomson Licensing S.A. Method for receiving and displaying thematic audio-visual programme sequences, and receiver therefor
FR2810834A1 (en) * 2000-06-27 2001-12-28 Thomson Multimedia Sa Audio visual receiver can insert advertising in program matches user interests
WO2002009432A2 (en) * 2000-07-25 2002-01-31 Cachestream Corporation Branded channel
WO2002009432A3 (en) * 2000-07-25 2002-08-29 Cachestream Corp Branded channel
EP1189433A1 (en) * 2000-09-13 2002-03-20 Pace Micro Technology PLC Improvements to television system
WO2002029602A1 (en) * 2000-10-06 2002-04-11 Canon Kabushiki Kaisha Xml encoding scheme
US7647552B2 (en) 2000-10-06 2010-01-12 Canon Kabushiki Kaisha XML encoding scheme
EP2293564A1 (en) * 2000-10-11 2011-03-09 United Video Properties, Inc. Systems and methods for supplementing on-demand media
EP1207699A3 (en) * 2000-11-17 2005-12-14 Hitachi, Ltd. A method for providing advertisement information and apparatus thereof
EP1207699A2 (en) * 2000-11-17 2002-05-22 Hitachi, Ltd. A method for providing advertisement information and apparatus thereof
EP1229721A2 (en) 2001-01-31 2002-08-07 Fuji Photo Film Co., Ltd. Information displaying method and menu service method and system
WO2002091739A3 (en) * 2001-05-10 2004-03-25 Ibm System and method for enhancing broadcast or recorded programs with information on the world wide web
US7552193B2 (en) 2001-05-10 2009-06-23 Yahoo! Inc. System and method for enhancing broadcast or recorded programs with information on the world wide web
WO2002091739A2 (en) * 2001-05-10 2002-11-14 International Business Machines Corporation System and method for enhancing broadcast or recorded programs with information on the world wide web
EP1315375A3 (en) * 2001-10-19 2003-08-06 Microsoft Corporation Video segment targeting using remotely issued instructions as well as local and behavior information
US7117439B2 (en) 2001-10-19 2006-10-03 Microsoft Corporation Advertising using a combination of video and banner advertisements
EP1315375A2 (en) * 2001-10-19 2003-05-28 Microsoft Corporation Video segment targeting using remotely issued instructions as well as local and behavior information
US7565506B2 (en) 2005-09-08 2009-07-21 Qualcomm Incorporated Method and apparatus for delivering content based on receivers characteristics
KR100941348B1 (en) * 2005-09-12 2010-02-11 퀄컴 인코포레이티드 Apparatus and methods for delivering and presenting auxiliary services for customizing a channel
WO2007033262A3 (en) * 2005-09-12 2007-06-07 Qualcomm Inc Apparatus and methods for delivering and presenting auxiliary services for customizing a channel
WO2007033262A2 (en) 2005-09-12 2007-03-22 Qualcomm Incorporated Apparatus and methods for delivering and presenting auxiliary services for customizing a channel
US8893179B2 (en) 2005-09-12 2014-11-18 Qualcomm Incorporated Apparatus and methods for providing and presenting customized channel information
WO2008026195A3 (en) * 2006-08-14 2008-07-24 Alcatel Lucent An approach for associating advertising supplemental information with video programming
WO2008026195A2 (en) * 2006-08-14 2008-03-06 Alcatel Lucent An approach for associating advertising supplemental information with video programming
WO2008146217A3 (en) * 2007-05-25 2009-04-30 Nokia Corp Network entity, terminal, computer-readable storage medium and method for providing widgets including advertisements for associated widgets
WO2008146217A2 (en) * 2007-05-25 2008-12-04 Nokia Corporation Network entity, terminal, computer-readable storage medium and method for providing widgets including advertisements for associated widgets
US9569230B2 (en) 2007-05-25 2017-02-14 Nokia Technologies Oy Network entity, terminal, computer-readable storage medium and method for providing widgets including advertisements for associated widgets
US8688841B2 (en) 2008-06-05 2014-04-01 Modena Enterprises, Llc System and method for content rights based on existence of a voice session
WO2010001372A1 (en) * 2008-06-30 2010-01-07 Alcatel Lucent Alternative mechanism to associate supplemental/advertising information with multimedia programs

Also Published As

Publication number Publication date
AU1517499A (en) 2000-06-19

Similar Documents

Publication Publication Date Title
US20240007696A1 (en) Systems and methods for using video metadata to associate advertisements therewith
US9930311B2 (en) System and method for annotating a video with advertising information
KR101478275B1 (en) System and/or method for distributing media content
WO2000033197A1 (en) Method and apparatus for content-linking supplemental information with time-sequence data
US9438966B2 (en) System and/or method for distributing media content and providing an option to maintain an advertising experience
US10299015B1 (en) Time-based content presentation
US20020059604A1 (en) System and method for linking media content
US20090235312A1 (en) Targeted content with broadcast material
US20070157251A1 (en) Methods and Systems For Distributing Assets Associated With Television Program
US20090089830A1 (en) Various methods and apparatuses for pairing advertisements with video files
EP2045730A1 (en) Methods and apparatuses for an engine that pairs advertisements with video files
US20030005437A1 (en) Networked broadcasting system with demographically controlled advertisement selection
US20030126611A1 (en) Methods and apparatus for controlling interactive television information and commerce services
US20080046919A1 (en) Method and system for combining and synchronizing data streams
US20020112247A1 (en) Method and system for creation, delivery, and presentation of time-synchronized multimedia presentations
US20060230415A1 (en) Electronic device and methods for reproducing mass media content
US20030226142A1 (en) Apparatus and method for selective insertion and pricing of media data into a media data stream
US20030004793A1 (en) Networked broadcasting system and traffic system for multiple broadcasts
US20030005052A1 (en) Networked broadcasting system with provision for the addition of advertisements or messages
JP2004517532A (en) Embedding object-based product information in audiovisual programs that is reusable for non-intrusive and viewer-centric use
US20090150927A1 (en) Facilitating interactive advertising in digital television program content through follow-up browsing of selectable advertised offerings presented within such digital television program content
KR20050086696A (en) Method for concurrently presenting multiple content types in a tv platform
TW200926036A (en) Bookmarking in videos
WO2001060071A2 (en) Interactive multimedia user interface using affinity based categorization
JP2010098730A (en) Link information providing apparatus, display device, system, method, program, recording medium, and link information transmitting/receiving system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 09341347

Country of ref document: US

AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase