Recherche Images Maps Play YouTube Actualités Gmail Drive Plus »
Connexion
Les utilisateurs de lecteurs d'écran peuvent cliquer sur ce lien pour activer le mode d'accessibilité. Celui-ci propose les mêmes fonctionnalités principales, mais il est optimisé pour votre lecteur d'écran.

Brevets

  1. Recherche avancée dans les brevets
Numéro de publicationUS20060064641 A1
Type de publicationDemande
Numéro de demandeUS 11/220,267
Date de publication23 mars 2006
Date de dépôt6 sept. 2005
Date de priorité20 janv. 1998
Autre référence de publicationUS6380950, US6941517, US20020080159, US20110200305
Numéro de publication11220267, 220267, US 2006/0064641 A1, US 2006/064641 A1, US 20060064641 A1, US 20060064641A1, US 2006064641 A1, US 2006064641A1, US-A1-20060064641, US-A1-2006064641, US2006/0064641A1, US2006/064641A1, US20060064641 A1, US20060064641A1, US2006064641 A1, US2006064641A1
InventeursJoseph Montgomery, Michael Richard Moore, Stephen Hartford, Mark Mooneyham, Daniel Kaye, Kenneth Turcotte, Steven Kell, Stephan Schaem
Cessionnaire d'origineMontgomery Joseph P, Moore Michael Richard Y, Hartford Stephen A, Mooneyham Mark R, Kaye Daniel A, Turcotte Kenneth A, Kell Steven R, Schaem Stephan D
Exporter la citationBiBTeX, EndNote, RefMan
Liens externes: USPTO, Cession USPTO, Espacenet
Low bandwidth television
US 20060064641 A1
Résumé
The present invention is concerned with client-side production in a personal computer environment of low bandwidth images and audio. A series of low bandwidth still images along with a “script” and audio data is sent over a network in a client/server architecture or is read from a compact disk or other memory. A “director” module residing in a client personal computer uses the “script” to tell the computer how to execute a sequence of “moves” on the still images. These moves include cuts, dissolves, fades, wipes, focuses, flying planes and digital video effects such as push and pull. Moves within a still image occur in real time, and are relatively smooth and continuous as compared to prior art network video. Low bandwidth is achieved because most of the production is done at the client location without relying upon slow, bandwidth-limited downloading of conventional network video formats.
Images(8)
Previous page
Next page
Revendications(20)
1-31. (canceled)
32. A system for data communications between a server and a client computer that are in communication with each other via a computer network to thereby display a digital video production on the client computer without the digital video production itself being sent over the network from the server to the client computer, the system comprising:
a client computer in communication with a computer network;
a server in communication with the computer network;
wherein the client computer is configured to receive a plurality of image files and a script module from the server over the computer network, the image files defining a plurality of images that are to be displayed as part of a digital video production, the script module defining how the plurality of image files are to be processed to generate the digital video production; and
wherein the client computer is configured to execute a software module that is resident thereon, the software module being configured to generate the digital video production for display on the client computer from the received image files and the received script module.
33. The system of claim 32 wherein the digital video production comprises a plurality of images and a plurality of transition effects that are displayed as the video progresses from one image to another.
34. The system of claim 33 wherein the client computer is further configured to receive at least one audio file from the server over the computer network, the audio file defining an audio portion of the digital video production, wherein the script module is configured to further define how the audio portion is to be coordinated with the images of the digital video production, and wherein the software module is further configured to generate the digital video production for display on the client computer from the received image files, the received at least one audio file, and the received script module.
35. The system of claim 34 wherein the server is further configured to communicate the script module to the client computer before the image files and before the at least one audio file.
36. The system of claim 34 wherein the computer network comprises the Internet.
37. The system of claim 33 wherein the server is further configured to send a preliminary communication to the client computer over the computer network, the preliminary communication comprising a plurality of preliminary image files and the script module.
38. The system of claim 37 wherein the client computer is further configured to begin displaying the digital video production once the software module has generated a preliminary portion of the digital video production from the received script module and the received preliminary image files, wherein the client computer continues to receive subsequent image files from the server over the computer network, and wherein the software module is configured to generate and display subsequent portions of the digital video production as the subsequent image files are received by the client computer from the server.
39. The system of claim 33 wherein the plurality of image files comprise a plurality of still images.
40. The system of claim 39 wherein the plurality of image files comprise a plurality of bit mapped still images.
41. The system of claim 33 wherein the script module comprises a plurality of commands in an edit decision list (EDL).
42. The system of claim 33 wherein the transition effects comprise at least one selected from the group consisting of cuts, dissolves, fades, wipes, focuses, defocuses, moving banners, flying image planes, pushes, and pulls.
43. A method comprising:
generating a video sequence locally at a client computer from (1) data received by the client computer from a remote server over a computer network that represents a plurality of still images and (2) data received by the client computer from a remote server over a computer network that represents instructions defining how the still images are to be sequenced together to generate the video sequence; and
displaying the generated video sequence on the client computer.
44. The method of claim 43 further comprising:
storing a software module locally on the client computer, the software module being configured to (1) process the received instructions data and (2) generate the video sequence from the received still images data in accordance with the processed instructions data.
45. The method of claim 44 further comprising:
receiving, at the client computer, the instructions data and a preliminary portion of the still images data from a remote server over a computer network; and
wherein the generating step comprises generating a preliminary portion of the video sequence from the received instructions data and the received preliminary portion of the still images data; and
wherein the displaying step comprises displaying the preliminary portion of the video sequence once it has been generated.
46. The method of claim 45 further comprising:
subsequently receiving a subsequent portion of the still images data from a remote server over a computer network; and
wherein the generating step further comprises generating a subsequent portion of the video sequence from the received instructions data and the received subsequent portion of the still images data; and
wherein the displaying step further comprises displaying the subsequent portion of the video sequence once it has been generated and after the preliminary video sequence portion has been displayed.
47. The method of claim 46 wherein the video sequence comprises a plurality of successive still images having transition effects interleaved therebetween, and wherein the generating step further comprises (1) processing the instructions data to identify at least one transition effect for placement between a succession of still images, and (2) placing the identified at least one transition effect between that succession of still images.
48. The method of claim 46 wherein the video sequence further comprises an audio portion, the method further comprising:
receiving data that represents the audio portion of the video sequence from a remote server over a computer network, wherein the instructions data further defines how the received audio data is to be incorporated into the video sequence, and wherein the generating step further comprises incorporating the received audio data into the video sequence in accordance with the processed instructions data.
49. The method of claim 46 wherein the computer network comprises the Internet, the method further comprising:
connecting the client computer to an Internet website;
displaying a page of the Internet website on the client computer; and
initiating the receiving steps, the generating step, and the displaying step in response to selection of a link on the displayed page by a user of the client computer.
50. A system comprising:
a client computer in communication with a computer network;
a server in communication with the computer network;
wherein the server is configured to communicate, over the computer network, a partial video production and a plurality of instructions to the client computer, the instructions defining how a software program resident on the client computer can generate a full video production from the partial video production; and
wherein the client computer is configured to (1) receive the partial video production and the instructions, (2) execute a software program resident thereon to generate the full video production from the received partial video production in accordance with the received instructions, and (3) display the full video production thereon.
Description
    CROSS-REFERENCE TO RELATED APPLICATIONS
  • [0001]
    This application is a continuation application of U.S. application Ser. No. 10/020,104, filed on Dec. 12, 2001, and entitled LOW BANDWIDTH TELEVISION, now U.S. Pat. No. ______, which is a divisional of U.S. application Ser. No. 09/233,687 filed Jan. 19, 1999, and entitled LOW BANDWIDTH TELEVISION, now U.S. Pat. No. 6,380,950, which claims priority to provisional application Ser. No. 60/071,930 filed Jan. 20, 1998, the entire disclosures of each of which are incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • [0002]
    1. Field of the Invention
  • [0003]
    The present invention relates generally to image processing, and specifically to production of images and audio in a personal computer environment.
  • [0004]
    2. Discussion of the Prior Art
  • [0005]
    An important issue in digital technology is providing video images on a personal computer. These images are transmitted across the Internet and other networks, across telephone lines with modem-to-to modem connections, or received from compact disk read-only memories (CD-ROMs). The speed of a modem is commonly the limiting factor in sending real time, continuous video information across the Internet, over corporate intranets or local area networks. In comparison, continuous network transmission of audio data does not present significant difficulties.
  • [0006]
    Table 1 shows theoretical bandwidth maxima for various network architectures. Modem-to-modem connections across lines in plain old telephone service (POTS) have a theoretical bandwidth of 3,360 bytes per second, while connections across the Internet with a modem or single ISDN are limited to 5,600 bytes per second. Dual ISDN network architectures transmit a maximum of 11,200 bytes per second, while corporate local area networks with 10BaseT connections have a capability of transmitting one megabyte per second. With the exception of telephone line connections, these other techniques involve non-continuous, packet-switched data. Satellite and cable architectures are also possible, but have not yet been widely adopted and present other difficulties.
    TABLE 1
    Theoretical Continuous
    Network Architecture Maximum Bandwidth Bandwidth
    Modem to modem over POTS 3,3360 bytes/sec Yes
    Internet with modem  5,600 bytes/sec No
    Internet with single ISDN  5,600 bytes/sec No
    Internet with dual ISDN 11,200 bytes/sec No
    Corporate 10BaseT One megabyte/sec No
  • [0007]
    On the other hand, computer memories and processor speeds have made rapid advances. Personal computers have hard drives accommodating many gigabits of data, and the price of memory chips is decreasing. Processor speeds approaching 300 MHz are available, and speeds of several GHz are contemplated.
  • [0008]
    To view a still or motion picture from the Internet on a personal computer, a user conventionally downloads video data from a web site by clicking on a web link. Often, however, it is necessary to separately download (or otherwise obtain) software, e.g. Adobe Acrobat, in order to display a particular image format. Images are frequently compressed for transmission over networks or storage on disks. Compression algorithms, such as JPEG and MPEG, using discrete cosine transfer (DCT) methods, produce serviceable images but compromise image size, image quality, definition, and acquisition speed. Image latency is also sacrificed. A user must wait while an entire image or series of images is buffered in a client side personal computer prior to display. Image transmission is sometimes interrupted due to network errors and traffic. Streaming techniques allow a user to begin viewing the images immediately while downloading, but streaming still sacrifices image quality and latency.
  • [0009]
    Currently, International Telecommunications Union Standard ITU-R 601 for digital formats in professional video production (i.e. NTSC) requires 720 by 486 pixels per frame in the scanned image, and an eight-bit 4:2:2 sampling of Y, R-Y, B-Y color components at sixty frames per second. This results in a data stream of 20 megabytes per second if the format is to remain uncompressed and if the images are to be viewed continuously in real time. Clearly, this is greater than the fastest rate for 10BaseT of one megabyte per second. A compression ratio of 5:1 is the most that is considered desirable for production marketplace image quality, but this only reduces the necessary data rate to 4 megabytes per second. Using 4:1:1 sampling, other conventional digital video production techniques (e.g. DVC Pro and DV Cam) produce a marginally improved data rate of 3 megabytes per second. Compression ratios of 30:1 are sometimes used for previewing and editing of video images, but this only yields a data rate of 700 kilobytes per second. Data rates for these formats are summarized in Table 2.
    TABLE 2
    Digital
    Video Format Compression Ratio Data Rate
    ITU-R 601  1:1 (uncompressed)  20 megabytes/sec
    ITU-R 601  5:1  4 megabytes/sec
    DV (DVC Pro  5:1 (using 4:1:1 sampling)  3 megabytes/sec
    & DV Cam)
    ITU-R 601 30:1 (offline quality) 700 kilobytes/sec
  • [0010]
    Comparing this to the standard modem of 56 kilobytes per second, there is a readily apparent, significant gap between requirements for ITU-R 601 and present-day hardware transmission capabilities. A further compression ratio of 125:1 on an already-compressed and marginally acceptable 30:1 compressed image, i.e. a total compression of 750:1, is needed to transmit ITU-R 601 data across a 56 k modem.
  • [0011]
    Present methods of displaying moving objects on web pages involve either bit-mapped or vector approaches. Simple moving icons on a web page are produced by changing only part of the image in every frame. For example, Microsoft® and Netscape® browsers show moving traces around their logos while a processor is retrieving a page. Advertisements on web pages also display moving images. The bandwidth for these images is reduced by making the images smaller so that fewer bits are needed for each frame, or by slowing down the frame rate so that the images appear to move discontinuously.
  • [0012]
    High definition television (HDTV) attempts to simplify the display of video images and reduce bandwidth by recognizing constant areas within a video picture and retaining much of the information from a previous frame. While HDTV developed concurrently with MPEG and JPEG, HDTV is broadcast-oriented and does not lend itself to network transmission or personal computer applications.
  • [0013]
    It is expected that bandwidth will continue to be the bottleneck in network transmission for the foreseeable future. Thus, there is an outstanding need in the prior art to be able to send professional quality video images across networks through ordinary modems by taking advantage of plenary memory and processor capacities within personal computers, and thereby reducing reliance on transmission hardware. There is also a need to create compelling new video experiences in personal computers.
  • SUMMARY OF THE INVENTION
  • [0014]
    The present invention is concerned with client-side production in a personal computer environment of low bandwidth images and audio. A series of still images in an image module along with a “script” module and an audio module are sent over a network in a client/server architecture or are read from a compact disk or other memory. A “director” module residing in memory (e.g. on hard disk) of the client personal computer uses the “script” to tell the computer how to execute a sequence of “moves” on the still images. These moves include, but are not limited to, cuts, dissolves, fades, wipes, focuses, flying image planes, and digital video effects such as push and pull. The director module is either downloaded from a network on a one-time basis or uploaded from a floppy or compact disk.
  • [0015]
    Production sequences are in real time, as well as being relatively smooth and continuous as compared to prior art network video. In order to permit viewing as soon as possible and to avoid caching, the script module is transmitted to the personal computer along with preliminary images, so playback begins immediately. Low bandwidth is achieved because a majority of the production is done at the client location and the transmission of still pictures, audio data and script is relatively rapid. Images are always displayed in real time and in full screen formats. If necessary to prevent latency delays, the director modules inserts stand-in from stock footage, animation and loops so that a viewer always has a continuous visual and audio experience.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0016]
    For a more complete understanding of the invention, as well as other features thereof, reference may be had to the following detailed description of the invention in conjunction with the drawings wherein:
  • [0017]
    FIG. 1 illustrates a network architecture of the present invention;
  • [0018]
    FIG. 2(a)(i)-(iii) show a first move of a bit-mapped image:
  • [0019]
    FIG. 2(b)(i)-(iv) show a second move of a bit-mapped image;
  • [0020]
    FIG. 2(c)(i)-(iv) show a third move of a bit-mapped image;
  • [0021]
    FIG. 2(d)(i)-(iv) show a fourth move of a bit-mapped image;
  • [0022]
    FIG. 3 illustrates a flowchart for playing back visual and audio sequences;
  • [0023]
    FIGS. 4(a) and (b) illustrate software modules for producing visual and audio sequences; and
  • [0024]
    FIG. 5 shows a user interface for authoring visual and audio sequences.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • [0025]
    FIG. 1 shows a general overview of a client/server architecture of the present invention. Client personal computer 100 is connected through modem 120 and network 125 to server 130. Computer 100 includes display screen 140, stereo speakers 150, disk drives 160, and hard drive 170 containing a number of software modules. Server 130 has a memory containing other software modules, and server 130 is connected to a plurality of other clients 180, 181 and also to a production client 185. Production client 185 authors production images 190 shown on display 140 of personal computer 100 as well as providing a director module for one-time plug-in at client computer 100.
  • [0026]
    FIGS. 2(a) to 2(d) show selected “moves” characteristic of the low bandwidth television of the present invention. FIG. 2(a) shows a flying video plane. A still picture 210 of an image to be displayed on computer screen 140 resides in the personal computer (FIG. 2(a)(i)). Images 230, 230′ of picture 210 are displayed on personal computer 100 such that not all of picture 210 fits within a display window 220, 220′, but part of the picture 210 is cropped on the computer screen 140 as images 230, 230′ (FIG. 2(a)(ii)-(iii)). Now, picture 210 is rapidly translated within the display window 220, 220′ of computer screen 140. Since the entire still picture 210 is already stored within the personal computer 100 as a bit-mapped image, there is no need to download a succession of images from a network or disk to give the illusion of motion. Moving images 230, 230′ are created at the client personal computer 100 from the bit-mapped still picture 210 stored in the computer memory. One application is a pan around of a three hundred and sixty degree scene. Once the scene is stored as a bit-mapped still picture 210 in the computer, the director uses the script accompanying the still three hundred and sixty degree picture 210 to simulate a camera track at any position around the scene.
  • [0027]
    Another application is a moving banner. The banner is stored as a bitmapped still picture 210 (FIG. 2(a)(i)), but picture 210 is cropped such that only one segment of the banner is displayed at one time (FIG. 2(a)(ii)-(iii)). The script accompanying the banner is used by the director module to move the banner from left to right across screen 140, or up, down or diagonally across screen 140. Images 230, 230′ appear to move much more rapidly and smoothly across screen 140 than in prior art systems because the processor of computer 100 is locally working on resident picture 210 to create images 230, 230′ and a series of bit-mapped pictures 210 need not be continuously downloaded from a network.
  • [0028]
    FIG. 2(b) shows a focus/defocus move. A bit-mapped still picture 240 resides in personal computer 100 along with a script module. Assume initially that the image is in focus and displayed on computer screen 140 as picture 240 (FIG. 2(b)(i)). The script cues the director to activate an algorithm residing on the personal computer 100 which calculates and displays a series of defocused images 241, 242, 243 of the original bit-mapped still picture 240 (FIG. 2(b)(ii)-(iv)). This algorithm is one of the utilities downloaded on a onetime basis with the director and is optimized to produce rapid calculation of the defocused images. Picture 240 optionally is downloaded as a pair of pictures 240 a and 240 b, with picture 240 a (FIG. 2(b)(i)) represented the focused or starting image and picture 240 b (FIG. 2(b)(iv)) represented the defocused or target image. Preferably, the defocusing algorithm involves an optimized table representing iteratively defocused image states between the starting image and the target image. The script may indicate that the image is initially displayed as a defocused image and subsequently brought into focus, or vice versa.
  • [0029]
    FIG. 2(b)(i)-(iv) also can be used to illustrate a dissolve. Picture 240 is sent with the script module including a dissolve code. The director contains an algorithm for executing this dissolve, preferably using optimized tables. The director thus tells computer 100 how to locally calculate dissolving images 240, 241, 242, 243 at client computer 100, and these images 240, 241, 242, 243 are continuously and rapidly displayed on screen 140.
  • [0030]
    FIG. 2(c)(i)-(iv) show consecutive stages in a linear wipe. During a wipe, picture 250 is made to disappear from display screen 140 across a moving line 260. Line 260 may be horizontal, vertical, diagonal, straight or curved. As line 260 moves from one side or corner of picture 250 displayed on the computer screen 140 to the other side, picture 240 disappears from one side of the line 260 but remains on the other side (FIG. 2(c)(ii)-(iv)). Thus, picture 240 is “wiped out” or removed as line 260 moves across screen 140, and images 251, 252, 253 are calculated by computer 100 with an algorithm found in the director. Wipe line 260 may also start from some place in the center of picture 240 and process outwards, or several wipe lines 260 may remove areas of picture 240 simultaneously starting from different places on picture 240. The kind of wipe that is to be executed by the director is indicated by the script code accompanying picture 240, and the processor of computer 100 locally calculates the wipe with algorithms found in the director. As the wipe line traverses across the image, a screen optionally is revealed to have a particular background 270 (FIG. 2(c)(iv)). Background 270 may be another bit-mapped image such as a photograph, text or graphic, or the background may be a solid.
  • [0031]
    FIG. 2(d) shows a biaxial wipe. Pieces 271, 272, 273, 274 of a bit-mapped picture 240 appear to split apart, and each piece 271, 272, 273, 274 moves in a different direction towards the edges of the display screen 140 (FIG. 2(d)(i)-(iv)). One example splits picture 240 along horizontal and vertical axes 280, 281, with each piece 271, 272, 273, 274 moving towards a respective corner of the display screen 140. There also may be two pieces moving along a diagonal line towards opposite diagonal sides of the screen. Once the wipe begins, the absence of the image optionally reveals another bit-mapped image, a blank screen, a particular color or texture.
  • [0032]
    Low bandwidth television produces a sequence of moves on still bit-mapped images specified by an accompanying script. The production sequence can be rapidly and consecutively strobed and repeated in a particular order, or the sequence can be strobed and repeated in a different order. Repetition and looping of sequences implies that any production sequence has an arbitrarily long and potentially infinite duration. A production sequence may consist of combinations of still images, high resolution photographs, text graphics, high resolution text, and animated computer graphics. While the present embodiment contemplates that the director primarily operates on still images, short video clips residing as stock footage with the director module may optionally be utilized.
  • [0033]
    Low bandwidth television assumes full screen and real time display of images. In contrast to prior art systems where image size must be scaled and quality reduced to conserve bandwidth, the present invention improves the viewing experience by requiring that images cover the entire screen of the personal computer. Larger size and higher resolution pictures are possible because a majority of the production work is contemporaneously performed by the director at the client location rather than prior to network transmission. Real time display is achieved because the image and audio modules are transmitted quickly across the network due to their small bandwidth. The director further guarantees a real time experience by inserting stock footage, looping and stretching whenever image data is delayed due to network latency.
  • [0034]
    Each image module is generally synchronized with an audio track that is sent with the script. The audio track optionally includes music tracks, Foley effects, and voiceovers. An audio engine has a capability of mixing multiple audio tracks and adding special audio effects such as reverb and audio delays in real-time. The director module includes a high quality audio synthesizer having a file size of about 20 megabytes.
  • [0035]
    One major difference between the low bandwidth production system of the present invention and prior art video production systems is the degree to which a finished product is sent over a network or stored on a disk. Prior art Internet video devices (e.g. MPEG) send a finished product over the network, while the present invention sends only a partial product and a script and then finishes the video production at the client station with the director. Much greater bandwidth is required for the prior systems of sending a finished series of images over the network than it does to send a partially completed set of images with a script describing how the images are to be animated, and then finishing the animation of the images at the client computer. In a disk storage environment, much more disk space is required to store all of the pixels of a series of images than to store one image and script code representing how the images are to be animated.
  • [0036]
    Furthermore, the video production method of the present invention is much faster than prior art methods despite the reassembly time for still image production at the client. The speed of the prior art method of downloading video images from the Internet is limited by a bottleneck at the modem. By contrast, while the video production of the present invention is uncompleted at the time it arrives at the client computer, the processor reconstructs the production from the images and the script much more quickly than the delay occasioned at the modem.
  • [0037]
    LBTV has a number of advantageous characteristics. It uses the same audio and visual language of film and video production standards. Smooth and continuous motion is produced in real-time as compared to standard methods of viewing images from networks. There is no image latency because the image stills and script are transmitted rapidly in comparatively small files. Moving images are displayed in real-time because the director quickly calculates the production sequence at the client computer from the stills and script. The images are displayed at sixty fields per second (in NTSC) with anti-aliased graphics, high-resolution imagery, full-screen displays and high-quality audio. These capabilities are realized because the majority of the work is done by exploiting the processor and memory at the client computer.
  • [0038]
    Although digitized video clips may be used with LBTV, their large bandwidth implies that they are utilized sparingly. However, clip bandwidth can be decreased with keys to reduce their size, or with other special effects such as strobing or posterization. In strobing, every fifth video frame is displayed and frozen. Stock footage stored at the client computer may also be used since it requires no network transmission time.
  • [0039]
    The present invention also provides stand-in and loops to permit an immediate and continuous viewing experience without caching. Initially, only the script module and the earliest part of the image data from the image module are sent across the network. Thus, presentation of images and sound begins immediately for the viewer without downloading of the entire image file. Neither is it necessary for the image and sound data to cache in the client computer memory. To prevent latency problems, the director inserts stock footage as stand-ins or causes the images already received to loop or stretch in the production sequence. Therefore, in contrast to prior art systems where the visual stream is interrupted or the viewer must wait while the images are downloaded, the director ensures a continuous viewing experience.
  • [0040]
    The present invention is also applicable to receiving a production module comprising a script module, an image module, and an audio module, from a disk drive, e.g. a CD-ROM, rather than obtaining this module over a network. While digital video disks (DVDs) provide for real time viewing at approximately sixty frames per second, low bandwidth production techniques further increase the number and run time of programs that can be stored on a single DVD. Moreover, LBTV does this without data compression.
  • [0041]
    FIG. 3 is a flowchart of the steps in creating and viewing a low bandwidth television production. A user first loads a plug-in in step 310. The plug-in contains a director module including algorithms to perform all of the video “moves,” as well as stock footage and other utilities. The loading is done on a one-time basis, although the plug-in may be updated periodically, e.g. when new algorithms are added to the director (step 315). The plug-in may be downloaded from a network server, or the plug-in may be uploaded from a disk drive, for example, a magnetic disk or a CD-ROM.
  • [0042]
    A particular video production begins in step 320. The production module includes an image module, an audio module and a script module. Initially, only the script module and first viewing parts of the image and audio modules are transmitted over the network so that viewing begins immediately without caching. Viewing is initiated either by clicking on a link in a web site and receiving transmitted data from a network (e.g. the Internet) via a server, or by reading from a disk drive, for example, a magnetic disk or a CD-ROM.
  • [0043]
    The director module uses the script module to generate initial video and audio sequences from the image module and the audio module (step 330). The video and audio sequences are played on the video screen and through stereo speakers of the personal computer (step 340). Meanwhile, more data from the image module and audio module are loaded across the network into the client computer (step 370). The director module continues to work on the newly received data from the image and audio modules with cues from the script module to generate new visual and audio sequences.
  • [0044]
    If there is a gap at any time in the production due to latency or data transfer problems (step 345), the director maintains a continuous real time presentation by inserting stock footage or providing looping (step 360). As long as there is more data being received from the network (step 365), the director continues to load data from the image and audio modules (step 370). When program data transmission is complete, a user may return to play another video and audio sequence (step 380), or terminate the program (step 390).
  • [0045]
    FIGS. 4(a) and (b) illustrate software components of the various modules of the present invention. The plug-in comprises director module 410, which includes full screen transition algorithms 420 and partial screen effects algorithms 430 (FIG. 4(a)). Examples of full screen transitions are moving bitmaps 421, wipes 422, and animation programs 423. Director 410 further comprises instrument sample libraries 440, stills 450, and stock footage 460. Stock footage 460 may include short video clips. Each of the modules is on the order of 20 megabytes. Software algorithms of director module 410 are designated by Global Unique Identifiers (GUIs) to permit indexing of algorithms.
  • [0046]
    Production module 470 includes script module 475 with commands in an edit decision list (EDL), image module 480 having bit-mapped images of the still pictures utilized in the production, including photographs 481, graphic images 482, and short video clips 483 (FIG. 4(b)). Audio module 490 includes music score 491, voiceovers 492 and sound effects 493. Production module 470 further includes optional new effects 495, which may be identified as needed for a specific production module 470. New effects software algorithms 495 are identified by the edit decision list of script module 480 via respective GUIs to determine whether algorithms 495 are already present in director module 410.
  • [0047]
    FIG. 5 illustrates a User Interface (UI) for an authoring tool to create production modules 470 as a series of pages 510. A user first specifies page 511 corresponding to a first in a series of effects in a sequence. Button bars 520, 521, 522, 523 are selected to edit pages 510. EDL commands are attached to page 511 by clicking on button bars 520-523 to create script module 480. Bit-mapped still image files are attached to page 511 to form image module 490, and sound effects files are attached to page 511 to make audio module 480. Preview window 530 displays still bitmapped images, and a list of file names for image, audio and script (EDL) files is displayed in preview window 540. Once a bitmapped image, audio file, and edit decision list are associated with page 511, the process is repeated for pages 512, 513, 514, 515, etc. Production module 470 is complete once all of pages 510 are created and assembled. A production editor can then go back and re-edit any of the pages.
Citations de brevets
Brevet cité Date de dépôt Date de publication Déposant Titre
US4758881 *2 juin 198719 juil. 1988Eastman Kodak CompanyStill video frame store memory
US4797750 *16 avr. 198610 janv. 1989John Hopkins UniversityMethod and apparatus for transmitting/recording computer-generated displays on an information channel having only audio bandwidth
US4870579 *1 oct. 198726 sept. 1989Neonics, Inc.System and method of predicting subjective reactions
US4996642 *25 sept. 198926 févr. 1991Neonics, Inc.System and method for recommending items
US5101364 *9 févr. 199031 mars 1992Massachusetts Institute Of TechnologyMethod and facility for dynamic video composition and viewing
US5130794 *29 mars 199014 juil. 1992Ritchey Kurtis JPanoramic display system
US5204969 *19 mars 199220 avr. 1993Macromedia, Inc.Sound editing system using visually displayed control line for altering specified characteristic of adjacent segment of stored waveform
US5353396 *4 juin 19924 oct. 1994Altsys CorporationSystem and method for generating complex calligraphic curves
US5361333 *4 juin 19921 nov. 1994Altsys CorporationSystem and method for generating self-overlapping calligraphic images
US5434959 *11 févr. 199218 juil. 1995Macromedia, Inc.System and method of generating variable width lines within a graphics system
US5467443 *25 sept. 199114 nov. 1995Macromedia, Inc.System and method for automatically generating derived graphic elements
US5500927 *18 mars 199319 mars 1996Macromedia, Inc.System and method for simplifying a computer-generated path
US5564001 *24 juin 19948 oct. 1996Multimedia Systems CorporationMethod and system for interactively transmitting multimedia information over a network which requires a reduced bandwidth
US5592602 *17 mai 19947 janv. 1997Macromedia, Inc.User interface and method for controlling and displaying multimedia motion, visual, and sound effects of an object on a display
US5594855 *9 janv. 199514 janv. 1997Macromedia, Inc.System and method for generating real time calligraphic curves
US5623593 *27 juin 199422 avr. 1997Macromedia, Inc.System and method for automatically spacing characters
US5630017 *31 mai 199513 mai 1997Bright Star Technology, Inc.Advanced tools for speech synchronized animation
US5640553 *15 sept. 199517 juin 1997Infonautics CorporationRelevance normalization for documents retrieved from an information retrieval system in response to a query
US5640590 *18 nov. 199217 juin 1997Canon Information Systems, Inc.Method and apparatus for scripting a text-to-speech-based multimedia presentation
US5761499 *21 déc. 19952 juin 1998Novell, Inc.Method for managing globally distributed software components
US5764276 *31 oct. 19969 juin 1998Interactive Pictures CorporationMethod and apparatus for providing perceived video viewing experiences using still images
US5781188 *27 juin 199614 juil. 1998SoftimageIndicating activeness of clips and applying effects to clips and tracks in a timeline of a multimedia work
US5796952 *21 mars 199718 août 1998Dot Com Development, Inc.Method and apparatus for tracking client interaction with a network resource and creating client profiles and resource database
US5801686 *28 févr. 19961 sept. 1998Videologic LimitedComputer display systems
US5808610 *28 août 199615 sept. 1998Macromedia, Inc.Method and system of docking panels
US5822537 *5 avr. 199613 oct. 1998At&T Corp.Multimedia networked system detecting congestion by monitoring buffers' threshold and compensating by reducing video transmittal rate then reducing audio playback rate
US5832100 *3 mai 19933 nov. 1998Trw Inc.Method and apparatus for converting documents between paper medium and electronic media using a user profile
US5841438 *10 oct. 199724 nov. 1998Intervoice Limited PartnershipVisual aid for bandwidth allocation in multimedia scripting tools
US5845299 *29 juil. 19961 déc. 1998Rae Technology LlcDraw-based editor for web pages
US5852435 *12 avr. 199622 déc. 1998Avid Technology, Inc.Digital multimedia editing and data management system
US5859641 *10 oct. 199712 janv. 1999Intervoice Limited PartnershipAutomatic bandwidth allocation in multimedia scripting tools
US5880788 *25 mars 19969 mars 1999Interval Research CorporationAutomated synchronization of video image sequences to new soundtracks
US5910795 *14 nov. 19948 juin 1999Videologic LimitedDigital image signal processing
US5911145 *29 juil. 19968 juin 1999Rae Technology, Inc.Hierarchical structure editor for web sites
US5915094 *2 juin 199722 juin 1999International Business Machines CorporationDisk access method for delivering multimedia and video information on demand over wide area networks
US5915256 *5 nov. 199722 juin 1999Newsweek, Inc.Multimedia method and apparatus for presenting a story using a bimodal spine
US5940080 *12 sept. 199617 août 1999Macromedia, Inc.Method and apparatus for displaying anti-aliased text
US5943046 *19 juil. 199524 août 1999Intervoice Limited PartnershipSystems and methods for the distribution of multimedia information
US5963203 *3 juil. 19975 oct. 1999Obvious Technology, Inc.Interactive video icon with designated viewing position
US5982364 *8 avr. 19969 nov. 1999Quantel, Ltd.Video processing system including frame position indicators
US5990941 *18 août 199523 nov. 1999Interactive Pictures CorporationMethod and apparatus for the interactive display of any portion of a spherical image
US5990972 *22 oct. 199623 nov. 1999Lucent Technologies, Inc.System and method for displaying a video menu
US5995091 *10 mai 199630 nov. 1999Learn2.Com, Inc.System and method for streaming multimedia data
US5999173 *3 avr. 19927 déc. 1999Adobe Systems IncorporatedMethod and apparatus for video editing with video clip representations displayed along a time line
US6005561 *14 déc. 199421 déc. 1999The 3Do CompanyInteractive information delivery system
US6006241 *14 mars 199721 déc. 1999Microsoft CorporationProduction of a video stream with synchronized annotations over a computer network
US6061403 *15 juil. 19999 mai 2000International Businbess Machines CorporationComputer program product for selectively reducing bandwidth of real-time video data
US6072503 *28 avr. 19976 juin 2000Hitachi, Ltd.Video synchronization processing method and apparatus
US6075843 *5 déc. 199613 juin 2000Intervoice Limited PartnershipUser device-independent transaction model
US6081262 *4 déc. 199627 juin 2000Quark, Inc.Method and apparatus for generating multi-media presentations
US6088027 *8 janv. 199811 juil. 2000Macromedia, Inc.Method and apparatus for screen object manipulation
US6121981 *19 mai 199719 sept. 2000Microsoft CorporationMethod and system for generating arbitrary-shaped animation in the user interface of a computer
US6128712 *31 janv. 19973 oct. 2000Macromedia, Inc.Method and apparatus for improving playback of interactive multimedia works
US6134373 *4 nov. 199117 oct. 2000Samsung Electronics Co., Ltd.System for recording and reproducing a wide bandwidth video signal via a narrow bandwidth medium
US6139197 *4 mars 199731 oct. 2000Seeitfirst.ComMethod and system automatically forwarding snapshots created from a compressed digital video stream
US6154600 *5 août 199728 nov. 2000Applied Magic, Inc.Media editor for non-linear editing system
US6172672 *18 déc. 19969 janv. 2001Seeltfirst.ComMethod and system for providing snapshots from a compressed digital video stream
US6173317 *14 mars 19979 janv. 2001Microsoft CorporationStreaming and displaying a video stream with synchronized annotations over a computer network
US6177930 *28 mars 199723 janv. 2001International Business Machines Corp.System and method for enabling a user to move between cyclically transmitted image streams
US6195692 *2 juin 199727 févr. 2001Sony CorporationTelevision/internet system having multiple data stream connections
US6240459 *16 juil. 199929 mai 2001Cddb, Inc.Network delivery of interactive entertainment synchronized to playback of audio recordings
US6258061 *8 déc. 199410 juil. 2001Possis Medical, Inc.Thrombectomy and tissue removal device
US6373490 *9 mars 199816 avr. 2002Macromedia, Inc.Using remembered properties to create and regenerate points along an editable path
US6374260 *28 févr. 200016 avr. 2002Magnifi, Inc.Method and apparatus for uploading, indexing, analyzing, and searching media content
US6380950 *19 janv. 199930 avr. 2002Globalstreams, Inc.Low bandwidth television
US6397230 *27 août 199728 mai 2002Geo Interactive Media Group, Ltd.Real-time multimedia transmission
US6397387 *2 juin 199728 mai 2002Sony CorporationClient and server system
US6438315 *7 mai 199720 août 2002Sony CorporationData input method, encoding apparatus, and data processing apparatus
US6459439 *9 mars 19981 oct. 2002Macromedia, Inc.Reshaping of paths without respect to control points
US6535634 *13 août 199918 mars 2003Globalstreams, Inc.Video image compression/decompression apparatus and method
US6558431 *11 sept. 19986 mai 2003Macromedia, Inc.Storing valid and invalid markup language in strict and relaxed tables respectively
US6573907 *4 oct. 19993 juin 2003Obvious TechnologyNetwork distribution and management of interactive video and multi-media containers
US6771276 *27 oct. 20003 août 2004Macromedia, Inc.Two-dimensional drawing environment utilizing perspective grids
US6789105 *9 avr. 20027 sept. 2004Collaboration Properties, Inc.Multiple-editor authoring of multimedia documents including real-time video and time-insensitive media
US6912688 *20 mars 199728 juin 2005Sony CorporationScript editor
US6941517 *12 déc. 20016 sept. 2005Vibe Solutions Group, Inc.Low bandwidth television
US6992983 *5 mai 200031 janv. 2006Macromedia, Inc.Bandwidth detection in a heterogeneous network with parallel and proxy modes
US7039643 *10 avr. 20012 mai 2006Adobe Systems IncorporatedSystem, method and apparatus for converting and integrating media files
US7086032 *20 févr. 20031 août 2006Adobe Systems IncorporatedSystem and method for representation of object animation within presentations of software application programs
US20010013009 *19 mai 19989 août 2001Daniel R. GreeningSystem and method for computer-based marketing
US20010037508 *1 mai 20011 nov. 2001Debby HindusVariable bandwidth communication systems and methods
US20020023111 *16 sept. 199821 févr. 2002Samir AroraDraw-based editor for web pages
US20020080159 *12 déc. 200127 juin 2002Montgomery Joseph PaulLow bandwidth television
US20030106063 *24 déc. 20025 juin 2003Guedalia Jacob LeonMethod and systems for scalable representation of multimedia data for progressive asynchronous transmission
US20050125714 *27 avr. 20049 juin 2005Eric FreemanDocument stream operating system
US20050159104 *20 janv. 200421 juil. 2005Tim ValleySystems, methods and apparatus for operating a broadcast network
Référencé par
Brevet citant Date de dépôt Date de publication Déposant Titre
US799687829 août 20009 août 2011At&T Intellectual Property Ii, L.P.System and method for generating coded video sequences from still media
US821881128 sept. 200710 juil. 2012Uti Limited PartnershipMethod and system for video interaction based on motion swarms
US89550318 août 201110 févr. 2015At&T Intellectual Property Ii, L.P.System and method for generating coded video sequences from still media
US20090273712 *1 mai 20085 nov. 2009Elliott LandySystem and method for real-time synchronization of a video resource and different audio resources
US20110200305 *26 avr. 201118 août 2011Dacreous Co. Limited Liability CompanyLow bandwidth television
Classifications
Classification aux États-Unis715/723, 348/E05.022, 715/731, 715/716, 348/E11.006, 715/719
Classification internationaleH04N7/26, G11B27/00, G06F3/00
Classification coopérativeH04N19/25, H04N11/042, H04N5/222, H04N11/02
Classification européenneH04N7/26J12, H04N7/26J8, H04N5/222, H04N11/04B
Événements juridiques
DateCodeÉvénementDescription
24 janv. 2007ASAssignment
Owner name: VIBE SOLUTIONS GROUP, INC., MISSOURI
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GLOBALSTREAMS, INC.;REEL/FRAME:018795/0986
Effective date: 20050415
11 nov. 2009ASAssignment
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MONTGOMERY, JOSEPH PAUL;MOORE, MICHAEL RICHARD YOUNG;HARTFORD, STEPHEN A.;AND OTHERS;REEL/FRAME:023498/0560;SIGNING DATES FROM 19990318 TO 19990401
Owner name: CREDIT MANAGERS ASSOCIATION OF CALIFORNIA, CALIFOR
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PLAY INDUSTRIES, INC. D/B/A PLAY INCORPORATED;REEL/FRAME:023504/0291
Effective date: 20091005
Owner name: DACREOUS CO. LIMITED LIABILITY COMPANY, DELAWARE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VIBE SOLUTIONS GROUP, INC.;REEL/FRAME:023498/0598
Effective date: 20090514
15 janv. 2010ASAssignment
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:KELL, STEVEN R.;REEL/FRAME:023796/0792
Effective date: 20090618
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:HARTFORD, STEPHEN A.;REEL/FRAME:023796/0709
Effective date: 20090717
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:MOONEYHAM, MARK R.;REEL/FRAME:023796/0760
Effective date: 20090903
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:TURCOTTE, KENNETH A.;REEL/FRAME:023796/0787
Effective date: 20090911
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:MONTGOMERY (SOLE HEIR AND SUCCESSOR IN TITLE TO JOSEPH PAUL MONTGOMERY), MICHELLE;REEL/FRAME:023796/0586
Effective date: 20091129
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:KAYE, DANIEL A.;REEL/FRAME:023796/0782
Effective date: 20090911
Owner name: PLAY INDUSTRIES, INC., CALIFORNIA
Free format text: FICTITIOUS BUSINESS NAME STATEMENT;ASSIGNOR:PLAY INCORPORATED;REEL/FRAME:023796/0394
Effective date: 19960214
Owner name: PLAY STREAMING MEDIA GROUP, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CREDIT MANAGERS ASSOCIATION OF CALIFORNIA;REEL/FRAME:023796/0827
Effective date: 20010130
Owner name: GLOBALSTREAMS, INC., CALIFORNIA
Free format text: CHANGE OF NAME;ASSIGNOR:PLAY STREAMING MEDIA GROUP, INC.;REEL/FRAME:023796/0854
Effective date: 20010515
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:SCHAEM, STEPHAN D.;REEL/FRAME:023796/0842
Effective date: 20090825
19 janv. 2010ASAssignment
Owner name: PLAY INCORPORATED, CALIFORNIA
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:MOORE, MICHAEL RICHARD YOUNG;REEL/FRAME:023807/0851
Effective date: 20090909