US20030177193A1 - Systems and methods for generating video e-mail - Google Patents

Systems and methods for generating video e-mail Download PDF

Info

Publication number
US20030177193A1
US20030177193A1 US10/388,036 US38803603A US2003177193A1 US 20030177193 A1 US20030177193 A1 US 20030177193A1 US 38803603 A US38803603 A US 38803603A US 2003177193 A1 US2003177193 A1 US 2003177193A1
Authority
US
United States
Prior art keywords
video
mail
audio
software
player
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/388,036
Inventor
Daniel Budge
David Glass
Alvin Pivowar
Mike Wells
Robert Scheussler
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US10/388,036 priority Critical patent/US20030177193A1/en
Publication of US20030177193A1 publication Critical patent/US20030177193A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/08Annexed information, e.g. attachments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10Multimedia information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21Monitoring or handling of messages
    • H04L51/216Handling conversation history, e.g. grouping of messages in sessions or threads
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/56Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]

Definitions

  • Electronic mail stores messages and delivers them when the addressee is ready to receive them, in a so-called “store-and-forward” manner.
  • the basic e-mail system consists of a front-end mail client and a back-end mail server.
  • the e-mail client is a program running on an individual user's computer which composes, sends, reads, and typically stores e-mail.
  • the e-mail server is a program running on a network server which the e-mail client contacts to send and receive messages.
  • INTERNET e-mail utilizes a SMTP (Simple Mail Transport Protocol) mail server to send mail and a POP (Post Office Protocol) server to receive mail.
  • SMTP Simple Mail Transport Protocol
  • POP Post Office Protocol
  • an e-mail client To send e-mail, an e-mail client contacts an SMTP mail server which moves the message to a POP server where it is sorted and made available to the recipient. The recipient's e-mail client logs on to the POP server and requests to see the messages that have accumulated in the mailbox.
  • e-mail communications involve the transfer of text. Text-only e-mail, however, does not utilize the full potential of this emerging form of communications.
  • One aspect of this invention is a sending subsystem and a receiving subsystem remotely interconnected with a communications link.
  • the sending sub-system incorporates a processor which executes a video e-mail recorder program.
  • Video e-mail contains audio and video, not just video.
  • the recorder combines video from a video camera and audio from a microphone into a message file.
  • the message file can optionally incorporate a video e-mail player program. This message file is then transferred from the sending subsystem to the receiving subsystem over the communications link.
  • the receiving subsystem has a video monitor and a speaker.
  • the receiving subsystem also incorporates a processor which executes the video e-mail player program obtained from the message file or otherwise preloaded into the receiving subsystem processor. The player separates the video and audio portions of the message from the message file, causing the video portion to be displayed on the monitor and the audio portion to be played on the speaker.
  • the recorder incorporates a video encoder, an audio encoder, and a video/audio multiplexer.
  • the video encoder processes video data at its input, generating encoded video data at its output.
  • the audio encoder processes audio data at its input, generating encoded audio data at its output.
  • the multiplexer combines the encoded video and encoded audio so that these portions of a video e-mail message remain synchronized in time relative to each other, resulting in a multiplexed multimedia data output.
  • a recorder manager controls these various recorder components to create video e-mail messages.
  • Yet another aspect of this invention is a video e-mail data file.
  • the data file includes encoded data packets, and for each data packet there is a type indicator associated therewith designating the data packet as having either encoded audio data or encoded video data, and a video e-mail player selectively attached to the data file.
  • the player is in an executable format such that execution of the video e-mail file causes execution of the player.
  • the player includes a demultiplexer, an audio decoder, and a video decoder.
  • Each encoded data packet contains a portion of a video e-mail message and is routed by the demultiplexer to either the audio decoder or the video decoder depending on the type indicator, which designates the data packet as having either encoded audio data or encoded video data.
  • Still another aspect of this invention is a graphical user interface which provides visual information for the creation of video e-mail messages.
  • the graphical user interface includes a display and a virtual video cassette recorder, both responsive to user inputs.
  • the display selectively provides the user a view of either current video data or stored video data.
  • the virtual video cassette recorder provides the user visual controls for storage of video data, as shown in the display, and retrieval of stored video data.
  • a further aspect of this invention is an improved video e-mail system.
  • the system provides means for capturing a video image and an audio signal.
  • the video image and audio signal are encoded and combined into a multimedia data file.
  • Selectively attached to this data file is an executable video e-mail player.
  • the video e-mail system provides a means for transferring this multimedia data file to an e-mail client for eventual transfer to an e-mail recipient.
  • FIG. 1 is a block diagram illustrating a sending sub-system, communications link and a receiving sub-system for video e-mail;
  • FIGS. 2 A- 2 C are a block diagram of the environment in which video e-mail software resides
  • FIG. 3 is a block diagram of a preferred video e-mail recorder
  • FIG. 4 is a block diagram of a preferred video e-mail player
  • FIG. 5 illustrates a preferred video e-mail file format
  • FIG. 6 illustrates a portion of a graphical user interface for video e-mail
  • FIGS. 7 A- 7 B are a functional flow diagram of a video e-mail system
  • FIG. 8 is a block diagram of a preferred H.261 video encoder for a video e-mail recorder
  • FIG. 9 is a block diagram of a preferred H.261 video decoder for a video e-mail player
  • FIG. 10 is a block diagram of a preferred H.263 video encoder for a video e-mail recorder
  • FIG. 11 is a block diagram of a preferred H.263 video decoder for a video e-mail player
  • FIG. 12 is a block diagram of a preferred G.723 audio encoder for a video e-mail recorder.
  • FIG. 13 is a block diagram of a preferred G.723 audio decoder for a video e-mail player.
  • the video e-mail system creates files of combined audio and video frames in the form of video e-mail files or self-contained executable video e-mail files.
  • These audio-video files can be transmitted in any conventional manner that digital information can be transmitted.
  • these audio-video files are electronic-mail (e-mail) ready and can be sent using any personal computer (PC) mail utility over the INTERNET or via on-line services such as America Online or CompuServe.
  • PC personal computer
  • FIG. 1 illustrates a preferred embodiment of the video e-mail sending sub-system 2 and receiving sub-system 4 and associated network interfaces 6 and communications link 8 according to the present invention.
  • the sending sub-system 2 is based on a PC 10 having an enclosure 12 containing conventional PC electronics including a motherboard containing the CPU and associated chip set, bus, power supply and various interface and drive electronics, such as hard disk and video display controllers.
  • the sending system also has a video display 14 , a keyboard 18 and an input mouse 19 .
  • PC 10 may have other input and output devices not shown.
  • a preferred PC for the sending system is a conventional “wintel” configuration based on Intel Corporation's family of microcomputer circuits, such as the 486 and PENTIUM family and Microsoft Corporation's WINDOWS operating systems such as WINDOWS 3.1, WINDOWS 95, or WINDOWS NT.
  • the video e-mail system according to the present invention is compatible with a wide range of computer platforms and operating systems.
  • the sending system PC 10 executes video e-mail software 50 which provides for the creation of video e-mail messages and the transfer of those messages to a conventional e-mail client, such as EUDORA PRO 3.0 from Qualcomm Inc., San Diego, Calif.
  • the sending sub-system 2 has a video input device 20 , an audio input device 30 and an audio output device 40 to support the creation and review of video e-mail messages.
  • the video input device 20 can be any image source, such as one of many types of video cameras, such as digital cameras, desktop video cameras, video camcorders, parallel-port cameras, and handycams. Some type of video input devices may require video capture electronics 22 which are typically contained on a single board within the PC enclosure 12 and mated with the bus provided on the PC motherboard.
  • the audio input device 30 can be any of various types of microphones or any sound source.
  • the microphone 30 typically plugs into a sound card 42 which is contained in the PC enclosure 12 and mated with the bus provided on the PC motherboard.
  • the sound card 42 provides analog-to-digital conversion for the microphone analog output and typically also provides an input amplifier for the microphone along with other audio processing electronics.
  • the sound card also provides a digital-to-analog converter and audio output amplifiers to drive an audio output device 40 .
  • the audio output device 40 may be any of a variety of speakers, headphones, or similar voice or music-quality sound-reproduction devices.
  • One of ordinary skill in the art will recognize that the video and audio data described above may be stored on various media, such as magnetic or optical disks, and input into the sending sub-system 2 through a corresponding storage media peripheral device, such as a disk drive or CD player.
  • the receiving sub-system 4 is also based on a PC 10 A as described above for the sending sub-system 2 .
  • the receiving sub-system 4 includes a sound card 42 A and a speaker 40 A, as described above for the sending sub-system 2 , in order to play back the audio portion of a received video e-mail.
  • the receiving sub-system 4 also includes a video display device 14 A, ordinarily a standard computer monitor, to play back the video portion.
  • a significant feature of the video e-mail system according to the present invention is that a video e-mail message is optionally sent with an attached executable video e-mail player, as described in detail below.
  • the receiving sub-system 4 need only include conventional PC hardware and peripherals and execute conventional software, such as widely available Email client programs, in order to receive and playback received video e-mail messages.
  • the communications link 8 may be any of a variety of communications channels which allow the transfer of digital data, such as Public Switched Telephone Network (PSTN), the INTERNET, local area networks (LANS), and wide area networks (WANS) to name a few.
  • PSTN Public Switched Telephone Network
  • INTERNET local area networks
  • WANS wide area networks
  • the network interfaces 6 , 6 A may be modem drivers, network adapter drivers, or terminal adapter drivers, for example.
  • FIG. 2 illustrates the preferred embodiment of the environment in which the video e-mail software for the sending sub-system 2 and receiving sub-system 4 resides, as shown in FIG. 2B.
  • the main software components of the video e-mail system are the video e-mail recorder 210 and the video e-mail player 220 .
  • the video e-mail recorder 210 receives as inputs video message data from the operating system video software 230 , audio message data from the sound card driver 240 , and user inputs from the keyboard driver 250 .
  • the video e-mail recorder 210 outputs user prompts to the video graphics-adapter driver 260 .
  • the video e-mail recorder 210 also executes the Email client 270 and passes the video e-mail file to the Email client 270 .
  • the video e-mail player receives as inputs the video message file from the Email client 270 and user inputs from the keyboard driver 250 .
  • the video e-mail player 220 outputs video message data and user prompts to the video graphics-adapter driver 260 and audio message data to the sound card driver 240 .
  • FIG. 3 shows a block diagram of a preferred embodiment of the video e-mail recorder 210 .
  • the recorder has a video encoder 310 which encodes and typically compresses video message data originating from a video input device and routed to the video encoder via the PC operating system video driver.
  • the recorder also has an audio encoder 320 which encodes and typically compresses audio message data originating from an audio input device and routed to the audio encoder from the sound card driver.
  • the encoded and typically compressed video and audio data streams are fed into a video/audio multiplexer 330 which places the video and audio data into a first-in-first-out (FIFO) buffer and multiplexes these data streams so as to maintain synchronism between the video and audio portions of the e-mail message.
  • the multiplexer 330 stores the video e-mail clip or message 335 in a temporary file 340 .
  • the video player 350 optionally is appended to this temporary file 340 in executable form.
  • the temporary file may reside on hard disk, floppy disk, memory, or any other storage media.
  • a graphical user interface (GUI) 360 provides for user control of the recorder functions.
  • a recorder manager 370 coordinates the various recorder functions and interfaces with the Email client software residing on the PC.
  • video e-mail messages are sent as video e-mail files or self-contained executable video files.
  • the video e-mail player may reside on the receiving PC and, when executed, read the video e-mail file.
  • the video e-mail player is transferred in executable form as an appended portion of the self-contained executable video file.
  • FIG. 4 shows a block diagram of a preferred embodiment of the video e-mail player 220 .
  • the player reads a video e-mail file 410 , originating from the resident E-mail client.
  • the player retrieves the video message, or clip, 420 from this video file.
  • the player has a demultiplexer 430 which separates the video and audio data from the video file.
  • the video data is decoded and typically decompressed with a video decoder 440 which transfers the video data to the video driver.
  • the audio data is decoded and typically decompressed with an audio decoder 450 which transfers the audio data to the sound card driver.
  • the various player functions are directed by the player manager 460 .
  • a graphical user interface (GUI) 480 provides for user control of the player functions.
  • GUI graphical user interface
  • FIG. 5 illustrates a preferred embodiment of the video e-mail file.
  • a video e-mail file 500 is made up of a file header 510 , one or more media packets 520 , and a file footer 530 . If the video player is not embedded in the file, the file header is not present. Otherwise, the file header 510 is the executable stand-alone video player, which occupies 62020 bytes in a specific embodiment of this invention.
  • Each media packet 520 is made up of a type byte 522 and a payload 524 .
  • the type byte 522 is an ASCII “A” or “V,” where “A” designates an audio packet and “V” designates a video packet.
  • the payload 524 is variable in length. As an example, the payload is 18 bytes, a full frame, of CELP-encoded data if an audio packet is designated and 64 bytes, which could be partial or multiple frames, of H.261-encoded data if a video packet is designated.
  • the file footer 530 is made up of a “VF” field 532 , a user name 534 , a file name 536 , and a player length field 538 .
  • the “VF” field 532 is the ASCII characters “V” and “F” in that order, indicating that this file 500 was generated by the video mail recorder of the present invention.
  • the user name 534 is made up of 128 bytes of a null-delimited ASCII character string containing a name provided by the user who recorded the particular video e-mail contained in the file.
  • the file name 536 is 13 bytes of a null-delimited ASCII character string containing the name of the file, as provided by the video e-mail recorder.
  • Player length 538 is a 32-bit unsigned value which designates the length in bytes (62020) of the executable video e-mail player if embedded in this file. If the player is not present, this value is 0.
  • the order of the bytes within this field is DCBA, where A is the most significant byte and D is the least significant byte. This byte order is sometimes referred to as “little-endian.” For example, 62020 is 0000F244 16 . These bytes are stored as 44, F2, 00, 00.
  • FIG. 6 illustrates a portion of the GUI for the preferred embodiment of the video e-mail recorder.
  • This GUI provides a virtual VCR, whose controls appear to the user as shown in the bottom portion of FIG. 6.
  • the virtual VCR allows the user to record and save both audio and video from the local camera and microphone interfaced to the user's PC.
  • the operation of this virtual VCR is similar to that of a standard VCR. Control over the VCR is accomplished with virtual buttons provided on the VCR display.
  • the RECORD button 610 is “pressed,” that is, activated with a point and click operation of a mouse device, for example.
  • the virtual VCR will continue to record until the STOP button 620 is pressed.
  • the video recorder stores video and audio data in a temporary file. If the SAVE VMail button 630 is pressed, this file is stored to hard disk along with the video e-mail player software 220 . If the SAVE file button 640 is pressed, this file is stored to hard disk without the video e-mail player. The latter option assumes the video e-mail player software 220 is present on the receiving sub-system 4 .
  • a significant feature of this invention is the ability to attach an executable version of the video e-mail player 220 to a video e-mail message file 500 .
  • This feature allows the receiving sub-system 4 to play a video e-mail message without the necessity of previously installing special software at the receiving sub-system 4 , such as the video e-mail player 220 .
  • the PLAY button 650 is pressed to watch a previously recorded message.
  • the LOAD button 660 allows a user to select which stored message to watch.
  • the MAIL button 670 is pressed to immediately send a recorded message.
  • Voice recording is either voice activated or activated in a push-to-talk mode by pressing the TALK button 680 .
  • FIGS. 7A and 7B provide a functional flow overview of both the sending and receiving portions of the video e-mail system as described above.
  • the sending user 710 receives prompts and provides inputs to the sending system 720 with respect to controlling the virtual VCR, embedding the video e-mail player 220 into the video e-mail message file 500 , and controlling the Email client.
  • the sending system 720 creates and transmits a video e-mail message to the receiving system 730 .
  • the recipient user 740 receives prompts and provides inputs to the receiving system 730 with respect to selecting and playing the video e-mail message.
  • FIGS. 8 - 11 illustrate the preferred embodiments of the video codecs, i.e. the video encoder 310 and video decoder 440 .
  • These codecs are based on public standards. These standards are H.261 and H.263, both from the International Telecommunication Union (ITU).
  • FIG. 8 is a block diagram for a preferred embodiment of a video encoder based on the H.261 standard. This encoder is described in “Techniques and Standards for Image, Video, and Audio Coding,” by K. R. Rao and J. J. Hwang, Prentice Hall (ISBN 0-13-309907-5).
  • FIGS. 9 and 11 are block diagrams of preferred embodiments of a H.261 video decoder, also described in the Rao and Hwang reference.
  • FIGS. 10 and 11 are block diagrams of preferred embodiments of a H.263 video encoder and a H.263 video decoder, respectively. These, too, are described in the Rao and Hwang reference. Although not a part of this invention, one of ordinary skill in the art will recognize that various specific implementations of the functions shown in FIGS. 8 - 11 are possible.
  • the encoder function can be described on a per-macroblock basis.
  • the current macroblock is extracted from the input frame 810 , which can be in one of two size formats, Common International Format (CIF) and Quarter CIF (QCIF).
  • CIF Common International Format
  • QCIF Quarter CIF
  • a Motion Estimator 812 uses the current macroblock and the reconstructed prior frame from a Frame Memory 870 to determine candidate motion vectors which, approximately, minimize the sum of absolute differences between the motion compensated prior frame and the current macroblock. These differences are computed by an adder 815 .
  • An Intra/Inter Decision 825 is made based on the variance of the differences computed by the adder 815 .
  • a large variance implies scene change or fast motion, and inter-picture prediction, even with motion estimation, can be ineffective.
  • the macroblock is sent Intra, i.e. with intra-picture correlation reduction only. If the variance is small, the macroblock is sent Inter, i.e. with inter-picture prediction. Additionally, according to the H.261 specification, the macroblock is sent Intra without regard to anything else if it has not been sent Intra in the last 132 frames. If the macroblock is sent Intra, the original macroblock is transformed by the discrete cosine transform (DCT) 830 . If it is sent Inter, the differences from the adder 815 are transformed by the DCT. The transformed macroblock is quantized using a user-selected quantizer 835 .
  • DCT discrete cosine transform
  • the transformed and quantized coefficients are encoded using the variable length codes (VLC) 840 given in the H.261 specification for these coefficients.
  • the macroblock type 845 is determined by the results of the Intra/Inter decision and, if Inter, the results of the Motion Estimator 812 .
  • the macroblock type is encoded with the VLC 847 given in the H.261 specification for macroblock types. If the macroblock is determined to be Inter, the motion vectors are encoded using the VLC 850 given in the H.261 specification for motion vectors.
  • the various codes are transmitted in the order given in the H.261 specification 855 .
  • the transformed and quantized coefficients are de-quantized 860 and inverse transformed 865 .
  • the results of the inverse transform are stored as is in the Frame Memory 870 for the reconstructed current macroblock. If the macroblock was determined Inter, an adder 867 adds the results of the inverse transform to the motion compensated reconstructed prior frame and stores this in the Frame Memory 870 for the reconstructed current macroblock.
  • the decoder function can be described on a per-macroblock basis.
  • the input bitstream 902 consisting of variable length codes, is buffer 904 and provided to the variable length decoder 910 .
  • the macroblock type is decoded from the bitstream to determine the mode switch control 920 .
  • the quantized transform coefficients are decoded 930 . If the macroblock is Inter, the motion vectors are decoded 940 .
  • the transformed and quantized coefficients are de-quantized 950 and inverse transformed 955 . If the macroblock is Intra, the results of the inverse transform 960 become the reconstructed current macroblock 965 . If the macroblock is Inter, the results of the inverse transform 960 are added 970 to the motion compensated reconstructed prior frame 975 to form the reconstructed current macroblock 965 .
  • the H.263 encoder function can be described on a per-macroblock basis.
  • the current macroblock is extracted from the input frame, M1 1005 .
  • Integer pixel motion estimation, ME1 1010 , and half-pixel motion estimation, ME2 1015 use the current macroblock and the reconstructed prior frame, M2 1020 , to determine candidate motion vectors which, approximately, minimize the sum of absolute differences (SAD) between the motion compensated prior frame and the current macroblock. These differences are computed by the adder 1025 .
  • the Intra/Inter decision is also made based on ME1 1010 .
  • the macroblock is sent Intra without regard to anything else if it has not been sent Intra in the last 132 frames. If the macroblock is sent Intra, the original macroblock is transformed by the DCT 1030 . If it is sent Inter, the differences from the adder 1025 are transformed by the DCT 1030 . The transformed macroblock is quantized using a user-selected quantizer 1035 . The transformed and quantized coefficients are encoded 1040 using variable length codes for transform coefficients, VLC[C], given in the H.263 specification. The macroblock type is determined 1045 by the results of the Intra/Inter decision.
  • the motion vectors are encoded 1050 using the variable length codes for motion vectors, VLC[M], given in the H.263 specification.
  • the various codes are transmitted via a multiplexer 1070 and buffer 1075 in the order given in the H.263 specification, as directed under coding control, CC 1080 .
  • the transformed and quantized coefficients are de-quantized, IQ 1055 , and inverse transformed, IDCT 1060 . If the macroblock was determined Intra, the results of the inverse transform are stored, as is, in the frame memory, M2 1020 , for the reconstructed current macroblock. If the macroblock was determined Inter, the results of the inverse transform are added 1065 to the motion compensated reconstructed prior frame and stored in the frame memory, M2 1020 , for the reconstructed current macroblock.
  • the H.263 decoder function can be described on a per-macroblock basis.
  • the input bitstream 1102 consisting of variable length codes, is transferred via a buffer 1110 and a demultiplexer 1120 to a variable length decoder for transform coefficients, VLD(C) 1130 .
  • the macroblock type is decoded 1125 from the bitstream. If the macroblock is Inter, a variable length decoder for motion vectors, VLD[M] 1140 is used.
  • the transformed and quantized coefficients are de-quantized, IQ 1150 , and inverse transformed, IDCT 1160 . If the macroblock is Intra, the results of the inverse transform become the reconstructed current macroblock. If the macroblock is Inter, the results of the inverse transform are added 1170 to the motion compensated reconstructed prior frame, derived from the decoded frame store 1180 and predictor 1190 to form the reconstructed current macroblock.
  • FIGS. 12 and 13 illustrate the preferred embodiments of the audio codecs, i.e. the audio encoder 320 and the audio decoder 450 .
  • the preferred audio codecs are based on the G.723 and CELP standards.
  • FIGS. 12 and 13 are block diagrams of the preferred G.723 audio encoder and G.723 audio decoder, respectively. These are described in the ITU standard of that name, specifically the Oct. 17, 1995 draft.
  • the preferred CELP audio codecs are based on the Federal (DoD) standard number 1016. Although not a part of this invention, one of ordinary skill in the art will recognize that various specific implementations of the functions shown in FIGS. 12 - 13 are possible.
  • the G.723 encoder function can be described on a per-frame basis.
  • Frames consist of 240 samples of speech, y, at a sampling rate of 8 KHz. Thus, each frame covers a duration of 30 ms. These frames are further subdivided into subframes consisting of 60 samples each.
  • the current frame, s is extracted 1210 from the input speech, y.
  • the DC component of the input frame is removed by a high-pass filter 1215 , resulting in filtered speech, x.
  • LPC coefficients, A are determined by linear predictive coding analysis 1220 of the filtered speech, x.
  • LSP frequencies are computed from the LPC coefficients, A, for sub-frame 3 and quantized 1225 .
  • the quantized LSP frequencies are decoded 1230 .
  • a full set of LSP frequencies for the entire frame are interpolated 1235 and a set of reconstructed LPC coefficients, ⁇ , are computed.
  • a set of formant perceptually weighted LPC coefficients
  • W perceptually weighted LPC coefficients
  • This filter 1240 is then applied to create the weighted speech signal, f
  • a pair of open loop pitch periods, L are estimated 1245 for the frame, one for sub-frames 1 and 2, and the other for sub-frames 3 and 4 .
  • a set of harmonic noise shaping filter coefficients, P are computed.
  • This filter 1250 is then applied to the weighted speech, f, to create the harmonic weighted vector, w.
  • the reconstructed LPC coefficients, ⁇ the formant perceptually weighted LPC coefficients, W, and the harmonic noise shaping coefficients, P, the combined impulse response, h, is computed 1255 .
  • the reconstructed LPC coefficients, ⁇ the formant perceptually weighted LPC coefficients, W, and the harmonic noise shaping coefficients, P, the zero input response, z, is computed 1260 and subtracted 1265 from the harmonic weighted vector, w, to form the target vector, t.
  • the 85-element or 170-element adaptive code books are searched 1270 to determine the optimal pitch, L, gain, ⁇ , and corresponding pitch prediction contribution, p.
  • the pitch prediction contribution, p is subtracted 1275 from the target vector, t, to form the residual vector, r.
  • the residual vector, r is quantized 1280 resulting in a pulse position index, ppos, pulse amplitude index, mamp, pulse position grid bit, grid, and pulse sign code word, pamp.
  • the pulse contribution, ⁇ , of the excitation is computed 1285 .
  • the pitch contribution, u of the excitation is computed 1290 .
  • the two contributions, u and ⁇ , are summed 1294 to form the combined excitation, e.
  • This is run through the combined filter determined by the reconstruction LPC coefficients, ⁇ , the format perceptually weighted LPC coefficients, W, and the harmonic noise shaping coefficients, P, forming the synthesis response.
  • the synthesis response and the various filter coefficients are saved 1298 for use by the next frame.
  • the G.723 decoder function can be described on a per-frame basis.
  • the quantized LSP frequencies are decoded 1310 .
  • a full set of LSP frequencies for the entire frame are interpolated 1320 and a set of reconstructed LPC coefficients, ⁇ , are computed.
  • the pulse contribution, ⁇ , of the excitation is computed 1330 .
  • the pitch contribution, u, of the excitation is computed 1340 .
  • the two contributions, u and ⁇ , are summed 1350 to form the combined excitation, e.
  • the pitch post filter 1360 resulting in pitch-post-filtered speech ppf.
  • the post-filtered speech ppf is filtered 1370 resulting in synthesized speech, sy.
  • a formant post-filter 1380 is applied to the synthesized speech, sy, resulting in post-filtered speech, pf.
  • the energy, E of the synthesized speech is computed.
  • the gain of the post-filtered speech is adjusted 1390 forming the final speech, q.

Abstract

Video messages are created in a manner that allows transparent delivery over any electronic mail (e-mail) system. The audio and video components of the message are recorded, encoded, and synchronously combined into a video message file. A player is selectively attached to the video message file to create an executable file which can be delivered as a standard binary file over conventional communications networks. To view the received video e-mail, the recipient executes the received file and the attached player automatically plays the video and audio message or the recipient executes the previously installed player which plays the video message.

Description

    REFERENCE TO RELATED APPLICATION
  • This application claims priority benefit under 35 U.S.C. §120 from, and is a continuation of U.S. patent application Ser. No. 09/456,770, filed on Dec. 7, 1999, titled “E-MAIL SYSTEM WITH VIDEO E-MAIL PLAYER,” which is a continuation of U.S. patent application Ser. No. 08/995,572, filed on Dec. 22, 1997, titled “E-MAIL SYSTEM WITH VIDEO E-MAIL PLAYER,” now U.S. Pat. No. 6,014,689, which claims a priority benefit under 35 U.S.C. §119(e) from U.S. Provisional Patent Application No. 60/048,378 filed Jun. 3, 1997, entitled “VIDEO E-MAIL APPARATUS AND METHOD.”[0001]
  • BACKGROUND OF THE INVENTION
  • Electronic mail, or e-mail, stores messages and delivers them when the addressee is ready to receive them, in a so-called “store-and-forward” manner. The basic e-mail system consists of a front-end mail client and a back-end mail server. The e-mail client is a program running on an individual user's computer which composes, sends, reads, and typically stores e-mail. The e-mail server is a program running on a network server which the e-mail client contacts to send and receive messages. For example, INTERNET e-mail utilizes a SMTP (Simple Mail Transport Protocol) mail server to send mail and a POP (Post Office Protocol) server to receive mail. To send e-mail, an e-mail client contacts an SMTP mail server which moves the message to a POP server where it is sorted and made available to the recipient. The recipient's e-mail client logs on to the POP server and requests to see the messages that have accumulated in the mailbox. Conventionally, e-mail communications involve the transfer of text. Text-only e-mail, however, does not utilize the full potential of this emerging form of communications. [0002]
  • SUMMARY OF THE INVENTION
  • One aspect of this invention is a sending subsystem and a receiving subsystem remotely interconnected with a communications link. The sending sub-system incorporates a processor which executes a video e-mail recorder program. “Video e-mail” contains audio and video, not just video. The recorder combines video from a video camera and audio from a microphone into a message file. The message file can optionally incorporate a video e-mail player program. This message file is then transferred from the sending subsystem to the receiving subsystem over the communications link. The receiving subsystem has a video monitor and a speaker. The receiving subsystem also incorporates a processor which executes the video e-mail player program obtained from the message file or otherwise preloaded into the receiving subsystem processor. The player separates the video and audio portions of the message from the message file, causing the video portion to be displayed on the monitor and the audio portion to be played on the speaker. [0003]
  • Another aspect of this invention is a video e-mail recorder. The recorder incorporates a video encoder, an audio encoder, and a video/audio multiplexer. The video encoder processes video data at its input, generating encoded video data at its output. The audio encoder processes audio data at its input, generating encoded audio data at its output The multiplexer combines the encoded video and encoded audio so that these portions of a video e-mail message remain synchronized in time relative to each other, resulting in a multiplexed multimedia data output. A recorder manager controls these various recorder components to create video e-mail messages. [0004]
  • Yet another aspect of this invention is a video e-mail data file. The data file includes encoded data packets, and for each data packet there is a type indicator associated therewith designating the data packet as having either encoded audio data or encoded video data, and a video e-mail player selectively attached to the data file. The player is in an executable format such that execution of the video e-mail file causes execution of the player. The player includes a demultiplexer, an audio decoder, and a video decoder. Each encoded data packet contains a portion of a video e-mail message and is routed by the demultiplexer to either the audio decoder or the video decoder depending on the type indicator, which designates the data packet as having either encoded audio data or encoded video data. [0005]
  • Still another aspect of this invention is a graphical user interface which provides visual information for the creation of video e-mail messages. The graphical user interface includes a display and a virtual video cassette recorder, both responsive to user inputs. The display selectively provides the user a view of either current video data or stored video data. The virtual video cassette recorder provides the user visual controls for storage of video data, as shown in the display, and retrieval of stored video data. [0006]
  • A further aspect of this invention is an improved video e-mail system. The system provides means for capturing a video image and an audio signal. The video image and audio signal are encoded and combined into a multimedia data file. Selectively attached to this data file is an executable video e-mail player. The video e-mail system provides a means for transferring this multimedia data file to an e-mail client for eventual transfer to an e-mail recipient. [0007]
  • One more aspect of this invention is a video e-mail method. A video message is generated at a sending location and a file is created from the video message. An executable player is attached to the file, which is sent over a communications link to a receiving location. The player is executed at the receiving location to retrieve the video message from the file.[0008]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram illustrating a sending sub-system, communications link and a receiving sub-system for video e-mail; [0009]
  • FIGS. [0010] 2A-2C are a block diagram of the environment in which video e-mail software resides;
  • FIG. 3 is a block diagram of a preferred video e-mail recorder; [0011]
  • FIG. 4 is a block diagram of a preferred video e-mail player; [0012]
  • FIG. 5 illustrates a preferred video e-mail file format; [0013]
  • FIG. 6 illustrates a portion of a graphical user interface for video e-mail; [0014]
  • FIGS. [0015] 7A-7B are a functional flow diagram of a video e-mail system;
  • FIG. 8 is a block diagram of a preferred H.261 video encoder for a video e-mail recorder; [0016]
  • FIG. 9 is a block diagram of a preferred H.261 video decoder for a video e-mail player; [0017]
  • FIG. 10 is a block diagram of a preferred H.263 video encoder for a video e-mail recorder; [0018]
  • FIG. 11 is a block diagram of a preferred H.263 video decoder for a video e-mail player; [0019]
  • FIG. 12 is a block diagram of a preferred G.723 audio encoder for a video e-mail recorder; and [0020]
  • FIG. 13 is a block diagram of a preferred G.723 audio decoder for a video e-mail player.[0021]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • The video e-mail system according to the present invention creates files of combined audio and video frames in the form of video e-mail files or self-contained executable video e-mail files. These audio-video files can be transmitted in any conventional manner that digital information can be transmitted. In a preferred embodiment, these audio-video files are electronic-mail (e-mail) ready and can be sent using any personal computer (PC) mail utility over the INTERNET or via on-line services such as America Online or CompuServe. [0022]
  • FIG. 1 illustrates a preferred embodiment of the video [0023] e-mail sending sub-system 2 and receiving sub-system 4 and associated network interfaces 6 and communications link 8 according to the present invention. The sending sub-system 2 is based on a PC 10 having an enclosure 12 containing conventional PC electronics including a motherboard containing the CPU and associated chip set, bus, power supply and various interface and drive electronics, such as hard disk and video display controllers. The sending system also has a video display 14, a keyboard 18 and an input mouse 19. In addition, as is well known in the art, PC 10 may have other input and output devices not shown. A preferred PC for the sending system is a conventional “wintel” configuration based on Intel Corporation's family of microcomputer circuits, such as the 486 and PENTIUM family and Microsoft Corporation's WINDOWS operating systems such as WINDOWS 3.1, WINDOWS 95, or WINDOWS NT. One of ordinary skill will recognize, however, that the video e-mail system according to the present invention is compatible with a wide range of computer platforms and operating systems. In addition to operating system software, the sending system PC 10 executes video e-mail software 50 which provides for the creation of video e-mail messages and the transfer of those messages to a conventional e-mail client, such as EUDORA PRO 3.0 from Qualcomm Inc., San Diego, Calif.
  • In addition to standard PC peripherals, the sending [0024] sub-system 2 has a video input device 20, an audio input device 30 and an audio output device 40 to support the creation and review of video e-mail messages. The video input device 20 can be any image source, such as one of many types of video cameras, such as digital cameras, desktop video cameras, video camcorders, parallel-port cameras, and handycams. Some type of video input devices may require video capture electronics 22 which are typically contained on a single board within the PC enclosure 12 and mated with the bus provided on the PC motherboard.
  • The [0025] audio input device 30 can be any of various types of microphones or any sound source. The microphone 30 typically plugs into a sound card 42 which is contained in the PC enclosure 12 and mated with the bus provided on the PC motherboard. The sound card 42 provides analog-to-digital conversion for the microphone analog output and typically also provides an input amplifier for the microphone along with other audio processing electronics. The sound card also provides a digital-to-analog converter and audio output amplifiers to drive an audio output device 40. The audio output device 40 may be any of a variety of speakers, headphones, or similar voice or music-quality sound-reproduction devices. One of ordinary skill in the art will recognize that the video and audio data described above may be stored on various media, such as magnetic or optical disks, and input into the sending sub-system 2 through a corresponding storage media peripheral device, such as a disk drive or CD player.
  • The [0026] receiving sub-system 4 is also based on a PC 10A as described above for the sending sub-system 2. The receiving sub-system 4 includes a sound card 42A and a speaker 40A, as described above for the sending sub-system 2, in order to play back the audio portion of a received video e-mail. The receiving sub-system 4 also includes a video display device 14A, ordinarily a standard computer monitor, to play back the video portion.
  • A significant feature of the video e-mail system according to the present invention is that a video e-mail message is optionally sent with an attached executable video e-mail player, as described in detail below. As a result, the receiving [0027] sub-system 4 need only include conventional PC hardware and peripherals and execute conventional software, such as widely available Email client programs, in order to receive and playback received video e-mail messages.
  • Also shown in FIG. 1 are [0028] network interfaces 6, 6A and a communications link 8 connecting the sending and receiving systems. The communications link 8 may be any of a variety of communications channels which allow the transfer of digital data, such as Public Switched Telephone Network (PSTN), the INTERNET, local area networks (LANS), and wide area networks (WANS) to name a few. The network interfaces 6, 6A may be modem drivers, network adapter drivers, or terminal adapter drivers, for example.
  • FIG. 2 illustrates the preferred embodiment of the environment in which the video e-mail software for the sending [0029] sub-system 2 and receiving sub-system 4 resides, as shown in FIG. 2B. The main software components of the video e-mail system are the video e-mail recorder 210 and the video e-mail player 220. The video e-mail recorder 210 receives as inputs video message data from the operating system video software 230, audio message data from the sound card driver 240, and user inputs from the keyboard driver 250. The video e-mail recorder 210 outputs user prompts to the video graphics-adapter driver 260. The video e-mail recorder 210 also executes the Email client 270 and passes the video e-mail file to the Email client 270.
  • The video e-mail player receives as inputs the video message file from the [0030] Email client 270 and user inputs from the keyboard driver 250. The video e-mail player 220 outputs video message data and user prompts to the video graphics-adapter driver 260 and audio message data to the sound card driver 240.
  • FIG. 3 shows a block diagram of a preferred embodiment of the [0031] video e-mail recorder 210. The recorder has a video encoder 310 which encodes and typically compresses video message data originating from a video input device and routed to the video encoder via the PC operating system video driver. The recorder also has an audio encoder 320 which encodes and typically compresses audio message data originating from an audio input device and routed to the audio encoder from the sound card driver. The encoded and typically compressed video and audio data streams are fed into a video/audio multiplexer 330 which places the video and audio data into a first-in-first-out (FIFO) buffer and multiplexes these data streams so as to maintain synchronism between the video and audio portions of the e-mail message. The multiplexer 330 stores the video e-mail clip or message 335 in a temporary file 340. The video player 350 optionally is appended to this temporary file 340 in executable form. The temporary file may reside on hard disk, floppy disk, memory, or any other storage media. A graphical user interface (GUI) 360 provides for user control of the recorder functions. A recorder manager 370 coordinates the various recorder functions and interfaces with the Email client software residing on the PC.
  • As described above, video e-mail messages are sent as video e-mail files or self-contained executable video files. The video e-mail player may reside on the receiving PC and, when executed, read the video e-mail file. Alternatively, the video e-mail player is transferred in executable form as an appended portion of the self-contained executable video file. [0032]
  • FIG. 4 shows a block diagram of a preferred embodiment of the [0033] video e-mail player 220. The player reads a video e-mail file 410, originating from the resident E-mail client. The player retrieves the video message, or clip, 420 from this video file. The player has a demultiplexer 430 which separates the video and audio data from the video file. The video data is decoded and typically decompressed with a video decoder 440 which transfers the video data to the video driver. The audio data is decoded and typically decompressed with an audio decoder 450 which transfers the audio data to the sound card driver. The various player functions are directed by the player manager 460. A graphical user interface (GUI) 480 provides for user control of the player functions.
  • FIG. 5 illustrates a preferred embodiment of the video e-mail file. A [0034] video e-mail file 500 is made up of a file header 510, one or more media packets 520, and a file footer 530. If the video player is not embedded in the file, the file header is not present. Otherwise, the file header 510 is the executable stand-alone video player, which occupies 62020 bytes in a specific embodiment of this invention.
  • Each [0035] media packet 520 is made up of a type byte 522 and a payload 524. The type byte 522 is an ASCII “A” or “V,” where “A” designates an audio packet and “V” designates a video packet. The payload 524 is variable in length. As an example, the payload is 18 bytes, a full frame, of CELP-encoded data if an audio packet is designated and 64 bytes, which could be partial or multiple frames, of H.261-encoded data if a video packet is designated.
  • The [0036] file footer 530 is made up of a “VF” field 532, a user name 534, a file name 536, and a player length field 538. The “VF” field 532 is the ASCII characters “V” and “F” in that order, indicating that this file 500 was generated by the video mail recorder of the present invention. The user name 534 is made up of 128 bytes of a null-delimited ASCII character string containing a name provided by the user who recorded the particular video e-mail contained in the file. The file name 536 is 13 bytes of a null-delimited ASCII character string containing the name of the file, as provided by the video e-mail recorder. Player length 538 is a 32-bit unsigned value which designates the length in bytes (62020) of the executable video e-mail player if embedded in this file. If the player is not present, this value is 0. The order of the bytes within this field is DCBA, where A is the most significant byte and D is the least significant byte. This byte order is sometimes referred to as “little-endian.” For example, 62020 is 0000F24416. These bytes are stored as 44, F2, 00, 00.
  • FIG. 6 illustrates a portion of the GUI for the preferred embodiment of the video e-mail recorder. This GUI provides a virtual VCR, whose controls appear to the user as shown in the bottom portion of FIG. 6. The virtual VCR allows the user to record and save both audio and video from the local camera and microphone interfaced to the user's PC. The operation of this virtual VCR is similar to that of a standard VCR. Control over the VCR is accomplished with virtual buttons provided on the VCR display. [0037]
  • To begin recording a video e-mail message, the [0038] RECORD button 610 is “pressed,” that is, activated with a point and click operation of a mouse device, for example. Once started, the virtual VCR will continue to record until the STOP button 620 is pressed. As the recording is made, the video recorder stores video and audio data in a temporary file. If the SAVE VMail button 630 is pressed, this file is stored to hard disk along with the video e-mail player software 220. If the SAVE file button 640 is pressed, this file is stored to hard disk without the video e-mail player. The latter option assumes the video e-mail player software 220 is present on the receiving sub-system 4. As noted above, however, a significant feature of this invention is the ability to attach an executable version of the video e-mail player 220 to a video e-mail message file 500. This feature allows the receiving sub-system 4 to play a video e-mail message without the necessity of previously installing special software at the receiving sub-system 4, such as the video e-mail player 220.
  • The [0039] PLAY button 650 is pressed to watch a previously recorded message. The LOAD button 660 allows a user to select which stored message to watch. The MAIL button 670 is pressed to immediately send a recorded message. Voice recording is either voice activated or activated in a push-to-talk mode by pressing the TALK button 680.
  • FIGS. 7A and 7B provide a functional flow overview of both the sending and receiving portions of the video e-mail system as described above. The sending [0040] user 710 receives prompts and provides inputs to the sending system 720 with respect to controlling the virtual VCR, embedding the video e-mail player 220 into the video e-mail message file 500, and controlling the Email client. The sending system 720 creates and transmits a video e-mail message to the receiving system 730. The recipient user 740 receives prompts and provides inputs to the receiving system 730 with respect to selecting and playing the video e-mail message.
  • FIGS. [0041] 8-11 illustrate the preferred embodiments of the video codecs, i.e. the video encoder 310 and video decoder 440. These codecs are based on public standards. These standards are H.261 and H.263, both from the International Telecommunication Union (ITU). FIG. 8 is a block diagram for a preferred embodiment of a video encoder based on the H.261 standard. This encoder is described in “Techniques and Standards for Image, Video, and Audio Coding,” by K. R. Rao and J. J. Hwang, Prentice Hall (ISBN 0-13-309907-5). FIG. 9 is a block diagram showing a preferred embodiment of a H.261 video decoder, also described in the Rao and Hwang reference. FIGS. 10 and 11 are block diagrams of preferred embodiments of a H.263 video encoder and a H.263 video decoder, respectively. These, too, are described in the Rao and Hwang reference. Although not a part of this invention, one of ordinary skill in the art will recognize that various specific implementations of the functions shown in FIGS. 8-11 are possible.
  • Referring to FIG. 8, the encoder function can be described on a per-macroblock basis. The current macroblock is extracted from the [0042] input frame 810, which can be in one of two size formats, Common International Format (CIF) and Quarter CIF (QCIF). A Motion Estimator 812 uses the current macroblock and the reconstructed prior frame from a Frame Memory 870 to determine candidate motion vectors which, approximately, minimize the sum of absolute differences between the motion compensated prior frame and the current macroblock. These differences are computed by an adder 815. An Intra/Inter Decision 825 is made based on the variance of the differences computed by the adder 815. A large variance implies scene change or fast motion, and inter-picture prediction, even with motion estimation, can be ineffective. Hence, if the variance is large, the macroblock is sent Intra, i.e. with intra-picture correlation reduction only. If the variance is small, the macroblock is sent Inter, i.e. with inter-picture prediction. Additionally, according to the H.261 specification, the macroblock is sent Intra without regard to anything else if it has not been sent Intra in the last 132 frames. If the macroblock is sent Intra, the original macroblock is transformed by the discrete cosine transform (DCT) 830. If it is sent Inter, the differences from the adder 815 are transformed by the DCT. The transformed macroblock is quantized using a user-selected quantizer 835. The transformed and quantized coefficients are encoded using the variable length codes (VLC) 840 given in the H.261 specification for these coefficients. The macroblock type 845 is determined by the results of the Intra/Inter decision and, if Inter, the results of the Motion Estimator 812. The macroblock type is encoded with the VLC 847 given in the H.261 specification for macroblock types. If the macroblock is determined to be Inter, the motion vectors are encoded using the VLC 850 given in the H.261 specification for motion vectors. The various codes are transmitted in the order given in the H.261 specification 855. The transformed and quantized coefficients are de-quantized 860 and inverse transformed 865. If the macroblock was determined Intra, the results of the inverse transform are stored as is in the Frame Memory 870 for the reconstructed current macroblock. If the macroblock was determined Inter, an adder 867 adds the results of the inverse transform to the motion compensated reconstructed prior frame and stores this in the Frame Memory 870 for the reconstructed current macroblock.
  • Referring to FIG. 9, the decoder function can be described on a per-macroblock basis. The input bitstream [0043] 902, consisting of variable length codes, is buffer 904 and provided to the variable length decoder 910. The macroblock type is decoded from the bitstream to determine the mode switch control 920. The quantized transform coefficients are decoded 930. If the macroblock is Inter, the motion vectors are decoded 940. The transformed and quantized coefficients are de-quantized 950 and inverse transformed 955. If the macroblock is Intra, the results of the inverse transform 960 become the reconstructed current macroblock 965. If the macroblock is Inter, the results of the inverse transform 960 are added 970 to the motion compensated reconstructed prior frame 975 to form the reconstructed current macroblock 965.
  • Referring to FIG. 10, the H.263 encoder function can be described on a per-macroblock basis. The current macroblock is extracted from the input frame, M1 [0044] 1005. Integer pixel motion estimation, ME1 1010, and half-pixel motion estimation, ME2 1015, use the current macroblock and the reconstructed prior frame, M2 1020, to determine candidate motion vectors which, approximately, minimize the sum of absolute differences (SAD) between the motion compensated prior frame and the current macroblock. These differences are computed by the adder 1025. The Intra/Inter decision is also made based on ME1 1010. Additionally, according to H.263 specification, the macroblock is sent Intra without regard to anything else if it has not been sent Intra in the last 132 frames. If the macroblock is sent Intra, the original macroblock is transformed by the DCT 1030. If it is sent Inter, the differences from the adder 1025 are transformed by the DCT 1030. The transformed macroblock is quantized using a user-selected quantizer 1035. The transformed and quantized coefficients are encoded 1040 using variable length codes for transform coefficients, VLC[C], given in the H.263 specification. The macroblock type is determined 1045 by the results of the Intra/Inter decision. If the macroblock is determined to be Inter, the motion vectors are encoded 1050 using the variable length codes for motion vectors, VLC[M], given in the H.263 specification. The various codes are transmitted via a multiplexer 1070 and buffer 1075 in the order given in the H.263 specification, as directed under coding control, CC 1080. The transformed and quantized coefficients are de-quantized, IQ 1055, and inverse transformed, IDCT 1060. If the macroblock was determined Intra, the results of the inverse transform are stored, as is, in the frame memory, M2 1020, for the reconstructed current macroblock. If the macroblock was determined Inter, the results of the inverse transform are added 1065 to the motion compensated reconstructed prior frame and stored in the frame memory, M2 1020, for the reconstructed current macroblock.
  • Referring to FIG. 11, the H.263 decoder function can be described on a per-macroblock basis. The input bitstream [0045] 1102, consisting of variable length codes, is transferred via a buffer 1110 and a demultiplexer 1120 to a variable length decoder for transform coefficients, VLD(C) 1130. The macroblock type is decoded 1125 from the bitstream. If the macroblock is Inter, a variable length decoder for motion vectors, VLD[M] 1140 is used. The transformed and quantized coefficients are de-quantized, IQ 1150, and inverse transformed, IDCT 1160. If the macroblock is Intra, the results of the inverse transform become the reconstructed current macroblock. If the macroblock is Inter, the results of the inverse transform are added 1170 to the motion compensated reconstructed prior frame, derived from the decoded frame store 1180 and predictor 1190 to form the reconstructed current macroblock.
  • FIGS. 12 and 13 illustrate the preferred embodiments of the audio codecs, i.e. the [0046] audio encoder 320 and the audio decoder 450. The preferred audio codecs are based on the G.723 and CELP standards. FIGS. 12 and 13 are block diagrams of the preferred G.723 audio encoder and G.723 audio decoder, respectively. These are described in the ITU standard of that name, specifically the Oct. 17, 1995 draft. The preferred CELP audio codecs are based on the Federal (DoD) standard number 1016. Although not a part of this invention, one of ordinary skill in the art will recognize that various specific implementations of the functions shown in FIGS. 12-13 are possible.
  • Referring to FIG. 12, the G.723 encoder function can be described on a per-frame basis. Frames consist of 240 samples of speech, y, at a sampling rate of 8 KHz. Thus, each frame covers a duration of 30 ms. These frames are further subdivided into subframes consisting of 60 samples each. The current frame, s, is extracted [0047] 1210 from the input speech, y. The DC component of the input frame is removed by a high-pass filter 1215, resulting in filtered speech, x. LPC coefficients, A, are determined by linear predictive coding analysis 1220 of the filtered speech, x. LSP frequencies are computed from the LPC coefficients, A, for sub-frame 3 and quantized 1225. The quantized LSP frequencies are decoded 1230. A full set of LSP frequencies for the entire frame are interpolated 1235 and a set of reconstructed LPC coefficients, Ã, are computed. From the high-pass filtered speech, x, a set of formant perceptually weighted LPC coefficients, W, are computed. This filter 1240 is then applied to create the weighted speech signal, f A pair of open loop pitch periods, L, are estimated 1245 for the frame, one for sub-frames 1 and 2, and the other for sub-frames 3 and 4. From the weighted speech, f; and pitch periods, L, a set of harmonic noise shaping filter coefficients, P, are computed. This filter 1250 is then applied to the weighted speech, f, to create the harmonic weighted vector, w. Using the reconstructed LPC coefficients, Ã, the formant perceptually weighted LPC coefficients, W, and the harmonic noise shaping coefficients, P, the combined impulse response, h, is computed 1255. Using the reconstructed LPC coefficients, Ã, the formant perceptually weighted LPC coefficients, W, and the harmonic noise shaping coefficients, P, the zero input response, z, is computed 1260 and subtracted 1265 from the harmonic weighted vector, w, to form the target vector, t. Using the vector, t, the impulse response, h, and the estimated pitch, L, the 85-element or 170-element adaptive code books are searched 1270 to determine the optimal pitch, L, gain, β, and corresponding pitch prediction contribution, p. The pitch prediction contribution, p, is subtracted 1275 from the target vector, t, to form the residual vector, r. Using the impulse response, h, and the optimal pitch, L, the residual vector, r, is quantized 1280 resulting in a pulse position index, ppos, pulse amplitude index, mamp, pulse position grid bit, grid, and pulse sign code word, pamp. Using ppos, mamp, grid and pamp, the pulse contribution, ν, of the excitation is computed 1285. Using the results of the adaptive code book search, the pitch contribution, u, of the excitation is computed 1290. The two contributions, u and ν, are summed 1294 to form the combined excitation, e. This is run through the combined filter determined by the reconstruction LPC coefficients, Ã, the format perceptually weighted LPC coefficients, W, and the harmonic noise shaping coefficients, P, forming the synthesis response. The synthesis response and the various filter coefficients are saved 1298 for use by the next frame.
  • Referring to FIG. 13, the G.723 decoder function can be described on a per-frame basis. The quantized LSP frequencies are decoded [0048] 1310. A full set of LSP frequencies for the entire frame are interpolated 1320 and a set of reconstructed LPC coefficients, Ã, are computed. Using the pulse position index, ppos, pulse amplitude index, mamp, pulse position grid bit, grid, and pulse sign code word, pamp, the pulse contribution, ν, of the excitation is computed 1330. Using the results of the adaptive code book search, the pitch contribution, u, of the excitation is computed 1340. The two contributions, u and ν, are summed 1350 to form the combined excitation, e. To this is applied the pitch post filter 1360 resulting in pitch-post-filtered speech ppf. Using the reconstructed LPC coefficients, Ã, the post-filtered speech ppf is filtered 1370 resulting in synthesized speech, sy. A formant post-filter 1380 is applied to the synthesized speech, sy, resulting in post-filtered speech, pf. At the same time, the energy, E, of the synthesized speech is computed. Using the energy, E, the gain of the post-filtered speech is adjusted 1390 forming the final speech, q.
  • The video e-mail apparatus and method according to the present invention has been disclosed in detail in connection with the preferred embodiments, but these embodiments are disclosed by way of examples only and are not to limit the scope of the present invention, which is defined by the claims that follow. One of ordinary skill in the art will appreciate many variations and modifications within the scope of this invention. [0049]

Claims (20)

What is claimed is:
1. A method of generating a file attached to a video e-mail ready for addressing and sending to a recipient, the method comprising:
activating video e-mail software to provide a graphical user interface which governs the preparation of a video clip;
providing within the graphical user interface of the video e-mail software a replay function allowing a user of the video e-mail software to replay at least a portion of audio and video data received from at least one of video capture electronics or audio processing electronics;
providing within the graphical user interface of the video e-mail software a save function allowing the user of the video e-mail software to save at least a portion of the audio and video data; and
providing within the graphical user interface of the video e-mail software a mail function allowing the user of the video e-mail software to generate a video e-mail in an e-mail client, wherein the video e-mail includes a video clip comprising at least a portion of the audio and video data and wherein the e-mail client is separate from the video e-mail software.
2. The method of claim 1, wherein the graphical user interface comprises a virtual video cassette recorder.
3. The method of claim 2, wherein the virtual video cassette recorder further includes at least a play function, a record function, and a stop function.
4. The method of claim 1, further comprising providing within the graphical user interface of the video e-mail software a load function allowing the user of the video e-mail software to load previously saved portions of audio and video data received from at least one of the video capture electronics or the audio processing electronics.
5. The method of claim 1, wherein the save function saves the at least a portion of the audio and video data along with an executable player configured to play the saved audio and video data.
6. The method of claim 1, wherein the video clip comprises a self-contained executable file.
7. The method of claim 6, wherein the self-contained executable file includes an executable player configured to play the audio and video data of the video clip.
8. The method of claim 1, further comprising compressing the audio and video data received from at least one of the video capture electronics or the audio processing electronics into a substantially reduced file to avoid the need for storing comparatively large intermediate files.
9. A method of generating a video e-mail within an e-mail client with software other than the e-mail client, the method comprising:
executing software which accesses stored multimedia data;
executing software which optionally appends a multimedia player to at least a portion of the stored multimedia data, wherein the multimedia player allows a recipient of a video e-mail to review at least the portion of the stored multimedia data; and
executing software which passes at least a portion of the stored multimedia data and when appended, the multimedia player, to the e-mail client, thereby generating the video e-mail within the e-mail client with software other than the e-mail client.
10. The method of claim 9, wherein the software which optionally appends the multimedia player to the stored multimedia data actually appends the multimedia player to at least the portion of the stored multimedia data.
11. The method of claim 9, wherein the software passing the stored multimedia data and optionally the multimedia player, passes an embedded object to the email client.
12. The method of claim 9, wherein the multimedia player comprises a graphical user interface controlling player functions.
13. The method of claim 12, wherein the player functions include play.
14. The method of claim 12, wherein the player functions include stop.
15. The method of claim 12, wherein the player functions include pause.
16. The method of claim 9, wherein the stored multimedia data is generated by compressing audio and video data received from at least one of the video capture electronics or the audio processing electronics.
17. The method of claim 16, wherein the audio and video data is compressed before it is stored to avoid the need for storing comparatively large intermediate files.
18. A computer processing system for generating a video e-mail data to be attached to a video e-mail, the computer processing system comprising:
software which accesses multimedia data;
software other than an e-mail client which passes at least a portion of the multimedia data to the e-mail client instructing the e-mail client to generate a video e-mail including an attached file including the multimedia data.
19. The computer processing system of claim 18, further comprising a processor which executes the software.
20. The computer processing system of claim 18, further comprising hardware for communicating with video capture and audio processing electronics.
US10/388,036 1997-06-03 2003-03-12 Systems and methods for generating video e-mail Abandoned US20030177193A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/388,036 US20030177193A1 (en) 1997-06-03 2003-03-12 Systems and methods for generating video e-mail

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US4837897P 1997-06-03 1997-06-03
US08/995,572 US6014689A (en) 1997-06-03 1997-12-22 E-mail system with a video e-mail player
US09/456,770 US6564248B1 (en) 1997-06-03 1999-12-07 E-mail system with video e-mail player
US10/388,036 US20030177193A1 (en) 1997-06-03 2003-03-12 Systems and methods for generating video e-mail

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/456,770 Continuation US6564248B1 (en) 1997-06-03 1999-12-07 E-mail system with video e-mail player

Publications (1)

Publication Number Publication Date
US20030177193A1 true US20030177193A1 (en) 2003-09-18

Family

ID=26726069

Family Applications (3)

Application Number Title Priority Date Filing Date
US08/995,572 Expired - Lifetime US6014689A (en) 1997-06-03 1997-12-22 E-mail system with a video e-mail player
US09/456,770 Expired - Lifetime US6564248B1 (en) 1997-06-03 1999-12-07 E-mail system with video e-mail player
US10/388,036 Abandoned US20030177193A1 (en) 1997-06-03 2003-03-12 Systems and methods for generating video e-mail

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US08/995,572 Expired - Lifetime US6014689A (en) 1997-06-03 1997-12-22 E-mail system with a video e-mail player
US09/456,770 Expired - Lifetime US6564248B1 (en) 1997-06-03 1999-12-07 E-mail system with video e-mail player

Country Status (1)

Country Link
US (3) US6014689A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010052019A1 (en) * 2000-02-04 2001-12-13 Ovt, Inc. Video mail delivery system
US20070220095A1 (en) * 2006-03-16 2007-09-20 Silver Edward M Systems, methods and computer program products for electronic information transfer by a sender
US20070220096A1 (en) * 2006-03-16 2007-09-20 Silver Edward M Systems, methods and computer program products for obtaining responses to announcement files
US20070230574A1 (en) * 2004-05-25 2007-10-04 Koninklijke Philips Electronics N.C. Method and Device for Encoding Digital Video Data
US20080103867A1 (en) * 2006-10-27 2008-05-01 Darryl Moore Systems, methods and computer program products for user-selected calendar and task alerts
US20080109522A1 (en) * 2006-11-08 2008-05-08 Kuo-Ching Chiang Video/audio electronic mail system and the method of the same
US20090106840A1 (en) * 2007-10-18 2009-04-23 Dreymann Daniel T Certification Of E-Mails With Embedded Code
US20090326979A1 (en) * 2007-02-02 2009-12-31 Koninklijke Philips Electronics N. V. Interactive patient forums
US20100026817A1 (en) * 2007-02-02 2010-02-04 Koninklijke Philips Electronics N. V. Medical video communication systems and methods
US20110047223A1 (en) * 2007-12-07 2011-02-24 Vidiense Technology Pty. Ltd. Method to display a video in an e-mail
US20110191683A1 (en) * 2009-12-04 2011-08-04 Dillard Daniel G Methods and Systems to Enhance Advisor-Client Communications
US8924395B2 (en) 2010-10-06 2014-12-30 Planet Data Solutions System and method for indexing electronic discovery data
US9264649B2 (en) 2009-07-30 2016-02-16 Koninklijke Philips N.V. Medical video communication systems and methods

Families Citing this family (143)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6014689A (en) 1997-06-03 2000-01-11 Smith Micro Software Inc. E-mail system with a video e-mail player
JP3048312U (en) * 1997-10-23 1998-05-06 船井電機株式会社 Terminal and server for combined self-portrait creating game device
JPH11203076A (en) * 1998-01-19 1999-07-30 Brother Ind Ltd Image forming device and recording medium
JP2002510820A (en) * 1998-04-08 2002-04-09 オープン ティーヴィー インコーポレイテッド One-touch email response system and method
JP3521738B2 (en) * 1998-04-08 2004-04-19 日本ビクター株式会社 Optical pickup device, error detection device and its detection method
US6252588B1 (en) * 1998-06-16 2001-06-26 Zentek Technology, Inc. Method and apparatus for providing an audio visual e-mail system
EP1093696A1 (en) * 1998-07-06 2001-04-25 Nokia Corporation Voice mail server, mobile station and method for voice mail message transmission
CN1867068A (en) 1998-07-14 2006-11-22 联合视频制品公司 Client-server based interactive television program guide system with remote server recording
US6366949B1 (en) * 1998-07-30 2002-04-02 Maila Nordic Ab Method and arrangement relating to communication in a network
US6223213B1 (en) * 1998-07-31 2001-04-24 Webtv Networks, Inc. Browser-based email system with user interface for audio/video capture
US6469689B1 (en) * 1998-08-07 2002-10-22 Hewlett-Packard Company Appliance and method of using same having a capability to graphically associate and disassociate data with and from one another
US6253231B1 (en) * 1998-10-07 2001-06-26 Sony Corporation System and method for incorporating image data into electronic mail documents
JP2002535932A (en) * 1999-01-19 2002-10-22 インテグラ5 コミュニケーションズ インコーポレーテッド Method and apparatus for selecting and displaying multimedia messages
US6697942B1 (en) * 1999-02-04 2004-02-24 Earthlink, Inc. Method for remotely managing a remote device using an electronic mail message
US6981023B1 (en) 1999-03-09 2005-12-27 Michael Hamilton Message routing
EP1183610A1 (en) * 1999-03-19 2002-03-06 Zairmail, Inc. Distributed system for conducting physical delivery mail service over the internet
US6449635B1 (en) 1999-04-21 2002-09-10 Mindarrow Systems, Inc. Electronic mail deployment system
US20080039052A1 (en) * 1999-06-02 2008-02-14 Knowles Andrew T Digital Message Processing System
US6795863B1 (en) 1999-08-10 2004-09-21 Intline.Com, Inc. System, device and method for combining streaming video with e-mail
US7099920B1 (en) * 1999-09-03 2006-08-29 Sony Corporation Method and system for creating an e-mail by automatically constituting a text and an attached file of the e-mail basing on at least one words or sentences and picture stored in a single picture file
US9092535B1 (en) 1999-09-21 2015-07-28 Google Inc. E-mail embedded textual hyperlink object
US7840639B1 (en) 1999-09-21 2010-11-23 G&H Nevada-Tek Method and article of manufacture for an automatically executed application program associated with an electronic message
US6360221B1 (en) * 1999-09-21 2002-03-19 Neostar, Inc. Method and apparatus for the production, delivery, and receipt of enhanced e-mail
WO2001028181A1 (en) * 1999-10-12 2001-04-19 Mindarrow Systems, Inc. Executable electronic commercials
US6625812B2 (en) * 1999-10-22 2003-09-23 David Hardin Abrams Method and system for preserving and communicating live views of a remote physical location over a computer network
US20010044829A1 (en) * 1999-11-05 2001-11-22 David Lundberg Remote e-mail management and communication system
EP1104156A1 (en) * 1999-11-17 2001-05-30 I-Tv Media Ag Video mail system for public use and operating method
US6832245B1 (en) 1999-12-01 2004-12-14 At&T Corp. System and method for analyzing communications of user messages to rank users and contacts based on message content
US6687668B2 (en) * 1999-12-31 2004-02-03 C & S Technology Co., Ltd. Method for improvement of G.723.1 processing time and speech quality and for reduction of bit rate in CELP vocoder and CELP vococer using the same
WO2001050293A1 (en) * 2000-01-05 2001-07-12 Majikam L.L.C. Method and system for creating and sending a video e-mail
BE1013301A6 (en) * 2000-02-25 2001-11-06 Yards Nv 9 Method and agent for the transmission of information via email.
CA2299946A1 (en) * 2000-03-03 2001-09-03 Destiny Software Productions Inc. Digital media distribution method and system
DE60132433T2 (en) 2000-03-17 2008-12-24 America Online, Inc. IMMEDIATE MESSAGE TRANSMISSION WITH ADDITIONAL LANGUAGE COMMUNICATION
US7187947B1 (en) 2000-03-28 2007-03-06 Affinity Labs, Llc System and method for communicating selected information to an electronic device
US7979881B1 (en) * 2000-03-30 2011-07-12 Microsoft Corporation System and method for identifying audio/visual programs to be recorded
US7844670B2 (en) 2000-04-03 2010-11-30 Paltalk Holdings, Inc. Method and computer program product for establishing real-time communications between networked computers
US20020023134A1 (en) * 2000-04-03 2002-02-21 Roskowski Steven G. Method and computer program product for establishing real-time communications between networked computers
DE10018143C5 (en) * 2000-04-12 2012-09-06 Oerlikon Trading Ag, Trübbach DLC layer system and method and apparatus for producing such a layer system
US7663652B1 (en) * 2000-05-03 2010-02-16 Morris Reese Enhanced electronic mail delivery system
US6912564B1 (en) 2000-05-04 2005-06-28 America Online, Inc. System for instant messaging the sender and recipients of an e-mail message
US8122363B1 (en) 2000-05-04 2012-02-21 Aol Inc. Presence status indicator
US7979802B1 (en) 2000-05-04 2011-07-12 Aol Inc. Providing supplemental contact information corresponding to a referenced individual
US8132110B1 (en) 2000-05-04 2012-03-06 Aol Inc. Intelligently enabled menu choices based on online presence state in address book
US20130067340A1 (en) 2000-05-04 2013-03-14 Facebook, Inc. Intelligently enabled menu choices based on online presence state in address book
US9100221B2 (en) 2000-05-04 2015-08-04 Facebook, Inc. Systems for messaging senders and recipients of an electronic message
US20130073648A1 (en) 2000-05-04 2013-03-21 Facebook, Inc. Presenting a recipient of an e-mail with an option to instant message a sender or another recipient based on the sender's or the other recipient's address and online status
US20020047892A1 (en) * 2000-05-18 2002-04-25 Gonsalves Charles J. Video messaging and video answering apparatus
WO2001095269A2 (en) * 2000-06-06 2001-12-13 Logan Mark Weavind Digital vending apparatus
US8001190B2 (en) 2001-06-25 2011-08-16 Aol Inc. Email integrated instant messaging
TWI263136B (en) * 2000-06-30 2006-10-01 Seiko Epson Corp Information distribution system, information distribution method, and computer program for executing the method
KR20020004417A (en) * 2000-07-05 2002-01-16 조충희 Video mail service method and system
US7984098B2 (en) 2000-07-25 2011-07-19 AOL, Inc. Video messaging
US7363589B1 (en) 2000-07-28 2008-04-22 Tandberg Telecom A/S System and method for generating invisible notes on a presenter's screen
US7584251B2 (en) * 2000-08-28 2009-09-01 Brown Scott T E-mail messaging system and method for enhanced rich media delivery
DE10043221A1 (en) 2000-09-01 2002-03-28 Picture Clip De Gmbh Soft Und Procedure for sending data with an automated terminal
US7103906B1 (en) 2000-09-29 2006-09-05 International Business Machines Corporation User controlled multi-device media-on-demand system
WO2002031728A2 (en) * 2000-10-06 2002-04-18 Highwired Technologies, Inc. Method and apparatus for creating mixed media messages
US20070121810A1 (en) * 2000-10-06 2007-05-31 Highwired Technologies, Inc. Automatically Mixing Audio Signals in a Predetermined Manner
MXPA03003138A (en) 2000-10-11 2003-07-14 United Video Properties Inc Systems and methods for providing storage of data on servers in an on-demand media delivery system.
US6990452B1 (en) 2000-11-03 2006-01-24 At&T Corp. Method for sending multi-media messages using emoticons
US7203648B1 (en) 2000-11-03 2007-04-10 At&T Corp. Method for sending multi-media messages with customized audio
US7091976B1 (en) 2000-11-03 2006-08-15 At&T Corp. System and method of customizing animated entities for use in a multi-media communication application
US20080040227A1 (en) 2000-11-03 2008-02-14 At&T Corp. System and method of marketing using a multi-media communication system
US6976082B1 (en) 2000-11-03 2005-12-13 At&T Corp. System and method for receiving multi-media messages
US6963839B1 (en) * 2000-11-03 2005-11-08 At&T Corp. System and method of controlling sound in a multi-media communication application
WO2002044950A2 (en) * 2000-11-29 2002-06-06 Logitech, Inc. System and method for video streaming
JP3419756B2 (en) * 2000-12-28 2003-06-23 パナソニック コミュニケーションズ株式会社 Dial-up Internet facsimile machine
US6999989B2 (en) * 2001-03-29 2006-02-14 At&T Corp. Methods for providing video enhanced electronic mail return receipts
NL1018087C2 (en) * 2001-05-16 2002-09-26 Yourfuture N V Information system and method for bringing together supply and demand on a labor market.
US20020180788A1 (en) * 2001-06-01 2002-12-05 Wu Hsiang Min Method of video displaying for E-mails
WO2003003235A1 (en) 2001-06-27 2003-01-09 4 Media, Inc. Improved media delivery platform
US20030018721A1 (en) * 2001-06-29 2003-01-23 Virad Gupta Unified messaging with separate media component storage
US7249165B1 (en) * 2001-07-30 2007-07-24 Enreach Technology, Inc. Method and system for message initiation of digital video recorders peer-to-peer video/media file delivery
AU2002321885A1 (en) 2001-08-03 2003-02-24 Hill-Rom Services, Inc. Patient point-of-care computer system
US20030046348A1 (en) * 2001-08-29 2003-03-06 Pinto Albert Gregory System and method of converting video to bitmap animation for use in electronic mail
JP2003076647A (en) * 2001-08-31 2003-03-14 Hitachi Ltd Mail transmitting/receiving method, and device using it
KR20030020195A (en) * 2001-09-03 2003-03-08 김동현 Voicedata execution system that have decoder and player within
US7716287B2 (en) 2004-03-05 2010-05-11 Aol Inc. Organizing entries in participant lists based on communications strengths
US7774711B2 (en) 2001-09-28 2010-08-10 Aol Inc. Automatic categorization of entries in a contact list
US7512652B1 (en) 2001-09-28 2009-03-31 Aol Llc, A Delaware Limited Liability Company Passive personalization of buddy lists
GB0123564D0 (en) * 2001-10-02 2001-11-21 Bednall Richard Film transmission
JP2003122713A (en) * 2001-10-11 2003-04-25 Sony Corp Information processor and program
US7671861B1 (en) * 2001-11-02 2010-03-02 At&T Intellectual Property Ii, L.P. Apparatus and method of customizing animated entities for use in a multi-media communication application
US7263669B2 (en) * 2001-11-14 2007-08-28 Denholm Enterprises, Inc. Patient communication method and system
US20030095184A1 (en) * 2001-11-22 2003-05-22 Accton Technology Coproration Electronic reception method
US20030223552A1 (en) * 2001-12-05 2003-12-04 Gustav Schoeman Means and method for computerized call logging
TWI254551B (en) * 2001-12-11 2006-05-01 Primax Electronics Ltd Electronic answering machine
KR100563198B1 (en) * 2001-12-14 2006-03-21 에스케이 텔레콤주식회사 Apparatus for Offering Event Image Mail Service using Multimedia Messaging Service and the Method Thereof
US7707591B2 (en) * 2002-02-05 2010-04-27 Talkway, Inc. Integration of audio or video program with application program
IL162886A0 (en) * 2002-02-11 2005-11-20 Beizhan Liu System and process for non-real-time video-based human computer interaction
US7937443B2 (en) * 2002-03-10 2011-05-03 Talkway, Inc. Email messaging program with built-in video and/or audio media recording and/or playback capabilities
US20040032486A1 (en) * 2002-08-16 2004-02-19 Shusman Chad W. Method and apparatus for interactive programming using captioning
US20040210947A1 (en) 2003-04-15 2004-10-21 Shusman Chad W. Method and apparatus for interactive video on demand
US20030196206A1 (en) 2002-04-15 2003-10-16 Shusman Chad W. Method and apparatus for internet-based interactive programming
US7966374B2 (en) * 2002-07-01 2011-06-21 Profiliq Software Inc. Adaptive media messaging, such as for rich media messages incorporating digital content
US7707317B2 (en) * 2002-07-01 2010-04-27 Prolifiq Software Inc. Adaptive electronic messaging
FR2844909A1 (en) * 2002-09-23 2004-03-26 Fabien Sol General public installation audio visual message recording/storing/replay having recorder/camera/video display with keyboard interface with central processing and integrated operating software.
US7308233B2 (en) 2002-10-10 2007-12-11 Aster Wireless System employing wideband wireless communication with super cycle detection
US7263614B2 (en) 2002-12-31 2007-08-28 Aol Llc Implicit access for communications pathway
US9742615B1 (en) 2002-12-31 2017-08-22 Aol Inc. Popularity index
US7945674B2 (en) 2003-04-02 2011-05-17 Aol Inc. Degrees of separation for handling communications
US7493646B2 (en) 2003-01-30 2009-02-17 United Video Properties, Inc. Interactive television systems with digital video recording and adjustable reminders
US20040223606A1 (en) * 2003-03-03 2004-11-11 Noel Enete Host based video clips and transport mechanism
US20040210639A1 (en) 2003-03-26 2004-10-21 Roy Ben-Yoseph Identifying and using identities deemed to be known to a user
US20050033855A1 (en) * 2003-08-05 2005-02-10 Ahmad Moradi Method and apparatus for generating and marketing video e-mail and an intelligent video streaming server
DE10338696A1 (en) * 2003-08-22 2005-03-17 Siemens Ag Method for creating and playing a media file
US7366992B2 (en) * 2003-09-19 2008-04-29 Siemens Medical Solutions Usa, Inc. Method and system for displaying and/or manipulating medical image data
KR100596921B1 (en) * 2003-11-20 2006-07-07 엘지전자 주식회사 method for displaying E-mail in mobile
US7752603B2 (en) * 2003-12-08 2010-07-06 Notable Solutions, Inc. Systems and methods for data interchange among autonomous processing entities
US20060294187A1 (en) * 2004-01-20 2006-12-28 Thomas Hakel Integrated web communications system
US8595146B1 (en) 2004-03-15 2013-11-26 Aol Inc. Social networking permissions
US20050210394A1 (en) * 2004-03-16 2005-09-22 Crandall Evan S Method for providing concurrent audio-video and audio instant messaging sessions
DE502004001164D1 (en) * 2004-06-02 2006-09-21 Ixos Software Ag Method and device for managing electronic messages
GB0414715D0 (en) * 2004-07-01 2004-08-04 Ibm Method and apparatus for instant messaging
US9021529B2 (en) 2004-07-15 2015-04-28 Microsoft Technology Licensing, Llc Content recordation techniques
US9112831B2 (en) 2004-07-28 2015-08-18 International Business Machines Corporation Scalable infrastructure for handling light weight message protocols
US20060026285A1 (en) * 2004-07-28 2006-02-02 David Osofsky Systems and methods for transmitting electronic data
CN100433776C (en) * 2004-10-20 2008-11-12 大竑企业股份有限公司 Network image and sound file fax device and synchronous classification pigeonhole work method
US8055711B2 (en) * 2004-10-29 2011-11-08 Emc Corporation Non-blocking commit protocol systems and methods
US8219073B2 (en) 2004-12-28 2012-07-10 Motorola Mobility, Inc. Method for simlutaneous communications management
US7543020B2 (en) * 2005-02-10 2009-06-02 Cisco Technology, Inc. Distributed client services based on execution of service attributes and data attributes by multiple nodes in resource groups
WO2006092811A2 (en) * 2005-03-03 2006-09-08 Ayyappa Nagubandi A system and method for delivering voice mail
WO2006092810A2 (en) * 2005-03-03 2006-09-08 Ayyappa Nagubandi A system and method for delivering video email
US20060271632A1 (en) * 2005-05-26 2006-11-30 Comcast Cable Holdings, Llc System and method of voicemail and videomail storage for instant messaging users
US9282081B2 (en) 2005-07-28 2016-03-08 Vaporstream Incorporated Reduced traceability electronic message system and method
US7751534B2 (en) * 2005-08-19 2010-07-06 Nicholas Sun System and method for the emergency voice and image e-mail transmitter device
US9681105B2 (en) 2005-12-29 2017-06-13 Rovi Guides, Inc. Interactive media guidance system having multiple devices
US20070244977A1 (en) * 2006-04-18 2007-10-18 Quixote Atkins Dynamic e-mail system and method
US20070288574A1 (en) * 2006-06-09 2007-12-13 Daren Koster System and method of email streaming digital video for subscribers
DE102006040264A1 (en) * 2006-08-28 2008-03-20 Nokia Siemens Networks Gmbh & Co.Kg Implementation method for video mail service in communication network, involves causing transmission of video mail from application server of address to B-subscriber by soft switch in progression of call
US8463927B2 (en) * 2006-12-29 2013-06-11 Ebay Inc. Video mail through peer to peer network
US20080313340A1 (en) * 2007-06-15 2008-12-18 Sony Ericsson Mobile Communications Ab Method and apparatus for sending and receiving content with associated application as an object
US20090019492A1 (en) 2007-07-11 2009-01-15 United Video Properties, Inc. Systems and methods for mirroring and transcoding media content
US20090037826A1 (en) * 2007-07-31 2009-02-05 Christopher Lee Bennetts Video conferencing system
US8478981B2 (en) * 2008-02-27 2013-07-02 Rpost International Limited Method of adding a postscript message to an email
US9563877B2 (en) * 2008-03-11 2017-02-07 Microsoft Technology Licensing, Llc Customizable controls provided by a messaging application for performing selected actions
US9998422B2 (en) * 2008-05-12 2018-06-12 Blackberry Limited Efficient attachment of user-selected files to e-mail from handheld device
US10063934B2 (en) 2008-11-25 2018-08-28 Rovi Technologies Corporation Reducing unicast session duration with restart TV
US8738443B2 (en) * 2009-05-18 2014-05-27 George M. Davison System and method for advertising using pushed video
US9183543B2 (en) * 2010-02-19 2015-11-10 Prolifiq Software Inc. Tracking digital content objects
US9235971B1 (en) * 2011-06-28 2016-01-12 Emc Corporation Service window optimized system alert engine
US8805418B2 (en) 2011-12-23 2014-08-12 United Video Properties, Inc. Methods and systems for performing actions based on location-based rules
US9749321B2 (en) 2013-01-22 2017-08-29 Prolifiq Software Inc. System for multi-point publication syndication

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5442744A (en) * 1992-04-03 1995-08-15 Sun Microsystems, Inc. Methods and apparatus for displaying and editing multimedia information
US5557320A (en) * 1995-01-31 1996-09-17 Krebs; Mark Video mail delivery system
US5748499A (en) * 1995-09-19 1998-05-05 Sony Corporation Computer graphics data recording and playback system with a VCR-based graphic user interface
US5778054A (en) * 1995-07-24 1998-07-07 Sony Corporation Communication apparatus and method for displaying on a screen a number of images corresponding to respective access information that is operative to initiate electronic communication
US5781901A (en) * 1995-12-21 1998-07-14 Intel Corporation Transmitting electronic mail attachment over a network using a e-mail page
US5832208A (en) * 1996-09-05 1998-11-03 Cheyenne Software International Sales Corp. Anti-virus agent for use with databases and mail servers
US5951638A (en) * 1997-03-21 1999-09-14 International Business Machines Corporation Integrated multimedia messaging system
US5961620A (en) * 1995-05-26 1999-10-05 Intel Corporation Extensible communication type manager for a computer system
US6014689A (en) * 1997-06-03 2000-01-11 Smith Micro Software Inc. E-mail system with a video e-mail player
US6014688A (en) * 1997-04-25 2000-01-11 Postx Corporation E-mail program capable of transmitting, opening and presenting a container having digital content using embedded executable software
US6526129B1 (en) * 1997-05-02 2003-02-25 Nortel Networks Limited System and method for communication media management

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5442744A (en) * 1992-04-03 1995-08-15 Sun Microsystems, Inc. Methods and apparatus for displaying and editing multimedia information
US5557320A (en) * 1995-01-31 1996-09-17 Krebs; Mark Video mail delivery system
US5961620A (en) * 1995-05-26 1999-10-05 Intel Corporation Extensible communication type manager for a computer system
US5778054A (en) * 1995-07-24 1998-07-07 Sony Corporation Communication apparatus and method for displaying on a screen a number of images corresponding to respective access information that is operative to initiate electronic communication
US5748499A (en) * 1995-09-19 1998-05-05 Sony Corporation Computer graphics data recording and playback system with a VCR-based graphic user interface
US5781901A (en) * 1995-12-21 1998-07-14 Intel Corporation Transmitting electronic mail attachment over a network using a e-mail page
US5832208A (en) * 1996-09-05 1998-11-03 Cheyenne Software International Sales Corp. Anti-virus agent for use with databases and mail servers
US5951638A (en) * 1997-03-21 1999-09-14 International Business Machines Corporation Integrated multimedia messaging system
US6014688A (en) * 1997-04-25 2000-01-11 Postx Corporation E-mail program capable of transmitting, opening and presenting a container having digital content using embedded executable software
US6526129B1 (en) * 1997-05-02 2003-02-25 Nortel Networks Limited System and method for communication media management
US6014689A (en) * 1997-06-03 2000-01-11 Smith Micro Software Inc. E-mail system with a video e-mail player

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010052019A1 (en) * 2000-02-04 2001-12-13 Ovt, Inc. Video mail delivery system
US20070230574A1 (en) * 2004-05-25 2007-10-04 Koninklijke Philips Electronics N.C. Method and Device for Encoding Digital Video Data
US7751802B2 (en) * 2006-03-16 2010-07-06 At&T Intellectual Property, I, L.P. Systems, methods and computer program products for obtaining responses to announcement files
US20070220095A1 (en) * 2006-03-16 2007-09-20 Silver Edward M Systems, methods and computer program products for electronic information transfer by a sender
US20070220096A1 (en) * 2006-03-16 2007-09-20 Silver Edward M Systems, methods and computer program products for obtaining responses to announcement files
US7756934B2 (en) 2006-03-16 2010-07-13 At&T Intellectual Property, I,L.P. Systems, methods and computer program products for electronic information transfer by a sender
US20080103867A1 (en) * 2006-10-27 2008-05-01 Darryl Moore Systems, methods and computer program products for user-selected calendar and task alerts
US7904321B2 (en) * 2006-10-27 2011-03-08 At&T Intellectual Property I, L.P. Systems, methods and computer program products for user-selected calendar and task alerts
US20080109522A1 (en) * 2006-11-08 2008-05-08 Kuo-Ching Chiang Video/audio electronic mail system and the method of the same
US8108473B2 (en) * 2006-11-08 2012-01-31 Kuo-Ching Chiang Mobile phone with CDMA and an audio/video electronic mail generator, and method of sending/receiving an audio/video electronic mail
US20090326979A1 (en) * 2007-02-02 2009-12-31 Koninklijke Philips Electronics N. V. Interactive patient forums
US8615408B2 (en) 2007-02-02 2013-12-24 Koninklijke Philips N.V. Interactive patient forums
US20100026817A1 (en) * 2007-02-02 2010-02-04 Koninklijke Philips Electronics N. V. Medical video communication systems and methods
US8390694B2 (en) 2007-02-02 2013-03-05 Koninklijke Philips Electronics N.V. Medical video communication systems and methods
US20090106840A1 (en) * 2007-10-18 2009-04-23 Dreymann Daniel T Certification Of E-Mails With Embedded Code
US8601071B2 (en) 2007-12-07 2013-12-03 Vidiense Technology Pty Ltd. Methods and systems to display a video in an e-mail
US20110047223A1 (en) * 2007-12-07 2011-02-24 Vidiense Technology Pty. Ltd. Method to display a video in an e-mail
US9083665B2 (en) 2007-12-07 2015-07-14 Vidiense Technology Pty Ltd Methods and systems to display a video in an email
US10270722B2 (en) 2007-12-07 2019-04-23 Vidiense Technology Pty Ltd. Methods and systems to display a video in an email
US9264649B2 (en) 2009-07-30 2016-02-16 Koninklijke Philips N.V. Medical video communication systems and methods
US20110191683A1 (en) * 2009-12-04 2011-08-04 Dillard Daniel G Methods and Systems to Enhance Advisor-Client Communications
US8924395B2 (en) 2010-10-06 2014-12-30 Planet Data Solutions System and method for indexing electronic discovery data

Also Published As

Publication number Publication date
US6014689A (en) 2000-01-11
US6564248B1 (en) 2003-05-13

Similar Documents

Publication Publication Date Title
US6564248B1 (en) E-mail system with video e-mail player
JP4208315B2 (en) DATA COMMUNICATION CONTROL DEVICE AND ITS CONTROL METHOD, DATA COMMUNICATION SYSTEM, RECORDING MEDIUM
US6339760B1 (en) Method and system for synchronization of decoded audio and video by adding dummy data to compressed audio data
US7047305B1 (en) Personal broadcasting system for audio and video data using a wide area network
US6349286B2 (en) System and method for automatic synchronization for multimedia presentations
US8817064B2 (en) Videoconference arrangement
CN112688965B (en) Conference audio sharing method and device, electronic equipment and storage medium
JPH10294927A (en) Communicating method for moving image data, recording and reproducing method for moving image data and storage medium
US7039112B2 (en) Moving picture mailing system and method
JP3014366B2 (en) Internet telephone communication method and apparatus, and recording medium storing the program
JPH0818622A (en) Information communication terminal
JP4505565B2 (en) Transmission of a digital information signal having a specific first sampling frequency
US20140003798A1 (en) System and method for recording collaborative information
US20060018634A1 (en) Creating a DVD compliant stream directly from encoder hardware
KR20090041057A (en) Appratus providing svc video contents and method thereof
US20030214509A1 (en) Digital image display device
JPH1168576A (en) Data expanding device
JPH10174092A (en) Audio/video automatic response control device for home automation system and method therefor
JP2000236490A (en) Mpeg decoder for caption display and decoding method
JPH10276395A (en) Image processing unit, image processing method and recording medium
KR20010078997A (en) TV Reception Card supporting the various video compression formats using the DSP
WO2001037561A1 (en) Compression-editing method for video image and video image editing device using the compression-editing method, video image retaining/reproducing device
KR0126889B1 (en) Cd-1 with video phone punction
WO2003088075A1 (en) Redbook encoding/decoding conversion device
JPH09130263A (en) Data communication equipment, encoding device and decoding device

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION