WO2002059802A1 - Non-recorded audio/video stream transmission using electronic mail - Google Patents

Non-recorded audio/video stream transmission using electronic mail Download PDF

Info

Publication number
WO2002059802A1
WO2002059802A1 PCT/AU2002/000055 AU0200055W WO02059802A1 WO 2002059802 A1 WO2002059802 A1 WO 2002059802A1 AU 0200055 W AU0200055 W AU 0200055W WO 02059802 A1 WO02059802 A1 WO 02059802A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
audio
destination
digital data
receiving
Prior art date
Application number
PCT/AU2002/000055
Other languages
French (fr)
Inventor
James Douglas Dorward
Original Assignee
Gts Pacific Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU16660/01A external-priority patent/AU746320B3/en
Priority claimed from AUPR3414A external-priority patent/AUPR341401A0/en
Application filed by Gts Pacific Pty Ltd filed Critical Gts Pacific Pty Ltd
Publication of WO2002059802A1 publication Critical patent/WO2002059802A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/107Computer-aided management of electronic mailing [e-mailing]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/50Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
    • H04M3/53Centralised arrangements for recording incoming messages, i.e. mailbox systems
    • H04M3/533Voice mail systems

Definitions

  • the present invention relates generally to sending messages over a computer network and, in particular, to sending messages containing live video and audio streams over the computer network.
  • Existing e-mail allows audio and video clips to be sent with a message to enhance communication.
  • Such audio and video clips are typically compiled by the sender, stored on a storage medium of the computer of the sender, and then added as attachments to a message before sending the message.
  • the message including the attachments which is typically very large in the case of audio and video clips, is then transferred to and stored on respective servers of each of the recipients. Each recipient may then open their received message and view any attachments if the recipient so desires.
  • the message including the attachments remains on the respective servers until the respective recipients delete those messages. Accordingly, a large amount of storage is associated with this manner of communication. Due to storage restrictions, certain servers may even block messages with large attachments and may only allow for transmission of text messages.
  • a method of transmitting a digital data stream including at least one of audio, video, and audio- video data via an electronic network comprising the steps of: streaming first digital data from a source to said electronic network; transmitting a first e-mail message from said source to at least one destination, said first e-mail message including a first application with a first address of said first digital data; activating said first application at said destination(s); and receiving said first digital data stream at said destination(s) using said first application dependent upon said first address.
  • Fig. 1 is schematic block diagram of a computer network system including a plurality of general-purpose computer systems
  • Fig. 2 is a more detailed schematic block diagram of one of the general purpose computer illustrated in Fig. 1 ;
  • Fig. 3 shows a schematic block diagram of a simplified computer network system of that shown in Fig. 1;
  • Fig. 4 shows a method of sending a "live" electronic-mail message from a initiating computer to a destination computer
  • Figs. 5 A to 5D illustrate schematic block diagrams of the initiating computer, the destination computer and the effective data flow between those computers for a number of implementations.
  • FIG. 1 is schematic block diagram of a computer network system 10. As shown, each of a plurality of general purpose personal computers (PC's) (hereinafter referred to as "computers") 100-1 to 00-ni ⁇ connects, via lines 12-1 to 12-m ⁇ respectively, to a plurality of Local Area Networks (LAN's) 14-1 to 14- ⁇ .
  • PC's general purpose personal computers
  • LAN's Local Area Networks
  • Each LAN 14-1 to 14-n typically extends over a distance from a few hundred meters to a few kilometres, and is usually located within a building or a group of proximate buildings.
  • Each LAN 14-1 to 14- « is also connected through a proxy server (not illustrated) to the World Wide Web (WWW) 150 via connections 18-1 to 18-n respectively.
  • WWW World Wide Web
  • FIG. 1 Further computers 100- 2 to 100- 3 are also provided which connect directly to the WWW 150 via connections 20-/w to 20- 3 respectively, typically through a "dial-up" connection to an Internet Service Provider (ISP) (not illustrated).
  • the computer network system 10 also includes a message web server 50 com ected to the WWW 150. Although only six computers 10 are illustrated in Fig. 1, it will be understood that many more could be provided.
  • Fig. 2 is a more detailed schematic block diagram of one of the computers 100.
  • the computer 100 comprises a computer module 101, input devices such as a keyboard 102, a mouse 103, a digital camera 119 and a microphone 117, and output devices including a display device 115 and loudspeakers 118.
  • a Modulator- Demodulator (Modem) transceiver device 116 is used by the computer module 101 for communicating to and from a communications network 120 connectable via a telephone line 121 or other functional medium.
  • the communications network 120 maybe the WWW 150 (Fig. 1) or LAN 14 (Fig. 1).
  • the computer module 101 typically includes at least one processor unit 105, a memory unit 106, for example formed from semiconductor random access memory (RAM) and read only memory (ROM), input/output (I/O) interfaces including a video interface 107, and an I/O interface 113 for the keyboard 102 and mouse 103, an I/O interface 114 for the microphone 117, the loudspeakers 118 and the digital camera 119, and an interface 108 for the modem 116.
  • a storage device 109 is provided and typically includes a hard disk drive 110 and a floppy disk drive 111.
  • a CD-ROM drive 112 is typically provided as a non- volatile source of data.
  • the components 105 to 114 of the computer module 101 typically communicate via an interconnected bus 104 and in a manner which results in a conventional mode of operation of the computer 100 known to those in the relevant art.
  • Fig. 3 shows a schematic block diagram of a simplified computer network system 300 of that shown in Fig. 1.
  • each of an initiating computer 305, a destination computer 310 and the message web server 50 are connected to the communication network 120, with intermediate data paths, such as LANs 14 where applicable, not illustrated.
  • the initiating and destination computers each represent one of the computers 100 illustrated in Figs. 1 and 2.
  • the initiating computer 305, destination computer 310 and the message web server 50 are configured to communicate with each other over the communication network 120 using HyperText Transfer Protocol (HTTP) in a manner known to those skilled in the relevant art.
  • HTTP HyperText Transfer Protocol
  • Fig. 4 shows a method 400 for sending a "live" electronic mail (e-mail) message from the initiating computer 305 to the destination computer 310.
  • the method 400 starts in step 402 when the user of the initiating computer 305 initiates a "live e-mail" application, typically resident on the hard disk drive 110, and read and controlled in its execution by the processor 105 of the initiating computer 305.
  • the live e-mail application may be stored on any computer readable medium.
  • computer readable medium refers to any storage or transmission medium that participates in providing instructions and/or data to the computer 100 for execution and/or processing.
  • Examples of storage media include floppy disks, magnetic tape, CD-ROM, a hard disk drive, a ROM or integrated circuit, a magneto- optical disk, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of the computer module 101.
  • Examples of transmission media include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or Intranets including email transmissions and information recorded on websites and the like.
  • the initiating computer 305 under control of the "live e-mail" application, emulates in step 403 a web server and streams video captured on the digital camera 119 and audio captured on the microphone 117 to the communication network 120.
  • the video and audio are streamed to the Internet Protocol (IP) address allocated to the initiating computer 305 for a current Internet session.
  • IP Internet Protocol
  • the initiating computer 305 also under control of the "live e-mail" application, executes a web browser application, stored on the hard disk drive 110 of the initiating computer 305.
  • the web browser application is also controlled by the live e-mail application to send a request to the message web server 50.
  • the request includes dynamic parameters including the allocated IP address of the initiating computer 305, a port address allocated for the video stream, user configurable video dimensions and frame rate, a password and an expiration time.
  • the password provides security in that only requests to that IP address which includes the password can received the streaming data.
  • the request further includes an e-mail address and a username of the user of the initiating computer 305.
  • the message web server 50 On receipt of the request from the initiating computer 305 by the message web server 50, the message web server 50 constructs in step 405 an audio applet and a video applet using the dynamic parameters included in the request. The expiration time allows the applets to only access the IP address up to the expiration time.
  • the audio and video applets are then embedded into a mail form that is also constructed by the message web server 50.
  • the mail form is a HyperText Mark-up Language (HTML) document which, when rendered by the web browser application of the initiating computer 305, provides a number of fields to be filled in by the user of the initiating computer 305.
  • the message web server 50 uses the e-mail address and username of the user of the initiating computer 305 received in step 404 to enter that information into the appropriate fields.
  • HTML HyperText Mark-up Language
  • step 406 the mail form is loaded into the web browser application of the initiating computer 305 from the message web server 50 and rendered on the display 115 of the initiating computer.
  • the advantage of retrieving the mail form from the message web server 50, rather than for the "live e-mail" application to construct the mail form and applets at the initiating computer, is that the provider of the message web server 50 retains control over the process. It also allows the provider to alter the appearance of the mail form periodically, for example by incorporating banner ads onto the mail form.
  • the mail form includes a field for an e-mail address of a user of the destination computer 310.
  • the form further includes fields for entering e- mail addresses for sending courtesy copies to other users and a field for entering a text message.
  • step 408 the initiating computer 305 receives data entered by the user into those fields.
  • the user of the initiating computer 305 does not use a normal e- mail client such as OutlookTM Express (product from Microsoft Corporation) to compose the e-mail message, but rather uses the mail form rendered by the web browser application to compose the message.
  • This removes the need for an HTML compatible e-mail client, which is needed for rendering rich graphical content and for including embedded applets.
  • the input step 408 ends when the user of the initiating computer 305 initiates the sending of the message. This is preferably done by depressing a "send button" on the form using the mouse 103.
  • step 410 the mail form, which includes the data received in step 408 and the applets, is sent to the message web server 50.
  • the message server 50 in step 412 forms an e-mail message from and routes the message to the server (not illustrated) of the destination computer 310, from where the user of the destination computer 310 is alerted to the presence of an e-mail message, typically by some audio indication that e-mail is available. Often subject and sender fields are also displayed.
  • the destination computer 310 When the destination computer 310 receives a command from its user to open the message in step 414, typically by pointing to and depressing a "open button" on its e-mail client with the mouse 103, the contents of the message is uploaded to the destination computer 310.
  • the video and audio applets are executed by the e-mail client of the destination computer 310.
  • the video and audio applets first confirm the validity of the password contained therein and provide an error message if determined not to be valid.
  • the video applet uses the dynamic parameters contained therein to provides a video window having the specified video dimensions and frame rate, and accesses the initiating computer's IP address and port address to receive the streaming video data from that IP address.
  • a video module 505 of the live e-mail application 502 on the initiating computer 305 forms video data from data received from the digital camera 119a and streams the video data to the IP address and allocated port of the initiating computer 305.
  • the video applet 510 executing on the destination computer 310 receives the video data and displays the video data on the display 115b of the destination computer 310.
  • an audio module 515 of the live e-mail application 502 on the initiating computer 305 forms audio data from a signal received from the microphone 117a and streams the audio data to the IP address of the initiating computer 305.
  • the audio applet 520 accesses the initiating computer's IP address to receive the streaming audio data and outputs the audio data through the speakers 118b of the destination computer 310.
  • the user of the destination computer 310 may thus view and listen to a streaming video and audio message from the user of the initiating computer 305.
  • the video and audio applets destruct upon closure of the message.
  • the expiration time contained in the applets ensures that the user of the destination computer 310 cannot at a later time execute the applets again, thereby preventing the user to view and listen to streaming video and audio streamed on that IP address at a later time, which may be intended for another recipient.
  • a talk back applet 530 is also constructed and embedded into the mail form in step 405.
  • a "talk back button” is also provided in the message on the display 115b of the destination computer 310.
  • the talk back applet 530 When the user of the destination computer 310 depresses the talk back button, the talk back applet 530 is executed.
  • the talk back applet 530 connects an audio stream received from the microphone 117b of the destination computer 310 back to the initiating computer 305, which emulates a server, to provide audio output over the loudspeaker 118a of the initiating computer 305.
  • Fig. 5B may also be used without a video applet 510, allowing a two- way voice communication between users without the destination computer 310 having particular applications installed, as the talk back applet provides the necessary functionality.
  • a multi-point communication may be established by sending the live e-mail including the talk back applet to a number of users. All recipients that open the messages, will connect to the audio module 515 of the initiating computer 305 and is be able to talk to and hear each other simultaneously.
  • the "live e-mail" application is also resident on the hard disk drive 110 of the destination computer 310.
  • the user of the destination computer 310 initiates the sending of another "live" electronic mail (e-mail) message and performing the steps of method 400 where the destination computer 310 becomes the initiating computer 305 and vice versa.
  • Fig. 5C shows a schematic block diagram of the case where both the initiating computer 305 and the destination computer 310 have the live e-mail applications 502 and 512 installed.
  • a video module 555 of the live e-mail application 512 on the destination computer 310 forms video data from data received from the digital camera 119b and streams the video data to the IP address and allocated port of the destination computer 310.
  • the video applet 560 executing on the initiating computer 305 receives the video data and displays the video data on the display 115a of the initiating computer 305.
  • An audio module 565 of the live e-mail application 512 on the destination computer 305 forms audio data from a signal received from the microphone 117b and streams the audio -data to the IP address of the destination computer 310.
  • the audio applet 570 accesses the destination computer's IP address to receive the streaming audio data and outputs the audio data through the speakers 118a of the initiating computer 310.
  • this implementation allows the users of the destination computer 310 and the initiating computer 305 to view and listen to streaming video and audio received from the other party in true multi-point, full duplex, video and audio, hence in a videoconference like manner. .
  • more parties may be linked by sending the live e-mail to a number of destination computers 310.
  • the live e-mail application is incorporated into an instant messaging (TM.) client known in the art.
  • the DVI client is also resident on the hard disk drive 110 of the computer 100, and is read and controlled in its execution by the processor 105 of the computer 100.
  • SUBSTITUTE-SHEET (RULE 26) ISA/AU
  • the message web server 50 and the associated computers 100 allows users of those computers to form part of an on-line community.
  • the IM client allows the user of the associated computer 100 to compile a contact list of other users within the online community.
  • the IM client communicates with the message web server 50 when the IM client is executed and the computer 100 is connected to the WWW 150 (Fig. 1).
  • the computer 100 coi nunicates to the message web server 50 a status notification notifying the message web server 50 that the user of the computer is now "on-line", the connection information of the computer 100 (the IP address and port number assigned to the computer 100 for that on-line session), as well as the contact list of the user.
  • the message web server 50 creates a record for the user that is now on-line. The record includes the user status and the contact list of the user.
  • the message web server 50 searches its records to determine which of the users in the contact list of that user currently have an on-line status, and replies to that computer 100 the status of each of the users in his contact list, as well as the contact information of the computer 100 of that user. In addition, the message web server 50 searches its records to determine which of the on-line users have the newly connected user entered in their contact list, and then communicates to the TM clients of those users the new status and the connection information of the computer 100 of that user.
  • the IM client may visually indicate to the user which of the users in the contact list is currently on-line.
  • the user may select one or more users for the contact list for the purpose of sending and receiving conventional text messages (chat), instigating a voice call over the WWW 150 using the Internet Protocol, sending a live e-mail message or, in the case where the other computers 100 also has the live e-mail application installed, a videoconference call.
  • chat conventional text messages
  • the direct communication links may be established with the computers 100 of the other parties.
  • Fig. 5D shows a schematic block diagram of this implementation. Additional to the functionality described in relation to Fig. 5C, the IM clients 580 and 590 on the initiating computer 305 and the destination computer 510 are illustrated. The IM clients 580 and 590 allow for the sending and receiving of conventional text messages (chat) and instigating a voice call over the WWW 150 using the Internet Protocol through link 595. The message web server 50 is also illustrated for receiving the status notification, the comiection information and contact lists from the computers 305 and 310 and updating the respective IM clients 580 and 590 with user status changes.
  • chat conventional text messages
  • the message web server 50 is also illustrated for receiving the status notification, the comiection information and contact lists from the computers 305 and 310 and updating the respective IM clients 580 and 590 with user status changes.

Abstract

A method (400) of transmitting a digital data stream an electronic network (120) is disclosed. The digital data stream includes at least one of audio, video, and audio-video data and is streamed from an initiating computer (305) to the electronic network (120). An e-mail message is then transmitted from the initiating computer (305) to a destination computer (310), with the e-mail message including an application with an address of the streaming digital data. Upon receipt of the message by the destination computer (310), the application is activated, and the digital data stream is received using the application dependent upon the address.

Description

NON-RECORDED AUDIO/VIDEO STREAM TRANSMISSION USING
ELECTRONIC MAIL
Technical Field of the Invention
The present invention relates generally to sending messages over a computer network and, in particular, to sending messages containing live video and audio streams over the computer network.
Background
Collaboration between and among individuals who are separated by distance is an integral part of our society, whether the collaboration is for personal or business purposes. Telephones have partially satisfied this need, but have a number of limitations. Such limitations include cost and the fact that audio communication only is prohibitive.
Conventional electronic mail (e-mail) provides a cost-effective means for communication to other parties anywhere in the world, but is often less personal than a telephone conversation. It is generally accepted that conventional e-mail messages and even telephone conversations lack the "personal touch" associated with face-to- face communication, as communication often involves more that mere exchange of words. Both e-mail messages and telephone conversations are totally incapable of communicating visual cues, gestures, etc.
Existing e-mail allows audio and video clips to be sent with a message to enhance communication. Such audio and video clips are typically compiled by the sender, stored on a storage medium of the computer of the sender, and then added as attachments to a message before sending the message. The message including the attachments, which is typically very large in the case of audio and video clips, is then transferred to and stored on respective servers of each of the recipients. Each recipient may then open their received message and view any attachments if the recipient so desires. The message including the attachments remains on the respective servers until the respective recipients delete those messages. Accordingly, a large amount of storage is associated with this manner of communication. Due to storage restrictions, certain servers may even block messages with large attachments and may only allow for transmission of text messages.
Traditional videoconferencing in turn satisfies the face-to-face aspect of the communication, but is prohibitive due to its cost and availability. Such videoconferencing is often only available in conference centers.
Thus, a need clearly exists for an improved method and system of transmitting audio and/or video streams to substantially overcome, or at least ameliorate, one or more disadvantages of existing arrangements.
Summary
According to a first aspect of the invention, there is provided a method of transmitting a digital data stream including at least one of audio, video, and audio- video data via an electronic network, said method comprising the steps of: streaming first digital data from a source to said electronic network; transmitting a first e-mail message from said source to at least one destination, said first e-mail message including a first application with a first address of said first digital data; activating said first application at said destination(s); and receiving said first digital data stream at said destination(s) using said first application dependent upon said first address.
Other aspects of the invention are also disclosed.
Brief Description of the Drawings
One or more embodiments of the present invention will now be described with reference to the drawings, in which:
Fig. 1 is schematic block diagram of a computer network system including a plurality of general-purpose computer systems;
Fig. 2 is a more detailed schematic block diagram of one of the general purpose computer illustrated in Fig. 1 ;
Fig. 3 shows a schematic block diagram of a simplified computer network system of that shown in Fig. 1;
Fig. 4 shows a method of sending a "live" electronic-mail message from a initiating computer to a destination computer; and
Figs. 5 A to 5D illustrate schematic block diagrams of the initiating computer, the destination computer and the effective data flow between those computers for a number of implementations.
Detailed Description including Best Mode
Where reference is made in any one or more of the accompanying drawings to steps and/or features, which have the same reference numerals, those steps and/or features have for the purposes of this description the same function(s) or operations), unless the contrary intention appears. Fig. 1 is schematic block diagram of a computer network system 10. As shown, each of a plurality of general purpose personal computers (PC's) (hereinafter referred to as "computers") 100-1 to 00-niχ connects, via lines 12-1 to 12-mι respectively, to a plurality of Local Area Networks (LAN's) 14-1 to 14-π. Each LAN 14-1 to 14-n typically extends over a distance from a few hundred meters to a few kilometres, and is usually located within a building or a group of proximate buildings. Each LAN 14-1 to 14-« is also connected through a proxy server (not illustrated) to the World Wide Web (WWW) 150 via connections 18-1 to 18-n respectively.
Further computers 100- 2 to 100- 3 are also provided which connect directly to the WWW 150 via connections 20-/w to 20- 3 respectively, typically through a "dial-up" connection to an Internet Service Provider (ISP) (not illustrated). The computer network system 10 also includes a message web server 50 com ected to the WWW 150. Although only six computers 10 are illustrated in Fig. 1, it will be understood that many more could be provided.
Fig. 2 is a more detailed schematic block diagram of one of the computers 100. The computer 100 comprises a computer module 101, input devices such as a keyboard 102, a mouse 103, a digital camera 119 and a microphone 117, and output devices including a display device 115 and loudspeakers 118. A Modulator- Demodulator (Modem) transceiver device 116 is used by the computer module 101 for communicating to and from a communications network 120 connectable via a telephone line 121 or other functional medium. The communications network 120 maybe the WWW 150 (Fig. 1) or LAN 14 (Fig. 1).
The computer module 101 typically includes at least one processor unit 105, a memory unit 106, for example formed from semiconductor random access memory (RAM) and read only memory (ROM), input/output (I/O) interfaces including a video interface 107, and an I/O interface 113 for the keyboard 102 and mouse 103, an I/O interface 114 for the microphone 117, the loudspeakers 118 and the digital camera 119, and an interface 108 for the modem 116. A storage device 109 is provided and typically includes a hard disk drive 110 and a floppy disk drive 111. A CD-ROM drive 112 is typically provided as a non- volatile source of data. The components 105 to 114 of the computer module 101, typically communicate via an interconnected bus 104 and in a manner which results in a conventional mode of operation of the computer 100 known to those in the relevant art.
Fig. 3 shows a schematic block diagram of a simplified computer network system 300 of that shown in Fig. 1. In the simplified computer network system 300, each of an initiating computer 305, a destination computer 310 and the message web server 50 are connected to the communication network 120, with intermediate data paths, such as LANs 14 where applicable, not illustrated. The initiating and destination computers each represent one of the computers 100 illustrated in Figs. 1 and 2. The initiating computer 305, destination computer 310 and the message web server 50 are configured to communicate with each other over the communication network 120 using HyperText Transfer Protocol (HTTP) in a manner known to those skilled in the relevant art.
Fig. 4 shows a method 400 for sending a "live" electronic mail (e-mail) message from the initiating computer 305 to the destination computer 310. The method 400 starts in step 402 when the user of the initiating computer 305 initiates a "live e-mail" application, typically resident on the hard disk drive 110, and read and controlled in its execution by the processor 105 of the initiating computer 305. The live e-mail application may be stored on any computer readable medium. The term "computer readable medium" as used herein refers to any storage or transmission medium that participates in providing instructions and/or data to the computer 100 for execution and/or processing. Examples of storage media include floppy disks, magnetic tape, CD-ROM, a hard disk drive, a ROM or integrated circuit, a magneto- optical disk, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of the computer module 101. Examples of transmission media include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or Intranets including email transmissions and information recorded on websites and the like.
The initiating computer 305, under control of the "live e-mail" application, emulates in step 403 a web server and streams video captured on the digital camera 119 and audio captured on the microphone 117 to the communication network 120. In particular, the video and audio are streamed to the Internet Protocol (IP) address allocated to the initiating computer 305 for a current Internet session.
In step 404 the initiating computer 305, also under control of the "live e-mail" application, executes a web browser application, stored on the hard disk drive 110 of the initiating computer 305. The web browser application is also controlled by the live e-mail application to send a request to the message web server 50. The request includes dynamic parameters including the allocated IP address of the initiating computer 305, a port address allocated for the video stream, user configurable video dimensions and frame rate, a password and an expiration time. The password provides security in that only requests to that IP address which includes the password can received the streaming data. The request further includes an e-mail address and a username of the user of the initiating computer 305. On receipt of the request from the initiating computer 305 by the message web server 50, the message web server 50 constructs in step 405 an audio applet and a video applet using the dynamic parameters included in the request. The expiration time allows the applets to only access the IP address up to the expiration time. The audio and video applets are then embedded into a mail form that is also constructed by the message web server 50. The mail form is a HyperText Mark-up Language (HTML) document which, when rendered by the web browser application of the initiating computer 305, provides a number of fields to be filled in by the user of the initiating computer 305. The message web server 50 uses the e-mail address and username of the user of the initiating computer 305 received in step 404 to enter that information into the appropriate fields.
In step 406 the mail form is loaded into the web browser application of the initiating computer 305 from the message web server 50 and rendered on the display 115 of the initiating computer. The advantage of retrieving the mail form from the message web server 50, rather than for the "live e-mail" application to construct the mail form and applets at the initiating computer, is that the provider of the message web server 50 retains control over the process. It also allows the provider to alter the appearance of the mail form periodically, for example by incorporating banner ads onto the mail form.
The mail form includes a field for an e-mail address of a user of the destination computer 310. Preferably the form further includes fields for entering e- mail addresses for sending courtesy copies to other users and a field for entering a text message.
In step 408 the initiating computer 305 receives data entered by the user into those fields. Hence, the user of the initiating computer 305 does not use a normal e- mail client such as Outlook™ Express (product from Microsoft Corporation) to compose the e-mail message, but rather uses the mail form rendered by the web browser application to compose the message. This removes the need for an HTML compatible e-mail client, which is needed for rendering rich graphical content and for including embedded applets. The input step 408 ends when the user of the initiating computer 305 initiates the sending of the message. This is preferably done by depressing a "send button" on the form using the mouse 103.
The method 400 then continues to step 410 where the mail form, which includes the data received in step 408 and the applets, is sent to the message web server 50. The message server 50 in step 412 forms an e-mail message from and routes the message to the server (not illustrated) of the destination computer 310, from where the user of the destination computer 310 is alerted to the presence of an e-mail message, typically by some audio indication that e-mail is available. Often subject and sender fields are also displayed.
When the destination computer 310 receives a command from its user to open the message in step 414, typically by pointing to and depressing a "open button" on its e-mail client with the mouse 103, the contents of the message is uploaded to the destination computer 310. Upon opening of the message, the video and audio applets are executed by the e-mail client of the destination computer 310. The video and audio applets first confirm the validity of the password contained therein and provide an error message if determined not to be valid. The video applet uses the dynamic parameters contained therein to provides a video window having the specified video dimensions and frame rate, and accesses the initiating computer's IP address and port address to receive the streaming video data from that IP address. In particular and referring to Fig. 5 A which is a schematic block diagram 500 of the initiating computer 305, the destination computer 310 and the effective data flow between those computers 305 and 310, a video module 505 of the live e-mail application 502 on the initiating computer 305 forms video data from data received from the digital camera 119a and streams the video data to the IP address and allocated port of the initiating computer 305. The video applet 510 executing on the destination computer 310 receives the video data and displays the video data on the display 115b of the destination computer 310. Also, an audio module 515 of the live e-mail application 502 on the initiating computer 305 forms audio data from a signal received from the microphone 117a and streams the audio data to the IP address of the initiating computer 305. The audio applet 520 accesses the initiating computer's IP address to receive the streaming audio data and outputs the audio data through the speakers 118b of the destination computer 310.
The user of the destination computer 310 may thus view and listen to a streaming video and audio message from the user of the initiating computer 305. The video and audio applets destruct upon closure of the message. The expiration time contained in the applets ensures that the user of the destination computer 310 cannot at a later time execute the applets again, thereby preventing the user to view and listen to streaming video and audio streamed on that IP address at a later time, which may be intended for another recipient.
In the event that the server of the destination computer 310 employs a firewall to block the applets, the user of the destination computer 310 presses a "no video click here" button provided on the message. This in turn launches a web browser stored on the storage device 109 of the destination computer 310 with a request to the IP address of the initiating computer 305. Accordingly, the web browser displays the exact same message and content, which includes the streaming video and audio. Referring to Fig. 5B where a schematic block diagram of a further implementation is shown, a talk back applet 530 is also constructed and embedded into the mail form in step 405. A "talk back button" is also provided in the message on the display 115b of the destination computer 310. When the user of the destination computer 310 depresses the talk back button, the talk back applet 530 is executed. The talk back applet 530 connects an audio stream received from the microphone 117b of the destination computer 310 back to the initiating computer 305, which emulates a server, to provide audio output over the loudspeaker 118a of the initiating computer 305.
As would be understood by a person skilled in the art, the implementation illustrated in Fig. 5B may also be used without a video applet 510, allowing a two- way voice communication between users without the destination computer 310 having particular applications installed, as the talk back applet provides the necessary functionality. Similarly, a multi-point communication may be established by sending the live e-mail including the talk back applet to a number of users. All recipients that open the messages, will connect to the audio module 515 of the initiating computer 305 and is be able to talk to and hear each other simultaneously.
In a preferred implementation, the "live e-mail" application is also resident on the hard disk drive 110 of the destination computer 310. In this implementation, the user of the destination computer 310 initiates the sending of another "live" electronic mail (e-mail) message and performing the steps of method 400 where the destination computer 310 becomes the initiating computer 305 and vice versa.
Fig. 5C shows a schematic block diagram of the case where both the initiating computer 305 and the destination computer 310 have the live e-mail applications 502 and 512 installed. In addition to the functionality described in relation to Fig. 5 A, a video module 555 of the live e-mail application 512 on the destination computer 310 forms video data from data received from the digital camera 119b and streams the video data to the IP address and allocated port of the destination computer 310. The video applet 560 executing on the initiating computer 305 receives the video data and displays the video data on the display 115a of the initiating computer 305. An audio module 565 of the live e-mail application 512 on the destination computer 305 forms audio data from a signal received from the microphone 117b and streams the audio -data to the IP address of the destination computer 310. The audio applet 570 accesses the destination computer's IP address to receive the streaming audio data and outputs the audio data through the speakers 118a of the initiating computer 310.
Hence, this implementation allows the users of the destination computer 310 and the initiating computer 305 to view and listen to streaming video and audio received from the other party in true multi-point, full duplex, video and audio, hence in a videoconference like manner. .
In a similar manner to that described in establishing a videoconference between two parties, more parties may be linked by sending the live e-mail to a number of destination computers 310.
However, it would be advantageous for the user of the initiating computer 305 at least to know whether the user of the destination computer(s) 310 is "on-line" before attempting to instigate a conference call. Hence, according to the preferred implementation, the live e-mail application is incorporated into an instant messaging (TM.) client known in the art. The DVI client is also resident on the hard disk drive 110 of the computer 100, and is read and controlled in its execution by the processor 105 of the computer 100.
SUBSTITUTE-SHEET (RULE 26) ISA/AU The message web server 50 and the associated computers 100 allows users of those computers to form part of an on-line community. The IM client allows the user of the associated computer 100 to compile a contact list of other users within the online community.
The IM client communicates with the message web server 50 when the IM client is executed and the computer 100 is connected to the WWW 150 (Fig. 1). In particular, the computer 100 coi nunicates to the message web server 50 a status notification notifying the message web server 50 that the user of the computer is now "on-line", the connection information of the computer 100 (the IP address and port number assigned to the computer 100 for that on-line session), as well as the contact list of the user. The message web server 50 creates a record for the user that is now on-line. The record includes the user status and the contact list of the user.
The message web server 50 then searches its records to determine which of the users in the contact list of that user currently have an on-line status, and replies to that computer 100 the status of each of the users in his contact list, as well as the contact information of the computer 100 of that user. In addition, the message web server 50 searches its records to determine which of the on-line users have the newly connected user entered in their contact list, and then communicates to the TM clients of those users the new status and the connection information of the computer 100 of that user.
This allows the IM client to visually indicate to the user which of the users in the contact list is currently on-line. Conveniently the user may select one or more users for the contact list for the purpose of sending and receiving conventional text messages (chat), instigating a voice call over the WWW 150 using the Internet Protocol, sending a live e-mail message or, in the case where the other computers 100 also has the live e-mail application installed, a videoconference call. With the connection information available, the direct communication links may be established with the computers 100 of the other parties.
Fig. 5D shows a schematic block diagram of this implementation. Additional to the functionality described in relation to Fig. 5C, the IM clients 580 and 590 on the initiating computer 305 and the destination computer 510 are illustrated. The IM clients 580 and 590 allow for the sending and receiving of conventional text messages (chat) and instigating a voice call over the WWW 150 using the Internet Protocol through link 595. The message web server 50 is also illustrated for receiving the status notification, the comiection information and contact lists from the computers 305 and 310 and updating the respective IM clients 580 and 590 with user status changes.
The foregoing describes only some embodiments of the present invention, and modifications and/or changes can be made thereto without departing from the scope and spirit of the invention, the embodiments being illustrative and not restrictive.
In the context of this specification, the word "comprising" means "including principally but not necessarily solely" or "having" or "including" and not "consisting only of. Variations of the word comprising, such as "comprise" and "comprises" have corresponding meanings.

Claims

The claims defining the invention are as follows:
1. A method of transmitting a digital data stream including at least one of audio, video, and audio-video data via an electronic network, said method comprising the steps of: streaming first digital data from a source to said electronic network; transmitting a first e-mail message from said source to at least one destination, said first e-mail message including a first application with a first address of said first digital data; activating said first application at said destination(s); and receiving said first digital data stream at said destination(s) using said first application dependent upon said first address.
2. A method as claimed in claim 1, wherein said source includes audio receiving means for receiving audio data from said electronic network and said first application comprises: a first audio application for receiving an audio component of said first digital data stream; and a second audio application for streaming audio data from said destination to said electronic network, said method comprising the further step of receiving said audio data streamed from said second application by said audio receiving means.
3. A method as claimed in claim 1 or 2, said method comprising the further step of closing said first application, wherein said first application destructs upon closure.
4. A method as claimed in claim 1 comprising the further steps of: streaming second digital data from said destination to said electronic network; transmitting a second e-mail message from said destination to said source, said second e-mail message including a second application with a network address of said second digital data; activating said second application at said source; and receiving said second digital data stream using said second application dependent upon said second address.
5. A method as claimed in any one of claims 1 to 4 wherein said step of transmitting a first e-mail message comprises the sub-steps of: requesting a message template from a message server; forming said first application by said message server; receiving said message template and said first application into a browser application; receiving at least destination data entered into said template; transmitting said destination data and said first address to said message server; and transmitting said first e-mail message to said destination using said destination data.
6. A method as claimed in claim 4 or 5, said method comprising the further step of closing said second application, wherein said second application destructs upon closure.
7. A method as claimed in any one of claims 1 to 6 comprising the further steps of: sending a notification to a presence server that said source is connected to said electronic network; and receiving by said source a connection status of a least one destination.
8. A method as claimed in claim 7 comprising the further step of sending a connection status of said source to a least one destination.
9. An apparatus for transmitting a digital data stream including at least one of audio, video, and audio-video data via an electronic network, said apparatus comprising: means for streaming first digital data from a source to said electronic network; means for transmitting a first e-mail message from said source to at least one destination, said first e-mail message including a first application with a first address of said first digital data; means for activating said first application at said destination(s); and means for receiving said first digital data stream at said destination(s) using said first application dependent upon said first address.
10. An apparatus as claimed in claim 9, wherein said source includes audio receiving means for receiving audio data from said electronic network and said first application comprises: a first audio application for receiving an audio component of said first digital data stream; and a second audio application for streaming audio data from said destination to said electronic network, whereby said audio receiving means receives said audio data streamed from said second application.
11. An apparatus as claimed in claim 9 or 10, said apparatus further comprising means for closing said first application, wherein said first application destructs upon closure.
12. An apparatus as claimed in claim 9 further comprising: means for streaming second digital data from said destination to said electronic network; means for transmitting a second e-mail message from said destination to said source, said second e-mail message including a second application with a network address of said second digital data; means for activating said second application at said source; and means for receiving said second digital data stream using said second application dependent upon said second address.
13. An apparatus as claimed in any one of claims 9 to 12 wherein said means for transmitting a first e-mail message comprises: means for requesting a message template from a message server; means for forming said first application by said message server; means for receiving said message template and said first application into a browser application; means for receiving at least destination data entered into said template; means for transmitting said destination data and said first address to said message server; and means for transmitting said first e-mail message to said destination using said destination data.
14. An apparatus as claimed in claim 12 or 13, said apparatus further comprises means for closing said second application, wherein said second application destructs upon closure.
15. An apparatus as claimed in any one of claims 9 to 14 further comprising: means for sending a notification to a presence server that said source is connected to said electronic network; and means for receiving by said source a connection status of a least one destination.
16. An apparatus as claimed in claim 15 further comprising means for sending a connection status of said source to a least one destination.
17. A program stored on a memory medium for transmitting a digital data stream including at least one of audio, video, and audio-video data via an electronic network, said program comprising: code for streaming first digital data from a source to said electronic network; code for transmitting a first e-mail message from said source to at least one destination, said first e-mail message including a first application with a first address of said first digital data; code for activating said first application at said destination(s); and code for receiving said first digital data stream at said destinations) using said first application dependent upon said first address.
18. A program stored on a memory medium for transmitting a digital data stream including at least one of audio, video, and audio-video data via an electronic network, said program being substantially as described herein with reference to any one of the embodiments in the drawings.
19. A method of transmitting a digital data stream including at least one of audio, video, and audio-video data via an electronic network, said method being substantially as described herein with reference to any one of the embodiments in the drawings.
20. An apparatus for transmitting a digital data stream including at least one of audio, video, and audio-video data via an electronic network, said apparatus being substantially as described herein with reference to any one of the embodiments in the drawings.
PCT/AU2002/000055 2001-01-25 2002-01-18 Non-recorded audio/video stream transmission using electronic mail WO2002059802A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
AU16660/01 2001-01-25
AU16660/01A AU746320B3 (en) 2001-01-25 2001-01-25 Method and software for transmitting messages live by electronic mail
AUPR3414A AUPR341401A0 (en) 2001-02-27 2001-02-27 Method and software for transmitting messages live via a computer network
AUPR3414 2001-02-27

Publications (1)

Publication Number Publication Date
WO2002059802A1 true WO2002059802A1 (en) 2002-08-01

Family

ID=25616584

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2002/000055 WO2002059802A1 (en) 2001-01-25 2002-01-18 Non-recorded audio/video stream transmission using electronic mail

Country Status (1)

Country Link
WO (1) WO2002059802A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1564945A1 (en) * 2004-02-10 2005-08-17 Alcatel VXML streaming for a unified messaging system with telephonic user interface
WO2014174431A1 (en) * 2013-04-22 2014-10-30 Amit Kumar Jain Amit Method of video interaction in social computing based community using self destructive videos
US20190280998A1 (en) * 2007-06-28 2019-09-12 Voxer Ip Llc Real-time messaging method and apparatus
US10841261B2 (en) 2007-06-28 2020-11-17 Voxer Ip Llc Telecommunication and multimedia management method and apparatus

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781901A (en) * 1995-12-21 1998-07-14 Intel Corporation Transmitting electronic mail attachment over a network using a e-mail page
WO2000007336A1 (en) * 1998-07-31 2000-02-10 Webtv Networks Inc. Browser-based email system with user interface for audio/video capture
WO2001010128A1 (en) * 1999-08-03 2001-02-08 Videoshare, Inc. Instant video messenger
WO2001052477A2 (en) * 2000-01-07 2001-07-19 Informio, Inc. Methods and apparatus for executing an audio attachment using an audio web retrieval telephone system
US6332164B1 (en) * 1997-10-24 2001-12-18 At&T Corp. System for recipient control of E-mail message by sending complete version of message only with confirmation from recipient to receive message

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781901A (en) * 1995-12-21 1998-07-14 Intel Corporation Transmitting electronic mail attachment over a network using a e-mail page
US6332164B1 (en) * 1997-10-24 2001-12-18 At&T Corp. System for recipient control of E-mail message by sending complete version of message only with confirmation from recipient to receive message
WO2000007336A1 (en) * 1998-07-31 2000-02-10 Webtv Networks Inc. Browser-based email system with user interface for audio/video capture
WO2001010128A1 (en) * 1999-08-03 2001-02-08 Videoshare, Inc. Instant video messenger
WO2001052477A2 (en) * 2000-01-07 2001-07-19 Informio, Inc. Methods and apparatus for executing an audio attachment using an audio web retrieval telephone system

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1564945A1 (en) * 2004-02-10 2005-08-17 Alcatel VXML streaming for a unified messaging system with telephonic user interface
US20190280998A1 (en) * 2007-06-28 2019-09-12 Voxer Ip Llc Real-time messaging method and apparatus
US10841261B2 (en) 2007-06-28 2020-11-17 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US11095583B2 (en) * 2007-06-28 2021-08-17 Voxer Ip Llc Real-time messaging method and apparatus
US11146516B2 (en) 2007-06-28 2021-10-12 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US20230051915A1 (en) 2007-06-28 2023-02-16 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US11658929B2 (en) 2007-06-28 2023-05-23 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US11658927B2 (en) 2007-06-28 2023-05-23 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US11700219B2 (en) 2007-06-28 2023-07-11 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US11777883B2 (en) 2007-06-28 2023-10-03 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
WO2014174431A1 (en) * 2013-04-22 2014-10-30 Amit Kumar Jain Amit Method of video interaction in social computing based community using self destructive videos

Similar Documents

Publication Publication Date Title
JP4467220B2 (en) Voice instant messaging
US6857006B1 (en) Multimedia direct communication system linked with HTTP protocol
CN105915436B (en) System and method for topic-based instant message isolation
US11855795B1 (en) Communication bridging in a remote office environment
EP1303974B1 (en) Video messaging
Ito Chocoa Communicator–A New Communication System Based on Awareness and Text Communications–
US7188140B1 (en) System and method for providing enhanced persistent communications
CN100512233C (en) Method and system for providing instant messaging functionality in non-instant messaging environments
US7415500B2 (en) Facilitating negotiations between users of a computer network through messaging communications enabling user interaction
CN101815039B (en) Passive personalization of buddy lists
JP4897611B2 (en) Instant messaging system, method, and program
US20030236835A1 (en) Network communication system and apparatus
US20040230659A1 (en) Systems and methods of media messaging
US20040158630A1 (en) Monitoring and controlling network activity in real-time
US20080140779A1 (en) System And Method For Sharing Search Result Using Messenger
TW200849959A (en) Immediate communication system and method based on WAP
CA2673335C (en) A method and system for handling media in an instant messaging environment
WO2002059802A1 (en) Non-recorded audio/video stream transmission using electronic mail
JP2008520022A (en) Method and system for preventing the reception of unwanted electronic messages such as spam mail
Rosenberg Identification of Communications Services in the Session Initiation Protocol (SIP)
EP2294780B1 (en) A method for masking data
KR20030039045A (en) Massage transmission method for instant messanger
US20070255800A1 (en) Automatic goodbye messages
Kim et al. Design and Implementation of Desktop Video Conference System Based on Client-Server and P2P.
Cui et al. Onechat: Enabling group chat and messaging in opportunistic networks

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP