CA2160822C - Graphical user interface for multimedia call set-up and call handling - Google Patents
Graphical user interface for multimedia call set-up and call handling Download PDFInfo
- Publication number
- CA2160822C CA2160822C CA002160822A CA2160822A CA2160822C CA 2160822 C CA2160822 C CA 2160822C CA 002160822 A CA002160822 A CA 002160822A CA 2160822 A CA2160822 A CA 2160822A CA 2160822 C CA2160822 C CA 2160822C
- Authority
- CA
- Canada
- Prior art keywords
- virtual meeting
- displaying
- call
- participants
- icon
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/567—Multimedia conference systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/563—User guidance or feature selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
- H04M2201/42—Graphical user interfaces
Abstract
A graphical user interface, i.e., multimedia communications application program, for setting up and handling a multimedia call is disclosed that employsrealistic metaphors of real life face-to-face meetings in setting up and handling a multimedia call to establish a virtual meeting which is automatically reconfigured in response to user action. This is realized by taking advantage of prospective virtual meeting participants' already existing knowledge of how real life face-to-face meetings operate. To this end, the multimedia communications application programenables the virtual meeting participants through direct manipulation of the realistic graphical metaphors to establish a realistic virtual meeting room which is displayed on the screen of their workstation monitor. The virtual meeting room includes a table and chairs arranged in a realistic manner in the virtual meeting room. The virtual meeting room and table are automatically configured in response to user action in such a manner as to minimize the screen area displaying the virtual meeting room and, thereby, maximizing the screen area available for multimedia collaboration by the meeting participants. An empty chair is displayed at the table which indicates that at least one more participant can be added to the virtual meeting. Once a predetermined maximum number of participants have been included in the virtual meeting, the empty chair is no longer displayed.
Description
~mo~~z GRAPHICAL USER INTERFACE FOR MULTIMEDIA CALL
SET-UP AND CALL HANDLING
Technical Field This invention relates to telecommunications networks and, more particularly, to multimedia communications networks for providing flexible multimedia telephone service and the like including video, voice and/or data.
Background Of the Invention The essential characteristics of face-to-face meetings can be simulated by multimedia telecommunications conference systems. Such conference systems permit separated meeting participants to communicate with one another in multiple media such as video, voice and/or data from their own workplace without requiring that they convene in the same place.
In prior known multimedia conference systems, it has been required that the individual meeting participants had to be conversant with sophisticated video and data communications protocols, including, for example network address and transport protocols, in order to set-up and handle a multimedia call in order to establish and operate a virtual meeting. If a prospective participant was not familiar with the video and/or data protocols, it essentially precluded his or her participation in the full virtual meeting. Those prospective participants would be limited to only the audio portion of the virtual meeting. This of course is extremely undesirable. Therefore, a problem exists in providing an easy natural real life way for unsophisticated prospective meeting participants to set-up and handle multimedia telephone calls.
~ummarv of the Invention The problems and limitations with prior multimedia telecommunications conference systems are overcome by utilizing a graphical user interface (multimedia communications application program) that employs realistic metaphors of real life face-to-face meetings in setting up and handling a multimedia call to establish a virtual meeting which is automatically reconfigured in response to user action. This is realized by taking advantage of prospective virtual meeting participants' already existing knowledge of how real life face-to-face meetings operate. To this end, the multimedia communications application program enables the virtual meeting participants through direct manipulation of the realistic graphical metaphors to establish a realistic virtual meeting room metaphor which is displayed on the screen j of their workstation monitor. The virtual meeting room includes a table and chairs arranged in a realistic manner in the meeting room. The virtual meeting room and table are automatically configured in response to user action in such a manner as to minimize the screen area displaying the virtual meeting room and, thereby, maximizing the screen area available for multimedia collaboration by the virtual meeting participants. In one embodiment, an empty chair is displayed at the table which indicates that at least one more participant can be added to the virtual meeting. Once a predetermined maximum number of participants have been included in the virtual meeting, the empty chair is no longer displayed. In a specific example, the multimedia call is established by use of a realistic telephone icon that looks and operates like an ordinary real life telephone.
Brief Descrietion of Drawing FIG. 1 is a graphical representation of a multimedia telecommunications system in which an embodiment of the present invention can be employed;
FIG. 2 is a block diagram illustrating the interaction of components of a multimedia application;
FIG. 3 is a block diagram illustrating the details of a user's workstation;
FIG. 4 is a graphical screen representation of the realistic graphical meeting room metaphor;
FIG. 5 is a graphical screen representation with the multimedia application minimized;
FIG. 6 is a flow chart illustrating the steps a user performs in starting the multimedia application in the initiation of a multimedia telephone call;
FIG. 7 is a graphical screen representation which is displayed upon a user starting the multimedia application in the initiation of the multimedia telephone call;
FIG. 8 is a flow chart illustrating the steps that the user would perform in selecting a telephone to initiate a multimedia call;
.~, 218082 2a FIG. 9 is a graphical screen representation of the call bar that appears when the telephone is selected to initiate the multimedia call;
FIG. 10 is a flow chart illustrating the steps in placing a multimedia call from the directory shown in FIG. 11;
FIG. 11 is a graphical screen representation of a directory;
FIG. 12 is a graphical screen representation of a multimedia call initiated from an entry in the directory;
FIG. 13 is a flow chart illustrating the steps taken in effecting a multimedia call directly from the call bar;
-. 3 2160822 FIG. 14 is a graphical screen representation illustrating a phone number being entered directly from the keyboard of the user workstation;
FIG. 15 is a graphical screen representation illustrating ringing at a remote participant's phone number that is being displayed;
FIG. 16 is a flow chart illustrating the steps taken in effecting a multimedia call from a dial pad;
FIG. 17 is a graphical screen representation illustrating the appearance of the dial pad below the call bar;
FIG. 18 is a graphical screen representation illustrating a phone number 1 o entered on the dial pad;
FIG. 19 is a graphical screen representation illustrating ringing at a remote participant's phone number that is being displayed;
FIG. 20 is a flow chart illustrating the steps taken once the call is placed;
FIG. 21 is a graphical screen representation illustrating the meeting upon a remote participant answering the call;
FIG. 22 is a flow chart illustrating the steps which are taken upon receipt of an incoming call at a user workstation;
FIG. 23 is a graphical screen representation illustrating the name and phone number of the calling party;
2o FIG. 24 is a graphical screen representation illustrating the meeting room upon the called party answering the incoming call;
FIG. 25 is a flow chart illustrating the steps taken in adding a participant to an ongoing meeting.
FIG. 26 is a graphical screen representation illustrating an ongoing meeting with three participants;
FIG. 27 is a graphical screen representation illustrating an ongoing meeting with four participants;
FIG. 28 is a graphical screen representation illustrating the addition of a participant to the meeting shown on the screen of FIG. 26;
3o FIG. 29 is a graphical screen representation illustrating the addition of a participant to the meeting shown on the screen of FIG. 27;
2~sos22 FIG. 30 is a graphical screen representation illustrating the addition of an empty chair to the meeting shown in the screen of FIG. 28;
FIG. 31 is a graphical screen representation illustrating expansion of the meeting room for the meeting shown in the screen of FIG. 29;
FIG. 32 is a graphical screen representation illustrating the addition of an empty chair to the meeting shown in the screen of FIG. 31;
FIG. 33 is a flow chart illustrating the steps taken when a meeting participant permanently leaves the meeting room;
FIG. 34 is a graphical screen representation of an ongoing meeting including i o six participants;
FIG. 35 is a graphical screen representation of the meeting shown in the screen of FIG. 34 upon a participant leaving that meeting;
FIG. 36 is a graphical screen representation of the meeting shown in the screen of )~'IG. 35 with the chairs rearranged;
FIG. 37 is a graphical screen representation of the meeting with the participants rearranged around the table to fill in empty chairs;
FIG. 38 is a graphical screen representation of the meeting shown in the screen of FIG. 37 with the extra empty chair being removed;
FIG. 39 is a graphical screen representation of an ongoing meeting including 2o five participants;
FIG. 40 is a graphical screen representation of the meeting shown in the screen of FIG. 39 upon a participant leaving that meeting;
FIG. 41 is a graphical screen representation of the meeting shown in the screen of FIG. 40 with the chairs rearranged;
FIG. 42 is a graphical screen representation of the meeting with the participants rearranged around the table to fill in empty chairs;
FIG. 43 is a graphical screen representation of the meeting shown in the screen of FIG. 42 with the extra empty chair being removed; and FIG. 44 is a graphical screen representation illustrating the shrinking of the 3o size of the meeting room.
Detailed Descri tn ion FIG. 1 shows an example of multimedia telecommunications system 100 in which an embodiment of the invention may be readily employed. Individual users at different work locations can set-up a multimedia conference call via a number of different desktop communications devices. As shown, the desktop communications 5 devices may include, but are not limited to, personal computer 101 with built in microphone for audio, workstation 102 including an attached video camera 103 and ISDN telephone 104, workstation 105 with attached video camera 106, personal computer 107 with an integrated video camera 108, workstation 109 including video camera 110 and an analog telephone 111, ISDN telephone 112, facsimile (FAX) l0 machine 113 and, finally, analog telephone 114. It should be noted that personal computer 101 does not provide local user video to the meeting, FAX machine 113 only provides FAX service and ISDN telephone 112 and analog telephone 114 only provide audio access to the meeting. The personal computers and workstations may be any of those known in the art, for example, personal computers and/or workstations commercially available from AT&T Corp., Apple Computer Inc., Sun Microsystems Inc. and others.
The several different desktop communications devices are interconnected via communications network 116. Note that workstations 101, 102, 107 and 109, and ISDN telephone 112, facsimile machine 113, and analog telephone 114 are directly connected to communications network 116, while workstation 105 is connected through multimedia server 115 to communications network 116. In this example, communications network 116 could be, for example, a long distance telecommunications network such as a long distance network provided by AT&T.
It may be connected to a number of local telephone networks provided by local exchange carriers or alternate access vendors to provide access to the different desktop communications devices. Alternatively, communications network 116 could be a wide band area network, a local area network or the like. Typically, communications network 116 may include the usual public switched long distance network composed of a plurality of well known digital switching units and may contain one or more packet networks. Additionally, communications network 116 may include known video conference bridge arrangements capable of conferencing video, audio and/or data bit streams among the different desktop communication devices.
Communications network 116 may also include multimedia multipoint control units (MCUs) that provide multimedia call capability including video, audio and/or data bit streams. Such MCU units are known and are described in Bell Core Generic Requirements GR-1337-CORE, Issue 1, September 1993 and entitled "Multipoint Multimedia Conferencing Control Unit". Furthermore, communications network 116 may include an asynchronous transport mode (ATM) network capable of transporting and switching multimedia calls including video, audio, and/or data bit streams.
As indicated above, workstation 1 OS is connected via multimedia server 115 to communications network 116. Multimedia server 115 provides for one or more video, one or more audio and one or more data bit streams to be combined, while maintaining the integrity of those bit streams for transmission to communications network 116, for workstation 105 and the other desktop communications devices in a particular meeting including workstation 105. The functionality of multimedia server 115 can be provided for a particular workstation locally, as shown in relationship to workstation 105, and for the other desktop communications devices in a meeting including workstation 105. It is noted that for the other desktop communications devices in a meeting not including workstation 105 and multimedia server 115, communications network 116 must provide the multimedia server functionality for them.
2o Thus, communications network 116, which is not part of this invention, provides the functionality including the multimedia server functionality, when necessary, for interconnecting selected ones of the desktop communications devices in particular virtual meetings, as desired.
FIG. 2 illustrates in simplified block diagram form how multimedia application, i.e., the graphical user interface, 201 (201') located on the user personal computer or workstation communicates via application program interfaces that connect to middleware 202 (202'). Note that the solid lines in FIG. 2 denote direct connectivity between elements 201 through 203 and 203' through 201', and vice versa, while the dotted lines denote logical connectivity between, for example, elements 201 3o and 201', and 202 and 202'. Middleware 202 (202') is software that is located at the workstation and also distributed among intelligent points in communications network 116. Middleware 202 (202') serves to isolate the multimedia application from ~isos22 platform differences (e.g., UNIX versus MS-DOS and the like) and communications network 116 details. Middleware 202 (202') also serves as a link between the workstation application programs, for example, 201, and network transport 203 server functions, as well as, applications that include, but are not limited to, multimedia call connection setup, directory services of people and network resources, information services, messaging services, and the like. When a user places or receives a multimedia call from his or her workstation, the workstation automatically registers its capabilities with middleware 202 (202'). Middleware 202 (202') employs the registered capabilities to control call setup and transmission of video, audio and/or to data. Since, all the capabilities (e.g., full-video, shared data, facsimile, audio and the like) from all of the meeting participants' workstations are registered with middleware 202 (202'), it is available to all of the meeting participants. When information is to be transmitted to participants in the multimedia meeting, middleware 202 (202') determines the proper display formats and transport protocols. Such middleware is 15 known in the art, see for example, an article entitled "Middleware's Next Step:
Enterprise-Wide Applications", Data Co municatin"s. Sept. 1992, pages 157-164 and an article entitled "Closeup Middleware: Networking's Silly Putty", C'om_m~nications Week, June 20, 1994, pages 48-49.
FIG. 3 shows, in simplified block diagram form details of a user's workstation.
20 Specifically, shown is central processing unit (CPU) 301 which is interconnected via bus 302 to random access memory (RAM) 303, data memory 304, which may be a ROM, and input/output (I/O) unit 305. I/O 305 interfaces pointing device 306, video camera 307, if available, telephone 308, analog or ISDN if available, keyboard 309, and display device 310 to bus 302 and to network interface 311. Such workstations 25 units are known in the art and commercially available, as indicated above, and provide shared data capabilities. Network interface 311 comprises an application program interface that translates computer application requests into the appropriate transport format for transmission via communications network 116 and also takes requests from communications network 116 and translates them into a format appropriate for 3o interacting with the workstation's applications program. Such arrangements are known in the art. It is further noted that transmission from a user workstation to communications network 116 may be via any of a number of transmission -- 8 zlsoszz arrangements for example, digital data system (DDS), basic rate interface (BRI) ISDN, primary rate interface (PRI) ISDN, a modem, analog transmission, digital transmission, facsimile transmission, or the like. It is noted that a mouse, track ball, touch screen, keyboard cursor control keys or the like may be employed as a pointing device.
FIG. 4 is a graphical screen representation of the real life meeting room metaphor illustrating the various components that could be included in a multimedia meeting. Shown in FIG. 4 is image icon 401, illustrating the image of the originator of the meeting, realistic telephone 402 which is used to place and receive multimedia 1o calls, image icon 403 of a participant in the meeting, empty chair 404 which is available for an additional participant to be included in the meeting, generic image icon 405 which would be employed for a participant whose bit map image is not available, table 406 on which objects can be placed to be shared among the meeting participants, projector 407 which is shown on table 406 and may be utilized to share 15 images among the participants, and view graph folder 408 which contains images that can be placed on the projector 407. Also, shown in FIG. 4 is tool closet 409, which includes the multimedia tools that may be utilized during a multimedia meeting by the participants. Shown in tool closet 409, in this example, are copier 410 which may be utilized by the participants to send computer files from one participant to one or more 20 of the other participants, application sharer (link) 411 which enables the participants to share a computer application program, screen snapshot camera 412 which is used to create a view graph by taking a snapshot of any portion of the monitor screen, call timer 413 which times the length of the multimedia call and can be used to set an alarm, slide projector 414 which is used to display a presentation of a sequence of one 25 or more images to the meeting participants, and FAX machine 415 which is used to send facsimiles to meeting participants and others. The instrumentalities shown in tool closet 409 are by way of example and any other desired multimedia tools may also be included. It is noted that tool closet 409 may be closed to save screen space on the user's workstation monitor screen. Note that the icons are of realistic real life 30 objects that are or should be well known to the meeting participants.
Since, all of the objects are well known as to their nature and use, the meeting participants do not need to know any sophisticated protocols in order to use them. Indeed, the virtual meeting participants use the realistic icons in the same manner as they would their real life counterparts. Additionally, the image icons of the meeting participants are arranged around the table in similar fashion as the participants would be seated in a real life face-to-face meeting. This allows the participants to interact with each other and use the objects in the meeting room based on their already existing knowledge.
This, in turn, enhances the ease of use of the graphical user interface of this invention.
FIG. 5 is a graphical screen representation with the multimedia application (MMECA) SO1 minimized. Also shown are a number of other application programs which have been minimized. Note that the multimedia application of this invention to can be implemented on top of a number of known personal computer systems.
Examples of such systems programs are the Vistium* personal video system commercially available from AT&T Corp. and the ProShare* personal conferencing system 200 commercially available from Intel Corporation (* note that Vistium is a trademark of AT&T Corp. and that ProShare is a trademark of Intel Corporation). In 15 this example, it is assumed that the personal video system is included as part of the user workstation and provides the network interface 311 (FIG. 3).
FIG. 6 is a flow chart illustrating the steps in utilizing the multimedia application for initiating a multimedia telephone call. In step 601, a user initiates a multimedia call. Then, in step 602, the user determines whether or not the multimedia 20 application is running. If the test result in step 602 is YES, in step 603, the user determines whether the multimedia application is minimized. If the test result in step 603 is YES, the user selects the minimized multimedia application icon 501, as shown in FIG. 5. Thereafter, control is transferred to step 605 in which the meeting room window opens as shown in the screen of FIG. 7. Returning to step 603, if the test 25 result is NO, the multimedia application is not minimized and the meeting room window is already open, as shown in the screen of FIG. 7. Returning to step 602, if the test result is NO, in step 607, the user starts the multimedia application in a manner consistent with the operating system employed in the user workstation.
Thereafter, control is passed to step 605 where the meeting room window opens and is 3o displayed, as shown in the screen of FIG. 7.
FIG. 7, as indicated above, is a graphical screen representation displayed upon a user starting the multimedia application upon initiating a multimedia call.
In the example shown in FIG. 7, image icon 701 is of the multimedia call originator.
Also shown is telephone 702 which may be used to originate the multimedia call, empty chair 703 which is available for an additional meeting participant to join the meeting in the multimedia call, table 704 which is used to share objects among the 5 participants, projector 705 which is used to share images among the meeting participants, view graph folder 706 which contains the images to be shared among the meeting participants, and tool closet 707 which is closed. Again, note that the icons are of realistic real life objects which are well known to the meeting participants.
FIG. 8 is a flow chart illustrating the steps taken in the user selecting telephone 10 702 (FIG. 7) to initiate a multimedia call. Thus, in step 801, the user selects the realistic telephone icon 702. This causes a call bar to appear on the screen adjacent to telephone 702, as shown in the screen of FIG. 9. The call bar includes a field 901 for the user to enter a number to be called directly from the workstation keyboard, and a dial pad button 902, which when selected will display a dial pad for entering the number. Additionally, in this example, option buttons 903 and 904 are provided to select either a local on-line telephone directory or a corporate telephone directory located on the network. It should be noted that the directories associated with option buttons 903 and 904 are just examples of such directories that can be utilized for selecting the number to be called.
FIG. 10 is a flow chart illustrating the steps the user takes in placing a call from a multimedia directory. Thus, the process is initiated via step 1001 from the screen shown in FIG. 9. Then, in step 1002, the user selects the call initiation technique which, in this example, is the directory. This causes the directory application window to open via step 1003 and is shown in the screen of FIG.
11. The directory, shown in the window of FIG. 1 l, is just one example of numerous such directories that may be employed. Then, in step 1004, the user searches for the name of the desired prospective participant to be called in the multimedia call.
This is realized by the user browsing through the directory.
Upon the user locating the name of the desired prospective meeting 3o participant, he or she places the multimedia call via step 1005. The call placement may be effected by any desired method, one of which is to select call button 1101, as shown adjacent to the prospective participant's telephone number in FIG. 11.
The l, 216082 placement of the call by the user in step 1005 causes the screen as shown in FIG. 12 to be displayed via step 1006. As shown in FIG. 12, the call bar adjacent to the telephone displays the name and telephone number of the prospective meeting participant that was dialed.
FIG. 13 is a flow chart illustrating the steps the user takes in effecting a multimedia call directly from the call bar, shown in FIG. 9. This process is initiated in step 1301 from the screen shown in FIG. 9. Then, in step 1302, the user enters the desired participant's telephone number on the local workstation keyboard. This causes the telephone number being dialed to appear in the call bar, as shown in the screen of 1o FIG. 14. Then, in step 1303, the user, in this example, presses enter on the keyboard to cause the displayed number to be dialed, which also causes the call bar to display that the number is being dialed, as shown in the screen of FIG. 15.
FIG. 16 is a flow chart illustrating the steps a user would take in effecting a multimedia call from the dial pad. This process is initiated in step 1601 from the screen of FIG. 9. In this instance, the user selects the dial pad option 902 from the call bar via step 1602, which causes the dial pad to appear on the screen, as shown in the screen of FIG. 17. Then, in step 1603, the user enters the desired participant's telephone number from the dial pad using a pointing device such as a mouse.
This, in turn, causes the number entered to appear in the call .bar, as shown in the screen of 2o FIG. 18. Then, in step 1604, the user selects the dial button from the dial pad, which causes the telephone number to be dialed. This, causes the call bar screen to display that the number is being dialed, as shown in the screen of FIG. 19.
FIG. 20 is a flow chart illustrating the steps which are taken once the multimedia call is placed, as displayed in either of the screens in FIGS. 12, 15 or 19, as initiated via step 2001. Then, as shown in either of FIGS. 12, 15 or 19, and as indicated in step 2002, the call has been placed and the dialed number and the name of the called participant, if available, appear in the call bar, as well as, a hang up option.
Then, step 2003 tests to determine if the call has been answered. If the test result in step 2003 is NO, in step 2004, the user selects the hang up option from the call bar.
Thereafter, the call bar is removed and the screen appears, as shown in FIG.7.
Returning to step 2003, if the test result is YES, step 2006 causes the call to begin with audio only, causes the call bar to be removed from the screen, and causes an icon ~2 2iso~~z of the called participant to be placed in the meeting room on a chair, as shown in the screen of FIG. 21. It is noted that if the participant's image bit map is not available the generic image icon 405 will appear instead.
FIG. 22 is a flow chart illustrating the steps which are effected upon receipt of an incoming multimedia call at a prospective meeting participant's workstation. The process is entered with the incoming call via step 2201. Thereafter, step 2202 tests to determine if the multimedia application is running at the prospective participant's workstation. If the test result in step 2202 is NO, step 2203 causes only the telephone to ring. Then, the only option available to the called participant is to participate in the to audio portion of the meeting. Returning to step 2202, if the test result is YES, step 2204 causes audible ringing to occur, the meeting room to appear on the participant's screen and the call bar to appear next to the telephone in a realistic meeting room metaphor, as shown in the screen of FIG. 23. Additionally, as shown in the screen of FIG. 23, the name and number of the calling party is displayed in the call bar. Then, in step 2205, the participant selects a desired call bar option. Thereafter, step 2206 tests to determine which option has been selected by the participant, namely, ignore, answer or other. If the test result in step 2206 indicates that the ignore option is selected, step 2207 causes the telephone to stop ringing, the realistic meeting room metaphor to be minimized and the call follows whatever call path has been setup by 2o the network (for example, with a PBX the call could be sent to voice mail or to coverage) and the called participant's screen appears as shown in FIG. 5.
Returning to step 2206, if the called participant selects other, step 2208 causes the called participant's workstation to perform any system specific action that the participant desires, such as voice mail or the like. Again, returning to step 2206, if the called participant selects answer, step 2209 causes the called participant's workstation to register its capabilities with the communications network middleware, the call bar on the called participant's screen is removed and the screen displays the real life meeting room with icons representing all the current meeting participants including the called participant being placed around the table in a realistic manner as would occur in a real life face-to-face meeting, as shown in the screen of FIG. 24.
FIG. 25 is a flow chart illustrating the steps that are taken in the automatic reconfiguration of the room and table when adding a participant to an ongoing virtual meeting. This process of adding a participant is initiated by step 2501 from either a meeting having an odd number of participants as shown in the screen of FIG. 26 or a meeting having an even number of participants as shown in the screen of FIG.
27.
Then, step 2502 causes the participant to be added to the empty chair in the meeting room, as shown in the screens of either FIG. 28 or FIG. 29. Once the participant has been added, step 2503 tests to determine if the number of participants has reached a predetermined maximum. If the test result in step 2503 is YES, the process is ended via step 2504, since no more participants can be added. Note that since the maximum number of participants has been reached, the room cannot be expanded nor can an to empty chair be added for any additional participants. If the test result in step 2503 is NO, step 2505 tests to determine if there is room to add an empty chair around the meeting table, i.e. whether there is an even number of participants. If the test result in step 2505 is NO, step 2506 causes the virtual meeting room and the table to expand by one participant space, as shown in the screen of FIG. 31. Thereafter, control is passed 15 to step 2507. If the test result in step 2505 is YES, control is passed directly to step 2507, which causes an empty chair to be added to the virtual meeting room.
This is shown in the screen of FIG. 30 for a room which did not require expansion and in the screen of FIG. 32 for a room which has been expanded. Thereafter, step 2508 causes the automatically reconfigured meetings) to continue.
20 FIG. 33 is a flow chart illustrating the steps taken in the automatic reco~guration of the meeting room and table when a participant permanently leaves the virtual meeting room. This process is initiated in step 3301 from an ongoing meeting having either an even number of participants, as shown in the screen of FIG.
34, or an odd number of participants, as shown in the screen of FIG. 39. Then, in step 25 3302, a test is made to determine whether a participant has permanently left the virtual meeting room, as shown in the screens of FIGS. 35 and 40, for the meeting shown in the screens of FIGS. 34 and 39, respectively. If a participant temporarily leaves the meeting (puts the call on hold) the room does not reconfigure and the particular participant's chair will remain empty until he or she returns. Step 3303 causes the 3o meeting participants of the virtual meeting on the same side of the table below the empty chair of the participant who left to move up one chair, as illustrated in the screens of FIGs. 36 and 41. Thereafter, step 3304 tests whether or not there are two 21fi~8~~
F"" 14 empty chairs on the same side of the table. If the test result in step 3304 is YES, step 3305 causes the person in the chair at the bottom of the table to move from the other side of the table to the top empty chair, as shown in the screens of FIGS. 37 and 42.
Thereafter, control is passed to step 3306 which tests to determine whether or not there are two empty chairs around the table. Returning to step 3304, if the test result is NO, control is directly passed to step 3306. If the test result in step 3306 is NO, there is only one empty chair and the process is ended via step 3307. If the test result in step 3306 is YES, step 3308 causes an empty chair at the lowest point of the table or on the left side of the table to be removed, as shown in the screens of FIGs.
38 and 43.
to Then, step 3309 tests whether or not there is excess space at the bottom of the table so that the room and table can be shrunk in size, i.e. whether or not there is an even number of participants in the virtual meeting room, as shown in the screen of FIG. 43.
If the test result in step 3309 is NO, the process is ended via step 3307. If the test result in step 3309 is YES, the table and room are shrunk by one chair space, as 15 shown in the screen of FIG. 44, and the meeting is continued including the automatically reconfigured room and table.
SET-UP AND CALL HANDLING
Technical Field This invention relates to telecommunications networks and, more particularly, to multimedia communications networks for providing flexible multimedia telephone service and the like including video, voice and/or data.
Background Of the Invention The essential characteristics of face-to-face meetings can be simulated by multimedia telecommunications conference systems. Such conference systems permit separated meeting participants to communicate with one another in multiple media such as video, voice and/or data from their own workplace without requiring that they convene in the same place.
In prior known multimedia conference systems, it has been required that the individual meeting participants had to be conversant with sophisticated video and data communications protocols, including, for example network address and transport protocols, in order to set-up and handle a multimedia call in order to establish and operate a virtual meeting. If a prospective participant was not familiar with the video and/or data protocols, it essentially precluded his or her participation in the full virtual meeting. Those prospective participants would be limited to only the audio portion of the virtual meeting. This of course is extremely undesirable. Therefore, a problem exists in providing an easy natural real life way for unsophisticated prospective meeting participants to set-up and handle multimedia telephone calls.
~ummarv of the Invention The problems and limitations with prior multimedia telecommunications conference systems are overcome by utilizing a graphical user interface (multimedia communications application program) that employs realistic metaphors of real life face-to-face meetings in setting up and handling a multimedia call to establish a virtual meeting which is automatically reconfigured in response to user action. This is realized by taking advantage of prospective virtual meeting participants' already existing knowledge of how real life face-to-face meetings operate. To this end, the multimedia communications application program enables the virtual meeting participants through direct manipulation of the realistic graphical metaphors to establish a realistic virtual meeting room metaphor which is displayed on the screen j of their workstation monitor. The virtual meeting room includes a table and chairs arranged in a realistic manner in the meeting room. The virtual meeting room and table are automatically configured in response to user action in such a manner as to minimize the screen area displaying the virtual meeting room and, thereby, maximizing the screen area available for multimedia collaboration by the virtual meeting participants. In one embodiment, an empty chair is displayed at the table which indicates that at least one more participant can be added to the virtual meeting. Once a predetermined maximum number of participants have been included in the virtual meeting, the empty chair is no longer displayed. In a specific example, the multimedia call is established by use of a realistic telephone icon that looks and operates like an ordinary real life telephone.
Brief Descrietion of Drawing FIG. 1 is a graphical representation of a multimedia telecommunications system in which an embodiment of the present invention can be employed;
FIG. 2 is a block diagram illustrating the interaction of components of a multimedia application;
FIG. 3 is a block diagram illustrating the details of a user's workstation;
FIG. 4 is a graphical screen representation of the realistic graphical meeting room metaphor;
FIG. 5 is a graphical screen representation with the multimedia application minimized;
FIG. 6 is a flow chart illustrating the steps a user performs in starting the multimedia application in the initiation of a multimedia telephone call;
FIG. 7 is a graphical screen representation which is displayed upon a user starting the multimedia application in the initiation of the multimedia telephone call;
FIG. 8 is a flow chart illustrating the steps that the user would perform in selecting a telephone to initiate a multimedia call;
.~, 218082 2a FIG. 9 is a graphical screen representation of the call bar that appears when the telephone is selected to initiate the multimedia call;
FIG. 10 is a flow chart illustrating the steps in placing a multimedia call from the directory shown in FIG. 11;
FIG. 11 is a graphical screen representation of a directory;
FIG. 12 is a graphical screen representation of a multimedia call initiated from an entry in the directory;
FIG. 13 is a flow chart illustrating the steps taken in effecting a multimedia call directly from the call bar;
-. 3 2160822 FIG. 14 is a graphical screen representation illustrating a phone number being entered directly from the keyboard of the user workstation;
FIG. 15 is a graphical screen representation illustrating ringing at a remote participant's phone number that is being displayed;
FIG. 16 is a flow chart illustrating the steps taken in effecting a multimedia call from a dial pad;
FIG. 17 is a graphical screen representation illustrating the appearance of the dial pad below the call bar;
FIG. 18 is a graphical screen representation illustrating a phone number 1 o entered on the dial pad;
FIG. 19 is a graphical screen representation illustrating ringing at a remote participant's phone number that is being displayed;
FIG. 20 is a flow chart illustrating the steps taken once the call is placed;
FIG. 21 is a graphical screen representation illustrating the meeting upon a remote participant answering the call;
FIG. 22 is a flow chart illustrating the steps which are taken upon receipt of an incoming call at a user workstation;
FIG. 23 is a graphical screen representation illustrating the name and phone number of the calling party;
2o FIG. 24 is a graphical screen representation illustrating the meeting room upon the called party answering the incoming call;
FIG. 25 is a flow chart illustrating the steps taken in adding a participant to an ongoing meeting.
FIG. 26 is a graphical screen representation illustrating an ongoing meeting with three participants;
FIG. 27 is a graphical screen representation illustrating an ongoing meeting with four participants;
FIG. 28 is a graphical screen representation illustrating the addition of a participant to the meeting shown on the screen of FIG. 26;
3o FIG. 29 is a graphical screen representation illustrating the addition of a participant to the meeting shown on the screen of FIG. 27;
2~sos22 FIG. 30 is a graphical screen representation illustrating the addition of an empty chair to the meeting shown in the screen of FIG. 28;
FIG. 31 is a graphical screen representation illustrating expansion of the meeting room for the meeting shown in the screen of FIG. 29;
FIG. 32 is a graphical screen representation illustrating the addition of an empty chair to the meeting shown in the screen of FIG. 31;
FIG. 33 is a flow chart illustrating the steps taken when a meeting participant permanently leaves the meeting room;
FIG. 34 is a graphical screen representation of an ongoing meeting including i o six participants;
FIG. 35 is a graphical screen representation of the meeting shown in the screen of FIG. 34 upon a participant leaving that meeting;
FIG. 36 is a graphical screen representation of the meeting shown in the screen of )~'IG. 35 with the chairs rearranged;
FIG. 37 is a graphical screen representation of the meeting with the participants rearranged around the table to fill in empty chairs;
FIG. 38 is a graphical screen representation of the meeting shown in the screen of FIG. 37 with the extra empty chair being removed;
FIG. 39 is a graphical screen representation of an ongoing meeting including 2o five participants;
FIG. 40 is a graphical screen representation of the meeting shown in the screen of FIG. 39 upon a participant leaving that meeting;
FIG. 41 is a graphical screen representation of the meeting shown in the screen of FIG. 40 with the chairs rearranged;
FIG. 42 is a graphical screen representation of the meeting with the participants rearranged around the table to fill in empty chairs;
FIG. 43 is a graphical screen representation of the meeting shown in the screen of FIG. 42 with the extra empty chair being removed; and FIG. 44 is a graphical screen representation illustrating the shrinking of the 3o size of the meeting room.
Detailed Descri tn ion FIG. 1 shows an example of multimedia telecommunications system 100 in which an embodiment of the invention may be readily employed. Individual users at different work locations can set-up a multimedia conference call via a number of different desktop communications devices. As shown, the desktop communications 5 devices may include, but are not limited to, personal computer 101 with built in microphone for audio, workstation 102 including an attached video camera 103 and ISDN telephone 104, workstation 105 with attached video camera 106, personal computer 107 with an integrated video camera 108, workstation 109 including video camera 110 and an analog telephone 111, ISDN telephone 112, facsimile (FAX) l0 machine 113 and, finally, analog telephone 114. It should be noted that personal computer 101 does not provide local user video to the meeting, FAX machine 113 only provides FAX service and ISDN telephone 112 and analog telephone 114 only provide audio access to the meeting. The personal computers and workstations may be any of those known in the art, for example, personal computers and/or workstations commercially available from AT&T Corp., Apple Computer Inc., Sun Microsystems Inc. and others.
The several different desktop communications devices are interconnected via communications network 116. Note that workstations 101, 102, 107 and 109, and ISDN telephone 112, facsimile machine 113, and analog telephone 114 are directly connected to communications network 116, while workstation 105 is connected through multimedia server 115 to communications network 116. In this example, communications network 116 could be, for example, a long distance telecommunications network such as a long distance network provided by AT&T.
It may be connected to a number of local telephone networks provided by local exchange carriers or alternate access vendors to provide access to the different desktop communications devices. Alternatively, communications network 116 could be a wide band area network, a local area network or the like. Typically, communications network 116 may include the usual public switched long distance network composed of a plurality of well known digital switching units and may contain one or more packet networks. Additionally, communications network 116 may include known video conference bridge arrangements capable of conferencing video, audio and/or data bit streams among the different desktop communication devices.
Communications network 116 may also include multimedia multipoint control units (MCUs) that provide multimedia call capability including video, audio and/or data bit streams. Such MCU units are known and are described in Bell Core Generic Requirements GR-1337-CORE, Issue 1, September 1993 and entitled "Multipoint Multimedia Conferencing Control Unit". Furthermore, communications network 116 may include an asynchronous transport mode (ATM) network capable of transporting and switching multimedia calls including video, audio, and/or data bit streams.
As indicated above, workstation 1 OS is connected via multimedia server 115 to communications network 116. Multimedia server 115 provides for one or more video, one or more audio and one or more data bit streams to be combined, while maintaining the integrity of those bit streams for transmission to communications network 116, for workstation 105 and the other desktop communications devices in a particular meeting including workstation 105. The functionality of multimedia server 115 can be provided for a particular workstation locally, as shown in relationship to workstation 105, and for the other desktop communications devices in a meeting including workstation 105. It is noted that for the other desktop communications devices in a meeting not including workstation 105 and multimedia server 115, communications network 116 must provide the multimedia server functionality for them.
2o Thus, communications network 116, which is not part of this invention, provides the functionality including the multimedia server functionality, when necessary, for interconnecting selected ones of the desktop communications devices in particular virtual meetings, as desired.
FIG. 2 illustrates in simplified block diagram form how multimedia application, i.e., the graphical user interface, 201 (201') located on the user personal computer or workstation communicates via application program interfaces that connect to middleware 202 (202'). Note that the solid lines in FIG. 2 denote direct connectivity between elements 201 through 203 and 203' through 201', and vice versa, while the dotted lines denote logical connectivity between, for example, elements 201 3o and 201', and 202 and 202'. Middleware 202 (202') is software that is located at the workstation and also distributed among intelligent points in communications network 116. Middleware 202 (202') serves to isolate the multimedia application from ~isos22 platform differences (e.g., UNIX versus MS-DOS and the like) and communications network 116 details. Middleware 202 (202') also serves as a link between the workstation application programs, for example, 201, and network transport 203 server functions, as well as, applications that include, but are not limited to, multimedia call connection setup, directory services of people and network resources, information services, messaging services, and the like. When a user places or receives a multimedia call from his or her workstation, the workstation automatically registers its capabilities with middleware 202 (202'). Middleware 202 (202') employs the registered capabilities to control call setup and transmission of video, audio and/or to data. Since, all the capabilities (e.g., full-video, shared data, facsimile, audio and the like) from all of the meeting participants' workstations are registered with middleware 202 (202'), it is available to all of the meeting participants. When information is to be transmitted to participants in the multimedia meeting, middleware 202 (202') determines the proper display formats and transport protocols. Such middleware is 15 known in the art, see for example, an article entitled "Middleware's Next Step:
Enterprise-Wide Applications", Data Co municatin"s. Sept. 1992, pages 157-164 and an article entitled "Closeup Middleware: Networking's Silly Putty", C'om_m~nications Week, June 20, 1994, pages 48-49.
FIG. 3 shows, in simplified block diagram form details of a user's workstation.
20 Specifically, shown is central processing unit (CPU) 301 which is interconnected via bus 302 to random access memory (RAM) 303, data memory 304, which may be a ROM, and input/output (I/O) unit 305. I/O 305 interfaces pointing device 306, video camera 307, if available, telephone 308, analog or ISDN if available, keyboard 309, and display device 310 to bus 302 and to network interface 311. Such workstations 25 units are known in the art and commercially available, as indicated above, and provide shared data capabilities. Network interface 311 comprises an application program interface that translates computer application requests into the appropriate transport format for transmission via communications network 116 and also takes requests from communications network 116 and translates them into a format appropriate for 3o interacting with the workstation's applications program. Such arrangements are known in the art. It is further noted that transmission from a user workstation to communications network 116 may be via any of a number of transmission -- 8 zlsoszz arrangements for example, digital data system (DDS), basic rate interface (BRI) ISDN, primary rate interface (PRI) ISDN, a modem, analog transmission, digital transmission, facsimile transmission, or the like. It is noted that a mouse, track ball, touch screen, keyboard cursor control keys or the like may be employed as a pointing device.
FIG. 4 is a graphical screen representation of the real life meeting room metaphor illustrating the various components that could be included in a multimedia meeting. Shown in FIG. 4 is image icon 401, illustrating the image of the originator of the meeting, realistic telephone 402 which is used to place and receive multimedia 1o calls, image icon 403 of a participant in the meeting, empty chair 404 which is available for an additional participant to be included in the meeting, generic image icon 405 which would be employed for a participant whose bit map image is not available, table 406 on which objects can be placed to be shared among the meeting participants, projector 407 which is shown on table 406 and may be utilized to share 15 images among the participants, and view graph folder 408 which contains images that can be placed on the projector 407. Also, shown in FIG. 4 is tool closet 409, which includes the multimedia tools that may be utilized during a multimedia meeting by the participants. Shown in tool closet 409, in this example, are copier 410 which may be utilized by the participants to send computer files from one participant to one or more 20 of the other participants, application sharer (link) 411 which enables the participants to share a computer application program, screen snapshot camera 412 which is used to create a view graph by taking a snapshot of any portion of the monitor screen, call timer 413 which times the length of the multimedia call and can be used to set an alarm, slide projector 414 which is used to display a presentation of a sequence of one 25 or more images to the meeting participants, and FAX machine 415 which is used to send facsimiles to meeting participants and others. The instrumentalities shown in tool closet 409 are by way of example and any other desired multimedia tools may also be included. It is noted that tool closet 409 may be closed to save screen space on the user's workstation monitor screen. Note that the icons are of realistic real life 30 objects that are or should be well known to the meeting participants.
Since, all of the objects are well known as to their nature and use, the meeting participants do not need to know any sophisticated protocols in order to use them. Indeed, the virtual meeting participants use the realistic icons in the same manner as they would their real life counterparts. Additionally, the image icons of the meeting participants are arranged around the table in similar fashion as the participants would be seated in a real life face-to-face meeting. This allows the participants to interact with each other and use the objects in the meeting room based on their already existing knowledge.
This, in turn, enhances the ease of use of the graphical user interface of this invention.
FIG. 5 is a graphical screen representation with the multimedia application (MMECA) SO1 minimized. Also shown are a number of other application programs which have been minimized. Note that the multimedia application of this invention to can be implemented on top of a number of known personal computer systems.
Examples of such systems programs are the Vistium* personal video system commercially available from AT&T Corp. and the ProShare* personal conferencing system 200 commercially available from Intel Corporation (* note that Vistium is a trademark of AT&T Corp. and that ProShare is a trademark of Intel Corporation). In 15 this example, it is assumed that the personal video system is included as part of the user workstation and provides the network interface 311 (FIG. 3).
FIG. 6 is a flow chart illustrating the steps in utilizing the multimedia application for initiating a multimedia telephone call. In step 601, a user initiates a multimedia call. Then, in step 602, the user determines whether or not the multimedia 20 application is running. If the test result in step 602 is YES, in step 603, the user determines whether the multimedia application is minimized. If the test result in step 603 is YES, the user selects the minimized multimedia application icon 501, as shown in FIG. 5. Thereafter, control is transferred to step 605 in which the meeting room window opens as shown in the screen of FIG. 7. Returning to step 603, if the test 25 result is NO, the multimedia application is not minimized and the meeting room window is already open, as shown in the screen of FIG. 7. Returning to step 602, if the test result is NO, in step 607, the user starts the multimedia application in a manner consistent with the operating system employed in the user workstation.
Thereafter, control is passed to step 605 where the meeting room window opens and is 3o displayed, as shown in the screen of FIG. 7.
FIG. 7, as indicated above, is a graphical screen representation displayed upon a user starting the multimedia application upon initiating a multimedia call.
In the example shown in FIG. 7, image icon 701 is of the multimedia call originator.
Also shown is telephone 702 which may be used to originate the multimedia call, empty chair 703 which is available for an additional meeting participant to join the meeting in the multimedia call, table 704 which is used to share objects among the 5 participants, projector 705 which is used to share images among the meeting participants, view graph folder 706 which contains the images to be shared among the meeting participants, and tool closet 707 which is closed. Again, note that the icons are of realistic real life objects which are well known to the meeting participants.
FIG. 8 is a flow chart illustrating the steps taken in the user selecting telephone 10 702 (FIG. 7) to initiate a multimedia call. Thus, in step 801, the user selects the realistic telephone icon 702. This causes a call bar to appear on the screen adjacent to telephone 702, as shown in the screen of FIG. 9. The call bar includes a field 901 for the user to enter a number to be called directly from the workstation keyboard, and a dial pad button 902, which when selected will display a dial pad for entering the number. Additionally, in this example, option buttons 903 and 904 are provided to select either a local on-line telephone directory or a corporate telephone directory located on the network. It should be noted that the directories associated with option buttons 903 and 904 are just examples of such directories that can be utilized for selecting the number to be called.
FIG. 10 is a flow chart illustrating the steps the user takes in placing a call from a multimedia directory. Thus, the process is initiated via step 1001 from the screen shown in FIG. 9. Then, in step 1002, the user selects the call initiation technique which, in this example, is the directory. This causes the directory application window to open via step 1003 and is shown in the screen of FIG.
11. The directory, shown in the window of FIG. 1 l, is just one example of numerous such directories that may be employed. Then, in step 1004, the user searches for the name of the desired prospective participant to be called in the multimedia call.
This is realized by the user browsing through the directory.
Upon the user locating the name of the desired prospective meeting 3o participant, he or she places the multimedia call via step 1005. The call placement may be effected by any desired method, one of which is to select call button 1101, as shown adjacent to the prospective participant's telephone number in FIG. 11.
The l, 216082 placement of the call by the user in step 1005 causes the screen as shown in FIG. 12 to be displayed via step 1006. As shown in FIG. 12, the call bar adjacent to the telephone displays the name and telephone number of the prospective meeting participant that was dialed.
FIG. 13 is a flow chart illustrating the steps the user takes in effecting a multimedia call directly from the call bar, shown in FIG. 9. This process is initiated in step 1301 from the screen shown in FIG. 9. Then, in step 1302, the user enters the desired participant's telephone number on the local workstation keyboard. This causes the telephone number being dialed to appear in the call bar, as shown in the screen of 1o FIG. 14. Then, in step 1303, the user, in this example, presses enter on the keyboard to cause the displayed number to be dialed, which also causes the call bar to display that the number is being dialed, as shown in the screen of FIG. 15.
FIG. 16 is a flow chart illustrating the steps a user would take in effecting a multimedia call from the dial pad. This process is initiated in step 1601 from the screen of FIG. 9. In this instance, the user selects the dial pad option 902 from the call bar via step 1602, which causes the dial pad to appear on the screen, as shown in the screen of FIG. 17. Then, in step 1603, the user enters the desired participant's telephone number from the dial pad using a pointing device such as a mouse.
This, in turn, causes the number entered to appear in the call .bar, as shown in the screen of 2o FIG. 18. Then, in step 1604, the user selects the dial button from the dial pad, which causes the telephone number to be dialed. This, causes the call bar screen to display that the number is being dialed, as shown in the screen of FIG. 19.
FIG. 20 is a flow chart illustrating the steps which are taken once the multimedia call is placed, as displayed in either of the screens in FIGS. 12, 15 or 19, as initiated via step 2001. Then, as shown in either of FIGS. 12, 15 or 19, and as indicated in step 2002, the call has been placed and the dialed number and the name of the called participant, if available, appear in the call bar, as well as, a hang up option.
Then, step 2003 tests to determine if the call has been answered. If the test result in step 2003 is NO, in step 2004, the user selects the hang up option from the call bar.
Thereafter, the call bar is removed and the screen appears, as shown in FIG.7.
Returning to step 2003, if the test result is YES, step 2006 causes the call to begin with audio only, causes the call bar to be removed from the screen, and causes an icon ~2 2iso~~z of the called participant to be placed in the meeting room on a chair, as shown in the screen of FIG. 21. It is noted that if the participant's image bit map is not available the generic image icon 405 will appear instead.
FIG. 22 is a flow chart illustrating the steps which are effected upon receipt of an incoming multimedia call at a prospective meeting participant's workstation. The process is entered with the incoming call via step 2201. Thereafter, step 2202 tests to determine if the multimedia application is running at the prospective participant's workstation. If the test result in step 2202 is NO, step 2203 causes only the telephone to ring. Then, the only option available to the called participant is to participate in the to audio portion of the meeting. Returning to step 2202, if the test result is YES, step 2204 causes audible ringing to occur, the meeting room to appear on the participant's screen and the call bar to appear next to the telephone in a realistic meeting room metaphor, as shown in the screen of FIG. 23. Additionally, as shown in the screen of FIG. 23, the name and number of the calling party is displayed in the call bar. Then, in step 2205, the participant selects a desired call bar option. Thereafter, step 2206 tests to determine which option has been selected by the participant, namely, ignore, answer or other. If the test result in step 2206 indicates that the ignore option is selected, step 2207 causes the telephone to stop ringing, the realistic meeting room metaphor to be minimized and the call follows whatever call path has been setup by 2o the network (for example, with a PBX the call could be sent to voice mail or to coverage) and the called participant's screen appears as shown in FIG. 5.
Returning to step 2206, if the called participant selects other, step 2208 causes the called participant's workstation to perform any system specific action that the participant desires, such as voice mail or the like. Again, returning to step 2206, if the called participant selects answer, step 2209 causes the called participant's workstation to register its capabilities with the communications network middleware, the call bar on the called participant's screen is removed and the screen displays the real life meeting room with icons representing all the current meeting participants including the called participant being placed around the table in a realistic manner as would occur in a real life face-to-face meeting, as shown in the screen of FIG. 24.
FIG. 25 is a flow chart illustrating the steps that are taken in the automatic reconfiguration of the room and table when adding a participant to an ongoing virtual meeting. This process of adding a participant is initiated by step 2501 from either a meeting having an odd number of participants as shown in the screen of FIG. 26 or a meeting having an even number of participants as shown in the screen of FIG.
27.
Then, step 2502 causes the participant to be added to the empty chair in the meeting room, as shown in the screens of either FIG. 28 or FIG. 29. Once the participant has been added, step 2503 tests to determine if the number of participants has reached a predetermined maximum. If the test result in step 2503 is YES, the process is ended via step 2504, since no more participants can be added. Note that since the maximum number of participants has been reached, the room cannot be expanded nor can an to empty chair be added for any additional participants. If the test result in step 2503 is NO, step 2505 tests to determine if there is room to add an empty chair around the meeting table, i.e. whether there is an even number of participants. If the test result in step 2505 is NO, step 2506 causes the virtual meeting room and the table to expand by one participant space, as shown in the screen of FIG. 31. Thereafter, control is passed 15 to step 2507. If the test result in step 2505 is YES, control is passed directly to step 2507, which causes an empty chair to be added to the virtual meeting room.
This is shown in the screen of FIG. 30 for a room which did not require expansion and in the screen of FIG. 32 for a room which has been expanded. Thereafter, step 2508 causes the automatically reconfigured meetings) to continue.
20 FIG. 33 is a flow chart illustrating the steps taken in the automatic reco~guration of the meeting room and table when a participant permanently leaves the virtual meeting room. This process is initiated in step 3301 from an ongoing meeting having either an even number of participants, as shown in the screen of FIG.
34, or an odd number of participants, as shown in the screen of FIG. 39. Then, in step 25 3302, a test is made to determine whether a participant has permanently left the virtual meeting room, as shown in the screens of FIGS. 35 and 40, for the meeting shown in the screens of FIGS. 34 and 39, respectively. If a participant temporarily leaves the meeting (puts the call on hold) the room does not reconfigure and the particular participant's chair will remain empty until he or she returns. Step 3303 causes the 3o meeting participants of the virtual meeting on the same side of the table below the empty chair of the participant who left to move up one chair, as illustrated in the screens of FIGs. 36 and 41. Thereafter, step 3304 tests whether or not there are two 21fi~8~~
F"" 14 empty chairs on the same side of the table. If the test result in step 3304 is YES, step 3305 causes the person in the chair at the bottom of the table to move from the other side of the table to the top empty chair, as shown in the screens of FIGS. 37 and 42.
Thereafter, control is passed to step 3306 which tests to determine whether or not there are two empty chairs around the table. Returning to step 3304, if the test result is NO, control is directly passed to step 3306. If the test result in step 3306 is NO, there is only one empty chair and the process is ended via step 3307. If the test result in step 3306 is YES, step 3308 causes an empty chair at the lowest point of the table or on the left side of the table to be removed, as shown in the screens of FIGs.
38 and 43.
to Then, step 3309 tests whether or not there is excess space at the bottom of the table so that the room and table can be shrunk in size, i.e. whether or not there is an even number of participants in the virtual meeting room, as shown in the screen of FIG. 43.
If the test result in step 3309 is NO, the process is ended via step 3307. If the test result in step 3309 is YES, the table and room are shrunk by one chair space, as 15 shown in the screen of FIG. 44, and the meeting is continued including the automatically reconfigured room and table.
Claims (26)
1. A method for use in a user workstation including a pointing device and a visual display unit to provide a graphical user interface for graphically depicting in a realistic manner setting up and/or handling of a multimedia call for a multimedia virtual meeting, comprising the steps of:
initiating a multimedia call from the user workstation to at least one prospective participant of the virtual meeting;
displaying in an area on a screen of the visual display unit at the user's workstation a graphical representation of a realistic virtual meeting room metaphor including realistic icons of at least a table, the user's image, at least one empty chair and a telephones wherein the user's image icon and the at least one empty chair icon are positioned around the table icon in a realistic, real life manner and the realistic telephone icon is for use in setting up a multimedia call to the at least one prospective virtual meeting participant, said empty chair being an indication that a prospective participant can be added to the virtual meeting;
filling the empty chair when a participant is added to the virtual meeting;
adding an empty chair if a maximum number of participants has not been attained;
adjusting the virtual meeting room display area on the users workstation screen to accommodate an added chair when that occurs; and causing the realistic icons to be arranged in the virtual meeting room metaphor being displayed so that the adjusted screen area displaying the virtual meeting room is minimized.
initiating a multimedia call from the user workstation to at least one prospective participant of the virtual meeting;
displaying in an area on a screen of the visual display unit at the user's workstation a graphical representation of a realistic virtual meeting room metaphor including realistic icons of at least a table, the user's image, at least one empty chair and a telephones wherein the user's image icon and the at least one empty chair icon are positioned around the table icon in a realistic, real life manner and the realistic telephone icon is for use in setting up a multimedia call to the at least one prospective virtual meeting participant, said empty chair being an indication that a prospective participant can be added to the virtual meeting;
filling the empty chair when a participant is added to the virtual meeting;
adding an empty chair if a maximum number of participants has not been attained;
adjusting the virtual meeting room display area on the users workstation screen to accommodate an added chair when that occurs; and causing the realistic icons to be arranged in the virtual meeting room metaphor being displayed so that the adjusted screen area displaying the virtual meeting room is minimized.
2. The method as defined in claim 1 further including the steps of selecting the realistic telephone icon and displaying a call bar on the screen in predetermined spatial relationship to the virtual meeting room metaphor in response to the selection of the telephone icon, the call bar including at least one option to be used in placing the multimedia call.
3. The method as defined in claim 2 wherein the call bar includes at least a dial pad option which can be employed in placing the multimedia call and an area for displaying a telephone number and further including the steps of selecting the dial pad option to place the multimedia call, displaying on the screen a realistic dial pad icon, inputting the at least one prospective participant's telephone number via the dial pad, displaying the telephone number being inputted in the call bar and causing the displayed number to be dialed.
4. The method as defined in claim 2 wherein the call bar includes at least a directory option which can be employed in placing the multimedia call and an area for displaying a telephone number, the directory including at least names and telephone numbers of individuals and further including the steps of selecting the directory option to place the multimedia call, displaying on the screen a realistic directory page icon, locating the name and telephone number in the directory of the at least one prospective participant, selecting the at least one prospective participant's telephone number from the directory, displaying the selected telephone number in the dial bar and causing the displayed number to be dialed.
5. The method as defined in claim 2 wherein the user workstation includes a keyboard having number keys and the call bar includes an area for displaying a telephone number and further including the steps of inputting the at least one prospective participant's telephone number via the keyboard number keys, displaying the telephone number being inputted in the dial bar and causing the displayed number to be dialed.
6. The method as defined in claim 1 further including the steps of selecting the realistic telephone icon and displaying a call bar on the screen in predetermined spatial relationship to the virtual meeting room metaphor in response to the selection of the telephone icon, the call bar including at least an area to display a telephone number to be dialed, supplying a telephone number of the at least one prospective participant to be dialed, displaying the supplied telephone number in the call bar area and causing the displayed number to be dialed, determining if the dialed number has been answered, if the dialed number is answered, removing the call bar from the display and displaying an image icon representative of the answering virtual meeting participant over the empty chair.
7. The method as defined in claim 6 further including the steps of determining if the number of participants in the virtual meeting is a maximum allowable number and if not, adding an empty chair at the table indicating that another prospective participant may be added to the virtual meeting.
8. The method as defined in claim 7 further including the steps of determining if the virtual meeting room and table need to be expanded to accommodate the added empty chair and, if so, expanding the size of the virtual meeting room and table to accommodate the added empty chair while keeping the virtual meeting room display area at a minimum size in order to accommodate the added empty chair.
9. The method as defined in claim 6 wherein a number of virtual meeting participants have been called and have been added to the virtual meeting with an image icon of each of the number of the added participants being placed over a respective chair around the table icon and further including the steps of determining if one or more of the virtual meeting participants have left the virtual meeting, if so, removing the image icons of the one or more participants that have left and displaying empty chairs around the table icon in place of the removed one or more image icons.
10. The method as defined in claim 9 further including the steps of rearranging the image icons around the table icon of the remaining virtual meeting participants to fill the one or more empty chairs if they are above the image icons of the remaining participants, if there are more than one empty chairs, removing all but one of the empty chairs, determining if there is space to shrink the length of the displayed virtual meeting room and, if so, shrinking the length of the virtual meeting room and the table to a length long enough to accommodate the image icons of the remaining virtual meeting participants and the one empty chair so that the virtual meeting room display area is kept to a minimum.
11. The method as defined in claim 1 wherein the meeting room includes a tool closet including tools to be employed in the multimedia virtual meeting for collaboration and/or communication among the virtual meeting participants, the tool closet being initially in a closed condition so that the screen area displaying the virtual meeting room is minimized.
12. The method as defined in claim 11 further including the steps of opening the tool closet and displaying on the screen realistic icons of the multimedia tools so that any one of the virtual meeting participants having a workstation including a pointing device and a visual display unit may select a tool from the opened tool closet to collaborate and/or communicate with one or more of the virtual meeting participants.
13. The method as defined in claim 1 wherein the step of adjusting further includes decreasing the display area of the virtual meeting being displayed on the user's workstation screen upon removal of an empty chair from the virtual.
meeting being displayed so that the adjusted display area is kept at a minimum.
meeting being displayed so that the adjusted display area is kept at a minimum.
14. Apparatus for use in a user workstation including a pointing device and a visual display unit to provide a graphical user interface for graphically depicting in a realistic manner setting up and/or handling of a multimedia call for a multimedia virtual meeting, comprising;
means for initiating a multimedia call from the user workstation to at least one prospective participant of the virtual meeting;
means for displaying in an area on a screen of the visual display unit at the user's workstation a graphical representation of a realistic virtual meeting room metaphor including realistic icons of at least a table, the user's image, at least one empty chair and a telephone, wherein the user's image icon and the at least one empty chair icon are positioned around the table icon in a realistic, real life manner and the realistic telephone icon is for use in setting up a multimedia call to the at least one prospective virtual meeting participant, said empty chair being an indication that a prospective participant can be added to the virtual meeting;
means for filling the empty chair when a participant is added to the virtual meeting;
means for adding an empty chair if a maximum number of participants has not been attained;
means for adjusting the virtual meeting room display area on the users workstation screen to accommodate an added chair when that occurs; and means for causing the realistic icons to be arranged in the virtual meeting room metaphor being displayed so that the adjusted screen area displaying the virtual meeting room is minimized.
means for initiating a multimedia call from the user workstation to at least one prospective participant of the virtual meeting;
means for displaying in an area on a screen of the visual display unit at the user's workstation a graphical representation of a realistic virtual meeting room metaphor including realistic icons of at least a table, the user's image, at least one empty chair and a telephone, wherein the user's image icon and the at least one empty chair icon are positioned around the table icon in a realistic, real life manner and the realistic telephone icon is for use in setting up a multimedia call to the at least one prospective virtual meeting participant, said empty chair being an indication that a prospective participant can be added to the virtual meeting;
means for filling the empty chair when a participant is added to the virtual meeting;
means for adding an empty chair if a maximum number of participants has not been attained;
means for adjusting the virtual meeting room display area on the users workstation screen to accommodate an added chair when that occurs; and means for causing the realistic icons to be arranged in the virtual meeting room metaphor being displayed so that the adjusted screen area displaying the virtual meeting room is minimized.
15. The apparatus as defined in claim 14 further including means for selecting the realistic telephone icon and means for displaying a call bar on the screen in predetermined spatial relationship to the virtual meeting room metaphor in response to the selection of the telephone icon, the call bar including at least one option to be used in placing the multimedia call.
16. The apparatus as defined in claim 15 wherein the call bar includes at least a dial pad option which can be employed in placing the multimedia call and an area for displaying a telephone number and further including means for selecting the dial pad option to place the multimedia call, means for displaying on the screen a realistic dial pad icon to input the at least one prospective participant's telephone number via the dial pad, means for displaying the telephone number being inputted in the dial bar and means for causing the displayed number to be dialed.
17. The apparatus as defined in claim 15 wherein the call bar includes at least a directory option which can be employed in placing the multimedia call and an area for displaying a telephone number, the directory including at least names and telephone numbers of individuals and further including means for selecting the directory option to place the multimedia call, means for displaying on the screen a realistic directory page icon, means for locating the name and telephone number in the directory of the at least one prospective participant, means for selecting the at least one prospective participant's telephone number from the directory, means for displaying the selected telephone number in the dial bar and means for causing the displayed number to be dialed.
18. The apparatus as defined in claim 15 wherein the user workstation includes a keyboard having number keys and the call bar includes an area for displaying a telephone number and further including the keyboard to be used to input the at least one prospective participants telephone number via the keyboard number keys, means for displaying an inputted telephone number in the dial bar and means for causing the displayed number to be dialed.
19. The apparatus as defined in claim 14 further including means for selecting the realistic telephone icon and means for displaying a call bar on the screen in predetermined spatial relationship to the virtual meeting room metaphor in response to the selection of the telephone icon, the call bar including at least an area to display a telephone number to be dialed, means for supplying a telephone number of the at least one prospective participant to be dialed, means for displaying the supplied telephone number in the call bar area and means for causing the displayed number to be dialed, means for determining if the dialed number has been answered, and means for removing
20 the call bar from the display upon the call being answered and for displaying an image icon representative of the answering virtual meeting participant over the empty chair.
20. The apparatus as defined in claim 19 further including means for determining if the number of participants in the virtual meeting is a maximum allowable number and means for adding an empty chair at the table indicating that another prospective participant may be added to the virtual meeting when the number of participants in the virtual meeting is less than the maximum.
20. The apparatus as defined in claim 19 further including means for determining if the number of participants in the virtual meeting is a maximum allowable number and means for adding an empty chair at the table indicating that another prospective participant may be added to the virtual meeting when the number of participants in the virtual meeting is less than the maximum.
21. The apparatus as defined in claim 20 further including the means for determining if the virtual meeting room and table need to be expanded to accommodate the added empty chair and means for expanding the size of the virtual meeting room and table to accommodate the added empty chair while keeping the virtual meeting room display area at a minimum size in order to accommodate the added empty chair.
22. The apparatus as defined in claim 19 wherein a number of virtual meeting participants have been called and have been added to the virtual meeting with an image icon of each of the number of the added participants being placed over a respective chair around the table icon and further including means for determining if one or more of the virtual meeting participants have left the virtual meeting, means for removing the image icons of the one or more participants that have left the virtual meeting and for displaying empty chairs around the table icon in place of the removed one or more image icons.
23. The apparatus as defined in claim 22 further including means for rearranging the image icons around the table icon of the remaining virtual meeting participants to fill the one or more empty chairs if they are above the image icons of the remaining participants, the means for removing removes all but one of the empty chairs, means for determining if there is space to shrink the length of the displayed virtual meeting room and means for shrinking the length of the virtual meeting room and the table to a length long enough to accommodate the image icons of the remaining virtual meeting participants and the one empty chair so that the virtual meeting room display area is kept to a minimum.
24. The apparatus as defined in claim 14 wherein the meeting room includes a tool closet including tools to be employed in the multimedia virtual meeting for collaboration and/or communication among the virtual meeting participants, the tool closet being initially in a closed condition so that the screen area displaying the virtual meeting room is minimized.
25. The apparatus as defined in claim 24 further including means for opening the tool closet and for displaying on the screen realistic icons of the multimedia tools so that any one of the virtual meeting participants having a workstation including a pointing device and a visual display unit may select a tool from the opened tool closet to collaborate and/or communicate with one or more of the virtual meeting participants.
26. The apparatus as defined in claim 14 wherein the means for adjusting further includes means for decreasing the display area of the virtual meeting being displayed on the user's workstation screen upon removal of an empty chair from the virtual meeting being displayed so that the adjusted display area is kept at a minimum.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/357,811 US5627978A (en) | 1994-12-16 | 1994-12-16 | Graphical user interface for multimedia call set-up and call handling in a virtual conference on a desktop computer conferencing system |
| US357,811 | 1994-12-16 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2160822A1 CA2160822A1 (en) | 1996-06-17 |
| CA2160822C true CA2160822C (en) | 2000-12-12 |
Family
ID=23407127
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002160822A Expired - Fee Related CA2160822C (en) | 1994-12-16 | 1995-10-18 | Graphical user interface for multimedia call set-up and call handling |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US5627978A (en) |
| EP (1) | EP0717345B1 (en) |
| JP (1) | JP3184443B2 (en) |
| CA (1) | CA2160822C (en) |
| DE (1) | DE69525600T2 (en) |
Families Citing this family (155)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7448063B2 (en) * | 1991-11-25 | 2008-11-04 | Actv, Inc. | Digital interactive system for providing full interactivity with live programming events |
| US20040261127A1 (en) * | 1991-11-25 | 2004-12-23 | Actv, Inc. | Digital interactive system for providing full interactivity with programming events |
| US20020091850A1 (en) | 1992-10-23 | 2002-07-11 | Cybex Corporation | System and method for remote monitoring and operation of personal computers |
| US6651050B2 (en) | 1994-05-02 | 2003-11-18 | International Business Machines Corporation | Co-presence data retrieval system which indicates observers of data |
| US6243714B1 (en) | 1997-04-11 | 2001-06-05 | Ubique Ltd. | Co-presence data retrieval system |
| US5802281A (en) | 1994-09-07 | 1998-09-01 | Rsi Systems, Inc. | Peripheral audio/video communication system that interfaces with a host computer and determines format of coded audio/video signals |
| US5754636A (en) * | 1994-11-01 | 1998-05-19 | Answersoft, Inc. | Computer telephone system |
| US5854898A (en) | 1995-02-24 | 1998-12-29 | Apple Computer, Inc. | System for automatically adding additional data stream to existing media connection between two end points upon exchange of notifying and confirmation messages therebetween |
| US5721842A (en) * | 1995-08-25 | 1998-02-24 | Apex Pc Solutions, Inc. | Interconnection system for viewing and controlling remotely connected computers with on-screen video overlay for controlling of the interconnection switch |
| JPH0970034A (en) * | 1995-08-31 | 1997-03-11 | Canon Inc | Terminal equipment |
| JP4156027B2 (en) * | 1995-08-31 | 2008-09-24 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Terminal |
| US5878403A (en) | 1995-09-12 | 1999-03-02 | Cmsi | Computer implemented automated credit application analysis and decision routing system |
| US7181427B1 (en) * | 1995-09-12 | 2007-02-20 | Jp Morgan Chase Bank, N.A. | Automated credit application system |
| US5754775A (en) * | 1995-09-27 | 1998-05-19 | Intel Corporation | Method and apparatus for formulating connection addresses on a PC conferencing system supporting multiple transport type |
| US5960173A (en) * | 1995-12-22 | 1999-09-28 | Sun Microsystems, Inc. | System and method enabling awareness of others working on similar tasks in a computer work environment |
| US7035914B1 (en) | 1996-01-26 | 2006-04-25 | Simpleair Holdings, Inc. | System and method for transmission of data |
| US6021433A (en) * | 1996-01-26 | 2000-02-01 | Wireless Internet, Inc. | System and method for transmission of data |
| US5761606A (en) * | 1996-02-08 | 1998-06-02 | Wolzien; Thomas R. | Media online services access via address embedded in video or audio program |
| US6513069B1 (en) * | 1996-03-08 | 2003-01-28 | Actv, Inc. | Enhanced video programming system and method for providing a distributed community network |
| US20020049832A1 (en) * | 1996-03-08 | 2002-04-25 | Craig Ullman | Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments |
| US5841976A (en) * | 1996-03-29 | 1998-11-24 | Intel Corporation | Method and apparatus for supporting multipoint communications in a protocol-independent manner |
| US5956491A (en) | 1996-04-01 | 1999-09-21 | Marks; Daniel L. | Group communications multiplexing system |
| US6396510B1 (en) * | 1996-06-21 | 2002-05-28 | Intel Corporation | Method and apparatus for scheduling a multi-point electronic conference |
| US6167426A (en) | 1996-11-15 | 2000-12-26 | Wireless Internet, Inc. | Contact alerts for unconnected users |
| US6151619A (en) * | 1996-11-26 | 2000-11-21 | Apple Computer, Inc. | Method and apparatus for maintaining configuration information of a teleconference and identification of endpoint during teleconference |
| US6446125B1 (en) * | 1997-03-28 | 2002-09-03 | Honeywell International Inc. | Ripple scheduling for end-to-end global resource management |
| JP2001521701A (en) * | 1997-04-18 | 2001-11-06 | ブリティッシュ・テレコミュニケーションズ・パブリック・リミテッド・カンパニー | Network integrating computer and telephone |
| KR100238180B1 (en) * | 1997-05-02 | 2000-01-15 | 윤종용 | Method for controlling computer communication using control window |
| US5999174A (en) * | 1997-07-02 | 1999-12-07 | At&T Corporation | Reusable sparing cell software component for a graphical user interface |
| US6664985B1 (en) | 1997-07-02 | 2003-12-16 | At&T Corporation | Method and apparatus for supervising a processor within a distributed platform switch through graphical representations |
| US6157378A (en) * | 1997-07-02 | 2000-12-05 | At&T Corp. | Method and apparatus for providing a graphical user interface for a distributed switch having multiple operators |
| US20040138992A1 (en) * | 1997-09-03 | 2004-07-15 | Defrancesco James | Computer implemented automated credit application analysis and decision routing system |
| US6100887A (en) * | 1997-12-05 | 2000-08-08 | At&T Corporation | Reusable reversible progress indicator software component for a graphical user interface |
| US6201538B1 (en) * | 1998-01-05 | 2001-03-13 | Amiga Development Llc | Controlling the layout of graphics in a television environment |
| US6313853B1 (en) * | 1998-04-16 | 2001-11-06 | Nortel Networks Limited | Multi-service user interface |
| US6243452B1 (en) * | 1998-04-23 | 2001-06-05 | Nortel Networks Limited | Graphical call status presentation system |
| US6505176B2 (en) | 1998-06-12 | 2003-01-07 | First American Credit Management Solutions, Inc. | Workflow management system for an automated credit application system |
| US5999208A (en) * | 1998-07-15 | 1999-12-07 | Lucent Technologies Inc. | System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room |
| US6215498B1 (en) | 1998-09-10 | 2001-04-10 | Lionhearth Technologies, Inc. | Virtual command post |
| CA2345084C (en) | 1998-09-22 | 2004-11-02 | Cybex Computer Products Corporation | System for accessing personal computers remotely |
| US6278454B1 (en) * | 1998-09-24 | 2001-08-21 | Ericsson Inc. | Call progress graphical user interface |
| US6330022B1 (en) * | 1998-11-05 | 2001-12-11 | Lucent Technologies Inc. | Digital processing apparatus and method to support video conferencing in variable contexts |
| US6192395B1 (en) * | 1998-12-23 | 2001-02-20 | Multitude, Inc. | System and method for visually identifying speaking participants in a multi-participant networked event |
| US7702720B1 (en) | 1998-12-30 | 2010-04-20 | Software Management, Inc. | Method and system for conducting a plurality of cyber-based conventions |
| US8700696B2 (en) * | 1998-12-30 | 2014-04-15 | Software Management, Inc. | Method and system for conducting a plurality of cyber-based conventions |
| ES2172378B1 (en) * | 1999-05-14 | 2003-12-16 | Gili Monica Socias | MULTIPLE TELECOMMUNICATIONS MACHINE FOR COMMON, PUBLIC AND / OR PRIVATE USE |
| WO2000070499A1 (en) * | 1999-05-14 | 2000-11-23 | Monica Socias Gili | Multiple telecommunications machine for common, public and/or private use |
| US6346934B1 (en) | 1999-05-17 | 2002-02-12 | Gateway, Inc. | Programmable remote device control apparatus and method |
| US6556219B1 (en) * | 1999-05-18 | 2003-04-29 | Gateway, Inc. | Method and system for peripheral device user interface construction |
| US6629129B1 (en) * | 1999-06-16 | 2003-09-30 | Microsoft Corporation | Shared virtual meeting services among computer applications |
| US6288753B1 (en) | 1999-07-07 | 2001-09-11 | Corrugated Services Corp. | System and method for live interactive distance learning |
| US20060121938A1 (en) * | 1999-08-12 | 2006-06-08 | Hawkins Jeffrey C | Integrated handheld computing and telephony device |
| US6781575B1 (en) * | 2000-09-21 | 2004-08-24 | Handspring, Inc. | Method and apparatus for organizing addressing elements |
| US7503016B2 (en) * | 1999-08-12 | 2009-03-10 | Palm, Inc. | Configuration mechanism for organization of addressing elements |
| US8064886B2 (en) * | 1999-08-12 | 2011-11-22 | Hewlett-Packard Development Company, L.P. | Control mechanisms for mobile devices |
| US7007239B1 (en) * | 2000-09-21 | 2006-02-28 | Palm, Inc. | Method and apparatus for accessing a contacts database and telephone services |
| US20040193722A1 (en) * | 1999-08-30 | 2004-09-30 | Donovan Kevin Remington Joseph Bartholomew | Universal instant messaging system for the internet |
| US7120871B1 (en) | 1999-09-15 | 2006-10-10 | Actv, Inc. | Enhanced video programming system and method utilizing a web page staging area |
| US7949722B1 (en) | 1999-09-29 | 2011-05-24 | Actv Inc. | Enhanced video programming system and method utilizing user-profile information |
| US6496201B1 (en) * | 1999-09-30 | 2002-12-17 | International Business Machines Corporation | System and user interface for multiparty conferencing |
| US7209980B2 (en) | 1999-12-17 | 2007-04-24 | Gateway Inc. | Method and system for interpreting device control commands |
| US7353251B1 (en) * | 1999-12-23 | 2008-04-01 | Polycom, Inc. | Automated call launching |
| WO2001048633A1 (en) * | 1999-12-24 | 2001-07-05 | Telstra New Wave Pty Ltd | A virtual token |
| US7407175B2 (en) * | 2000-03-01 | 2008-08-05 | Deka Products Limited Partnership | Multiple-passenger transporter |
| WO2001076242A2 (en) | 2000-03-31 | 2001-10-11 | Intellocity Usa, Inc. | System and method for local meta data insertion |
| US7064772B1 (en) * | 2000-06-01 | 2006-06-20 | Aerocast.Com, Inc. | Resizable graphical user interface |
| US7325029B1 (en) * | 2000-08-08 | 2008-01-29 | Chang Ifay F | Methods for enabling e-commerce voice communication |
| JP3555865B2 (en) * | 2000-08-30 | 2004-08-18 | 日本電気株式会社 | ATM name system |
| US8332553B2 (en) * | 2000-09-21 | 2012-12-11 | Hewlett-Packard Development Company, L.P. | Method and apparatus for accessing a contacts database and telephone services |
| US6980204B1 (en) * | 2000-09-21 | 2005-12-27 | Jeffrey Charles Hawkins | Charging and communication cable system for a mobile computer apparatus |
| GB2370188A (en) * | 2000-11-01 | 2002-06-19 | Orange Personal Comm Serv Ltd | Mixed-media telecommunication call set-up |
| US7242674B2 (en) * | 2000-12-20 | 2007-07-10 | Lg Electronics Inc. | System and method of controlling multimedia call in mobile communication system |
| CA2333342A1 (en) * | 2001-01-31 | 2002-07-31 | Curomax Corporation | Automotive finance portal |
| US20020156909A1 (en) * | 2001-02-15 | 2002-10-24 | Harrington Jeffrey M. | System and method for server side control of a flash presentation |
| US20020112002A1 (en) * | 2001-02-15 | 2002-08-15 | Abato Michael R. | System and process for creating a virtual stage and presenting enhanced content via the virtual stage |
| WO2002075716A1 (en) * | 2001-03-16 | 2002-09-26 | Novatel Wireless, Inc. | System and methods for a dialer function |
| US20020152101A1 (en) * | 2001-04-12 | 2002-10-17 | Lawson Robert J. | Travel expense management module for an intranet portal |
| US20020152117A1 (en) * | 2001-04-12 | 2002-10-17 | Mike Cristofalo | System and method for targeting object oriented audio and video content to users |
| US7692667B2 (en) * | 2001-08-17 | 2010-04-06 | Palm, Inc. | Handheld computer having moveable segments that are interactive with an integrated display |
| US20030034987A1 (en) * | 2001-08-17 | 2003-02-20 | William Webb | Handheld computer having moveable segments that can be adjusted to affect a size of the handheld computer |
| US7062533B2 (en) * | 2001-09-20 | 2006-06-13 | International Business Machines Corporation | Specifying monitored user participation in messaging sessions |
| US7107316B2 (en) * | 2001-09-20 | 2006-09-12 | International Business Machines Corporation | Controlling throughput of message requests in a messaging system |
| US6938213B2 (en) * | 2001-09-20 | 2005-08-30 | International Business Machines Corporation | Tracking user availability for participation in messaging sessions |
| US7376846B2 (en) * | 2001-10-14 | 2008-05-20 | Palm, Inc. | Charging and communication cable system for a mobile computer apparatus |
| US7231208B2 (en) * | 2001-10-17 | 2007-06-12 | Palm, Inc. | User interface-technique for managing an active call |
| US7068299B2 (en) * | 2001-10-26 | 2006-06-27 | Tandberg Telecom As | System and method for graphically configuring a video call |
| US20030145338A1 (en) * | 2002-01-31 | 2003-07-31 | Actv, Inc. | System and process for incorporating, retrieving and displaying an enhanced flash movie |
| US7474298B2 (en) | 2002-05-31 | 2009-01-06 | Palm, Inc. | Mobile device having an adjustable length to selectively expose a surface component |
| US6954524B2 (en) * | 2002-06-07 | 2005-10-11 | Sbc Properties, L.P. | System and method for implementing and accessing call forwarding services |
| US20040051745A1 (en) * | 2002-09-18 | 2004-03-18 | Ullas Gargi | System and method for reviewing a virtual 3-D environment |
| US7379393B2 (en) * | 2002-10-07 | 2008-05-27 | Michael Morykwas | Timer device for use in an audio/visual presentation |
| JP2004139365A (en) * | 2002-10-18 | 2004-05-13 | Hitachi Ltd | Presentation system |
| JP4321203B2 (en) * | 2002-10-29 | 2009-08-26 | 富士ゼロックス株式会社 | Remote conference system, remote conference support method, and computer program |
| US7930716B2 (en) * | 2002-12-31 | 2011-04-19 | Actv Inc. | Techniques for reinsertion of local market advertising in digital video from a bypass source |
| US7295852B1 (en) | 2003-05-01 | 2007-11-13 | Palm, Inc. | Automated telephone conferencing method and system |
| US7865180B2 (en) * | 2003-06-23 | 2011-01-04 | Palm, Inc. | Automated telephone conferencing method and system |
| WO2005010731A2 (en) * | 2003-07-31 | 2005-02-03 | Dealertrack, Inc. | Integrated electronic credit application, contracting and securitization system and method |
| US8489442B1 (en) | 2004-02-02 | 2013-07-16 | Avaya Inc. | Interface for meeting facilitation and coordination, method and apparatus |
| CN100444588C (en) * | 2004-06-18 | 2008-12-17 | 腾讯科技（深圳）有限公司 | Method for realizing file discussion group in prompt communication and system thereof |
| US7797293B2 (en) * | 2004-06-24 | 2010-09-14 | Oracle America, Inc. | Adaptive contact list |
| US8640035B2 (en) * | 2004-06-24 | 2014-01-28 | Oracle America, Inc. | Identity based user interface |
| US9762623B1 (en) * | 2005-12-22 | 2017-09-12 | Apple Inc. | Automatic call initiation in response to selecting tags in electronic documents and applications |
| US7984378B1 (en) | 2006-02-07 | 2011-07-19 | Avaya Inc. | Management of meetings by grouping |
| DE102006009673A1 (en) * | 2006-03-02 | 2007-09-06 | Deere & Company, Moline | Housing of a telescopic handlebar |
| US8600794B2 (en) * | 2006-05-10 | 2013-12-03 | Avaya Inc. | Meeting notification and merging agents |
| US7778858B1 (en) | 2006-07-17 | 2010-08-17 | Avaya Inc. | Linking unable to respond messages to entries in electronic calendar |
| US20080055263A1 (en) * | 2006-09-06 | 2008-03-06 | Lemay Stephen O | Incoming Telephone Call Management for a Portable Multifunction Device |
| US8014760B2 (en) | 2006-09-06 | 2011-09-06 | Apple Inc. | Missed telephone call management for a portable multifunction device |
| US8687037B2 (en) | 2006-09-12 | 2014-04-01 | Savant Systems, Llc | Telephony services for programmable multimedia controller |
| US8090087B2 (en) * | 2006-10-26 | 2012-01-03 | Apple Inc. | Method, system, and graphical user interface for making conference calls |
| US7693736B1 (en) | 2006-10-30 | 2010-04-06 | Avaya Inc. | Recurring meeting schedule wizard |
| US10445703B1 (en) | 2006-10-30 | 2019-10-15 | Avaya Inc. | Early enough reminders |
| US8037143B1 (en) * | 2006-10-30 | 2011-10-11 | Avaya Inc. | Automatic display of email distribution lists |
| JP4288622B2 (en) | 2006-12-27 | 2009-07-01 | 富士フイルム株式会社 | Icon registration method, identification information addition method, and digital still camera |
| US7827240B1 (en) | 2007-01-02 | 2010-11-02 | Avaya Inc. | Calendar item hierarchy for automatic specialization |
| US7975242B2 (en) * | 2007-01-07 | 2011-07-05 | Apple Inc. | Portable multifunction device, method, and graphical user interface for conference calling |
| US8060565B1 (en) | 2007-01-31 | 2011-11-15 | Avaya Inc. | Voice and text session converter |
| US8126519B2 (en) * | 2007-08-31 | 2012-02-28 | Hewlett-Packard Development Company, L.P. | Housing for mobile computing device having construction to slide and pivot into multiple positions |
| US20090288007A1 (en) * | 2008-04-05 | 2009-11-19 | Social Communications Company | Spatial interfaces for realtime networked communications |
| US9009603B2 (en) | 2007-10-24 | 2015-04-14 | Social Communications Company | Web browser interface for spatial communication environments |
| US8930472B2 (en) | 2007-10-24 | 2015-01-06 | Social Communications Company | Promoting communicant interactions in a network communications environment |
| US8397168B2 (en) | 2008-04-05 | 2013-03-12 | Social Communications Company | Interfacing with a spatial virtual communication environment |
| US7769806B2 (en) | 2007-10-24 | 2010-08-03 | Social Communications Company | Automated real-time data stream switching in a shared virtual area communication environment |
| US8407605B2 (en) | 2009-04-03 | 2013-03-26 | Social Communications Company | Application sharing |
| US9357025B2 (en) | 2007-10-24 | 2016-05-31 | Social Communications Company | Virtual area based telephony communications |
| US20110134204A1 (en) * | 2007-12-05 | 2011-06-09 | Florida Gulf Coast University | System and methods for facilitating collaboration of a group |
| US8150482B2 (en) | 2008-01-08 | 2012-04-03 | Hewlett-Packard Development Company, L.P. | Mobile computing device with moveable housing segments |
| US8233948B2 (en) * | 2007-12-11 | 2012-07-31 | Hewlett-Packard Development Company, L.P. | Slider assembly for a housing of a mobile computing device |
| US20090234721A1 (en) * | 2007-12-21 | 2009-09-17 | Bigelow David H | Persistent collaborative on-line meeting space |
| US8200298B2 (en) | 2008-01-08 | 2012-06-12 | Hewlett-Packard Development Company, L.P. | Keypad housing configuration for a mobile computing device |
| US20090192845A1 (en) * | 2008-01-30 | 2009-07-30 | Microsoft Corporation | Integrated real time collaboration experiences with online workspace |
| CN102084354A (en) | 2008-04-05 | 2011-06-01 | 社会传播公司 | Shared virtual area communication environment based apparatus and methods |
| EP2377089A2 (en) * | 2008-12-05 | 2011-10-19 | Social Communications Company | Managing interactions in a network communications environment |
| US9288242B2 (en) | 2009-01-15 | 2016-03-15 | Social Communications Company | Bridging physical and virtual spaces |
| US9319357B2 (en) | 2009-01-15 | 2016-04-19 | Social Communications Company | Context based virtual area creation |
| US9065874B2 (en) | 2009-01-15 | 2015-06-23 | Social Communications Company | Persistent network resource and virtual area associations for realtime collaboration |
| US9853922B2 (en) | 2012-02-24 | 2017-12-26 | Sococo, Inc. | Virtual area communications |
| JP5669418B2 (en) * | 2009-03-30 | 2015-02-12 | アバイア インク． | A system and method for managing incoming requests that require a communication session using a graphical connection display. |
| US20110268263A1 (en) * | 2010-04-30 | 2011-11-03 | American Teleconferencing Services Ltd. | Conferencing alerts |
| US9158444B2 (en) * | 2010-05-26 | 2015-10-13 | Avaya Inc. | User interface for managing communication sessions |
| DE102010017700A1 (en) | 2010-07-01 | 2012-01-05 | Mirjam Cordt | Virtual interactive live remote coaching- and training system i.e. sports remote coaching- and training system, for coaching-and training e.g. yoga for student in fitness studio, has reproducing unit reproducing audio signal |
| US20120030595A1 (en) * | 2010-07-29 | 2012-02-02 | Seiko Epson Corporation | Information storage medium, terminal apparatus, and image generation method |
| WO2012034044A2 (en) | 2010-09-11 | 2012-03-15 | Social Communications Company | Relationship based presence indicating in virtual area contexts |
| WO2012135231A2 (en) | 2011-04-01 | 2012-10-04 | Social Communications Company | Creating virtual areas for realtime communications |
| US9503488B2 (en) * | 2011-09-14 | 2016-11-22 | Avaya Inc. | System and method for virtual call hold |
| US10523804B2 (en) * | 2011-09-16 | 2019-12-31 | Samsung Electronics Co., Ltd. | Method and system for searching for object in network |
| JP6139912B2 (en) * | 2013-02-27 | 2017-05-31 | 京セラ株式会社 | Portable electronic device, control method and control program |
| JP5418713B1 (en) * | 2013-06-07 | 2014-02-19 | 富士ゼロックス株式会社 | Image forming apparatus and program |
| WO2016154426A1 (en) * | 2015-03-26 | 2016-09-29 | Wal-Mart Stores, Inc. | System and methods for a multi-display collaboration environment |
| US10471348B2 (en) | 2015-07-24 | 2019-11-12 | Activision Publishing, Inc. | System and method for creating and sharing customized video game weapon configurations in multiplayer video games via one or more social networks |
| US10099140B2 (en) | 2015-10-08 | 2018-10-16 | Activision Publishing, Inc. | System and method for generating personalized messaging campaigns for video game players |
| US11185784B2 (en) | 2015-10-08 | 2021-11-30 | Activision Publishing, Inc. | System and method for generating personalized messaging campaigns for video game players |
| US11546552B1 (en) * | 2020-09-14 | 2023-01-03 | Aniruddha Gupta | System and method for real-life interactive experience between event participants in a virtual gathering |
| US11663750B2 (en) * | 2021-06-25 | 2023-05-30 | Hewlett-Packard Development Company, L.P. | Image data bars |
| US11656747B2 (en) * | 2021-09-21 | 2023-05-23 | Microsoft Technology Licensing, Llc | Established perspective user interface and user experience for video meetings |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5065309A (en) * | 1985-03-25 | 1991-11-12 | At&T Bell Laboratories | Personal computer note-taking facility |
| US4653090A (en) * | 1985-12-16 | 1987-03-24 | American Telephone & Telegraph (At&T) | Graphics based call management |
| US4939507A (en) * | 1986-04-28 | 1990-07-03 | Xerox Corporation | Virtual and emulated objects for use in the user interface of a display screen of a display processor |
| US4899136A (en) * | 1986-04-28 | 1990-02-06 | Xerox Corporation | Data processor having a user interface display with metaphoric objects |
| US4763356A (en) * | 1986-12-11 | 1988-08-09 | AT&T Information Systems, Inc. American Telephone and Telegraph Company | Touch screen form entry system |
| US5107443A (en) * | 1988-09-07 | 1992-04-21 | Xerox Corporation | Private regions within a shared workspace |
| US4953159A (en) * | 1989-01-03 | 1990-08-28 | American Telephone And Telegraph Company | Audiographics conferencing arrangement |
| JP2791146B2 (en) * | 1989-11-15 | 1998-08-27 | 株式会社日立製作所 | Data processing device |
| US5195086A (en) * | 1990-04-12 | 1993-03-16 | At&T Bell Laboratories | Multiple call control method in a multimedia conferencing system |
| JP2865827B2 (en) * | 1990-08-13 | 1999-03-08 | 株式会社日立製作所 | Data storage method in conference system |
| JPH04344789A (en) * | 1991-05-21 | 1992-12-01 | Fuji Xerox Co Ltd | Remote conference system |
| JP3200932B2 (en) * | 1992-03-24 | 2001-08-20 | 株式会社日立製作所 | Electronic dialogue system |
| GB9215662D0 (en) * | 1992-07-23 | 1992-09-09 | Workspace Technologies Limited | Conference assisting apparatus |
| US5309509A (en) * | 1992-07-27 | 1994-05-03 | At&T Bell Laboratories | Graphical user interface workstation |
| US5689553A (en) * | 1993-04-22 | 1997-11-18 | At&T Corp. | Multimedia telecommunications network and service |
| US5491743A (en) * | 1994-05-24 | 1996-02-13 | International Business Machines Corporation | Virtual conference system and terminal apparatus therefor |
-
1994
- 1994-12-16 US US08/357,811 patent/US5627978A/en not_active Expired - Lifetime
-
1995
- 1995-10-18 CA CA002160822A patent/CA2160822C/en not_active Expired - Fee Related
- 1995-12-01 DE DE69525600T patent/DE69525600T2/en not_active Expired - Lifetime
- 1995-12-01 EP EP95308716A patent/EP0717345B1/en not_active Expired - Lifetime
- 1995-12-18 JP JP34753495A patent/JP3184443B2/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| EP0717345B1 (en) | 2002-02-27 |
| DE69525600T2 (en) | 2002-08-14 |
| EP0717345A1 (en) | 1996-06-19 |
| DE69525600D1 (en) | 2002-04-04 |
| US5627978A (en) | 1997-05-06 |
| JPH08251568A (en) | 1996-09-27 |
| JP3184443B2 (en) | 2001-07-09 |
| CA2160822A1 (en) | 1996-06-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2160822C (en) | Graphical user interface for multimedia call set-up and call handling | |
| CA2122179C (en) | Video view selection by a chairperson | |
| US4953159A (en) | Audiographics conferencing arrangement | |
| US7215752B2 (en) | Intelligent switching system for voice and data | |
| US5689553A (en) | Multimedia telecommunications network and service | |
| EP0721266A2 (en) | Collaborative computer system | |
| Addeo et al. | An experimental multi-media bridging system | |
| EP0717544A2 (en) | Graphical user interface for multimedia conferencing system | |
| US20030025786A1 (en) | Method and system for saving and applying a video address from a video conference | |
| WO1999055099A1 (en) | Integrated telecommunication collaboration system | |
| CA2221702A1 (en) | Multimedia document conferencing system | |
| EP0717546A2 (en) | A multimedia user interface for accessing a network-based multipoint meeting | |
| CA2303053A1 (en) | Information retrieval system | |
| Hoshi et al. | B-ISDN multimedia communication and collaboration platform using advanced video workstations to support cooperative work | |
| KR100203279B1 (en) | The multi-point control unit of video conference that has terminal information | |
| Clark | Audiovisual conferencing using the ISDN | |
| Ensor et al. | User interfaces for multimedia multiparty communications | |
| Simon et al. | ISDN multimedia desk top teleconferencing | |
| Hoshi et al. | B-ISDN Group Tele-Working System | |
| Hastings et al. | ISDN Centrex applications in a large multinational company |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |