CA2172535C - Virtual reality network - Google Patents

Virtual reality network Download PDF

Info

Publication number
CA2172535C
CA2172535C CA002172535A CA2172535A CA2172535C CA 2172535 C CA2172535 C CA 2172535C CA 002172535 A CA002172535 A CA 002172535A CA 2172535 A CA2172535 A CA 2172535A CA 2172535 C CA2172535 C CA 2172535C
Authority
CA
Canada
Prior art keywords
virtual
sound
user
space
users
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CA002172535A
Other languages
French (fr)
Other versions
CA2172535A1 (en
Inventor
James Durward
Jonathan Levine
Michael Nemeth
Jerry Prettegiani
Ian T. Tweedie
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Virtual Universe Corp
Original Assignee
Virtual Universe Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Virtual Universe Corp filed Critical Virtual Universe Corp
Publication of CA2172535A1 publication Critical patent/CA2172535A1/en
Application granted granted Critical
Publication of CA2172535C publication Critical patent/CA2172535C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/24Traffic characterised by specific attributes, e.g. priority or QoS
    • A63F13/12
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/358Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/24Traffic characterised by specific attributes, e.g. priority or QoS
    • H04L47/2425Traffic characterised by specific attributes, e.g. priority or QoS for supporting services specification, e.g. SLA
    • H04L47/2433Allocation of priorities to traffic types
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M11/00Telephonic communication systems specially adapted for combination with other electrical systems
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/53Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
    • A63F2300/534Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for network load management, e.g. bandwidth optimization, latency reduction
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082Virtual reality
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99944Object-oriented database structure
    • Y10S707/99945Object-oriented database structure processing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99948Application of database or data structure, e.g. distributed, multimedia, or image
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S715/00Data processing: presentation processing of document, operator interface processing, and screen saver display processing
    • Y10S715/978Audio interaction as part of an operator interface

Abstract

A virtual reality system has a database for defining one or more three-dimensional virtual spaces. A communication unit establishes a communication between the database and a user, and a data communication unit communicates data from the database to the user so that the user's computer may display a portion of a selected virtual space on the user's head mounted display. The communications unit also receives data corresponding to the position, orientation, and/or movement of the user relative to a reference point and uses the data to define a virtual being within the virtual space, wherein the position, orientation, and/or movements of the virtual being are correlated to the received data. Preferably, the data communicated to the user typically corresponds to the portion of the virtual space viewed from the perspective of the virtual being. The system defines other virtual beings within the database in response to position, orientation, and/or movement data received from other users, and the portions of the virtual space communicated to the other users may correspond to the perspectives of their associated virtual beings. The system periodically updates the database and communicates the updated portions of the database to the users to reflect changes in perspective of the virtual beings and changes in the position of moving objects within the virtual space. The system also supports audio communication with the users. To reduce the amount of data communicated between the computer and each user, visual and sound priority spaces may be defined within the portion of the virtual space data communicated to the user, and elements within selected priority spaces may be updated in priority over other priority spaces.

Description

~ 95I0~793 PC~'ICA94/00529 1 Z~~ ~2~~
'7IRTUAL REALITY NETWGRK
EACKGR~UN1~ ~F TFiE INVENTI~N
This invention relates to virtual reality systems and, more particularly, to a virtual reality network wherein multiple users at remote locations may telephone a central communications center and participate in a virtual reality experience.
~lirtual reality systems are computer controlled systems which simulate artificial worlds and which allow users t0 experience and interact with the artificial worlds as if the users actually existed within them. Examples of virtual reality systems and components are disclosed in U.S. Patent NOS. 4,542,291, 4,017,858; 4,945,305D 3,983,474 4,406,532~
5,003,300a 4,984,1'79~ 4,988,9816, and 4,75°7,'7148 all Of which are incorporated herein by reference. The typical virtual reality system includes a computer, a head-mounted display for displaying an artificial world to the user, and instrumentation for sensing the position and orientation of the user with respect to the computer or some other reference point. The artificial world is defined within the computer's database. Instrumentation data is communicated to the computer, and the computer creates a virtual being within the artificial world which emulates the position, orientation, and movements of tree user. Tile computer then communicates graphical data to the head-mounted display which then displays the artificial world from the perspective of the virtual being. ~y gesturing in an appropriate manner, the user may interact with virtual objects within the artificial world as if they were real. For example, the user may drive an artificial automobile, throw an artificial ball, etc..
Although virtual reality has proven to be an exciting new technology, it is also a very expensive one. Most virtual reality hardware is located at universities and government agencies, although some virtual reality arcades have been built in major shopping centers located in large cities for playing a few basic games. Still, access to sophisticated '~'~ 951~~7~~ L~~~'/~~9~/~~~~9 ~~s virtual reality systems has been extremely limited and is often not available to the general public wa.tl~o~at great inconvenienceo 5 Y ~F° TFiE I~T~IEI~T~°I~~
The present invention is directed to a virtual reality system wherein multiple users located at diffe~°e~at remote physical locations may communicate with the system via conventional dialup telephone l~.~es and may perform 1~ independent and/or interactive/collaborative tasks within the systemo aided by inter-user audio communicationso In one embodiment of the present inve~ationv the virtual reality system has a central database for defining one or more three-dimensional virtual spaceso A communication unit establishes a communication between the database and a usere and a data communication unit communicates data f~°om the database to the user so that the user°s computer may display a portion of a selected vi~°t~aal space o~ the aase~° ° s head mounted display o The co~ecmu~aicatgo~s unit also receives data 2~ corresponding to the position~ orientations and/or movement of the user relative to a reference point and uses the date. to define a virtual being within the virtual space wherein t~ve position~ orientations and/or movements of the virtual being are correlated to the received datum Preferably the data communicated to the user typically corresponds to the portion of the virtual space viewed from tfiie perspective of the virtual beingo The system defines other virtual beings with~.~ the database in response to position orientation and~o~° movement 3~ data received from other userso and the port.iox~s of ~.he virtual space commu~aicated to the other use~°s may co~°respond to the perspectives of their associated vir~:ual beingso The system periodically updates the database and communicates the updated portions of the virtual space to the use~°s to ~°eflect changes in the position of moving objects within the virtual spaceo To further reduce the amournt of data co unicate~l betweer~ the computer and each usero priority spaces may be defined within the portion of the virtual space data 2~~2535 communicated to the user, and elements within selected priority spaces may be updated in priority over other priority spaces.
The system also supports audio communication with the users. Sounds may be defined within the virtual space, and data correlated to the sounds may be communicated to the users. Additionally, the communications unit may receive sounds from each user and then communicate the sounds to the other users to facilitate verbal or other audio communication among the users. The sounds may be assigned origins within the virtual space, and a sound control unit may then send data to each user for simulating the origin of the sound within the virtual space. The sounds may be assigned to sound priority spaces so that the amplitudes of sounds assigned to a particular priority space may be varied relative to the amplitudeslof sounds in other priority spaces.
Accordingly, the present invention provides an apparatus for allowing a plurality of users to interact in a virtual space, the apparatus comprising:
a database configured to define a virtual space;
virtual sound means for defining a virtual sound within said virtual space, comprising:
origin assigning means for assigning a sound origin to said virtual sound within said virtual space;
communication means for establishing a communication between said database and each of said plurality of users;
data communicating means for communicating data from said database to each of said plurality of users, wherein said communicated data comprises data regarding said virtual space; virtual sound communicating means, associated with c.,:1.

2~~25~5 3a said data communicating means, for communicating, to each of said plurality of users, data correlated to said virtual sound wherein said virtual sound communicating means communicates the data correlated to said virtual sound to a given user only if the sound origin is located within a sound relevant space of the given user, said sound relevant space including a plurality of sound priority spaces comprising:
amplitude varying means for communicating, to the given user, data for varying the amplitude of sounds within said sound relevant space depending upon which sound priority space said sounds have their origins.
The present invention provides a method of allowing a plurality of users to interact with a virtual space, the method comprising:
providing a computer system having a database defining said virtual space;
providing each of said plurality of users a bidirectional communication channel with said computer system;
providing each of said plurality of users a sound display device;
providing each of said plurality of users a position sensing device that generates position information representing that user's position in said virtual space;
communicating each user's position information to said computer system;
providing each of said plurality of users a device that generates sound information representing sounds initiated by that user;
communicating each user's sound information to said computer system;
for each of said plurality of users, defining a virtual being within said virtual space, said virtual being .J

2~~25~~
3b having a position within said virtual space correlated to that user's position information; and operating said computer system to perform the steps of:
for each of said plurality of users, defining a sound relevant space that depends on position information from that user; and for each. of said plurality of users, combining sound information from only those other users whose virtual beings are in that user's sound relevant space, and communicating the combined sound information to that user.
The present invention provides an apparatus for allowing at least first and second users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;
means for establishing a communication between said database and each of said first and second users;
means for receiving position data corresponding to positions of each of said first and second users;
means for updating said database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of said first and second users within said virtual space, said virtual beings having respective position within said virtual space correlated to said position data received from the corresponding Said first and second users;
first sound receiving means for receiving data corresponding to a first sound from said first user;
first sound origin assigning means for assigning a first sound origin to said data corresponding to said first sound within the virtual space;

3c second sound receiving means for receiving data corresponding to a second sound from said second user;
second sound origin assigning means for assigning a second sound origin to the data corresponding to said second sound within said virtual space;
first sound relevant space defining means for defining a first sound relevant space in said virtual space corresponding to said first virtual being;
second sound relevant space defining means for defining a second sound relevant space in said virtual space corresponding to the said second virtual being;
first sound communicating means for communicating, to said first user, data correlated to sounds having their origin only within the first sound relevant space; and second sound communicating means for communicating, to said second user, data correlated to sounds having their origin only within the second sound relevant space.
The present invention provides an apparatus for allowing a plurality of users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;
communication means for establishing a communication between the database and each of the plurality of users;
data communicating means for communicating data from the database to each of the users, wherein the communicated data comprises data regarding the virtual space;
means for receiving position data corresponding to positions of each of the users;
means for updating the database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of the users within the virtual space, the virtual beings ~, z ~~?~~3~
3d having respective positions within the virtual space correlated to the position data received from the corresponding users;
means, responsive to the position data, for defining visual relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective visual relevant spaces that are less than the entire virtual space with at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space; and means, associated with the data communicating means and responsive to changed position data from the users, for communicating updated position information regarding each given user's virtual being to other users, but only to those other users having visual relevant spaces within which the given user's virtual being is located.
The present invention provides an apparatus for allowing a plurality of users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;
communication means for establishing a communication between the database and each of the plurality of users;
data communicating means for communicating data from the database to each of the users, wherein the communicated data comprises data regarding the virtual space;
means for receiving position data corresponding to positions of each of the users;
means for updating the database in response to received positior~ data that differs from earlier-received position data;
means for defining virtual beings corresponding to each 21~~535 3e of the users within the virtual space, the virtual beings having respective positions within the virtual space correlated to the position data received from the corresponding users;
means, responsive to the position data, for defining visual relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective visual relevant spaces that are less than the entire virtual space with at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space;
means, associated with at least a particular user's visual relevant space, for defining a plurality of visual priority spaces within the particular user's visual relevant space;
means, associated with the data communicating means and responsive to changed position data from the users, for 2G communicating updated position information regarding each given user's virtual being to other users, but only to those other users having visual relevant spaces within which th.e given user's virtual being is located; and means, associated with the means for communicating updated position information, for communicating updated data corresponding to virtual beings in a given one of the visual priority spaces in priority over updated data corresponding to virtual beings within other visual priority spaces within the particular user's visual relevant space.
The present invention provides an apparatus for allowing a plurality of at least first and second users to interact with a virtual space, the apparatus ~17~5~5 3f comprising:
a database defining a three-dimensional virtual space;
means for establishing a communication between the database and each of the plurality of users;
means for receiving position data corresponding to positions of each of the users;
means for updating the database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of the users within the virtual space, the virtual beings having respective positions within the virtual space correlated to the position data received from the corresponding users;
means, responsive to the position data, for defining visual relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective visual relevant spaces that are less than the entire virtual space with at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space;
means, associated with the data communicating means and responsive to changed position data from the users, for communicating updated position information regarding each given user's virtual being to other users, but only to those other users having visual relevant spaces within which the given user's virtual being is located;
first sound receiving means for receiving data corresponding to a first sound from the first user;
first sound origin assigning means for assigning a first sound origin to the data corresponding to the first sound :r':

~ ~~535 3g within the virtual space;
second sound receiving means for receiving data corresponding to a second sound from the second user;
second sound origin assigning means for assigning a second sound origin to the data corresponding to the second sound within the virtual space;
first sound relevant space defining means for defining a first sound relevant space in the virtual space corresponding to the first virtual being wherein the first sound relevant space includes a plurality of first sound priority spaces;
second sound relevant space defining means for defining a second sound relevant space in the virtual space corresponding to the second virtual being;
first sound communicating means for communicating, to the first user, data correlated to sounds having their origin only within the first sound relevant space wherein the first sound communicating means includes first amplitude varying means for communicating, to the first user, data for varying the amplitude of sounds within the first sound relevant space depending upon the sound priority space in which the sounds have their origin; and second sound communicating means for communicating, to the second user, data correlated to sounds having their origin only within the second sound relevant space.
The present invention provides a method of allowing a plurality of users to interact with a three-dimensional virtual space, the method comprising:
providing a computer system having a database defining the virtual space;
providing each user a bidirectional communication channel with the computer system;
providing each user a visual display device;

3h providing each user a position sensing device that generates position information representing that user's position;
communicating each user's position information to the computer system;
for each user, defining a virtual being within the virtual space, the virtual being having a position within the virtual space correlated to that user's position information;
operating the computer system to perform the steps of:
for each user, defining a visual relevant space that depends on position information from that user, at least one user's relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space;
for at least a particular user, defining a set of visual priority spaces within the particular user's visual relevant space; and in response to changes in position information from a given user, communicating updated position information regarding the given user's virtual being to each other user only if the given user's virtual being is located within that other user's visual relevant space, wherein said updated position information regarding the given user's virtual being is communicated to the particular user at different time intervals depending on the visible priority space in which the given user's virtual being is located.
The present invention provides a method of allowing a plurality of users to interact with a three-dimensional virtual space, the method comprising:
providing a computer system having a database defining 3i the virtual space;
providing each user a bidirectional communication channel with the computer system;
providing each user a visual display and a sound display device;
for each user, generating position information representing that user's position and communicating that user's position information to the computer system;
for each user, generating sound information representing sounds initiated by that user and communicating that user's sound information to the computer for each user, defining a virtual being within the virtual space, the virtual being having a position within the virtual space correlated to that user's position information;
operating the computer system to perform the steps of:
for each user, defining a visual relevant space that depends on position information from that user, at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as exclude an angular range of the virtual space;
for each user, communicating to that user updated position information regarding other users' virtual beings only for those other users whose virtual beings are located within that user's visual relevant space;
for each user, defining a sound relevant space that depends on position information from that user;
for at least a particular user, defining a set of sound priority spaces within the particular user's sound relevant space;
for each user, combining sound information from only those other users whose virtual beings are in that user's sound relevant space, and communicating the combined 3j sound information to that user; and for at 7_east the particular user, determining relative amplitudes of sounds from the other users in said combining step depending on the sound priority space in which each other user's virtual being is located.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a diagram of a particular embodiment of a virtual reality network according to the present invention;
Fig. 2 is a block diagram of a particular embodiment of the central control unit shown in Fig. 1;
Fig. 3 is a block diagram illustrating how the database shown in Fig. 2 is partitioned into multiple virtual spaces;
Fig. 4 is a diagram illustrating a particular embodiment of a virtual space according to the present invention;
Fig. 5 is a diagram illustrating the concepts of visual relevant spaces and priority spaces within the virtual space;
Fig. 6 is a diagram illustrating the concepts of sound relevant spaces and sound priority spaces within the virtual space; and Fig. 7 is a flowchart showing operation of the virtual reality network according to the present invention.
DET~-1ILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Fig. 1 is a diagram illustrating a particular embodiment of a virtual reality network 10 aocording to lh~.~.....
nia ~1~~5~~
3k the present invention. Network 10 includes a central unit 14 for ,u ~ 95108793 ~ ~ ~ ~CTICA94100529 communicating with a plurality of users, e.g., users 18 and 22, througr{ a public telephone system represented by dialup telephone lines 26 and 30 coupled to telephones 34 and 38, respectively. Although telephone lines 26 and 30 have bean shown as single lines, each may comprise multiple lines wherein one: or more lines may be used for virtual object or virtual space data arid other lines may be used for audio data.
Furthermore, the present invention is not limited to telephone communications. Any data transmission network may suffice.
For example, network 10 may comprise high speed digital communication lines, cable broadcasting communication lines, etc. 3'he number of users supported by network 10 is not limited to the two shown. Any number of users, even thousands, may be supported.
Typically, user 18 is equipped with a computer 42, a head-mounted display 46, earphones 50, a microphone 52, a head position sensor 53, arid an instrumented garment 54. User 22 is ordinarily equipped iri the same manner. Computer 42 may include a keyboard 43 for entering control information.
Computer 42 may also include a monitor 58 for displaying control information or the virtual space viewed by user 18, but it should be understood that the primary display of the virtual space to user 18 is preferably accomplished by head-mounted display 46. Alternatively, head-mounted display may be substitwted in some applications by a stand-alone display unit which realistically displays the virtual space to the user. Earphones 50 receive sounds associated with the displayed virtual space from central control unit 14 via computer 42, and microphone 52 communicates sounds from user 18 via computer 42 to central control unit 14 which, in turn, merges the sounds received into the virtual space. Head position sensor 53 senses the position and/or orientation of the user's head relative to computer 42 or some other reference point and communicates the positional data to computer 42 which, in turn, communicates the data to central control unit 14. Tnstrumented garment 54 is shown as a glove in this embodiment, but other instrumented garments such as shirts, pants, or full-body suits may be used as well.

~ 95/~~79~ ~ ~ ~ ~ ~ ~ I~~°II°le~A9~l~~~~9 datao are input teleph~ne interface 1.08 ~~~° r~~e~.~i~~ d~~a ~~~m the users P ~n ~utput teleph~ne ~.ntex°f~~e 1~2 f~~°
~~a~uni~~ting i~~ 95/0793 ~ ~ ~ ~ ~ ~ ~ PC~'ICA94100529 contain a C;a~D virtual space 160 which allows users to engage in computer aided design, a game virtual space 164 which allows users to play a game, a task virtual space 168 which.
allows users to manipulate virtual objects to perform a particular task, and other virtual spaces. Central control unit 14 allows the user to interactively communicate with the virtual space either alone or in collaboration with other users. Each virtual space includes identification information 170, 172, 174, etc. so that users may specify which virtual space they intend to interact with.
Fig. 4 is a diagram of a particular embodiment of a virtual space 1.69. Virtual space 169 may include a plurality of virtual beings such as virtual beings 182, 183, and 184, sound origins 186, 188, 190, and 192, a movable virtual object 194, Ot~'1'l~r Virtual ObJeCts 196, 1.97 and 198, and graphics pr1m1t1.V2s 199A~F. GraphlCS pr1m1t1VE..'S 199.A~F may b~ used by any user to create further virtual objects if desired. To provide maximum flexibility and to facilitate communication with the users, each virtual being, and hence each user, is assigned a visual relevant space which determines which data defining the virtual space may be perceived by the user. In the context of the preferred embodiment, visual relevant spaces determine which state changes are communicated to (or perceivable by) the users. Of course, in other embodiments the visual relevant space may include all the graphical information encompassed by the boundaries of the visual relevant space. Fig. 5 is a diagram showing how the concepts of visual relevant spaces are applied to virtual beings 182 and 184 of Fig. 4. Virtual being 182 is assigned a visual relevant space 200, and virtual being 184 is assigned a visual relevant space 204. Virtual beings 182 and 184 may view only those elements (objects or states changes) which are disposed within their visual relevant spaces. For example, elements 194 and 196 and/or their motion may be visible to both virtual beings 182 and 384; element 197 and/or its motion may be visible only to virtual being 184; element 183 and/or its motion: may be visible only to virtual being 182, and element 198 and/or its motion may be visible to neither virtual, W~ 95/0793 . ~ ~ 3 5 ~C1'/CA94/00529 Relevant spaces also may be defined for sound data. Fig.
6 is a diagram illustrating the concept of sound relevant spaces. Virtual being 182 has a sound relevant space 230 associated with it, and virtwal being 184 has a sound relevant space 234 (indicated by a dashed line) associated with it.
Only sound sources disposed within a virtual beinges sound relevant space (and/or changes in the sounds) may be perceived by that being, and hence the corresponding user. In this case, sound sources 186, 188, 1.90, and 192 and/or their 1~ changes may be perceived by both virtual beings 182 and 184.
It should be noted that sound sources associated with an element which cannot be visually perceived by a virtual being may nevertheless be heard by the virtual being. Such may be the case with element 183 associated with sound source 192.
If so, while only virtual being 182 may see the element, both virtual beings 182 and 184 may hear it. It should also be noted that sound relevant spaces, like visual relevant spaces, need not be contiguous and need not have a direct spatial relationship to the virtual space.
2~

2~~~5~5 priority space to another may be continuous or discrete as desiredo Input telephone interface unit 2.0~ (F'igo 2~ receives input data from the users through the telephone net~rork and communicates control data and positional data such as that from the users head position sensors and instrumented garments (eogmg positiono orientation and/or m~vement~ t~
position/control data receiver 116 through a communication path 3.560 Sound data received from the users (eogo3 from 1~ their microphones) is communicated to soug~d data receiver I~~
through a communication path 1.6~m~ Position/cor.trol data receiver 11.6 a1'1d sound data receiver 1.2 ~ cc unicate with processor 1~~ 'through communication paths 161 and ~.63~
respectivelye Processor 10~ maps the positiono orientation and/or movement data from each user to corresponding virtual beings within the requested virtual space in database ~.~40 Control data received from the users may be used t~ establish the telephonic communication with central control unit 14~ to specify a desired virtual space to specify the type of 2~ virtual being the user wishes to assumes and possibly ~.ow the positional data is to be mapped to the selected, virtual beings to create virtual objects (using graphics primitives 199A~~°)a to specify visual and sound relevant spaces and their corresponding priority spaces etco Sound data received from the users may be associated with the virtual beings defined for those users or assigned in some other manners ~'or exampleo sound data from one of the users may be assig~8ed to a virtual public address system for announcing the beginning of a race in which that user and other users competes 3~ Processor 1~0 updates database 1~4 with the received positions motions controls and sound datap determines which user is to receive which data according to the relevant and priority spaces defined for that users coatam~.nicates positi~na motion and control information to position/control data transmitter 1.24 through a communication path 162A and c~mmunicates sound data to sound data transmitter 12~ th~°ough a communication path 164~ Position/control data transmitte~°
1.2.4 and sound data transmitter 12~ cc unicate with output ~ 95/0793 ~ ~ PCT/CA94I00529 telephone interface 112 through respective communication paths 168 and 172 for sending the data to the users.
Perspective monitor 132 monitors the defined field of view of each virtual being to determine the visual state change data to be communicated to the users. As noted above, in the preferred embodiment, each user has a copy of the selected virtual space in his or her computer, and processor 100 periodically sends only the positional and sound data assigned to points within the user's relevant space or field of view to the user so that the user°s computer may update the images viewed and sounds heard with the new positional and sound data. To further reduce the amount of data communicated to the users, which updated data is sent t~ the user at a particular 'time m::y be determined by the priority space in which the object or sound is located. Thus, data for updating objects or sounds in one priority space may be communicated thirty timers per second, whereas data for updating objects or sounds in another priority space may be communicated once per second.
In another embodiment of the invention, processor 100 may communicate all graphical data associated with the relevant space or field of view of the virtual being to the corresponding user and then instruct update communication control unit 148 to send updated data as appropriate. For example, processor 100 may use the positional data from the user's head position sensor to determine the position of the head of the virtual being defined for that user and communicate the graphical data for that portion of the relevant space to the user. As the user moves about, processor 100 receives new positional ~~ta, and database update unit 140 uses that data to update the position (and hence the fa.eld of view) of the corresponding virtual being in database 104. Perspective monitor detects the occurrence of a selected event and then instructs update communication control unit 148 to communicate the graphical data for the updated field of view to the user. The event which triggers the communication of the updated data to the users may be the W~ 95/0~7~~ ~ ~ ~ TP~"~'1~~~~1~~5~~

passage of a selected time interval measured ~~ timer ~.36a Alternatively, perspective monitor 132 may inst~°~act update coanmunication control unit 14~ to send the updated data when the position of the user°s head changes by a selected amount, or it may rely upon the occurrence of some other va~°i~,nce in the data received from the usero ~lirtual object control unit 144 defines or maintains the virtual objects within database 1~4 and assigns the positioa~, orientation, and/or movement data received from the a~ser to 1~ the virtual objectse For example, data designating flexure and position of the user°s legs, arms, fingers, etce may be assigned to the virtual being°s legs, a~°ms, fingers, etco so that the virtual being may emulate the gestures of the user for running, kicking, catching virtual balls, painting, writing, etcom ~f coazrse, as noted above, the vigtual being defined or maintained by vi~°tual object control unit 144 need not be humanoid and it may be specified by the user using primitives 199A~F in any desired combinationo The position, orientation, and/or movement data received from a user may be 2~ assigned to one or more visible or invisible objects as the imagination allowso ~Iirtual object control snit 144 also may define or maintain program~generated and controlled virtual objects ~rithin the virtual spaceo For example, virtual object control unit 144 may define or maintain a virtual volley ball or a virtual satellite which moves in accordance with program~
defined constraints such as range of motion, speed, gravitational forces, etcoo Sound control unit 152 defines the origin and nature of sotands within the virtual space and assigns the sound data 3~ received from the users to themm The simplest example of the assignment of sounds is the assignment of a use~°°s voice to the voice of the correspondi~ag ~ai~°tual beinge The voice of the virtual being may track the user°s vosce exactly, ~~° else sound control unit 152 may vary the pitch or timb~°e of the voice accordingly< The user°s voice also could be changed to emulate the chosen virtual beinge For example, the user°s voice could be changed to emulate a frog or jet ai~°c~°aftD with the amplitude of the user°s voice being used to control the ~ 95I0~793 ~ PCT/CA94/00529 1. 3 amplitude of the virtual sound. Sound control unit 152 also may assign program-defined sounds to the virtual space. For example, sound control unit may generate the sound accompanying a program-generated aircraft randomly passing through the virtual space. Sound control unit also controls the characteristics (e.g., amplitude, update frequency, etc~) of the virtual sounds according to the sound priority spaces in which the sounds are located.
Finally, sound control unit 152 also may control the perceived spatial positioning of the sound within the virtual space. The user transmits to central control unit 14 monophonic speech which is processed by an mixer within sound control unit 152. The mixer combines all the sounds received by the various users and transmits the sounds located within a user's sound relevant space to that user. ~nplitude may be determined by the sound priority space in which the sound origin is located and/or based on how loud a user is talking (or some other dynamically alterable rule). The data communicated by sound data transmitter 128 may include data to direct the user's hardware to pan, in real time, the incoming monophonic signal across its stereo outputs, thus creating the illusion of stereo audio to enhance the sensation of immersion within the virtual space without increasing communications bandwidth requirements between the user and the system.
Operation of one embodiment of the system is illustrated in figure 7. The user initially logs on to central control unit 14 in a step 300 using a conventional modem and serial line concentrator coupled to a telephone line which functions as a data line. The user's computer transmits identification codes along the data line to begin the logon sequence. Once the data line connection has been established, the user's computer establishes a second connection with the system, using a second telephone line, to establish the audio connection in a step 304. This is done by transmitting a unique series of DTI~IF codes along the second telephone line to central con°trol unit Z4 to inform central control unit 14 which audio line is to be correlated to which data line. This is important, since the incoming lines to central control unit ~1~ 95I~~7~3 ~ ~ ~ ~f~'~'I~~~~I~~5~9 14 most likely originate from a telephone company rotary switchg and without the D'fM~° identifiers the system would not know which audio line corresponds to which data linem ~nce the second connection is established~ the user connection to the system is complete<
~nce the connection is established~ the user transmits data to central control unit 14 to select which virtual space the user desires to integact with in a step 3~8o This data also may include mapping information specifying virtual 1~ objects within the virtual space and how the positionp motionp and sound data is to be mapped within the selected virtual spaceo The data also may include relevant and p~°io~°ity space information as well as information which enables central control unit 14 to create virtual objects from graphical primitivesm central control unit 14 then establishes the users relevant spaces~ priority spaces and any specified virtual objects within the virtual space in a step 31~a ~t the same time central control unit 14 searches for other users in the same universeo If other users are foa~~adp central 2~ control unit 14 calculates the proximity of the other users (and their defined virtual objects) based on X~~ coordinate differentialso ~nce the coordinate differentials are calculatedD locations of the other users and their defined virtual objects within and without the relevant and priority spaces may be determined and used to ascertain which positiono motion and sound data is transmitted to which use~° in a step 31~o In this manner positions motion and sound data is not transmitted to users that would not be able to use that data at that point in timeo 3~ It is then ascertained in a step 31.8 whether the session is to be terminatedo If sop the user is logged off the system in a step 3~~a If not central control unit 1~ conti~a~nes to receive positions motion~ and sound data (together with any other commands] from the various users in a step 326a updates the virtual space in a step 33~a calculates coordinates and processes the data in the various relevant spaces in a step 33~o processes the data in the various priority spaces in a step 3388 communicates the updated state data to the various ~ 95/0793 °~ PC~'ICA94/00529 users in a step 342 (based on the relevant and priority spaces for each user), and continues in step 318.
While the above is a det~.iled description of a preferred embodiment of the present invention, various modifications may 5 be employed. Consequently, the scope of the invention should be ascertained by the follobaing claims.

Claims (26)

WHAT IS CLAIMED IS:
1. An apparatus for allowing a plurality of users to interact in a virtual space, the apparatus comprising:
a database configured to define a virtual space;
virtual sound means for defining a virtual sound within said virtual space, comprising:
origin assigning means for assigning a sound origin to said virtual sound within said virtual space;
communication means for establishing a communication between said database and each of said plurality of users;
data communicating means for communicating data from said database to each of said plurality of users, wherein said communicated data comprises data regarding said virtual space;
virtual sound communicating means, associated with said data communicating means, for communicating, to each of said plurality of users, data correlated to said virtual sound wherein said virtual sound communicating means communicates the data correlated to said virtual sound to a given user only if the sound origin is located within a sound relevant space of the given user, said sound relevant space including a plurality of sound priority spaces comprising:
amplitude varying means for communicating, to the given user, data for varying the amplitude of sounds within said sound relevant space depending upon which sound priority space said sounds have their origins.
2. The apparatus according to claim 1 wherein said means for defining a virtual sound includes:
means for assigning a sound origin to said virtual sound within said virtual space; and means, responsive to a position data, for defining sound relevant spaces in said virtual space corresponding to each of said plurality of users, at least some of said plurality of users having respective sound relevant spaces that are less than the entire virtual space, wherein said sound communicating means communicates the data correlated to said virtual sound to a given one of said plurality of users only if an origin of said virtual sound is located within the given user's sound relevant space.
3. A method of allowing a plurality of users to interact with a virtual space, the method comprising:
providing a computer system having a database defining said virtual space;
providing each of said plurality of users a bidirectional communication channel with said computer system;
providing each of said plurality of users a sound display device;
providing each of said plurality of users a position sensing device that generates position information representing that user's position in said virtual space;
communicating each user's position information to said computer system;
providing each of said plurality of users a device that generates sound information representing sounds initiated by that user;
communicating each user's sound information to said computer system;

for each of said plurality of users, defining a virtual being within said virtual space, said virtual being having a position within said virtual space correlated to that user's position information; and operating said computer system to perform the steps of for each of said plurality of users, defining a sound relevant space that depends on position information from that user; and for each of said plurality of users, combining sound information from only those other users whose virtual beings are in that user's sound relevant space, and communicating the combined sound information to that user.
4. The method of claim 3 wherein the sounds initiated by at least one of said plurality of users include voice.
5. The method of claim 3 comprising operating said computer system to perform the additional steps of:
for at least a particular user, defining a set of sound priority spaces within the particular user's sound relevant space; and determining relative amplitudes of sounds from the other users in said combining step depending on the sound priority space in which each other user's virtual being is located.
6. An apparatus for allowing at least first and second users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;

means for establishing a communication between said database and each of said first and second users;
means for receiving position data corresponding to positions of each of said first and second users;
means for updating said database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of said first and second users within said virtual space, said virtual beings having respective position within said virtual space correlated to said position data received from the corresponding said first and second users;
first sound receiving means for receiving data corresponding to a first sound from said first user;
first sound origin assigning means for assigning a first sound origin to said data corresponding to said first sound within the virtual space;
second sound receiving means for receiving data corresponding to a second sound from said second user;
second sound origin assigning means for assigning a second sound origin to the data corresponding to said second sound within said virtual space;
first sound relevant space defining means for defining a first sound relevant space in said virtual space corresponding to said first virtual being;
second sound relevant space defining means for defining a second sound relevant space in said virtual space corresponding to the said second virtual being;
first sound communicating means for communicating, to said first user, data correlated to sounds having their origin only within the first sound relevant space; and second sound communicating means for communicating, to said second user, data correlated to sounds having their origin only within the second sound relevant space.
7. The apparatus according to claim 6 wherein said first sound communicating means further comprises first sound position emulating means for communicating, to said first user, data for emulating the spatial origin of sounds within said first sound relevant space.
8. The apparatus according to claim 7 wherein said second sound communicating means further comprises second sound position emulating means for communicating, to said second user, data for emulating the spatial origin of sounds within said second sound relevant space.
9. The apparatus according to claim 6 wherein said first sound relevant space includes a plurality of first sound priority spaces, and wherein said first sound communicating means includes first amplitude varying means for communicating, to said first user, data for varying the amplitude of sounds within said first sound relevant space depending upon in which sound priority space said sounds have their origin.
10. The apparatus according to claim 9 wherein said second sound relevant space includes a plurality of second sound priority spaces, and wherein said second sound communicating means includes second amplitude varying means for communicating, to said second user, data for varying the amplitude of sounds within said second sound relevant space depending upon in which sound priority space the sounds have their origin.
11. An apparatus for allowing a plurality of users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;
communication means for establishing a communication between the database and each of the plurality of users;
data communicating means for communicating data from the database to each of the users, wherein the communicated data comprises data regarding the virtual space;
means for receiving position data corresponding to positions of each of the users;
means for updating the database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of the users within the virtual space, the virtual beings having respective positions within the virtual space correlated to the position data received from the corresponding users;
means, responsive to the position data, for defining visual relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective visual relevant spaces that are less than the entire virtual space with at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space; and means, associated with the data communicating means and responsive to changed position data from the users, for communicating updated position information regarding each given user's virtual being to other users, but only to those other users having visual relevant spaces within which the given user's virtual being is located.
12. An apparatus for allowing a plurality of users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;
communication means for establishing a communication between the database and each of the plurality of users;
data communicating means for communicating data from the database to each of the users, wherein the communicated data comprises data regarding the virtual space;
means for receiving position data corresponding to positions of each of the users;
means for updating the database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of the users within the virtual space, the virtual beings having respective positions within the virtual space correlated to the position data received from the corresponding users;
means, responsive to the position data, for defining visual relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective visual relevant spaces that are less than the entire virtual space with at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space;
means, associated with at least a particular user's visual relevant space, for defining a plurality of visual priority spaces within the particular user's visual relevant space;
means, associated with the data communicating means and responsive to changed position data from the users, for communicating updated position information regarding each given user's virtual being to other users, but only to those other users having visual relevant spaces within which the given user's virtual being is located; and means, associated with the means for communicating updated position information, for communicating updated data corresponding to virtual beings in a given one of the visual priority spaces in priority over updated data corresponding to virtual beings within other visual priority spaces within the particular user's visual relevant space.
13. The apparatus according to claim 12 further comprising:
means for defining a movable first virtual object within the virtual space; and means for allowing at least one virtual being to manipulate the first virtual object.
14. The apparatus according to claim 12 wherein:

the database defines a plurality of virtual spaces, the apparatus further comprises means for receiving identifying data from each user for identifying one of the plurality of virtual spaces, and the data communicated by the data communicating means to each user corresponds to the identified virtual space.
15. The apparatus according to claim 12 wherein each user's visual relevant space is defined by a portion of the virtual space viewed from the perspective of that user's virtual being.
16. The apparatus according to claim 12 further comprising:
means for defining a virtual sound within the virtual space; and virtual sound communicating means, associated with the data communicating means, for communicating, to each of the users, data correlated to the virtual sound.
17. The apparatus according to claim 16 wherein:
the means for defining a virtual sound includes means for assigning a sound origin to the virtual sound within the virtual space, means, responsive to the position data, for defining sound relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective sound relevant spaces that are less than the entire virtual space; and the sound communicating means communicates the data correlated to the virtual sound to a given user only if the sound origin is located within the given user's sound relevant space.
18. An apparatus for allowing a plurality of at least first and second users to interact with a virtual space, the apparatus comprising:
a database defining a three-dimensional virtual space;
means for establishing a communication between the database and each of the plurality of users;
means for receiving position data corresponding to positions of each of the users;
means for updating the database in response to received position data that differs from earlier-received position data;
means for defining virtual beings corresponding to each of the users within the virtual space, the virtual beings having respective positions within the virtual space correlated to the position data received from the corresponding users;
means, responsive to the position data, for defining visual relevant spaces in the virtual space corresponding to each of the users, at least some of the users having respective visual relevant spaces that are less than the entire virtual space with at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space;
means, associated with the data communicating means and responsive to changed position data from the users, for communicating updated position information regarding each given user's virtual being to other users, but only to those other users having visual relevant spaces within which the given user's virtual being is located;
first sound receiving means for receiving data corresponding to a first sound from the first user;
first sound origin assigning means for assigning a first sound origin to the data corresponding to the first sound within the virtual space;
second sound receiving means for receiving data corresponding to a second sound from the second user;
second sound origin assigning means for assigning a second sound origin to the data corresponding to the second sound within the virtual space;
first sound relevant space defining means for defining a first sound relevant space in the virtual space corresponding to the first virtual being wherein the first sound relevant space includes a plurality of first sound priority spaces;
second sound relevant space defining means for defining a second sound relevant space in the virtual space corresponding to the second virtual being;
first sound communicating means for communicating, to the first user, data correlated to sounds having their origin only within the first sound relevant space wherein the first sound communicating means includes first amplitude varying means for communicating, to the first user, data for varying the amplitude of sounds within the first sound relevant space depending upon the sound priority space in which the sounds have their origin; and second sound communicating means for communicating, to the second user, data correlated to sounds having their origin only within the second sound relevant space.
19. The apparatus according to claim 18 wherein the first sound communicating means further comprises first sound position emulating means for communicating, to the first user, data for emulating the spatial origin of sounds within the first sound relevant space.
20. The apparatus according to claim 19 wherein the second sound communicating means further comprises second sound position emulating means for communicating, to the second user, data for emulating the spatial origin of sounds within the second sound relevant space.
21. The apparatus according to claim 18 wherein the second sound relevant space includes a plurality of second sound priority spaces, and wherein the sound communicating means includes second amplitude varying means for communicating, to the second user, data for varying the amplitude of sounds within the second sound relevant space depending upon the sound priority space in which the sounds have their origin.
22. A method of allowing a plurality of users to interact with a three-dimensional virtual space, the method comprising:
providing a computer system having a database defining the virtual space;
providing each user a bidirectional communication channel with the computer system;
providing each user a visual display device;
providing each user a position sensing device that generates position information representing that user's position;
communicating each user's position information to the computer system;
for each user, defining a virtual being within the virtual space, the virtual being having a position within the virtual space correlated to that user's position information;
operating the computer system to perform the steps of:
for each user, defining a visual relevant space that depends on position information from that user, at least one user's relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as to exclude an angular range of the virtual space;
for at least a particular user, defining a set of visual priority spaces within the particular user's visual relevant space; and in response to changes in position information from a given user, communicating updated position information regarding the given user's virtual being to each other user only if the given user's virtual being is located within that other user's visual relevant space, wherein said updated position information regarding the given user's virtual being is communicated to the particular user at different time intervals depending on the visible priority space in which the given user's virtual being is located.
23. A method of allowing a plurality of users to interact with a three-dimensional virtual space, the method comprising:
providing a computer system having a database defining the virtual space;

providing each user a bidirectional communication channel with the computer system;
providing each user a visual display and a sound display device;
for each user, generating position information representing that user's position and communicating that user's position information to the computer system;
for each user, generating sound information representing sounds initiated by that user and communicating that user's sound information to the computer for each user, defining a virtual being within the virtual space, the virtual being having a position within the virtual space correlated to that user's position information;
operating the computer system to perform the steps of:
for each user, defining a visual relevant space that depends on position information from that user, at least one user's visual relevant space being defined by a portion of the virtual space viewed from the perspective of that user's virtual being so as exclude an angular range of the virtual space;
for each user, communicating to that user updated position information regarding other users' virtual beings only for those other users whose virtual beings are located within that user's visual relevant space;
for each user, defining a sound relevant space that depends on position information from that user;
for at least a particular user, defining a set of sound priority spaces within the particular user's sound relevant space;
for each user, combining sound information from only those other users whose virtual beings are in that user's sound relevant space, and communicating the combined sound information to that user; and for at least the particular user, determining relative amplitudes of sounds from the other users in said combining step depending on the sound priority space in which each other user's virtual being is located.
24. The method of claim 23, comprising operating the computer system to perform the additional steps of:
for at least a particular user, defining a set of visual priority spaces within the particular user's visual relevant space; and communicating the updated position information regarding the given users virtual being to the particular user at different time intervals depending on the visible priority space in which the given user's virtual being is located.
25. The method of claim 23 wherein the sounds initiated by at least one user include voice.
26. The method of claim 23 wherein said step of combining sound information for a given user includes weighing amplitudes of other users' virtual beings' sounds according to the positions of the other users' different virtual beings relative to the given user's virtual being.
CA002172535A 1993-09-23 1994-09-22 Virtual reality network Expired - Lifetime CA2172535C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/125,950 US5659691A (en) 1993-09-23 1993-09-23 Virtual reality network with selective distribution and updating of data to reduce bandwidth requirements
US08/125,950 1993-09-23
PCT/CA1994/000529 WO1995008793A1 (en) 1993-09-23 1994-09-22 Virtual reality network

Publications (2)

Publication Number Publication Date
CA2172535A1 CA2172535A1 (en) 1995-03-30
CA2172535C true CA2172535C (en) 2002-12-10

Family

ID=22422202

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002172535A Expired - Lifetime CA2172535C (en) 1993-09-23 1994-09-22 Virtual reality network

Country Status (8)

Country Link
US (2) US5659691A (en)
EP (1) EP0721614B1 (en)
JP (2) JP4152432B2 (en)
AU (1) AU687888B2 (en)
CA (1) CA2172535C (en)
DE (1) DE69433061T2 (en)
NZ (2) NZ330003A (en)
WO (1) WO1995008793A1 (en)

Families Citing this family (191)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5956501A (en) * 1997-01-10 1999-09-21 Health Hero Network, Inc. Disease simulation system and method
US8027809B2 (en) 1992-11-17 2011-09-27 Health Hero Network, Inc. Home power management system
US9215979B2 (en) 1992-11-17 2015-12-22 Robert Bosch Healthcare Systems, Inc. Multi-user remote health monitoring system
US7624028B1 (en) 1992-11-17 2009-11-24 Health Hero Network, Inc. Remote health monitoring and maintenance system
US20010011224A1 (en) 1995-06-07 2001-08-02 Stephen James Brown Modular microprocessor-based health monitoring system
AU1766201A (en) 1992-11-17 2001-05-30 Health Hero Network, Inc. Method and system for improving adherence with a diet program or other medical regimen
US8078431B2 (en) 1992-11-17 2011-12-13 Health Hero Network, Inc. Home power management system
US5951300A (en) 1997-03-10 1999-09-14 Health Hero Network Online system and method for providing composite entertainment and health information
US5832448A (en) 1996-10-16 1998-11-03 Health Hero Network Multiple patient monitoring system for proactive health management
US6968375B1 (en) 1997-03-28 2005-11-22 Health Hero Network, Inc. Networked system for interactive communication and remote monitoring of individuals
US8095340B2 (en) 1992-11-17 2012-01-10 Health Hero Network, Inc. Home power management system
US6330426B2 (en) 1994-05-23 2001-12-11 Stephen J. Brown System and method for remote education using a memory card
US8078407B1 (en) 1997-03-28 2011-12-13 Health Hero Network, Inc. System and method for identifying disease-influencing genes
US5307263A (en) 1992-11-17 1994-04-26 Raya Systems, Inc. Modular microprocessor-based health monitoring system
JP3182736B2 (en) * 1994-01-14 2001-07-03 日本電信電話株式会社 Virtual space display system
DE69534523D1 (en) * 1994-08-19 2006-03-02 Sony Corp Cyberspace system
JP3632705B2 (en) * 1994-08-31 2005-03-23 ソニー株式会社 Interactive image providing method, server device, providing method, user terminal, receiving method, image providing system, and image providing method
EP0736996A3 (en) * 1995-04-07 1996-11-27 At & T Corp Method of and apparatus for transmitting voice messages in a multiuser interactive virtual environment
US5784570A (en) * 1995-04-07 1998-07-21 At&T Corp Server for applying a recipient filter and compressing the input data stream based upon a set of at least one characteristics in a multiuser interactive virtual environment
AU6334396A (en) * 1995-06-15 1997-01-15 Apple Computer, Inc. Method and apparatus for providing independent audio in multiple listener digital sound systems
US6020885A (en) * 1995-07-11 2000-02-01 Sony Corporation Three-dimensional virtual reality space sharing method and system using local and global object identification codes
CA2180891C (en) * 1995-07-12 2010-01-12 Junichi Rekimoto Notification of updates in a three-dimensional virtual reality space sharing system
CA2180899A1 (en) 1995-07-12 1997-01-13 Yasuaki Honda Synchronous updating of sub objects in a three dimensional virtual reality space sharing system and method therefore
GB9519921D0 (en) * 1995-09-29 1995-11-29 Philips Electronics Nv Graphics image manipulation
US6430997B1 (en) 1995-11-06 2002-08-13 Trazer Technologies, Inc. System and method for tracking and assessing movement skills in multidimensional space
US6219045B1 (en) * 1995-11-13 2001-04-17 Worlds, Inc. Scalable virtual world chat client-server system
AU1328597A (en) 1995-11-30 1997-06-19 Virtual Technologies, Inc. Tactile feedback man-machine interface device
GB9525047D0 (en) * 1995-12-07 1996-02-07 Philips Electronics Nv Virtual body control device
US5821925A (en) * 1996-01-26 1998-10-13 Silicon Graphics, Inc. Collaborative work environment supporting three-dimensional objects and multiple remote participants
US6050898A (en) * 1996-05-15 2000-04-18 Vr-1, Inc. Initiating and scaling massive concurrent data transaction
US5841980A (en) * 1996-05-15 1998-11-24 Rtime, Inc. Distributed system for communication networks in multi-user applications
US5945992A (en) * 1996-05-29 1999-08-31 Hewlett Packard Company Multilevel, client-server, large model traverser
JPH1040197A (en) * 1996-07-19 1998-02-13 Fujitsu Ltd Communication managing device
US6240444B1 (en) 1996-09-27 2001-05-29 International Business Machines Corporation Internet web page sharing
US5926179A (en) * 1996-09-30 1999-07-20 Sony Corporation Three-dimensional virtual reality space display processing apparatus, a three-dimensional virtual reality space display processing method, and an information providing medium
US6154211A (en) * 1996-09-30 2000-11-28 Sony Corporation Three-dimensional, virtual reality space display processing apparatus, a three dimensional virtual reality space display processing method, and an information providing medium
US6437777B1 (en) 1996-09-30 2002-08-20 Sony Corporation Three-dimensional virtual reality space display processing apparatus, a three-dimensional virtual reality space display processing method, and an information providing medium
US20010055039A1 (en) 1996-09-30 2001-12-27 Koichi Matsuda Three-dimensional virtual reality space display processing apparatus, a three-dimensional virtual reality space display processing method, and an information providing medium
US6954906B1 (en) * 1996-09-30 2005-10-11 Sony Corporation Image display processing apparatus that automatically changes position of sub-window relative to main window depending on distance at watch sub window is commanded to be displayed
US6057856A (en) * 1996-09-30 2000-05-02 Sony Corporation 3D virtual reality multi-user interaction with superimposed positional information display for each user
US6025801A (en) * 1996-10-01 2000-02-15 Philips Electronics North America Corporation Video game with local updates mitigates latency effects in wide area network
NL1004195C1 (en) * 1996-10-04 1998-04-07 Christine Karman System for transmitting touch sensation via a computer network.
US20010044725A1 (en) * 1996-11-19 2001-11-22 Koichi Matsuda Information processing apparatus, an information processing method, and a medium for use in a three-dimensional virtual reality space sharing system
AU3805697A (en) * 1996-11-21 1998-06-10 William J. Benman Jr. Virtual networks
US5953506A (en) * 1996-12-17 1999-09-14 Adaptive Media Technologies Method and apparatus that provides a scalable media delivery system
US5812126A (en) * 1996-12-31 1998-09-22 Intel Corporation Method and apparatus for masquerading online
US6032119A (en) 1997-01-16 2000-02-29 Health Hero Network, Inc. Personalized display of health information
US6058397A (en) * 1997-04-08 2000-05-02 Mitsubishi Electric Information Technology Center America, Inc. 3D virtual environment creation management and delivery system
US6081266A (en) * 1997-04-21 2000-06-27 Sony Corporation Interactive control of audio outputs on a display screen
JP3799134B2 (en) 1997-05-28 2006-07-19 ソニー株式会社 System and notification method
US5970493A (en) * 1997-05-29 1999-10-19 Oracle Corporation Method, article of manufacture, and apparatus for generating a multi-dimensional record display
US6108657A (en) * 1997-05-29 2000-08-22 Oracle Corporation Method, article of manufacture, and apparatus for generating a multi-dimensional record layout mapping
US6073134A (en) * 1997-05-29 2000-06-06 Oracle Corporation Method article of manufacture, and apparatus for generating a multi-dimensional record management index
US6968379B2 (en) * 1997-05-30 2005-11-22 Sun Microsystems, Inc. Latency-reducing bandwidth-prioritization for network servers and clients
US6025839A (en) * 1997-06-06 2000-02-15 International Business Machines Corp. Method for displaying information in a virtual reality environment
IL121178A (en) * 1997-06-27 2003-11-23 Nds Ltd Interactive game system
KR100287138B1 (en) * 1997-07-15 2001-04-16 윤종용 Method for managing participants in multi-participating virtual space and system thereof
JPH11126017A (en) 1997-08-22 1999-05-11 Sony Corp Storage medium, robot, information processing device and electronic pet system
GB9722343D0 (en) * 1997-10-22 1997-12-17 British Telecomm Distributed virtual environment
FR2770719B1 (en) * 1997-10-30 2000-01-07 Sagem METHOD FOR COMMUNICATING AN IMAGE OF A COMPOSITION OF ELEMENTARY OBJECTS FROM A SERVER TERMINAL TO AT LEAST ONE USER TERMINAL
JPH11154178A (en) * 1997-11-19 1999-06-08 Fujitsu Ltd Communication managing device and recording medium
JPH11177628A (en) * 1997-12-15 1999-07-02 Mitsubishi Electric Corp Three-dimension virtual space common share system for broad area environment
US6169549B1 (en) 1998-01-07 2001-01-02 Iengineer.Com, Inc. Method and apparatus for providing continuous level of detail
US6160540A (en) * 1998-01-12 2000-12-12 Xerox Company Zoomorphic computer user interface
JPH11203009A (en) 1998-01-20 1999-07-30 Sony Corp Information processing device and method and distribution medium
JP3855430B2 (en) 1998-01-23 2006-12-13 ソニー株式会社 Information processing apparatus and method, information processing system, and recording medium
US6349301B1 (en) * 1998-02-24 2002-02-19 Microsoft Corporation Virtual environment bystander updating in client server architecture
US6088698A (en) * 1998-02-27 2000-07-11 Oracle Corporation Method and apparatus for incrementally generating a virtual three-dimensional world
US6348927B1 (en) * 1998-02-27 2002-02-19 Oracle Cor Composing a description of a virtual 3D world from values stored in a database and generated by decomposing another description of a virtual 3D world
US6611196B2 (en) 1998-03-20 2003-08-26 Xerox Corporation System and method for providing audio augmentation of a physical environment
JPH11272156A (en) * 1998-03-25 1999-10-08 Sega Enterp Ltd Virtual three-dimensional sound image generating device and method and medium thereof
US6118456A (en) * 1998-04-02 2000-09-12 Adaptive Media Technologies Method and apparatus capable of prioritizing and streaming objects within a 3-D virtual environment
US6765570B1 (en) * 1998-07-21 2004-07-20 Magic Earth, Inc. System and method for analyzing and imaging three-dimensional volume data sets using a three-dimensional sampling probe
US6697869B1 (en) 1998-08-24 2004-02-24 Koninklijke Philips Electronics N.V. Emulation of streaming over the internet in a broadcast application
CN1275091A (en) * 1998-08-24 2000-11-29 皇家菲利浦电子有限公司 Real time video game uses emulation of streaming over internet in broadcast event
NO984070D0 (en) * 1998-09-04 1998-09-04 Norsk Hydro As Method for visualization and analysis of volume data
US6215498B1 (en) 1998-09-10 2001-04-10 Lionhearth Technologies, Inc. Virtual command post
US8521546B2 (en) 1998-09-25 2013-08-27 Health Hero Network Dynamic modeling and scoring risk assessment
WO2000023915A1 (en) * 1998-10-16 2000-04-27 Commontown Pte Ltd A virtual space
JP2000194726A (en) * 1998-10-19 2000-07-14 Sony Corp Device, method and system for processing information and providing medium
JP4006873B2 (en) 1999-03-11 2007-11-14 ソニー株式会社 Information processing system, information processing method and apparatus, and information providing medium
US6416412B1 (en) * 1999-03-16 2002-07-09 Atari Games Corporation System for remotely activating a sound in a game unit
CN1345503A (en) * 1999-03-31 2002-04-17 英国电讯有限公司 Packet messaging method and apparatus
EP1069744A1 (en) * 1999-07-13 2001-01-17 BRITISH TELECOMMUNICATIONS public limited company Packet messaging method and apparatus
KR100347456B1 (en) * 1999-08-10 2002-08-03 학교법인 한국정보통신학원 Scalable prediction based concurrency control method for distributed virtual environments
US6463343B1 (en) * 1999-08-10 2002-10-08 International Business Machines Corporation System and method for controlling remote devices from a client computer using digital images
EP1087323A1 (en) * 1999-09-24 2001-03-28 Nokia Corporation A wireless system for interacting with a virtual space
JP2001118081A (en) 1999-10-15 2001-04-27 Sony Corp Device and method for processing information, and program storing medium
US6287200B1 (en) * 1999-12-15 2001-09-11 Nokia Corporation Relative positioning and virtual objects for mobile devices
WO2001044990A1 (en) * 1999-12-15 2001-06-21 Trellion Technologies, Inc. System and method for controlling data in a virtual being database
US6674995B1 (en) 1999-12-22 2004-01-06 Nokia Corporation Electronically augmented multiplayer sporting game with virtual ball passed by infrared apparatus
US6810422B1 (en) 2000-01-14 2004-10-26 Lockheed Martin Tactical Defense Systems System and method for probabilistic quality of communication service determination
US20010047517A1 (en) * 2000-02-10 2001-11-29 Charilaos Christopoulos Method and apparatus for intelligent transcoding of multimedia data
US8463839B2 (en) 2000-03-28 2013-06-11 Cybernet Systems Corporation Distributed computing environment
KR20010104493A (en) * 2000-05-02 2001-11-26 성필문 Stereoscopic providing Method and Apparatus Using Network
US7109970B1 (en) * 2000-07-01 2006-09-19 Miller Stephen S Apparatus for remotely controlling computers and other electronic appliances/devices using a combination of voice commands and finger movements
US6453160B1 (en) * 2000-07-31 2002-09-17 Motorola, Inc. Exploiting a broadcast system to enhance a wireless gaming experience using position holders to replace data
JP2002083320A (en) * 2000-09-07 2002-03-22 Sony Corp Virtual conversation aiding system, virtual conversation aid, and storage medium
US7006085B1 (en) * 2000-10-30 2006-02-28 Magic Earth, Inc. System and method for analyzing and imaging three-dimensional volume data sets
US7251788B2 (en) * 2000-12-21 2007-07-31 Nokia Corporation Simulated speed-of-light delay for recreational benefit applications
US6690820B2 (en) * 2001-01-31 2004-02-10 Magic Earth, Inc. System and method for analyzing and imaging and enhanced three-dimensional volume data set using one or more attributes
AUPR296601A0 (en) * 2001-02-08 2001-03-08 Anderson Technologies Pty Ltd Optical tracking computer interface
GB0104232D0 (en) * 2001-02-21 2001-04-11 Reynolds David J Computer system on the world wide web
GB2373882B (en) * 2001-03-27 2005-07-27 Proksim Software Inc Comparing the position of shared objects
DE10125075B4 (en) * 2001-05-14 2004-07-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Personal Immersion: PC-based real-time graphics system for virtual reality applications
WO2003003194A1 (en) 2001-06-27 2003-01-09 Sony Corporation Integrated circuit device, information processing device, information recording device memory management method, mobile terminal device, semiconductor integrated circuit device, and communication method using mobile terminal device
US7216288B2 (en) * 2001-06-27 2007-05-08 International Business Machines Corporation Dynamic scene description emulation for playback of audio/visual streams on a scene description based playback system
KR20030035138A (en) * 2001-10-30 2003-05-09 한국전자통신연구원 Transmit method of state message in client-server-based networked virtual environment
FR2833101B1 (en) * 2001-12-03 2004-07-02 Dotvision METHOD FOR CREATING AND MANAGING VIRTUAL UNIVERSE
AUPR989802A0 (en) * 2002-01-09 2002-01-31 Lake Technology Limited Interactive spatialized audiovisual system
JP4054585B2 (en) * 2002-02-18 2008-02-27 キヤノン株式会社 Information processing apparatus and method
US8612196B2 (en) * 2002-04-11 2013-12-17 Linden Research, Inc. System and method for distributed simulation in which different simulation servers simulate different regions of a simulation space
US20040024849A1 (en) * 2002-04-19 2004-02-05 Adel El-Beik Method and system for distributing data
US7371175B2 (en) 2003-01-13 2008-05-13 At&T Corp. Method and system for enhanced audio communications in an interactive environment
US7399276B1 (en) 2003-05-08 2008-07-15 Health Hero Network, Inc. Remote health monitoring system
US9841809B2 (en) * 2003-12-12 2017-12-12 Kurzweil Technologies, Inc. Virtual encounters
US9948885B2 (en) * 2003-12-12 2018-04-17 Kurzweil Technologies, Inc. Virtual encounters
US20050130108A1 (en) * 2003-12-12 2005-06-16 Kurzweil Raymond C. Virtual encounters
US8600550B2 (en) * 2003-12-12 2013-12-03 Kurzweil Technologies, Inc. Virtual encounters
US9971398B2 (en) * 2003-12-12 2018-05-15 Beyond Imagination Inc. Virtual encounters
US7796155B1 (en) * 2003-12-19 2010-09-14 Hrl Laboratories, Llc Method and apparatus for real-time group interactive augmented-reality area monitoring, suitable for enhancing the enjoyment of entertainment events
JP2005326987A (en) * 2004-05-13 2005-11-24 Sony Corp Audio signal transmission system, audio signal transmission method, server, network terminal device, program and recording medium
FR2871606B1 (en) * 2004-06-09 2006-10-06 Giat Ind Sa TRAINING SYSTEM FOR THE OPERATION, USE OR MAINTENANCE OF A WORK ENVIRONMENT
EP1605420A3 (en) * 2004-06-09 2010-05-05 Nexter Training Learning system for the exploitation, the use or the maintenance of a working framework in a virtual reality environment
CA2578653A1 (en) 2004-07-29 2006-02-09 Kevin Ferguson A human movement measurement system
US7298378B1 (en) 2004-12-13 2007-11-20 Hagenbuch Andrew M Virtual reality universe realized as a distributed location network
CN100492382C (en) * 2005-04-12 2009-05-27 国际商业机器公司 Slitless game world system based on server/customer's machine and method thereof
US20060256907A1 (en) * 2005-05-13 2006-11-16 Freescale Semiconductor Inc. Real time clock
US9250703B2 (en) 2006-03-06 2016-02-02 Sony Computer Entertainment Inc. Interface with gaze detection and voice input
US8730156B2 (en) 2010-03-05 2014-05-20 Sony Computer Entertainment America Llc Maintaining multiple views on a shared stable virtual space
US20080004729A1 (en) * 2006-06-30 2008-01-03 Nokia Corporation Direct encoding into a directional audio coding format
RU2006131759A (en) * 2006-09-04 2008-03-10 Николай Иванович Пальченко (RU) METHOD AND SYSTEM OF MODELING, REPRESENTATION AND FUNCTIONING OF A UNIFIED VIRTUAL SPACE AS A UNIFIED INFRASTRUCTURE FOR IMPLEMENTATION OF REAL AND VIRTUAL ECONOMIC AND OTHER HUMAN ACTIVITIES
US20080125218A1 (en) * 2006-09-20 2008-05-29 Kelly James Collins Method of use for a commercially available portable virtual reality system
US9968850B2 (en) * 2007-09-17 2018-05-15 Disney Enterprises, Inc. System for providing virtual spaces for access by users
US20090077475A1 (en) * 2007-09-17 2009-03-19 Areae, Inc. System for providing virtual spaces with separate places and/or acoustic areas
US8196050B2 (en) 2007-09-17 2012-06-05 Mp 1, Inc. System and method for embedding a view of a virtual space in a banner ad and enabling user interaction with the virtual space within the banner ad
KR20100131467A (en) * 2008-03-03 2010-12-15 노키아 코포레이션 Apparatus for capturing and rendering a plurality of audio channels
US8066571B2 (en) 2008-06-09 2011-11-29 Metaplace, Inc. System and method for enabling characters to be manifested within a plurality of different virtual spaces
US9403087B2 (en) 2008-06-09 2016-08-02 Disney Enterprises, Inc. System and method of providing access to virtual spaces that are associated with physical analogues in the real world
US8243970B2 (en) * 2008-08-11 2012-08-14 Telefonaktiebolaget L M Ericsson (Publ) Virtual reality sound for advanced multi-media applications
US9384469B2 (en) 2008-09-22 2016-07-05 International Business Machines Corporation Modifying environmental chat distance based on avatar population density in an area of a virtual world
US20100077318A1 (en) * 2008-09-22 2010-03-25 International Business Machines Corporation Modifying environmental chat distance based on amount of environmental chat in an area of a virtual world
US8218690B1 (en) 2008-09-29 2012-07-10 Qualcomm Atheros, Inc. Timing offset compensation for high throughput channel estimation
US9100249B2 (en) 2008-10-10 2015-08-04 Metaplace, Inc. System and method for providing virtual spaces for access by users via the web
US8405770B2 (en) * 2009-03-12 2013-03-26 Intellectual Ventures Fund 83 Llc Display of video with motion
CN102577441B (en) 2009-10-12 2015-06-03 诺基亚公司 Multi-way analysis for audio processing
US8326855B2 (en) 2009-12-02 2012-12-04 International Business Machines Corporation System and method for abstraction of objects for cross virtual universe deployment
KR101099519B1 (en) * 2010-02-12 2011-12-28 주식회사 블루사이드 Method for Synchronizing Character Object Information by Classified Data Type
FR2961919A1 (en) * 2010-06-29 2011-12-30 France Telecom Method for processing 360 degree audiovisual scene of football match broadcasted in Internet by server, involves transmitting information relative to scene portion visualized by user to mobile telephone for utilization
US9239765B2 (en) * 2010-08-31 2016-01-19 Avaya Inc. Application triggered state migration via hypervisor
US10455089B2 (en) 2011-03-22 2019-10-22 Fmr Llc Augmented reality system for product selection
US8836771B2 (en) * 2011-04-26 2014-09-16 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US10120438B2 (en) 2011-05-25 2018-11-06 Sony Interactive Entertainment Inc. Eye gaze to alter device behavior
US8854282B1 (en) * 2011-09-06 2014-10-07 Google Inc. Measurement method
US9874437B2 (en) * 2011-12-28 2018-01-23 Femtonics Kft. Method for the 3-dimensional measurement of a sample with a measuring system comprising a laser scanning microscope and such measuring system
US9339691B2 (en) 2012-01-05 2016-05-17 Icon Health & Fitness, Inc. System and method for controlling an exercise device
EP2846887A1 (en) 2012-05-07 2015-03-18 Embodify ApS A method and system for improving bodily dexterity
CN102930753B (en) * 2012-10-17 2014-11-12 中国石油化工股份有限公司 Gas station virtual training system and application
EP2736276A1 (en) * 2012-11-27 2014-05-28 GN Store Nord A/S Personal communications unit for observing from a point of view and team communications system comprising multiple personal communications units for observing from a point of view
US9254409B2 (en) 2013-03-14 2016-02-09 Icon Health & Fitness, Inc. Strength training apparatus with flywheel and related methods
US10228242B2 (en) 2013-07-12 2019-03-12 Magic Leap, Inc. Method and system for determining user input based on gesture
US9282309B1 (en) 2013-12-22 2016-03-08 Jasmin Cosic Methods, systems and apparatuses for multi-directional still pictures and/or multi-directional motion pictures
JP5971316B2 (en) * 2013-12-25 2016-08-17 キヤノンマーケティングジャパン株式会社 INFORMATION PROCESSING SYSTEM, ITS CONTROL METHOD, AND PROGRAM, AND INFORMATION PROCESSING DEVICE, ITS CONTROL METHOD, AND PROGRAM
WO2015100429A1 (en) 2013-12-26 2015-07-02 Icon Health & Fitness, Inc. Magnetic resistance mechanism in a cable machine
WO2015138339A1 (en) 2014-03-10 2015-09-17 Icon Health & Fitness, Inc. Pressure sensor to quantify work
US10426989B2 (en) 2014-06-09 2019-10-01 Icon Health & Fitness, Inc. Cable system incorporated into a treadmill
WO2015195965A1 (en) 2014-06-20 2015-12-23 Icon Health & Fitness, Inc. Post workout massage device
US10391361B2 (en) 2015-02-27 2019-08-27 Icon Health & Fitness, Inc. Simulating real-world terrain on an exercise device
WO2016144279A1 (en) * 2015-03-06 2016-09-15 Ors Filiz Mujdehan Virtual reality based remote learning system and method
US10055888B2 (en) 2015-04-28 2018-08-21 Microsoft Technology Licensing, Llc Producing and consuming metadata within multi-dimensional data
US10102226B1 (en) 2015-06-08 2018-10-16 Jasmin Cosic Optical devices and apparatuses for capturing, structuring, and using interlinked multi-directional still pictures and/or multi-directional motion pictures
KR20170019649A (en) * 2015-08-12 2017-02-22 삼성전자주식회사 Device For Providing Sound User Interface and Method Thereof
US10491711B2 (en) 2015-09-10 2019-11-26 EEVO, Inc. Adaptive streaming of virtual reality data
JP6735077B2 (en) * 2015-09-25 2020-08-05 株式会社コロプラ System, method and program
US10625137B2 (en) 2016-03-18 2020-04-21 Icon Health & Fitness, Inc. Coordinated displays in an exercise device
US10272317B2 (en) 2016-03-18 2019-04-30 Icon Health & Fitness, Inc. Lighted pace feature in a treadmill
US10493349B2 (en) 2016-03-18 2019-12-03 Icon Health & Fitness, Inc. Display on exercise device
GB2557705A (en) * 2016-09-06 2018-06-27 Russell Hampson Inc Virtual reality motion simulation system.
US10671705B2 (en) 2016-09-28 2020-06-02 Icon Health & Fitness, Inc. Customizing recipe recommendations
US10831830B2 (en) 2016-12-30 2020-11-10 DISH Technologies L.L.C. Normative process of interaction with a registry of virtual spaces
WO2018135057A1 (en) * 2017-01-20 2018-07-26 ソニー株式会社 Information processing device, information processing method, and program
US10146300B2 (en) * 2017-01-25 2018-12-04 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Emitting a visual indicator from the position of an object in a simulated reality emulation
CN107862920A (en) * 2017-11-29 2018-03-30 桂林蓝港科技有限公司 A kind of method and system of process control experiment teaching under the environment based on VR
KR20190078475A (en) 2017-12-26 2019-07-04 (주)스코넥엔터테인먼트 Virtual reality control system
WO2019132521A1 (en) * 2017-12-26 2019-07-04 스코넥엔터테인먼트주식회사 Virtual environment control system
JP6714625B2 (en) * 2018-02-16 2020-06-24 株式会社カプコン Computer system
US10694311B2 (en) * 2018-03-15 2020-06-23 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation
WO2020002781A1 (en) * 2018-06-24 2020-01-02 Altusform Teaching device involving computer hardware and design unit suitable for such a teaching device
CN116312572A (en) * 2019-01-31 2023-06-23 华为技术有限公司 Audio signal processing method and device
US11813528B2 (en) * 2021-11-01 2023-11-14 Snap Inc. AR enhanced gameplay with a personal mobility system
US11645032B1 (en) 2022-09-14 2023-05-09 International Business Machines Corporation Smart multi-screen wall arrangement in a virtual reality environment

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4017858A (en) * 1973-07-30 1977-04-12 Polhemus Navigation Sciences, Inc. Apparatus for generating a nutating electromagnetic field
US3983474A (en) * 1975-02-21 1976-09-28 Polhemus Navigation Sciences, Inc. Tracking and determining orientation of object using coordinate transformation means, system and process
US4406532A (en) * 1980-03-25 1983-09-27 Howlett Eric M Wide angle color photography method and system
US4714989A (en) * 1982-02-19 1987-12-22 Billings Roger E Funtionally structured distributed data processing system
US4479195A (en) * 1982-09-07 1984-10-23 At&T Bell Laboratories Data conference system
US4542291A (en) * 1982-09-29 1985-09-17 Vpl Research Inc. Optical flex sensor
US4937444A (en) * 1982-09-29 1990-06-26 Vpl Research, Inc. Optical flex sensor
US4540850A (en) * 1983-04-29 1985-09-10 At&T Bell Laboratories Method and apparatus for controlling a conference
US4640989A (en) * 1984-07-23 1987-02-03 Asher Technologies, Inc. Communications unit for executive work station
US4710870A (en) * 1985-07-10 1987-12-01 Bell Communications Research, Inc. Central computer backup system utilizing localized data bases
US4757714A (en) * 1986-09-25 1988-07-19 Insight, Inc. Speed sensor and head-mounted data display
US4945305A (en) * 1986-10-09 1990-07-31 Ascension Technology Corporation Device for quantitatively measuring the relative position and orientation of two bodies in the presence of metals utilizing direct current magnetic fields
US4734934A (en) * 1986-11-24 1988-03-29 Gte Laboratories Incorporated Binaural teleconferencing system
GB8701288D0 (en) * 1987-01-21 1987-02-25 Waldern J D Perception of computer-generated imagery
US5001628A (en) * 1987-02-13 1991-03-19 International Business Machines Corporation Single system image uniquely defining an environment for each user in a data processing system
US4988981B1 (en) * 1987-03-17 1999-05-18 Vpl Newco Inc Computer data entry and manipulation apparatus and method
US5003300A (en) * 1987-07-27 1991-03-26 Reflection Technology, Inc. Head mounted display for miniature video display system
US4796293A (en) * 1987-12-18 1989-01-03 Communications Network Enhancement Inc. Enhanced dedicated teleconferencing system
US5021976A (en) * 1988-11-14 1991-06-04 Microelectronics And Computer Technology Corporation Method and system for generating dynamic, interactive visual representations of information structures within a computer
US5588139A (en) * 1990-06-07 1996-12-24 Vpl Research, Inc. Method and system for generating objects for a multi-person virtual world using data flow networks
CA2047412A1 (en) * 1990-08-24 1992-02-25 Albert F. Harvard Theme park attraction for multiple participants using real time simulation
JP3247126B2 (en) * 1990-10-05 2002-01-15 テキサス インスツルメンツ インコーポレイテツド Method and apparatus for providing a portable visual display
US5469511A (en) * 1990-10-05 1995-11-21 Texas Instruments Incorporated Method and apparatus for presentation of on-line directional sound
WO1992009921A1 (en) * 1990-11-30 1992-06-11 Vpl Research, Inc. Improved method and apparatus for creating sounds in a virtual world
US5307456A (en) * 1990-12-04 1994-04-26 Sony Electronics, Inc. Integrated multi-media production and authoring system
JPH06508222A (en) * 1991-05-23 1994-09-14 アタリ ゲームズ コーポレーション modular display simulator
US5381158A (en) * 1991-07-12 1995-01-10 Kabushiki Kaisha Toshiba Information retrieval apparatus
GB9115142D0 (en) * 1991-07-13 1991-08-28 Ibm Data processing system
US5310349A (en) * 1992-04-30 1994-05-10 Jostens Learning Corporation Instructional management system
US5495576A (en) * 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5466200A (en) * 1993-02-02 1995-11-14 Cybergear, Inc. Interactive exercise apparatus
US5633993A (en) * 1993-02-10 1997-05-27 The Walt Disney Company Method and apparatus for providing a virtual world sound system

Also Published As

Publication number Publication date
US5659691A (en) 1997-08-19
CA2172535A1 (en) 1995-03-30
EP0721614A1 (en) 1996-07-17
NZ330003A (en) 1999-10-28
JP4152432B2 (en) 2008-09-17
AU7736694A (en) 1995-04-10
AU687888B2 (en) 1998-03-05
JP2005182843A (en) 2005-07-07
NZ273893A (en) 1998-05-27
JPH09503082A (en) 1997-03-25
US5950202A (en) 1999-09-07
EP0721614B1 (en) 2003-08-20
WO1995008793A1 (en) 1995-03-30
DE69433061D1 (en) 2003-09-25
DE69433061T2 (en) 2004-06-03

Similar Documents

Publication Publication Date Title
CA2172535C (en) Virtual reality network
JP7109408B2 (en) Wide range simultaneous remote digital presentation world
CN107103801B (en) Remote three-dimensional scene interactive teaching system and control method
CN108074431B (en) System and method for applying VR (virtual reality) technical lecture practical training
CN106095235B (en) control method and device based on virtual reality
WO1997023845A2 (en) A computer method and computer system based on a simulated environment using procedural animation in a simulated city
CN100442313C (en) Three-dimensional virtual space simulator, three-dimensional virtual space simulation program, and computer readable recording medium where the program is recorded
US6215498B1 (en) Virtual command post
CN102939139B (en) Calibration of portable devices in shared virtual space
US20070225077A1 (en) Method, system and apparatus for location-based gaming
CN101978707A (en) Realistic audio communication in a three dimensional computer-generated virtual environment
CN101303622A (en) Chat interface with haptic feedback function
US5784570A (en) Server for applying a recipient filter and compressing the input data stream based upon a set of at least one characteristics in a multiuser interactive virtual environment
JPH05113941A (en) Transmission/reception device
JP2913624B1 (en) Disaster experience simulator
CN109634424A (en) Physical space is set to be mapped as virtual method based on novel imaging and multiple technologies
JP7050884B6 (en) Information processing system, information processing method, information processing program
CN212208359U (en) Virtual reality system of making equipment
CN112035047A (en) Cross-platform multi-person online interaction method, system and storage medium
JP2000155589A (en) Spatial position presentation method and recording medium recorded with spatial position presentation program
Wong The Philosophy of Virtual Reality
Yura et al. Design and implementation of the browser for the multimedia multi-user dungeon of the digital museum
CN114549800A (en) Control method for virtual reality system and virtual reality system
Rosenberg et al. Future Human Interfaces to Computer-Controlled Sound Systems
Wang Audiovideo services for a virtual laboratory

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20140922