US20090131165A1 - Physical feedback channel for entertainment or gaming environments - Google Patents

Physical feedback channel for entertainment or gaming environments Download PDF

Info

Publication number
US20090131165A1
US20090131165A1 US12/357,184 US35718409A US2009131165A1 US 20090131165 A1 US20090131165 A1 US 20090131165A1 US 35718409 A US35718409 A US 35718409A US 2009131165 A1 US2009131165 A1 US 2009131165A1
Authority
US
United States
Prior art keywords
user
signals
application software
feedback
software program
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/357,184
Inventor
Peter Buchner
Ulrich Clanget
Jorg Treiner
Sophie Boucher
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US12/357,184 priority Critical patent/US20090131165A1/en
Publication of US20090131165A1 publication Critical patent/US20090131165A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/217Input arrangements for video game devices characterised by their sensors, purposes or types using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/218Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/28Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A63F13/285Generating tactile feedback signals via the game input device, e.g. force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/33Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
    • A63F13/332Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using wireless networks, e.g. cellular phone networks
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • AHUMAN NECESSITIES
    • A41WEARING APPAREL
    • A41DOUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
    • A41D1/00Garments
    • A41D1/002Garments adapted to accommodate electronic equipment
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1012Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1037Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1056Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving pressure sensitive buttons
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/20Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
    • A63F2300/209Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform characterized by low level software layer, relating to hardware management, e.g. Operating System, Application Programming Interface
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/302Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device specially adapted for receiving control signals not targeted to a display device or game input means, e.g. vibrating driver's seat, scent dispenser
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/406Transmission via wireless network, e.g. pager or GSM
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/66Methods for processing data by generating or executing the game program for rendering three dimensional images
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082Virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/013Force feedback applied to a game

Definitions

  • the present invention generally relates to the field of providing physical feedback to the user of an application, such as f.e. a computer game or other entertainment application software.
  • Haptic interfaces represent an interesting alternative to conventional human-machine interfaces and feature a wide variety of applications. Examples include virtual-reality (VR) applications for immersive simulation, teleoperated master-slave robot systems, and robotic surgery.
  • a haptic interface according to the state of the art comprises a special input/output device (e.g. a force-feedback joystick, a haptic mouse, or an exoskeleton), a real-time controller, and a real-time simulation of a virtual environment.
  • the controller thereby collects information from integrated sensors of the input/output device (e.g. position, velocity, force or torque sensors), which are then used as input information to the simulation.
  • the simulation estimates the forces a user should feel based on this input information and the internal state of the simulation itself.
  • the simulation outputs are then used by the controller to drive the input/output device's actuators, which allows said user to touch, feel, and manipulate virtual environments.
  • WO 01/41636 A1 refers to a tactile communication system enabling remotely control of tactile output devices, e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
  • tactile output devices e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
  • WO 98/14860 pertains to a method for transmitting the touch of a sensor array via a computer or computer network and a corresponding system for transmitting perceptible feelings, which comprises at least one computer, a sensor array for detecting touches from a person and providing sensor signals, an actuator array for generating physically perceptible pressure signals, and a control unit linking the sensor array and the actuator array to the computer.
  • a communication terminal device with a tactile feedback comprises a pen-input tablet, a microphone, an acceleration sensor and a number of pressure sensors.
  • a computerized system including a touch/pressure-sensitive transducer and a computer responsive thereto for producing a sentic cycle and recording touch expression is disclosed in U.S. Pat. No. 5,305,423.
  • a system providing realistic physical feedback in a computer gaming environment can comprise:
  • the wearable receiver can be integrated in a piece of garment.
  • a display can be integrated into the piece of garment.
  • the wearable receiver can comprise a controller for controlling an array of actuators according to an operational pattern depending on any feedback signal received.
  • the system furthermore can comprise a channel for transmitting signals representing biological data from the user to the computing device hosting the application software program.
  • the application software can be an entertainment or game-type software.
  • the feedback signals can be generated depending on a background scene and/or a virtual actor of a game-type software.
  • the application software can be divided into several logical parts, wherein each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator means.
  • the actuator means can comprise means for generating vibrational, tactile and/or heat.
  • the wearable receiver can comprise means for adjusting manually operational parameters of the actuator means.
  • a method for providing physical feedback sensations to the body of a user of an application software program can comprise the following steps:
  • Another aspect relates to computer program product, a computer game console and a wearable game accessory respectively supporting such a method.
  • FIG. 1 shows a user wearing a piece of clothing which includes integrated actuators for generating vibrations, heat or coolness, pressure and/or electric pulses generated by actuators worn on or placed near the user's body,
  • FIG. 2 block diagram showing the interaction between biometric sensors placed on or close to the body of a person wearing said piece of clothing, a game console platform and its controlling unit,
  • FIG. 3 a shows a piece of clothing (e.g. a shirt) comprising a wearable display
  • FIG. 3 b shows a piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red,
  • a piece of clothing e.g. a shirt
  • a wearable display which shows a simulated heavy violation by coloring parts of said shirt red
  • FIG. 4 a illustrates a tactile communication scenario according to a first embodiment of the invention
  • FIG. 4 b illustrates a tactile communication scenario according to a second embodiment of this invention
  • FIGS. 1 to 4 b different embodiments of the present invention as depicted in FIGS. 1 to 4 b shall be explained in detail.
  • the meaning of the symbols designated with reference numerals and signs in these figures can be taken from an annexed table.
  • the present invention particularly refers to a piece of clothing or wearable accessory 101 equipped with at least one wearable computing device 100 , wherein the computing device is connected to the central controlling unit 109 ′′ e.g. of a game console application or any type of application software running on an external controlling device 109 over a wireless or wirebound link 199 . It comprises means ( 100 C) for receiving (S 202 ′) and processing (S 202 ′) e.g. digitally encoded control information representing physical feedback signals from the external controlling device 109 , actuating means 106 a - d placed on or close to the body of a person wearing said piece of clothing or wearable accessory 101 , which generate multi-sensorial feedback e.g.
  • the central controlling unit can be connected operatively with a monitor device, as it is well known f.e. from game consoles, to transmit and eventually receive signals from the monitor device.
  • said device 100 features a tactile interface which comprises different sensing means 105 a - c for detecting tactile input information when being touched by a user and/or a number of actuating means 106 a - d for generating (S 104 ′) tactile stimuli, which provides said user with sensoric feedback f.e. from a virtual gaming scene according to said control information.
  • tactile stimulation is achieved by means of a dedicated piece of clothing equipped with one or a number of the same or different types of mechanical and/or electric actuators 106 a - d (e.g. micro motors, micro speakers, piezo elements, micro fans and electrostatic discharge modules for simulating e.g. “laser shocks”, etc.).
  • Said actuators are embedded into a piece of clothing 101 or into a part of said clothing worn by the player, wearable accessories or intelligent jewelries that are preferably worn on the upper part of the person's body or on his/her arms.
  • the game console application 109 ′ is usually responsible for controlling only a single actuator 106 or a number of actuators 106 a - d at a time and works according to a predefined set of rules.
  • biometric 105 a - c
  • environmental sensors 105 ′
  • the sensors are used for measuring e.g. the skin conductivity, which indicates the degree of sweating, body temperature, blood volume pressure, respiration and/or pulse rate (and therewith the excitement level) of the player or several environmental conditions (e.g. the temperature, atmospheric pressure, relative humidity and/or wind speed) in the environment of said person, respectively.
  • the controlling unit 100 C of a wearable computing device 100 integrated into the player's clothes thereby acts as a wireless or wired link between the actuators 106 a - d and the game console platform 109 .
  • conventional wireless standards such as Bluetooth, ZigBee or IEEE 802.11b WLAN technology
  • high-speed fixed network connections such as Ethernet, USB or 1394 can also be supported.
  • a second embodiment of the present invention as depicted in FIG. 4 b is based on an active wearable device 100 driven by e.g. a game console platform 109 which targets a relaxing stimulation of a person wearing a piece of clothing 101 including such an embedded active wearable device 100 .
  • This device comprises at least one haptic interface and/or a number of sensors 105 a - c and actuators 106 a - d placed on or close to a user's body (e.g. on the neck, shoulders and/or arms of said person), which are used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting the player's feelings, emotional states or states of mind) and generating different types of stimulation (e.g.
  • a third embodiment of the present invention is directed to an interactive tactile communication scenario, wherein wearable computing devices of at least two players, each wearing a piece of clothing as described above and having a communication platform (i.e. a game console or PC) with the appropriate interfaces and application software, are interconnected via a wireless or wired network link.
  • a number of biometric ( 110 c ) and/or environmental signals ( 110 c ′) indicating the physical condition, emotional states and/or states of mind of a first person wearing a first piece of clothing 101 equipped with a first wearable computing device 100 and/or tactile sensations perceived by said first person are continuously (or intermittently) sensed and monitored (S 100 ).
  • the application software provides predefined patterns for a mutual tactile stimulation and also enables the users to create their own individual “remote touch” patterns or sequences.
  • real-time entertaining is available; for non-real-time operation the provision of an email interface to drive the “remote touch” scenario is also possible.
  • a user can also wear a piece of clothing 300 a/b (e-g. a shirt) that comprises optical fibers and/or any other type of wearable optical displays 102 , 102 ′ or 102 ′′.
  • a piece of clothing 300 a/b e-g. a shirt
  • optical fibers e.g. a display
  • 102 ′ or 102 ′′ e.g. a display
  • These displays can e.g.
  • the haptic interface additionally comprises actuators 106 a - d which are used for generating low-frequency vibrations or acoustic signals making the player feeling tired, stressed or unconcentrated and simulating physical strain.
  • a smart jacket equipped with at least one wearable computing device as described above, worn by a first person, 101′ second piece of clothing (e.g. a smart jacket) equipped with at least one further integrated wearable computing device, worn by a second person, that is specially adapted to receive digitally encoded information from said first piece of clothing or wearable accessory 101 102 liquid crystal display (LCD), incorporated into the upper right front part of the piece of clothing 101, that is used e.g. to display relaxing images, images reflecting emotional states of a person wearing said piece of clothing 101 - e.g. in the form of emoticons (“smileys”, e.g.
  • LCD liquid crystal display
  • a shirt which displays a simulated heavy violation by using integrated optical fibers made of quartz glass and/or plastics for illuminating and/or coloring parts of said shirt red 103 tactile interface, integrated into said piece of clothing 101, which is used for sensing tactile input information, monitoring a user's physiological, physical and/or psychological condition and generating heat, pressure, vibrational and/or electric pulses or other types of stimulation based on this tactile input information, physical or mental strain of said user and/or context information provided by applications running on a game console 109 104 smart button for buttoning up said jacket 101, which can also be used for activating or deactivating an integrated function allowing the wearer of said jacket 101 e.g.
  • biometric sensors body temperature, blood volume 105a-c pressure, skin conductivity, respiration rate and/or pulse rate sensors, etc.
  • biometric signals indicating the physical condition and excitement level of a user wearing the jacket 101
  • meteorological sensors 105′ e.g.
  • thermometer barometer, hygrometer and/or wind speed meter
  • actuating means micro motors, micro speakers, piezo 106a-d elements, heating elements and micro fans or electrostatic discharge modules, etc.
  • vibrations acoustic signals, heat or coolness, pressure or electric pulses stimulating the user, which are integrated e.g.
  • mapping the results of this analysis to emotional patterns stored in a read access memory (RAM) and using these patterns for activating/deactivating (S104) at least one of the available actuators 106a-d that are integrated into the piece of clothing 101 for stimulating the wearer's energy level, said processing means being integrated e.g.
  • Internet or SMS emoticons such as “:-)”, “:-
  • biometric sensors 105 e.g. body temperature, blood volume pressure, respiration rate and/or pulse rate sensors
  • meteorological sensors 105′ e.g. thermometer, barometer, hygrometer, and wind speed meter
  • a shirt comprising a wearable display which shows the name or logo of an interactive network game or displays the current high-score rank of a player participating in said game and/or any other game- related information 300b piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red 400a tactile communication scenario according to a first embodiment of the present invention (“Shock U”), wherein a wearable computing device 100 comprising at least one haptic interface or a number of actuators 106a-d placed on or close to a user's body, which are used for generating different types of stimulation (e.g.
  • a wearable computing device 100 - comprising at least one haptic interface or a number of sensors 105a-c and actuators 106a-d placed on or close to a user's body, that are respectively used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting said user's feelings, emotional states and/or states of mind) and generating different types of stimulation (e.g.
  • step #100 sensing and monitoring different biometric signals (e.g. body temperature, blood volume pressure, respiration rate and/or pulse rate) indicating the physical condition of a person wearing said jacket 101
  • step #1001 measuring meteorological parameters (e.g.
  • step #101 extracting features from biometric signal taken from a user wearing said jacket 101, which indicates the physical condition of said user, and/or measured meteorological conditions in the environment of said user S102 step #102: analyzing these features S102′ step #102′: analyzing user inputs by evaluating oral and/or written user statements and signs (e.g.

Abstract

A physical feedback system for computer gaming environments including a computing device for executing an application software program, the computing device having an interface for transmitting feedback signals generated by the application software program, and a wearable receiver having means for receiving the feedback signals from the computing device and actuator means designed to enter physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a Continuation of and claims the benefit priority from U.S. Ser. No. 10/995,001, filed Nov. 22, 2004, the entire contents of each of which are incorporated herein by reference, which claims the benefit of priority from European Patent Application No. 03026896.5, filed Nov. 24, 2003.
  • FIELD AND BACKGROUND OF THE INVENTION
  • The present invention generally relates to the field of providing physical feedback to the user of an application, such as f.e. a computer game or other entertainment application software.
  • BRIEF DESCRIPTION OF THE PRESENT STATE OF THE ART
  • To understand the proposed idea of the present invention, it is necessary to briefly describe the main features, advantages and problems of haptic interfaces and tactile communication systems according to the state of the art.
  • Haptic interfaces represent an interesting alternative to conventional human-machine interfaces and feature a wide variety of applications. Examples include virtual-reality (VR) applications for immersive simulation, teleoperated master-slave robot systems, and robotic surgery. A haptic interface according to the state of the art comprises a special input/output device (e.g. a force-feedback joystick, a haptic mouse, or an exoskeleton), a real-time controller, and a real-time simulation of a virtual environment. The controller thereby collects information from integrated sensors of the input/output device (e.g. position, velocity, force or torque sensors), which are then used as input information to the simulation. The simulation estimates the forces a user should feel based on this input information and the internal state of the simulation itself. The simulation outputs are then used by the controller to drive the input/output device's actuators, which allows said user to touch, feel, and manipulate virtual environments.
  • WO 01/41636 A1 refers to a tactile communication system enabling remotely control of tactile output devices, e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
  • WO 98/14860 pertains to a method for transmitting the touch of a sensor array via a computer or computer network and a corresponding system for transmitting perceptible feelings, which comprises at least one computer, a sensor array for detecting touches from a person and providing sensor signals, an actuator array for generating physically perceptible pressure signals, and a control unit linking the sensor array and the actuator array to the computer.
  • In EP 0 875 821 A2, a communication terminal device with a tactile feedback is described. The device comprises a pen-input tablet, a microphone, an acceleration sensor and a number of pressure sensors.
  • A computerized system including a touch/pressure-sensitive transducer and a computer responsive thereto for producing a sentic cycle and recording touch expression is disclosed in U.S. Pat. No. 5,305,423.
  • PROBLEMS OF PRIOR-ART SOLUTIONS
  • Today, entertainment and gaming software such as e.g. adventure games are getting more and more realistic due to a more and more enhanced graphical resolution and frame rate. Modern game console platforms are also used in combination with hand-held controller devices providing a haptic force-feedback function. However, these force-feedback controller devices according to the state of the art do not provide a realistic way of feeling tactile sensations in virtual game scenarios.
  • OBJECT OF THE PRESENT INVENTION
  • In view of the explanations mentioned above, it is the object of the present invention to provide a controlling device which allows a more realistic (intuitive) feedback.
  • This object is achieved by means of the features of the independent claims. Advantageous features are defined in the subordinate claims. Further objects and advantages of the invention are apparent in the detailed description which follows.
  • SUMMARY OF THE INVENTION
  • A system providing realistic physical feedback in a computer gaming environment according can comprise:
      • a computing device for executing an application software program,
        the computing device having an interface for transmitting feedback signals generated by the application software program, and
      • a wearable receiver having means for receiving the feedback signals from the computing device and actuator means designed to enter physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
  • The wearable receiver can be integrated in a piece of garment.
  • A display can be integrated into the piece of garment.
  • The wearable receiver can comprise a controller for controlling an array of actuators according to an operational pattern depending on any feedback signal received.
  • The system furthermore can comprise a channel for transmitting signals representing biological data from the user to the computing device hosting the application software program.
  • The application software can be an entertainment or game-type software.
  • The feedback signals can be generated depending on a background scene and/or a virtual actor of a game-type software.
  • The application software can be divided into several logical parts, wherein each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator means.
  • The actuator means can comprise means for generating vibrational, tactile and/or heat.
  • The wearable receiver can comprise means for adjusting manually operational parameters of the actuator means.
  • According to another aspect of the present invention, a method for providing physical feedback sensations to the body of a user of an application software program can comprise the following steps:
      • generating feedback signals in an application software program,
      • transmitting the feedback signals to a wearable receiver, and
      • entering, based on the received feedback signals, physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
  • Another aspect relates to computer program product, a computer game console and a wearable game accessory respectively supporting such a method.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Further advantages and conceivable applications of the present invention result from the subordinate claims as well as from the following description of one embodiment of the invention as depicted in the following drawings:
  • FIG. 1 shows a user wearing a piece of clothing which includes integrated actuators for generating vibrations, heat or coolness, pressure and/or electric pulses generated by actuators worn on or placed near the user's body,
  • FIG. 2 block diagram showing the interaction between biometric sensors placed on or close to the body of a person wearing said piece of clothing, a game console platform and its controlling unit,
  • FIG. 3 a shows a piece of clothing (e.g. a shirt) comprising a wearable display,
  • FIG. 3 b shows a piece of clothing (e.g. a shirt) comprising a wearable display which shows a simulated heavy violation by coloring parts of said shirt red,
  • FIG. 4 a illustrates a tactile communication scenario according to a first embodiment of the invention, and
  • FIG. 4 b illustrates a tactile communication scenario according to a second embodiment of this invention,
  • DETAILED DESCRIPTION OF THE PRESENT INVENTION
  • In the following, different embodiments of the present invention as depicted in FIGS. 1 to 4 b shall be explained in detail. The meaning of the symbols designated with reference numerals and signs in these figures can be taken from an annexed table.
  • The present invention particularly refers to a piece of clothing or wearable accessory 101 equipped with at least one wearable computing device 100, wherein the computing device is connected to the central controlling unit 109″ e.g. of a game console application or any type of application software running on an external controlling device 109 over a wireless or wirebound link 199. It comprises means (100C) for receiving (S202′) and processing (S202′) e.g. digitally encoded control information representing physical feedback signals from the external controlling device 109, actuating means 106 a-d placed on or close to the body of a person wearing said piece of clothing or wearable accessory 101, which generate multi-sensorial feedback e.g. from a virtual gaming scene by generating (S104′) visual, auditive, tactile, gustatoric and/or olfactoric stimuli, particularly stimuli using the skin of a user as an interface, as well as means for activating, controlling and deactivating (S104) these actuating means 106 a-d according to said control information.
  • The central controlling unit can be connected operatively with a monitor device, as it is well known f.e. from game consoles, to transmit and eventually receive signals from the monitor device.
  • According to a further aspect of the invention, said device 100 features a tactile interface which comprises different sensing means 105 a-c for detecting tactile input information when being touched by a user and/or a number of actuating means 106 a-d for generating (S104′) tactile stimuli, which provides said user with sensoric feedback f.e. from a virtual gaming scene according to said control information.
  • According to a first embodiment of the invention as depicted in FIG. 4 a, tactile stimulation is achieved by means of a dedicated piece of clothing equipped with one or a number of the same or different types of mechanical and/or electric actuators 106 a-d (e.g. micro motors, micro speakers, piezo elements, micro fans and electrostatic discharge modules for simulating e.g. “laser shocks”, etc.). Said actuators are embedded into a piece of clothing 101 or into a part of said clothing worn by the player, wearable accessories or intelligent jewelries that are preferably worn on the upper part of the person's body or on his/her arms. To get a more realistic impression of the gaming atmosphere (displayed on the monitor device), simulated environmental conditions such as wind, rain or heat become feelable to said player. The intensity of simulated tactile sensations, which is under main control of the game console application software and also controlled by different controlling means which are directly controllable by the player, depends on the number of worn clothing layers. The game console application 109′ is usually responsible for controlling only a single actuator 106 or a number of actuators 106 a-d at a time and works according to a predefined set of rules.
  • As shown in FIGS. 1 and 2, in addition to the signals originating from the game console, furthermore feedback data from the player, detected by a number of biometric (105 a-c) and/or environmental sensors (105′) placed on or close to the user's body can also be used to influence the game console application software. The sensors are used for measuring e.g. the skin conductivity, which indicates the degree of sweating, body temperature, blood volume pressure, respiration and/or pulse rate (and therewith the excitement level) of the player or several environmental conditions (e.g. the temperature, atmospheric pressure, relative humidity and/or wind speed) in the environment of said person, respectively.
  • There are usually different types of visual or audio information conveyed to the user. Possible categories are:
  • (1) information regarding the atmosphere, e.g. via the rhythm of music indicating danger,
    (2) information about what the main character in a virtual game scenario shown on the monitor is doing (e.g. jumping or firing), and
    (3) information related to other characters such as enemies and partners of the main character. These different categories of information (background, main and foreground information) can be conveyed by different types of actuators (acoustic, optical, haptic actuators or special actuators that generate signals stimulating a player's gustatoric or olfactoric sense) to represent different levels of information to the user. For each category, the intensity of a signal can be varied.
  • The controlling unit 100C of a wearable computing device 100 integrated into the player's clothes thereby acts as a wireless or wired link between the actuators 106 a-d and the game console platform 109. Besides conventional wireless standards such as Bluetooth, ZigBee or IEEE 802.11b WLAN technology, high-speed fixed network connections such as Ethernet, USB or 1394 can also be supported.
  • A second embodiment of the present invention as depicted in FIG. 4 b is based on an active wearable device 100 driven by e.g. a game console platform 109 which targets a relaxing stimulation of a person wearing a piece of clothing 101 including such an embedded active wearable device 100. This device comprises at least one haptic interface and/or a number of sensors 105 a-c and actuators 106 a-d placed on or close to a user's body (e.g. on the neck, shoulders and/or arms of said person), which are used for sensing tactile input information, monitoring his/her physiological, physical and/or psychological condition (which especially includes physical expressions of affection reflecting the player's feelings, emotional states or states of mind) and generating different types of stimulation (e.g. heat, pressure, vibrational and/or electric pulses, etc.) based on this information, respectively. In this connection, so-called “relax software titles” are needed which are specially designed to control the actuators in a way that is being received by said person as a tactile sensation and/or relaxing stimulation. The software for running the haptic interface can also be supported by relaxing music, video or graphical scenes. Also conceivable is a combination of the first and said second embodiment.
  • A third embodiment of the present invention is directed to an interactive tactile communication scenario, wherein wearable computing devices of at least two players, each wearing a piece of clothing as described above and having a communication platform (i.e. a game console or PC) with the appropriate interfaces and application software, are interconnected via a wireless or wired network link. Thereby, a number of biometric (110 c) and/or environmental signals (110 c′) indicating the physical condition, emotional states and/or states of mind of a first person wearing a first piece of clothing 101 equipped with a first wearable computing device 100 and/or tactile sensations perceived by said first person are continuously (or intermittently) sensed and monitored (S100).
  • After having extracted (S101) a number of features from said biometric (110 c) and/or environmental signals (100 c′), these features are analyzed (S102) and mapped (S103) to a number of emotional patterns (meta information), that are stored in an integrated read access memory (RAM) for further processing. This meta information is then transmitted (S201) to a second person wearing a second piece of clothing 101′ equipped with at least one further wearable computing device 100′ for receiving (S202) and reproducing (S104) tactile sensations perceived and/or physical affection expressed by said first person. The application software thereby allows a “remote touch” by opening an e.g. Internet-based “tactile remote control” connection between the two players. Each player can alternatively select to control the distant wearable device of his/her counterpart or his/her own wearable device. Therefore, the application software provides predefined patterns for a mutual tactile stimulation and also enables the users to create their own individual “remote touch” patterns or sequences. In case of an online connection, real-time entertaining is available; for non-real-time operation the provision of an email interface to drive the “remote touch” scenario is also possible. Finally, it should be mentioned that this embodiment can advantageously be combined with said first and/or said second embodiment described above.
  • In addition to the haptic interface, a user can also wear a piece of clothing 300 a/b (e-g. a shirt) that comprises optical fibers and/or any other type of wearable optical displays 102, 102′ or 102″. These displays can e.g.
      • show the name and/or logo of an interactive network game or display the current high-score rank of a player participating in said game and/or any other game-related information (cf. FIG. 3 a),
      • show a simulated heavy violation by using integrated optical fibers for coloring parts of said shirt red (cf. FIG. 3 b), or
      • display relaxing images, images reflecting emotional states of a user wearing said piece of clothing—e.g. in the form of emoticons (“smileys”, e.g. “:-)”, “:-|”, or “:-(”, etc.) or other symbols and signs—or any other type of visual information.
  • According to a further aspect of the invention, the haptic interface additionally comprises actuators 106 a-d which are used for generating low-frequency vibrations or acoustic signals making the player feeling tired, stressed or unconcentrated and simulating physical strain.
  • TABLE
    Depicted Features
    and their Corresponding Reference Signs
    No. Technical Feature (System Component or Procedure Step)
    100 wearable computing device, integrated into a first piece of
    clothing 101 (e.g. a smart jacket) or any type of wearable
    accessory such as watches, wrist or arm bracelets, rings,
    brooches, etc. (so-called “digital jewelry”), comprising
    actuators transmitting feedback-information using the skin
    of a user as an interface for entering informational
    sensation to the body of the user
    100′ wearable computing device, integrated into a second piece
    of clothing 101′ worn by a second user
    wearable computing device
    100C central controlling unit (μC) of the wearable computing
    device 100
    central controlling unit (μC′) of the second wearable
    computing device 100′
    transmitting means of the wearable computing device 100
    receiving means of the wearable computing device 100′ for
    wirelessly receiving information
    transmitting means of the wearable computing device, that
    is used for wirelessly transmitting information
    receiving means of the wearable computing device for
    wirelessly receiving information
    diagram showing a user wearing a piece of clothing 101
    which includes a number of integrated electronic devices
    for monitoring tactile sensations, emotional states and/or
    the state of mind of the user, analyzing said feelings and
    combining vibrational, heat, pressure or electric pulses
    generated by actuators 106a-c worn on and/or placed near
    the user's body for stimulating said user
    block diagram showing the feature extraction and tactile
    stimulation procedure according to the present invention
    101 first piece of clothing (e.g. a smart jacket) equipped with
    at least one wearable computing device as described above,
    worn by a first person,
    101′ second piece of clothing (e.g. a smart jacket) equipped
    with at least one further integrated wearable computing
    device, worn by a second person, that is specially adapted
    to receive digitally encoded information from said first
    piece of clothing or wearable accessory 101
    102 liquid crystal display (LCD), incorporated into the upper
    right front part of the piece of clothing 101, that is used
    e.g. to display relaxing images, images reflecting
    emotional states of a person wearing said piece of clothing
    101 - e.g. in the form of emoticons (“smileys”, e.g. “:-)”,
    “:-|”, “:-(”, etc.) or other symbols and signs - or any
    other type of visual information
    102′ wearable display, embedded into a piece of clothing 300a
    (e.g. a shirt), which displays the name and/or logo of an
    interactive network game, the current high-score rank of a
    player participating in said game, game-related and/or any
    other type of textual and/or visual information
    102″ wearable display, embedded into another piece of clothing
    300b (e.g. a shirt), which displays a simulated heavy
    violation by using integrated optical fibers made of quartz
    glass and/or plastics for illuminating and/or coloring
    parts of said shirt red
    103 tactile interface, integrated into said piece of clothing
    101, which is used for sensing tactile input information,
    monitoring a user's physiological, physical and/or
    psychological condition and generating heat, pressure,
    vibrational and/or electric pulses or other types of
    stimulation based on this tactile input information,
    physical or mental strain of said user and/or context
    information provided by applications running on a game
    console 109
    104 smart button for buttoning up said jacket 101, which can
    also be used for activating or deactivating an integrated
    function allowing the wearer of said jacket 101 e.g. to
    listen his/her favorite music stored on an integrated
    microchip, tune into his/her favorite radio channel,
    display moving images on the liquid crystal display 102,
    activate or deactivate integrated heating elements, etc.
    105, different biometric sensors (body temperature, blood volume
    105a-c pressure, skin conductivity, respiration rate and/or pulse
    rate sensors, etc.) for monitoring a number of biometric
    signals indicating the physical condition and excitement
    level of a user wearing the jacket 101,
    105′ different meteorological sensors 105′ (e.g. thermometer,
    barometer, hygrometer and/or wind speed meter) indicating
    different climatic and/or meteorological conditions
    (temperature, atmospheric pressure, relative humidity and
    wind speed) in the environment of said user
    106, actuating means (micro motors, micro speakers, piezo
    106a-d elements, heating elements and micro fans or electrostatic
    discharge modules, etc.) for generating vibrations,
    acoustic signals, heat or coolness, pressure or electric
    pulses stimulating the user, which are integrated e.g. into
    the waist belt of the user's smart jacket 101
    106′ processing means for extracting (S101) features from
    biometric signals taken from a user wearing said jacket
    101, which indicate the physical condition of said user,
    and/or measured meteorological parameters in the
    environment of the user, analyzing (S102′) user inputs by
    evaluating oral and/or written user statements and signs
    (e.g. Internet or SMS emoticons such as “:-)”, “:-|”, or “-
    (” typed in on an integrated keyboard 107a of a user's
    smart jacket 101), which reflect perceived sensations of
    said user, mapping (S103) the results of this analysis to
    emotional patterns stored in a read access memory (RAM) and
    using these patterns for activating/deactivating (S104) at
    least one of the available actuators 106a-d that are
    integrated into the piece of clothing 101 for stimulating
    the wearer's energy level, said processing means being
    integrated e.g. into the waist belt of the user's smart
    jacket 101
    106″ battery pack, integrated into the waist belt of the user's
    smart jacket 101
    107 control display, integrated into the left sleeve of the
    user's smart jacket 101
    107a keyboard for inputting user and control information needed
    for controlling said control display 107, integrated into
    the left sleeve of said jacket 101
    107b “JogDial” button, integrated into the left sleeve of said
    jacket 101, which gives a rundown on the user's physical
    performances after a sporting activity
    108 fake pocket, integrated into the upper left front part of
    said user's jacket 101, which includes a digital pocket
    storage
    109 game console platform, driving the haptic interface 103 of
    a wearable computing device 100 integrated into a piece of
    clothing 101 or any other type of wearable accessory
    109′ game console application, running on said game console 109
    U129
    109″ controlling unit of the game console application, used for
    controlling the haptic interface 103 of the wearable
    computing device 100 or a number of different sensors 105,
    105′ and actuators 106a-d placed on or close to said user's
    body
    signs (e.g. Internet or SMS emoticons such as “:-)”, “:-|”,
    or “:-(” typed in on an integrated keyboard 107a of the
    user's smart jacket 101), that reflect perceived sensations
    and/or emotional states of a user wearing said jacket
    written statements and/or spoken utterances reflecting
    tactile sensations and/or emotional states perceived by a
    user wearing said jacket
    biometric signals indicating the physical condition of a
    user's body, detected by different biometric sensors 105
    (e.g. body temperature, blood volume pressure, respiration
    rate and/or pulse rate sensors) integrated into the piece
    of clothing 101 worn by said user
    environmental signals indicating climatic and/or
    meteorological conditions (e.g. temperature, atmospheric
    pressure, relative humidity, and/or wind speed) in the
    environment of said user, detected by different
    meteorological sensors 105′ (e.g. thermometer, barometer,
    hygrometer, and wind speed meter)
    literally, lexically and syntactically analyzed and
    semantically interpreted written statement typed in on an
    integrated keyboard 107a of the piece of clothing 101 or
    phonetically, lexically and syntactically analyzed and
    semantically interpreted spoken utterance of a user wearing
    said jacket 101 (“feeling language statement”), which
    reflects expressed feelings of said user
    vibrations, heat or coolness, pressure and/or electric
    pulses generated by actuators worn on and/or placed near
    the user's body for stimulating the user depending on the
    perceived and analyzed sensations of said user
    300a piece of clothing (e.g. a shirt) comprising a wearable
    display which shows the name or logo of an interactive
    network game or displays the current high-score rank of a
    player participating in said game and/or any other game-
    related information
    300b piece of clothing (e.g. a shirt) comprising a wearable
    display which shows a simulated heavy violation by coloring
    parts of said shirt red
    400a tactile communication scenario according to a first
    embodiment of the present invention (“Shock U”), wherein a
    wearable computing device 100 comprising at least one
    haptic interface or a number of actuators 106a-d placed on
    or close to a user's body, which are used for generating
    different types of stimulation (e.g. heat, pressure,
    vibrational and/or electric pulses), is controlled by the
    controlling unit 109″ of a game console platform 109
    400b tactile communication scenario according to a second
    embodiment of this invention (“Relax U”), wherein a
    wearable computing device 100 - comprising at least one
    haptic interface or a number of sensors 105a-c and
    actuators 106a-d placed on or close to a user's body, that
    are respectively used for sensing tactile input
    information, monitoring his/her physiological, physical
    and/or psychological condition (which especially includes
    physical expressions of affection reflecting said user's
    feelings, emotional states and/or states of mind) and
    generating different types of stimulation (e.g. heat,
    pressure, vibrational and/or electric pulses, etc.) based
    on this input information, physical or mental strain of the
    user - is controlled by the controlling unit 109′ of the
    game console platform 109
    S100 step #100: sensing and monitoring different biometric
    signals (e.g. body temperature, blood volume pressure,
    respiration rate and/or pulse rate) indicating the physical
    condition of a person wearing said jacket 101
    S100′ step #1001: measuring meteorological parameters (e.g.
    temperature, atmospheric pressure, relative humidity and/or
    wind speed) indicating climatic and meteorological
    conditions in the environment of said user
    S101 step #101: extracting features from biometric signal taken
    from a user wearing said jacket 101, which indicates the
    physical condition of said user, and/or measured
    meteorological conditions in the environment of said user
    S102 step #102: analyzing these features
    S102′ step #102′: analyzing user inputs by evaluating oral and/or
    written user statements and signs (e.g. Internet or SMS
    emoticons such as “:-)”, “:-|”, or “:-(” typed in on an
    integrated keyboard 107a of a user's smart jacket 101),
    which reflect perceived sensations of the user
    S103 step #103: translating these signals into a “feeling
    language statement”, that reflects perceived sensations
    and/or emotional states of said user, by mapping results of
    this analysis to a number of emotional patterns (meta
    information) stored in a read access memory (RAM)
    S104 step #104: using these patterns for activating or
    deactivating at least one of the available actuators 106a-d
    integrated into the piece of clothing 101 for stimulating a
    user's energy level
    S104′ step #104′: continuously or intermittently generating
    visual, auditive, tactile, gustatoric and/or olfactoric
    stimuli based on digitally encoded control information
    received from an external controlling unit 109″ via a
    wireless or wired link
    S201 step #201: transmitting meta information from a first
    person wearing a first piece of clothing 101 equipped with
    at least one integrated wearable computing device to a
    second person wearing a second piece of clothing 101′
    equipped with at least one further integrated wearable
    computing device for receiving said meta information,
    evaluating and reproducing feelable signals, tactile
    sensations perceived and/or physical affection expressed by
    said first person
    S202 step #202: receiving meta information representing feelable
    signals, tactile sensations perceived and/or physical
    affection expressed by a first person wearing a first piece
    of clothing 101 equipped with at least one integrated
    wearable computing device
    S202′ step #202′: receiving digitally encoded control information
    received from an external controlling unit 109″ via a
    wireless or wired link
    S202″ step #202″: processing this control information
    S301 step #301: character scan procedure for automatically
    recognizing characters, numbers and/or symbols typed in on
    the integrated keyboard 107a of said smart jacket 101
    S301′ step #301′: phonetic scan procedure for automatically
    recognizing the phonemes in a spoken utterance of a person
    wearing this piece of clothing 101
    S302 step #302: lexical scan procedure for automatically
    recognizing feeling language tokens belonging to a “feeling
    language vocabulary” reflecting perceived sensations and/or
    emotional states of a user wearing said jacket
    S303 step #303: syntax scan procedure for analyzing the
    grammatical structure of a recognized “feeling language
    statement”
    S304 step #304: semantic scan procedure for interpreting expressed
    feelings by performing a semantic analysis of this
    recognized and syntactically analyzed feeling language
    statement
    S401 step #401: searching the read access memory (RAM)
    integrated into the wearable computing device of the first
    piece of clothing 101 worn by said first person, which
    serves as a repository for meta information representing
    feelings, tactile sensations perceived and/or physical
    affection expressed by said first person
    S401′ step #401′: selecting a pattern dependent on an
    interpretation of a tactile sensation perceived or a
    feeling expressed by said first person gained by a literal
    and/or phonetic, lexical, syntactical and semantic analysis
    of a statement typed in on an integrated keyboard 107a of
    said first piece of clothing 101 and/or a spoken utterance
    of said first person wearing this particular piece of
    clothing 101, respectively
    S402 step #402: enriching or updating the UPF pattern
    descriptors 600 of said patterns with additional
    information derived from available context information
    provided by a number of different biometric (105) and/or
    environmental sensors (105′) integrated into the first
    piece of clothing 101 worn by said first person

Claims (19)

1. A system comprising:
a first wearable device including sensors configured to receive biological data from a first user and a channel configured to transmit signals representing the biological data;
a computing device configured to receive the signals and to execute an application software program, the computing device having an interface configured to transmit feedback signals generated by the application software program based on the received signals; and
a second wearable device including a receiver configured to receive the feedback signals from the computing device and an actuator configured to produce physical feedback sensations to a body and/or head of a second user using skin of the second user as an interface.
2. The system according to claim 1, wherein at least one of the first wearable device and the second wearable device is integrated in a piece of garment.
3. The system according to claim 2, wherein a display is integrated into the piece of garment, and the display is configured to react to the feedback signals from the computing device.
4. The system according to claim 1, wherein the second wearable device includes a controller configured to control an array of actuators according to an operational pattern depending on any feedback signal received.
5. The system according to claim 1, wherein the application software is an entertainment or game-type software.
6. The system according to claim 5, wherein the feedback signals are generated depending on a user or application context.
7. The system according to claim 6, wherein the feedback signals are generated depending on at least one of a background scene, defined virtual objects, sounds, colors and a virtual actor generated by a game-type software.
8. The system according to claim 1, wherein the application software is designed to display scenes on the monitor, and different elements of the scenes displayed are respectively associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator.
9. The system according to claim 1, wherein the actuator is configured to produce at least one of vibrational stimuli, tactile stimuli and heat stimuli.
10. The system according to claim 1, wherein the first wearable device and the second wearable device each include means for manually adjusting operational parameters of the actuator.
11. A method for providing physical feedback sensations to a body of a second user of an application software program, the method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
12. The method according to claim 11, wherein an array of actuators is controlled according to an operational pattern depending on any feedback signal.
13. The method according to claim 11, wherein signals representing biological data from the first user are transmitted to the computing device hosting the application software program for further processing.
14. The method according to claim 11, wherein the feedback signals are generated depending on at least one of a background scene, defined virtual objects, sounds, colors and a virtual actor generated by a game-type software.
15. The method according to claim 11, wherein the application software is divided into several logical parts, and each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of an actuator.
16. The method according to claim 11, wherein the at least one of producing vibrational stimuli, tactile stimuli and heat stimuli to a user.
17. A computer readable storage medium in which a program is recorded, said program executing a method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
18. A computer game console in which a program is executed, said program executing a method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
19. A wearable game accessory including a controller in which a method is executed, said method comprising:
receiving biological data of a first user from sensors of a first wearable device;
transmitting signals representing the biological data to an application software program;
receiving the signals in the application software program;
generating feedback signals in the application software program based on the received signals;
transmitting the feedback signals to a second wearable device; and
producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
US12/357,184 2003-11-24 2009-01-21 Physical feedback channel for entertainment or gaming environments Abandoned US20090131165A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/357,184 US20090131165A1 (en) 2003-11-24 2009-01-21 Physical feedback channel for entertainment or gaming environments

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP03026896A EP1533678A1 (en) 2003-11-24 2003-11-24 Physical feedback channel for entertaining or gaming environments
EP03026896.5 2003-11-24
US10/995,001 US20050113167A1 (en) 2003-11-24 2004-11-22 Physical feedback channel for entertainement or gaming environments
US12/357,184 US20090131165A1 (en) 2003-11-24 2009-01-21 Physical feedback channel for entertainment or gaming environments

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/995,001 Continuation US20050113167A1 (en) 2003-11-24 2004-11-22 Physical feedback channel for entertainement or gaming environments

Publications (1)

Publication Number Publication Date
US20090131165A1 true US20090131165A1 (en) 2009-05-21

Family

ID=34429424

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/995,001 Abandoned US20050113167A1 (en) 2003-11-24 2004-11-22 Physical feedback channel for entertainement or gaming environments
US12/357,184 Abandoned US20090131165A1 (en) 2003-11-24 2009-01-21 Physical feedback channel for entertainment or gaming environments

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/995,001 Abandoned US20050113167A1 (en) 2003-11-24 2004-11-22 Physical feedback channel for entertainement or gaming environments

Country Status (2)

Country Link
US (2) US20050113167A1 (en)
EP (1) EP1533678A1 (en)

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070063849A1 (en) * 2005-09-02 2007-03-22 Francesca Rosella Wearable haptic telecommunication device and system
US20100152620A1 (en) * 2008-12-12 2010-06-17 Immersion Corporation Method and Apparatus for Providing A Haptic Monitoring System Using Multiple Sensors
US20100315228A1 (en) * 2009-06-16 2010-12-16 Honeywell International Inc. Wearable data hub for first responders
US20110134063A1 (en) * 2008-08-29 2011-06-09 Shin Norieda Information input device, information input method, and information input program
US20110193703A1 (en) * 2010-02-08 2011-08-11 Adriana Payton Wearable fluid-sensitive hygiene compliance device
US20110212756A1 (en) * 2010-02-27 2011-09-01 Thuuz, LLC Method and system for an online performance service with recommendation module
US20120078393A1 (en) * 2009-09-30 2012-03-29 Miral Kotb Self-contained, wearable light controller with wireless communication interface
US20120086550A1 (en) * 2009-02-24 2012-04-12 Leblanc Donald Joseph Pedobarographic biometric system
US20120242478A1 (en) * 2009-12-16 2012-09-27 Weng Onn Chen Digital electronic second identity for vehicle
US20120258800A1 (en) * 2011-04-11 2012-10-11 Sony Computer Entertainment Inc. Temperature feedback motion controller
US20130073305A1 (en) * 2001-09-15 2013-03-21 Stmicroelectronics S.R.L. Multimedia tagging system and method, related computer program product
US20130222139A1 (en) * 2011-08-24 2013-08-29 Safetyminded Holdings, Inc. Human safety indicator
US20130226580A1 (en) * 2012-02-29 2013-08-29 Fluential, Llc Spoken control for user construction of complex behaviors
US20130328783A1 (en) * 2011-06-30 2013-12-12 Sheridan Martin Transmission of information to smart fabric ouput device
US20130331157A1 (en) * 2009-01-06 2013-12-12 Immersion Corporation Programmable game-based haptic enabled gun controller
US8624836B1 (en) * 2008-10-24 2014-01-07 Google Inc. Gesture-based small device input
US20140043228A1 (en) * 2010-03-31 2014-02-13 Immersion Corporation System and method for providing haptic stimulus based on position
US20140114445A1 (en) * 2011-06-16 2014-04-24 Fondazione Istituto Italiano Di Tecnologia Interface system for man-machine interaction
US20150164322A1 (en) * 2009-09-01 2015-06-18 Adidas Ag Multi modal method and system for transmitting information about a subject
US20150206322A1 (en) * 2014-01-23 2015-07-23 Kiomars Anvari Fast image sensor for body protection gear or equipment
US20150277563A1 (en) * 2014-03-28 2015-10-01 Wen-Ling M. Huang Dynamic tactile user interface
US20150289034A1 (en) * 2014-04-08 2015-10-08 Matthew A.F. Engman Event entertainment system
US20150324181A1 (en) * 2013-05-08 2015-11-12 Natalya Segal Smart wearable devices and system therefor
US20150332659A1 (en) * 2014-05-16 2015-11-19 Not Impossible LLC Sound vest
US20160027338A1 (en) * 2014-05-16 2016-01-28 Not Impossible LLC Wearable sound
WO2016033512A1 (en) * 2014-08-28 2016-03-03 Georgia Tech Research Corporation Physical interactions through information infrastructures integrated in fabrics and garments
US20160278444A1 (en) * 2015-03-24 2016-09-29 Intel Corporation Smart clothing
TWI562811B (en) * 2015-11-09 2016-12-21 Univ Nan Kai Technology Intelligent starting system of interactive game and method thereof
WO2017010697A1 (en) * 2015-07-11 2017-01-19 홍선기 Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same
WO2017091141A1 (en) * 2015-11-24 2017-06-01 Razer (Asia-Pacific) Pte. Ltd. Wearable devices, methods for controlling a wearable device, and computer-readable media
US9727139B2 (en) 2008-12-12 2017-08-08 Immersion Corporation Method and apparatus for providing a haptic monitoring system using multiple sensors
US10052029B2 (en) * 2014-09-11 2018-08-21 General Electric Company Infant patient transfer device with temperature sensor
US10105594B2 (en) * 2016-06-17 2018-10-23 Disney Enterprises, Inc. Wearable garments recognition and integration with an interactive gaming system
US10157487B2 (en) 2015-07-30 2018-12-18 International Business Machines Corporation VR biometric integration
US20180364807A1 (en) * 2014-06-05 2018-12-20 Immersion Corporation Systems and Methods for Induced Electrostatic Haptic Effects
CN109710058A (en) * 2018-11-27 2019-05-03 南京恩诺网络科技有限公司 Tactile data recording method and device, system
US20190201779A1 (en) * 2017-12-28 2019-07-04 Keith Vargo App integrated wearable gaming board design
CN110199243A (en) * 2016-10-31 2019-09-03 泰格韦有限公司 For providing feedback device, the content playback unit, system and method for heat experience
US20190317605A1 (en) * 2016-11-23 2019-10-17 Google Llc Providing Mediated Social Interactions
US10467926B2 (en) * 2013-10-07 2019-11-05 Mc10, Inc. Conformal sensor systems for sensing and analysis
US10564730B2 (en) * 2014-05-19 2020-02-18 Immersion Corporation Non-collocated haptic cues in immersive environments
US10569167B1 (en) 2018-08-22 2020-02-25 Abdul Hotaki System and methods for providing wireless feedback to a video game
US10616534B2 (en) * 2014-10-16 2020-04-07 Lat Enterprises, Inc. Personal tactical system and network
US10761608B2 (en) 2013-07-15 2020-09-01 Vr Electronics Limited Method and wearable apparatus for synchronizing a user with a virtual environment
CN112156448A (en) * 2020-11-05 2021-01-01 王照斌 Mutual wearing equipment is felt to artificial intelligence body
US10937284B2 (en) 2017-01-23 2021-03-02 Hewlett-Packard Development Company, L.P. Somatosensory feedback system
US10944140B2 (en) 2014-01-15 2021-03-09 Lat Enterprises, Inc. Wearable and replaceable pouch or skin for holding a portable battery pack
US10964179B2 (en) 2014-05-16 2021-03-30 Not Impossible, Llc Vibrotactile control systems and methods
US11049380B2 (en) * 2015-01-13 2021-06-29 Robert Kaindl Personal safety device, method and article
US11118819B2 (en) 2016-10-31 2021-09-14 Tegway Co., Ltd. Feedback device and thermal feedback providing method using same
US11191491B2 (en) * 2016-10-31 2021-12-07 Tegway Co., Ltd. Feedback device and method for providing thermal feedback using the same
US11207032B2 (en) 2016-10-31 2021-12-28 Tegway Co., Ltd. Feedback device and method for providing thermal feedback using the same
US11315396B2 (en) 2018-01-08 2022-04-26 Robert Kaindl Threat identification device and system with optional active countermeasures
US11403264B2 (en) * 2014-09-12 2022-08-02 Verily Life Sciences Llc Long-term data storage service for wearable device data
US11416120B2 (en) * 2009-07-08 2022-08-16 Steelseries Aps Apparatus and method for managing operations of accessories
US11450429B2 (en) 2015-07-11 2022-09-20 Sun Ki Hong Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same
US20220343740A1 (en) * 2019-09-26 2022-10-27 Nippon Telegraph And Telephone Corporation Vibration presentation apparatus
US11701585B2 (en) 2013-03-15 2023-07-18 Steelseries Aps Gaming device with independent gesture-sensitive areas
US11759389B2 (en) * 2013-12-31 2023-09-19 Iftech Inventing Future Technology, Inc. Wearable devices, systems, methods and architectures for sensory stimulation and manipulation and physiological data acquisition
US11876354B2 (en) 2014-01-15 2024-01-16 Lat Enterprises, Inc. Wearable and replaceable pouch or skin for holding a portable battery pack
US11876161B2 (en) 2014-10-16 2024-01-16 Lat Enterprises, Inc. Material for dissipating heat from and/or reducing heat signature of electronic devices and clothing
US11876241B2 (en) 2014-01-15 2024-01-16 Lat Enterprises, Inc. System for supplying power to a portable battery using at least one solar panel
US11955825B2 (en) 2014-10-16 2024-04-09 Lat Enterprises, Inc. Portable power case with lithium iron phosphate battery

Families Citing this family (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7046151B2 (en) * 2003-07-14 2006-05-16 Michael J. Dundon Interactive body suit and interactive limb covers
CN101039641B (en) 2004-10-11 2010-06-09 康复宝科技有限公司 Electro active compression bandage
US8123624B2 (en) * 2005-03-03 2012-02-28 Theodore Weissenburger Caldwell Shot Monitoring Watch
US8139803B2 (en) 2005-08-15 2012-03-20 Immerz, Inc. Systems and methods for haptic sound
US20070050880A1 (en) * 2005-08-17 2007-03-08 Edoc Apparel Llc System and method for interpretive garments
ES2303744B1 (en) * 2005-08-31 2009-07-23 David Nieto Hernandez PHYSICAL SENSATIONS TRANSMISSION SYSTEM.
US20100201512A1 (en) 2006-01-09 2010-08-12 Harold Dan Stirling Apparatus, systems, and methods for evaluating body movements
DK1981459T3 (en) 2006-01-13 2011-11-28 Convatec Technologies Inc Device and system for chromic treatment of body part
EP1993437A4 (en) * 2006-02-24 2014-05-14 Hmicro Inc A medical signal processing system with distributed wireless sensors
TWI434718B (en) * 2006-12-07 2014-04-21 Cel Kom Llc Tactile wearable gaming device
US8157730B2 (en) * 2006-12-19 2012-04-17 Valencell, Inc. Physiological and environmental monitoring systems and methods
US8652040B2 (en) 2006-12-19 2014-02-18 Valencell, Inc. Telemetric apparatus for health and environmental monitoring
CA2618942A1 (en) * 2007-01-24 2008-07-24 Splitfish Gameware Inc. Game controller with tactile feedback
AU2007345046A1 (en) 2007-01-24 2008-07-31 Convatec Technologies Inc. An elastomeric particle having an electrically conducting surface, a pressure sensor comprising said particles, a method for producing said sensor and a sensor system comprising sais sensors
US20090233710A1 (en) * 2007-03-12 2009-09-17 Roberts Thomas J Feedback gaming peripheral
US8033916B2 (en) * 2007-05-04 2011-10-11 Theodore Caldwell Grip pressure sensor
US9046919B2 (en) * 2007-08-20 2015-06-02 Hmicro, Inc. Wearable user interface device, system, and method of use
US8926509B2 (en) * 2007-08-24 2015-01-06 Hmicro, Inc. Wireless physiological sensor patches and systems
US8611319B2 (en) * 2007-10-24 2013-12-17 Hmicro, Inc. Methods and apparatus to retrofit wired healthcare and fitness systems for wireless operation
WO2009055423A1 (en) * 2007-10-24 2009-04-30 Hmicro, Inc. Low power radiofrequency (rf) communication systems for secure wireless patch initialization and methods of use
US8251903B2 (en) 2007-10-25 2012-08-28 Valencell, Inc. Noninvasive physiological analysis using excitation-sensor modules and related devices and methods
US20090150158A1 (en) * 2007-12-06 2009-06-11 Becker Craig H Portable Networked Picting Device
US20090156308A1 (en) * 2007-12-17 2009-06-18 Hsu Kent T J Foot-actuated mat with flashing indicators for video game console
US8250454B2 (en) * 2008-04-03 2012-08-21 Microsoft Corporation Client-side composing/weighting of ads
US20090251407A1 (en) * 2008-04-03 2009-10-08 Microsoft Corporation Device interaction with combination of rings
US20090289937A1 (en) * 2008-05-22 2009-11-26 Microsoft Corporation Multi-scale navigational visualtization
US8682736B2 (en) 2008-06-24 2014-03-25 Microsoft Corporation Collection represents combined intent
US8380561B1 (en) * 2008-07-30 2013-02-19 Immersion Corporation Method and apparatus for scoring haptic devices
IT1394880B1 (en) * 2009-01-05 2012-07-20 Fond Istituto Italiano Di Tecnologia WEARABLE DEVICE AND ITS RELATED SYSTEM FOR DETECTION AND GUIDANCE OF THE MOVEMENTS OF A USER.
US8376858B2 (en) * 2009-02-20 2013-02-19 Sony Computer Entertainment America Llc System and method for communicating game information between a portable gaming device and a game controller
US9750462B2 (en) 2009-02-25 2017-09-05 Valencell, Inc. Monitoring apparatus and methods for measuring physiological and/or environmental conditions
US8788002B2 (en) 2009-02-25 2014-07-22 Valencell, Inc. Light-guiding devices and monitoring devices incorporating same
US8700111B2 (en) 2009-02-25 2014-04-15 Valencell, Inc. Light-guiding devices and monitoring devices incorporating same
US20100240458A1 (en) * 2009-03-20 2010-09-23 Pub Company S.R.L. Video game hardware systems and software methods using electroencephalogrophy
EP2419808B1 (en) 2009-04-15 2015-06-10 Koninklijke Philips N.V. A foldable tactile display
WO2012007860A1 (en) * 2010-07-16 2012-01-19 Koninklijke Philips Electronics N.V. Device including a multi-actuator haptic surface for providing haptic effects on said surface.
PT105469A (en) * 2011-01-04 2012-11-19 Marta Isabel Santos Paiva Ferraz Da Conceicao INTERACTIVE FACT FOR VIDEO GAMES IN WHICH ELECTRONIC SENSORS AND PHYSICAL OBJECTS ARE USED
US8888701B2 (en) 2011-01-27 2014-11-18 Valencell, Inc. Apparatus and methods for monitoring physiological data during environmental interference
ES1074734Y (en) * 2011-04-13 2011-09-27 Casado Miguel Angel Roncero DRESS WITH SENSORY AND / OR MECHANICAL EFFECTS
WO2013016007A2 (en) 2011-07-25 2013-01-31 Valencell, Inc. Apparatus and methods for estimating time-state physiological parameters
EP3222210A1 (en) 2011-08-02 2017-09-27 Valencell, Inc. Systems and methods for variable filter adjustment by heart rate metric feedback
US20140049487A1 (en) * 2012-08-17 2014-02-20 Qualcomm Incorporated Interactive user interface for clothing displays
US10856749B2 (en) 2013-01-28 2020-12-08 Valencell, Inc. Physiological monitoring devices having sensing elements decoupled from body motion
CN104994919B (en) * 2013-02-07 2017-11-21 马卡里 Special-shaped attachment and system in a kind of game for laser gunfight
US9486272B2 (en) 2013-03-12 2016-11-08 Biosense Webster (Israel) Ltd. Force feedback device and method for catheters
US9443401B2 (en) * 2013-09-06 2016-09-13 Immersion Corporation Automatic remote sensing and haptic conversion system
US20150105129A1 (en) * 2013-10-15 2015-04-16 Kevin Chapman Video Game Body Suit
FR3013443B1 (en) * 2013-11-15 2016-04-29 Michelin Travel Partner METHOD AND SYSTEM FOR SENSITIVE NAVIGATION
AU2014100006A4 (en) 2014-01-03 2014-02-13 Wearable Experiments Pty Ltd Fan Garment
EP3757718B1 (en) * 2014-05-15 2022-03-30 Federal Express Corporation Wearable devices for courier processing and methods of use thereof
US20160029898A1 (en) 2014-07-30 2016-02-04 Valencell, Inc. Physiological Monitoring Devices and Methods Using Optical Sensors
US10536768B2 (en) 2014-08-06 2020-01-14 Valencell, Inc. Optical physiological sensor modules with reduced signal noise
US9799177B2 (en) 2014-09-23 2017-10-24 Intel Corporation Apparatus and methods for haptic covert communication
US9794653B2 (en) 2014-09-27 2017-10-17 Valencell, Inc. Methods and apparatus for improving signal quality in wearable biometric monitoring devices
DE102014015103A1 (en) * 2014-10-10 2016-04-14 Marc Ebel Device for head mounted displays
US9627804B2 (en) 2014-12-19 2017-04-18 Intel Corporation Snap button fastener providing electrical connection
US9958903B2 (en) * 2015-04-29 2018-05-01 Sony Mobile Communications Inc. Providing a representation of orientation and movement of an item being moved in space
US20170055596A1 (en) * 2015-08-28 2017-03-02 Raquel Smith Colby Smart Clothing for Simulated Touch and Concussive Force
EP4079383A3 (en) * 2015-10-01 2023-02-22 Medidata Solutions, Inc. Method and system for interacting with a virtual environment
US10945618B2 (en) 2015-10-23 2021-03-16 Valencell, Inc. Physiological monitoring devices and methods for noise reduction in physiological signals based on subject activity type
WO2017070463A1 (en) 2015-10-23 2017-04-27 Valencell, Inc. Physiological monitoring devices and methods that identify subject activity type
US10055948B2 (en) 2015-11-30 2018-08-21 Nike, Inc. Apparel with ultrasonic position sensing and haptic feedback for activities
CN105536249B (en) * 2016-02-18 2023-09-01 高创(苏州)电子有限公司 game system
JP2017182495A (en) * 2016-03-30 2017-10-05 ソニー株式会社 Information processing device, information processing method and program
DE202016003692U1 (en) * 2016-06-10 2017-09-12 Kuka Roboter Gmbh Haptic feedback devices for a manipulator system
WO2018009736A1 (en) 2016-07-08 2018-01-11 Valencell, Inc. Motion-dependent averaging for physiological metric estimating systems and methods
US10699538B2 (en) * 2016-07-27 2020-06-30 Neosensory, Inc. Method and system for determining and providing sensory experiences
US10198076B2 (en) 2016-09-06 2019-02-05 Neosensory, Inc. Method and system for providing adjunct sensory information to a user
WO2018047102A1 (en) * 2016-09-09 2018-03-15 Ecole Polytechnique Federale De Lausanne (Epfl) Jacket for embodied interaction with virtual or distal robotic device
EP3573525B1 (en) * 2017-01-27 2023-06-07 Northwestern University Epidermal virtual reality devices
US10181331B2 (en) 2017-02-16 2019-01-15 Neosensory, Inc. Method and system for transforming language inputs into haptic outputs
US10744058B2 (en) * 2017-04-20 2020-08-18 Neosensory, Inc. Method and system for providing information to a user
CN107219919A (en) * 2017-05-10 2017-09-29 北京小鸟看看科技有限公司 A kind of virtual reality body-sensing method and system, wear display device and wearable device
CN109985378A (en) * 2017-12-30 2019-07-09 广州大正新材料科技有限公司 A kind of game effect expression based on body-sensing clothes
US10627896B1 (en) * 2018-10-04 2020-04-21 International Business Machines Coporation Virtual reality device
US10437340B1 (en) 2019-01-29 2019-10-08 Sean Sullivan Device for providing thermoreceptive haptic feedback
US11467667B2 (en) 2019-09-25 2022-10-11 Neosensory, Inc. System and method for haptic stimulation
AT17923U1 (en) * 2019-10-15 2023-08-15 Katerina Sedlackova Ma garment
US11467668B2 (en) 2019-10-21 2022-10-11 Neosensory, Inc. System and method for representing virtual object information with haptic stimulation
LT3711829T (en) * 2019-11-04 2022-04-11 Boreal Technology & Investment S.L Wearable gaming device and method thereof
US11079854B2 (en) 2020-01-07 2021-08-03 Neosensory, Inc. Method and system for haptic stimulation
CN111383313B (en) * 2020-03-31 2023-05-12 歌尔股份有限公司 Virtual model rendering method, device, equipment and readable storage medium
US11925433B2 (en) * 2020-07-17 2024-03-12 Daniel Hertz S.A. System and method for improving and adjusting PMC digital signals to provide health benefits to listeners
US11497675B2 (en) 2020-10-23 2022-11-15 Neosensory, Inc. Method and system for multimodal stimulation
US11862147B2 (en) 2021-08-13 2024-01-02 Neosensory, Inc. Method and system for enhancing the intelligibility of information for a user
US20230062315A1 (en) * 2021-08-30 2023-03-02 Msg Entertainment Group, Llc Live venue performance sensor capture and visualization over game network
CN114176534A (en) * 2021-11-25 2022-03-15 爱其服(杭州)科技有限公司 Intelligent wearing system for metacarpal space
KR20230123219A (en) * 2022-02-16 2023-08-23 한국전자통신연구원 System and method for reproducing tactile content using spatial information
CN116909392B (en) * 2023-06-30 2024-01-26 青岛登云智上科技有限公司 Wearable and perceivable interaction system and interaction method
CN117180720B (en) * 2023-11-07 2024-01-05 成都孚谦科技有限公司 Virtual action game interaction system and method based on somatosensory tracker technology

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5565840A (en) * 1994-09-21 1996-10-15 Thorner; Craig Tactile sensation generator
US5588139A (en) * 1990-06-07 1996-12-24 Vpl Research, Inc. Method and system for generating objects for a multi-person virtual world using data flow networks
US6135450A (en) * 1998-02-09 2000-10-24 Huang; Cheng-Pin Wearable vibration device for video games
US20010040590A1 (en) * 1998-12-18 2001-11-15 Abbott Kenneth H. Thematic response to a computer user's context, such as by a wearable personal computer
US6422941B1 (en) * 1994-09-21 2002-07-23 Craig Thorner Universal tactile feedback system for computer video games and simulations
US6563487B2 (en) * 1998-06-23 2003-05-13 Immersion Corporation Haptic feedback for directional control pads
US20030125110A1 (en) * 2001-12-27 2003-07-03 Lalley Timothy J. Games utilizing electronic display strips and methods of making display strips
US6695770B1 (en) * 1999-04-01 2004-02-24 Dominic Kin Leung Choy Simulated human interaction systems
US6786863B2 (en) * 2001-06-07 2004-09-07 Dadt Holdings, Llc Method and apparatus for remote physical contact
US20040229702A1 (en) * 1999-05-21 2004-11-18 Cooke Michael Charles Feedback assembly for computer games
US7046151B2 (en) * 2003-07-14 2006-05-16 Michael J. Dundon Interactive body suit and interactive limb covers

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0468340A3 (en) * 1990-07-24 1992-12-16 Biocontrol Systems, Inc. Eye directed controller
NL1004195C1 (en) * 1996-10-04 1998-04-07 Christine Karman System for transmitting touch sensation via a computer network.
US6522417B1 (en) * 1997-04-28 2003-02-18 Matsushita Electric Industrial Co., Ltd. Communication terminal device that processes received images and transmits physical quantities that affect the receiving communication terminal device
FR2786899B1 (en) * 1998-12-03 2006-09-29 Jean Bonnard MOVEMENT INDICATOR FOR SOFTWARE
DE60138894D1 (en) * 2000-04-02 2009-07-16 Tangis Corp THEMATIC RESPONSE TO THE CONTEXT OF A COMPUTER USER, SUCH AS A CONNECTION WITH A PERSONAL COMPUTER PORTABLE ON A BODY
FR2819371B1 (en) * 2001-01-10 2004-04-02 Medialux COMPUTER OR TELEPHONE INTEGRATED IN A GARMENT

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5588139A (en) * 1990-06-07 1996-12-24 Vpl Research, Inc. Method and system for generating objects for a multi-person virtual world using data flow networks
US5565840A (en) * 1994-09-21 1996-10-15 Thorner; Craig Tactile sensation generator
US6422941B1 (en) * 1994-09-21 2002-07-23 Craig Thorner Universal tactile feedback system for computer video games and simulations
US6135450A (en) * 1998-02-09 2000-10-24 Huang; Cheng-Pin Wearable vibration device for video games
US6563487B2 (en) * 1998-06-23 2003-05-13 Immersion Corporation Haptic feedback for directional control pads
US20010040590A1 (en) * 1998-12-18 2001-11-15 Abbott Kenneth H. Thematic response to a computer user's context, such as by a wearable personal computer
US6695770B1 (en) * 1999-04-01 2004-02-24 Dominic Kin Leung Choy Simulated human interaction systems
US20040229702A1 (en) * 1999-05-21 2004-11-18 Cooke Michael Charles Feedback assembly for computer games
US6786863B2 (en) * 2001-06-07 2004-09-07 Dadt Holdings, Llc Method and apparatus for remote physical contact
US20030125110A1 (en) * 2001-12-27 2003-07-03 Lalley Timothy J. Games utilizing electronic display strips and methods of making display strips
US7046151B2 (en) * 2003-07-14 2006-05-16 Michael J. Dundon Interactive body suit and interactive limb covers

Cited By (100)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130073305A1 (en) * 2001-09-15 2013-03-21 Stmicroelectronics S.R.L. Multimedia tagging system and method, related computer program product
US20070063849A1 (en) * 2005-09-02 2007-03-22 Francesca Rosella Wearable haptic telecommunication device and system
US10185356B2 (en) * 2008-08-29 2019-01-22 Nec Corporation Information input device, information input method, and information input program
US20110134063A1 (en) * 2008-08-29 2011-06-09 Shin Norieda Information input device, information input method, and information input program
US8624836B1 (en) * 2008-10-24 2014-01-07 Google Inc. Gesture-based small device input
US9292097B1 (en) 2008-10-24 2016-03-22 Google Inc. Gesture-based small device input
US11307718B2 (en) 2008-10-24 2022-04-19 Google Llc Gesture-based small device input
US10139915B1 (en) 2008-10-24 2018-11-27 Google Llc Gesture-based small device input
US10852837B2 (en) 2008-10-24 2020-12-01 Google Llc Gesture-based small device input
US9727139B2 (en) 2008-12-12 2017-08-08 Immersion Corporation Method and apparatus for providing a haptic monitoring system using multiple sensors
US20100152620A1 (en) * 2008-12-12 2010-06-17 Immersion Corporation Method and Apparatus for Providing A Haptic Monitoring System Using Multiple Sensors
US20180233226A1 (en) * 2008-12-12 2018-08-16 Immersion Corporation Method and apparatus for providing a haptic monitoring system using multiple sensors
US20130331157A1 (en) * 2009-01-06 2013-12-12 Immersion Corporation Programmable game-based haptic enabled gun controller
US9504914B2 (en) * 2009-01-06 2016-11-29 Immersion Corporation Programmable game-based haptic enabled gun controller
US20120086550A1 (en) * 2009-02-24 2012-04-12 Leblanc Donald Joseph Pedobarographic biometric system
US20100315228A1 (en) * 2009-06-16 2010-12-16 Honeywell International Inc. Wearable data hub for first responders
US11416120B2 (en) * 2009-07-08 2022-08-16 Steelseries Aps Apparatus and method for managing operations of accessories
US11709582B2 (en) 2009-07-08 2023-07-25 Steelseries Aps Apparatus and method for managing operations of accessories
US20150164322A1 (en) * 2009-09-01 2015-06-18 Adidas Ag Multi modal method and system for transmitting information about a subject
US9826903B2 (en) * 2009-09-01 2017-11-28 Adidas Ag Multi modal method and system for transmitting information about a subject
US8892220B2 (en) * 2009-09-30 2014-11-18 Iluminate Llc Self-contained, wearable light controller with wireless communication interface
US20120078393A1 (en) * 2009-09-30 2012-03-29 Miral Kotb Self-contained, wearable light controller with wireless communication interface
US20120242478A1 (en) * 2009-12-16 2012-09-27 Weng Onn Chen Digital electronic second identity for vehicle
US20110193703A1 (en) * 2010-02-08 2011-08-11 Adriana Payton Wearable fluid-sensitive hygiene compliance device
US20130337920A1 (en) * 2010-02-27 2013-12-19 Thuuz, LLC Method and system for an online performance service with recommendation module
US20110212756A1 (en) * 2010-02-27 2011-09-01 Thuuz, LLC Method and system for an online performance service with recommendation module
US8535131B2 (en) * 2010-02-27 2013-09-17 Thuuz, LLC Method and system for an online performance service with recommendation module
US9050537B2 (en) * 2010-02-27 2015-06-09 Thuuz, Inc. Method and system for an online performance service with recommendation module
US20140043228A1 (en) * 2010-03-31 2014-02-13 Immersion Corporation System and method for providing haptic stimulus based on position
US9987555B2 (en) * 2010-03-31 2018-06-05 Immersion Corporation System and method for providing haptic stimulus based on position
US8550905B2 (en) * 2011-04-11 2013-10-08 Sony Computer Entertainment Inc. Temperature feedback motion controller
US20120258800A1 (en) * 2011-04-11 2012-10-11 Sony Computer Entertainment Inc. Temperature feedback motion controller
US20140114445A1 (en) * 2011-06-16 2014-04-24 Fondazione Istituto Italiano Di Tecnologia Interface system for man-machine interaction
US20130328783A1 (en) * 2011-06-30 2013-12-12 Sheridan Martin Transmission of information to smart fabric ouput device
US20130222139A1 (en) * 2011-08-24 2013-08-29 Safetyminded Holdings, Inc. Human safety indicator
US9501918B2 (en) 2011-08-24 2016-11-22 Safetyminded Holdings, Inc. Human safety indicator
US9183719B2 (en) * 2011-08-24 2015-11-10 Safetyminded Holdings, Inc. Human safety indicator
US9324327B2 (en) 2012-02-29 2016-04-26 Nant Holdings Ip, Llc Spoken control for user construction of complex behaviors
US20130226580A1 (en) * 2012-02-29 2013-08-29 Fluential, Llc Spoken control for user construction of complex behaviors
US9026441B2 (en) * 2012-02-29 2015-05-05 Nant Holdings Ip, Llc Spoken control for user construction of complex behaviors
US11701585B2 (en) 2013-03-15 2023-07-18 Steelseries Aps Gaming device with independent gesture-sensitive areas
US10225721B2 (en) * 2013-05-08 2019-03-05 Natalya Segal Smart wearable devices and system therefor
US9955286B2 (en) * 2013-05-08 2018-04-24 Natalya Segal Smart wearable devices and system therefor
US20150324181A1 (en) * 2013-05-08 2015-11-12 Natalya Segal Smart wearable devices and system therefor
US11209906B2 (en) 2013-07-15 2021-12-28 Vr Electronics Limited Method and wearable apparatus for synchronizing a user with a virtual environment
US10761608B2 (en) 2013-07-15 2020-09-01 Vr Electronics Limited Method and wearable apparatus for synchronizing a user with a virtual environment
US10467926B2 (en) * 2013-10-07 2019-11-05 Mc10, Inc. Conformal sensor systems for sensing and analysis
US11759389B2 (en) * 2013-12-31 2023-09-19 Iftech Inventing Future Technology, Inc. Wearable devices, systems, methods and architectures for sensory stimulation and manipulation and physiological data acquisition
US11876241B2 (en) 2014-01-15 2024-01-16 Lat Enterprises, Inc. System for supplying power to a portable battery using at least one solar panel
US11955779B2 (en) 2014-01-15 2024-04-09 Lat Enterprises, Inc. Portable battery pack
US10944140B2 (en) 2014-01-15 2021-03-09 Lat Enterprises, Inc. Wearable and replaceable pouch or skin for holding a portable battery pack
US11876354B2 (en) 2014-01-15 2024-01-16 Lat Enterprises, Inc. Wearable and replaceable pouch or skin for holding a portable battery pack
US20150206322A1 (en) * 2014-01-23 2015-07-23 Kiomars Anvari Fast image sensor for body protection gear or equipment
US9444988B2 (en) * 2014-01-23 2016-09-13 Kiomars Anvari Fast image sensor for body protection gear or equipment
US20150277563A1 (en) * 2014-03-28 2015-10-01 Wen-Ling M. Huang Dynamic tactile user interface
US20150289034A1 (en) * 2014-04-08 2015-10-08 Matthew A.F. Engman Event entertainment system
US10412470B2 (en) * 2014-04-08 2019-09-10 Matthew A. F. Engman Event entertainment system
US9679546B2 (en) * 2014-05-16 2017-06-13 Not Impossible LLC Sound vest
US20150332659A1 (en) * 2014-05-16 2015-11-19 Not Impossible LLC Sound vest
US9786201B2 (en) * 2014-05-16 2017-10-10 Not Impossible LLC Wearable sound
US11625994B2 (en) 2014-05-16 2023-04-11 Not Impossible, Llc Vibrotactile control systems and methods
US10964179B2 (en) 2014-05-16 2021-03-30 Not Impossible, Llc Vibrotactile control systems and methods
US20160027338A1 (en) * 2014-05-16 2016-01-28 Not Impossible LLC Wearable sound
US10564730B2 (en) * 2014-05-19 2020-02-18 Immersion Corporation Non-collocated haptic cues in immersive environments
US20180364807A1 (en) * 2014-06-05 2018-12-20 Immersion Corporation Systems and Methods for Induced Electrostatic Haptic Effects
WO2016033512A1 (en) * 2014-08-28 2016-03-03 Georgia Tech Research Corporation Physical interactions through information infrastructures integrated in fabrics and garments
US10052029B2 (en) * 2014-09-11 2018-08-21 General Electric Company Infant patient transfer device with temperature sensor
US11403264B2 (en) * 2014-09-12 2022-08-02 Verily Life Sciences Llc Long-term data storage service for wearable device data
US11955825B2 (en) 2014-10-16 2024-04-09 Lat Enterprises, Inc. Portable power case with lithium iron phosphate battery
US11800067B2 (en) 2014-10-16 2023-10-24 Lat Enterprises, Inc. Personal tactical system including a power distribution and data hub and network of personal tactical systems
US10616534B2 (en) * 2014-10-16 2020-04-07 Lat Enterprises, Inc. Personal tactical system and network
US10951865B2 (en) 2014-10-16 2021-03-16 Lat Enterprises, Inc. Personal tactical system including a power distribution and data hub and network of personal tactical systems
US11876161B2 (en) 2014-10-16 2024-01-16 Lat Enterprises, Inc. Material for dissipating heat from and/or reducing heat signature of electronic devices and clothing
US11049380B2 (en) * 2015-01-13 2021-06-29 Robert Kaindl Personal safety device, method and article
US20160278444A1 (en) * 2015-03-24 2016-09-29 Intel Corporation Smart clothing
WO2017010697A1 (en) * 2015-07-11 2017-01-19 홍선기 Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same
US11450429B2 (en) 2015-07-11 2022-09-20 Sun Ki Hong Athlete management apparatus for managing state of athlete in conjunction with protector worn by athlete, athlete management system, and athlete management method using same
US10157487B2 (en) 2015-07-30 2018-12-18 International Business Machines Corporation VR biometric integration
TWI562811B (en) * 2015-11-09 2016-12-21 Univ Nan Kai Technology Intelligent starting system of interactive game and method thereof
US10786731B2 (en) * 2015-11-24 2020-09-29 Razer (Asia-Pacific) Pte. Ltd. Wearable devices, methods for controlling a wearable device, and computer-readable media
WO2017091141A1 (en) * 2015-11-24 2017-06-01 Razer (Asia-Pacific) Pte. Ltd. Wearable devices, methods for controlling a wearable device, and computer-readable media
US10105594B2 (en) * 2016-06-17 2018-10-23 Disney Enterprises, Inc. Wearable garments recognition and integration with an interactive gaming system
US11118819B2 (en) 2016-10-31 2021-09-14 Tegway Co., Ltd. Feedback device and thermal feedback providing method using same
US11747056B2 (en) 2016-10-31 2023-09-05 Tegway Co., Ltd. Feedback device and thermal feedback providing method using same
US11191491B2 (en) * 2016-10-31 2021-12-07 Tegway Co., Ltd. Feedback device and method for providing thermal feedback using the same
US11813089B2 (en) 2016-10-31 2023-11-14 Tegway Co., Ltd. Feedback device and method for providing thermal feedback using the same
US11207032B2 (en) 2016-10-31 2021-12-28 Tegway Co., Ltd. Feedback device and method for providing thermal feedback using the same
US11612358B2 (en) 2016-10-31 2023-03-28 Tegway Co., Ltd. Feedback device and method for providing thermal feedback using the same
CN110199243A (en) * 2016-10-31 2019-09-03 泰格韦有限公司 For providing feedback device, the content playback unit, system and method for heat experience
US11402915B2 (en) * 2016-11-23 2022-08-02 Google Llc Providing mediated social interactions
US20190317605A1 (en) * 2016-11-23 2019-10-17 Google Llc Providing Mediated Social Interactions
US10884502B2 (en) * 2016-11-23 2021-01-05 Google Llc Providing mediated social interactions
US10937284B2 (en) 2017-01-23 2021-03-02 Hewlett-Packard Development Company, L.P. Somatosensory feedback system
US20190201779A1 (en) * 2017-12-28 2019-07-04 Keith Vargo App integrated wearable gaming board design
US11315396B2 (en) 2018-01-08 2022-04-26 Robert Kaindl Threat identification device and system with optional active countermeasures
US11351451B2 (en) 2018-08-22 2022-06-07 Abdul Hotaki System and methods for providing wireless feedback to a video game
US10569167B1 (en) 2018-08-22 2020-02-25 Abdul Hotaki System and methods for providing wireless feedback to a video game
CN109710058A (en) * 2018-11-27 2019-05-03 南京恩诺网络科技有限公司 Tactile data recording method and device, system
US20220343740A1 (en) * 2019-09-26 2022-10-27 Nippon Telegraph And Telephone Corporation Vibration presentation apparatus
CN112156448A (en) * 2020-11-05 2021-01-01 王照斌 Mutual wearing equipment is felt to artificial intelligence body

Also Published As

Publication number Publication date
US20050113167A1 (en) 2005-05-26
EP1533678A1 (en) 2005-05-25

Similar Documents

Publication Publication Date Title
US20090131165A1 (en) Physical feedback channel for entertainment or gaming environments
US11157080B2 (en) Detection device, detection method, control device, and control method
US10216474B2 (en) Variable computing engine for interactive media based upon user biometrics
CN102473320B (en) Bringing a visual representation to life via learned input from the user
CN100583007C (en) Movable device with surface display information and interaction function
US20070149282A1 (en) Interactive gaming method and apparatus with emotion perception ability
CN107077229B (en) Human-machine interface device and system
US20170216675A1 (en) Fitness-based game mechanics
US20130311132A1 (en) Wearable computing device
CN104049746A (en) Systems and methods for parameter modification of haptic effects
CN106878390B (en) Electronic pet interaction control method and device and wearable equipment
WO2001012285A1 (en) Networked toys
WO2018108174A1 (en) Interface interactive assembly control method and apparatus, and wearable device
Salter Sensing machines: How sensors shape our everyday life
Taheri et al. Exploratory design of a hands-free video game controller for a quadriplegic individual
US20130014055A1 (en) Device and method for inducing use
Taheri et al. Designing a first person shooter game for quadriplegics
TWM600411U (en) Behavior data processing system
Ossmann et al. AsTeRICS, a flexible AT construction set
CN111610857A (en) Gloves with interactive installation is felt to VR body
Kruijff Unconventional 3D user interfaces for virtual environments
Pagliarini et al. Wearable playware
US20240036619A1 (en) Systems and methods to select an action using a handheld device by perceptual association
KR102431050B1 (en) An Artificial Intelligence Type of a Game System for Improving a Brain Cognitive Skill
Cheok et al. Huggy pajama: A remote interactive touch and hugging system

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION