WO2015048038A3 - Camera based safety mechanisms for users of head mounted displays - Google Patents

Camera based safety mechanisms for users of head mounted displays Download PDF

Info

Publication number
WO2015048038A3
WO2015048038A3 PCT/US2014/057041 US2014057041W WO2015048038A3 WO 2015048038 A3 WO2015048038 A3 WO 2015048038A3 US 2014057041 W US2014057041 W US 2014057041W WO 2015048038 A3 WO2015048038 A3 WO 2015048038A3
Authority
WO
WIPO (PCT)
Prior art keywords
head mounted
user
game
hmd
signal
Prior art date
Application number
PCT/US2014/057041
Other languages
French (fr)
Other versions
WO2015048038A2 (en
Inventor
Jeffrey Roger Stafford
Original Assignee
Sony Computer Entertainment Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/170,470 external-priority patent/US9729864B2/en
Application filed by Sony Computer Entertainment Inc. filed Critical Sony Computer Entertainment Inc.
Priority to BR112016007009-7A priority Critical patent/BR112016007009B1/en
Priority to JP2016517455A priority patent/JP6292686B2/en
Priority to CN201480058815.3A priority patent/CN105705210B/en
Priority to EP14783725.6A priority patent/EP3052209A2/en
Priority to RU2016117101A priority patent/RU2661857C2/en
Publication of WO2015048038A2 publication Critical patent/WO2015048038A2/en
Publication of WO2015048038A3 publication Critical patent/WO2015048038A3/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/53Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/537Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/26Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/45Controlling the progress of the video game
    • A63F13/49Saving the game status; Pausing or ending the game
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525Changing parameters of virtual cameras
    • A63F13/5255Changing parameters of virtual cameras according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/53Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/533Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/303Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device for displaying additional data, e.g. simulating a Head Up Display
    • A63F2300/306Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device for displaying additional data, e.g. simulating a Head Up Display for displaying a marker associated to an object or location in the game field
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/53Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
    • A63F2300/538Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for performing operations on behalf of the game client, e.g. rendering

Abstract

The disclosure provides methods and systems for warning a user of a head mounted display during gameplay of a video game. A game is executed causing interactive scenes of the game to be rendered on a display portion of a head mounted display (HMD) worn by a user. A change in position of the HMD worn by the user, while the user is interacting with the game, is detected. The change in position is evaluated, the evaluation causing a signal to be generated when the change exceeds a pre-defined threshold value. When the signal is generated, data is sent to interrupt the interactive scenes being rendered on the display portion of the HMD. The data sent provides descriptive context for the signal.
PCT/US2014/057041 2013-09-30 2014-09-23 Camera based safety mechanisms for users of head mounted displays WO2015048038A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
BR112016007009-7A BR112016007009B1 (en) 2013-09-30 2014-09-23 CAMERA-BASED SECURITY MECHANISMS FOR HEAD-MOUNTED DISPLAY USERS
JP2016517455A JP6292686B2 (en) 2013-09-30 2014-09-23 Camera-based safety mechanism for head-mounted display users
CN201480058815.3A CN105705210B (en) 2013-09-30 2014-09-23 Camera-based security mechanism for head-mounted display users
EP14783725.6A EP3052209A2 (en) 2013-09-30 2014-09-23 Camera based safety mechanisms for users of head mounted displays
RU2016117101A RU2661857C2 (en) 2013-09-30 2014-09-23 Camera based safety mechanisms for users of head mounted displays

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201361884900P 2013-09-30 2013-09-30
US61/884,900 2013-09-30
US14/170,470 US9729864B2 (en) 2013-09-30 2014-01-31 Camera based safety mechanisms for users of head mounted displays
US14/170,470 2014-01-31
US14/333,500 2014-07-16
US14/333,500 US9630105B2 (en) 2013-09-30 2014-07-16 Camera based safety mechanisms for users of head mounted displays

Publications (2)

Publication Number Publication Date
WO2015048038A2 WO2015048038A2 (en) 2015-04-02
WO2015048038A3 true WO2015048038A3 (en) 2015-07-02

Family

ID=52740703

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/057041 WO2015048038A2 (en) 2013-09-30 2014-09-23 Camera based safety mechanisms for users of head mounted displays

Country Status (7)

Country Link
US (5) US9630105B2 (en)
EP (1) EP3052209A2 (en)
JP (4) JP6292686B2 (en)
CN (1) CN105705210B (en)
BR (1) BR112016007009B1 (en)
RU (1) RU2661857C2 (en)
WO (1) WO2015048038A2 (en)

Families Citing this family (232)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8020095B2 (en) 1997-11-14 2011-09-13 Immersion Corporation Force feedback system including multi-tasking graphical host environment
FR2976681B1 (en) * 2011-06-17 2013-07-12 Inst Nat Rech Inf Automat SYSTEM FOR COLOCATING A TOUCH SCREEN AND A VIRTUAL OBJECT AND DEVICE FOR HANDLING VIRTUAL OBJECTS USING SUCH A SYSTEM
US8947216B2 (en) 2012-11-02 2015-02-03 Immersion Corporation Encoding dynamic haptic effects
US9898084B2 (en) 2012-12-10 2018-02-20 Immersion Corporation Enhanced dynamic haptic effects
US9202352B2 (en) 2013-03-11 2015-12-01 Immersion Corporation Automatic haptic effect adjustment system
US9092954B2 (en) 2013-03-15 2015-07-28 Immersion Corporation Wearable haptic device
US10162416B2 (en) 2013-09-06 2018-12-25 Immersion Corporation Dynamic haptic conversion system
US9207764B2 (en) 2013-09-18 2015-12-08 Immersion Corporation Orientation adjustable multi-channel haptic device
US9213408B2 (en) 2013-10-08 2015-12-15 Immersion Corporation Generating haptic effects while minimizing cascading
US9164587B2 (en) 2013-11-14 2015-10-20 Immersion Corporation Haptic spatialization system
US9619029B2 (en) 2013-11-14 2017-04-11 Immersion Corporation Haptic trigger control system
US10254836B2 (en) 2014-02-21 2019-04-09 Immersion Corporation Haptic power consumption management
GB201404732D0 (en) * 2014-03-17 2014-04-30 Sony Comp Entertainment Europe Virtual Reality
US9392212B1 (en) 2014-04-17 2016-07-12 Visionary Vr, Inc. System and method for presenting virtual reality content to a user
US9741169B1 (en) * 2014-05-20 2017-08-22 Leap Motion, Inc. Wearable augmented reality devices with object detection and tracking
US10852838B2 (en) * 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9746901B2 (en) * 2014-07-31 2017-08-29 Google Technology Holdings LLC User interface adaptation based on detected user location
US9990774B2 (en) 2014-08-08 2018-06-05 Sony Interactive Entertainment Inc. Sensory stimulus management in head mounted display
JP2016038889A (en) 2014-08-08 2016-03-22 リープ モーション, インコーポレーテッドLeap Motion, Inc. Extended reality followed by motion sensing
US20160064947A1 (en) * 2014-09-02 2016-03-03 Apple Inc. Adjusting Operations in an Electronic Device Based on Environmental Data
US20160070343A1 (en) * 2014-09-09 2016-03-10 Beijing Lenovo Software Ltd. Information processing method and electronic device
US10256859B2 (en) 2014-10-24 2019-04-09 Usens, Inc. System and method for immersive and interactive multimedia generation
CN106062862B (en) 2014-10-24 2020-04-21 杭州凌感科技有限公司 System and method for immersive and interactive multimedia generation
US10185396B2 (en) 2014-11-12 2019-01-22 Immersion Corporation Haptic trigger modification system
CN107003135B (en) * 2014-12-09 2020-04-21 旭化成株式会社 Position and orientation detection device and position and orientation detection program
US10613628B2 (en) 2014-12-23 2020-04-07 Immersion Corporation Media driven haptics
US10656720B1 (en) 2015-01-16 2020-05-19 Ultrahaptics IP Two Limited Mode switching for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments
US10269392B2 (en) 2015-02-11 2019-04-23 Immersion Corporation Automated haptic effect accompaniment
US10055887B1 (en) * 2015-02-19 2018-08-21 Google Llc Virtual/augmented reality transition system and method
US10216277B2 (en) 2015-02-25 2019-02-26 Immersion Corporation Modifying haptic effects for slow motion
KR20160105321A (en) 2015-02-27 2016-09-06 임머숀 코퍼레이션 Generating actions based on a user's mood
US9952669B2 (en) 2015-04-21 2018-04-24 Immersion Corporation Dynamic rendering of etching input
US10261582B2 (en) 2015-04-28 2019-04-16 Immersion Corporation Haptic playback adjustment system
US10115303B2 (en) 2015-05-05 2018-10-30 Razer (Asia-Pacific) Pte. Ltd. Methods for controlling a headset device, headset devices, computer readable media, and infrared sensors
US10298281B2 (en) * 2015-05-07 2019-05-21 Nxp B. V. Establishing communication with wireless devices using orientation data
US9910275B2 (en) * 2015-05-18 2018-03-06 Samsung Electronics Co., Ltd. Image processing for head mounted display devices
KR101700767B1 (en) * 2015-06-02 2017-01-31 엘지전자 주식회사 Head mounted display
US9898091B2 (en) 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
US9665170B1 (en) 2015-06-10 2017-05-30 Visionary Vr, Inc. System and method for presenting virtual reality content to a user based on body posture
US9833700B2 (en) * 2015-06-11 2017-12-05 Oculus Vr, Llc Connectable hand-held controllers for virtual-reality systems
USD772986S1 (en) 2015-06-11 2016-11-29 Oculus Vr, Llc Wireless game controller
JP2017011436A (en) * 2015-06-19 2017-01-12 セイコーエプソン株式会社 Image display device
US10083544B2 (en) * 2015-07-07 2018-09-25 Google Llc System for tracking a handheld device in virtual reality
US10002429B2 (en) 2015-08-17 2018-06-19 Samsung Electronics Co., Ltd. Apparatus and method for notifying a virtual reality user of real world objects
EP3133468A1 (en) * 2015-08-17 2017-02-22 Samsung Electronics Co., Ltd. Virtual reality headset for notifying an object and method thereof
US10109161B2 (en) 2015-08-21 2018-10-23 Immersion Corporation Haptic driver with attenuation
US9901816B2 (en) * 2015-08-24 2018-02-27 Htc Corporation Interactive game system with an HMD and a ground pad
US9857871B2 (en) 2015-09-04 2018-01-02 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
US20170103574A1 (en) * 2015-10-13 2017-04-13 Google Inc. System and method for providing continuity between real world movement and movement in a virtual/augmented reality experience
EP3163407B1 (en) * 2015-10-29 2020-08-26 Samsung Electronics Co., Ltd. Method and apparatus for alerting to head mounted display user
US10474411B2 (en) 2015-10-29 2019-11-12 Samsung Electronics Co., Ltd. System and method for alerting VR headset user to real-world objects
US9839840B2 (en) * 2015-11-05 2017-12-12 Oculus Vr, Llc Interconnectable handheld controllers
US10007339B2 (en) 2015-11-05 2018-06-26 Oculus Vr, Llc Controllers with asymmetric tracking patterns
US10130875B2 (en) 2015-11-12 2018-11-20 Oculus Vr, Llc Handheld controller with finger grip detection
US9990045B2 (en) 2015-11-12 2018-06-05 Oculus Vr, Llc Method and apparatus for detecting hand gestures with a handheld controller
JP2017099686A (en) * 2015-12-02 2017-06-08 株式会社ブリリアントサービス Head-mounted display for game, program for head-mounted display for game, and control method of head-mounted display for game
JP6363587B2 (en) 2015-12-14 2018-07-25 株式会社ソニー・インタラクティブエンタテインメント Information processing apparatus and warning presenting method
US9804693B2 (en) * 2015-12-18 2017-10-31 Oculus Vr, Llc Handheld controller with activation sensors
EP3376674B1 (en) 2015-12-24 2023-09-06 Sony Interactive Entertainment Inc. Frequency band determination device, head-mounted display, method for determining frequency band, and program
JP2017119032A (en) * 2015-12-29 2017-07-06 株式会社バンダイナムコエンターテインメント Game device and program
JP6727807B2 (en) * 2015-12-29 2020-07-22 株式会社バンダイナムコアミューズメント Game device and program
US10343059B2 (en) 2015-12-30 2019-07-09 Facebook Technologies, Llc Handheld controller with thumbstick guard
US10441880B2 (en) 2015-12-30 2019-10-15 Facebook Technologies, Llc Handheld controller with spring-biased third finger button assembly
US9977494B2 (en) 2015-12-30 2018-05-22 Oculus Vr, Llc Tracking constellation assembly for use in a virtual reality system
US10386922B2 (en) 2015-12-30 2019-08-20 Facebook Technologies, Llc Handheld controller with trigger button and sensor retainer assembly
US11857869B2 (en) 2015-12-31 2024-01-02 Meta Platforms Technologies, Llc Handheld controller with hand detection sensors
JP6675209B2 (en) 2016-01-20 2020-04-01 株式会社ソニー・インタラクティブエンタテインメント Information processing apparatus and user guide presentation method
US10229541B2 (en) * 2016-01-28 2019-03-12 Sony Interactive Entertainment America Llc Methods and systems for navigation within virtual reality space using head mounted display
KR101910529B1 (en) * 2016-01-28 2018-10-22 엠더블유엔테크 주식회사 Virtual Reality System for Fire Safety
JP6232649B2 (en) * 2016-02-18 2017-11-22 国立大学法人名古屋大学 Virtual space display system
JP6673717B2 (en) * 2016-02-22 2020-03-25 株式会社キーエンス Optical safety system
US9939635B2 (en) * 2016-02-29 2018-04-10 Brillio LLC Method for providing notification in virtual reality device
JP5996138B1 (en) * 2016-03-18 2016-09-21 株式会社コロプラ GAME PROGRAM, METHOD, AND GAME SYSTEM
US10099122B2 (en) 2016-03-30 2018-10-16 Sony Interactive Entertainment Inc. Head-mounted display tracking
US10401952B2 (en) 2016-03-31 2019-09-03 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10372205B2 (en) 2016-03-31 2019-08-06 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10192528B2 (en) 2016-03-31 2019-01-29 Sony Interactive Entertainment Inc. Real-time user adaptive foveated rendering
US10169846B2 (en) 2016-03-31 2019-01-01 Sony Interactive Entertainment Inc. Selective peripheral vision filtering in a foveated rendering system
EP3377962A1 (en) * 2016-04-27 2018-09-26 Rovi Guides, Inc. Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment
US10025376B2 (en) 2016-04-27 2018-07-17 Rovi Guides, Inc. Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment
US10521255B2 (en) * 2016-05-19 2019-12-31 International Business Machines Corporation Interface and interruption management
KR101822471B1 (en) * 2016-05-26 2018-01-29 경북대학교 산학협력단 Virtual Reality System using of Mixed reality, and thereof implementation method
US10614628B2 (en) * 2016-06-09 2020-04-07 Screenovate Technologies Ltd. Method for supporting the usage of a computerized source device within virtual environment of a head mounted device
US10556175B2 (en) 2016-06-10 2020-02-11 Immersion Corporation Rendering a haptic effect with intra-device mixing
JP6767515B2 (en) * 2016-06-13 2020-10-14 ソニー・インタラクティブエンタテインメント エルエルシー How and systems to direct user attention to location-based gameplay companion applications
US10981061B2 (en) * 2016-06-13 2021-04-20 Sony Interactive Entertainment LLC Method and system for directing user attention to a location based game play companion application
US10401962B2 (en) 2016-06-21 2019-09-03 Immersion Corporation Haptically enabled overlay for a pressure sensitive surface
CN106125927B (en) * 2016-06-23 2019-11-29 捷开通讯(深圳)有限公司 Image processing system and method
US10210724B2 (en) 2016-06-29 2019-02-19 Immersion Corporation Real-time patterned haptic effect generation using vibrations
US10471353B2 (en) * 2016-06-30 2019-11-12 Sony Interactive Entertainment America Llc Using HMD camera touch button to render images of a user captured during game play
EP3264801B1 (en) * 2016-06-30 2019-10-02 Nokia Technologies Oy Providing audio signals in a virtual environment
US11341776B2 (en) * 2016-07-15 2022-05-24 Htc Corporation Method, electronic apparatus and recording medium for automatically configuring sensors
US9946337B2 (en) * 2016-07-25 2018-04-17 Immersv, Inc. Utilizing inertial measurement unit data of a head mounted display device to generate inferred comfort data
CN106139587B (en) * 2016-08-05 2020-06-09 惠州Tcl移动通信有限公司 Method and system for avoiding real environment obstacles based on VR game
US20180059812A1 (en) * 2016-08-22 2018-03-01 Colopl, Inc. Method for providing virtual space, method for providing virtual experience, program and recording medium therefor
CN106325512A (en) * 2016-08-24 2017-01-11 韩龙潇 Terminal for monitoring surrounding in use state
WO2018045112A1 (en) * 2016-09-01 2018-03-08 Harman International Industries, Incorporated Dynamic augmentation of real-world sounds into a virtual reality sound mix
USD835104S1 (en) 2016-09-27 2018-12-04 Oculus Vr, Llc Wireless game controller
US10440240B2 (en) * 2016-09-30 2019-10-08 Sony Interactive Entertainment Inc. Systems and methods for reducing an effect of occlusion of a tracker by people
US10617956B2 (en) 2016-09-30 2020-04-14 Sony Interactive Entertainment Inc. Methods for providing interactive content in a virtual reality scene to guide an HMD user to safety within a real world space
CN106293101A (en) * 2016-09-30 2017-01-04 陈华丰 A kind of man-machine interactive system for head-mounted display and method
CN106547353A (en) * 2016-10-21 2017-03-29 北京小米移动软件有限公司 Based reminding method and device
TWI637287B (en) * 2016-11-04 2018-10-01 宏達國際電子股份有限公司 Method, virtual reality apparatus and recording medium for fast moving in virtual reality
US10591987B2 (en) 2016-11-04 2020-03-17 Htc Corporation Method, virtual reality apparatus and recording medium for fast moving in virtual reality
GB2556910A (en) 2016-11-25 2018-06-13 Nokia Technologies Oy Virtual reality display
CN106621320A (en) * 2016-11-29 2017-05-10 维沃移动通信有限公司 Data processing method of virtual reality terminal and virtual reality terminal
CN109416614B (en) * 2016-11-30 2023-04-04 日本聚逸株式会社 Method implemented by computer and non-volatile computer-readable medium, system
US10055028B2 (en) * 2016-12-05 2018-08-21 Google Llc End of session detection in an augmented and/or virtual reality environment
GB2557593A (en) * 2016-12-09 2018-06-27 Sony Interactive Entertainment Inc Virtual reality
US10147460B2 (en) 2016-12-28 2018-12-04 Immersion Corporation Haptic effect generation for space-dependent content
US10204455B2 (en) * 2016-12-31 2019-02-12 Intel Corporation Collision prevention for virtual reality systems
GB2558596A (en) * 2017-01-09 2018-07-18 Sony Interactive Entertainment Inc User analysis system and method
US10212428B2 (en) 2017-01-11 2019-02-19 Microsoft Technology Licensing, Llc Reprojecting holographic video to enhance streaming bandwidth/quality
WO2018152690A1 (en) * 2017-02-22 2018-08-30 深圳市卓梦科技有限责任公司 Obstacle detecting patent information pushing method and vr helmet
WO2018152689A1 (en) * 2017-02-22 2018-08-30 深圳市卓梦科技有限责任公司 Data acquisition method for obstacle detection technology, and vr helmet
JP2018148257A (en) * 2017-03-01 2018-09-20 セイコーエプソン株式会社 Head mounted display device and control method for the same
CN108536279B (en) * 2017-03-06 2021-08-03 北京可见文化传播有限公司 Method and system for interaction in virtual reality environment
US20180260022A1 (en) * 2017-03-07 2018-09-13 Htc Corporation Method suitable for a head mounted device and virtual reality system
CN107066088B (en) * 2017-03-08 2023-03-21 联想(北京)有限公司 Interaction method and electronic equipment
JP6955351B2 (en) * 2017-03-16 2021-10-27 ヤフー株式会社 Protective devices, protection methods and protection programs
WO2018173399A1 (en) * 2017-03-21 2018-09-27 ソニー株式会社 Information processing device, information processing method, and program
US10564725B2 (en) 2017-03-23 2020-02-18 Immerson Corporation Haptic effects using a high bandwidth thin actuation system
US10277943B2 (en) * 2017-03-27 2019-04-30 Microsoft Technology Licensing, Llc Selective rendering of sparse peripheral displays based on user movements
US10216260B2 (en) * 2017-03-27 2019-02-26 Microsoft Technology Licensing, Llc Selective rendering of sparse peripheral displays based on element saliency
AU2018244316B2 (en) * 2017-03-28 2022-09-29 Magic Leap, Inc. Augmented reality system with spatialized audio tied to user manipulated virtual object
US20180288392A1 (en) * 2017-04-01 2018-10-04 Intel Corporation Adjusting display content based on user distance detection
US10713848B2 (en) * 2017-04-06 2020-07-14 Htc Corporation System and method for providing simulated environment
US10726792B2 (en) 2017-04-17 2020-07-28 Intel Corporation Glare and occluded view compensation for automotive and other applications
CN110692086A (en) * 2017-04-21 2020-01-14 惠普发展公司,有限责任合伙企业 Object detection for virtual reality
US10366584B2 (en) 2017-06-05 2019-07-30 Immersion Corporation Rendering haptics with an illusion of flexible joint movement
US10194078B2 (en) 2017-06-09 2019-01-29 Immersion Corporation Haptic enabled device with multi-image capturing abilities
EP3416381A1 (en) * 2017-06-12 2018-12-19 Thomson Licensing Method and apparatus for providing information to a user observing a multi view content
CN107281752A (en) * 2017-06-16 2017-10-24 苏州蜗牛数字科技股份有限公司 It is a kind of that the method that intelligent virtual is conducted a sightseeing tour is set in VR game
EP3616035B1 (en) 2017-06-19 2024-04-24 Apple Inc. Augmented reality interface for interacting with displayed maps
US10423241B1 (en) 2017-07-31 2019-09-24 Amazon Technologies, Inc. Defining operating areas for virtual reality systems using sensor-equipped operating surfaces
US20190041987A1 (en) 2017-08-03 2019-02-07 Immersion Corporation Haptic effect encoding and rendering system
US20190049558A1 (en) * 2017-08-08 2019-02-14 KC Sense Limited Hand Gesture Recognition System and Method
GB2565836B (en) * 2017-08-25 2021-04-14 Sony Interactive Entertainment Inc Data processing for position detection using markers in captured images
US10521942B2 (en) * 2017-09-07 2019-12-31 Motorola Mobility Llc Low power virtual reality presence monitoring and notification
US10477298B2 (en) 2017-09-08 2019-11-12 Immersion Corporation Rendering haptics on headphones with non-audio data
EP3454177B1 (en) * 2017-09-11 2020-06-10 Barco N.V. Method and system for efficient gesture control of equipment
JP6340464B1 (en) * 2017-09-27 2018-06-06 株式会社Cygames Program, information processing method, information processing system, head-mounted display device, information processing device
US20190094955A1 (en) * 2017-09-27 2019-03-28 Apple Inc. Range finding and accessory tracking for head-mounted display systems
US10839547B2 (en) 2017-09-28 2020-11-17 Samsung Electronics Co., Ltd. Camera pose determination and tracking
US10529074B2 (en) * 2017-09-28 2020-01-07 Samsung Electronics Co., Ltd. Camera pose and plane estimation using active markers and a dynamic vision sensor
JP7058034B2 (en) 2017-09-29 2022-04-21 グリー株式会社 Game processing program, game processing method, and game processing device
US10777007B2 (en) 2017-09-29 2020-09-15 Apple Inc. Cooperative augmented reality map interface
GB2567203B (en) 2017-10-05 2022-02-23 Displaylink Uk Ltd System and method for locally generating data
US10506217B2 (en) * 2017-10-09 2019-12-10 Facebook Technologies, Llc Head-mounted display tracking system
KR102572675B1 (en) * 2017-11-22 2023-08-30 삼성전자주식회사 Method and electronic device for adaptively configuring user interface
US11087527B2 (en) * 2017-12-01 2021-08-10 Koninklijke Kpn N.V. Selecting an omnidirectional image for display
US11156844B2 (en) * 2017-12-27 2021-10-26 Sony Corporation Information processing apparatus, information processing method, and program
US10583359B2 (en) 2017-12-28 2020-03-10 Immersion Corporation Systems and methods for providing haptic effects related to touching and grasping a virtual object
CN110044322B (en) * 2018-01-17 2022-03-22 中兴通讯股份有限公司 Display method and device of virtual reality terminal and mobile terminal
US11386572B2 (en) 2018-02-03 2022-07-12 The Johns Hopkins University Calibration system and method to align a 3D virtual scene and a 3D real world for a stereoscopic head-mounted display
US10726765B2 (en) * 2018-02-15 2020-07-28 Valve Corporation Using tracking of display device to control image display
AU2019231697B2 (en) 2018-03-07 2020-01-30 Magic Leap, Inc. Visual tracking of peripheral devices
US10695667B2 (en) * 2018-03-14 2020-06-30 Sony Interactive Entertainment LLC Pro gaming AR visor and method for parsing context specific HUD content from a video stream
EP3542877A1 (en) * 2018-03-20 2019-09-25 InterDigital CE Patent Holdings Optimized content sharing interaction using a mixed reality environment
CN108664887A (en) * 2018-03-20 2018-10-16 重庆邮电大学 Prior-warning device and method are fallen down in a kind of virtual reality experience
EP3777137A4 (en) * 2018-04-06 2021-10-27 Nokia Technologies Oy Method and apparatus for signaling of viewing extents and viewing space for omnidirectional content
EP3557378B1 (en) 2018-04-16 2022-02-23 HTC Corporation Tracking system for tracking and rendering virtual object corresponding to physical object and the operating method for the same
US10916066B2 (en) * 2018-04-20 2021-02-09 Edx Technologies, Inc. Methods of virtual model modification
US11595637B2 (en) * 2018-05-14 2023-02-28 Dell Products, L.P. Systems and methods for using peripheral vision in virtual, augmented, and mixed reality (xR) applications
US10859831B1 (en) * 2018-05-16 2020-12-08 Facebook Technologies, Llc Systems and methods for safely operating a mobile virtual reality system
US10942564B2 (en) 2018-05-17 2021-03-09 Sony Interactive Entertainment Inc. Dynamic graphics rendering based on predicted saccade landing point
US11262839B2 (en) 2018-05-17 2022-03-01 Sony Interactive Entertainment Inc. Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment
US10665067B2 (en) 2018-06-15 2020-05-26 Immersion Corporation Systems and methods for integrating haptics overlay in augmented reality
CN110634189B (en) 2018-06-25 2023-11-07 苹果公司 System and method for user alerting during an immersive mixed reality experience
US10607367B2 (en) * 2018-06-26 2020-03-31 International Business Machines Corporation Methods and systems for managing virtual reality sessions
EP3598270A1 (en) * 2018-07-17 2020-01-22 Technische Universität München Method and control unit for controlling a virtual reality display, virtual reality display and virtual reality system
KR20200010952A (en) * 2018-07-23 2020-01-31 삼성전자주식회사 Wearable electronic device for controlling transmittance of transparent member and output brightness of projector based on battery remains and method for operating thefeof
JP7309849B2 (en) * 2018-07-24 2023-07-18 マジック リープ, インコーポレイテッド Method and Apparatus for Determining and/or Evaluating Localization Maps of Image Display Devices
CN109045692A (en) * 2018-07-25 2018-12-21 灵然创智(天津)动画科技发展有限公司 A kind of handle control virtual camera
JP7073228B2 (en) * 2018-08-23 2022-05-23 株式会社コロプラ Information processing methods, computers, and programs
US10853649B2 (en) * 2018-08-27 2020-12-01 Dell Products, L.P. Context-aware hazard detection using world-facing cameras in virtual, augmented, and mixed reality (xR) applications
JP7101250B2 (en) * 2018-09-04 2022-07-14 株式会社ソニー・インタラクティブエンタテインメント Information processing device and playfield deviation detection method
US11036284B2 (en) * 2018-09-14 2021-06-15 Apple Inc. Tracking and drift correction
US11520041B1 (en) * 2018-09-27 2022-12-06 Apple Inc. Correcting depth estimations derived from image data using acoustic information
US11366514B2 (en) 2018-09-28 2022-06-21 Apple Inc. Application placement based on head position
CN111077984A (en) * 2018-10-19 2020-04-28 北京微播视界科技有限公司 Man-machine interaction method and device, electronic equipment and computer storage medium
CN109284056A (en) * 2018-10-24 2019-01-29 深圳市领点科技有限公司 A kind of efficient virtual scene sharing method and device
US11288733B2 (en) * 2018-11-14 2022-03-29 Mastercard International Incorporated Interactive 3D image projection systems and methods
US11347303B2 (en) * 2018-11-30 2022-05-31 Sony Interactive Entertainment Inc. Systems and methods for determining movement of a controller with respect to an HMD
CN209596544U (en) * 2019-02-17 2019-11-08 上海狮峪智能科技有限公司 VR slot machine head shows device
US11934244B2 (en) * 2019-03-06 2024-03-19 Sony Interactive Entertainment Inc. Low battery switchover
US20200327867A1 (en) * 2019-04-15 2020-10-15 XRSpace CO., LTD. Head mounted display system capable of displaying a virtual scene and a map of a real environment in a picture-in-picture mode, related method and related non-transitory computer readable storage medium
JP7351638B2 (en) * 2019-04-23 2023-09-27 株式会社ソニー・インタラクティブエンタテインメント Image generation device, image display system, and information presentation method
GB2583535B (en) * 2019-05-03 2021-11-10 Sony Interactive Entertainment Inc Data processing
EP3751531A1 (en) * 2019-06-14 2020-12-16 Sword Health, S.A. Determination of cause of disconnection of sensors of a motion tracking system
US11132052B2 (en) * 2019-07-19 2021-09-28 Disney Enterprises, Inc. System for generating cues in an augmented reality environment
KR102614495B1 (en) * 2019-08-02 2023-12-15 엘지전자 주식회사 Xr device and method for controlling the same
CN110456957B (en) * 2019-08-09 2022-05-03 北京字节跳动网络技术有限公司 Display interaction method, device, equipment and storage medium
US11526212B1 (en) * 2019-09-25 2022-12-13 Amazon Technologies, Inc. System to determine don/doff of wearable device
CN113711175A (en) 2019-09-26 2021-11-26 苹果公司 Wearable electronic device presenting a computer-generated real-world environment
CN116360601A (en) 2019-09-27 2023-06-30 苹果公司 Electronic device, storage medium, and method for providing an augmented reality environment
JP7448943B2 (en) 2019-10-07 2024-03-13 株式会社mediVR Rehabilitation support device, method and program
JP6710845B1 (en) * 2019-10-07 2020-06-17 株式会社mediVR Rehabilitation support device, its method and program
JP6867464B2 (en) * 2019-11-28 2021-04-28 株式会社ソニー・インタラクティブエンタテインメント Information processing device and warning presentation method
US11175730B2 (en) 2019-12-06 2021-11-16 Facebook Technologies, Llc Posture-based virtual space configurations
US11164390B2 (en) 2019-12-30 2021-11-02 Korea Institute Of Science And Technology Method and apparatus for displaying virtual reality image
KR102285015B1 (en) * 2019-12-30 2021-08-04 한국과학기술연구원 Method and apparatus for displaying virtual reality image
KR102285012B1 (en) * 2019-12-30 2021-08-04 한국과학기술연구원 Method and apparatus for displaying virtual reality image
US11635802B2 (en) * 2020-01-13 2023-04-25 Sony Interactive Entertainment Inc. Combined light intensity based CMOS and event detection sensor for high speed predictive tracking and latency compensation in virtual and augmented reality HMD systems
US11410387B1 (en) 2020-01-17 2022-08-09 Facebook Technologies, Llc. Systems, methods, and media for generating visualization of physical environment in artificial reality
US11200745B2 (en) 2020-01-27 2021-12-14 Facebook Technologies, Llc. Systems, methods, and media for automatically triggering real-time visualization of physical environment in artificial reality
US11113891B2 (en) 2020-01-27 2021-09-07 Facebook Technologies, Llc Systems, methods, and media for displaying real-time visualization of physical environment in artificial reality
US11210860B2 (en) 2020-01-27 2021-12-28 Facebook Technologies, Llc. Systems, methods, and media for visualizing occluded physical objects reconstructed in artificial reality
US10950034B1 (en) 2020-01-27 2021-03-16 Facebook Technologies, Llc Systems, methods, and media for generating visualization of physical environment in artificial reality
US11451758B1 (en) 2020-02-12 2022-09-20 Meta Platforms Technologies, Llc Systems, methods, and media for colorizing grayscale images
JP7085578B2 (en) * 2020-03-10 2022-06-16 株式会社ソニー・インタラクティブエンタテインメント Information processing device, user guide presentation method, and head-mounted display
WO2021183736A1 (en) * 2020-03-13 2021-09-16 Harmonix Music Systems, Inc. Techniques for virtual reality boundaries and related systems and methods
US11126850B1 (en) 2020-04-09 2021-09-21 Facebook Technologies, Llc Systems and methods for detecting objects within the boundary of a defined space while in artificial reality
US11257280B1 (en) 2020-05-28 2022-02-22 Facebook Technologies, Llc Element-based switching of ray casting rules
US11493764B2 (en) * 2020-06-04 2022-11-08 Htc Corporation Method for dynamically displaying real-world scene, electronic device, and computer readable medium
US11256336B2 (en) 2020-06-29 2022-02-22 Facebook Technologies, Llc Integration of artificial reality interaction modes
JP7435330B2 (en) 2020-07-14 2024-02-21 株式会社島津製作所 Head motion tracker device and head motion tracker device for aircraft
US11049277B1 (en) 2020-07-17 2021-06-29 Microsoft Technology Licensing, Llc Using 6DOF pose information to align images from separated cameras
US11688168B1 (en) 2020-08-03 2023-06-27 Apple Inc. Method and device for visual augmentation of sporting events
DE102020210473A1 (en) * 2020-08-18 2022-02-24 BSH Hausgeräte GmbH Monitoring module for a household appliance
US11178376B1 (en) 2020-09-04 2021-11-16 Facebook Technologies, Llc Metering for display modes in artificial reality
US11189253B1 (en) * 2020-11-04 2021-11-30 At&T Intellectual Property I, L.P. Methods, systems, and devices to determine positioning of content on a cross reality headset display based on movement of the cross reality headset
US11448884B2 (en) * 2020-11-25 2022-09-20 Sony Interactive Entertainment Inc. Image based finger tracking plus controller tracking
WO2022135685A1 (en) * 2020-12-22 2022-06-30 Telefonaktiebolaget Lm Ericsson (Publ) Method and communication device for positioning estimation
US11232644B1 (en) * 2020-12-31 2022-01-25 Facebook Technologies, Llc Systems and methods for providing spatial awareness in virtual reality
US11294475B1 (en) 2021-02-08 2022-04-05 Facebook Technologies, Llc Artificial reality multi-modal input switching model
GB2606182B (en) * 2021-04-28 2023-08-23 Sony Interactive Entertainment Inc System and method of error logging
GB2610386B (en) * 2021-09-01 2024-01-10 Sony Interactive Entertainment Inc Head-mountable display system and methods
US20230081452A1 (en) * 2021-09-10 2023-03-16 Qualcomm Incorporated Proximity motion sensing for virtual reality systems
US20230185406A1 (en) * 2021-12-09 2023-06-15 Meta Platforms Technologies, Llc Smart rejection of false solid-state button presses on smart glasses
US11747891B1 (en) * 2022-07-15 2023-09-05 Google Llc Content output management in a head mounted wearable device
US11947862B1 (en) * 2022-12-30 2024-04-02 Meta Platforms Technologies, Llc Streaming native application content to artificial reality devices

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110230263A1 (en) * 2010-03-16 2011-09-22 Choo Boon Ng Gaming system with saftey features
WO2012101720A1 (en) * 2011-01-28 2012-08-02 Sony Corporation Information processing device, alarm method, and program
WO2013052855A2 (en) * 2011-10-07 2013-04-11 Google Inc. Wearable computer with nearby object response

Family Cites Families (67)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0226870U (en) * 1988-08-04 1990-02-21
JPH05304646A (en) * 1992-04-24 1993-11-16 Sony Corp Video display device
GB2301216A (en) * 1995-05-25 1996-11-27 Philips Electronics Uk Ltd Display headset
US5838262A (en) * 1996-12-19 1998-11-17 Sikorsky Aircraft Corporation Aircraft virtual image display system and method for providing a real-time perspective threat coverage display
US7107539B2 (en) * 1998-12-18 2006-09-12 Tangis Corporation Thematic response to a computer user's context, such as by a wearable personal computer
JP3492942B2 (en) * 1999-06-30 2004-02-03 株式会社東芝 Wearable information presenting apparatus and method, and storage medium
US8068942B2 (en) * 1999-12-15 2011-11-29 Automotive Technologies International, Inc. Vehicular heads-up display system
US6375570B1 (en) * 2000-06-29 2002-04-23 Igt Gaming device displaying an exhibition for replacing video reels
JP2002073246A (en) * 2000-08-25 2002-03-12 Minolta Co Ltd Video display system
JP2002245490A (en) * 2001-02-16 2002-08-30 Sony Corp Device and method for image reproduction
JP2003337963A (en) 2002-05-17 2003-11-28 Seiko Epson Corp Device and method for image processing, and image processing program and recording medium therefor
JP2005025563A (en) * 2003-07-03 2005-01-27 Canon Inc Virtual reality generation method
JP2005165778A (en) * 2003-12-03 2005-06-23 Canon Inc Head mounted display device and its control method
JP4393169B2 (en) 2003-12-04 2010-01-06 キヤノン株式会社 Mixed reality presentation method and apparatus
JP4600290B2 (en) * 2004-01-29 2010-12-15 コニカミノルタホールディングス株式会社 Visual auxiliary display device
JP2005252732A (en) * 2004-03-04 2005-09-15 Olympus Corp Imaging device
US7677734B2 (en) * 2004-04-09 2010-03-16 Arthur Wallace Audiovisual distraction in patients undergoing surgery with regional anesthesia
US8040361B2 (en) 2005-04-11 2011-10-18 Systems Technology, Inc. Systems and methods for combining virtual and real-time physical environments
JP4642538B2 (en) * 2005-04-20 2011-03-02 キヤノン株式会社 Image processing method and image processing apparatus
JP5188977B2 (en) * 2005-09-30 2013-04-24 アイロボット コーポレイション Companion robot for personal interaction
JP2007156561A (en) * 2005-11-30 2007-06-21 Canon Inc Augmented reality presenting method and system
JP4883774B2 (en) * 2006-08-07 2012-02-22 キヤノン株式会社 Information processing apparatus, control method therefor, and program
US9891435B2 (en) * 2006-11-02 2018-02-13 Sensics, Inc. Apparatus, systems and methods for providing motion tracking using a personal viewing device
JP2008148874A (en) * 2006-12-15 2008-07-03 Aruze Corp Slot machine designed to array symbols with reels
EP1990674A1 (en) * 2007-05-09 2008-11-12 Harman Becker Automotive Systems GmbH Head-mounted display system
JP2012510676A (en) 2008-12-01 2012-05-10 ビジュアル ドメインズ リミテッド Method and system for browsing visual content displayed in a virtual three-dimensional space
JP2010134649A (en) 2008-12-03 2010-06-17 Canon Inc Information processing apparatus, its processing method, and program
US20150054826A1 (en) 2009-03-19 2015-02-26 Real Time Companies Augmented reality system for identifying force capability and occluded terrain
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
JP2011008351A (en) * 2009-06-23 2011-01-13 Canon Inc Image processing method and image processing apparatus
JP2011010126A (en) * 2009-06-26 2011-01-13 Canon Inc Image processing apparatus, and image processing method
US20120283942A1 (en) * 2009-11-12 2012-11-08 T Siobbel Stephen Navigation system with live speed warning for merging traffic flow
JP2011128838A (en) * 2009-12-17 2011-06-30 Panasonic Corp Image display device
JP5279737B2 (en) 2010-01-25 2013-09-04 株式会社コナミデジタルエンタテインメント Display control device, line-of-sight guidance method, and program
US20130278631A1 (en) * 2010-02-28 2013-10-24 Osterhout Group, Inc. 3d positioning of augmented reality information
US20130314303A1 (en) * 2010-02-28 2013-11-28 Osterhout Group, Inc. Ar glasses with user action control of and between internal and external applications with feedback
US9129295B2 (en) * 2010-02-28 2015-09-08 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear
US20120206485A1 (en) * 2010-02-28 2012-08-16 Osterhout Group, Inc. Ar glasses with event and sensor triggered user movement control of ar eyepiece facilities
US20110214082A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US9285589B2 (en) * 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US8964298B2 (en) * 2010-02-28 2015-02-24 Microsoft Corporation Video display modification based on sensor input for a see-through near-to-eye display
JP5039808B2 (en) * 2010-03-16 2012-10-03 株式会社コナミデジタルエンタテインメント GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM
EP2402838A1 (en) * 2010-07-03 2012-01-04 Fachhochschule Dortmund Methods and device for the determination and/or feedback and/or control of the effective measurement space in motion capturing systems
US8576276B2 (en) 2010-11-18 2013-11-05 Microsoft Corporation Head-mounted display device which provides surround video
US9213405B2 (en) * 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
JP2012155655A (en) * 2011-01-28 2012-08-16 Sony Corp Information processing device, notification method, and program
RU111703U1 (en) * 2011-02-08 2011-12-20 Федеральное агенство воздушного транспорта Федеральное государственное образовательное учреждение высшего профессионального образования "Московский государственный технический университет гражданской авиации" (МГТУГА) TRAINING COMPLEX FOR TRAINING OF AIR TRAFFIC CONTROLLERS OF STEERING, LAUNCHING AND LANDING AT REAL FLIGHT
JP2012173772A (en) * 2011-02-17 2012-09-10 Panasonic Corp User interaction apparatus, user interaction method, user interaction program and integrated circuit
JP2012186660A (en) 2011-03-06 2012-09-27 Sony Corp Head mounted display
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
KR20140059213A (en) 2011-08-30 2014-05-15 마이크로소프트 코포레이션 Head mounted display with iris scan profiling
US9345957B2 (en) * 2011-09-30 2016-05-24 Microsoft Technology Licensing, Llc Enhancing a sport using an augmented reality display
US9255813B2 (en) * 2011-10-14 2016-02-09 Microsoft Technology Licensing, Llc User controlled real object disappearance in a mixed reality display
JP5923926B2 (en) 2011-10-24 2016-05-25 ソニー株式会社 Head mounted display and method for controlling head mounted display
US8704882B2 (en) 2011-11-18 2014-04-22 L-3 Communications Corporation Simulated head mounted display system and method
US8872853B2 (en) 2011-12-01 2014-10-28 Microsoft Corporation Virtual light in augmented reality
US20130293530A1 (en) 2012-05-04 2013-11-07 Kathryn Stone Perez Product augmentation and advertising in see through displays
JP5580855B2 (en) * 2012-06-12 2014-08-27 株式会社ソニー・コンピュータエンタテインメント Obstacle avoidance device and obstacle avoidance method
US9317971B2 (en) 2012-06-29 2016-04-19 Microsoft Technology Licensing, Llc Mechanism to give holographic objects saliency in multiple spaces
US9105210B2 (en) 2012-06-29 2015-08-11 Microsoft Technology Licensing, Llc Multi-node poster location
CN104508600B (en) * 2012-07-27 2017-06-13 日本电气方案创新株式会社 Three-dimensional user interface device and three-dimensional manipulating method
GB2504999B8 (en) 2012-08-17 2015-04-22 Sony Comp Entertainment Europe Apparatus and method for object positioning
US20150193977A1 (en) 2012-08-31 2015-07-09 Google Inc. Self-Describing Three-Dimensional (3D) Object Recognition and Control Descriptors for Augmented Reality Interfaces
DE102012217573A1 (en) * 2012-09-27 2014-03-27 Krones Ag Operating system for a machine
US9812046B2 (en) * 2013-01-10 2017-11-07 Microsoft Technology Licensing, Llc Mixed reality display accommodation
JP6177872B2 (en) 2013-02-19 2017-08-09 ミラマ サービス インク I / O device, I / O program, and I / O method
JP6057396B2 (en) 2013-03-11 2017-01-11 Necソリューションイノベータ株式会社 3D user interface device and 3D operation processing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110230263A1 (en) * 2010-03-16 2011-09-22 Choo Boon Ng Gaming system with saftey features
WO2012101720A1 (en) * 2011-01-28 2012-08-02 Sony Corporation Information processing device, alarm method, and program
WO2013052855A2 (en) * 2011-10-07 2013-04-11 Google Inc. Wearable computer with nearby object response

Also Published As

Publication number Publication date
US20180093184A1 (en) 2018-04-05
RU2661857C2 (en) 2018-07-19
US10124257B2 (en) 2018-11-13
JP2017148530A (en) 2017-08-31
CN105705210A (en) 2016-06-22
US20190070506A1 (en) 2019-03-07
JP2016541035A (en) 2016-12-28
US20170203213A1 (en) 2017-07-20
JP2018099523A (en) 2018-06-28
US9873049B2 (en) 2018-01-23
BR112016007009B1 (en) 2022-07-12
WO2015048038A2 (en) 2015-04-02
US9908049B2 (en) 2018-03-06
JP7028917B2 (en) 2022-03-02
CN105705210B (en) 2021-12-28
EP3052209A2 (en) 2016-08-10
US10532284B2 (en) 2020-01-14
US20150094142A1 (en) 2015-04-02
US9630105B2 (en) 2017-04-25
BR112016007009A2 (en) 2017-08-22
JP6292686B2 (en) 2018-03-14
US20160214016A1 (en) 2016-07-28
RU2016117101A (en) 2017-11-09
JP2020175204A (en) 2020-10-29

Similar Documents

Publication Publication Date Title
WO2015048038A3 (en) Camera based safety mechanisms for users of head mounted displays
WO2014197231A3 (en) Switching mode of operation in a head mounted display
USD857745S1 (en) Display screen or a portion thereof with graphical user interface
USD916833S1 (en) Display screen of a computer with a graphical user interface with object tracking game
USD759068S1 (en) Display screen or portion thereof with a baccarat game graphical user interface
USD686240S1 (en) Display screen with graphical user interface for a sports device
BR112017000069A2 (en) anti-tripping item when immersed in a virtual reality medium
WO2014197873A3 (en) Transitioning gameplay on a head-mounted display
TW201614331A (en) Head mounted display device, control method thereof, and computer program
WO2014144526A3 (en) Display system and method
WO2014066779A3 (en) Athletic performance monitoring systems and methods in a team sports environment
JP2013168910A5 (en)
WO2014197338A3 (en) Head mounted display based on optical prescription of a user
WO2015060936A8 (en) Improved provision of contextual data to a computing device using eye tracking technology
WO2015047453A3 (en) Interactions of virtual objects with surfaces
WO2014011266A3 (en) Apparatus for optical see-through head mounted display with mutual occlusion and opaqueness control capability
GB2533520A (en) Gaze-controlled interface method and system
WO2014151031A3 (en) Visual gestures
JP2015045805A5 (en)
MX2011010222A (en) Methods and apparatus for providing an adaptive gaming machine display.
CA2898755C (en) Extending gameplay with physical activity monitoring device
WO2014004482A3 (en) Providing streams of filtered photographs for user consumption
WO2015047599A3 (en) Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking
GB201200913D0 (en) Head-mounted display apparatus having display orientation lock-on mechanism and method using same
WO2013165646A3 (en) User input processing with eye tracking

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14783725

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 2016517455

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112016007009

Country of ref document: BR

REEP Request for entry into the european phase

Ref document number: 2014783725

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014783725

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2016117101

Country of ref document: RU

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 112016007009

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20160330