EP0775961B1 - Virtual reality and remote reality system - Google Patents
Virtual reality and remote reality system Download PDFInfo
- Publication number
- EP0775961B1 EP0775961B1 EP95925143A EP95925143A EP0775961B1 EP 0775961 B1 EP0775961 B1 EP 0775961B1 EP 95925143 A EP95925143 A EP 95925143A EP 95925143 A EP95925143 A EP 95925143A EP 0775961 B1 EP0775961 B1 EP 0775961B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- force
- electrorheological fluid
- teleexistence
- image
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- C—CHEMISTRY; METALLURGY
- C10—PETROLEUM, GAS OR COKE INDUSTRIES; TECHNICAL GASES CONTAINING CARBON MONOXIDE; FUELS; LUBRICANTS; PEAT
- C10M—LUBRICATING COMPOSITIONS; USE OF CHEMICAL SUBSTANCES EITHER ALONE OR AS LUBRICATING INGREDIENTS IN A LUBRICATING COMPOSITION
- C10M171/00—Lubricating compositions characterised by purely physical criteria, e.g. containing as base-material, thickener or additive, ingredients which are characterised exclusively by their numerically specified physical properties, i.e. containing ingredients which are physically well-defined but for which the chemical nature is either unspecified or only very vaguely indicated
- C10M171/001—Electrorheological fluids; smart fluids
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
Definitions
- the present invention relates to virtual reality and telereality employed in various fields such as design, education, training, amusement, hazardous operation, micromanipulation/super-micromanipulation, and more particularly to virtual reality system and telereality system which display .
- virtual reality and telereality employed in various fields such as design, education, training, amusement, hazardous operation, micromanipulation/super-micromanipulation, and more particularly to virtual reality system and telereality system which display .
- force senses in a virtual world created by a computer or in a telereal world which actually exists by using control mechanism that electrically varies flow resistance of an electrorheological fluid.
- the virtual reality system and telereality system in accordance with the present invention are also utilized as a haptic interface that displays information perceived by a motor-sensory system, that is, information associated with mechanical force senses involved in body movement.
- virtual reality in the present invention refers to a world of images such as computer graphics created on a display by a computer.
- the images may be formed on any of a CRT, screen, flat display, and 3D (3-dimensional) display.
- the images formed on the visual display are synchronized in real time with the flow resistance of the electrorheological fluid in a force display device as in the telereal world, real force effect is not involved as in the telereal world.
- real time in the present invention refers to a fact that no substantial delay is present although a very short delay is allowed in image processing, or electrical or mechanical transmission.
- the term "telereal world” in the present invention refers to a world in which mechanical forces are exerted such as operations in extreme environments in various fields like nuclear power, sea, disaster prevention, or space, or micromanipulation/supermicromanipulation in various fields like medical treatment, electronic components, micro-machining.
- it is a telereal world in which mechanical forces are exerted by the operator of the force display system via a mechanical medium such as a robot or manipulator, and a real world in which, are exerted the same mechanical or physical laws as in the world the operator is present. Therefore, the world in which the operator of the force display system is present is synchronized with the telereal world in which the mechanical forces are exerted are performed in real time.
- virtual reality system in the present invention refers to a system that provides an operator with real time telepresence as if he or she were present, and acted or worked in the virtual world created by a computer.
- conventional systems mainly appeal to the eye and/or ear, the system in accordance with the present invention appeals to force senses, as well.
- the term "telereality system” in the present invention refers to a system that provides an operator with real time telepresence as if he or she experienced events in a unique real world such as extremely fine, hazardous, or bad environment through a mechanical medium like a robot, thereby appealing with real time presence to the various senses of the operator, particularly to the force senses.
- the term "teleexistence system" in the present invention includes both the virtual reality system and the telereality system.
- force sense refers to a tactile or bodily sensation, that is, senses accompanying the movement of man's hands and feet, or actions on external objects.
- the tactile sensation includes senses such as soft, hard, heavy, light, strong, elastic or viscous associated with actions such as push, pull, touch, grasp, turn, hit, or kick, and the bodily sensation includes similar senses involved in actions such as press, draw, or tightening.
- force display device refers to a device implemented in the form of gloves, fingers, arms, grips or elbows, which are analogous to man's counterparts.
- the force display device in accordance with the present invention which utilizes electrorheological fluid can be implemented by simpler and more compact structure than the conventional purely mechanical device.
- mechanical variables refers to variables such as position, angle, distortion amount, velocity, force, pressure, acceleration. Sensors for detecting these variables are generally mounted on the force display device. They are often mounted on the output system which performs mechanical operation in the telereal world.
- electrororheological fluid refers to fluid whose viscosity changes instantaneously and reversibly when electric field is applied thereto, and is roughly divided into dispersion electrorheological fluid and homogeneous electrorheological fluid.
- the dispersion electrorheological fluid is formed by dispersing dielectric particles into insulating oil, whereas the homogeneous electrorheological fluid does not use particles.
- the dispersion electrorheological fluid employs particles such as:
- insulating oils are generally used which are stable in electric insulation, in addition to stable mechanical, physical and chemical characteristics: for example, silicone oil, fluorocarbon oil, mineral oil, paraffin, aromatic ester oil, aliphatic cyclic compound ester oil, natural oil.
- the homogeneous electrorheological fluid it is preferable to use materials or their solution with such properties as liquid crystal, viscosity anisotropy, amphiphilic, ferroelectricity, and high dipole moment.
- liquid crystal especially liquid crystalline polymer is preferable.
- the dispersion electrorheological fluid generally exhibits Bingham fluid characteristic in which the shear stress is nearly constant independently of the shear velocity when electric field is applied.
- the homogeneous electrorheological fluid generally shows so-called Newtonian Flow characteristic in which the shear stress is proportional to the shear velocity.
- the virtual reality or teleexistence technology flourishes which provides real time telepresence where we have the illusion that we are really present and work in the virtual reality created by a computer or in the telereal world which actually exists in a very fine or hazardous environment.
- a high performance force display device is essential.
- All the devices employing the electrorheological fluid relate to the control of mechanical outputs rather than the display of force senses, particularly the force display of the virtual reality system.
- the foregoing conventional force display devices have various problems.
- the devices using motors are large, limited in degrees of freedom, and inferior in response.
- the devices using solenoids or air cylinders have poor controllability, and difficulty in the display of delicate senses.
- GB 2 263 179 A discloses a touch simulator to be used in a virtual reality system, which is not identical to the definition given above, wherein an interactive glove is worn by an operator and used to give command control signals to control various operations within the artificial image environment of the virtual reality system.
- An object of the present invention is to provide a teleexistence system including a compact force display device which can provide multiple degrees of freedom, delicate display of force senses, and good telepresence.
- the object is achieved by a teleexistence system according to claim 1, a method according to claim 17, and a computer program according to claim 33, respectively.
- the inventors of the present invention have grasped a concept of applying the electrorheological fluid whose viscosity is electrically variable not only to the control of mechanical output, but also to the sense display using the variations of the flow resistance due to viscosity changes of the electrorheological fluid, and have carried out intensive research on it to complete the present invention.
- the present invention is featured in that it adopts a device using an electrorheological fluid as a force display device. Since the electrorheological fluid changes its viscosity in accordance with the intensity of the electric field applied thereto, its flow resistance can be controlled by the intensity of the electric field.
- This type of the force display device can make reduce the mass of an output portion, and hence can remarkably increase an output/inertia ratio.
- the force senses perceived in the virtual world or the telereal world can be displayed with a feeling close to a real one.
- a force display device with multiple degrees of freedom can be implemented in a simple and compact structure. As a result, a compact virtual reality system or telereality system with an excellent force display function can be implemented by synchronizing the force display device with an image display unit by a computer.
- Figs. 1 and 2 are block diagrams schematically showing teleexistence systems in accordance with the present invention.
- Fig. 1 shows a virtual reality system and
- Fig. 2 shows a telereality system.
- the virtual reality system has a force display device 1, a sensor 2, an image display unit 3, and a computer 4.
- the sensor 2 is connected to the force display device 1 to detect its mechanical variables which are fed back to the computer 4.
- the sensor 2 is not essential to the system.
- the image display unit 3 displays a virtual world to show it to an operator of the virtual reality system.
- the telereality system shown in Fig. 2 includes, in addition to the virtual reality system shown in Fig. 1, a robot 5 operating in a real telereal world, a sensor 6 for detecting the position and motion of the robot 5, and a camera 7 for picking up the image of the telereal world, in which the image display unit 3 displays the telereal world instead of the virtual world.
- a force sensor is used for detecting the mechanical operation in the telereal world.
- the force display device 1 is incorporated into the operating means of the robot 5.
- An image signal from the virtual world which is acquired by the camera 7 may be directly fed to the image display unit 3 and computer 4, or to the computer 4 through the image display unit 3. Reversely, it may be fed to the image display unit 3 via the computer 4.
- the signal from the sensor 6 is fed back to the computer 4 to control the force display device 1 and/or the image display unit 3.
- the force display device 1 in these systems includes a controller for electrically changing the flow resistance of the electrorheological fluid, and is classified into a passive force display device and an active force display device.
- Fig. 3 shows a passive force display device which electrically controls the viscosity of the electrorheological fluid (ER fluid) 11 by a controller 12 to change the flow resistance, thereby obtaining a force display output 13.
- the passive force display device employs one of the following mechanisms.
- the force display device employing such controllers is usually implemented in the form of an orifice composed of a double or multiple coaxial cylinders, a combination of a cylinder and piston, or one or more pairs of parallel plates in the form of slits, sliders, disks, or flanges.
- Fig. 4 shows an active force display device. It electrically controls the electrorheological fluid 11 with the controller 12 to change the flow resistance so that the output from a driving system 14 is controlled by the flow resistance to produce the output as a force display output 15.
- the active force display device controls the mechanical output of the driving system by the flow resistance of the electrorheological fluid. Its structure is similar to that of the passive force display system, and its output mechanism usually takes a form of the cylindrical type or parallel plate type.
- external drivers such as motors, solenoids, air pressure, oil pressure, wires, or internal drivers using self-shape recovery force, such as springs, leaf springs, wire springs, rubber, or elastomer are used individually or in combination.
- the computer 4 controls the force display device 1 and image display unit 3 in synchronism in accordance with the database and program which are input in advance.
- the computer 4 processes a signal from the sensor 2 and/or a signal from the image display unit 3 to supply the processing results to the force display device 1.
- the computer 4 calculates the intensity of an electric field to be applied to the electrorheological fluid in accordance with the database and program stored in advance, or the signal from the sensor 2 to change the electric field in response to the calculation result, thereby controlling the flow resistance of the electrorheological fluid.
- the computer 4 in the telereality system as shown in Fig. 2 further carries out the synchronization with the telereal world. This can be carried out by another computer which supplements the computer 4.
- the feeling of resistance at the beginning (start) or end (stop) of actions such as push, draw, grasp, turn, kick is displayed with a feeling close to a real one.
- the force display device 1 employing the electrorheological fluid exhibiting the Newtonian flow in which the shear stress is proportional to the shear velocity, excels in the reproduction and display of the viscosity resistance.
- the feeling of resistance in the process of successive operations such as touch, search, squeeze, turn is displayed with a feeling close to a real one.
- all types of operations can be displayed with a feeling close to a real one by using the electrorheological fluid exhibiting the Bingham fluid and that exhibiting the Newtonian flow in combination, and by controlling them independently.
- the feeling displayed by the force display device 1 is represented by the passive force based on only the flow resistance of the electrorheological fluid, or the active force due to the combination of the output of the driving system and the flow resistance. Since the electrorheological fluid does not produce driving force by itself, there is no fear that the passive force exceeds the force generated by the operator. Therefore, the passive force is appropriate to implement a safe force display device. The actual force display, however, often requires an active force which combines the passive force with a driving force.
- the force display device in accordance with the present invention carries out the display by electrically changing the flow resistance of the electrorheological fluid, in which the electrorheological fluid changes its flow resistance in good electrical response. It is more compact and faster in response than the conventional force display devices, because it uses smaller number of mechanical components than the conventional ones. Furthermore, it can remarkably reduce the mass of the output parts as compared with motors or the like, thereby achieving a large output/inertia ratio. As a result, it can achieve the output with a desired acceleration, frequency or waveform. This makes it possible, for example, to exhibit or reproduce delicate forces represented by a wording such as tap, rub, pat, picking, massage, numb. In other words, it enables various colors to be put on the force, thereby achieving the display of the force sense superior to the conventional ones. As a result, a virtual reality system or telereality system can be implemented which provides an excellent sense of being at that place.
- These teleexistence system can incorporate, in addition to the force display device 1 and image display unit 3, a device for displaying the tactile senses associated with hearing, smell, taste, pain, itch, to operate it in synchronism through the computer 4 or another computer.
- Figs. 5-7 show an embodiment of the virtual reality system in accordance with the present invention.
- the embodiment is an example of the virtual reality system comprising a glove type force display device using the electrorheological fluid.
- Fig. 5 is a perspective view showing the internal structure of a shape reproducing ball 101, a basic structure of the glove type force display device.
- the device has a ball 102 having a surface on which many cylindrical holes 103 are formed.
- a pin 104 In each hole 103, there is inserted a pin 104 in such a manner that a fixed width space is kept between the pin 104 and the inner wall of the hole 103 by an insulating partial spacers 105.
- the electrorheological fluid is filled in the space and the interior of the hole.
- the electrorheological fluid 106 can easily move in response to the movement of the pins 104 through a fluid tank (not shown) in the ball and the spaces formed by the partial spacers 105.
- the ball 105 forms a negative electrode, and the pins 104 form positive electrodes to which leads are arranged to apply voltages independently.
- the ball 102 is an aluminum ball of 40 mm diameter.
- the holes 103 are 5 mm in diameter, and the pins 104 are a 4 mm diameter and 25 mm long aluminum pin with a resinous flat head.
- the spaces between the pins 104 and the inner walls of the holes 103 are 0.5 mm in width, and are positively maintained by the Teflon spacers 105.
- Fig. 6 shows cross-sectional views of the surface of the shape recovery ball 101.
- the ball 102 is wholly enveloped with a rubber-ball-like rubber 107, and the flat heads of the pins 104 are stuck on the inner wall of the rubber ball 107.
- the diameter of the rubber ball 107 is 55 mm.
- the electrorheological fluid 106 is filled not only in the space between the pins 104 and the holes 103, which is maintained at a fixed width by the spacers 105, and in the interior of the holes 103, but also in the space between the inner wall of the rubber ball 107 and the surface of the ball 102.
- Fig. 7 is a diagram showing the relationship between the rubber ball 107 and a data glove 108.
- the data glove 108 is provided for measuring bending angles of the thumb and fingers (called “fingers” from now on), and the rubber ball 107 is adhered on the inner wall of the data glove 108. Accordingly, the pins 104 move back and forth in the holes 103 in response to the movement of the hand such as clasping or spreading, in the course of which it is unnecessary to use external driving system such as air cylinders.
- the electrorheological fluid 106 varies its viscosity in accordance with the intensity of the electric field. That is, the viscosity of the electrorheological fluid 106 filled in the space between the pins 104 and the holes 103 increases or decreases in response to the intensity of the electric field.
- the movement of the pins 104 can be freely controlled such as heavy or light movement by varying the flow resistance of the electrorheological fluid 106 with the electric field.
- the operator gradually closes his fingers. Voltages are sequentially applied to the pins as the fingers touch the virtual object which is generated by the computer 4 and displayed on the image display unit 3, thereby tightening the movement of the pins.
- the movement of the fingers are measured by the optical fiber sensor 2 attached to the data glove 108, and the measured results are input to the computer 4 which controls the voltages to be applied to the pins 104.
- the voltages are applied to the entire pins as the fingers touch the virtual object, so that the pins are locked. This will provide the operator with a sense as if he were really grasping the virtual object displayed as an image, from both visual sense and mechanical force sense. Reversely, while spreading the fingers, the voltages are released so that the pins 104 can move freely.
- the data glove 108 is spread by the spreading force of the operator.
- Fig. 8 is a partially cross-sectioned view showing a variation of the shape reproducing ball 101. Since the shape reproducing ball 101 comprises pins 104 extending radially, it can display a more real grasping sense. Voltages are sequentially applied to the pins (shaded portions) as the fingers come to touch the virtual object 109 (a rectangular solid in this case).
- the force display device as shown in Fig. 8 has very high degrees of freedom, it can display the senses of touch and grasp of the virtual object not only to the fingertips but also to the finger pads and the palm.
- the fingers are not constrained in such a manner they are mechanically enveloped, it is comfortable to wear.
- the force display device is compact, it can be freely moved in the real space in use.
- the virtual reality system of this embodiment carries out the passive force sense display without using a driving system, it can reproduce more delicate force than the conventional systems using air pressure. Furthermore, it is possible, without using the optical fiber sensor 2, to move fingers by coordinating the force display device with another sense display device such as a voice display device. In this case, the voltage application to the electrorheological fluid 106 is carried out on the basis of the database and program stored in the computer 4. The operator, listening to voices and watching the images displayed on the image display unit 3, moves his or her fingers. Such systems serve as a safe rehabilitation device of fingertips, or a training device of fine operations which can be used to learn the fine operations to an enlarged image, or operations demanding delicate grasping force.
- Fig. 9 is a cross-sectional view showing EMBODIMENT 2 of the teleexistence system in accordance with the present invention.
- This embodiment is an example of applying the virtual reality system in accordance with the present invention to an automobile driving simulation system.
- the simulation system changes the images of the virtual driving in response to handling to provide the steering wheel with force senses accordingly.
- a disk 111 perpendicularly fixed to the shaft of a freely rotatable wheel 110 is sandwiched between two, upper and lower disks 112 and 113 in parallel with maintaining spaces of 1.0 mm.
- the wheel 110 has a diameter of 320 mm.
- the disk 111 is an aluminum disk of 250 mm in diameter, and the disks 112 and 113 are in the form of an aluminum disk of 200 mm in diameter.
- the electrorheological fluid 106 is filled in the spaces between the disk 111 and the two fixed disks 112 and 113.
- independent electric fields are applied to the electrorheological fluid filled in the space between the disk 111 and the fixed disk 112, and to the electrorheological fluid filled in the space between the disk 111 and the fixed disk 113.
- Images of the virtual driving of an automobile are shown on the display 3 on the basis of the database and program which have been input to the computer 4 in advance.
- the signals from the sensor 2 for detecting steering wheel handling and a sensor 2a for detecting acceleration and braking are fed back to the computer 4, so that the images are changed in response to the operation.
- the intensity of the electric fields to be applied to the electrorheological fluid 106 is calculated by the computer 4 in cooperation with the image and the acceleration and braking.
- the computer 4 controls the electric fields applied to the electrorheological fluid 106 in accordance with the calculated intensity of the electric fields, thereby varying the flow resistance of the electrorheological fluid 106. As a result, the force sense is provided to the wheel 110.
- Fig. 10 is a schematic diagram showing a force display device used in EMBODIMENT 3 of a teleexistence system in accordance with the present invention.
- This embodiment is an example of a telereality system which operates a remote object with a robot grip.
- Fig. 10 illustrates the operation principle of the force display device.
- the telereality system employs a hydraulic system using the electrorheological fluid 106 as a circulating liquid to control the direction and force of the piston output by the intensity of the electric field applied to the electrorheological fluid 106, thereby displaying the piston output to a manipulator on the operator side as a force sense.
- the electrorheological fluid 106 is controlled such that it flows out of a pump 114, circulates the Wheatstone bridge 115, and returns to a tank 116.
- Fig. 11 is a cross-sectional view showing the structure of the Wheatstone bridge 115.
- the Wheatstone bridge 115 includes a piston 121 and four electrorheological fluid valves 117, 118, 119 and 120, each having double cylinder type electrodes.
- the piston 120 is freely moved by controlling the voltages applied to the four valves.
- the piston 121 is moved downward by substantially closing the valves 117 and 119 by applying voltages thereto to increase the viscosity of the electrorheological fluid in these valves, and by opening the valves 118 and 120 without applying any voltages, while circulating the electrorheological fluid 106.
- the piston 121 is moved upward by removing the voltages applied to the valves 117 and 119 and applying the voltages to the valves 118 and 120. By controlling the applied voltages in this way, the direction, velocity and force of the piston 121 can be freely controlled.
- the maximum force of the piston 121 is determined by the performance of the pump 114 and the electrorheological fluid 106.
- Fig. 12 shows a force display device using a Wheatstone bridge type piston 121. Fingerstalls (or a fingerstall and a thumbstall) 145 are fixed to the ends of a cylinder 144 and a piston rod 121a. This force display device is connected to the computer 4 as the force display device 1 shown in Fig. 11.
- the tactile feeling with a remote object can be displayed to the operator by making the signal from the pressure sensor 6 fixed to the grip of the robot 5 in cooperation with the movement of the piston 121, while picking up the remote object and the grip with the camera 7 to display them on the image display unit 3.
- the Wheatstone bridge 115 can be made compact using thin flexible pipes, and many Wheatstone bridges can be supplied with the electrorheological fluid from a single pump. Therefore, this method can implement a simple, compact force display device that can provide senses associated with the telereal world having multiple degrees of freedom with much reality.
- the telereality system in accordance with the present embodiment has an advantage that it is superior in response, in displaying the force sense with a feeling to be really at that place, and in making the system much more compact than the conventional systems which control the oil pressure or air pressure with mechanical fluid valves.
- Fig. 13 is a partially cross-sectioned view showing EMBODIMENT 4 of the teleexistence system in accordance with the present invention.
- This is an example of the present invention which is applied an automobile driving simulation system, to which displays active force sense.
- the automobile driving simulation system displays the passive force sense in EMBODIMENT 2 as shown in Fig. 9, the present embodiment further displays the active force sense.
- a cylindrical electrode 123 there are fixed to the shaft 122 of the wheel 110 upper and lower two disks 124, to each of which a cylindrical electrode 123 is attached.
- the shaft 122 is supported by bearings 125 at upper and lower two positions.
- Upper and lower two flanges 127 each having a ring-like deep slot 126, are rotatably mounted on the shaft 122 through the intermediary of bearings 125a.
- Each of the cylindrical electrodes 123 is rotatably inserted into the deep slot 126 in the flange 127, while keeping a 1.0 mm wide space between the inner wall of the deep slot 126.
- the respective flanges 127 are connected to a motor 129 through belts 128 such that the two flanges rotate in the opposite directions at the same speed.
- the electrorheological fluid 106 is filled by a predetermined amount into the spaces between the deep slots 126 and the cylindrical electrodes 123, and the upper and lower cylindrical electrodes 123 are supplied with independent voltages.
- an acceleration sensor 2 is attached to the bottom end of the shaft 122 to detect the position and the movement of the wheel 110 in the form of angle and rotational acceleration.
- the direction and force of the rotation of the wheel 110 can be freely controlled.
- the inertial force can be reduced by using a light material for the cylindrical electrodes 123 and flanges 127, it is possible to generate a rotational force with desired acceleration or oscillations of desired frequencies on the wheel 110.
- the force senses are displayed to the operator by calculating the voltages to be applied to the force display device 1 by the computer 4 in response to the signal from the sensor 2 and the signal to be supplied to the image display unit 3 of the driving simulation, and by supplying the calculated voltages to the cylindrical electrodes 123.
- This makes it possible to provide the operator with force senses with higher reality than the automobile driving simulation system of EMBODIMENT 2.
- the images on the image display unit 3 are generated by the computer graphics, and move in response to the signals from sensors associated with the accelerator or brakes among other signals.
- Figs. 14 and 15 are diagrams showing EMBODIMENT 5 of the teleexistence system in accordance with the present invention.
- Fig. 14 is a perspective view showing the force display device 1 that can display the force sense on an X-Y plane
- Fig. 15 is a block diagram showing the virtual reality system employing the force display device 1.
- the force display device 1 in accordance with the present embodiment employs a parallel linkage having two devices, to each of which a pulley 131, in place of the wheel 110 as shown in Fig. 13 is attached.
- the reference numeral 132 designates electrorheological fluid portions into which the electrorheological fluid 106 is filled. These portions have the same structure as the corresponding portions in Fig. 13. In other words, they are structured such that the electrorheological fluid 106 is filled into spaces between the deep slot 126 formed in the flange 127 and the cylindrical electrode 123 inserted thereinto.
- the electrorheological fluid portions 132 vary the output torques of the motors 129 in response to the voltages applied thereto, and transmit the varied torques to the pulleys 131.
- Pulleys 131a and 131b are attached to two adjacent links 133 and 134 among the four links constituting the parallel linkage (which forms a parallelogram).
- the pulleys 131a and 131b are linked to the pulleys 131 via belts 128 to transmit their rotational forces to the adjacent links 133 and 134 of the parallel linkage.
- the links 133 and 134 are rotatably fixed to a double coaxial shaft 135.
- the four links of the parallel linkage are rotatably linked to each other, and a lever 136 is fixed to a position opposite to the shaft 135. Accordingly, the lever 136 can freely move on the X-Y plane around the shaft 135 in a range limited by the length of the frames, when no rotational force is transmitted from the pulleys 131.
- the sensor 2 detects the angle and angular acceleration of the links 133 and 134 around the shaft 135, thereby outputting the position and moving speed of the links 133 and 134.
- the magnitude and direction of the forces transmitted to the lever 136 can be controlled by applying voltages calculated by the computer 4 to the electrorheological fluid portions 132 in response to the position and movement of the lever 136 while rotating the two motors 129 at a fixed speed.
- the lever 136 is a knob of a virtual room door displayed on the image display unit 3
- the force sense when the door is opened or closed can be presented through the lever 136.
- the data associated with the delicate force sense in accordance with the movement of the door and the oscillation when the door bumps against the wall are stored in the computer 4 in advance, and the voltages calculated through the calculation processing by the computer 4 are applied to the electrorheological fluid portions 132.
- Figs. 16-18 are diagrams showing EMBODIMENT 6 of the teleexistence system in accordance with the present invention.
- Fig. 16 shows the overall configuration of the system with the force display device 1 being centered
- Fig. 17 shows parallel electrodes 139
- Fig. 18 shows the state in which a virtual object 9 is grasped with the thumb and four fingers.
- This embodiment provides the operator through the force display device 1 with the forces exerted on the fingers when the soft virtual object 9 is held.
- the force display device 1 also displays the force sense by varying the viscosity of the electrorheological fluid when the intensity of the electric field applied to the electrorheological fluid is controlled.
- the thumb and fingers wear electrode units 150, each of which comprises metallic film electrodes 138 and metallic parallel plate electrodes 139.
- First ends of the metallic film electrodes 138 are connected to the backs of the fingers via metallic insulating portions 137, and second ends thereof are deeply inserted into the spaces of the parallel plate electrodes 139.
- the parallel plate electrodes 139 are provided with thin, insulating, synthetic nonwoven fabrics stuck to their surfaces which serve as spacers 105.
- the spacers 105 insulate the metallic film electrodes 138 from the parallel plate electrodes 139, and keep the spaces constant, as well.
- the electrorheological fluid 106 is filled in the spaces between the metallic film electrodes 138 and the parallel plate electrodes 139.
- Independent voltages calculated by the computer 4 are supplied between the metallic film electrodes 138 and parallel plate electrodes 139, thereby controlling the intensity of the electric fields applied to the electrorheological fluid 106.
- the movement of the fingers is detected by the position sensor 2, and the output signal of the sensor 2 is fed back to the computer 4.
- the force senses when grasping the virtual object 9 generated on the image display unit 3 by the computer graphics are displayed to the operator by supplying the electrodes 138 and 139 with the voltages calculated by the computer 4 in response to the movement of the fingers.
- the method can have three degrees of freedom in the directions, i.e., upwards and downwards, rightwards and leftwards, and around the axis normal to the sheet.
- the forces exerted on the fingers that is, the displayed forces, act in the directions normal to the finger pads.
- To generate desired display forces by the conventional manipulator type display devices it is necessary to individually control actuators by using a transform matrix, which results in a complicated system.
- the force display device of this embodiment can display the senses involved in holding objects of complicated shapes in various grasping shapes without any special control, because the flow resistance and the display forces are approximately in the same direction since the metallic film electrodes 138 are kept normal to the fingers.
- Fig. 19 shows a force display device used in EMBODIMENT 7 of the teleexistence system in accordance with the present invention.
- each electrode unit 150 comprises metallic film electrodes 138, parallel plate electrodes 139 and an electrorheological fluid 106 filled in the spaces therebetween.
- a force sensor (distortion sensor) 2 is attached to each of the metallic film electrodes 138 near the finger, and a motor 129 is mounted on the electrode unit 150 at a position near the wrist.
- the display of the active force senses can be implemented by the feedback control of the applied voltages to the electrorheological fluid 106 and of the movement of the parallel plate electrodes 139 in response to the information from the force sensors 2. Since the active senses involved in holding the virtual object 9 with fingers are primarily displayed while opening the fingers, many states can be displayed, although the degrees of freedom of the motor 129 is limited to one per finger.
- EMBODIMENT 6 described above has a problem in that the metallic film electrodes 138 are gradually pulled out of the parallel plate electrodes 139 with the bend of the fingers, thus reducing the effective areas of the electrodes. To improve this, it is necessary to adjust every moment the intensity of electric fields applied to the electrorheological fluid 106 by measuring the length of the metallic film electrodes 138, or to set the metallic film electrodes 138 very long.
- the present embodiment can solve this problem, because the electrode units 150 can be shifted by the motor 129. It is possible to control such that the effective electrode areas are kept as large as possible and nearly constant by detecting the bending amounts of the fingers by the sensors 2b fixed to the metallic film electrodes 138, and by controlling the position of the electrode units 150 by the motor 129, for example.
- LEDs can be used as the position sensors 2b.
- Fig. 20 is a block diagram showing EMBODIMENT 8 of the teleexistence system in accordance with the present invention.
- EMBODIMENT 8 is an example in which the virtual reality system is applied to a fishing game.
- An operator carries a fishhook to the mouth of a targeted fish displayed on the image display unit 3 by handling a fishing rod 42.
- the fishhook is synchronized with the image on the image display unit 3 by the computer 4.
- the computer 4 includes database and program so that when the fishhook is carried well to the mouth of the fish, it will nibble at the bait, and the feeling of a strike and tug can be obtained in response to the action of the fish.
- a force display device can be used which adjusts the tension by changing the transmitted torque by controlling the intensity of the electric field applied to the electrorheological fluid filled in the space between two parallel rotatable disk electrodes.
- the present invention relates to a system in which the flow resistance of the electrorheological fluid is synchronized with images (virtual world) generated by a computer or with a telereal world (teleexistence) that really exists and can be contacted through the intermediary of a robot, so that the force senses are displayed to an operator. It can achieve the display of movements with multiple degrees of freedom with a feeling of reality in a simple and compact device.
- This system can be applied to various fields such as design, education, training, amusement, hazardous operations, micromanipulation/super-micromanipulation, as a virtual reality or telereality (teleexistence) system.
- In the amusement for example, it can be applied to skiing, fishing, flight, walking in the sea, golf, baseball, cycling, or the like.
- the training it can be applied to automobile driving, space work; in the education, it can be applied to the standardization of skilled jobs; in the hazardous operation or micromanipulation, it can be applied to nuclear material handling, deep-sea operations, or working, assembling and processing of fine objects; in the medical treatment, it can be applied to rehabilitation of muscular strength, operations under camera monitor; in the design, it can be applied to the design of handleability of equipment or furniture.
- the force display device in accordance with the present invention serves as one of the fundamental techniques of multimedia utilizing high speed networks: it serves as'an input/output device of an information terminal like a mouse, keyboard, display or speaker, thereby making it possible to transmit information on haptic senses such as touch, grasp or rub in addition to the conventionally transmitted information like characters, images or voices.
Description
Silica or zeolite containing ionically polarizable water, acid or alkali, or organic electrolyte.
Ion exchange resin, or cellulose.
Carbon or polyaniline or metallo phthalocyanine which contains no water and causes electronic polarization rather than ionic polarization.
Claims (34)
- A teleexistence system including a virtual reality system and a telereality system, the teleexistence system comprisinga force display device (1) for providing interactively an operator with a force sense in response to a continuous action of the operator to an environment presented to the operator in the form of an image;an image display unit (3) for displaying the image in response to a given image signal, anda computer (4) for generating a force sense signal corresponding to the force sense,wherein the force display device (1) includescontrol means (12) for electrically changing the flow resistance of an electrorheological fluid (11) in response to the force sense signal, andforce providing means (15) for providing the operator with a force controlled by the flow resistance such that the operator is provided with the force sense.
- The teleexistence system as claimed in claim 1, characterized by
a sensor (2) for detecting mechanical variables of said force display device, wherein an output signal from said sensor (2) is fed back to said computer (4), so that said computer controls at least one of said force display device (1) and said image display unit (3) in response to the output signal from said sensor. - The teleexistence system as claimed in claim 2, characterized in that
said force display device (1) further comprises a driving system (14) for driving said force providing means (15). - The teleexistence system as claimed in any one of the claims 1-3, characterized in that
said environment provided in the form of an image is a telereal world, said teleexistence system further comprises image pick up means (7) for outputting said image signal by picking up said telereal world, and a telereal world sensor (6) for detecting mechanical actions in said telereal world and for feeding an output signal of said telereal world sensor back to said computer (4), and said computer generates said force signal in response to at least one of said image signal output from said image pick up means and said output signal from said telereal world sensor to provide said force signal to said force display device. - The teleexistence system as claimed in any one of claims 1-3, characterized in that
said environment provided in the form of an image is a virtual world, and said computer (4) stores images of said virtual world in advance, supplies said image signal to said image display unit (3) in response to said images of said virtual world, and supplies said force signal to said force display device (1) in response to said images of said virtual world. - The teleexistence system as claimed in one of claims 1 to 5, characterized in that
said electrorheological fluid is an electrorheological fluid exhibiting Bingham fluid characteristic when an electric field is applied to said electrorheological fluid. - The teleexistence system as claimed in one of claims 1 to 5, characterized in that
said electrorheological fluid is an electrorheological fluid exhibiting Newtonian flow characteristic when an electric field is applied to said characteristic electrorheological fluid. - The teleexistence system as claimed in one of claims 1 to 7, characterized in that
said electrorheological fluid is composed of an electrorheological fluid exhibiting Bingham fluid characteristic and an electrorheological fluid exhibiting, Newtonian flow characteristic when an electric field is applied to said electrorheological fluid. - The teleexistence system as claimed in one of claims 1 to 8, characterized in that
said force providing means (1) is in the form of a ball (101). - The teleexistence system as claimed in one of claims 1 to 8, characterized in that
said force providing means is in the form of a handle (110) of a car. - The teleexistence system as claimed in one of claims 1 to 10, characterized by speech output means for outputting a speech related to said image.
- The teleexistence system as claimed in one of claims 1 to 9 and 11, characterized in that said force providing means gives a tactile sense by pushing the operator's fingers.
- The teleexistence system as claimed in one of claims 1 to 8 characterized in that said force providing means comprises a fishing rod and said force providing means gives a tension force to said fishing rod.
- The teleexistence system as claimed in one of claims 1 to 8, 11 and 12 characterized in that said control means in which said electrorheological fluid is filled in a space between two electrodes controls the change of the flow resistance of said electrorheological fluid by applying an electric field to said electrorheological fluid.
- The teleexistence system as claimed in claim 14, characterized in that said two electrodes are provided stationarily.
- The teleexistence system as claimed in claim 14, characterized in that one of said two electrodes is provided stationarily and the other of said tow electrodes is movable.
- A method for providing a force sense in a teleexistence system which comprises a display unit (3), a computer (4) and a force display device (1) including a control unit (12) and a force providing unit (15), the method comprising steps ofproviding interactively an operator with a force sense in response to a continuous action of the operator to an environment presented in the form of an image,displaying said image in response to a given image signal on said image display unit,generating a force sense signal corresponding to said force sense, andchanging electrically the flow resistance of an electrorheological fluid (11) by said control unit in response to the force sense signal, andproviding said operator with a force controlled by said flow resistance by the force providing unit (15) such that the operator is provided with the force sense.
- The method as claimed in claim 17, wherein said teleexistence system further comprises a sensor (2) for detecting mechanical variables of said force display device, said method further characterized by comprising steps of feeding back the output signal from said sensor to said computer and controlling by said computer at least one of said force display device and said image display unit in response to the output signal from said sensor.
- The method as claimed in claim 18, wherein said force display device further comprises a driving system, said method further comprising a step of driving said force providing unit by said driving system.
- The method as claimed in one of claims 17 to 19, wherein said environment provided in the form of an image is a telereal world, and said teleexistence system further comprises an image pick up unit (7) for picking up said telereal world and a telereal world sensor, said method further comprising the steps of outputting said image signal from said image pick up unit, detecting mechanical actions.in said telereal world by said telereal world sensor, feeding an output signal of said telereal world sensor back to said computer, and generating said force signal in response to at least one of said image signal output from said image pick up and said output signal from said telereal world sensor to provides said force signal to said force display device.
- The method as claimed in one of claims 17 to 19, wherein said environment provided in the form of an image is a virtual world, and said computer stores images of said virtual world in advance, said method further comprising the steps of supplying said image signal to said image display unit in response to said images of said virtual world, and supplying said force signal to said force display device in response to said images of said virtual world.
- The method as claimed in one of claims 17 to 21, characterized in that
said electrorheological fluid is an electrorheological fluid exhibiting Bingham fluid characteristic when an electric field is applied to said electrorheological fluid. - The method as claimed in one of claims 17 to 21, characterized in that
said electrorheological fluid is an electrorheological fluid exhibiting Newtonian flow characteristic when an electric field is applied to said electrorheological fluid. - The'method as claimed in one of claims 17 to 23, characterized in that
said electrorheological fluid is composed of an electrorheological fluid exhibiting Bingham fluid characteristic and an electrorheological fluid exhibiting Newtonian flow characteristic when an electric field is applied to said electrorheological fluid. - The method as claimed in one of claims 17 to 24, characterized in that
said force providing means is in the form of a ball (101). - The method as claimed in one of claims 17 to 24, characterized in that
said force providing unit is in the form of a handle of a car (110). - The method as claimed in one of claims 17 to 26, characterized in that said teleexistence system further comprises a speech output unit, said method further comprising a step of outputting a speech related to said image by said speech output unit.
- The method as claimed in one of claims 17 to 25 and 27, characterized in that said force providing unit gives a tactile sense by pushing the operator's fingers.
- The method as claimed in claim one of claims 17 to 24, characterized in that said force providing unit comprises a fishing rod and said force providing unit provides a tension force to said fishing rod.
- The method as claimed in one of claims 17 to 24 and 28, characterized in that said control unit in which said electrorheological fluid is filled in a space between two electrodes controls the change of the flow resistance of said electrorheological fluid by applying an electric field to said electrorheological fluid.
- The method as claimed in claim 30, characterized in that said two electrodes are provided stationarily.
- The method as claimed in claim 30, characterized in that one of said two electrodes is provided stationarily and the other of said tow electrodes is movable.
- A computer program having program code means readable by a computer (4) included in a teleexistence system which comprises an image display unit (3), the computer (4) and a force display device (1) including a control unit (12) and a force providing unit (15), said program code means comprisingfirst program code means for providing interactively an operation with a force sense in response to a continuous action of the operator to an environment presented in the form of an image in a teleexistence system including a virtual reality system,second program code means for displaying the image in response to a given signal on said image display unit (3),third program code means for generating said force sense signal by said computer (4),fourth program code means for changing electrically the flow resistance of an electrorheological fluid (11) by said control unit (12) in response to the force sense signal, and providing said operator with a force controlled by said flow resistance such that the operator is provided with said force sense, andfifth program code means for synchronizing said image display unit and said force display device (1).
- A computer program product having a computer program according to claim 33 recorded therein.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP16679194 | 1994-07-19 | ||
JP166791/94 | 1994-07-19 | ||
JP16679194 | 1994-07-19 | ||
PCT/JP1995/001426 WO1996002887A1 (en) | 1994-07-19 | 1995-07-18 | Virtual reality and remote reality system |
Publications (3)
Publication Number | Publication Date |
---|---|
EP0775961A1 EP0775961A1 (en) | 1997-05-28 |
EP0775961A4 EP0775961A4 (en) | 1997-10-22 |
EP0775961B1 true EP0775961B1 (en) | 2001-10-17 |
Family
ID=15837744
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP95925143A Expired - Lifetime EP0775961B1 (en) | 1994-07-19 | 1995-07-18 | Virtual reality and remote reality system |
Country Status (9)
Country | Link |
---|---|
US (1) | US6310604B1 (en) |
EP (1) | EP0775961B1 (en) |
JP (1) | JP3585498B2 (en) |
KR (1) | KR100222628B1 (en) |
CN (1) | CN1135480C (en) |
CA (1) | CA2195227C (en) |
DE (1) | DE69523323T2 (en) |
RU (1) | RU2131621C1 (en) |
WO (1) | WO1996002887A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI490628B (en) * | 2011-09-23 | 2015-07-01 | Nat Inst Chung Shan Science & Technology | Virtual reality video control method |
Families Citing this family (59)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7113166B1 (en) * | 1995-06-09 | 2006-09-26 | Immersion Corporation | Force feedback devices using fluid braking |
DE19528457C2 (en) * | 1995-08-03 | 2001-03-08 | Mannesmann Vdo Ag | Control device |
US6297805B1 (en) | 1997-08-29 | 2001-10-02 | Xerox Corporation | Multiple interacting computers interfaceable through a physical manipulatory grammar |
US6243075B1 (en) | 1997-08-29 | 2001-06-05 | Xerox Corporation | Graspable device manipulation for controlling a computer display |
US6243074B1 (en) | 1997-08-29 | 2001-06-05 | Xerox Corporation | Handedness detection for a physical manipulatory grammar |
US6268857B1 (en) | 1997-08-29 | 2001-07-31 | Xerox Corporation | Computer user interface using a physical manipulatory grammar |
JP4149574B2 (en) * | 1997-08-29 | 2008-09-10 | ゼロックス コーポレイション | User interface support device and information input method |
US6297838B1 (en) | 1997-08-29 | 2001-10-02 | Xerox Corporation | Spinning as a morpheme for a physical manipulatory grammar |
US7159009B2 (en) * | 1997-12-17 | 2007-01-02 | Sony Corporation | Method and apparatus for automatic sending of e-mail and automatic sending control program supplying medium |
US6195085B1 (en) * | 1998-04-07 | 2001-02-27 | International Business Machines Corporation | Apparatus in a computer system for pliant ergonomic pointing device |
US6339419B1 (en) * | 1998-11-10 | 2002-01-15 | Lord Corporation | Magnetically-controllable, semi-active haptic interface system and apparatus |
KR20000042575A (en) * | 1998-12-26 | 2000-07-15 | Daewoo Electronics Co Ltd | Vr system for exercise |
KR20000043370A (en) * | 1998-12-29 | 2000-07-15 | Daewoo Electronics Co Ltd | Vr system for exercise |
US6976215B1 (en) * | 1999-12-20 | 2005-12-13 | Vulcan Patents Llc | Pushbutton user interface with functionality preview |
BR0108399A (en) * | 2000-02-15 | 2004-01-06 | Yong-Nam Park | Internet-based extended order communication system and method |
KR100542016B1 (en) * | 2000-03-21 | 2006-01-10 | 주식회사 한발 | The Real Time Cyber Space |
US7196688B2 (en) * | 2000-05-24 | 2007-03-27 | Immersion Corporation | Haptic devices using electroactive polymers |
US7084854B1 (en) | 2000-09-28 | 2006-08-01 | Immersion Corporation | Actuator for providing tactile sensations and device for directional tactile sensations |
US6491649B1 (en) * | 2000-10-06 | 2002-12-10 | Mark P. Ombrellaro | Device for the direct manual examination of a patient in a non-contiguous location |
AU1159402A (en) * | 2000-10-06 | 2002-04-15 | Mark P Ombrellaro | Device for the direct manual examination of a patient in a non-contiguous location |
US20050149364A1 (en) * | 2000-10-06 | 2005-07-07 | Ombrellaro Mark P. | Multifunction telemedicine software with integrated electronic medical record |
US7176895B2 (en) * | 2000-12-29 | 2007-02-13 | International Business Machines Corporation | Wearable keyboard apparatus |
JP4618661B2 (en) * | 2001-06-22 | 2011-01-26 | 株式会社Ihiエアロスペース | Image supply system |
DE10138537B4 (en) * | 2001-08-06 | 2006-07-06 | Siemens Ag | Tactile feedback to visualize tissue elasticity |
US7623114B2 (en) | 2001-10-09 | 2009-11-24 | Immersion Corporation | Haptic feedback sensations based on audio output from computer devices |
US7008231B2 (en) * | 2002-01-23 | 2006-03-07 | Patrick Pesnell | Catching training apparatus |
US7471280B2 (en) * | 2002-06-19 | 2008-12-30 | Koninklijke Philips Electronics N.V. | Tactile device |
JP2004213350A (en) * | 2002-12-27 | 2004-07-29 | Seiko Epson Corp | Inner force sense presenting device and image correcting method |
JP2005348779A (en) * | 2004-06-08 | 2005-12-22 | Asahi Kasei Engineering Kk | Kinetic rehabilitation and training system |
US8232969B2 (en) | 2004-10-08 | 2012-07-31 | Immersion Corporation | Haptic feedback for button and scrolling action simulation in touch input devices |
JP2006247280A (en) * | 2005-03-14 | 2006-09-21 | Osaka Univ | Upper extremity rehabilitation apparatus |
US7825903B2 (en) | 2005-05-12 | 2010-11-02 | Immersion Corporation | Method and apparatus for providing haptic effects to a touch panel |
JP4944692B2 (en) * | 2007-07-13 | 2012-06-06 | 今在家精工株式会社 | Motion control device and motor function training device for movable member |
MX2008014783A (en) | 2008-02-05 | 2009-08-27 | Krueger Int Inc | Chair shell with integral hollow contoured support. |
US8350843B2 (en) * | 2008-03-13 | 2013-01-08 | International Business Machines Corporation | Virtual hand: a new 3-D haptic interface and system for virtual environments |
US8203529B2 (en) * | 2008-03-13 | 2012-06-19 | International Business Machines Corporation | Tactile input/output device and system to represent and manipulate computer-generated surfaces |
KR101557025B1 (en) * | 2008-11-14 | 2015-10-05 | 삼성전자주식회사 | 3 3d interface apparatus and interface method using the same |
JP2011039647A (en) * | 2009-08-07 | 2011-02-24 | Sony Corp | Device and method for providing information, terminal device, information processing method, and program |
FR2950187B1 (en) * | 2009-09-17 | 2011-11-18 | Centre Nat Rech Scient | METHOD OF SIMULATION OF CLEAN MOVEMENTS BY HAPTIC RETURN AND DEVICE IMPLEMENTING THE METHOD |
US8542105B2 (en) | 2009-11-24 | 2013-09-24 | Immersion Corporation | Handheld computer interface with haptic feedback |
KR101685922B1 (en) * | 2010-04-05 | 2016-12-13 | 삼성전자주식회사 | Method and Apparatus for Processing Virtual World |
CN103250203B (en) * | 2011-01-13 | 2015-07-01 | 英派尔科技开发有限公司 | Haptic feedback device using electro-heological fluid |
CA2878554A1 (en) * | 2012-06-18 | 2013-12-27 | Matthias Rath | Integrated interactive system and method for visualizing human physiology, disease, treatment options and use |
KR101490617B1 (en) * | 2013-08-30 | 2015-02-05 | 주식회사 포스코 | Muscular strenght transmission apparatus and assist muscular strenght supporting robot having the same |
CN104308844A (en) * | 2014-08-25 | 2015-01-28 | 中国石油大学(华东) | Somatosensory control method of five-finger bionic mechanical arm |
RU2592392C2 (en) * | 2014-08-27 | 2016-07-20 | Федеральное государственное автономное образовательное учреждение высшего образования "Уральский федеральный университет имени первого Президента Б.Н. Ельцина" | Information processing device and 3d images of problematic object |
CN104323859B (en) * | 2014-11-10 | 2016-08-24 | 上海速介机器人科技有限公司 | Blood vessel intervention operation robot guide wire resistive haptic reduction apparatus and control method thereof |
CN113817529A (en) * | 2015-12-04 | 2021-12-21 | 旭化成株式会社 | Electrorheological fluid and electrical equipment |
CN206643787U (en) * | 2016-01-07 | 2017-11-17 | 昭和电工气体产品株式会社 | Peener annex and peener |
JP6600269B2 (en) * | 2016-03-22 | 2019-10-30 | 日本放送協会 | Three-dimensional shape presentation system and haptic sense presentation device |
CN105922262A (en) * | 2016-06-08 | 2016-09-07 | 北京行云时空科技有限公司 | Robot and remote control equipment and remote control method thereof |
RU176660U1 (en) * | 2017-06-07 | 2018-01-24 | Федоров Александр Владимирович | VIRTUAL REALITY GLOVE |
RU176318U1 (en) * | 2017-06-07 | 2018-01-16 | Федоров Александр Владимирович | VIRTUAL REALITY GLOVE |
CN107566510B (en) * | 2017-09-20 | 2020-12-01 | 歌尔光学科技有限公司 | Remote medical diagnosis service system |
JP6874149B2 (en) * | 2017-10-26 | 2021-05-19 | 株式会社ソニー・インタラクティブエンタテインメント | Image processing equipment, image processing methods and programs |
RU2673406C1 (en) * | 2017-10-27 | 2018-11-26 | Федоров Александр Владимирович | Method of manufacturing virtual reality glove |
JP6959991B2 (en) * | 2017-12-19 | 2021-11-05 | 株式会社ソニー・インタラクティブエンタテインメント | Information processing equipment, information processing methods, and programs |
US20200286298A1 (en) * | 2019-03-06 | 2020-09-10 | Immersion Corporation | Systems and methods for a user interaction proxy |
JP7319813B2 (en) * | 2019-04-17 | 2023-08-02 | 日本放送協会 | Haptic presentation system, haptic presentation device, and program |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
IS2972A7 (en) * | 1985-01-21 | 1986-01-21 | Style Ltd., Ragnar Magnusson | Automatic, micro-controlled jigging reel. |
US5071581A (en) * | 1990-03-01 | 1991-12-10 | The Dow Chemical Company | Electrorheological fluids based on crown ethers and quaternary amines |
US5143505A (en) | 1991-02-26 | 1992-09-01 | Rutgers University | Actuator system for providing force feedback to a dextrous master glove |
GB2263179B (en) | 1992-01-04 | 1996-03-27 | British Aerospace | Apparatus for selectively controlling movement |
GB2265746B (en) | 1992-04-04 | 1995-07-19 | Gareth John Monkman | Electrorheological tactile display |
US5830065A (en) * | 1992-05-22 | 1998-11-03 | Sitrick; David H. | User image integration into audiovisual presentation system and methodology |
JP3170875B2 (en) * | 1992-05-30 | 2001-05-28 | ソニー株式会社 | Input device |
US5316261A (en) * | 1992-10-26 | 1994-05-31 | Northern Research & Engineering Corp. | Fluid conduit having a variable inner diameter |
US5451924A (en) * | 1993-01-14 | 1995-09-19 | Massachusetts Institute Of Technology | Apparatus for providing sensory substitution of force feedback |
US5749807A (en) * | 1993-01-19 | 1998-05-12 | Nautilus Acquisition Corporation | Exercise apparatus and associated method including rheological fluid brake |
JP3444638B2 (en) * | 1993-01-25 | 2003-09-08 | 旭化成株式会社 | Control amount control device |
US5734373A (en) * | 1993-07-16 | 1998-03-31 | Immersion Human Interface Corporation | Method and apparatus for controlling force feedback interface systems utilizing a host computer |
DE4332580A1 (en) | 1993-09-24 | 1995-03-30 | Deutsche Aerospace | Apparatus for reconstructing or simulating the sense of touch in a surgical instrument |
US5577981A (en) * | 1994-01-19 | 1996-11-26 | Jarvik; Robert | Virtual reality exercise machine and computer controlled video system |
-
1995
- 1995-07-18 US US08/776,054 patent/US6310604B1/en not_active Expired - Fee Related
- 1995-07-18 WO PCT/JP1995/001426 patent/WO1996002887A1/en active IP Right Grant
- 1995-07-18 JP JP50489396A patent/JP3585498B2/en not_active Expired - Fee Related
- 1995-07-18 RU RU97102354A patent/RU2131621C1/en not_active IP Right Cessation
- 1995-07-18 CN CNB95194777XA patent/CN1135480C/en not_active Expired - Fee Related
- 1995-07-18 KR KR1019970700351A patent/KR100222628B1/en not_active IP Right Cessation
- 1995-07-18 CA CA002195227A patent/CA2195227C/en not_active Expired - Fee Related
- 1995-07-18 DE DE69523323T patent/DE69523323T2/en not_active Expired - Fee Related
- 1995-07-18 EP EP95925143A patent/EP0775961B1/en not_active Expired - Lifetime
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI490628B (en) * | 2011-09-23 | 2015-07-01 | Nat Inst Chung Shan Science & Technology | Virtual reality video control method |
Also Published As
Publication number | Publication date |
---|---|
DE69523323D1 (en) | 2001-11-22 |
EP0775961A4 (en) | 1997-10-22 |
CA2195227A1 (en) | 1996-02-01 |
CN1135480C (en) | 2004-01-21 |
KR970705095A (en) | 1997-09-06 |
DE69523323T2 (en) | 2002-07-04 |
US6310604B1 (en) | 2001-10-30 |
EP0775961A1 (en) | 1997-05-28 |
CN1156513A (en) | 1997-08-06 |
RU2131621C1 (en) | 1999-06-10 |
CA2195227C (en) | 2002-10-29 |
WO1996002887A1 (en) | 1996-02-01 |
JP3585498B2 (en) | 2004-11-04 |
KR100222628B1 (en) | 1999-10-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0775961B1 (en) | Virtual reality and remote reality system | |
Sreelakshmi et al. | Haptic technology: A comprehensive review on its applications and future prospects | |
US5436638A (en) | Image display method and apparatus with means for yoking viewpoint orienting muscles of a user | |
US6278439B1 (en) | Method and apparatus for shaping force signals for a force feedback device | |
Biggs et al. | Haptic interfaces | |
Massie | Design of a three degree of freedom force-reflecting haptic interface | |
US7084884B1 (en) | Graphical object interactions | |
Buss et al. | Control problems in multi-modal telepresence systems | |
O’malley et al. | Haptic interfaces | |
Ooka et al. | Virtual object manipulation system with substitutive display of tangential force and slip by control of vibrotactile phantom sensation | |
Bar-Cohen et al. | Virtual reality robotic telesurgery simulations using MEMICA haptic system | |
Iwata | History of haptic interface | |
KR102234776B1 (en) | A virtual reality or game controller using haptic wheel, a control method, and virtual reality system having the same | |
CN101739129B (en) | Four freedom degrees flexible cable driven man-machine interaction device capable of feeding back grasping force | |
Deng et al. | A survey of haptics in serious gaming | |
Dettori et al. | Art Touch with CREATE haptic interface | |
Mo et al. | Analysis and performance evaluation of a 3-DOF wearable fingertip device for haptic applications | |
CN1736670A (en) | Fingerstall type force feeling feedback generator | |
Bejczy | Teleoperation and telerobotics | |
Sawahashi et al. | Development of a wearable four-degrees-of-freedom force feedback device with a clutch mechanism using artificial muscle contraction | |
Sawahashi et al. | Development of a Bimanual Wearable Force Feedback Device with Pneumatic Artificial Muscles, MR Fluid Brakes, and Sensibility Evaluation Based on Pushing Motion | |
Kojima et al. | Grip-Type Pseudo Force Display with Normal and Tangential Skin Stimulation | |
Pott | Haptic interfaces | |
Puerto et al. | Control strategies applied to kinesthetic haptic devices | |
Basdogan et al. | Perception of Soft Objects in Virtual Environments Under Conflicting Visual and Haptic Cues |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 19970116 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): DE FR IT |
|
A4 | Supplementary search report drawn up and despatched | ||
AK | Designated contracting states |
Kind code of ref document: A4 Designated state(s): DE FR IT |
|
17Q | First examination report despatched |
Effective date: 20000126 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ASAHI KASEI KABUSHIKI KAISHA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR IT |
|
REF | Corresponds to: |
Ref document number: 69523323 Country of ref document: DE Date of ref document: 20011122 |
|
ET | Fr: translation filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20030711 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20030731 Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050331 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050718 |