WO2006076173A2 - Enhancement of visual perception - Google Patents

Enhancement of visual perception Download PDF

Info

Publication number
WO2006076173A2
WO2006076173A2 PCT/US2005/047577 US2005047577W WO2006076173A2 WO 2006076173 A2 WO2006076173 A2 WO 2006076173A2 US 2005047577 W US2005047577 W US 2005047577W WO 2006076173 A2 WO2006076173 A2 WO 2006076173A2
Authority
WO
WIPO (PCT)
Prior art keywords
viewer
dimensional image
image
enhancement
visually identifiable
Prior art date
Application number
PCT/US2005/047577
Other languages
French (fr)
Other versions
WO2006076173A3 (en
Inventor
Anthony Provitola
Original Assignee
Anthony Provitola
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/033,186 external-priority patent/US7073908B1/en
Priority claimed from US11/222,733 external-priority patent/US7086735B1/en
Application filed by Anthony Provitola filed Critical Anthony Provitola
Priority to EA200701457A priority Critical patent/EA013779B1/en
Priority to CA002593243A priority patent/CA2593243A1/en
Priority to MX2007008424A priority patent/MX2007008424A/en
Priority to BRPI0518498-3A priority patent/BRPI0518498A2/en
Priority to JP2007551283A priority patent/JP2008527918A/en
Priority to EP05856050A priority patent/EP1836531A4/en
Priority to AU2005324379A priority patent/AU2005324379A1/en
Publication of WO2006076173A2 publication Critical patent/WO2006076173A2/en
Publication of WO2006076173A3 publication Critical patent/WO2006076173A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/40Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images giving the observer of a single two-dimensional [2D] image a perception of depth
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00Details of stereoscopic systems
    • H04N2213/006Pseudo-stereoscopic systems, i.e. systems wherein a stereoscopic effect is obtained without sending different images to the viewer's eyes

Definitions

  • the field of the invention pertains to systems, devices, and methods for enhancing the visual perception of a viewer in a two-dimensional image, which includes enhancement of the viewer's perception of depth and clarity in a two-dimensional image.
  • This field of invention is distinct from that of Garcia, U.S. Patent No. 5,510,832: synthesized stereoscopic imaging from two-dimensional images.
  • Garcia adequately discusses the utility and merits of simulation of 3D video from two-dimensional video sources.
  • the field of the present invention is also distinct from that of Ashbey, U.S. Patent No. 5,541,642: stereoscopic imaging with interlaced video through a lenticular decoder screen.
  • Ashbey also discusses derivation of stereoscopic effects from a "monoscopic” source by simultaneously displaying successive frames of a motion picture with lateral displacement through his system.
  • the use of the terms “two-dimensional”, “monoscopic”, and “monocular” have been used in the prior art to distinguish the viewing of single images from that which is “stereoscopic” — the quality of vision with which a human viewer with two normal eyes and the ability for stereopsis sees a scene in physical (three-dimensional) space with objects at varying distances from the viewer.
  • the term "two-dimensional” as an adjective for the term "image” does not mean that the image does not represent a three-dimensional scene, i.e.
  • the term "three-dimensional” or “3D” as applied to an image does not necessarily mean that it is stereoscopic, but may also mean that it is an image displayed on a two- dimensional surface, flat or curved, and/or which may be manipulated so that the objects represented therein are viewable at different angles, either by rotation of the object or the variation in the angle of view with an apparent change in position of the viewer;
  • Le May uses a window screen type mesh in a device to be worn by a viewer through which a two- dimensional television image is viewed, and creates, according to its inventor, an "illusion".
  • the present invention in its preferred embodiments, does not require any type of eye wear or worn device, and provides a natural stereo vision experience in the viewing of two-dimensional images of all kinds, including photographs, posters, drawings and paintings, signs, television and motion pictures, and projected images in general.
  • the present invention does not rely upon an "illusion", but enhances the viewer's perception of depth in the monocular depth cues and perception of clarity in a two- dimensional image.
  • the present invention should be distinguished from stereographic devices and methods providing stereoscopic vision which require simultaneous or alternated display of two images, still or motion picture, each image being of one of two monocular views, actual or simulated, of a binocular view of a scene, which must be viewed with special viewing glasses or display lens; whereas the present invention involves the display of only one image, still or motion picture, of a single monocular view of the scene.
  • the stereo vision provided by the prior art is artificial in appearance as discussed in Garcia.
  • Stereographic devices have been well known for many years, while the principle underlying the present invention, although not yet completely understood, is newly presented in this application.
  • the present invention should also be distinguished from the well-known effect that is observed with monocular viewing of a two-dimensional image with monocular depth cues against a featureless or flat background without such cues.
  • the same effect can also be observed by monocular viewing of a two-dimensional image at the end of an enclosed space. With such a viewing the monocular depth cues in the two-dimensional image become pronounced, albeit seen with only one eye.
  • Such monocular viewing not only involves the discomfort of viewing with only one eye, but more importantly deprives the viewer of the accommodation reflex which occurs with binocular vision that gives the viewer the ability to accurately focus on the two-dimensional image.
  • the present invention operates very differently: the viewer's depth perception and perception of clarity in a two-dimensional image is enhanced by inducing a retinal disparity in the viewer that results in a fusion experience.
  • the two-dimensional image can be seen binocularly with the accurate focus of the accommodation reflex. Such accurate focus in turn heightens the fusion experience, and thus the enhancement of depth perception and perception of clarity afforded by the present invention.
  • the present invention provides enhanced perception of clarity for the viewer in a two- dimensional image. This effect became known during the testing of the depth perception enhancement effect from the assertions of many viewer-subjects that the two-dimensional images they viewed with the invention were "clearer" than without the system. Such an effect appears to have a basis in the notions of eye dominance and binocular retinal rivalry.
  • the enhancement of clarity of the present invention should be distinguished from eye wear, lens systems, and surgical procedures for gaining improved focus of images on the retina, which are all well-known. Distinction should also be made between the present invention and eye exercise systems, discussed extensively in Liberman, U. S. Patent Number 6,742,892 (along with an informative tract on eye anatomy, function and optics), which are primarily concerned with the improvement of eye tracking, convergence and accommodation.
  • the present invention provides enhancement of a viewer's visual perception in a single two-dimensional image, which includes enhancement of the depth perception of a viewer in various types of two-dimensional images that include monocular cues for depth, and thereby the experience of stereo vision in the viewing by such enhancement of the viewer's perception of those monocular depth cues.
  • Such an enhancement is effected by the present invention with the induction of a slight but sufficient retinal disparity in the viewer's view of the two-dimensional image.
  • Such a retinal disparity is experienced by a viewer with a normal capacity for stereopsis as the fusion of retinally disparate images which include the two-dimensional image, the "enhancement effect" of the present invention.
  • the present invention so enhances the viewer's perception of the monocular depth cues in a single two-dimensional image as to cause the viewer to experience the fusion of stereo vision. Also a part of the enhancement effect andincluded in the invention is the enhancement of the "clarity " with which the viewer perceives a two-dimensional image, that is, the increase in resolution of the two-dimensional image as perceived by the viewer.
  • the present invention comprises the creation for the viewer of what is referred to herein as an "enhanced scene" which includes a single two-dimensional image.
  • Such an enhanced scene may be created by the invention, examples of which are: 1) the placement in front of the two-dimensional image of a visually identifiable object; 2) the horizontal movement of the two-dimensional image on the surface upon which the two-dimensional image is displayed; and 3) the display and horizontal movement of a visually identifiable object, or an image of such, on or at the surface upon which the two-dimensional image is displayed. All of these ways may be effected mechanically, electronically, optically, or by computer programming, or by a combination of such means.
  • the currently preferred way to create an enhanced scene is the first way stated above, such an enhanced scene being also be referred to herein as a "combined scene", i.e.
  • the creation of the enhanced scene within which the two-dimensional image is presented for viewing causes a retinal disparity in the viewer of the two-dimensional image.
  • the retinal disparity is induced spatially, by reason of the viewer's binocular viewing of the enhanced scene, and is slight but sufficient to cause the viewer to experience the enhancement effect.
  • the retinal disparity is temporally induced, i.e. by the enhanced scene changing in time.
  • the currently preferred visually identifiable object is frame a which completely or partially surrounds the viewer's area of interest in the two-dimensional image. Such a frame may have other features, such as illumination, shape, and color, that can add to the enhancement effect by combination and/or control with reference to the qualities of the two-dimensional image and the viewer's vision.
  • the system may include means for obscuring the edge of the two-dimensional image, where the edge of the two- dimensional image is sufficiently well defined to detract from the enhancement effect; and may also include a background mask for the enhanced scene to prevent the diminution of the enhancement effect by the visual environment in which the system is operating.
  • the present invention provides a system, device within a system, and method for enhancing a viewer's visual perception in a two-dimensional image, which enhances the depth perception of a viewer in various types of two-dimensional images that include monocular cues for depth, and enhances the "clarity" with which the viewer perceives a two-dimensional image.
  • the term "clarity” is used herein to mean the resolution with which the two-dimensional image is perceived by the viewer, and not the focus of the two-dimensional image.
  • the effect of these enhancements shall hereinafter be referred to as the “enhancement effect”.
  • the enhancement effect being twofold, the aspects thereof shall be referred to as the “depth perception enhancement effect” and the “clarity enhancement effect” when the distinction is necessary. Otherwise, the term “enhancement effect” should be understood to mean either or both, depending on the context.
  • the present invention is described herein as a "device within a system", rather than simply a “device", because the device that is employed receives its identity and function according to an interactive relationship with the other elements of the system and/or the visual system of a viewer.
  • the term visual system shall be taken to mean the human visual system, including the eyes and all of their internal structures, the optic nerves, all neural structures associated with all other functions of eye movement, protection, or control; and all neural structures by which data collected by the eyes is processed, recorded and interpreted, including the human brain, particularly the visual cortex.
  • Binocular visual field region of overlapping visibility for the two eyes.
  • Point of Fixation Point or object on which the eyes are directed and one's sight is fixed.
  • Fovea Point on the retina on which are focused the rays coming from an object directly regarded, i.e. from the point of regard.
  • Monocular depth cues Visual cues which present information about the relative location of objects using one eye, which include: occlusion or interposition; aerial perspective (atmospheric perspective, aerial haze); linear perspective (convergence of parallel lines); relative height; texture gradients; shading and light; relative size; relative motion (monocular movement parallax); and familiar size.
  • Retinal disparity Differences between two or more images projected on the retina of the eye with reference to the fovea of the retina.
  • Fusion Neural process commonly referred to as stereoscopic vision (or stereo vision) thought to occur in the visual cortex that brings two retinal images to form a single image which is known as the single cyclopean image.
  • Panum's fusional region Region in visual space over which humans perceive binocular single vision derived from the fusion of binocular retinal images. (Outside Panum's fusional region physiological diplopia occurs.)
  • Panum's fusional area Area on the retina of one eye, any point on which, when stimulated simultaneously with a single specific slightly disparate point in the retina of the other eye, will give rise to a single fused image.
  • Retinally disparate points Retinal points which can give rise to different principal visual directions, which, when within Panum's fusional area (zone of single binocular vision), can be fused resulting in single vision.
  • Retinally disparate images Retinal images which are comprised of retinally disparate points.
  • Retinal disparity The difference in the retinal images that results from retinally disparate points of retinal images detected in the visual cortex which, if within Panum's fusional area (zone of single binocular vision), can be fused resulting in single vision.
  • Stereopsis Ability to perceive depth produced by retinal disparity within Panum's fusional area requiring properly functioning binocular cells thought to exist in the visual cortex: the ability to distinguish the relative distance of objects resulting from the lateral displacement of the eyes that provides two slightly different views of the same object (disparate images).
  • Binocular retinal rivalry Alternating suppression of the two eyes resulting in alternating perception of the two retinal images.
  • the present invention provides a viewer who has the capacity for stereopsis with the experience of stereo vision in the viewing of a single two-dimensional image, hereinafter referred to as the "2D image", by enhancing the viewer's perception of depth in the monocular depth cues in the 2D image. That is, the depth perception enhancement effect of the present invention so enhances the viewer's perception of the monocular depth cues in a single two-dimensional image as to cause the viewer to experience the fusion of stereo vision with respect to the content of that 2D image.
  • the present invention provides a viewer who has the capacity for stereopsis with enhancement of the viewer's perception of clarity in viewing a 2D image, even without the presence of monocular depth cues therein.
  • Such enhancements are effected by the present invention with the stimulation of a slight but sufficient retinal disparity on the Panum's fusional area of the viewer.
  • a retinal disparity is experienced by a viewer with a normal capacity for stereopsis as the fusion of binocular views of the 2D image when viewed with the present invention.
  • the theoretical foundation for the clarity enhancement effect also resides in the phenomena of eye dominance in humans, i.e., the dominant eye more strongly contributes to binocular vision than the other, and is said to be the eye that looks directly at an object; and the phenomena of binocular retinal rivalry, i.e., alternating perception of the two retinal images - indicating that the retinal image from only one eye at a time is being neurally recorded in the visual cortex. If it is the fusion of slightly disparate retinal images in the visual cortex that provides the experience of stereo vision, then a diminution of the strength of one of such images in the visual cortex must diminish the experience.
  • the system is here exemplified in various embodiments: mechanical (static and dynamic), electromechanical, electrical, electronic, optical, and by computer programming. All of the embodiments are designed to produce the enhancement effect for the viewer of a 2D image by a fusion experience resulting from the viewing of an "enhanced scene", hereinafter referred to as such, that includes the 2D image and the device within the system, the viewing of which causes a retinal disparity in the viewer.
  • such retinal disparity may be spatial and/or temporal: spatial retinal disparity resulting from creation of retinal images with different eye locations, as where an enhanced scene includes mechanical elements spatially arranged with the 2D image and is viewed binocularly (with separation of the viewer's eyes); temporal retinal disparity resulting from the creation of retinal images at different times, as when an enhanced scene changes over time with the motion of its elements and/or motion of the viewer's eye.
  • FIGS. 1-3 and FIGS. 13-19 show different examples of the fundamental embodiment, with FIG. 1 showing the a simple frame example, FIG. 2 showing a hood- frame example, FIG. 3 showing a simple-frame projection example , and FIGS. 13-19 showing various partial frame examples for various forms of display, the partial-frames being pairs of vertically oriented panels which bound the 2D image only on the sides.
  • the 2D image 1 is referred to as such because it is substantially representable using coordinates of only two dimensions, regardless of the shape of the image surface 3, such as on an embossed surface, having a discernable texture, or the surface of a relief.
  • the 2D image may be of any kind, including photographs, posters, drawings, paintings, signs, television and computer images; and all forms of front and rear projection images, film or electronic, both still and motion; however viewed, either directly or by other means; or whether generated or displayed mechanically, optically, or electronically.
  • the term "2D image” as used in this disclosure may represent a three-dimensional scene, which is a scene with one or more monocular depth cues related to objects and/or surfaces at varying apparent distances from the viewer.
  • a 2D image need not have any monocular depth cues in order for it to be viewed with the clarity enhancement effect; but in order to be viewed with the depth perception enhancement effect where not representing a three-dimensional scene, the 2D image must have at a minimum some monocular depth cue, even if only contrived for that purpose.
  • image surface 3 The surface upon which a 2D image is presented shall be referred to as the "image surface" 3, which may be flat, faceted, horizontally and/or vertically curved, spherical, some other shape, or as previously discussed herein, and may be a surface which is not associated with a solid physical object, such as a sheet flow, spray of liquid, or cloud of vapor; or may be a surface defined by the 2D image in physical space not associated with any physical object at all.
  • image surface may be flat, faceted, horizontally and/or vertically curved, spherical, some other shape, or as previously discussed herein, and may be a surface which is not associated with a solid physical object, such as a sheet flow, spray of liquid, or cloud of vapor; or may be a surface defined by the 2D image in physical space not associated with any physical object at all.
  • the term "horizontal”, as referred to in all its derivative forms as well shall mean a direction substantially parallel to the orientation of the viewer's eyes, i.e. in the direction of the line joining the center of the viewer's eyes, even though not horizontal in relation to the earth's surface; or the direction of a component of the distance vector between two points in space (from the vector representation of location, wherein the distance vector of a location is resolved into two component distance vectors at right angles, the magnitude of the resolved vector being the magnitude of the hypotenuse of the right triangle formed by the resolved distance vector with its components), which is substantially parallel to the orientation of the viewer's eyes.
  • vertical as referred to in all its derivative forms as well (such as “vertically"), shall mean a direction substantially within the plane perpendicular to said horizontal direction and substantially perpendicular to the direction of view of the viewer.
  • An object 6 upon which an image surface 3 may be displayed or otherwise exist shall hereinafter be referred to as the
  • image object 6 may be solid, liquid or gaseous.
  • the system for enhancement of visual perception includes a 2D image 1 which is displayed on an image surface 3, and a device within the system, which shall hereinafter be referred to as an "enhancer".
  • the enhancer is a visually identifiable object, hereinafter referred to as a "VIO" 2, which is a physical object that is placed in front of the 2D image 1 (and thus in front of the image surface 3), visually discernable by the viewer as a distinct entity substantially separate from the 2D image 1, and not masked by confusion with the content of the 2D image 1 behind it.
  • VIO visually identifiable object
  • VIO in front of the 2D image does not imply that any part of a 2D image is blocked from the viewer's view by the VIO.
  • the VIO 2 in front of the 2D image 1 be substantially within the depth of field of the viewer 9, i.e. substantially in focus for the viewer's 9 eyes 10 as they are focused on the 2D image 1, so that the entire enhanced scene 13 is also substantially in focus for the viewer 9. It is also preferable that the VIO 2 be located within the viewer's Panum's fusional region for the 2D image 1 , and the preferred location of the VIO 2 within the Panum's fusional region is in the boundary space of the Panum's fusional region: the space within the Panum's fusional region where the distance from the 2D image is significantly greater than the distance from the boundary of the Panum's fusional region in front of the 2D image.
  • the VIO 2 may be opaque, translucent, transparent, or transparent with distortion.
  • the preferred VIO 2 should have a clearly defined boundary 7 which can be readily focused upon when viewed by the viewer 9.
  • the VIO 2 may obscure a part 11 of the 2D image
  • VIO 2 should also be such that the clearly defined boundary 7 of the VIO 2 nearest to the viewer 9 is a sufficient distance away from the 2D image 1 to render two slightly disparate images of the enhanced scene 13 in the binocular view 8 of the viewer, one on the retina of each of the veiwer's 9 eyes 10 and in the Panum's fusional area of the viewer.
  • the location of the VIO should also be such that the clearly defined boundary 7 of the VIO 2 nearest to the viewer 9 is a sufficient distance away from the 2D image 1 to render two slightly disparate images of the enhanced scene 13 in the binocular view 8 of the viewer, one on the retina of each of the veiwer's 9 eyes 10 and in the Panum's fusional area of the viewer.
  • the 2 should preferably be, together with the 2D image 1 in the enhanced scene 13, substantially within the depth of field of the viewer's view of the 2D image 1, and/or within the boundary space of the Panum's fusional region of the viewer for the 2D image 1. Corresponding points of the enhanced scene 13 are thus projected on the Panum's fusional area of the viewer's 9 eyes
  • Such a fused cyclopean image of the enhanced scene 13 in the viewer 9 gives the viewer 9 the experience of stereo vision, not simply by distinguishing distance between the 2D image 1 and the VIO 2, but within the 2D image 1 itself, by enhancing the viewer's perception of depth in the available monocular depth cues within the 2D image 1.
  • This enhancement effect suggests that the human brain has the capacity to reconstruct and appreciate stereo vision in a two-dimensional image by the stimulation to fusion in the visual cortex of a retinal disparity presented by the binocular depth cue, substantially in Panum's fusional region, of the enhanced scene.
  • the invention is designed to be effective to enhance depth perception and/or clarity perception in a 2D image for a viewer who has two eyes and a relatively normal ocular and neural capacity for stereopsis.
  • the intensity of the enhancement effect will vary with the level of such capacity in the viewer.
  • the invention may also serve as an experimental probe for the phenomena of visual perception, both binocular and monocular.
  • a VIO may have any shape, and may also be made to be adjustable between flat, and horizontally and/or vertically curved.
  • the placement of a VIO may be by any means, such as suspension in position or attachment to the image object 6, fixed or adjustable with respect to distance from and angle with the image surface 3.
  • a VIO is operably associated with the image surface by a spatial relationship with and proximity to the image surface in order to produce the enhancement effect.
  • Such status of a VIO is also intended to mean herein that the VIO is not physically connected to or with the viewer, either by attachment to or being worn by the viewer.
  • a VIO may be a vertically oriented rod or tube, placed to the side and in front of the image surface; or may be a group of medallions strung above and in front of the image surface.
  • the VIO may be a grid between the viewer and the 2D image with wide enough spacing between visible grid elements to minimize interference with the viewing of the 2D image.
  • the VIO must be clearly present to the viewer as an integral part of the enhanced scene, the use of a grid as the VIO would probably interfere with the viewer's appreciation of the content of the 2D image as an entirety.
  • a VIO 2 may be designed that is effective for that area of attention 5, such as a frame about the area of attention 5, which may partially obscure the rest of the image area, which shall hereinafter be referred to as a "VIO/frame" 2, examples of which are shown in FIGS. 1 -3.
  • the term "area of attention” 5 is used here to mean the whole or part of a 2D image 1 that a viewer is focused upon and includes the viewer's 9 point of fixation.
  • Such a VIO/frame 2 may be limited to a sufficient size to substantially bound the area of attention 5 for the viewer at a particular distance from the 2D image 1 , so that no well defined edges 4 of the 2D image 1 are available to the view 8 of the viewer 9, as shown in the example of FIG. 1.
  • the preferred VIO/frame 2 is one that completely or partially surrounds the entire 2D image 1, with an aperture 12 that does not severely crop the 2D image 1 to the viewer 9.
  • Such a VIO/frame 2 may have an adjustable aperture 12 in order to compensate for the viewer's 9 viewing position relative to the 2D image 1, the viewer's 9 angle of view, the shape of the image surface 3, the size of the 2D image 1 , and the distance of the viewer 9 from the 2D image 1.
  • An adjustable aperture 12 may also be moved horizontally within the structure of a VIO/frame 2 for the purpose of intensification of the enhancement effect. Examples of VIO/frames that only partially surround the 2D image, such as partial-frame VIOs, are shown in FIGS.
  • VIO/frames may be attached to the image object or image surface in various ways: as with clamps in FIGS. 13 (horizontal 24) and 14 (vertical 31) to which the panels 14 are attached by hinges 23; by attachment directly or with hinges 23 to the image surface 3 as in FIGS. 15 and 19; by attachment directly or with hinges 23 to the image object 6 as in FIGS. 16 and 18; or with display housings attached to or integrated with the image object as in FIG. 17.
  • edge effect As indicated with respect to a VIO/frame which restricts the view of a viewer to a specific area of attention, the visibility to the viewer of well defined edges of a 2D image tends to announce the 2D image as flat in the space in front of the viewer, in contrast to other binocular cues within that viewing environment, and thus detracts from the enhancement effect. This tendency shall hereinafter be referred to as the "edge effect".
  • the edge effect can be diminished by the diminution of the visibility of the edge of a 2D image, which shall hereinafter be referred to as "edge obscuring".
  • a device employed to accomplish edge obscuring shall be referred to as an "edge obscuring" device.
  • a VIO/frame 2 may be a simple-frame, as shown in FIGS. 1 and 3, or hood-like as shown in FIG. 2 with edge obscuring panels 14 producing a reflection 15 of part of the 2D image 1 toward the viewer 9.
  • Such a hood-like VIO/frame 2 may also incorporate reflective edge obscuration on the inner surface of the hood, and a telescoping section 2a which can be used to adjust the distance between the 2D image 1 and the visually identifiable boundary 7 of the VIO/frame 2.
  • a simple-frame VIO/frame 2 may be used with separate edge obscuring panels 14 as shown in FIG. 3, where the 2D image 1 is produced on an image surface 3 by a projector 16 on an area bounded by edge obscuring panels 14, or integrated with edge obscuring panels as shown in FIGS. 13-19 with partial- frame VIO/frames..
  • the VIO 2 may also be itself an edge obscuring device by obscuring the edges 4 of the 2D image 1 from the immediate view 8 of the viewer 9, as in the case of a VIO/frame 2 shown in FIG. 1 , where the edges 4 of the 2D image 1 are cropped by the aperture 12 of the VIO/frame 2.
  • the VIO/frame 2 may also be in the form of a hood around the 2D image 1 as shown in FIG. 2, in which the edge obscuring panels 14 are reflective and a part of the hood VIO/frame 2.
  • obscuring the edges of a 2D image may be accomplished by various means that are integrated with or independent of the VIO, and are included in the invention.
  • an edge obscuring device may also operate as an enhancing device in the same manner as a VIO.
  • various means may be employed to obscure the edge of the 2D image 1 using the light from the 2D image 1.
  • the 2D image 1 can be bounded at one or more of its edges 4 by edge obscuring panels 14 as in the example of FIG.2, so that light from the 2D image 1 near an edge 4 is wholly or partially reflected or transmitted toward the viewer 9.
  • Such an edge obscuring panel 14 may have other optical qualities that diffuse or distort light reflected from the 2D image 1 in order to more smoothly obscure the edge of the 2D image 1.
  • the 2D image 1 may also be similarly bounded by edge obscuring panels 14 which are translucent or transparent, with internal light transmitting properties, that similarly diffuse and distort the light from the 2D image I.
  • the edge 4 of the 2D image 1 can also be obscured by being bounded at one or more of its edges 4 by a light source distributed along the edge 4.
  • Another means of edge obscuring is shown in FIG. 9: the edge obscuring mask (or image) 18B, 18W (B and W indicating Black and White colored patterns respectively), which can be attached to or displayed on the image surface 3 along the edges 4 of the 2D image 1 to diffuse or break up the viewers view of the edges 4 of the 2D image 1.
  • the preferred edge obscuring mask 18B, 18W is one that is transparent with a pattern printed on it, where the pattern may be either opaque, transparent, translucent, or a combination thereof. Such a pattern would probably be most effective if it is most dense at the edge 4 of the 2D image 1, with a gradual diminution of the density of the pattern from the edge to the interior of the 2D image 1, as shown in FIG. 9: the series of dots of a color close to that of the color of the image surface 3 bordering the 2D image 1, that are most densely packed on the edge obscuring mask (or image) 18B, 18W near the edge, so as to be almost solid, diminishing to zero in size and packing density toward the interior boundary of the mask.
  • Another form of pattern would obscure the edge of the 2D image 1 not only by variation in density from outer to inner boundary, but also by its variation in coloration (other than black and white) which would change in appearance as the image shines through or upon it.
  • Many such patterns are possible, the suitability of which may vary with the viewer's visual ability and taste, and there is no intent to have this disclosure limit the invention to any particular type of pattern.
  • an edge obscuring image such as shown in FIG.
  • the display 9 as 18B, 18W may be combined with the 2D image 1 , so that the display includes an image which effects edge obscuring.
  • This may be accomplished by superimposing an electronically generated edge obscuring image on the 2D image in simulation of a transparency with a pattern as described above: either by including the edge obscuring image on the film print, in the case of film projection, or combining an electronically generated edge obscuring image with the 2D image for display.
  • Such electronically generated edge obscuring images may be static and of various design, or dynamic, changing with time in design, size, color, frequency, etc. to intensify the enhancement effect as the nature of the 2D image may require.
  • Embodiment No. 9 The image obscuring in the form shown in FIG. 9 may be practiced independently of Embodiment No. 3, and may be practiced with the fundamental embodiment and Embodiment No. 2.
  • another form of mask for obscuring the edge 4 of the 2D image 1 can be affixed at the edge 4 of the 2D image 1 on that part of the image surface 3 that surrounds the 2D image 1.
  • Such a mask may have an edge obscuring pattern printed on it similar to the series of dots for the mask 18B, 18W on the 2D image 1, but with a background close to the 2D image 1 in color, such a pattern being most densely packed on the mask furthest from the edge 4 of the 2D image, diminishing to zero in size and packing at the edge 4 of the 2D image 1.
  • an edge obscuring device may also operate as an enhancing device in the same manner as a VIO;. That is, an edge obscuring device may be effective as a VIO if it has the attributes of a VIO previously described herein.
  • an edge obscuring panel which has optical and/or electrical properties that cause the light from the 2D image to be reflected from and/or transmitted along the panel so as to provide a visually identifiable boundary of the panel within the Panum's fusional region would have some enhancement effect as a VIO, depending on its shape and other physical characteristics, as shown in FIGS. 13-19. For the examples in FIGS.
  • such a panel 14 which is vertically oriented would so function at a vertical edge of a 2D image if it is mirror-like on the side exposed to the 2D image.
  • a panel similar to the panel 14 in FIG. 18, would so function if it was partly mirror-like and partly light-transmitting, with the mirror-like part of the panel being curved and exposed to the 2D image at the edge of the 2D image, and the light-transmitting part, similar to the VIO 2 strip in FIG. 18, facing the viewer.
  • a panel which may operate as an edge obscuring device and a VIO at the same time is a "live panel", a panel which is capable of displaying an image such as an LCD panel or plasma display as shown in FIG.
  • Such a live panel could be of any shape, flat (as shown in FIG. 19) or curved (as shown in FIG. 18), with a surface on which an image could be displayed toward the viewer, such surface hereinafter being referred to as the "live face” and the image displayed thereon as the "face image” 27.
  • the live panel, or a substantial part thereof, would preferably be disposed at a sufficient angle (more than 90 degrees) with the image surface 3 so that the viewer has an angular view of a substantial part of the face of the panel 14 when viewing the 2D image 1 directly.
  • the face image may have an edge obscuring component and/or a VIO component.
  • the edge obscuring component of the face image would blend with the 2D image and distort the 2D image to obscure the boundary with the 2D image, while the VIO component of the face image would provide a graphic that would be a clearly distinguishable VIO in contrast with edge obscuring component.
  • the VIO aspect of the live panel may only be a function of the VIO component of the face image displayed on the live face, or the shape of the panel may contribute to the definition of the VIO as in FIGS. 17-19.
  • Either or both the VIO and edge obscuring components of the face image may be displayed as fixed or in motion on the panel and may be varied in their respective properties in the manner disclosed herein for VIOs and edge obscuration generally.
  • detraction from the enhancement effect may also occur with the "background effect”: the spatial contrast between the enhanced depth perception in the viewing of a 2D image and the scene of objects in the region of physical space within focus behind or beside the 2D image.
  • a spatial contrast also occurs when the relatively confined region of space behind the 2D image is not greatly out of focus and contains easily visible and distinguishable objects that are distributed therein. Large spaces behind the 2D image with objects distributed therein that are not easily focused upon when viewing the 2D image do not tend to provide the spatial contrast of the background effect. That tendency is similarly avoided when the 2D image is displayed against or a short distance in front of a relatively flat wall, or a background with random textures, regular patterns, or visually indiscernible objects.
  • background masking a mechanical or optical background for the enhanced scene to prevent the diminution of the enhancement effect by the visual environment in which the system is operating, which effects the conditions that avoid the spatial contrast of the visual environment with the enhanced scene.
  • the enhancement effect may be intensified and/or maintained by illumination of the VIO for the viewer from the front, back, or internally, or where the VIO is itself in whole or in part an illuminating device. Illumination of the VIO may also be derived from the light emitted or reflected by the 2D image, in the case of video display or projection, using light transmitting or reflecting panels.
  • the illumination of the VIO may be of various colors and intensities, and/or may be polarized; and the ' color, intensity and/or polarization of the illumination may be variable over time.
  • Such variation in the illumination may be programably controlled with reference to the characteristics of the 2D image, such as brightness, coloration, resolution, shape, program material, monocular depth cues, etc.; and/or controlled with reference to the characteristics of the viewer's vision.
  • Intensification of the enhancement effect may be achieved with a graphic pattern 19 visually discernable by the viewer
  • the pattern itself may be illuminated, a graphic directly applied to the VIO 2, illuminated or otherwise, integrated with the illumination of the VIO, or applied to interrupt the illumination of the VIO 2 by blocking certain parts of such illumination of the VIO 2 to the viewer's 9 view.
  • the pattern may be a group of VIOs arranged for the purpose, or a group of VIOs may be arranged to form such a pattern. Such a pattern may also operate to distribute the enhancement effect over the viewer's area of interest 5.
  • the enhancement effect of the system and device may also be improved by illumination of the 2D image.
  • illumination of the 2D image may be from sources attached to or independent of the VIO, and may be controlled in a manner similar to the illumination of the VIO.
  • All of the various attributes of the 2D image and the VIO may be combined and controlled-to accommodate the position and vision characteristics for the viewer and to intensify and/or maintain the enhancement effect with respect to the various characteristics of the 2D image; and the entire range of such combination and control is included in the invention.
  • Such control of the system may also be programmed to achieve specific effects in the 2D image, and/or associated with the generation of the 2D image, such as a broadcast signal, or on a recorded track, such as videotape, compact disc, digital video disk, digital video recorder, or on a motion picture film.
  • Such programming may even be composed for presentation of the entire range of 2D images with which the system may be practiced, preexisting as well as contemporary with the composition.
  • the method for enhancement of visual perception of the present invention may include the creation for the viewer of an enhanced scene.
  • the method may therefore involves the selection of the elements of the enhanced scene: the 2D image which is the subject of the enhanced scene; the surface upon which it is to be displayed, and the enhancer.
  • the 2D image For depth perception enhancement, it is necessary that the 2D image have monocular depth cues, but such monocular depth cues are not necessary for clarity enhancement.
  • monocular depth cues to be considered in the selection for depth perception enhancement of a 2D image as the subject of an enhanced scene are occlusion or interposition, aerial perspective, linear perspective, relative height, texture gradients, shading and light, relative size, relative motion, and familiar size.
  • other characteristics of the 2D image may be considered in the analysis, such as the inherent clarity of the 2D image, the level of illumination depicted within the 2D image, the number of objects in the 2D image, the similarity of objects in the 2D image, the randomness or order of the objects in the 2D image, and the inherent resolution of the 2D image; and, in the case of moving 2D images, the steadiness of the 2D image, the rapidity of movement within the 2D image, the duration of the cuts (the period of uninterrupted action) in the 2D image, and the length of time that monocular depth cues exist uninterruptedly in the scenes of the 2D image.
  • the method may also include the taking into consideration of the size of the 2D image, the distance of the viewer from the 2D image, and the angle from which the 2D image is being viewed.
  • the 2D image is then presented on an image surface selected for the 2D image.
  • One or more enhancers to be used with the 2D image as displayed (its type, size, etc.), and its mode of operation (coloration, illumination, motion, programming, etc.) may then be selected for the desired enhancement effect.
  • the enhancer is a VIO, it is preferred that it be operably associated with the image surface upon which the 2D image is displayed.
  • the VIO together with the 2D image presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity.
  • the other possible enhancers include a configuration of standard electronic, optical and/or mechanical components which moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface; and/or generates a horizontally moving two-dimensional image of a visually identifiable obj ect at or on the image surface which is seen by the viewer with said 2D image.
  • the visual system of the viewer of the 2D image is caused by the constitution of the enhanced scene to be subjected to a slight but sufficient spatial retinal disparity in the retinal images of the 2D image detected by the viewer's visual system: if one of the other enhancers is used, the viewer of the 2D image is caused to be subjected to a slight but sufficient temporal retinal disparity in the retinal images of the 2D image.
  • the viewer is thus caused to experience a single fused cyclopean image, a single vision resulting from a fusion of the retinally disparate images, in which the viewer' perception of depth in any monocular depth cue in the 2D image may have is so enhanced as to be experienced as a form of stereo vision, and in which the viewer's perception of clarity is so enhanced as to be experienced as an increase in resolution of the 2D image.
  • the criteria for the analysis of the 2D image that is to be performed in conjunction with the method described above may be included in a rating system for 2D images the purpose of which is to inform the viewer and the parties involved with the presentation of the 2D image as to the level of qualification of the 2D image for the enhancement effect that may be expected with the present invention.
  • a rating system may quantify the criteria used to rate the 2D image, and report the results thereof in a numerical, verbal, graphic, and/or summary form.
  • the ratings thereby generated may also be used by the parties having a proprietary interest in the content of the 2D image to market same and to qualify for the use of the present invention.
  • Embodiment No. 2 Electronic generation of a 3D VIO for a stationary 2D image.
  • Embodiment No. 3 Electronic or mechanical horizontal movement of the 2D image relative to the image surface.
  • Embodiment No. 4 Electronic or mechanical horizontal movement of a 2D VIO image relative to the image surface for a stationary 2D image.
  • Embodiment No. 5 Horizontal movement of a mechanical VIO at the image surface for a stationary 2D image.
  • Embodiment No.6 A computer program operating in a computer to provide horizontal movement of a 2D image relative to the image surface and/or horizontal movement of a 2D VIO image relative to the image surface for a stationary 2D image.
  • Other embodiments are possible by various combinations of these with each other, including the fundamental embodiment, and with edge obscuring and/or background masking.
  • Embodiments 2 through 5 may be practiced with enhancers which are various configurations of standard components: devices which are well known for the purpose for which they are designed and fabricated. Such devices are comprised of standard signal processing circuitry that generates, combines, modifies, and extracts the signals for the 2D image and the accessory images of which Embodiments 2 through 5 are comprised.
  • a configuration of standard components is a utilization of standard components by combination in a relationship and/or connection to achieve an operation to which each contributes according to its respective purpose.
  • the operations performed by the configurations of standard components disclosed herein do not appear to be known in the prior art.
  • Embodiment No. 2 is shown in FIGS. 4, 5, and 8, and is a system that operates essentially as the fundamental embodiment, but with a computer generated virtual 3D VIO image 17 (FIG. 8), instead of a mechanical VIO, which is
  • the 3D VIO image 17 is generated by standard video image generation equipment 30 for viewing with a standard form of 3D viewing glasses, two color (usually for black and white 2D images), polarized, or shutter 130, the latter being controlled by a standard device 110 providing a control signal 120 in synchronization with alternating left-right frames of the 3D VIO image 17.
  • the left-right components of the 3D VIO image 17 are generated 30 to make the 3D VIO image 17 appear outside and in front of the image surface 3 when viewed with 3D glasses
  • the 3D VIO image 17 with the 2D image 1 is seen through the 3D glasses 130 by the viewer as a 2D image I on the image surface with a VIO 2 suspended in front of it as in the case of the fundamental embodiment shown in FIG. 1.
  • the 3D VIO image 17 may incorporate edge obscuring for the 2D image 1 , or may itself obscure the edge of the 2D image 1.
  • the 3D VIO image signal 40 which includes a synchronizing 3D VIO control signal 60, is sent to a standard video mixing device 50 for combination with the 2D image signal 35 input from a standard
  • the synchronizing 3D VIO control signal 60 may be extracted from the combined image signal 70 with the processing in the device for converting the combined image signal for input to display 80, or sent directly to the device for controlling viewing glasses 110 from the device
  • Embodiment No. 2 is not a preferred embodiment for normal viewing inasmuch as it suffers from the disadvantage of the necessity for eye wear, but may be of use in diagnostic and treatment applications of the present invention.
  • Embodiment No. 3 shown in FIGS. 6 and 9 is a system which provides the enhancement effect by horizontal motion
  • component of motion means the motion represented by one of the components of the velocity vector (well known from the 5 vector representation of uniform linear motion), wherein the velocity vector is resolved into two component velocity vectors at right angles, the magnitude of the resolved vector being the magnitude of the hypotenuse of the right triangle formed by the resolved velocity vector with its components.
  • such a retinal disparity usually results in fusion of the retinal images in the viewer 9, and thus the enhancement effect.
  • the horizontal movement 2OL, 2OR may be timed for the individual viewer in order to accommodate the viewer's alternating perception of the disparate retinal images.
  • the system devices may be used to effect such horizontal motion 2OL, 2OR at any velocity consistent with the characteristics of the display 100, such as refresh rate.
  • Such horizontal motion 2OL, 2OR may also be regulated with respect to distance, direction, and frequency, so that the 2D image 1 may be moved horizontally 2OL, 2OR back and forth on the image surface 3, either automatically, under the control of the viewer directly, or as programmed by the viewer.
  • the frequency, the velocity, and the mode of such motion may be chosen to suit the viewer.
  • Such control may also be coordinated with the content of the 2D image 1, provided with and as part of the 2D image signal 35, and/or be made subject to the preferences of the viewer.
  • Embodiment No.3 of the system for horizontal motion 2OL, 2OR of the 2D image 1 may be mechanical, as in the case of a film projector, front or rear, motion or still. Such motion may be accomplished by the mechanical movement of certain components of a film projector, such as the film gate, aperture plate, or the projector optics; or electromechanically, electronically controlled electrically driven mechanical motion, all of which may be regulated in the same manner as the electronic system previously described.
  • Embodiment No. 3 optionally lends itself to the use of viewing glasses of the type used with Embodiment No. 2. In this embodiment, however, the viewing glasses alternately shutter each eye as the 2D image 1 is horizontally moved 2OL, 2OR.
  • the system of Embodiment No. 3 is designed to provide an adequate enhancement effect without the necessity for viewing glasses, but the use thereof is not excluded from use with the system.
  • Embodiment No.3 may be employed with edge obscuring by combining an edge obscuring image signal 150 with the horizontally moving 2D image signal 180.
  • An edge obscuring image signal 150 is produced by a standard device for generating 2D edge obscuring image 140 which is combined with the 2D image signal by a standard device 160.
  • the combined image signal 70 is such that the edge obscuring image 18B, 18W (FIG. 9) displayed is relatively stationary relative to the image surface 3, while the 2D image 1 is in horizontal motion 20L, 20R. As shown in FIG.
  • the color of the image surface border 3B, 3W should match the color and/or pattern of the edge obscuring image 18B, 18W.
  • the border of the image surface 3 would usually have a color and/or pattern which would match the color and/or pattern of the edge obscuring image 18B, 18W).
  • such an edge obscuring image 18B, 18W may also be dynamic in nature, and may be designed to intensify the enhancement effect for the particular 2D image 1 displayed.
  • edge obscuring in the form shown in FIG. 9 may be practiced independently of Embodiment No. 3, and may be practiced with the fundamental embodiment and Embodiment No. 2.
  • Embodiment No.4 shown in FIGS.7, 10, 11, and 12 is a system which induces the slight but sufficient retinal disparity required for the enhancement effect by horizontal motion 22L, 22R (L and R indicating Left and Right movement respectively) of one or more two-dimensional VIO images 21 , hereinafter referred to as 2D VIO images, the preferred form of which is a frame that may hereinafter referred to as "2D VIO/frame image" 21, which is displayed with the 2D image 1 to be viewed.
  • the 2D VIO/frame image 21 may be other than the simple-frame shown in FIG. 10, and may be partial-frames 21 as shown in FIGS. 11 and 12 as a pair of vertical bars or patterns superimposed on or part ofthe 2D image 1.
  • the horizontal motion of the 2D VIO/frame image 21 is with respect to a viewer's point of fixation on the image surface with a sufficient component of such motion parallel to the orientation of the viewer's eyes in both directions of such orientation, but is not significantly perceptible by the viewer. Such motion is of sufficient speed and frequency (left and right) to induce a temporal retinal disparity in the viewer.
  • the 2D VIO/frame image 21 may be superimposed upon or surround the 2D image 1. As in the other embodiments disclosed, such a retinal disparity normally results in fusion of the retinal images in the viewer, and thus the enhancement effect.
  • the horizontal motion 22L, 22R may be timed for the individual viewer in order to accommodate the viewer's alternating perception of the disparate retinal images.
  • the system devices may be used to effect such horizontal motion 22L, 22R at any velocity consistent with the characteristics of the display 100, such as refresh rate.
  • Such horizontal motion 22L, 22R may also be regulated with respect to distance, direction, and frequency, so that the 2D image 1 may be moved horizontally 22L, 22R back and forth on the image surface 3, either automatically, under the control of the viewer directly or as programmed by the viewer. That is, the frequency, the velocity, and the mode of such movement (such as: slowly to the right, and rapidly back to the left; rapidly to the right, and suddenly back to left to the original or another position; or, suddenly to the right, and back slowly to the left; etc.), may be chosen to suit the viewer.
  • Such control may also be coordinated with the content of the 2D image 1, provided with and as part of the 2D image signal 35, and/or be made subject to the preferences of the viewer.
  • the 2D VIO/frame image 21 completely or partially surrounds the 2D image 1
  • the 2D image 1 may be reduced in size so that substantially all of the 2D image 1 is displayed within the frame, that is, without cropping by the frame.
  • Embodiment No. 4 also includes the mechanical, electromechanical, or electronically controlled electrically driven mechanical horizontal motion of the 2D VIO image 21 , and the regulation thereof, which may be implemented in a substantially similar manner as that described for Embodiment No. 3.
  • the system for horizontal movement 22L, 22R of the 2D/frame image 21 may be mechanical, as in the case of a film projector, front or rear, motion or still. Such motion may be accomplished by the mechanical movement of certain components of a film projector, such as the film gate, aperture plate, or the projector optics; or electromechanically, electronically controlled electrically driven mechanical movement, all of which may be regulated in the same manner as the electronic system previously described.
  • Embodiment No. 4 also optionally lends itself to the use of viewing glasses of the type used with Embodiment No. 2. In this embodiment, however, the viewing glasses alternately shutter each eye as the 2D VIO/frame image 21 is horizontally moved 22L, 22R.
  • the system of Embodiment No.4 is designed to provide an adequate enhancement effect without the necessity for viewing glasses, but the use thereof is not excluded from use with the system.
  • Embodiment No. 4 may also be employed with edge obscuring images 18B, 18W (FIG. 9) by combining an edge obscuring image signal 150 (FIG. 6) with the signal of the horizontally moved 22R, 22L 2D VIO/frame image 21 as is accomplished for the combination in the case of Embodiment No. 3.
  • An edge obscuring image signal 150 (FIG. 6) produced by a standard image generator 140 (FIG. 6) may also be combined with the 2D VIO/frame image signal 220.
  • the combined image signal 70 after conversion for display 90, is such that the edge obscuring image 18B, 18W (FIG.9) displayed is relatively stationary with respect to the 2D image 1 and the image surface 3, as in Embodiment No.
  • the 2D VIO/frame image 21 is in horizontal motion 22R, 22L.
  • the 2D VIO/frame image 21 may be dynamic in nature in the same manner as a dynamic edge obscuring image 18B, 18W, and may be designed to intensify the enhancement effect for the particular 2D image 1 displayed.
  • Embodiment No. 5 involves a mechanical VIO, and may be practiced in a manner similar to Embodiment No. 4, but without the flexibility afforded by the use of an electronically generated 2D VIO/frame image 21 (FIG. 10).
  • Horizontal movement of a mechanical VIO at the image surface 3 may be accomplished by standard forms of mechanical actuation, electrically or mechanically motivated, and electronically or mechanically controlled. Otherwise, substantially the same types of VIO configurations and movements may be used as described for Embodiment No. 4 to produce the enhancement effect.
  • the full range of edge obscuring techniques are employable to diminish the edge effect.
  • Embodiment No. 6 is implemented by and within a computer program operating in a computer that generates and/or displays 2D images, such as for animation, art, simulation, graphical representation, and from processing and/or presentation of analog and digitized images generally.
  • the term computer program as used herein shall mean a complete operational computer program, or a component thereof, such as a program overlay, a coded algorithm, or a subroutine.
  • the computer program performs by instructions to the computer for the operations carried out by the configurations of standard components in Embodiments Nos. 3 and 4.
  • Embodiment No. 6 makes the movement of the 2D image and/or the movement of the 2D VIO images practiced by Embodiments Nos.
  • a computer program that generates or processes "still" 2D images may include with the generated video frames information for one or more 2D VIO images and their horizontal movement, and/or information for the horizontal motion of the 2D image. Edge obscuring image information may also be incorporated with the information for the generated frames of the 2D image.
  • a computer program that generates or processes a "moving" 2D image i.e.
  • Embodiments Nos.3 and 4 may also be practiced with Embodiment No.6, but controlled by the program and the inputs provided for thereby.
  • Embodiments 2-4 and 6 of the invention disclosed herein may be practiced in their electronic or electromechanical form with any presently known form of signal transmission, such as electromagnetic broadcast, cable, and computer networking, or video recording; or presently known form of intermediate electronic processing thereof by devices interposed between the reception or production of a 2D image and the display of the 2D image; and the entire range of combination and control of such signal transmission and processing is contemplated for the practice of said embodiments and included in the invention.
  • the foregoing practice as applied with respect to any control of the system and/or face image that may be used is also contemplated for the fundamental embodiment (Embodiment No. 1).
  • the enhancement effect of the present invention has application to the study of vision, particularly in diagnostics and treatment. It has also been suggested that the principle upon which the present invention operates is newly presented here. In fact there are additional aspects to the enhancement effect of the present invention that plumb the depths of the currently unknown functions of the visual cortex and the operation of binocular retinal rivalry.
  • FIG. 1 is a perspective view of a mechanical embodiment of the system with a simple frame VIO.
  • FIG.2 is a perspective view of a mechanical embodiment of the system with a hood-frame VIO with integrated edge obscuring.
  • FIG. 3 is a perspective view of a mechanical embodiment of the system for front projection with a a simple frame VIO and separate edge obscuring.
  • FIG. 4 is a block diagram of a first example of the system utilizing an electronically generated virtual 3D VIO.
  • FIG. 5 is a block diagram of a second example of the system utilizing an electronically generated virtual 3D VIO.
  • FIG. 6 is a block diagram of an example of the system utilizing an horizontal image movement and edge obscuring.
  • FIG. 7 is a block diagram of an example of the system utilizing horizontal frame image movement.
  • FIG. 8 is a schematic diagram of the system with a generated virtual 3D VIO.
  • FIG. 9 is a schematic diagram of horizontal image movement with edge obscuring.
  • FIG. 10 is a schematic diagram of horizontal simple-frame image movement.
  • FIGFIG. 11 is a schematic diagram of horizontal partial-frame (vertical bars) image movement.
  • FIG. 12 is a schematic diagram of horizontal partial-frame (vertical pattern) image movement.
  • FIG. 13 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO attached to an image object with a horizontal clamp.
  • FIG. 14 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO attached to an image object by a vertical clamp.
  • FIG. 15 is a perspective view of a mechanical embodiment of the system for front projection with a partial-frame VIO attached to an image surface.
  • FIG. 16 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO attached to an image object.
  • FIG. 17 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO of display housings.
  • FIG. 18 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO of display panels.
  • FIG. 19 is a perspective view of a mechanical embodiment of the system for front projection with a partial-frame VIO which is illuminated by the front projection.
  • the best mode for carrying out the invention depends on the application, and the disposition of the viewer with respect to the particular embodiments disclosed. For entertainment, and cultural applications, it is believed that the fundamental embodiment in its various forms will provide the most satisfying experience where space permits. For computer and gaming applications, the best mode may be found in the various forms of Embodiment No. 6. For television and cable broadcasters, the best mode may be found in various forms of Embodiment No. 4. For medical imaging the best mode may be Embodiment No. 2.
  • the use of the invention applies to all manner of display of two-dimensional images wherein the enhancement of depth perception of the viewer increases the intelligibility of the image to the viewer, such as medical imaging and computer graphic displays, as well as the entertainment (motion pictures and television), cultural (drawings, paintings, photographs, etc.), and commercial (posters, billboards, etc.) applications.
  • the invention may also be used for scientific purposes as probe of the human visual system, particularly the visual cortex and the brain-eye connection, as well as the phenomena of vision generally.
  • the principle objects of the invention are to provide: 1) enhancement of a viewer's visual perception in a single two-dimensional image, which includes enhancement of the depth perception of a viewer in various types of two-dimensional images that include monocular cues for depth, and 2)

Abstract

A system, device within a system, and a method for enhancing visual perception in a two-dimensional image (1) is disclosed, providing the induction of retinal disparity in the viewer (9) by a device (2) with which the two-dimensional image is viewed. With fusion of the retinally disparate images of the two-dimensional image, the viewer experiences the enhancement of his or her visual perception in the two dimensional image, which includes enhancement of depth perception and enhancement in clarity perception.

Description

ENHANCEMENT OF VISUAL PERCEPTION
Technical Field
The classification that applies to this aspect of the invention is generally in U. S. Class 359, "OPTICAL: SYSTEMS AND ELEMENTS", but the only subclass titles that provide a verbal similarity are 462, "STEROSCOPIC", and 478, "RELIEF ILLUSION", the descriptions of neither being applicable to the theory of operability of the present invention. It is presumed that U. S. Class 359, "OPTICAL: SYSTEMS AND ELEMENTS" may apply to this aspect of the invention as well. U. S. Class 351, "OPTICAL: EYE EXAMINING, VISION TESTING AND CORRECTION" may also apply. Otherwise, the patent classification system does not contain a classification for the invention in the phenomena employed.
Background Art
The field of the invention pertains to systems, devices, and methods for enhancing the visual perception of a viewer in a two-dimensional image, which includes enhancement of the viewer's perception of depth and clarity in a two-dimensional image. This field of invention is distinct from that of Garcia, U.S. Patent No. 5,510,832: synthesized stereoscopic imaging from two-dimensional images. Garcia adequately discusses the utility and merits of simulation of 3D video from two-dimensional video sources. The field of the present invention is also distinct from that of Ashbey, U.S. Patent No. 5,541,642: stereoscopic imaging with interlaced video through a lenticular decoder screen. Ashbey also discusses derivation of stereoscopic effects from a "monoscopic" source by simultaneously displaying successive frames of a motion picture with lateral displacement through his system. The use of the terms "two-dimensional", "monoscopic", and "monocular" have been used in the prior art to distinguish the viewing of single images from that which is "stereoscopic" — the quality of vision with which a human viewer with two normal eyes and the ability for stereopsis sees a scene in physical (three-dimensional) space with objects at varying distances from the viewer. However, some clarification of these terms is necessary: the term "two-dimensional" as an adjective for the term "image" does not mean that the image does not represent a three-dimensional scene, i.e. a scene with visual cues for depth related to objects and surfaces at varying distances within the perspective of the scene; the term "three-dimensional" or "3D" as applied to an image does not necessarily mean that it is stereoscopic, but may also mean that it is an image displayed on a two- dimensional surface, flat or curved, and/or which may be manipulated so that the objects represented therein are viewable at different angles, either by rotation of the object or the variation in the angle of view with an apparent change in position of the viewer; the term "monocular", which literally means "having only one eye" or "with one eye" (in contrast with "binocular", meaning with two eyes), sometimes used as a synonym for "two-dimensional", is used to describe an image which appears to be displayed on a two-dimensional surface (as when a physical scene of objects at varying distance from the viewer is viewed with one eye), and is also used in the prior art terms "monocular cues" and "monocular depth cues" to describe certain aspects of a two-dimensional display of a three-dimensional scene which indicate the varying distances and angles of objects with reference to the view represented therein; the term "monoscopic" appears to be used in the prior art as a synonym for "monocular", particularly in Ashbey, but is not defined as such in common usage.
The subject of "depth perception of images on a television screen" has been discussed in LeMay, U. S. Patent Number
5,488,510, but not the subject of depth perception in other types of two-dimensional images, such as posters, paintings, signs, still photographs, cinema, etc. LeMay uses a window screen type mesh in a device to be worn by a viewer through which a two- dimensional television image is viewed, and creates, according to its inventor, an "illusion". Unlike LeMay, the present invention, in its preferred embodiments, does not require any type of eye wear or worn device, and provides a natural stereo vision experience in the viewing of two-dimensional images of all kinds, including photographs, posters, drawings and paintings, signs, television and motion pictures, and projected images in general. Also, unlike LeMay, the present invention does not rely upon an "illusion", but enhances the viewer's perception of depth in the monocular depth cues and perception of clarity in a two- dimensional image. The present invention should be distinguished from stereographic devices and methods providing stereoscopic vision which require simultaneous or alternated display of two images, still or motion picture, each image being of one of two monocular views, actual or simulated, of a binocular view of a scene, which must be viewed with special viewing glasses or display lens; whereas the present invention involves the display of only one image, still or motion picture, of a single monocular view of the scene. It is to be noted that the stereo vision provided by the prior art is artificial in appearance as discussed in Garcia. Stereographic devices have been well known for many years, while the principle underlying the present invention, although not yet completely understood, is newly presented in this application.
The present invention should also be distinguished from the well-known effect that is observed with monocular viewing of a two-dimensional image with monocular depth cues against a featureless or flat background without such cues. The same effect can also be observed by monocular viewing of a two-dimensional image at the end of an enclosed space. With such a viewing the monocular depth cues in the two-dimensional image become pronounced, albeit seen with only one eye. Such monocular viewing, however, not only involves the discomfort of viewing with only one eye, but more importantly deprives the viewer of the accommodation reflex which occurs with binocular vision that gives the viewer the ability to accurately focus on the two-dimensional image. The result is that although, with such monocular viewing, the monocular depth cues in the two- dimensional image have an effect greater than if viewed binocularly, the two-dimensional image cannot be seen with the same degree of focus as if seen binocularly. The present invention operates very differently: the viewer's depth perception and perception of clarity in a two-dimensional image is enhanced by inducing a retinal disparity in the viewer that results in a fusion experience. With the present invention the two-dimensional image can be seen binocularly with the accurate focus of the accommodation reflex. Such accurate focus in turn heightens the fusion experience, and thus the enhancement of depth perception and perception of clarity afforded by the present invention.
As previously indicated, the present invention provides enhanced perception of clarity for the viewer in a two- dimensional image. This effect became known during the testing of the depth perception enhancement effect from the assertions of many viewer-subjects that the two-dimensional images they viewed with the invention were "clearer" than without the system. Such an effect appears to have a basis in the notions of eye dominance and binocular retinal rivalry.
The enhancement of clarity of the present invention should be distinguished from eye wear, lens systems, and surgical procedures for gaining improved focus of images on the retina, which are all well-known. Distinction should also be made between the present invention and eye exercise systems, discussed extensively in Liberman, U. S. Patent Number 6,742,892 (along with an informative tract on eye anatomy, function and optics), which are primarily concerned with the improvement of eye tracking, convergence and accommodation.
Disclosure of Invention The present invention provides enhancement of a viewer's visual perception in a single two-dimensional image, which includes enhancement of the depth perception of a viewer in various types of two-dimensional images that include monocular cues for depth, and thereby the experience of stereo vision in the viewing by such enhancement of the viewer's perception of those monocular depth cues. Such an enhancement is effected by the present invention with the induction of a slight but sufficient retinal disparity in the viewer's view of the two-dimensional image. Such a retinal disparity is experienced by a viewer with a normal capacity for stereopsis as the fusion of retinally disparate images which include the two-dimensional image, the "enhancement effect" of the present invention. That is, the present invention so enhances the viewer's perception of the monocular depth cues in a single two-dimensional image as to cause the viewer to experience the fusion of stereo vision. Also a part of the enhancement effect andincluded in the invention is the enhancement of the "clarity " with which the viewer perceives a two-dimensional image, that is, the increase in resolution of the two-dimensional image as perceived by the viewer. The present invention comprises the creation for the viewer of what is referred to herein as an "enhanced scene" which includes a single two-dimensional image. There are several ways in which such an enhanced scene may be created by the invention, examples of which are: 1) the placement in front of the two-dimensional image of a visually identifiable object; 2) the horizontal movement of the two-dimensional image on the surface upon which the two-dimensional image is displayed; and 3) the display and horizontal movement of a visually identifiable object, or an image of such, on or at the surface upon which the two-dimensional image is displayed. All of these ways may be effected mechanically, electronically, optically, or by computer programming, or by a combination of such means. The currently preferred way to create an enhanced scene is the first way stated above, such an enhanced scene being also be referred to herein as a "combined scene", i.e. a scene including the 2D image with the addition of a visually identifiable object (VIO) in front of the 2D image. The creation of the enhanced scene within which the two-dimensional image is presented for viewing causes a retinal disparity in the viewer of the two-dimensional image. In the case of the preferred way, the retinal disparity is induced spatially, by reason of the viewer's binocular viewing of the enhanced scene, and is slight but sufficient to cause the viewer to experience the enhancement effect. In the other ways of creation of the enhanced scene, the retinal disparity is temporally induced, i.e. by the enhanced scene changing in time. The currently preferred visually identifiable object is frame a which completely or partially surrounds the viewer's area of interest in the two-dimensional image. Such a frame may have other features, such as illumination, shape, and color, that can add to the enhancement effect by combination and/or control with reference to the qualities of the two-dimensional image and the viewer's vision.
The system may include means for obscuring the edge of the two-dimensional image, where the edge of the two- dimensional image is sufficiently well defined to detract from the enhancement effect; and may also include a background mask for the enhanced scene to prevent the diminution of the enhancement effect by the visual environment in which the system is operating. The present invention provides a system, device within a system, and method for enhancing a viewer's visual perception in a two-dimensional image, which enhances the depth perception of a viewer in various types of two-dimensional images that include monocular cues for depth, and enhances the "clarity" with which the viewer perceives a two-dimensional image. The term "clarity" is used herein to mean the resolution with which the two-dimensional image is perceived by the viewer, and not the focus of the two-dimensional image. The effect of these enhancements shall hereinafter be referred to as the "enhancement effect". However, the enhancement effect being twofold, the aspects thereof shall be referred to as the "depth perception enhancement effect" and the "clarity enhancement effect" when the distinction is necessary. Otherwise, the term "enhancement effect" should be understood to mean either or both, depending on the context.
The present invention is described herein as a "device within a system", rather than simply a "device", because the device that is employed receives its identity and function according to an interactive relationship with the other elements of the system and/or the visual system of a viewer. The term visual system shall be taken to mean the human visual system, including the eyes and all of their internal structures, the optic nerves, all neural structures associated with all other functions of eye movement, protection, or control; and all neural structures by which data collected by the eyes is processed, recorded and interpreted, including the human brain, particularly the visual cortex.
As a foundation for understanding the invention and the nature of the enhancement effect, the following generally accepted definitions and principles related to the human visual system and visual perception may be considered:
1. Binocular visual field: region of overlapping visibility for the two eyes.
2. Point of Fixation (Point of Regard): Point or object on which the eyes are directed and one's sight is fixed.
3. Fovea: Point on the retina on which are focused the rays coming from an object directly regarded, i.e. from the point of regard.
4. Monocular depth cues: Visual cues which present information about the relative location of objects using one eye, which include: occlusion or interposition; aerial perspective (atmospheric perspective, aerial haze); linear perspective (convergence of parallel lines); relative height; texture gradients; shading and light; relative size; relative motion (monocular movement parallax); and familiar size.
5. Retinal disparity: Differences between two or more images projected on the retina of the eye with reference to the fovea of the retina. 6. Fusion: Neural process commonly referred to as stereoscopic vision (or stereo vision) thought to occur in the visual cortex that brings two retinal images to form a single image which is known as the single cyclopean image.
7. Panum's fusional region (Panum's fusional space): Region in visual space over which humans perceive binocular single vision derived from the fusion of binocular retinal images. (Outside Panum's fusional region physiological diplopia occurs.)
8. Panum's fusional area: Area on the retina of one eye, any point on which, when stimulated simultaneously with a single specific slightly disparate point in the retina of the other eye, will give rise to a single fused image.
9. Retinally disparate points: Retinal points which can give rise to different principal visual directions, which, when within Panum's fusional area (zone of single binocular vision), can be fused resulting in single vision.
10. Retinally disparate images: Retinal images which are comprised of retinally disparate points.
11. Retinal disparity: The difference in the retinal images that results from retinally disparate points of retinal images detected in the visual cortex which, if within Panum's fusional area (zone of single binocular vision), can be fused resulting in single vision.
12. Stereopsis: Ability to perceive depth produced by retinal disparity within Panum's fusional area requiring properly functioning binocular cells thought to exist in the visual cortex: the ability to distinguish the relative distance of objects resulting from the lateral displacement of the eyes that provides two slightly different views of the same object (disparate images).
13. Binocular retinal rivalry: Alternating suppression of the two eyes resulting in alternating perception of the two retinal images.
With respect to depth perception enhancement, the present invention provides a viewer who has the capacity for stereopsis with the experience of stereo vision in the viewing of a single two-dimensional image, hereinafter referred to as the "2D image", by enhancing the viewer's perception of depth in the monocular depth cues in the 2D image. That is, the depth perception enhancement effect of the present invention so enhances the viewer's perception of the monocular depth cues in a single two-dimensional image as to cause the viewer to experience the fusion of stereo vision with respect to the content of that 2D image. With respect to the clarity enhancement, the present invention provides a viewer who has the capacity for stereopsis with enhancement of the viewer's perception of clarity in viewing a 2D image, even without the presence of monocular depth cues therein. Such enhancements are effected by the present invention with the stimulation of a slight but sufficient retinal disparity on the Panum's fusional area of the viewer. A retinal disparity is experienced by a viewer with a normal capacity for stereopsis as the fusion of binocular views of the 2D image when viewed with the present invention. The theoretical foundation for the clarity enhancement effect also resides in the phenomena of eye dominance in humans, i.e., the dominant eye more strongly contributes to binocular vision than the other, and is said to be the eye that looks directly at an object; and the phenomena of binocular retinal rivalry, i.e., alternating perception of the two retinal images - indicating that the retinal image from only one eye at a time is being neurally recorded in the visual cortex. If it is the fusion of slightly disparate retinal images in the visual cortex that provides the experience of stereo vision, then a diminution of the strength of one of such images in the visual cortex must diminish the experience. Therefore, if one eye is more dominant, greater viewer attention to binocular vision, with consequently greater contribution by the non-dominant eye, may be required for a full perception of binocular cues. In ordinary viewing of a 2D image (without the use of the present invention) the viewer's attention in the 2D image is probably relaxed, because no significant retinal disparity results from the viewing of a 2D image directly, that is, along a line-of-sight which is substantially perpendicular to the 2D image. Such relaxation in attention appears to decrease the contribution that the retinal image from the non-dominant eye makes to the single cyclopean image (said to be the result of the fusion of the two retinal images in the visual cortex). However, greater attention in a two-dimensional image seems to occur with the use of the present invention and the consequent greater contribution to the cyclopean image by the non-dominant eye. This greater contribution by the retinal image of the non-dominant eye is a product of and carries with it the stimulus of the rods and cones of the non-dominant eye, thus increasing by as much as two-fold the number of stimulus points contributing to the cyclopean image with fusion of the retinally disparate images in the visual cortex. With such an increase in stimulus points being fused in the visual cortex, the resolution of the cyclopean image in the visual cortex is increased, and thus the increase in the "clarity" of the two-dimensional image experienced by the viewer, the clarity enhancement effect.
The system is here exemplified in various embodiments: mechanical (static and dynamic), electromechanical, electrical, electronic, optical, and by computer programming. All of the embodiments are designed to produce the enhancement effect for the viewer of a 2D image by a fusion experience resulting from the viewing of an "enhanced scene", hereinafter referred to as such, that includes the 2D image and the device within the system, the viewing of which causes a retinal disparity in the viewer.
In the various embodiments of the invention such retinal disparity may be spatial and/or temporal: spatial retinal disparity resulting from creation of retinal images with different eye locations, as where an enhanced scene includes mechanical elements spatially arranged with the 2D image and is viewed binocularly (with separation of the viewer's eyes); temporal retinal disparity resulting from the creation of retinal images at different times, as when an enhanced scene changes over time with the motion of its elements and/or motion of the viewer's eye.
The present invention and its underlying principle may be understood with reference to the drawings of the fundamental embodiment, also referred to as Embodiment No. 1, which is the static mechanical embodiment shown in FIGS. 1-3. The fundamental embodiment is referred to as such for the reason that the enhancement effect is attained with the operative parts of the system at rest (not in motion), and is operative with all types of 2D images. FIGS. 1-3 and FIGS. 13-19 show different examples of the fundamental embodiment, with FIG. 1 showing the a simple frame example, FIG. 2 showing a hood- frame example, FIG. 3 showing a simple-frame projection example , and FIGS. 13-19 showing various partial frame examples for various forms of display, the partial-frames being pairs of vertically oriented panels which bound the 2D image only on the sides.
In the various drawings it should be noted that the reference numerals for certain elements of the system are the same throughout the drawings where the function of such elements remains the same.
The 2D image 1 is referred to as such because it is substantially representable using coordinates of only two dimensions, regardless of the shape of the image surface 3, such as on an embossed surface, having a discernable texture, or the surface of a relief. The 2D image may be of any kind, including photographs, posters, drawings, paintings, signs, television and computer images; and all forms of front and rear projection images, film or electronic, both still and motion; however viewed, either directly or by other means; or whether generated or displayed mechanically, optically, or electronically. The term "2D image" as used in this disclosure may represent a three-dimensional scene, which is a scene with one or more monocular depth cues related to objects and/or surfaces at varying apparent distances from the viewer. A 2D image need not have any monocular depth cues in order for it to be viewed with the clarity enhancement effect; but in order to be viewed with the depth perception enhancement effect where not representing a three-dimensional scene, the 2D image must have at a minimum some monocular depth cue, even if only contrived for that purpose. The term "monocular", which literally means "having only one eye" or "with one eye", is not used in this disclosure as a synonym for "two-dimensional" as used in the term "2D image", and is specifically excluded from the meaning of "2D image" as used in this disclosure. However, the common meaning of "monocular" is used in this disclosure to describe an image of a physical scene of objects when viewed with one eye (and thereby may appear to be displayed on a two-dimensional surface), as well as with reference to "monocular cues" or "monocular depth cues".
The surface upon which a 2D image is presented shall be referred to as the "image surface" 3, which may be flat, faceted, horizontally and/or vertically curved, spherical, some other shape, or as previously discussed herein, and may be a surface which is not associated with a solid physical object, such as a sheet flow, spray of liquid, or cloud of vapor; or may be a surface defined by the 2D image in physical space not associated with any physical object at all.
For the purpose of this disclosure the term "horizontal", as referred to in all its derivative forms as well (such as "horizontally" as used hereinabove), shall mean a direction substantially parallel to the orientation of the viewer's eyes, i.e. in the direction of the line joining the center of the viewer's eyes, even though not horizontal in relation to the earth's surface; or the direction of a component of the distance vector between two points in space (from the vector representation of location, wherein the distance vector of a location is resolved into two component distance vectors at right angles, the magnitude of the resolved vector being the magnitude of the hypotenuse of the right triangle formed by the resolved distance vector with its components), which is substantially parallel to the orientation of the viewer's eyes. Consequently, the term "vertical", as referred to in all its derivative forms as well (such as "vertically"), shall mean a direction substantially within the plane perpendicular to said horizontal direction and substantially perpendicular to the direction of view of the viewer. An object 6 upon which an image surface 3 may be displayed or otherwise exist shall hereinafter be referred to as the
"image object" 6, and may be solid, liquid or gaseous.
Referring to the examples of the fundamental embodiment shown in FIGS. 1-3, the system for enhancement of visual perception includes a 2D image 1 which is displayed on an image surface 3, and a device within the system, which shall hereinafter be referred to as an "enhancer". In the case of the fundamental embodiment shown in FIGS. 1-3, the enhancer is a visually identifiable object, hereinafter referred to as a "VIO" 2, which is a physical object that is placed in front of the 2D image 1 (and thus in front of the image surface 3), visually discernable by the viewer as a distinct entity substantially separate from the 2D image 1, and not masked by confusion with the content of the 2D image 1 behind it. "In front" of the 2D image 1 means the side of the image surface 3 from which the 2D image is viewed by the viewer 9, and before and within the view 8 of the viewer
9 of the enhanced scene 13, regardless of the orientation of the image surface 3, but not necessarily between the 2D image 1 and the viewer 9. Thus, a VIO "in front" of the 2D image does not imply that any part of a 2D image is blocked from the viewer's view by the VIO.
It is preferable that the VIO 2 in front of the 2D image 1 be substantially within the depth of field of the viewer 9, i.e. substantially in focus for the viewer's 9 eyes 10 as they are focused on the 2D image 1, so that the entire enhanced scene 13 is also substantially in focus for the viewer 9. It is also preferable that the VIO 2 be located within the viewer's Panum's fusional region for the 2D image 1 , and the preferred location of the VIO 2 within the Panum's fusional region is in the boundary space of the Panum's fusional region: the space within the Panum's fusional region where the distance from the 2D image is significantly greater than the distance from the boundary of the Panum's fusional region in front of the 2D image. The VIO 2 may be opaque, translucent, transparent, or transparent with distortion. The preferred VIO 2 should have a clearly defined boundary 7 which can be readily focused upon when viewed by the viewer 9. The VIO 2 may obscure a part 11 of the 2D image
1 to the viewer, surround an area which includes the 2D image 1 , or surround all or part of the 2D image 1. The placement of the VIO 2 should also be such that the clearly defined boundary 7 of the VIO 2 nearest to the viewer 9 is a sufficient distance away from the 2D image 1 to render two slightly disparate images of the enhanced scene 13 in the binocular view 8 of the viewer, one on the retina of each of the veiwer's 9 eyes 10 and in the Panum's fusional area of the viewer. Thus, the location of the VIO
2 should preferably be, together with the 2D image 1 in the enhanced scene 13, substantially within the depth of field of the viewer's view of the 2D image 1, and/or within the boundary space of the Panum's fusional region of the viewer for the 2D image 1. Corresponding points of the enhanced scene 13 are thus projected on the Panum's fusional area of the viewer's 9 eyes
10 and generate a fused cyclopean image of the enhanced scene 13 in the viewer 9. Such a fused cyclopean image of the enhanced scene 13 in the viewer 9 gives the viewer 9 the experience of stereo vision, not simply by distinguishing distance between the 2D image 1 and the VIO 2, but within the 2D image 1 itself, by enhancing the viewer's perception of depth in the available monocular depth cues within the 2D image 1. This enhancement effect suggests that the human brain has the capacity to reconstruct and appreciate stereo vision in a two-dimensional image by the stimulation to fusion in the visual cortex of a retinal disparity presented by the binocular depth cue, substantially in Panum's fusional region, of the enhanced scene.
The invention is designed to be effective to enhance depth perception and/or clarity perception in a 2D image for a viewer who has two eyes and a relatively normal ocular and neural capacity for stereopsis. However, the intensity of the enhancement effect will vary with the level of such capacity in the viewer. In this respect the invention may also serve as an experimental probe for the phenomena of visual perception, both binocular and monocular.
The experience of stereo vision provided by the present invention is superior to the prior art in that the cyclopean images experienced with the present invention do not suffer from the defects described in the prior art, but are as natural as normal stereo vision to the viewer. The experience is natural because the experience is with the viewer's own eye separation and capacity for stereopsis. A VIO may have any shape, and may also be made to be adjustable between flat, and horizontally and/or vertically curved. The placement of a VIO may be by any means, such as suspension in position or attachment to the image object 6, fixed or adjustable with respect to distance from and angle with the image surface 3.
In an enhanced scene a VIO is operably associated with the image surface by a spatial relationship with and proximity to the image surface in order to produce the enhancement effect. Such status of a VIO is also intended to mean herein that the VIO is not physically connected to or with the viewer, either by attachment to or being worn by the viewer.
Different types of VIO may be used effectively, depending on the application for the invention. For example, a VIO may be a vertically oriented rod or tube, placed to the side and in front of the image surface; or may be a group of medallions strung above and in front of the image surface. The VIO may be a grid between the viewer and the 2D image with wide enough spacing between visible grid elements to minimize interference with the viewing of the 2D image. However, because the VIO must be clearly present to the viewer as an integral part of the enhanced scene, the use of a grid as the VIO would probably interfere with the viewer's appreciation of the content of the 2D image as an entirety. Where the viewer's "area of attention" 5 in the 2D image 1 is less than the entire 2D image 1 , a VIO 2 may be designed that is effective for that area of attention 5, such as a frame about the area of attention 5, which may partially obscure the rest of the image area, which shall hereinafter be referred to as a "VIO/frame" 2, examples of which are shown in FIGS. 1 -3. The term "area of attention" 5 is used here to mean the whole or part of a 2D image 1 that a viewer is focused upon and includes the viewer's 9 point of fixation. Such a VIO/frame 2 may be limited to a sufficient size to substantially bound the area of attention 5 for the viewer at a particular distance from the 2D image 1 , so that no well defined edges 4 of the 2D image 1 are available to the view 8 of the viewer 9, as shown in the example of FIG. 1.
Where the viewer's appreciation of the entire image is practically or aesthetically necessary, the preferred VIO/frame 2 is one that completely or partially surrounds the entire 2D image 1, with an aperture 12 that does not severely crop the 2D image 1 to the viewer 9. Such a VIO/frame 2 may have an adjustable aperture 12 in order to compensate for the viewer's 9 viewing position relative to the 2D image 1, the viewer's 9 angle of view, the shape of the image surface 3, the size of the 2D image 1 , and the distance of the viewer 9 from the 2D image 1. An adjustable aperture 12 may also be moved horizontally within the structure of a VIO/frame 2 for the purpose of intensification of the enhancement effect. Examples of VIO/frames that only partially surround the 2D image, such as partial-frame VIOs, are shown in FIGS. 13-19, all of which are essentially a pair of vertically oriented panels 14 to which individual VIOs 2 are attached or which generate images that operate as individual VIOs 2. Such partial-frame VIO/frames may be attached to the image object or image surface in various ways: as with clamps in FIGS. 13 (horizontal 24) and 14 (vertical 31) to which the panels 14 are attached by hinges 23; by attachment directly or with hinges 23 to the image surface 3 as in FIGS. 15 and 19; by attachment directly or with hinges 23 to the image object 6 as in FIGS. 16 and 18; or with display housings attached to or integrated with the image object as in FIG. 17. As indicated with respect to a VIO/frame which restricts the view of a viewer to a specific area of attention, the visibility to the viewer of well defined edges of a 2D image tends to announce the 2D image as flat in the space in front of the viewer, in contrast to other binocular cues within that viewing environment, and thus detracts from the enhancement effect. This tendency shall hereinafter be referred to as the "edge effect". The edge effect can be diminished by the diminution of the visibility of the edge of a 2D image, which shall hereinafter be referred to as "edge obscuring". A device employed to accomplish edge obscuring shall be referred to as an "edge obscuring" device.
A VIO/frame 2 may be a simple-frame, as shown in FIGS. 1 and 3, or hood-like as shown in FIG. 2 with edge obscuring panels 14 producing a reflection 15 of part of the 2D image 1 toward the viewer 9. Such a hood-like VIO/frame 2 may also incorporate reflective edge obscuration on the inner surface of the hood, and a telescoping section 2a which can be used to adjust the distance between the 2D image 1 and the visually identifiable boundary 7 of the VIO/frame 2. A simple-frame VIO/frame 2 may be used with separate edge obscuring panels 14 as shown in FIG. 3, where the 2D image 1 is produced on an image surface 3 by a projector 16 on an area bounded by edge obscuring panels 14, or integrated with edge obscuring panels as shown in FIGS. 13-19 with partial- frame VIO/frames..
As indicated earlier, the VIO 2 may also be itself an edge obscuring device by obscuring the edges 4 of the 2D image 1 from the immediate view 8 of the viewer 9, as in the case of a VIO/frame 2 shown in FIG. 1 , where the edges 4 of the 2D image 1 are cropped by the aperture 12 of the VIO/frame 2. However, also as earlier indicated, the VIO/frame 2 may also be in the form of a hood around the 2D image 1 as shown in FIG. 2, in which the edge obscuring panels 14 are reflective and a part of the hood VIO/frame 2. Indeed, obscuring the edges of a 2D image may be accomplished by various means that are integrated with or independent of the VIO, and are included in the invention. As shall be disclosed later in this description of the invention, an edge obscuring device may also operate as an enhancing device in the same manner as a VIO. With respect to the fundamental embodiment, various means may be employed to obscure the edge of the 2D image 1 using the light from the 2D image 1. In the example of the projection system shown in FIG. 3, the 2D image 1 can be bounded at one or more of its edges 4 by edge obscuring panels 14 as in the example of FIG.2, so that light from the 2D image 1 near an edge 4 is wholly or partially reflected or transmitted toward the viewer 9. Such an edge obscuring panel 14 may have other optical qualities that diffuse or distort light reflected from the 2D image 1 in order to more smoothly obscure the edge of the 2D image 1. The 2D image 1 may also be similarly bounded by edge obscuring panels 14 which are translucent or transparent, with internal light transmitting properties, that similarly diffuse and distort the light from the 2D image I. The edge 4 of the 2D image 1 can also be obscured by being bounded at one or more of its edges 4 by a light source distributed along the edge 4. Another means of edge obscuring is shown in FIG. 9: the edge obscuring mask (or image) 18B, 18W (B and W indicating Black and White colored patterns respectively), which can be attached to or displayed on the image surface 3 along the edges 4 of the 2D image 1 to diffuse or break up the viewers view of the edges 4 of the 2D image 1. The preferred edge obscuring mask 18B, 18W is one that is transparent with a pattern printed on it, where the pattern may be either opaque, transparent, translucent, or a combination thereof. Such a pattern would probably be most effective if it is most dense at the edge 4 of the 2D image 1, with a gradual diminution of the density of the pattern from the edge to the interior of the 2D image 1, as shown in FIG. 9: the series of dots of a color close to that of the color of the image surface 3 bordering the 2D image 1, that are most densely packed on the edge obscuring mask (or image) 18B, 18W near the edge, so as to be almost solid, diminishing to zero in size and packing density toward the interior boundary of the mask. Another form of pattern would obscure the edge of the 2D image 1 not only by variation in density from outer to inner boundary, but also by its variation in coloration (other than black and white) which would change in appearance as the image shines through or upon it. Many such patterns are possible, the suitability of which may vary with the viewer's visual ability and taste, and there is no intent to have this disclosure limit the invention to any particular type of pattern. In the case of front- or rear- projected 2D images, film or electronic, an edge obscuring image, such as shown in FIG.
9 as 18B, 18W, may be combined with the 2D image 1 , so that the display includes an image which effects edge obscuring. This may be accomplished by superimposing an electronically generated edge obscuring image on the 2D image in simulation of a transparency with a pattern as described above: either by including the edge obscuring image on the film print, in the case of film projection, or combining an electronically generated edge obscuring image with the 2D image for display. Such electronically generated edge obscuring images may be static and of various design, or dynamic, changing with time in design, size, color, frequency, etc. to intensify the enhancement effect as the nature of the 2D image may require.
The image obscuring in the form shown in FIG. 9 may be practiced independently of Embodiment No. 3, and may be practiced with the fundamental embodiment and Embodiment No. 2.
Again referring to FIG. 9, another form of mask (not shown in FIG. 9) for obscuring the edge 4 of the 2D image 1 can be affixed at the edge 4 of the 2D image 1 on that part of the image surface 3 that surrounds the 2D image 1. Such a mask may have an edge obscuring pattern printed on it similar to the series of dots for the mask 18B, 18W on the 2D image 1, but with a background close to the 2D image 1 in color, such a pattern being most densely packed on the mask furthest from the edge 4 of the 2D image, diminishing to zero in size and packing at the edge 4 of the 2D image 1.
As mentioned earlier in this disclosure, an edge obscuring device may also operate as an enhancing device in the same manner as a VIO;. That is, an edge obscuring device may be effective as a VIO if it has the attributes of a VIO previously described herein. Thus, an edge obscuring panel which has optical and/or electrical properties that cause the light from the 2D image to be reflected from and/or transmitted along the panel so as to provide a visually identifiable boundary of the panel within the Panum's fusional region would have some enhancement effect as a VIO, depending on its shape and other physical characteristics, as shown in FIGS. 13-19. For the examples in FIGS. 13-16 such a panel 14 which is vertically oriented would so function at a vertical edge of a 2D image if it is mirror-like on the side exposed to the 2D image. For another example, such a panel, similar to the panel 14 in FIG. 18, would so function if it was partly mirror-like and partly light-transmitting, with the mirror-like part of the panel being curved and exposed to the 2D image at the edge of the 2D image, and the light-transmitting part, similar to the VIO 2 strip in FIG. 18, facing the viewer. Yet another example of a panel which may operate as an edge obscuring device and a VIO at the same time is a "live panel", a panel which is capable of displaying an image such as an LCD panel or plasma display as shown in FIG. 18, or upon which a projected image, front (as shown in FIG. 19) or rear (as from within the housing shown in FIG. 17) can be displayed. Such a live panel could be of any shape, flat (as shown in FIG. 19) or curved (as shown in FIG. 18), with a surface on which an image could be displayed toward the viewer, such surface hereinafter being referred to as the "live face" and the image displayed thereon as the "face image" 27. The live panel, or a substantial part thereof, would preferably be disposed at a sufficient angle (more than 90 degrees) with the image surface 3 so that the viewer has an angular view of a substantial part of the face of the panel 14 when viewing the 2D image 1 directly. The face image may have an edge obscuring component and/or a VIO component. The edge obscuring component of the face image would blend with the 2D image and distort the 2D image to obscure the boundary with the 2D image, while the VIO component of the face image would provide a graphic that would be a clearly distinguishable VIO in contrast with edge obscuring component. The VIO aspect of the live panel may only be a function of the VIO component of the face image displayed on the live face, or the shape of the panel may contribute to the definition of the VIO as in FIGS. 17-19. Either or both the VIO and edge obscuring components of the face image may be displayed as fixed or in motion on the panel and may be varied in their respective properties in the manner disclosed herein for VIOs and edge obscuration generally.
As with the edge effect, detraction from the enhancement effect may also occur with the "background effect": the spatial contrast between the enhanced depth perception in the viewing of a 2D image and the scene of objects in the region of physical space within focus behind or beside the 2D image. Such a spatial contrast also occurs when the relatively confined region of space behind the 2D image is not greatly out of focus and contains easily visible and distinguishable objects that are distributed therein. Large spaces behind the 2D image with objects distributed therein that are not easily focused upon when viewing the 2D image do not tend to provide the spatial contrast of the background effect. That tendency is similarly avoided when the 2D image is displayed against or a short distance in front of a relatively flat wall, or a background with random textures, regular patterns, or visually indiscernible objects. Indeed, a means for the defeat of the background effect is thus suggested, which shall be referred to as "background masking": a mechanical or optical background for the enhanced scene to prevent the diminution of the enhancement effect by the visual environment in which the system is operating, which effects the conditions that avoid the spatial contrast of the visual environment with the enhanced scene.
The enhancement effect may be intensified and/or maintained by illumination of the VIO for the viewer from the front, back, or internally, or where the VIO is itself in whole or in part an illuminating device. Illumination of the VIO may also be derived from the light emitted or reflected by the 2D image, in the case of video display or projection, using light transmitting or reflecting panels. The illumination of the VIO may be of various colors and intensities, and/or may be polarized; and the' color, intensity and/or polarization of the illumination may be variable over time. Such variation in the illumination may be programably controlled with reference to the characteristics of the 2D image, such as brightness, coloration, resolution, shape, program material, monocular depth cues, etc.; and/or controlled with reference to the characteristics of the viewer's vision. Intensification of the enhancement effect may be achieved with a graphic pattern 19 visually discernable by the viewer
9 being applied to a surface of the VIO 2 which faces the viewer 9, as shown in FIG. 1 , and is particularly effective when placed on the most horizontal sides of a rectangular VIO/frame 2. The pattern itself may be illuminated, a graphic directly applied to the VIO 2, illuminated or otherwise, integrated with the illumination of the VIO, or applied to interrupt the illumination of the VIO 2 by blocking certain parts of such illumination of the VIO 2 to the viewer's 9 view. The pattern may be a group of VIOs arranged for the purpose, or a group of VIOs may be arranged to form such a pattern. Such a pattern may also operate to distribute the enhancement effect over the viewer's area of interest 5.
Where the 2D image is not produced on an illuminating device, such as a television monitor, light box, or projection screen, the enhancement effect of the system and device may also be improved by illumination of the 2D image. Such illumination of the 2D image may be from sources attached to or independent of the VIO, and may be controlled in a manner similar to the illumination of the VIO.
All of the various attributes of the 2D image and the VIO may be combined and controlled-to accommodate the position and vision characteristics for the viewer and to intensify and/or maintain the enhancement effect with respect to the various characteristics of the 2D image; and the entire range of such combination and control is included in the invention. Such control of the system may also be programmed to achieve specific effects in the 2D image, and/or associated with the generation of the 2D image, such as a broadcast signal, or on a recorded track, such as videotape, compact disc, digital video disk, digital video recorder, or on a motion picture film. Such programming may even be composed for presentation of the entire range of 2D images with which the system may be practiced, preexisting as well as contemporary with the composition.
The method for enhancement of visual perception of the present invention, which the system and device of the present invention are designed to practice, may include the creation for the viewer of an enhanced scene. The method may therefore involves the selection of the elements of the enhanced scene: the 2D image which is the subject of the enhanced scene; the surface upon which it is to be displayed, and the enhancer. For depth perception enhancement, it is necessary that the 2D image have monocular depth cues, but such monocular depth cues are not necessary for clarity enhancement. Among the monocular depth cues to be considered in the selection for depth perception enhancement of a 2D image as the subject of an enhanced scene are occlusion or interposition, aerial perspective, linear perspective, relative height, texture gradients, shading and light, relative size, relative motion, and familiar size. In addition to monocular depth cues, other characteristics of the 2D image may be considered in the analysis, such as the inherent clarity of the 2D image, the level of illumination depicted within the 2D image, the number of objects in the 2D image, the similarity of objects in the 2D image, the randomness or order of the objects in the 2D image, and the inherent resolution of the 2D image; and, in the case of moving 2D images, the steadiness of the 2D image, the rapidity of movement within the 2D image, the duration of the cuts (the period of uninterrupted action) in the 2D image, and the length of time that monocular depth cues exist uninterruptedly in the scenes of the 2D image. The method may also include the taking into consideration of the size of the 2D image, the distance of the viewer from the 2D image, and the angle from which the 2D image is being viewed. The 2D image is then presented on an image surface selected for the 2D image. One or more enhancers to be used with the 2D image as displayed (its type, size, etc.), and its mode of operation (coloration, illumination, motion, programming, etc.) may then be selected for the desired enhancement effect. If the enhancer is a VIO, it is preferred that it be operably associated with the image surface upon which the 2D image is displayed. The VIO together with the 2D image presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity. The other possible enhancers include a configuration of standard electronic, optical and/or mechanical components which moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface; and/or generates a horizontally moving two-dimensional image of a visually identifiable obj ect at or on the image surface which is seen by the viewer with said 2D image. If one or more of the enhancers is a VIO, the visual system of the viewer of the 2D image is caused by the constitution of the enhanced scene to be subjected to a slight but sufficient spatial retinal disparity in the retinal images of the 2D image detected by the viewer's visual system: if one of the other enhancers is used, the viewer of the 2D image is caused to be subjected to a slight but sufficient temporal retinal disparity in the retinal images of the 2D image. The viewer is thus caused to experience a single fused cyclopean image, a single vision resulting from a fusion of the retinally disparate images, in which the viewer' perception of depth in any monocular depth cue in the 2D image may have is so enhanced as to be experienced as a form of stereo vision, and in which the viewer's perception of clarity is so enhanced as to be experienced as an increase in resolution of the 2D image.
The criteria for the analysis of the 2D image that is to be performed in conjunction with the method described above may be included in a rating system for 2D images the purpose of which is to inform the viewer and the parties involved with the presentation of the 2D image as to the level of qualification of the 2D image for the enhancement effect that may be expected with the present invention. Such a rating system may quantify the criteria used to rate the 2D image, and report the results thereof in a numerical, verbal, graphic, and/or summary form. The ratings thereby generated may also be used by the parties having a proprietary interest in the content of the 2D image to market same and to qualify for the use of the present invention.
With the understanding of Embodiment No. 1, the fundamental embodiment, the other following described basic embodiments will be seen to also employ the essential elements: Embodiment No. 2: Electronic generation of a 3D VIO for a stationary 2D image.
Embodiment No. 3: Electronic or mechanical horizontal movement of the 2D image relative to the image surface. Embodiment No. 4: Electronic or mechanical horizontal movement of a 2D VIO image relative to the image surface for a stationary 2D image. Embodiment No. 5: Horizontal movement of a mechanical VIO at the image surface for a stationary 2D image. Embodiment No.6: A computer program operating in a computer to provide horizontal movement of a 2D image relative to the image surface and/or horizontal movement of a 2D VIO image relative to the image surface for a stationary 2D image. Other embodiments are possible by various combinations of these with each other, including the fundamental embodiment, and with edge obscuring and/or background masking.
Embodiments 2 through 5 may be practiced with enhancers which are various configurations of standard components: devices which are well known for the purpose for which they are designed and fabricated. Such devices are comprised of standard signal processing circuitry that generates, combines, modifies, and extracts the signals for the 2D image and the accessory images of which Embodiments 2 through 5 are comprised. A configuration of standard components is a utilization of standard components by combination in a relationship and/or connection to achieve an operation to which each contributes according to its respective purpose. However, the operations performed by the configurations of standard components disclosed herein do not appear to be known in the prior art. Embodiment No. 6, however, is practiced with a computer program operating 5 in a computer which itself generates and/or displays the 2D image which is enhanced by the operation of the computer program itself in the generation and/or display of the 2D image, such enhancement including the elements of horizontal movement of the 2D image and/or horizontal movement of one or more 2D VIO images in the same way as in Embodiments Nos. 3 and 4.
Embodiment No. 2 is shown in FIGS. 4, 5, and 8, and is a system that operates essentially as the fundamental embodiment, but with a computer generated virtual 3D VIO image 17 (FIG. 8), instead of a mechanical VIO, which is
10 electronically displayed 1 OO at the same time with the 2D image 1. The 3D VIO image 17 is generated by standard video image generation equipment 30 for viewing with a standard form of 3D viewing glasses, two color (usually for black and white 2D images), polarized, or shutter 130, the latter being controlled by a standard device 110 providing a control signal 120 in synchronization with alternating left-right frames of the 3D VIO image 17. The left-right components of the 3D VIO image 17 are generated 30 to make the 3D VIO image 17 appear outside and in front of the image surface 3 when viewed with 3D glasses
15 130, so that the resulting enhanced scene displayed, the 3D VIO image 17 with the 2D image 1, is seen through the 3D glasses 130 by the viewer as a 2D image I on the image surface with a VIO 2 suspended in front of it as in the case of the fundamental embodiment shown in FIG. 1. The 3D VIO image 17 may incorporate edge obscuring for the 2D image 1 , or may itself obscure the edge of the 2D image 1. As can be seen from FIG. 4, the 3D VIO image signal 40, which includes a synchronizing 3D VIO control signal 60, is sent to a standard video mixing device 50 for combination with the 2D image signal 35 input from a standard
20 video source 25, which throughputs the synchronizing 3D VIO control signal 60 for transmission to a standard device for controlling viewing glasses 110 with a viewing glasses control signal 120. The combined image signal 70 is then converted 80, if necessary, to a video display signal 90 for the video display 100 being used. As shown in FIG. 5 the synchronizing 3D VIO control signal 60 may be extracted from the combined image signal 70 with the processing in the device for converting the combined image signal for input to display 80, or sent directly to the device for controlling viewing glasses 110 from the device
25 for generating the 3D VIO image 30. The use of the other forms of 3D glasses for viewing a 3D VIO would require the 3D VIO image to be generated with the appropriate colorations or polarization, and would eliminate the need for a 3D glasses controller and its driving signal. Embodiment No. 2 is not a preferred embodiment for normal viewing inasmuch as it suffers from the disadvantage of the necessity for eye wear, but may be of use in diagnostic and treatment applications of the present invention.
Embodiment No. 3 shown in FIGS. 6 and 9 is a system which provides the enhancement effect by horizontal motion
30 2OL, 2OR (L and R indicating Left and Right movement respectively) of the 2D image lwith reference to the viewer's point of fixation on the image surface 3, such motion not being significantly perceptible by the viewer, so that a sufficient component of such motion is substantially parallel to the orientation of the viewer's eyes in both directions of such orientation, and is of sufficient speed and frequency to induce a slight but sufficient temporal retinal disparity in the viewer. The term "component of motion" as used herein means the motion represented by one of the components of the velocity vector (well known from the 5 vector representation of uniform linear motion), wherein the velocity vector is resolved into two component velocity vectors at right angles, the magnitude of the resolved vector being the magnitude of the hypotenuse of the right triangle formed by the resolved velocity vector with its components. As in the other embodiments disclosed, such a retinal disparity usually results in fusion of the retinal images in the viewer 9, and thus the enhancement effect. The horizontal movement 2OL, 2OR, however, may be timed for the individual viewer in order to accommodate the viewer's alternating perception of the disparate retinal images. 0 The system devices may be used to effect such horizontal motion 2OL, 2OR at any velocity consistent with the characteristics of the display 100, such as refresh rate. Such horizontal motion 2OL, 2OR may also be regulated with respect to distance, direction, and frequency, so that the 2D image 1 may be moved horizontally 2OL, 2OR back and forth on the image surface 3, either automatically, under the control of the viewer directly, or as programmed by the viewer. That is, the frequency, the velocity, and the mode of such motion, (such as: slowly to the right, and rapidly back to the left; rapidly to the right, and 5 suddenly back to left to the original or another position; or, suddenly to the right, and back slowly to the left; etc.) may be chosen to suit the viewer. Such control may also be coordinated with the content of the 2D image 1, provided with and as part of the 2D image signal 35, and/or be made subject to the preferences of the viewer.
Embodiment No.3 of the system for horizontal motion 2OL, 2OR of the 2D image 1 may be mechanical, as in the case of a film projector, front or rear, motion or still. Such motion may be accomplished by the mechanical movement of certain components of a film projector, such as the film gate, aperture plate, or the projector optics; or electromechanically, electronically controlled electrically driven mechanical motion, all of which may be regulated in the same manner as the electronic system previously described.
Embodiment No. 3 optionally lends itself to the use of viewing glasses of the type used with Embodiment No. 2. In this embodiment, however, the viewing glasses alternately shutter each eye as the 2D image 1 is horizontally moved 2OL, 2OR. The system of Embodiment No. 3 is designed to provide an adequate enhancement effect without the necessity for viewing glasses, but the use thereof is not excluded from use with the system.
As can be seen from FIGS. 6 and 9, Embodiment No.3 may be employed with edge obscuring by combining an edge obscuring image signal 150 with the horizontally moving 2D image signal 180. An edge obscuring image signal 150 is produced by a standard device for generating 2D edge obscuring image 140 which is combined with the 2D image signal by a standard device 160. The combined image signal 70 is such that the edge obscuring image 18B, 18W (FIG. 9) displayed is relatively stationary relative to the image surface 3, while the 2D image 1 is in horizontal motion 20L, 20R. As shown in FIG. 9 the color of the image surface border 3B, 3W (B and W indicating Black and White colored image surface borders respectively) should match the color and/or pattern of the edge obscuring image 18B, 18W. (Although the image surface borders 3B, 3 W are shown in two colors (black and white) in FIG. 9 for purposes of illustration of the variation possible, the border of the image surface 3 would usually have a color and/or pattern which would match the color and/or pattern of the edge obscuring image 18B, 18W). However, as previously discussed, such an edge obscuring image 18B, 18W may also be dynamic in nature, and may be designed to intensify the enhancement effect for the particular 2D image 1 displayed. Also as previously mentioned, edge obscuring in the form shown in FIG. 9 may be practiced independently of Embodiment No. 3, and may be practiced with the fundamental embodiment and Embodiment No. 2.
Embodiment No.4 shown in FIGS.7, 10, 11, and 12 is a system which induces the slight but sufficient retinal disparity required for the enhancement effect by horizontal motion 22L, 22R (L and R indicating Left and Right movement respectively) of one or more two-dimensional VIO images 21 , hereinafter referred to as 2D VIO images, the preferred form of which is a frame that may hereinafter referred to as "2D VIO/frame image" 21, which is displayed with the 2D image 1 to be viewed. As with the fundamental embodiment, the 2D VIO/frame image 21 may be other than the simple-frame shown in FIG. 10, and may be partial-frames 21 as shown in FIGS. 11 and 12 as a pair of vertical bars or patterns superimposed on or part ofthe 2D image 1. The horizontal motion of the 2D VIO/frame image 21 is with respect to a viewer's point of fixation on the image surface with a sufficient component of such motion parallel to the orientation of the viewer's eyes in both directions of such orientation, but is not significantly perceptible by the viewer. Such motion is of sufficient speed and frequency (left and right) to induce a temporal retinal disparity in the viewer. The 2D VIO/frame image 21 may be superimposed upon or surround the 2D image 1. As in the other embodiments disclosed, such a retinal disparity normally results in fusion of the retinal images in the viewer, and thus the enhancement effect. The horizontal motion 22L, 22R, however, may be timed for the individual viewer in order to accommodate the viewer's alternating perception of the disparate retinal images. The system devices may be used to effect such horizontal motion 22L, 22R at any velocity consistent with the characteristics of the display 100, such as refresh rate. Such horizontal motion 22L, 22R may also be regulated with respect to distance, direction, and frequency, so that the 2D image 1 may be moved horizontally 22L, 22R back and forth on the image surface 3, either automatically, under the control of the viewer directly or as programmed by the viewer. That is, the frequency, the velocity, and the mode of such movement (such as: slowly to the right, and rapidly back to the left; rapidly to the right, and suddenly back to left to the original or another position; or, suddenly to the right, and back slowly to the left; etc.), may be chosen to suit the viewer. Such control may also be coordinated with the content of the 2D image 1, provided with and as part of the 2D image signal 35, and/or be made subject to the preferences of the viewer. Where the 2D VIO/frame image 21 completely or partially surrounds the 2D image 1, the 2D image 1 may be reduced in size so that substantially all of the 2D image 1 is displayed within the frame, that is, without cropping by the frame. Embodiment No. 4 also includes the mechanical, electromechanical, or electronically controlled electrically driven mechanical horizontal motion of the 2D VIO image 21 , and the regulation thereof, which may be implemented in a substantially similar manner as that described for Embodiment No. 3. The system for horizontal movement 22L, 22R of the 2D/frame image 21 may be mechanical, as in the case of a film projector, front or rear, motion or still. Such motion may be accomplished by the mechanical movement of certain components of a film projector, such as the film gate, aperture plate, or the projector optics; or electromechanically, electronically controlled electrically driven mechanical movement, all of which may be regulated in the same manner as the electronic system previously described.
Embodiment No. 4 also optionally lends itself to the use of viewing glasses of the type used with Embodiment No. 2. In this embodiment, however, the viewing glasses alternately shutter each eye as the 2D VIO/frame image 21 is horizontally moved 22L, 22R. The system of Embodiment No.4 is designed to provide an adequate enhancement effect without the necessity for viewing glasses, but the use thereof is not excluded from use with the system.
Embodiment No. 4 may also be employed with edge obscuring images 18B, 18W (FIG. 9) by combining an edge obscuring image signal 150 (FIG. 6) with the signal of the horizontally moved 22R, 22L 2D VIO/frame image 21 as is accomplished for the combination in the case of Embodiment No. 3. An edge obscuring image signal 150 (FIG. 6) produced by a standard image generator 140 (FIG. 6) may also be combined with the 2D VIO/frame image signal 220. The combined image signal 70, after conversion for display 90, is such that the edge obscuring image 18B, 18W (FIG.9) displayed is relatively stationary with respect to the 2D image 1 and the image surface 3, as in Embodiment No. 2, while the 2D VIO/frame image 21 is in horizontal motion 22R, 22L. Moreover, the 2D VIO/frame image 21 may be dynamic in nature in the same manner as a dynamic edge obscuring image 18B, 18W, and may be designed to intensify the enhancement effect for the particular 2D image 1 displayed.
Embodiment No. 5 (shown only in relation to the drawings for the other embodiments) involves a mechanical VIO, and may be practiced in a manner similar to Embodiment No. 4, but without the flexibility afforded by the use of an electronically generated 2D VIO/frame image 21 (FIG. 10). Horizontal movement of a mechanical VIO at the image surface 3 (not shown in the drawings but essentially portrayed in FIG. 10 in identification with the 2D VIO/frame 21) may be accomplished by standard forms of mechanical actuation, electrically or mechanically motivated, and electronically or mechanically controlled. Otherwise, substantially the same types of VIO configurations and movements may be used as described for Embodiment No. 4 to produce the enhancement effect. As with all of the embodiments, the full range of edge obscuring techniques are employable to diminish the edge effect.
Embodiment No. 6 is implemented by and within a computer program operating in a computer that generates and/or displays 2D images, such as for animation, art, simulation, graphical representation, and from processing and/or presentation of analog and digitized images generally. The term computer program as used herein shall mean a complete operational computer program, or a component thereof, such as a program overlay, a coded algorithm, or a subroutine. The computer program performs by instructions to the computer for the operations carried out by the configurations of standard components in Embodiments Nos. 3 and 4. Embodiment No. 6 makes the movement of the 2D image and/or the movement of the 2D VIO images practiced by Embodiments Nos. 3 and 4 inherent in and/or included with and/or and adjunct to the 2D images generated or processed by the computer program in its primary function (such as a presentation, gaming, design, animation, artistic expression, word processing, and image processing). A computer program that generates or processes "still" 2D images (such as photographs, graphics and word processing) may include with the generated video frames information for one or more 2D VIO images and their horizontal movement, and/or information for the horizontal motion of the 2D image. Edge obscuring image information may also be incorporated with the information for the generated frames of the 2D image. A computer program that generates or processes a "moving" 2D image, i.e. motion presented by successive still frames (such as animation, cinematography, or television), may include with the generated video frames similar information as that for "still" images appropriate for the characteristics of the "moving" 2D image. The same control of the horizontal movement involved in Embodiments Nos.3 and 4 may also be practiced with Embodiment No.6, but controlled by the program and the inputs provided for thereby.
Embodiments 2-4 and 6 of the invention disclosed herein may be practiced in their electronic or electromechanical form with any presently known form of signal transmission, such as electromagnetic broadcast, cable, and computer networking, or video recording; or presently known form of intermediate electronic processing thereof by devices interposed between the reception or production of a 2D image and the display of the 2D image; and the entire range of combination and control of such signal transmission and processing is contemplated for the practice of said embodiments and included in the invention. Similarly, the foregoing practice as applied with respect to any control of the system and/or face image that may be used is also contemplated for the fundamental embodiment (Embodiment No. 1).
At various points during the course of this disclosure the suggestion has been made that the enhancement effect of the present invention has application to the study of vision, particularly in diagnostics and treatment. It has also been suggested that the principle upon which the present invention operates is newly presented here. In fact there are additional aspects to the enhancement effect of the present invention that plumb the depths of the currently unknown functions of the visual cortex and the operation of binocular retinal rivalry.
While the invention has been disclosed in connection with the example of certain embodiments, it will be understood that there is no intention to limit the invention to the particular embodiments shown. This disclosure is intended to cover the general application of the method and systems specifically disclosed and the various alternative and equivalent constructions included within the spirit and scope of the appended claims.
Brief Description of the Drawings
FIG. 1 is a perspective view of a mechanical embodiment of the system with a simple frame VIO.
FIG.2 is a perspective view of a mechanical embodiment of the system with a hood-frame VIO with integrated edge obscuring. FIG. 3 is a perspective view of a mechanical embodiment of the system for front projection with a a simple frame VIO and separate edge obscuring.
FIG. 4 is a block diagram of a first example of the system utilizing an electronically generated virtual 3D VIO.
FIG. 5 is a block diagram of a second example of the system utilizing an electronically generated virtual 3D VIO.
FIG. 6 is a block diagram of an example of the system utilizing an horizontal image movement and edge obscuring. FIG. 7 is a block diagram of an example of the system utilizing horizontal frame image movement.
FIG. 8 is a schematic diagram of the system with a generated virtual 3D VIO.
FIG. 9 is a schematic diagram of horizontal image movement with edge obscuring.
FIG. 10 is a schematic diagram of horizontal simple-frame image movement.
FIGFIG. 11 is a schematic diagram of horizontal partial-frame (vertical bars) image movement. FIG. 12 is a schematic diagram of horizontal partial-frame (vertical pattern) image movement.
FIG. 13 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO attached to an image object with a horizontal clamp.
FIG. 14 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO attached to an image object by a vertical clamp. FIG. 15 is a perspective view of a mechanical embodiment of the system for front projection with a partial-frame VIO attached to an image surface.
FIG. 16 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO attached to an image object.
FIG. 17 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO of display housings.
FIG. 18 is a perspective view of a mechanical embodiment of the system with a partial-frame VIO of display panels. FIG. 19 is a perspective view of a mechanical embodiment of the system for front projection with a partial-frame VIO which is illuminated by the front projection.
Best Mode for Carrying Out Invention
The best mode for carrying out the invention depends on the application, and the disposition of the viewer with respect to the particular embodiments disclosed. For entertainment, and cultural applications, it is believed that the fundamental embodiment in its various forms will provide the most satisfying experience where space permits. For computer and gaming applications, the best mode may be found in the various forms of Embodiment No. 6. For television and cable broadcasters, the best mode may be found in various forms of Embodiment No. 4. For medical imaging the best mode may be Embodiment No. 2.
Industrial Applicability
The use of the invention applies to all manner of display of two-dimensional images wherein the enhancement of depth perception of the viewer increases the intelligibility of the image to the viewer, such as medical imaging and computer graphic displays, as well as the entertainment (motion pictures and television), cultural (drawings, paintings, photographs, etc.), and commercial (posters, billboards, etc.) applications. The invention may also be used for scientific purposes as probe of the human visual system, particularly the visual cortex and the brain-eye connection, as well as the phenomena of vision generally. The principle objects of the invention are to provide: 1) enhancement of a viewer's visual perception in a single two-dimensional image, which includes enhancement of the depth perception of a viewer in various types of two-dimensional images that include monocular cues for depth, and 2)

Claims

CLAIMSWhat I claim as my invention is:
Claim 1. A system and device for enhancement of visual perception in a viewer of a two-dimensional image comprising: a) a two-dimensional image having one or more monocular depth cues displayed on an image surface; and b) at least one visually identifiable object placed in front of said image surface to create a combined scene with said two- dimensional image, said visually identifiable object being:
1) substantially within the depth of field of focus of said viewer's eyes when said two-dimensional image is in focus for said viewer, 2) without substantially interfering with the view of the viewer of said two-dimensional image, and
3) a sufficient distance from the two-dimensional image to induce disparate binocular retinal images in the eyes of the viewer; having the effect of enhancement of the viewer's visual perception in viewing said two-dimensional image by and/or with the fusion of said binocular images of the combined scene in the viewer.
Claim 2. The system and device for enhancement of visual perception of claim 1 wherein said at least one visually identifiable object is substantially within the Panum's fusional region for said two-dimensional image;
Claim 3. A system and device for enhancement of visual perception in a viewer of a two-dimensional image comprising: a) a two-dimensional image displayed on an image surface; and b) at least one visually identifiable object positioned in front of the image surface, said at least one visually identifiable object being:
1) substantially in focus for said viewer with said two-dimensional image, and
2) at a sufficient distance from said image surface to induce disparate retinal images in the eyes of the viewer; having the effect of enhancement of the viewer's visual perception in viewing said two-dimensional image by and/or with the fusion of said disparate retinal images in the viewer.
Claim 4. The system and device for enhancement of visual perception of claim 3 wherein said two-dimensional image includes one or more monocular depth cues.
Claim 5. The system and device for enhancement of visual perception of claim 3 wherein said image surface is curved, either horizontally, vertically, or horizontally and vertically.
Claim 6. The system and device for enhancement of visual perception of claim 3 wherein said at least one visually identifiable object is a frame.
Claim 7. The system and device for enhancement of visual perception of claim 3 wherein said two-dimensional image is in horizontal motion within the viewer's view relative to the visually identifiable object, such horizontal motion being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 8. The system and device for enhancement of visual perception of claim 3 wherein said visually identifiable object is in horizontal motion within said viewer's view relative to the image surface, such horizontal motion being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 9. The system and device for enhancement of visual perception of claim 3 wherein said at least one visually identifiable object is substantially within the Panum's fusional region for said two-dimensional image;.
Claim 10. The system and device for enhancement of visual perception of claim 3 wherein said at least one visually identifiable object is illuminated on the side which faces said viewer.
Claim 11. The system and device for enhancement of visual perception of claim 10 wherein the source of illumination is attached to or within said at least one visually identifiable object.
Claim l2. The system and device for enhancement ofvisual perception of claim 1 1 wherein the illumination ofsaid at least one visually identifiable object is variable in intensity, color and/or polarization, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 13. A system and device for enhancement ofvisual perception in a viewer of a two-dimensional image comprising: a) a two-dimensional image with one or more monocular depth cues, the two-dimensional image being displayed on an image surface; and b) at least one visually identifiable object positioned in front of the image surface, said at least one visually identifiable object being: 1) at a sufficient distance from said image surface to induce disparate retinal images in the eyes of the viewer, and
2) substantially in focus for said viewer with said two-dimensional image and/or substantially within the Panum's fusional region for said two-dimensional image; having the effect of enhancement of the viewer's visual perception in viewing said two-dimensional image by and/or with the fusion ofsaid disparate retinal images in the viewer.
Claim 14. The system and device for enhancement ofvisual perception of claim 13 wherein said image surface is curved, either horizontally, vertically, or horizontally and vertically.
Claim 15. The system and device for enhancement ofvisual perception of claim 13 wherein said two-dimensional image is in horizontal motion within the viewer's view relative to the visually identifiable object, such horizontal motion being controlled with reference to the brightness, color, and/or monocular depth cues ofsaid two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 16. The system and device for enhancement ofvisual perception of claim 13 wherein said visually identifiable object is in horizontal motion within said viewer's view relative to the image surface, such horizontal motion being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 17. The system and device for enhancement ofvisual perception of claim 13 wherein said at least one visually identifiable object is illuminated on the side which faces said viewer.
Claim 18. The system and device for enhancement ofvisual perception of claim 17 wherein the illumination ofsaid at least one visually identifiable object is variable in intensity, color and/or polarization, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 19. The system and device for enhancement of visual perception of claim 13 wherein said at least one visually identifiable object is a frame.
Claim 20. The system and device for enhancement of visual perception of claim 19 wherein the horizontal size of said aperture of said frame is variable within the viewer's view relative to the two-dimensional image, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 21. The system and device for enhancement of visual perception of claim 19 wherein the shape of said frame and/or the size of the aperture of said frame is variable, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 22. The system and device for enhancement of visual perception of claim 19 wherein the aperture of said frame has the same shape as said two-dimensional image, and is of sufficient size so that substantially all of said two-dimensional image appears to said viewer to be within said aperture.
Claim 23. The system and device for enhancement of visual perception of claim 13 wherein at least half of the opposing edges of said two-dimensional image are obscured from the view of said viewer of said two-dimensional image.
Claim 24. The system and device for enhancement of visual perception of claim 13 wherein a pattern which is visually discernable by said viewer of said two-dimensional image is applied to the most horizontal sides of said visually identifiable object which faces the viewer.
Claim 25. The system and device for enhancement of visual perception of claim 13 wherein said image surface is curved, either horizontally, vertically, or horizontally and vertically.
Claim 26. The system and device for enhancement of visual perception of claim 13 wherein said at least one visually identifiable object is illuminated, and the source of illumination is attached to or within said at least one visually identifiable object.
Claim 27. The system and device for enhancement of visual perception of claim 13 wherein said at least one visually identifiable object is recognizable as being a particular thing distinguishable by said viewer as nearer in space to said viewer than said two- dimensional image.
Claim 28. The system and device for enhancement of visual perception of claim 13 wherein said at least one visually identifiable object is a partial frame further comprised of two vertical sides.
Claim 29. The system and device for enhancement of visual perception of claim 13 wherein said two-dimensional image is illuminated.
Claim 30. The system and device for enhancement of visual perception of claim 29 wherein the illumination of said two- dimensional image is from a source within or attached to said visually identifiable object, so that said viewer is shielded from such illumination.
Claim 31. The system and device for enhancement of visual perception of claim 29 wherein the illumination of said two- dimensional image is variable in intensity, color and/or polarization, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate said viewer.
Claim 32. A method for enhancement of visual perception in a viewer of a two-dimensional image comprising: a) two-dimensional image with one or more monocular depth cues; b) induction of retinal disparity in the viewer from binocular retinal images of a combined scene created by the addition of a visually identifiable object to the scene of the two-dimensional image-substantially within the depth of field of focus of said viewer's eyes when said two-dimensional image is in focus for said viewer; and c) fusion of such retinally disparate images in the visual cortex of the viewer with the interpretation of said one or more monocular depth cues as binocular depth cues with those of the visually identifiable object in the combined scene.
Claim 33. A method for enhancement of visual perception in a viewer of a two-dimensional image comprising: a) selection of a substantially two-dimensional image with at least one monocular depth cue; b) selection of one or more visually identifiable objects for viewing with the two-dimensional image; c) formation of a combined scene by placement of at least one visually identifiable object in front of said two-dimensional image and within the view of the viewer, which is:
1) substantially within the depth of field of focus of said viewer's eyes when said two- dimensional image is in focus for said viewer;
2) at a sufficient distance from said two-dimensional image so as to be distinguishable by said viewer as nearer in space to said viewer than said two-dimensional image;
3) without interfering with the view of said viewer of said two-dimensional image; d) obscuring at least two opposing edges of said two-dimensional image; e) induction in the viewer of a sufficient retinal disparity in said viewer by the visual presentation to said viewer of the combined scene; and f) effecting the enhancement of said viewer's visual perception in said two-dimensional image by and/or with the viewer's fusion of the disparate retinal images of the combined scene.
Claim 34. A method for enhancement of visual perception in a viewer of a two-dimensional image comprising the induction of disparate retinal images in the viewer of the two-dimensional image with the formation of a combined scene of said two- dimensional image and at least one visually identifiable object placed in front of said two-dimensional image and before said viewer, said at least one visually identifiable object being: a) substantially within the depth of field of focus of said viewer's eyes when said two-dimensional image is in focus for said viewer; b) at a sufficient distance from said two-dimensional image so as to be distinguishable by the viewer as nearer in space than said two-dimensional image; c) without interfering with the view of the viewer of said two-dimensional image; effecting the enhancement of said viewer's visual perception in said two-dimensional image by and/or with the viewer's fusion of said disparate retinal images.
Claim 35. A method for enhancement of visual perception in a viewer of a two-dimensional image comprising: a) induction of disparate retinal images in the viewer of a two-dimensional image by the placement of a visually identifiable object in front of the two-dimensional image within the depth of field of focus of said viewer's eyes that includes said two- dimensional image; and b) effecting the enhancement of said viewer's visual perception in said two-dimensional image by and/or with the viewer's fusion of said disparate retinal images.
36. A method for enhancement of visual perception of claim 35 wherein: a) the placement of the visually identifiable object is within the Panum's fusional region for said two-dimensional image and a sufficient distance from said two-dimensional image so as to be distinguishable by the viewer as nearer in space than said two- dimensional image; b) the two dimensional image has one or more monocular depth cues; and c) at least two of the opposing edges of said two-dimensional image are obscured to the view of the viewer.
37. A system and device within the system for enhancement of visual perception in a viewer of a two-dimensional image comprising:
(a) a substantially two-dimensional image displayed on and/or at an image surface; and (b) one or more enhancers which induce retinal disparity in the viewing of said two dimensional image, including:
(1) at least one visually identifiable object positioned in front of the image surface which, together with the two- dimensional image, presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity, the visually identifiable object being: a) within the boundary space of the Panum's fusional region for the viewer's view of said two-dimensional image; b) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the Panum's fusional area of the viewer; and c) operably associated with said image surface; and/or (2) at least one visually identifiable object positioned in front of the image surface which, together with the two- dimensional image, presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity, the visually identifiable object being: a) within the depth of field of focus for the viewer's view of said two-dimensional image; b) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the eyes of the viewer; and c) operably associated with said image surface;
and/or
(3) a configuration of standard electronic and/or optical and/or mechanical components which: a) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or b) generates a two-dimensional image of a visually identifiable object at or on the image surface which is seen by the viewer with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or
(4) a computer program operating in a computer, said computerprogram having generated the two-dimensional image, and which: a) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or b) generates a two-dimensional image of a visually identifiable object which is seen by the viewer on the image surface with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer;
(5) a computer program operating in a computer, said computer program having displayed the two-dimensional image, and which: a) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or b) generates a two-dimensional image of a visually identifiable object which is seen by the viewer on the image surface with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; which causes the viewer's visual system to enhance the viewer's perception of depth in said two-dimensional image and/or enhance the clarity of said two-dimensional image by the fusion of said retinally disparate images of said two-dimensional image.
38. A system and device within the system for enhancement of visual perception in a viewer of a two-dimensional image comprising:
(a) a substantially two-dimensional image displayed on and/or at an image surface; and
(b) one or more enhancers which induce retinal disparity in the viewing of said two dimensional image, which causes the viewer's visual system to enhance the viewer's perception of depth in said two-dimensional image and/or enhance the clarity of said two-dimensional image by the fusion of said retinally disparate images of said two-dimensional image.
39. The system and device within the system for enhancement of visual perception of claim 38 wherein said one or more enhancers include at least one visually identifiable object positioned in front of the image surface which, together with the two- dimensional image, presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity, the visually identifiable object being:
1) within the boundary space of the Panum's fusional region for the viewer's view of said two-dimensional image;
2) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the Panum's fusional area of the viewer; and 3) operably associated with said image surface.
40. The system and device within the system for enhancement of visual perception of claim 38 wherein at least one visually identifiable object positioned in front of the image surface which, together with the two-dimensional image, presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity, the visually identifiable object being:
1) within the depth of field of focus for the viewer's view of said two-dimensional image;
2) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the eyes of the viewer; and
3) operably associated with said image surface.
41. The system and device within the system for enhancement of visual perception of claim 38 wherein a configuration of standard electronic and/or optical and/or mechanical components which:
1) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or 2) generates a two-dimensional image of a visually identifiable object at or on the image surface which is seen by the viewer with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity
5 in the viewer.
42. The system and device within the system for enhancement of visual perception of claim 38 wherein a computer program operating in a computer, said computer program having generated the two-dimensional image, and which:
1) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface 10 so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or
2) generates a two-dimensional image of a visually identifiable object which is seen by the viewer on the image surface with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes,
15 in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer.
43. The system and device within the system for enhancement of visual perception of claim 38 wherein a computer program operating in a computer, said computer program having displayed the two-dimensional image, and which:
1) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface 20 so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or
2) generates a two-dimensional image of a visually identifiable object which is seen by the viewer on the image surface with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes,
25 in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer.
44. The system and device within the system for enhancement of visual perception as in any one of claims 37-43 inclusive in which said two-dimensional image has one or more monocular depth cues.
30 45. The system and device within the system for enhancement of visual perception as in any one of claims 37-43 inclusive in which said image surface is curved, horizontally and/or vertically.
46. The system and device within the system for enhancement of visual perception as in any one of claims 37-43 inclusive in which said at least one visually identifiable object is a complete or partial frame surrounding all or part of said two-dimensional
35 image, the size, shape, color, brightness, illumination, and/or movement of which is fixed or variable, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate the viewer.
47. The system and device within the system for enhancement of visual perception as in any one of claims 37-43 inclusive in 40 which a pattern which is visually discernable by said viewer of said two-dimensional image is applied to at least one of the surfaces of said visually identifiable object which faces said viewer, the size, shape, color, brightness, illumination, and/or movement of which is fixed or variable, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate the viewer. 45
48. A system and device within the system for enhancement of visual perception in a viewer of a substantially two-dimensional image comprising:
(a) a substantially two-dimensional image displayed on and/or at an image surface; and
(b) at least one visually identifiable object operably associated with the image surface which, together with said two-dimensional 5 image, presents an enhanced scene to a viewer's visual system, said at least one visually identifiable object being positioned in front of said image surface:
1) within the boundary space of the Panum's fusional region for the viewer's view of said two-dimensional image; and
2) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the Panum's fusional areas of the viewer; and which causes the viewer's visual system to enhance the
10 viewer's perception of depth in said two-dimensional image and/or enhance the clarity of said two-dimensional image by the fusion of said disparate binocular retinal images of said two-dimensional image.
49. The system and device within the system for enhancement of visual perception of claim 48 wherein said visually identifiable object is a virtual three-dimensional image appearing to the viewer to be in front of the two dimensional image, said virtual three-
15 dimensional image being viewable as such at the same time as the two-dimensional image.
50. The system and device within the system for enhancement of visual perception of claim 48 wherein said two-dimensional image has one or more monocular depth cues.
20 51. The system and device within the system for enhancement of visual perception of claim 48 wherein said visually identifiable object is substantially within the depth of field of focus of said viewer's eyes when said two-dimensional image is substantially in focus for said viewer, and/or is in substantial focus when any point of said two-dimensional image is directly binocularly regarded by said viewer.
25 52. The system and device within the system for enhancement of visual perception of claim 48 wherein a pattern which is visually discernable by said viewer of said two-dimensional image is applied to at least one of the surfaces of said visually identifiable object which faces said viewer, the size, shape, color, brightness, illumination, and/or movement of which is fixed or variable, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two- dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate the viewer.
30
53. The system and device within the system for enhancement of visual perception of claim 48 wherein said at least one visually identifiable object is a complete or partial frame surrounding all or part of said two-dimensional image, the size, shape, color, brightness, illumination, and/or movement of which is fixed or variable, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify
35 the enhancement effect and/or accommodate the viewer.
54. The system and device within the system for enhancement of visual perception of claim 53 wherein the frame is a hood.
55. The system and device within the system for enhancement of visual perception of claim 48 wherein said at least one visually 40 identifiable object is illuminated on at least one of the surfaces which faces said viewer, the source of such illumination being attached to and/or within said at least one visually identifiable object.
56. The system and device within the system for enhancement of visual perception of claim 55 wherein the illumination of said at least one visually identifiable object is fixed or variable in intensity, color, and/or polarization, such variability being
45 controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate the viewer.
57. The system and device within the system for enhancement of visual perception of claim 48 wherein said two-dimensional image is illuminated.
5 58. The system and device within the system for enhancement of visual perception of claim 57 wherein the illumination of said two-dimensional image is from a source within or attached to said visually identifiable object so that said viewer is shielded from such illumination.
59. The system and device within the system for enhancement of visual perception of claim 58 wherein the intensity, color or 10 polarization of the illumination of said two-dimensional image is fixed or variable, such variability being controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to intensify the enhancement effect and/or accommodate the viewer.
60. A system and device within the system for enhancement of visual perception in a viewer of a substantially two-dimensional 15 image comprising:
(a) a substantially two-dimensional image displayed on and/or at an image surface; and
(b) an enhancer which induces retinal disparity in the viewing of said two dimensional image, further comprising a configuration of standard electronic and/or optical and/or mechanical components which:
(1) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface 20 so that a significant component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or
(2) generates a two-dimensional image of a visually identifiable object at or on the image surface which is seen by the viewer with said two-dimensional image, and moves the two-dimensional image of a visually identifiable object horizontally with respect to a viewer's point of fixation on the image surface so that a significant component of such motion is parallel to the
25 orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; which causes the viewer's visual system to enhance the viewer's perception of depth in said two-dimensional image and/or enhance the clarity of said two-dimensional image by the fusion of said retinally disparate images of said two dimensional image.
30 61. The system and device within the system for enhancement of visual perception of claim 60 wherein said two-dimensional image has one or more monocular depth cues.
62. The system and device within the system for enhancement of visual perception of claim 61 wherein the horizontal motion of said two-dimensional image of a visually identifiable object and/or said two-dimensional image is not significantly perceptible 35 as such by a viewer.
63 The system and device within the system for enhancement of visual perception of claim 61 wherein the horizontal motion of said two-dimensional image of a visually identifiable object and/or said two-dimensional image is controlled with reference to the brightness, color, and/or monocular depth cues of said two-dimensional image, or otherwise programably controlled to 40 intensify the enhancement effect and/or accommodate said viewer.
64. An apparatus for enhancement of visual perception in a viewer of a two-dimensional image comprising:
(a) an image surface upon which the two-dimensional image is displayed; and
(b) one or more enhancers which induce retinal disparity in the viewing of the two dimensional image, including at least one 45 of the following group of five enhancers: (1) at least one visually identifiable object positioned in front of the image surface which presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity, the visually identifiable object being: a) within the boundary space of the Panum's fusional region for the viewer's view of said two-dimensional image; b) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the Panum's fusional area of the viewer; and c) operably associated with said image surface;
(2) at least one visually identifiable object positioned in front of the image surface which, together with the two- dimensional image, presents an enhanced scene to a viewer's visual system as an image on the retina of each eye of the viewer with a spatial retinal disparity, the visually identifiable object being: a) within the depth of field of focus for the viewer's view of said two-dimensional image; b) at a sufficient distance from said two-dimensional image to render spatially disparate binocular retinal images of the enhanced scene in the eyes of the viewer; and c) operably associated with said image surface;
(3) a configuration of standard electronic and/or optical and/or mechanical components which moves said two- dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; (4) a configuration of standard electronic and/or optical and/or mechanical components which generates a two- dimensional image of a visually identifiable object at or on the image surface which is seen by the viewer with said two- dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; (5) a computer program operating in a computer, said computer program having generated said two-dimensional image, and which: a) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or b) generates a two-dimensional image of a visually identifiable object which is seen by the viewer on the image surface with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; (6) a computer program operating in a computer, said computer program having displayed the two-dimensional image, and which: a) moves said two-dimensional image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; and/or b) generates a two-dimensional image of a visually identifiable object which is seen by the viewer on the image surface with said two-dimensional image, and moves said visually identifiable object image horizontally with respect to a viewer's point of fixation on the image surface so that a sufficient component of such motion is parallel to the orientation of the viewer's eyes, in both directions of said orientation with sufficient speed and frequency to induce a temporal retinal disparity in the viewer; which cause the viewer's visual system to enhance the viewer's perception of depth in said two-dimensional image and/or enhance the clarity of said two-dimensional image by the fusion of said retinally disparate images of said two-dimensional image.
65. A method for enhancement of visual perception in a viewer of a two-dimensional image comprising: the induction of a slight but sufficient retinal disparity in the viewer's view of the two-dimensional image, thus effecting the enhancement of said viewer's depth perception and/or clarity perception in the two-dimensional image by and/or with the viewer's fusion of said disparate retinal images.
PCT/US2005/047577 2005-01-11 2005-12-31 Enhancement of visual perception WO2006076173A2 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EA200701457A EA013779B1 (en) 2005-01-11 2005-12-31 Enhancement of visual perception
CA002593243A CA2593243A1 (en) 2005-01-11 2005-12-31 Enhancement of visual perception
MX2007008424A MX2007008424A (en) 2005-01-11 2005-12-31 Enhancement of visual perception.
BRPI0518498-3A BRPI0518498A2 (en) 2005-01-11 2005-12-31 increased visual perception
JP2007551283A JP2008527918A (en) 2005-01-11 2005-12-31 Enhance visual perception
EP05856050A EP1836531A4 (en) 2005-01-11 2005-12-31 Enhancement of visual perception
AU2005324379A AU2005324379A1 (en) 2005-01-11 2005-12-31 Enhancement of visual perception

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US11/033,186 US7073908B1 (en) 2005-01-11 2005-01-11 Enhancement of depth perception
US11/033,186 2005-01-11
US68573705P 2005-05-27 2005-05-27
US60/685,737 2005-05-27
US11/222,733 US7086735B1 (en) 2005-05-27 2005-09-10 Enhancement of visual perception
US11/222,733 2005-09-10

Publications (2)

Publication Number Publication Date
WO2006076173A2 true WO2006076173A2 (en) 2006-07-20
WO2006076173A3 WO2006076173A3 (en) 2006-09-08

Family

ID=36678081

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/047577 WO2006076173A2 (en) 2005-01-11 2005-12-31 Enhancement of visual perception

Country Status (8)

Country Link
EP (1) EP1836531A4 (en)
JP (1) JP2008527918A (en)
AU (1) AU2005324379A1 (en)
BR (1) BRPI0518498A2 (en)
CA (1) CA2593243A1 (en)
EA (1) EA013779B1 (en)
MX (1) MX2007008424A (en)
WO (1) WO2006076173A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2228678A1 (en) * 2009-01-22 2010-09-15 Koninklijke Philips Electronics N.V. Display device with displaced frame perception
WO2015038036A3 (en) * 2013-09-11 2015-06-18 Сергей Николаевич ГОРЛОВ Stereoscopy method and device for implementing same
US10547831B2 (en) 2013-11-27 2020-01-28 Semiconductor Energy Laboratory Co., Ltd. Display device and display device frame

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4882489B2 (en) * 2006-04-28 2012-02-22 カシオ計算機株式会社 Stereoscopic image display device
JP2017227816A (en) * 2016-06-24 2017-12-28 株式会社半導体エネルギー研究所 Display device and method for making the same, and frame-like member
RU2679512C2 (en) * 2016-11-09 2019-02-11 Федеральное государственное бюджетное учреждение науки Институт теоретической и экспериментальной биофизики Российской академии наук (ИТЭБ РАН) Method of nontransparent multilayer mask hydrobionts application to eye
CN115103223B (en) * 2022-06-02 2023-11-10 咪咕视讯科技有限公司 Video content detection method, device, equipment and storage medium

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3582961A (en) * 1967-05-01 1971-06-01 Chushiro Shindo System for displaying a two-dimensional photographic picture in three dimensions
US3701581A (en) * 1971-11-15 1972-10-31 Gen Electric Stereoscopic enhancement of pictorial displays
JPH0666969B2 (en) * 1988-11-02 1994-08-24 忠四郎 神藤 Stereoscopic movie display
US5751927A (en) * 1991-03-26 1998-05-12 Wason; Thomas D. Method and apparatus for producing three dimensional displays on a two dimensional surface
GB9121418D0 (en) * 1991-10-09 1991-11-20 Nader Esfahani Rahim Imaginograph
US5257130A (en) * 1992-01-30 1993-10-26 The Walt Disney Company Apparatus and method for creating a real image illusion
GB9406481D0 (en) * 1994-03-31 1994-05-25 Central Research Lab Ltd Border for an image
JP3478606B2 (en) * 1994-10-12 2003-12-15 キヤノン株式会社 Stereoscopic image display method and apparatus
JP3983953B2 (en) * 2000-03-10 2007-09-26 パイオニア株式会社 Stereoscopic two-dimensional image display apparatus and image display method
JP2005070255A (en) * 2003-08-22 2005-03-17 Denso Corp Virtual image display device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of EP1836531A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2228678A1 (en) * 2009-01-22 2010-09-15 Koninklijke Philips Electronics N.V. Display device with displaced frame perception
WO2015038036A3 (en) * 2013-09-11 2015-06-18 Сергей Николаевич ГОРЛОВ Stereoscopy method and device for implementing same
US10547831B2 (en) 2013-11-27 2020-01-28 Semiconductor Energy Laboratory Co., Ltd. Display device and display device frame

Also Published As

Publication number Publication date
EP1836531A2 (en) 2007-09-26
EA200701457A1 (en) 2008-04-28
EA013779B1 (en) 2010-06-30
MX2007008424A (en) 2007-09-18
CA2593243A1 (en) 2006-07-20
BRPI0518498A2 (en) 2008-11-25
EP1836531A4 (en) 2009-11-04
JP2008527918A (en) 2008-07-24
AU2005324379A1 (en) 2006-07-20
WO2006076173A3 (en) 2006-09-08

Similar Documents

Publication Publication Date Title
US7086735B1 (en) Enhancement of visual perception
US7612795B2 (en) Enhancement of visual perception III
US7073908B1 (en) Enhancement of depth perception
JP3177518B2 (en) Technology for observing images in deep visual fields with improved clarity and contrast
US8646917B2 (en) Three dimensional display with multiplane image display elements
US7440004B2 (en) 3-D imaging arrangements
US7545405B2 (en) Enhancement of visual perception II
US8115803B2 (en) Apparatus and method for projecting spatial image
WO2006076173A2 (en) Enhancement of visual perception
JP4284158B2 (en) Stereoscopic two-dimensional image display system and image display method
JP2008527918A5 (en)
US5691843A (en) Enhanced depth perception in a two-dimensional image
US8717425B2 (en) System for stereoscopically viewing motion pictures
EA029852B1 (en) Vibrating grid based 3d space visualization device
CN206674125U (en) A kind of equipment and viewing apparatus of display system including the display system
JP2003295115A (en) Stereoscopic image display device with no glasses
KR101093929B1 (en) Method and system for displaying 3-dimensional images using depth map
WO2024034481A1 (en) Stereoscopic display device
JP2017032802A (en) Exhibition set and exhibition method
JPH02123890A (en) Pattern real viewing system
Lee et al. Elimination of Pseudoscopy using Low-passed Images in Multiview 3D Displays
EP0140963A1 (en) Stereoscopic video systems
CN107091882A (en) Ultrasonic phase array 3D Display Techniques
BG66279B1 (en) Method and device for converting a two-dimensional image into a three-dimensional one
JP2017032792A (en) Exhibition set and exhibition method

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200580046400.5

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 4895/DELNP/2007

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 556244

Country of ref document: NZ

ENP Entry into the national phase in:

Ref document number: 2593243

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: MX/a/2007/008424

Country of ref document: MX

Ref document number: 12007501496

Country of ref document: PH

Ref document number: 2007551283

Country of ref document: JP

Ref document number: 07070657

Country of ref document: CO

NENP Non-entry into the national phase in:

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2005324379

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2005856050

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1200701636

Country of ref document: VN

WWE Wipo information: entry into national phase

Ref document number: 200701457

Country of ref document: EA

ENP Entry into the national phase in:

Ref document number: 2005324379

Country of ref document: AU

Date of ref document: 20051231

Kind code of ref document: A

ENP Entry into the national phase in:

Ref document number: PI0518498

Country of ref document: BR