CA2419624A1

CA2419624A1 - Interactive three dimensional display with layered screens

Info

Publication number: CA2419624A1
Application number: CA002419624A
Authority: CA
Inventors: Gabriel Damon Engel; Pita Witehira
Original assignee: Deep Video Imaging Limited; Gabriel Damon Engel; Pita Witehira; Puredepth Limited
Current assignee: PureDepth Ltd
Priority date: 1999-08-01
Filing date: 2000-08-01
Publication date: 2001-02-08
Also published as: AU766049B2; JP2003506742A; US7626594B1; AU6326500A; EP1204894A1; EP1204894A4; US20100045601A1; WO2001009664A1

Abstract

An interactive imaging system (1) with a perception of depth includes at least two screens (2) configured to show a three dimensional image, where the user can manipulate the image via control means (3). The control means (3) can comprise touch screen controls, or means adjacent to the screens such as buttons, touchpads or a joystick. Image information may be transmitted over the Internet or other communication means. Applications include computer games and simulators. Advertising messages may be displayed on one screen while images are being displayed on other screens.

Description

CA 02419624 2003-O1-31 Received 2 November 2<)t)1 IMAGING SYSTEM WITH DEPTH
TECHNICAL FIELD
This invention relates to an improved method of displaying images and in particular to producing images with depth.
BACKGROUND ART
Since our eyes naturally perceive depth, it is seen as a disadvantage that most display systems are two dimensional. Furthermore, there are many applications of displays where the realism of depth would improve the effectiveness of the display.
Thus many attempts have been made to create display systems with depth.
A number of display systems that present an image of depth have been developed.
One class of such displays requires the viewer to wear some form of eye shield system by which various means allows the viewer's two eyes to see different images that are concurrently displayed on the same two dimensional screen. However, many users find it unsatisfactory to wear eye shields, while the method of providing two different images on the same screen is cumbersome and inconvenient for many applications.
A related but different class of displays presents a different image to each eye by means of a binocular image system in close proximity to both eyes. This method, however, is restricted in the number of viewers who can use the system and again many users find it unsatisfactory and uncomfortable to use.
A third class of display uses modifications of the two dimensional screen surface wherein two images are created on the screen, but by manipulation of multiple refractors on the screen, for a viewer in the correct position one image is refracted into the right eye, and the other image is refracted into the left eye.

AMENDED SHEET
IPEA/AU

Received 2 November 2001 This system requires the users to be carefully placed, is inflexible and has not found favour with many users.
The major problems with these systems were overcome by the innovative screen techniques disclosed in PCT Patent Application No's. PCT/NZ98/00098 and PCT/NZ99/00021 which detail a screen system producing a perception of depth comprising at least two screens placed such that their axes are approximately co-linear, with each screen separated from the other in the direction of the normal, wherein an image, or part of an image, displayed on one or more screens can be selectively made transparent, opaque or partially opaque as desired.
It has been found however that even with these types of screens there are some applications where the operator needs more control of the images, such as with computer games and other interactive programs - for example training programs.
All references, including any patents or patent applications, cited in this specification are hereby incorporated by reference. No admission is made that any reference constitutes prior art. The discussion of the references states what their authors assert, and the applicants reserve the right to challenge the accuracy and pertinency of the cited documents. It will be clearly understood that, although a number of prior art publications are referred to herein, this reference does not constitute an admission that any of these documents forms part of the common general knowledge in the art, in New Zealand or in any other country.
It is an object of the present invention to address the foregoing problems or at least to provide the public with a useful choice.
Further' aspects and advantages of the present invention will become apparent from the ensuing description which is given by way of example only.

2 AMENDED SHEET
IpEAIAU

CA 02419624 2003-O1-31 Received 2 November 2001 DISCLOSURE OF INVENTION
According to one aspect of the present invention there is provided an interactive imaging system with depth, including at least two screens configured to show a 3-dimensional image, each screen being capable of simultaneously displaying independent images, characterised in that a user can manipulate one or more parts of any image independently displayed, by the means of using one or more on-screen touch control means.
It should be understood that in preferred embodiments of the present invention the 3 dimensional composite image, spread over two or more screens, can be interactive with any son of controls, in particular with "touch" controls on a screen or on a clear panel in front of the front screen.
It should be further understood that in preferred embodiments the "touch"
control can be activated by a variety of items including, but not limited to, pointers, pens, fingers or pencils.
One form of touch control means can be an image of a "button" on the front andlor rear screens which when touched can flip between 2 or more screens to show the information relating to the button, or can perform an operation associated with that button.
According to another aspect of the present invention there is provided an interactive imaging system with depth, including at least two screens configured to show a 3-dimensional image,

3 AMENDED SHEET
MEA/AU

CA 02419624 2003-O1-31 Rived 2 November 2U~1 each screen being capable of simultaneously displaying independent images, characterised in that at least one part of any image, independently displayed on one or more of the screens, can be manipulated by the actions of the user by using one or more control means.
In preferred embodiments of the present invention a user can manipulate one or more parts of any image by using one or more control means located on or near the screens, these control means can be in the form of a standard "keypress"
button or a type of joystick control or may even be "touch" controls located on at least one touchpad adjacent to the screen, any of which can be readily purchased "off the shelf '.
It would be clear to anyone skilled in the art that these are all "off the shelf' items that are readily available.
According to a further aspect of the present invention there is provided an interactive imaging system which creates a perception of depth, including at least two screens configured to show a 3-dimensional image, each screen being capable of simultaneously displaying independent images, characterised in that at least one part of any image, independently displayed on one or more of the screens, can be manipulated by the actions of the user by using one or more control means, and the information necessary to generate at least part of an image can be transmitted from or received by the display apparatus via the Internet or by another suitable data

4 AMENDED SHEET
IPEA/AU

CA 02419624 2003-O1-31 pCT,INZ00/00143 Received 2 November 2001 transfer system.
In preferred embodiments of the present invention there is provided a method of controlling at least part of an image displayed on an interactive imaging system which creates a perception of depth including at least two screens configured to show a 3-dimensional image, each screen being capable of simultaneously displaying independent images, characterised by the step of manipulating, by the actions of the user, at least one or more parts of any image independently displayed on the interactive imaging system.
In some preferred embodiments of the present invention there is provided a method of controlling at least part of an image displayed on an interactive imaging system which creates a perception of depth including at least two screens configured to show a 3-dimensional image, each screen being capable of simultaneously displaying independent images, characterised by the step of sending or receiving the information necessary to generate any image on the interactive imaging system via the Internet or by another suitable data transfer system.
In preferred embodiments of the present invention the images, or the data corresponding to the images, may be transmitted over the Internet or by other communication means for display at any compatible display unit, or in the absence of a suitable display unit, as one or more separate images simultaneously on a single

5 AMENDED SHEET
~PEA/AU

CA 02419624 2003-O1-31 Rived 2 November 2U01 screen display. The data corresponding to the images may be stored at any compatible remote location for processing or display.
Therefore the present invention has huge advantages over the display systems currently available as a far greater amount of data can be displayed on the display system.
Generally, data for front and rear images can be obtained and stored separately.
Applications where this is appropriate can be in kiosks or booths, games, simulators, training devices and the like.
It should be understood that in preferred embodiments a "booth" is defined as an enclosed, or partially enclosed, walled area in which an activity can take place For example, a flight simulator in its simplest form may consist of two screens wherein the front screen may display the cockpit instruments, control settings and generally illustrate the interior of the cockpit, while the rear screen shows the image as seen through the cockpit windscreen - such as other aircraft, sky, cloud, grounds, the runway and so on, therefore giving the operator a sense of true perspective as different manoeuvres are simulated.
Either conventional instrument displays or "head-up" displays can be simulated with this invention, with the "touch-screen" ability improving the "playability" of these applications.
Display kiosks and booths in stores and also for other applications can be configured to show images of products, their use and typically pictorial data for describing, promoting and benefiting from the product on the rear screen, while written or symbolic information about the product can be shown on the front screen.
Alternatively, this order may be reversed, combined or arranged as appropriate for

6 AMENDED SHEET
~'E4IAt~

CA 02419624 2003-O1-31 Received 2 November 2001 the preferred method of presentation.
The front screen may also have interactive functions such as touch controls, selectors and the like which allow the viewer to select or control either or all of the display screens.
Alternatively the controls may be separate from, but in close proximity to, the screen and still allow the user to manipulate or select separately or simultaneously what is displayed on each screen.
Kiosks and booths based on the invention may be used for a variety of advertising and information presentation purposes. For example, a customer may be attracted to the kiosk by the use of attractive 3 dimensional images which can then show advertising in an attractive and unobtrusive manner principally on one screen while other screens at different depths continue to keep the viewers attention. The viewer may be encouraged to concentrate on action occurring on one screen while advertising or other messages are unobtrusively shown on parts of another screen, typically the front screen, which may be mostly transparent.
This has a significant advantage over prior systems in that far more information can be displayed at any one time, for instance on a two screen system - twice the information is available to the operator than on a single screen system.
The use of kiosks based on the invention allows the dissemination of more advertising within the same footprint or floor area, while also enabling the advertising to be made less obtrusive and more acceptable to customers, allowing the advertising to be more effective.
In effect the available screen size within the same footprint or floor area is expanded allowing more information to be displayed and in a form where it becomes easier to be absorbed.

7 AMENDED SHEET
IPEA/AU

CA 02419624 2003-O1-31 Received 2 November 2001 One huge advantage with the present invention over the systems previously available is that due to having either on-screen touch controls, or controls located adjacent to the screen system, the operator does not need to take their gaze away from the screen area in order to perform a control function.
This not only means that their concentration is not broken but also that they will be able to cope with a higher information rate.
There are a number of applications which are ideally suited to this aspect, in particular computer gaming where taking your eyes from the screen can affect your performance in an extremely adverse manner.
The use of the present invention means that a computer garner for instance will have a much faster response time to any given situation and less likelihood of missing any on-screen event.
This has even further advantages when the image or images are transferred over the Internet as the advantages disclosed previously can be applied to on-line applications.
BRIEF DESCRIPTION OF DRAWINGS
Further aspects of the present invention will become apparent from the following description which is given by way of example only and with reference to the accompanying drawings in which:
Figure 1 This is a perspective representation of one preferred embodiment of the present invention; and Fi_ pure 2 This is a perspective representation of another preferred embodiment of the present invention.

8 AMENDED SHEET

CA 02419624 2003-O1-31 Rived 2 November 2001 BEST MODES FOR CARRYING OUT THE INVENTION
With reference to Figure 1 there is illustrated an interactive imaging system with a perception of depth generally indicated by arrow 1.
The interactive imaging system 1 is comprised of a number of parallel screens configured in order they give a perception of depth.
An image, or part of an image, contained on one or more of the screens 2 can be manipulated by use of the on-screen touch controls 3.
It should be appreciated that the on-screen touch controls are of a known off-the-shelf type.
The on-screen touch controls 3 can be configured to perform a variety of functions including the switching of the screens to the foreground and the manipulation of part of an image from one screen to another.
It is envisaged that in some preferred modes of operation the interactive imaging system 1 will display three dimensional images on the screens 2 that have been transmitted to the interactive imaging system 1 via the Internet.
With reference to figure 2 there is shown an interactive imaging system with a perception of depth where an image, or part of an image, contained on one or more of the screens 2 can be manipulated by use of controls at the side of the screen which work in the same manner as those in figure 1.
It should also be appreciated that these can be replaced by other controls such as an off-the-shelf type joystick.
Aspects of the present invention have been described by way of example only and it should be appreciated that modifications and additions may be made thereto without departing from the scope thereof.

9 AMENDED SHEET
IPEA/AU

Received 2 November 2001 it should be appreciated that modifications and additions may be made thereto without departing from the scope thereof.
.AMENDED SHE
IPEA/AU

Claims

WHAT WE CLAIM IS;

1. An interactive imaging system with a perception of depth including at least two screens, each screen being capable of simultaneously displaying independent images, configured to show a three dimensional image characterised in that a user can manipulate one or more parts of any image independently by using one or more on-screen touch control means.

2. An interactive imaging system as claimed in claim one wherein the touch control means are on a screen or on a clear panel in front of the front screen.

3. An interactive imaging system with a perception of depth, including at least two parallel screens, each screen being capable of simultaneously displaying independent images, configured to show a three dimensional image characterised in that a user can manipulate one or more parts of any image independently across one or more screens by using one or more control means, wherein the controls are located adjacent to the screens and are in the form of a keypress button, a type of joystick or a touch control located on at least one touchpad.

4. An interactive imaging system which creates a perception of depth, including at least two screens, each screen being capable of simultaneously displaying independent images, configured to show a three dimensional image characterised in that at least one part of any image independently displayed on one or more of the screens can be manipulated by the actions of the user, and the information necessary to generate at least part of an image is transmitted or received by the display apparatus via the Internet or by another suitable data transfer system.

5. An interactive imaging system as claimed in claim 4 wherein the information transmitted over the internet or by another suitable data transfer system can be stored at any compatible remote location for processing or displaying.

6. An interactive imaging system as claimed in claim 5 wherein the display is located within a kiosk or booth.

7. A method of controlling at least part of an image displayed on an interactive imaging system which creates a perception of depth, including at least two parallel screens, each screen being capable of simultaneously displaying independent images, configured to show a three dimensional image characterised by the step of manipulating, by the actions of the user, at least one or more parts of any image independently displayed on the interactive imaging system.

8. A method of controlling at least part of an image displayed on an interactive imaging system which creates a perception of depth including at least two screens, each screen being capable of simultaneously displaying independent images, configured to show a three dimensional image characterised by the step of sending or receiving the information necessary to generate any image independently on the interactive imaging system via the Internet or by another suitable data transfer system.