EP0829798A3 - Image-based touchscreen - Google Patents

Image-based touchscreen Download PDF

Info

Publication number
EP0829798A3
EP0829798A3 EP97115924A EP97115924A EP0829798A3 EP 0829798 A3 EP0829798 A3 EP 0829798A3 EP 97115924 A EP97115924 A EP 97115924A EP 97115924 A EP97115924 A EP 97115924A EP 0829798 A3 EP0829798 A3 EP 0829798A3
Authority
EP
European Patent Office
Prior art keywords
image
pixel values
screen
scene
successive frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP97115924A
Other languages
German (de)
French (fr)
Other versions
EP0829798A2 (en
Inventor
Keith Waters
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Digital Equipment Corp
Original Assignee
Digital Equipment Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digital Equipment Corp filed Critical Digital Equipment Corp
Publication of EP0829798A2 publication Critical patent/EP0829798A2/en
Publication of EP0829798A3 publication Critical patent/EP0829798A3/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0428—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual

Abstract

In a touch activated computer system, a display terminal displays an image on a screen of the terminal. The image includes one or more visual option buttons arranged in a predetermined pattern. Each button corresponds to a specific application program which can be executed by the system. A camera has a lens oriented to capture frames representing a scene in front of the screen. Each frame includes a plurality of regularized pixel values. The system includes an image registration subsystem for comparing the pixel values of successive frames. A particular application is selected for execution when the pixel values corresponding to that portion of the scene directly in front of a particular button differ in successive frames more than a predetermined threshold value.
EP97115924A 1996-09-12 1997-09-12 Image-based touchscreen Withdrawn EP0829798A3 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/712,970 US5936615A (en) 1996-09-12 1996-09-12 Image-based touchscreen
US712970 1996-09-12

Publications (2)

Publication Number Publication Date
EP0829798A2 EP0829798A2 (en) 1998-03-18
EP0829798A3 true EP0829798A3 (en) 1998-06-17

Family

ID=24864259

Family Applications (1)

Application Number Title Priority Date Filing Date
EP97115924A Withdrawn EP0829798A3 (en) 1996-09-12 1997-09-12 Image-based touchscreen

Country Status (2)

Country Link
US (1) US5936615A (en)
EP (1) EP0829798A3 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8115753B2 (en) 2007-04-11 2012-02-14 Next Holdings Limited Touch screen system with hover and click input methods
US8149221B2 (en) 2004-05-07 2012-04-03 Next Holdings Limited Touch panel display system with illumination and detection provided from a single edge
US8289299B2 (en) 2003-02-14 2012-10-16 Next Holdings Limited Touch screen signal processing
US8384693B2 (en) 2007-08-30 2013-02-26 Next Holdings Limited Low profile touch panel systems
US8405637B2 (en) 2008-01-07 2013-03-26 Next Holdings Limited Optical position sensing system and optical position sensor assembly with convex imaging window
US8432377B2 (en) 2007-08-30 2013-04-30 Next Holdings Limited Optical touchscreen with improved illumination
US8456447B2 (en) 2003-02-14 2013-06-04 Next Holdings Limited Touch screen signal processing
US8508508B2 (en) 2003-02-14 2013-08-13 Next Holdings Limited Touch screen signal processing with single-point calibration
US8692768B2 (en) 2009-07-10 2014-04-08 Smart Technologies Ulc Interactive input system

Families Citing this family (84)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL131056A (en) * 1997-01-30 2003-07-06 Yissum Res Dev Co Generalized panoramic mosaic
US6750848B1 (en) * 1998-11-09 2004-06-15 Timothy R. Pryor More useful man machine interfaces and applications
US6388654B1 (en) * 1997-10-03 2002-05-14 Tegrity, Inc. Method and apparatus for processing, displaying and communicating images
KR100595924B1 (en) 1998-01-26 2006-07-05 웨인 웨스터만 Method and apparatus for integrating manual input
US6522395B1 (en) 1999-04-30 2003-02-18 Canesta, Inc. Noise reduction techniques suitable for three-dimensional information acquirable with CMOS-compatible image sensor ICS
US6512838B1 (en) 1999-09-22 2003-01-28 Canesta, Inc. Methods for enhancing performance and data acquired from three-dimensional image systems
JP4052498B2 (en) 1999-10-29 2008-02-27 株式会社リコー Coordinate input apparatus and method
US6710770B2 (en) * 2000-02-11 2004-03-23 Canesta, Inc. Quasi-three-dimensional method and apparatus to detect and localize interaction of user-object and virtual transfer device
JP2001184161A (en) 1999-12-27 2001-07-06 Ricoh Co Ltd Method and device for inputting information, writing input device, method for managing written data, method for controlling display, portable electronic writing device, and recording medium
DE10007891C2 (en) 2000-02-21 2002-11-21 Siemens Ag Method and arrangement for interacting with a representation visible in a shop window
WO2001073745A1 (en) * 2000-03-29 2001-10-04 Indelelink Corporation Personalized computer peripheral
AU6262501A (en) * 2000-05-29 2001-12-11 Vkb Inc. Virtual data entry device and method for input of alphanumeric and other data
US6803906B1 (en) 2000-07-05 2004-10-12 Smart Technologies, Inc. Passive touch system and method of detecting user input
ES2396587T3 (en) * 2000-07-05 2013-02-22 Smart Technologies Ulc Touch camera method and device
EP1336172B1 (en) 2000-09-07 2007-06-27 Canesta, Inc. Quasi-three-dimensional method and apparatus to detect and localize interaction of user-object and virtual transfer device
US7058204B2 (en) * 2000-10-03 2006-06-06 Gesturetek, Inc. Multiple camera control system
US6774889B1 (en) * 2000-10-24 2004-08-10 Microsoft Corporation System and method for transforming an ordinary computer monitor screen into a touch screen
US6809726B2 (en) * 2000-12-11 2004-10-26 Xerox Corporation Touchscreen display calibration using results history
US6919880B2 (en) * 2001-06-01 2005-07-19 Smart Technologies Inc. Calibrating camera offsets to facilitate object position determination using triangulation
US8339379B2 (en) * 2004-04-29 2012-12-25 Neonode Inc. Light-based touch screen
US9471170B2 (en) * 2002-11-04 2016-10-18 Neonode Inc. Light-based touch screen with shift-aligned emitter and receiver lenses
US9164654B2 (en) * 2002-12-10 2015-10-20 Neonode Inc. User interface for mobile computer unit
US9052777B2 (en) 2001-11-02 2015-06-09 Neonode Inc. Optical elements with alternating reflective lens facets
US9052771B2 (en) * 2002-11-04 2015-06-09 Neonode Inc. Touch screen calibration and update methods
WO2009008786A1 (en) * 2007-07-06 2009-01-15 Neonode Inc. Scanning of a touch screen
US9213443B2 (en) * 2009-02-15 2015-12-15 Neonode Inc. Optical touch screen systems using reflected light
US9778794B2 (en) 2001-11-02 2017-10-03 Neonode Inc. Light-based touch screen
US20100238139A1 (en) * 2009-02-15 2010-09-23 Neonode Inc. Optical touch screen systems using wide light beams
US8674966B2 (en) 2001-11-02 2014-03-18 Neonode Inc. ASIC controller for light-based touch screen
US20040001144A1 (en) * 2002-06-27 2004-01-01 Mccharles Randy Synchronization of camera images in camera-based touch system to enhance position determination of fast moving objects
US8587562B2 (en) * 2002-11-04 2013-11-19 Neonode Inc. Light-based touch screen using elliptical and parabolic reflectors
US8416217B1 (en) 2002-11-04 2013-04-09 Neonode Inc. Light-based finger gesture user interface
US8896575B2 (en) * 2002-11-04 2014-11-25 Neonode Inc. Pressure-sensitive touch screen
US6954197B2 (en) * 2002-11-15 2005-10-11 Smart Technologies Inc. Size/scale and orientation determination of a pointer in a camera-based touch system
US9195344B2 (en) * 2002-12-10 2015-11-24 Neonode Inc. Optical surface using a reflected image for determining three-dimensional position information
US9389730B2 (en) * 2002-12-10 2016-07-12 Neonode Inc. Light-based touch screen using elongated light guides
US8403203B2 (en) * 2002-12-10 2013-03-26 Neonoda Inc. Component bonding using a capillary effect
US8902196B2 (en) * 2002-12-10 2014-12-02 Neonode Inc. Methods for determining a touch location on a touch screen
US6972401B2 (en) * 2003-01-30 2005-12-06 Smart Technologies Inc. Illuminated bezel and touch system incorporating the same
US7532206B2 (en) 2003-03-11 2009-05-12 Smart Technologies Ulc System and method for differentiating between pointers used to contact touch surface
US6947032B2 (en) * 2003-03-11 2005-09-20 Smart Technologies Inc. Touch system and method for determining pointer contacts on a touch surface
US7256772B2 (en) * 2003-04-08 2007-08-14 Smart Technologies, Inc. Auto-aligning touch system and method
WO2004093318A2 (en) * 2003-04-11 2004-10-28 Canesta, Inc. Method and system to differentially enhance sensor dynamic range
US7176438B2 (en) * 2003-04-11 2007-02-13 Canesta, Inc. Method and system to differentially enhance sensor dynamic range using enhanced common mode reset
US7411575B2 (en) * 2003-09-16 2008-08-12 Smart Technologies Ulc Gesture recognition method and touch system incorporating the same
US7274356B2 (en) 2003-10-09 2007-09-25 Smart Technologies Inc. Apparatus for determining the location of a pointer within a region of interest
US7355593B2 (en) 2004-01-02 2008-04-08 Smart Technologies, Inc. Pointer tracking across multiple overlapping coordinate input sub-regions defining a generally contiguous input region
US20050156901A1 (en) * 2004-01-20 2005-07-21 Guolin Ma Touch screen display system
US7232986B2 (en) * 2004-02-17 2007-06-19 Smart Technologies Inc. Apparatus for detecting a pointer within a region of interest
US7460110B2 (en) 2004-04-29 2008-12-02 Smart Technologies Ulc Dual mode touch system
US7492357B2 (en) 2004-05-05 2009-02-17 Smart Technologies Ulc Apparatus and method for detecting a pointer relative to a touch surface
US8120596B2 (en) 2004-05-21 2012-02-21 Smart Technologies Ulc Tiled touch system
US8508710B2 (en) * 2004-12-02 2013-08-13 Hewlett-Packard Development Company, L.P. Display panel
TW200627244A (en) * 2005-01-17 2006-08-01 Era Optoelectronics Inc Data input device
WO2006090386A2 (en) * 2005-02-24 2006-08-31 Vkb Inc. A virtual keyboard device
EP1879099A1 (en) * 2006-07-10 2008-01-16 Era Optoelectronics Inc. Data input device
US20080096651A1 (en) * 2006-07-28 2008-04-24 Aruze Corp. Gaming machine
US9442607B2 (en) 2006-12-04 2016-09-13 Smart Technologies Inc. Interactive input system and method
US8130203B2 (en) 2007-01-03 2012-03-06 Apple Inc. Multi-touch input discrimination
US7855718B2 (en) 2007-01-03 2010-12-21 Apple Inc. Multi-touch input discrimination
US8269727B2 (en) 2007-01-03 2012-09-18 Apple Inc. Irregular input identification
HUP0700391A2 (en) * 2007-06-05 2008-12-29 Zsombor Lazar Method of determining an intrusion into a monitored area and system for generating output signals in response to such intrusion
US8094137B2 (en) 2007-07-23 2012-01-10 Smart Technologies Ulc System and method of detecting contact on a display
US20090172714A1 (en) * 2007-12-28 2009-07-02 Harel Gruia Method and apparatus for collecting metadata during session recording
US8902193B2 (en) 2008-05-09 2014-12-02 Smart Technologies Ulc Interactive input system and bezel therefor
KR101529916B1 (en) * 2008-09-02 2015-06-18 엘지전자 주식회사 Portable terminal
US8339378B2 (en) 2008-11-05 2012-12-25 Smart Technologies Ulc Interactive input system with multi-angle reflector
US8775023B2 (en) 2009-02-15 2014-07-08 Neanode Inc. Light-based touch controls on a steering wheel and dashboard
US9063614B2 (en) 2009-02-15 2015-06-23 Neonode Inc. Optical touch screens
US8276077B2 (en) * 2009-07-10 2012-09-25 The Mcgraw-Hill Companies, Inc. Method and apparatus for automatic annotation of recorded presentations
US20110193969A1 (en) * 2010-02-09 2011-08-11 Qisda Corporation Object-detecting system and method by use of non-coincident fields of light
US8818027B2 (en) * 2010-04-01 2014-08-26 Qualcomm Incorporated Computing device interface
US9164625B2 (en) 2012-10-14 2015-10-20 Neonode Inc. Proximity sensor for determining two-dimensional coordinates of a proximal object
US9921661B2 (en) 2012-10-14 2018-03-20 Neonode Inc. Optical proximity sensor and associated user interface
US10282034B2 (en) 2012-10-14 2019-05-07 Neonode Inc. Touch sensitive curved and flexible displays
US9207800B1 (en) 2014-09-23 2015-12-08 Neonode Inc. Integrated light guide and touch screen frame and multi-touch determination method
US9092093B2 (en) 2012-11-27 2015-07-28 Neonode Inc. Steering wheel user interface
US9317171B2 (en) * 2013-04-18 2016-04-19 Fuji Xerox Co., Ltd. Systems and methods for implementing and using gesture based user interface widgets with camera input
EP3230049B1 (en) * 2015-04-24 2021-07-28 Hewlett-Packard Development Company, L.P. Processing three-dimensional object data for storage
EP3887192B1 (en) 2018-11-28 2023-06-07 Neonode Inc. Motorist user interface sensor
EP4085321A4 (en) 2019-12-31 2024-01-24 Neonode Inc Contactless touch input system
EP4222586A1 (en) 2020-09-30 2023-08-09 Neonode Inc. Optical touch sensor
CA3147560A1 (en) 2021-02-04 2022-08-04 1004335 Ontario Inc. carrying on business as A D Metro Touch sensor system configuration
US11829556B2 (en) 2021-03-12 2023-11-28 1004335 Ontario Inc. Methods for configuring touch sensor system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4644582A (en) * 1983-01-28 1987-02-17 Hitachi, Ltd. Image registration method
EP0535988A2 (en) * 1991-10-04 1993-04-07 Sigmax Kabushiki Kaisha Data input apparatus and methods
EP0613079A1 (en) * 1993-02-23 1994-08-31 ZELTRON S.p.A. Man-machine interface system
EP0718748A2 (en) * 1994-12-22 1996-06-26 Canon Kabushiki Kaisha Pointed-position detecting apparatus and method

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821029A (en) * 1984-04-26 1989-04-11 Microtouch Systems, Inc. Touch screen computer-operated video display process and apparatus
US4851616A (en) * 1986-01-03 1989-07-25 Langdon Wales R Touch screen input system
US4873398A (en) * 1988-06-30 1989-10-10 Hewlett-Packard Company Flat panel display with integrated digitizing tablet
FR2645300B1 (en) * 1989-03-29 1994-09-09 Gen Electric Cgr AUTOMATIC IMAGE RECORDING PROCESS
GB8914843D0 (en) * 1989-06-28 1989-08-16 British Aerospace A method of processing video image data for use in the storage or transmission of moving digital images
US5105186A (en) * 1990-05-25 1992-04-14 Hewlett-Packard Company Lcd touch screen
EP0554492B1 (en) * 1992-02-07 1995-08-09 International Business Machines Corporation Method and device for optical input of commands or data
US5483261A (en) * 1992-02-14 1996-01-09 Itu Research, Inc. Graphical input controller and method with rear screen image detection
JP3205585B2 (en) * 1992-03-09 2001-09-04 パイオニア株式会社 Input terminal device
US5317140A (en) * 1992-11-24 1994-05-31 Dunthorn David I Diffusion-assisted position location particularly for visual pen detection
DE4344050C1 (en) * 1993-12-23 1995-03-09 Henry Rudolph Entry method and entry apparatus for computer terminals for the purpose of protecting against covert observation and for ensuring the privacy of a user
US5736976A (en) * 1995-02-13 1998-04-07 Cheung; Nina T. Computer data entry apparatus with hand motion sensing and monitoring
US5736975A (en) * 1996-02-02 1998-04-07 Interactive Sales System Interactive video display

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4644582A (en) * 1983-01-28 1987-02-17 Hitachi, Ltd. Image registration method
EP0535988A2 (en) * 1991-10-04 1993-04-07 Sigmax Kabushiki Kaisha Data input apparatus and methods
EP0613079A1 (en) * 1993-02-23 1994-08-31 ZELTRON S.p.A. Man-machine interface system
EP0718748A2 (en) * 1994-12-22 1996-06-26 Canon Kabushiki Kaisha Pointed-position detecting apparatus and method

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8289299B2 (en) 2003-02-14 2012-10-16 Next Holdings Limited Touch screen signal processing
US8456447B2 (en) 2003-02-14 2013-06-04 Next Holdings Limited Touch screen signal processing
US8466885B2 (en) 2003-02-14 2013-06-18 Next Holdings Limited Touch screen signal processing
US8508508B2 (en) 2003-02-14 2013-08-13 Next Holdings Limited Touch screen signal processing with single-point calibration
US8149221B2 (en) 2004-05-07 2012-04-03 Next Holdings Limited Touch panel display system with illumination and detection provided from a single edge
US8115753B2 (en) 2007-04-11 2012-02-14 Next Holdings Limited Touch screen system with hover and click input methods
US8384693B2 (en) 2007-08-30 2013-02-26 Next Holdings Limited Low profile touch panel systems
US8432377B2 (en) 2007-08-30 2013-04-30 Next Holdings Limited Optical touchscreen with improved illumination
US8405637B2 (en) 2008-01-07 2013-03-26 Next Holdings Limited Optical position sensing system and optical position sensor assembly with convex imaging window
US8405636B2 (en) 2008-01-07 2013-03-26 Next Holdings Limited Optical position sensing system and optical position sensor assembly
US8692768B2 (en) 2009-07-10 2014-04-08 Smart Technologies Ulc Interactive input system

Also Published As

Publication number Publication date
EP0829798A2 (en) 1998-03-18
US5936615A (en) 1999-08-10

Similar Documents

Publication Publication Date Title
EP0829798A3 (en) Image-based touchscreen
EP2664131B1 (en) Apparatus and method for compositing image in a portable terminal
US7304681B2 (en) Method and apparatus for continuous focus and exposure in a digital imaging device
US9952754B2 (en) Information processing device, information processing method, and program
EP2273450B1 (en) Target tracking and detecting in images
CN110503725B (en) Image processing method, device, electronic equipment and computer readable storage medium
EP3588456A1 (en) Image processing apparatus, image processing method, and program
CN112135046B (en) Video shooting method, video shooting device and electronic equipment
CN105229720A (en) Display control unit, display control method and recording medium
EP1107186A3 (en) Image processing method and system
EP3323238B1 (en) Photographing apparatus using multiple exposure sensor and photographing method thereof
WO1999032959A3 (en) Method and system for gesture based option selection
CA2256992A1 (en) Image processing apparatus and method, image synthesizing system and method, image synthesizer and client computer which constitute image synthesizing system, and image separatingmethod
CN102063231A (en) Non-contact electronic whiteboard system and detection method based on image detection
WO2002092180A3 (en) Device and method for digitizing an object
CN112911147B (en) Display control method, display control device and electronic equipment
CN113794829B (en) Shooting method and device and electronic equipment
WO2002061672A3 (en) System and method for extracting a point of interest of an object in front of a computer controllable display captured by an imaging device
CN108847191B (en) Backlight adjusting system, backlight adjusting method and device thereof, and intelligent interaction equipment
JP4715653B2 (en) Laser pointer position determination system and laser pointer position determination method
EP4294000A1 (en) Display control method and apparatus, and electronic device and medium
CN112584040B (en) Image display method and device and electronic equipment
CN112153291B (en) Photographing method and electronic equipment
CN113794831B (en) Video shooting method, device, electronic equipment and medium
CN110089103B (en) Demosaicing method and device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE FR GB IT NL

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

17P Request for examination filed

Effective date: 19980923

17Q First examination report despatched

Effective date: 19990108

AKX Designation fees paid

Free format text: DE FR GB IT NL

RBV Designated contracting states (corrected)

Designated state(s): DE FR GB IT NL

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20000401