US20070273642A1 - Method and apparatus for selecting information in multi-dimensional space - Google Patents

Method and apparatus for selecting information in multi-dimensional space Download PDF

Info

Publication number
US20070273642A1
US20070273642A1 US11/697,670 US69767007A US2007273642A1 US 20070273642 A1 US20070273642 A1 US 20070273642A1 US 69767007 A US69767007 A US 69767007A US 2007273642 A1 US2007273642 A1 US 2007273642A1
Authority
US
United States
Prior art keywords
motion
effective
information
unit
result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/697,670
Inventor
Tae-Sik Park
Sang-goog Lee
Kwang-Woon Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to US11/697,670 priority Critical patent/US20070273642A1/en
Publication of US20070273642A1 publication Critical patent/US20070273642A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033Indexing scheme relating to G06F3/033
    • G06F2203/0331Finger worn pointing device

Definitions

  • the present invention relates to an apparatus for sensing a motion for selecting information in a two- or three-dimensional space, and more particularly, to an information selection method and apparatus for determining whether a sensed motion is effective in a multi-dimensional space.
  • Representative apparatuses for sensing a user's motion for pointing at or inputting information in a two- or three-dimensional space are handheld space-type input apparatuses, such as personal computers (PCs), personal digital assistances (PDAs), and cellular phones; wireless portable pointing apparatuses, wireless portable keyboards; hand motion and gesture recognizing apparatuses; virtual musical playing apparatuses; computer game machines; virtual environment exercise and training apparatuses; virtual reality data gloves; mechanical impact and shake tracking and monitoring apparatuses; and robot motion information acquiring apparatuses.
  • handheld space-type input apparatuses such as personal computers (PCs), personal digital assistances (PDAs), and cellular phones
  • wireless portable pointing apparatuses wireless portable keyboards
  • hand motion and gesture recognizing apparatuses virtual musical playing apparatuses
  • computer game machines virtual environment exercise and training apparatuses
  • virtual reality data gloves virtual reality data gloves
  • mechanical impact and shake tracking and monitoring apparatuses and robot motion information acquiring apparatuses.
  • a mechanical switch or a pressure sensor is used in order to determine whether information generated by a user's motion using the above apparatuses is effective.
  • a mechanical switch or a pressure sensor is used in order to determine whether information generated by a user's motion using the above apparatuses is effective.
  • a switch or sensor is pushed or touched on a plane, an on/off signal is generated, and effective information is identified according to the on/off signal.
  • whether a user's motion for selecting information is an effective one can be determined by contact on a plane, but whether a user's motion for selecting information in a three-dimensional space is an effective one cannot be determined via the same method.
  • the present invention provides an information selection method through which information selected by a user can be exactly recognized from the user's motion for selecting information in a multi-dimensional space.
  • the present invention also provides an information selection apparatus for performing the above information selection method in a multi-dimensional space.
  • a method of selecting information in a multi-dimensional space includes the steps of (a) sensing the motion of a user for information selection; and (b) determining whether the sensed motion is an effective motion of the intended information selection and returning to step (a) if it is determined that the motion is not the effective motion.
  • an apparatus for selecting information in a multi-dimensional space includes at least one motion unit moved by a user intending to select information; at least one sensing unit for sensing the motion of the motion unit and outputting the result of sensing; and at least one effective signal detection unit for checking whether the motion of the motion unit is an effective motion intending to select the information based on the result of sensing and outputting the result of checking as an effective signal.
  • FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention
  • FIG. 2 is a block diagram of an information selection apparatus for performing the method of FIG. 1 according to the present invention
  • FIG. 3 is a flowchart of a preferred embodiment of step 16 of FIG. 1 according to the present invention.
  • FIG. 4 is a block diagram of a preferred embodiment of an effective signal detection unit of FIG. 2 according to the present invention.
  • FIG. 5 is a block diagram of a first embodiment of a feature amount detector of FIG. 4 according to the present invention.
  • FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector of FIG. 5 ;
  • FIG. 7 is a block diagram of a second embodiment of a feature amount detector of FIG. 4 according to the present invention.
  • FIGS. 8A through 8D are waveform diagrams of the respective parts of FIG. 7 ;
  • FIG. 9 is a block diagram of a first embodiment of a signal extractor of FIG. 5 or 7 according to the present invention.
  • FIG. 10 is a block diagram of a second embodiment of a signal extractor of FIG. 5 or 7 according to the present invention.
  • FIG. 11 is a waveform diagram showing the first and second predetermined periods for explaining steps 74 and 76 shown in FIG. 3 ;
  • FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated;
  • FIG. 13 is a block diagram of an information selection apparatus for performing the method of FIG. 12 according to the present invention.
  • FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated;
  • FIG. 15 is a block diagram of an information selection apparatus for performing the method of FIG. 14 according to the present invention.
  • FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated;
  • FIG. 17 is a block diagram of an information selection apparatus for performing the method of FIG. 16 according to the present invention.
  • FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated.
  • FIG. 19 is a block diagram of an information selection apparatus for performing the method of FIG. 18 according to the present invention.
  • FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention. The method includes identifying effective information depending on whether a user's motion is effective, in steps 10 through 18 .
  • FIG. 2 is a block diagram of an information selection apparatus for performing the method of FIG. 1 according to the present invention.
  • the information selection apparatus includes a motion unit 40 , a sensing unit 42 , a regularizing unit 44 , an analog-to-digital converter (ADC) 46 , an effective signal detection unit 48 , a motion amount detection unit 50 , a first comparator 52 , and an effective information determination unit 54 .
  • ADC analog-to-digital converter
  • At least one motion unit 40 shown in FIG. 2 is moved by a user.
  • the user desires to select information, that is, when the user points at information or determines input of information, he/she moves the motion unit 40 in a two- or three-dimensional space.
  • the user performs a clicking motion when determining the input of pointed information.
  • the motion unit 40 may be attached to each finger performing the clicking motion.
  • the motion unit 40 can be attached to a predetermined body part, for example, a hand, finger, foot, head, arm, or leg, of a user.
  • the motion unit 40 may be a member (not shown) of a glove type which is directly installed on the hand or may be a manipulation member (not shown) which can be manipulated by the user without being directly attached to the user's predetermined body part.
  • the manipulation member as the motion unit 40 can be realized in the form of a glove-puppet.
  • At least one sensing unit 42 senses the motion of the motion unit 40 moved by a user desiring to select information and outputs the result of sensing the motion in step 10 .
  • the sensing unit 42 can visually sense the motion of the motion unit 40 .
  • the sensing unit 42 visually observes the motion of the motion unit 40 through a monitor (not shown) and outputs the result of observation as the motion of the motion unit 40 .
  • the sensing unit 42 can sense the amount of motion of the motion unit 40 through the variation of acceleration, the variation of angular velocity, the variation of resistance, the variation of capacitance, the variation of a magnetic field, the direction of a magnetic field, or the variation of the number of pulses.
  • the sensing unit 42 can be realized as a Micro ElectroMechanic System (MEMS) inertial sensor for sensing the variation of acceleration and angular velocity, a variable resistance sensor for sensing the variation of resistance, a variable capacity sensor for sensing the variation of capacitance, a magnetic sensor for sensing the variation of a magnetic field or the direction of a magnetic field, or a rotary encoder type sensor for sensing the variation of the number of pulses.
  • MEMS Micro ElectroMechanic System
  • the magnetic sensor can be realized as a giant magneto resistive (GMR) sensor.
  • GMR giant magneto resistive
  • the information selection apparatus of FIG. 2 can be provided with the regularizing unit 44 for the case where a plurality of motions are sensed by at least one sensing unit 42 .
  • the information selection apparatus may not be provided with the regularizing unit 44 when only one motion is sensed by the sensing unit 42 .
  • the regularizing unit 44 regularizes the result of sensing of the sensing unit 42 and outputs the result of regularization to the ADC 46 and the motion amount detection unit 50 .
  • step 10 it is determined whether the amount of the sensed motion exceeds a predetermined amount in step 12 . If it is determined that the sensed motion amount exceeds the predetermined amount, an information selection method according to the present invention ends. However, if it is determined that the sensed motion amount does not exceed the predetermined amount, the procedure goes to step 14 .
  • the information selection apparatus of FIG. 2 can be provided with the motion amount detection unit 50 and the first comparator 52 .
  • the motion amount detection unit 50 detects a motion amount from the result of sensing of the sensing unit 42 and outputs the detected motion amount to the first comparator 52 .
  • the motion amount detection unit 50 detects a motion amount from the result of regularization received from the regularizing unit 44 .
  • the first comparator 52 compares the motion amount received from the motion amount detection unit 50 with a predetermined amount externally received and outputs the result of comparison to the effective signal detection unit 48 .
  • the motion unit 40 is attached to each finger, and that a user selects information by moving a finger, that is, by bending or clicking the finger, the motion of a finger accompanied with a large motion of a user's hand to the front, to the back, to the left, to the right, up, or down is supposed not to be the user's intentional motion for selecting information.
  • step 12 is performed. Accordingly, if it is determined that the motion amount exceeds the predetermined amount based on the result of comparison received from the first comparator 52 , the effective signal detection unit 48 does not generate an effective signal. According to the present invention, step 12 can be selectively provided. Consequently, the motion amount detection unit 50 and the first comparator 52 can also be selectively provided.
  • the ADC 46 converts the result of sensing received from the sensing unit 42 from an analog form into a digital form in response to the result of comparison received from the first comparator 52 and outputs the result of conversion to the effective signal detection unit 48 in step 14 .
  • the ADC 46 converts the result of regularization received from the regularizing unit 44 from an analog form into a digital form and outputs the result of conversion to the effective signal detection unit 48 .
  • the ADC 46 converts the result of sensing from an analog form into a digital form only when it is recognized that the sensed motion amount does not exceed the predetermined amount based on the result of comparison received from the first comparator 52 .
  • the ADC 46 can convert the result of sensing in an analog form into a digital form regardless of the result of comparison performed by the first comparator 52 .
  • the effective signal detection unit 48 receiving the result of comparison performed by the first comparator 52 determines whether the result of conversion output from the ADC 46 is used for generating an effective signal.
  • step 14 and the ADC 46 can be selectively provided.
  • the ADC 46 when the result of sensing performed by the sensing unit 42 has an analog form and the effective signal detection unit 48 detects an effective signal in a digital form, the ADC 46 is provided. However, when the result of sensing performed by the sensing unit 42 has a digital form, the ADC 46 is not provided.
  • step 14 can be provided between step 10 and step 12 .
  • the result of sensing is converted from an analog form into a digital form, and the procedure goes to step 12 .
  • the ADC 46 is provided between the sensing unit 42 and the regularizing unit 44 , so the result of sensing is converted from an analog form into a digital form either in response to the result of comparison performed by the first comparator 52 or regardless of the result of comparison performed by the first comparator 52 .
  • the regularizing unit 44 regularizes a signal in a digital form resulting from the conversion performed by the ADC 46 and outputs the result of regularizing to the effective signal detection unit 48 and the motion amount detection unit 50 .
  • step 14 it is determined whether the motion sensed by the sensing unit 42 is an effective one, i.e., the intended one for information selection when the user moves the motion unit, in step 16 .
  • the effective signal detection unit 48 determines whether the motion of the motion unit 40 moved by the user is an effective one based on the result of sensing performed by the sensing unit 42 when the ADC 46 and the regularizing unit 44 are not provided, based on the result of conversion performed by the ADC 46 when the ADC 46 is provided as shown in FIG.
  • the effective signal detection unit 48 controls the sensing unit 42 to sense a new motion. In contrast, if it is determined that the motion of the motion unit 40 is an effective one intended for information selection, the effective signal detection unit 48 generates an effective signal indicating that the motion of the motion unit 40 is an effective one and outputs the effective signal to the effective information determination unit 54 .
  • step 16 shown in FIG. 1 a preferred embodiment of step 16 shown in FIG. 1 and the structure and operations of a preferred embodiment of the effective signal detection unit 48 shown in FIG. 2 will be described with reference to the attached drawings. Even if the regularizing unit 44 and/or the ADC 46 are provided, descriptions of the embodiments will be the same as in the case where the regularizing unit 44 and the ADC 46 are not provided, with the exception that not the result of sensing but the result of regularization or a signal in a digital form is input to the effective signal detection unit 48 .
  • FIG. 3 is a flowchart of a preferred embodiment 16 A of step 16 of FIG. 1 according to the present invention.
  • the embodiment 16 A of step 16 includes determining the sensed motion as an effective motion according to a feature amount detected from the result of sensing and a period for which the detected feature amount is maintained in steps 70 through 76 .
  • FIG. 4 is a block diagram of a preferred embodiment 48 A of the effective signal detection unit 48 of FIG. 2 according to the present invention.
  • the preferred embodiment 48 A of the effective signal detection unit 48 includes a feature amount detector 90 , a regularizing unit 92 , a second comparator 94 , a first counter 96 , a third comparator 98 , an effective signal generator 100 , and a fourth comparator 102 .
  • the feature amount detector 90 of FIG. 4 extracts a portion having a change in size from the result of sensing received through an input terminal IN 2 as a feature amount and outputs the extracted feature amount in step 70 . If there is no motion of the motion unit 40 , the result of sensing has only a direct current component, so there is no portion having a change in the size of the result of sensing.
  • the regularizing unit 92 may not be provided. However, if a plurality of motions are sensed by the sensing unit 42 , the regularizing unit 92 is provided as a substitute for the regularizing unit 44 of FIG. 2 . In other words, only one of the regularizing units 44 and 92 can be selectively provided.
  • the regularizing unit 92 regularizes the portion having a change in size, which has been extracted by the feature amount detector 90 in step 70 , and outputs the result of regularization to the second comparator 94 .
  • the functions and operations of the regularizing units 44 and 92 shown in FIGS. 2 and 4 , respectively, will be described in detail.
  • the regularizing unit 44 or 92 regularizes input data and can be realized as a multiplier (not shown) for multiplying the received sensing result by a weight and outputting the multiplication result as the result of regularization.
  • a multiplier for multiplying the received sensing result by a weight and outputting the multiplication result as the result of regularization.
  • the motion unit 40 is provided at each of a thumb, index finger, middle finger, ring finger, and little finger, a different amount of a motion is generated when clicking each finger, so the result of sensing is regularized to detect only the component having a change in size from the result of sensing as a feature amount.
  • a weight multiplied by the result of sensing the motion of the thumb is set to be larger than a weight multiplied by the result of sensing the motion of a finger other than the thumb, for example, the little finger.
  • weights can be empirically determined in advance as having different values according to the motion degree of the motion unit 40 .
  • the results of sensing the motions generated when clicking the thumb, index finger, middle finger, ring finger, and little finger, respectively are examined in advance, and the results of examinations are analyzed to set different weights for different fingers.
  • different weights can be set depending on an angle at which each finger is bent regardless of the kind of finger. For example, all angles at which the thumb, index finger, middle finger, ring finger, and little finger can be bent are examined, and the results of examinations are analyzed to set different weights for different angles.
  • FIG. 5 is a block diagram of a first embodiment 90 A of the feature amount detector 90 of FIG. 4 according to the present invention.
  • the first embodiment 90 A of the feature amount detector 90 includes a low-pass filter 120 , a high-pass filter 122 , and a signal extractor 124 .
  • FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector 90 A of FIG. 5 .
  • FIG. 6A is a waveform diagram of a signal input to the low-pass filter 120 .
  • FIG. 6B is a waveform diagram of a signal output from the low-pass filter 120 .
  • FIG. 6C is a waveform diagram of a signal output from the high-pass filter 122 .
  • a band pass filter 126 of the feature amount detector 90 A band-pass filters the result of sensing received through an input terminal IN 3 , as shown in FIG. 6A , and outputs the result of band-pass filtering as a feature amount to the signal extractor 124 .
  • the band pass filter 126 can include the low-pass filter 120 and the high-pass filter 122 .
  • the low-pass filter 120 low-pass filters the result of sensing, which is shown in FIG. 6A and input through the input terminal IN 3 , and outputs the result of low-pass filtering shown in FIG. 6B to the high-pass filter 122 .
  • the high-pass filter 122 high-pass filters the result of low-pass filtering shown in FIG. 6B and outputs the result of high-pass filtering shown in FIG. 6C as a portion having a change in size of the result of sensing to the signal extractor 124 .
  • the signal extractor 124 extracts only the positive or negative component from the portion having a change in size shown in FIG. 6C , which is output from the high-pass filter 122 , as a feature amount and outputs the extracted feature amount through an output terminal OUT 6 .
  • FIG. 7 is a block diagram of a second embodiment 90 B of the feature amount detector 90 of FIG. 4 according to the present invention.
  • the second embodiment 90 B of the feature amount detector 90 includes first and second filters 140 and 142 , a differential calculator 144 , and a signal extractor 146 .
  • the first filter 140 of the feature amount detector 90 B filters a first frequency component of the result of sensing input through an input terminal IN 4 and outputs the result of filtering to the differential calculator 144 .
  • the second filter 142 filters a second frequency component of the result of sensing input through the input terminal IN 4 and outputs the result of filtering to the differential calculator 144 .
  • the differential calculator 144 calculates the difference between the result of filtering of the first filter 140 and the result of filtering of the second filter 142 and outputs the calculated difference to the signal extractor 146 .
  • each of the first and second frequency components filtered by the first and second filters 140 and 142 may be a low-band component, a high-band component, or just a band component.
  • the first and second frequency components may be a low-band component and a high-band component, respectively, a low-band component and a band component, respectively, or a high-band component and a band component, respectively.
  • the feature amount detector 90 B of FIG. 7 generates a portion having a change in the size of the result of sensing as follows.
  • FIGS. 8A through 8D are waveform diagrams of the respective parts of FIG. 7 .
  • FIG. 8A is a waveform diagram of the result of sensing input to the first and second filters 140 and 142 .
  • FIG. 8B is a waveform diagram of the result of low-pass filtering of the first filter 140 .
  • FIG. 8C is a waveform diagram of the result of low-pass filtering of the second filter 142 .
  • FIG. 8D is a waveform diagram of a difference component output from the differential calculator 144 .
  • the first filter 140 having the cut-off frequency f c1 of 10 Hz low-pass filters the first frequency component of the result of sensing, which is input through the input terminal IN 4 and shown in FIG. 8A , and outputs the result of filtering shown in FIG. 8B to the differential calculator 144 .
  • the second filter 142 having the cut-off frequency f c2 of 4 Hz low-pass filters the second frequency component of the result of sensing, which is input through the input terminal IN 4 and shown in FIG. 8A , and outputs the result of filtering shown in FIG. 8C to the differential calculator 144 .
  • the differential calculator 144 calculates the difference between the result of filtering of the first filter 140 shown in FIG. 8B and the result of filtering of the second filter 142 shown in FIG.
  • the signal extractor 146 extracts only the positive or negative component from the difference received from the differential calculator 144 as a feature amount and outputs the extracted feature amount through an output terminal OUT 7 .
  • the motion unit 40 is attached to the thumb of a glove-shaped member (not shown) and a user wearing the glove-shaped member on his/her hand clicks information by moving his/her thumb to the left or right.
  • the thumb since the thumb usually moves to the left and right when the user clicks the thumb, it is necessary to set only one direction effective in clicking. Otherwise, when the thumb is moved for one click, two clicks may be recognized.
  • the signal extractor 124 or 146 shown in FIG. 5 or 7 extracts a negative or positive component as a feature amount from the portion having a change in size.
  • FIG. 9 is a block diagram of a first embodiment of the signal extractor 124 or 146 of FIG. 5 or 7 according to the present invention.
  • the signal extractor 124 or 146 is realized as a first rectifier 160 .
  • the first rectifier 160 shown in FIG. 9 rectifies the portion, which has a change in size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN 5 , or the difference received from the differential calculator 144 through the input terminal IN 5 and outputs the result of rectification as the feature amount through an output terminal OUT 8 . Accordingly, only the portion having a change in size of the result of sensing output from the high-pass filter 122 or only the positive component of the difference output from the differential calculator 144 can be extracted as the feature amount.
  • FIG. 10 is a block diagram of a second embodiment of the signal extractor 124 or 146 of FIG. 5 or 7 according to the present invention.
  • the signal extractor 124 or 146 includes a first inverter 180 , a second rectifier 182 , and a second inverter 184 .
  • the first inverter 180 shown in FIG. 10 inverts the portion, which has a change in the size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN 6 , or the difference received from the differential calculator 144 through the input terminal IN 6 and outputs the result of inversion to the second rectifier 182 .
  • the second rectifier 182 rectifies the result of inversion received from the first inverter 180 and outputs the result of rectification to the second inverter 184 .
  • the second inverter 184 inverts the result of rectification received from the second rectifier 182 and outputs the result of inversion as the feature amount through an output terminal OUT 9 . Accordingly, only the size-changed portion of the result of sensing output from the high-pass filter 122 or only the negative component of the difference output from the differential calculator 144 can be extracted as the feature amount.
  • a predetermined threshold is previously set according to the motion range of the motion unit 40 can be moved. For example, when the motion unit 40 is attached to a user's each finger, the amplitudes of feature amounts detected when each finger is clicked are acquired in advance, and the predetermined threshold can be set based on the result of analyzing the acquired amplitudes of the feature amounts, that is, the motion degrees of the fingers.
  • the second comparator 94 compares the feature amount received from the feature amount detector 90 with the externally received predetermined threshold and outputs the result of comparison to the first counter 96 and to the sensing unit 42 through an output terminal OUT 2 . If it is determined that the feature amount is less than the predetermined threshold, the procedure goes to step 10 . For this, the sensing unit 42 senses a new motion of the motion unit 40 when the feature amount is recognized as being less than the predetermined threshold based on the result of comparison performed by the second comparator 94 .
  • FIG. 11 is a waveform diagram showing first and second predetermined periods T 1 and T 2 for explaining steps 74 and 76 shown in FIG. 3 .
  • the vertical axis refers to time, and the horizontal axis refers to amplitude values.
  • the effective signal detection unit 48 A can be further provided with the first counter 96 and the third comparator 98 .
  • the first counter 96 performs a counting operation in response to the result of comparison received from the second comparator 94 and outputs the result of counting to the third comparator 98 .
  • the first counter 96 performs a counting operation when recognizing that the feature amount is at least of the same value as the predetermined threshold based on the result of comparison performed by the second comparator 94 and does not perform the counting operation when it is recognized that the feature amount 200 is less than the predetermined threshold.
  • the third comparator 98 compares the result of counting received from the first counter 96 with the first predetermined period T 1 externally received and outputs the result of comparison to the effective signal generator 100 and to the sensing unit 42 through an output terminal OUT 3 .
  • the procedure goes to step 10 .
  • the sensing unit 42 senses a new motion of the motion unit 40 if it is determined that the feature amount 200 is not maintained to be at least the predetermined threshold for the first predetermined period T 1 based on the resuit of comparison performed by the third comparator 98 . This is because a feature amount should be maintained to be at least a predetermined threshold for at least the first predetermined period T 1 in order to determine a user's motion as an intentional motion to select information. Otherwise, the user's motion is not determined as an intentional effective motion.
  • the sensed motion of the motion unit 40 is determined as an effective motion in step 76 , and the procedure goes to step 18 .
  • the first predetermined period T 1 is set to the minimum time taken for the user to move the motion unit 40 to intentionally select information.
  • the effective signal generator 100 generates an effective signal indicating that the motion of the motion unit 40 is an effective motion in response to the result of comparison received from the third comparator 98 and outputs the effective signal to the effective information determination unit 54 through an output terminal OUT 4 .
  • the sensing unit 42 may not sense a new motion of the motion unit 40 or may not output the result of sensing.
  • Step 74 may be selectively provided. Accordingly, the first counter 96 and the third comparator 98 of FIG. 4 may also be selectively provided.
  • the effective signal generator 100 generates an effective signal in response to the result of comparison received from the second comparator 94 . For example, the effective signal generator 100 generates an effective signal if it is determined that the feature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison received from the second comparator 94 and does not generate an effective signal if it is determined that the feature amount 200 is less than the predetermined threshold.
  • the result of sensing obtained for a period other than the first predetermined period T 1 in the second predetermined period T 2 of FIG. 11 is not used because undesirable cross-talk or noise may occur when the user selects information.
  • the ring finger may be moved together, which causes cross-talk occurrence.
  • the effective signal detection unit 48 A can be provided with the fourth comparator 102 .
  • the fourth comparator 102 compares the result of counting received from the first counter 96 with the second predetermined period T 2 received externally and outputs the result of comparison to the effective signal generator 100 and to the sensing unit 42 through an output terminal OUT 5 . Then, the effective signal generator 100 generates an effective signal in response to the result of comparison received from the fourth comparator 102 .
  • the effective signal generator 100 does not generate a new effective signal even if it is recognized that the feature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison of the second comparator 94 .
  • the sensing unit 42 may not sense a new motion of the motion unit 40 or may not output the result of sensing.
  • the second predetermined period T 2 is set according to a time period for which the motion unit 40 may be unnecessarily moved when the user selects information.
  • the second predetermined period T 2 may be set to be different depending on the type of motion unit 40 .
  • the second predetermined period T 2 is set to be longer than it is set on the assumption that the clicking operation is performed by moving a finger other than the thumb, in order to prevent two feature amounts from being detected.
  • the fourth comparator 102 shown in FIG. 4 can be selectively provided.
  • the effective signal generator 100 generates an effective signal in response to only the result of comparison received from the third comparator 98 regardless of whether the second predetermined period T 2 has elapsed.
  • the effective information determination unit 54 of FIG. 2 determines the information received through an input terminal IN 1 as effective information in response to the effective signal received from the effective signal detection unit 48 and outputs the effective information through an output terminal OUT 1 in step 18 . For example, if it is recognized that the motion of the motion unit 40 is an effective motion based on the effective signal, the effective information determination unit 54 determines the information, which is selected by the effective motion and received through the input terminal IN 1 , as effective information and outputs the determined information through the output terminal OUT 1 .
  • the effective information determination unit 54 determines the information, which is selected by the motion of the motion unit 40 and received through the input terminal IN 1 , as ineffective information.
  • the effective information determination unit 54 shown in FIG. 2 may be applied as an information selection unit which is disclosed in the Korean Patent Application No. 2001-41560 mentioned above.
  • the effective information determination unit 54 establishes a one-dimensional position of an information screen from a first and/or second displacement and an angle, determines the information, which is located at the established one-dimensional position and received through the input terminal IN 1 , as effective information selected by the user in response to the effective signal received from the effective signal detection unit 48 , and outputs the established effective information through the output terminal OUT 1 .
  • the effective information determination unit 54 acts as an information recognizer disclosed in the Korean Patent Application No. 2001-41560.
  • the effective information determination unit 54 searches for the information which is mapped to a one-dimensional position designated by a user on the information screen, recognizes the searched information which is received through the input terminal IN 1 as effective information which is selected by the user in response to the effective signal received from the effective signal detection unit 48 , and outputs the recognized effective information through the output terminal OUT 1 .
  • the effective information determination unit 54 searches for the information, which is mapped to the horizontal and vertical coordinate values corresponding to a two-dimensional position determined from the horizontal and vertical positions of information designated by the user on the information screen, recognizes the searched information which is received through the input terminal IN 1 as effective information which is selected by the user in response to the effective signal received from the effective signal detection unit 48 , and outputs the recognized effective information through the output terminal OUT 1 .
  • At least two effective motions may be detected.
  • the clicking motion of a middle finger can be accompanied with the motion of a ring finger and the motion of a little finger.
  • the unintentional motions of the ring and little fingers must be considered as ineffective motions.
  • the motions of the ring and little fingers may act as cross-talk when it is determined whether the motion of the middle finger is an effective motion.
  • FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated.
  • the information selection method includes determining effective information using one motion among a plurality of effective motions in steps 220 through 226 .
  • FIG. 13 is a block diagram of an information selection apparatus for performing the method of FIG. 12 according to the present invention.
  • the information selection apparatus includes a first storage unit 240 , a second counter 242 , a first feature amount selector 244 , and an effective information determination unit 246 .
  • the second counter 242 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN 8 and outputs the result of counting to the first feature amount selector 244 and to the effective information determination unit 246 .
  • the first storage unit 240 receives one or more feature amounts corresponding to one or more effective motions from the feature amount detector 90 through an input terminal IN 7 and stores the one or more feature amounts.
  • the first feature amount selector 244 selects the biggest feature amount from the feature amounts stored in the first storage unit 240 in response to the result of counting received from the second counter 242 and outputs the selected feature amount to the effective information determination unit 246 . For example, only if it is recognized that there are at least two effective motions based on the result of counting received from the second counter 242 , the first feature amount selector 244 performs step 224 .
  • the steps 220 and 224 may be performed between steps 16 and 18 shown in FIG. 1 .
  • the first storage unit 240 , the second counter 242 , and the first feature amount selector 244 shown in FIG. 13 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2 .
  • the effective information determination unit 246 acts as the effective information determination unit 54 .
  • the effective information determination unit 246 determines the information, which is selected by a single effective motion and received through an input terminal IN 9 , as effective information and outputs the determined effective information through an output terminal OUT 10 in step 222 .
  • the effective information determination unit 246 determines information, which is selected by an effective motion corresponding to the feature amount selected by the first feature amount selector 244 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN 9 , as the effective information and outputs the determined effective information through the output terminal OUT 10 in step 226 .
  • FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated.
  • the information selection method includes determining the effective information using one motion among a plurality of effective motions, in steps 260 through 266 .
  • FIG. 15 is a block diagram of an information selection apparatus for performing the method of FIG. 14 according to the present invention.
  • the information selection apparatus includes a second storage unit 280 , a third counter 282 , a first time selector 284 , and an effective information determination unit 286 .
  • step 260 it is determined whether there are at least two effective motions in step 260 .
  • the third counter 282 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN 11 and outputs the result of counting to the first time selector 284 and to the effective information determination unit 286 .
  • a first determined effective motion is selected from the effective motions in step 264 , and the procedure goes to step 266 .
  • step 264 it is assumed that the motion unit 40 is attached to each finger of a user's hands intending to select information, and information is selected by moving one of the user's fingers.
  • at least one finger near to a finger which is intentionally moved may be moved together or following with the intentionally moved finger regardless of the user's intention.
  • the second storage unit 280 stores points (that is, instants of time) when one or more feature amounts corresponding to one or more effective motions are received from the feature amount detector 90 through an input terminal IN 10 .
  • the first time selector 284 selects an earliest time from the instants of time stored in the second storage unit 280 in response to the result of counting received from the third counter 282 and outputs the selected time to the effective information determination unit 286 . For example, only if it is recognized that there are at least two effective motions based on the result of counting received from the third counter 282 , the first time selector 284 performs step 264 . Steps 260 and 264 may be performed between steps 16 and 18 shown in FIG. 1 .
  • the second storage unit 280 , the third counter 282 , and the first time selector 284 shown in FIG. 15 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2 . In this case, the effective information determination unit 286 acts as the effective information determination unit 54 .
  • the effective information determination unit 286 determines the information, which is selected by a single effective motion and received through an input terminal IN 12 , as effective information and outputs the determined effective information through an output terminal OUT 11 in step 262 .
  • the effective information determination unit 286 determines the information, which is selected by the first determined effective motion corresponding to a feature amount generated at the time selected by the first time selector 284 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN 12 , as the effective information and outputs the determined effective information through the output terminal OUT 11 in step 266 .
  • FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated.
  • the information selection method includes determining the effective information using one motion among a plurality of effective motions, in steps 300 through 310 .
  • FIG. 17 is a block diagram of an information selection apparatus for performing the method of FIG. 16 according to the present invention.
  • the information selection apparatus includes a third storage unit 330 , a fourth storage unit 332 , a fourth counter 334 , a fifth comparator 336 , a second feature amount selector 338 , a second time selector 340 , and an effective information determination unit 342 .
  • the fourth counter 334 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN 15 and outputs the result of counting to the fifth comparator 336 and to the effective information determination unit 342 .
  • the fourth storage unit 332 stores instants of time when one or more feature amounts corresponding to one or more effective motions are received from the feature amount detector 90 through an input terminal IN 12 .
  • the fifth comparator 336 compares the instants of time stored in the fourth storage unit 332 and outputs the result of comparison to the second feature amount selector 338 , the second time selector 340 , and the effective information determination unit 342 .
  • the fifth comparator 336 may perform a comparison operation in response to the result of counting received from the fourth counter 334 . For example, if it is recognized that there are not at least two effective motions based on the result of counting performed by the fourth counter 334 , the fifth comparator 336 does not perform the comparison operation.
  • step 306 is performed based on the fact that a feature amount corresponding to the first determined effective motion is first detected by the feature amount detector 90 .
  • the second time selector 340 selects the earliest instant of time from the instants of time stored in the fourth storage unit 332 in response to the result of comparison received from the fifth comparator 336 and outputs the selected instant of time to the effective information determination unit 342 . For example, only if it is recognized that the effective motions are not determined simultaneously based on the result of comparison received from the fifth comparator 336 , the second time selector 340 performs step 306 .
  • the third storage unit 330 receives one or more feature amounts corresponding to one or more effective motions from the feature amount detector 90 through an input terminal IN 13 and stores the one or more feature amounts.
  • the second feature amount selector 338 selects a biggest feature amount from among the feature amounts stored in the third storage unit 330 in response to the result of comparison received from the fifth comparator 336 and outputs the selected feature amount to the effective information determination unit 342 . For example, only if it is recognized that the effective motions are determined simultaneously based on the result of comparison received from the fifth comparator 336 , the second feature amount selector 338 performs step 308 .
  • the steps 300 through 308 may be performed between steps 16 and 18 shown in FIG. 1 .
  • the third and fourth storage units 330 and 332 , the fourth counter 334 , the fifth comparator 336 , the second feature amount selector 338 , and the second time selector 340 shown in FIG. 17 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2 .
  • the effective information determination unit 342 acts as the effective information determination unit 54 .
  • the effective information determination unit 342 determines the information, which is selected by a single effective motion and received through an input terminal IN 16 , as effective information and outputs the determined effective information through an output terminal OUT 12 in step 302 .
  • the effective information determination unit 342 determines the information, which is selected by the effective motion corresponding to the feature amount selected by the second feature amount selector 338 or the feature amount generated at the instant of time selected by the second time selector 340 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN 16 , as the effective information in response to the result of comparison received from the fifth comparator 336 and outputs the determined effective information through the output terminal OUT 12 in step 310 .
  • FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated.
  • the information selection method includes determining the effective information using one motion, among a plurality of effective motions, in steps 300 , 306 through 310 , and 370 .
  • FIG. 19 is a block diagram of an information selection apparatus for performing the method of FIG. 18 according to the present invention.
  • the information selection apparatus includes a third storage unit 330 , a fourth storage unit 332 , a fourth counter 334 , a sixth comparator 360 , a second feature amount selector 338 , a second time selector 340 , and an effective information determination unit 342 .
  • the information selection method of FIG. 18 is the same as that of FIG. 16 with the exception that, step 370 in FIG. 18 is performed instead of step 304 .
  • the structure and operations of the information selection apparatus shown in FIG. 19 are the same as those of the information selection apparatus shown in FIG. 17 with the exception that the sixth comparator 360 in FIG. 19 is used instead of the fifth comparator 336 . Accordingly, in describing FIGS. 18 and 19 , repeated portions will be omitted.
  • step 370 if it is determined that there are at least two effective motions, it is determined in step 370 whether the amounts of the effective motions, that is, the degrees of the effective motions, are the same. If it is determined that the amounts of the effective motions are the same, the procedure goes to step 306 . If it is determined that the amounts of the effective motions are not the same, the procedure goes to step 308 .
  • the sixth comparator 360 of FIG. 19 compares the feature amounts received from the third storage unit 330 and outputs the result of comparison to the second feature amount selector 338 , the second time selector 340 , and the effective information determination unit 342 .
  • the second time selector 340 performs step 306 .
  • the second feature amount selector 338 performs step 308 .
  • the effective information determination unit 246 , 286 , or 342 shown in FIG. 13, 15 , 17 , or 19 may recognize which motion unit 40 among one or more motion units 40 generates the effective motion selected in step 224 , 264 , 306 , or 308 .
  • the first or second feature amount selector 244 or 338 instead of outputting the selected feature amount, the first or second feature amount selector 244 or 338 outputs a unique identification number for identifying the motion unit 40 , which generates a motion corresponding to the selected feature amount, to the effective information determination unit 246 or 342 .
  • the first or second time selector 284 or 340 outputs the unique identification number of the motion unit 40 , which generates a motion corresponding to the feature amount generated at the selected time, to the effective information determination unit 286 or 342 .
  • the effective information determination unit 246 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the first feature amount selector 244 .
  • the effective information determination unit 286 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the first time selector 284 .
  • the effective information determination unit 342 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the second feature amount selector 338 or the second time selector 340 .
  • the information selection apparatus shown in FIG. 2 may be provided with a separate communication unit (not shown) for converting the format of an effective signal received from the effective signal detection unit 48 , converting the signal having the converted format into a wireless signal, and wirelessly transmitting the wireless signal to the effective information determination unit 54 .
  • the motion unit 40 can be attached to a user's predetermined body part.
  • the sensing unit 42 senses the motion of a finger joint.
  • the sensing unit 42 senses the motion of the wrist.
  • the sensing unit 42 senses the motion of the neck joint.
  • an information selection method and apparatus can be used for recognizing whether the clicking motion of a finger such as an index finger, middle finger, ring finger, or little finger is effective, because the third joint of a finger is usually moved when a user clicks a key on a widely known QWERY keyboard.
  • an information selection method can be used for recognizing whether the information pointed at by the motion angle of a finger at its joint is effective or for recognizing whether a finger's clicking motion for determining the input of information pointed at by the finger is effective.
  • an information selection method and apparatus can recognize whether the motion of the motion unit 40 is effective in apparatuses for sensing the motion of the motion unit 40 .
  • a method and apparatus for selecting information in a multi-dimensional space detect, as a portion having a change in size, the difference between the results of filtering performed using the first and second filters 140 and 142 having different cut-off frequencies, thereby overcoming difficulty in setting a predetermined threshold to a single value.
  • even the very slight motion of the motion unit 40 can be accurately detected without being influenced by gravity and offsets which can be provoked by using an inertial sensor as the sensing unit 42 .
  • the present invention can accurately determine whether a user's two- or three-dimensional motion is an effective motion for selecting information and which motion unit 40 , among at least two motion units 40 , has generated the effective motion, thereby achieving a high correct recognition rate and high reliability and allowing a user to easily select the desired information.

Abstract

Method and apparatus for selecting information in a multi-dimensional space are provided. The method includes the steps of sensing the motion of a user intending to select information, and determining whether the sensed motion is an effective motion intended for information selection and returning to the sensing step if it is determined that the motion is not the effective one. Accordingly, difficulty in setting a predetermined threshold to a single value can be overcome. In addition, even a very slight motion can be accurately detected without being influenced by gravity and offsets. Moreover, it can be accurately determined whether a user's two- or three-dimensional motion is an effective motion for selecting information and which motion unit among at least two motion units has generated the effective motion, so that a high correct recognition rate for information and high reliability can be achieved, and a user is allowed to easily select information.

Description

  • This application is a continuation of pending prior application Ser. No. 10/484,505 filed Jan. 22, 2005, which is a National Stage Application of PCT Application No. PCT/KR02/01369 filed Jul. 22, 2002, and claims benefit of priority based on Korean Patent Application No. 2001-44588, filed Jul. 24, 2001, the disclosures of which is incorporated herein in their entirety by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to an apparatus for sensing a motion for selecting information in a two- or three-dimensional space, and more particularly, to an information selection method and apparatus for determining whether a sensed motion is effective in a multi-dimensional space.
  • 2. Description of the Related Art
  • Representative apparatuses for sensing a user's motion for pointing at or inputting information in a two- or three-dimensional space are handheld space-type input apparatuses, such as personal computers (PCs), personal digital assistances (PDAs), and cellular phones; wireless portable pointing apparatuses, wireless portable keyboards; hand motion and gesture recognizing apparatuses; virtual musical playing apparatuses; computer game machines; virtual environment exercise and training apparatuses; virtual reality data gloves; mechanical impact and shake tracking and monitoring apparatuses; and robot motion information acquiring apparatuses.
  • Usually, in order to determine whether information generated by a user's motion using the above apparatuses is effective, conventionally, a mechanical switch or a pressure sensor is used. In other words, according to a conventional method, when a switch or sensor is pushed or touched on a plane, an on/off signal is generated, and effective information is identified according to the on/off signal. Conventionally, whether a user's motion for selecting information is an effective one can be determined by contact on a plane, but whether a user's motion for selecting information in a three-dimensional space is an effective one cannot be determined via the same method.
  • SUMMARY OF THE INVENTION
  • The present invention provides an information selection method through which information selected by a user can be exactly recognized from the user's motion for selecting information in a multi-dimensional space.
  • The present invention also provides an information selection apparatus for performing the above information selection method in a multi-dimensional space.
  • According to an aspect of the invention, there is provided a method of selecting information in a multi-dimensional space. The method includes the steps of (a) sensing the motion of a user for information selection; and (b) determining whether the sensed motion is an effective motion of the intended information selection and returning to step (a) if it is determined that the motion is not the effective motion.
  • According to an aspect of the invention, there is provided an apparatus for selecting information in a multi-dimensional space. The apparatus includes at least one motion unit moved by a user intending to select information; at least one sensing unit for sensing the motion of the motion unit and outputting the result of sensing; and at least one effective signal detection unit for checking whether the motion of the motion unit is an effective motion intending to select the information based on the result of sensing and outputting the result of checking as an effective signal.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other features and advantages of the present invention will become more apparent by describing in detail preferred embodiments thereof with reference to the attached drawings in which:
  • FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention;
  • FIG. 2 is a block diagram of an information selection apparatus for performing the method of FIG. 1 according to the present invention;
  • FIG. 3 is a flowchart of a preferred embodiment of step 16 of FIG. 1 according to the present invention;
  • FIG. 4 is a block diagram of a preferred embodiment of an effective signal detection unit of FIG. 2 according to the present invention;
  • FIG. 5 is a block diagram of a first embodiment of a feature amount detector of FIG. 4 according to the present invention;
  • FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector of FIG. 5;
  • FIG. 7 is a block diagram of a second embodiment of a feature amount detector of FIG. 4 according to the present invention;
  • FIGS. 8A through 8D are waveform diagrams of the respective parts of FIG. 7;
  • FIG. 9 is a block diagram of a first embodiment of a signal extractor of FIG. 5 or 7 according to the present invention;
  • FIG. 10 is a block diagram of a second embodiment of a signal extractor of FIG. 5 or 7 according to the present invention;
  • FIG. 11 is a waveform diagram showing the first and second predetermined periods for explaining steps 74 and 76 shown in FIG. 3;
  • FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated;
  • FIG. 13 is a block diagram of an information selection apparatus for performing the method of FIG. 12 according to the present invention;
  • FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated;
  • FIG. 15 is a block diagram of an information selection apparatus for performing the method of FIG. 14 according to the present invention;
  • FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated;
  • FIG. 17 is a block diagram of an information selection apparatus for performing the method of FIG. 16 according to the present invention;
  • FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated; and
  • FIG. 19 is a block diagram of an information selection apparatus for performing the method of FIG. 18 according to the present invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Hereinafter, a method of selecting information in a multi-dimensional space according to the present invention and the structure and operations of an information selection apparatus for performing the above method according to the present invention will be described with reference to the attached drawings.
  • FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention. The method includes identifying effective information depending on whether a user's motion is effective, in steps 10 through 18.
  • FIG. 2 is a block diagram of an information selection apparatus for performing the method of FIG. 1 according to the present invention. The information selection apparatus includes a motion unit 40, a sensing unit 42, a regularizing unit 44, an analog-to-digital converter (ADC) 46, an effective signal detection unit 48, a motion amount detection unit 50, a first comparator 52, and an effective information determination unit 54.
  • At least one motion unit 40 shown in FIG. 2 is moved by a user. When the user desires to select information, that is, when the user points at information or determines input of information, he/she moves the motion unit 40 in a two- or three-dimensional space. Generally, the user performs a clicking motion when determining the input of pointed information. To sense such a clicking motion, for example, the motion unit 40 may be attached to each finger performing the clicking motion.
  • In one embodiment of the present invention, the motion unit 40 can be attached to a predetermined body part, for example, a hand, finger, foot, head, arm, or leg, of a user. The motion unit 40 may be a member (not shown) of a glove type which is directly installed on the hand or may be a manipulation member (not shown) which can be manipulated by the user without being directly attached to the user's predetermined body part. For example, the manipulation member as the motion unit 40 can be realized in the form of a glove-puppet.
  • To perform a method of selecting information according to the present invention, at least one sensing unit 42 senses the motion of the motion unit 40 moved by a user desiring to select information and outputs the result of sensing the motion in step 10. The sensing unit 42 can visually sense the motion of the motion unit 40. For this, the sensing unit 42 visually observes the motion of the motion unit 40 through a monitor (not shown) and outputs the result of observation as the motion of the motion unit 40. In addition, the sensing unit 42 can sense the amount of motion of the motion unit 40 through the variation of acceleration, the variation of angular velocity, the variation of resistance, the variation of capacitance, the variation of a magnetic field, the direction of a magnetic field, or the variation of the number of pulses. For this, the sensing unit 42 can be realized as a Micro ElectroMechanic System (MEMS) inertial sensor for sensing the variation of acceleration and angular velocity, a variable resistance sensor for sensing the variation of resistance, a variable capacity sensor for sensing the variation of capacitance, a magnetic sensor for sensing the variation of a magnetic field or the direction of a magnetic field, or a rotary encoder type sensor for sensing the variation of the number of pulses. Here, the magnetic sensor can be realized as a giant magneto resistive (GMR) sensor. The examples of the structures and operations of these sensors are disclosed in Korean Patent Application No. 2001-41560, entitled “Information Input Apparatus and Method Using Body Angle at Joint”.
  • The information selection apparatus of FIG. 2 can be provided with the regularizing unit 44 for the case where a plurality of motions are sensed by at least one sensing unit 42. The information selection apparatus may not be provided with the regularizing unit 44 when only one motion is sensed by the sensing unit 42. The regularizing unit 44 regularizes the result of sensing of the sensing unit 42 and outputs the result of regularization to the ADC 46 and the motion amount detection unit 50.
  • If the regularizing unit 44 is not provided, after step 10, it is determined whether the amount of the sensed motion exceeds a predetermined amount in step 12. If it is determined that the sensed motion amount exceeds the predetermined amount, an information selection method according to the present invention ends. However, if it is determined that the sensed motion amount does not exceed the predetermined amount, the procedure goes to step 14. To perform step 12, the information selection apparatus of FIG. 2 can be provided with the motion amount detection unit 50 and the first comparator 52. Here, if the regularizing unit 44 is not provided, the motion amount detection unit 50 detects a motion amount from the result of sensing of the sensing unit 42 and outputs the detected motion amount to the first comparator 52. In contrast, if the regularizing unit 44 is provided, the motion amount detection unit 50 detects a motion amount from the result of regularization received from the regularizing unit 44. The first comparator 52 compares the motion amount received from the motion amount detection unit 50 with a predetermined amount externally received and outputs the result of comparison to the effective signal detection unit 48. For example, when it is assumed that the motion unit 40 is attached to each finger, and that a user selects information by moving a finger, that is, by bending or clicking the finger, the motion of a finger accompanied with a large motion of a user's hand to the front, to the back, to the left, to the right, up, or down is supposed not to be the user's intentional motion for selecting information. Therefore, the result of sensing such an unintentional motion must not be used in an information selection method according to the present invention. For this, step 12 is performed. Accordingly, if it is determined that the motion amount exceeds the predetermined amount based on the result of comparison received from the first comparator 52, the effective signal detection unit 48 does not generate an effective signal. According to the present invention, step 12 can be selectively provided. Consequently, the motion amount detection unit 50 and the first comparator 52 can also be selectively provided.
  • If it is determined that the motion amount does not exceed the predetermined amount, when the regularizing unit 44 is not provided, the ADC 46 converts the result of sensing received from the sensing unit 42 from an analog form into a digital form in response to the result of comparison received from the first comparator 52 and outputs the result of conversion to the effective signal detection unit 48 in step 14. However, when the regularizing unit 44 is provided, the ADC 46 converts the result of regularization received from the regularizing unit 44 from an analog form into a digital form and outputs the result of conversion to the effective signal detection unit 48. According to an embodiment of the present invention, the ADC 46 converts the result of sensing from an analog form into a digital form only when it is recognized that the sensed motion amount does not exceed the predetermined amount based on the result of comparison received from the first comparator 52. However, according to another embodiment of the present invention, unlike FIG. 2, the ADC 46 can convert the result of sensing in an analog form into a digital form regardless of the result of comparison performed by the first comparator 52. In this case, the effective signal detection unit 48 receiving the result of comparison performed by the first comparator 52 determines whether the result of conversion output from the ADC 46 is used for generating an effective signal.
  • In addition, according to the present invention, step 14 and the ADC 46 can be selectively provided. In other words, when the result of sensing performed by the sensing unit 42 has an analog form and the effective signal detection unit 48 detects an effective signal in a digital form, the ADC 46 is provided. However, when the result of sensing performed by the sensing unit 42 has a digital form, the ADC 46 is not provided.
  • According to the present invention, unlike FIG. 1, step 14 can be provided between step 10 and step 12. For example, after step 10, the result of sensing is converted from an analog form into a digital form, and the procedure goes to step 12. For this, unlike FIG. 2, the ADC 46 is provided between the sensing unit 42 and the regularizing unit 44, so the result of sensing is converted from an analog form into a digital form either in response to the result of comparison performed by the first comparator 52 or regardless of the result of comparison performed by the first comparator 52. Here, the regularizing unit 44 regularizes a signal in a digital form resulting from the conversion performed by the ADC 46 and outputs the result of regularizing to the effective signal detection unit 48 and the motion amount detection unit 50.
  • After step 14, it is determined whether the motion sensed by the sensing unit 42 is an effective one, i.e., the intended one for information selection when the user moves the motion unit, in step 16. For this, if it is recognized that the amount of the sensed motion does not exceed the predetermined amount based on the result of comparison received from the first comparator 52, the effective signal detection unit 48 determines whether the motion of the motion unit 40 moved by the user is an effective one based on the result of sensing performed by the sensing unit 42 when the ADC 46 and the regularizing unit 44 are not provided, based on the result of conversion performed by the ADC 46 when the ADC 46 is provided as shown in FIG. 2, based on the result of regularization performed by the regularizing unit 44 when the ADC 46 is provided between the sensing unit 42 and the regularizing unit 44 in FIG. 2, or based on the result of conversion performed by the ADC 46 when the regularizing unit 44 is not provided in FIG. 2.
  • If it is determined that the motion of the motion unit 40 is not an effective one intended for information selection, the effective signal detection unit 48 controls the sensing unit 42 to sense a new motion. In contrast, if it is determined that the motion of the motion unit 40 is an effective one intended for information selection, the effective signal detection unit 48 generates an effective signal indicating that the motion of the motion unit 40 is an effective one and outputs the effective signal to the effective information determination unit 54.
  • For clarity of the present invention, on the assumption that the regularizing unit 44 and the ADC 46 are not provided, a preferred embodiment of step 16 shown in FIG. 1 and the structure and operations of a preferred embodiment of the effective signal detection unit 48 shown in FIG. 2 will be described with reference to the attached drawings. Even if the regularizing unit 44 and/or the ADC 46 are provided, descriptions of the embodiments will be the same as in the case where the regularizing unit 44 and the ADC 46 are not provided, with the exception that not the result of sensing but the result of regularization or a signal in a digital form is input to the effective signal detection unit 48.
  • FIG. 3 is a flowchart of a preferred embodiment 16A of step 16 of FIG. 1 according to the present invention. The embodiment 16A of step 16 includes determining the sensed motion as an effective motion according to a feature amount detected from the result of sensing and a period for which the detected feature amount is maintained in steps 70 through 76.
  • FIG. 4 is a block diagram of a preferred embodiment 48A of the effective signal detection unit 48 of FIG. 2 according to the present invention. The preferred embodiment 48A of the effective signal detection unit 48 includes a feature amount detector 90, a regularizing unit 92, a second comparator 94, a first counter 96, a third comparator 98, an effective signal generator 100, and a fourth comparator 102.
  • The feature amount detector 90 of FIG. 4 extracts a portion having a change in size from the result of sensing received through an input terminal IN2 as a feature amount and outputs the extracted feature amount in step 70. If there is no motion of the motion unit 40, the result of sensing has only a direct current component, so there is no portion having a change in the size of the result of sensing.
  • If only one motion is always sensed by the sensing unit 42 of FIG. 2, the regularizing unit 92 may not be provided. However, if a plurality of motions are sensed by the sensing unit 42, the regularizing unit 92 is provided as a substitute for the regularizing unit 44 of FIG. 2. In other words, only one of the regularizing units 44 and 92 can be selectively provided. The regularizing unit 92 regularizes the portion having a change in size, which has been extracted by the feature amount detector 90 in step 70, and outputs the result of regularization to the second comparator 94. The functions and operations of the regularizing units 44 and 92 shown in FIGS. 2 and 4, respectively, will be described in detail.
  • The regularizing unit 44 or 92 regularizes input data and can be realized as a multiplier (not shown) for multiplying the received sensing result by a weight and outputting the multiplication result as the result of regularization. For example, when it is assumed that the motion unit 40 is provided at each of a thumb, index finger, middle finger, ring finger, and little finger, a different amount of a motion is generated when clicking each finger, so the result of sensing is regularized to detect only the component having a change in size from the result of sensing as a feature amount. For this, a weight multiplied by the result of sensing the motion of the thumb is set to be larger than a weight multiplied by the result of sensing the motion of a finger other than the thumb, for example, the little finger. As described above, weights can be empirically determined in advance as having different values according to the motion degree of the motion unit 40. For example, the results of sensing the motions generated when clicking the thumb, index finger, middle finger, ring finger, and little finger, respectively, are examined in advance, and the results of examinations are analyzed to set different weights for different fingers.
  • Alternatively, according to the present invention, different weights can be set depending on an angle at which each finger is bent regardless of the kind of finger. For example, all angles at which the thumb, index finger, middle finger, ring finger, and little finger can be bent are examined, and the results of examinations are analyzed to set different weights for different angles.
  • Meanwhile, the structures and operations of embodiments of the feature amount detector 90 shown in FIG. 4 will be described with reference to the attached drawings.
  • FIG. 5 is a block diagram of a first embodiment 90A of the feature amount detector 90 of FIG. 4 according to the present invention. The first embodiment 90A of the feature amount detector 90 includes a low-pass filter 120, a high-pass filter 122, and a signal extractor 124.
  • FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector 90A of FIG. 5. FIG. 6A is a waveform diagram of a signal input to the low-pass filter 120. FIG. 6B is a waveform diagram of a signal output from the low-pass filter 120. FIG. 6C is a waveform diagram of a signal output from the high-pass filter 122.
  • According to this embodiment of the present invention, a band pass filter 126 of the feature amount detector 90A band-pass filters the result of sensing received through an input terminal IN3, as shown in FIG. 6A, and outputs the result of band-pass filtering as a feature amount to the signal extractor 124. For this, as shown in FIG. 5, the band pass filter 126 can include the low-pass filter 120 and the high-pass filter 122. The low-pass filter 120 low-pass filters the result of sensing, which is shown in FIG. 6A and input through the input terminal IN3, and outputs the result of low-pass filtering shown in FIG. 6B to the high-pass filter 122. The high-pass filter 122 high-pass filters the result of low-pass filtering shown in FIG. 6B and outputs the result of high-pass filtering shown in FIG. 6C as a portion having a change in size of the result of sensing to the signal extractor 124. The signal extractor 124 extracts only the positive or negative component from the portion having a change in size shown in FIG. 6C, which is output from the high-pass filter 122, as a feature amount and outputs the extracted feature amount through an output terminal OUT6.
  • FIG. 7 is a block diagram of a second embodiment 90B of the feature amount detector 90 of FIG. 4 according to the present invention. The second embodiment 90B of the feature amount detector 90 includes first and second filters 140 and 142, a differential calculator 144, and a signal extractor 146.
  • According to this embodiment, the first filter 140 of the feature amount detector 90B filters a first frequency component of the result of sensing input through an input terminal IN4 and outputs the result of filtering to the differential calculator 144. The second filter 142 filters a second frequency component of the result of sensing input through the input terminal IN4 and outputs the result of filtering to the differential calculator 144. The differential calculator 144 calculates the difference between the result of filtering of the first filter 140 and the result of filtering of the second filter 142 and outputs the calculated difference to the signal extractor 146.
  • According to the present invention, each of the first and second frequency components filtered by the first and second filters 140 and 142, respectively, may be a low-band component, a high-band component, or just a band component. The first and second frequency components may be a low-band component and a high-band component, respectively, a low-band component and a band component, respectively, or a high-band component and a band component, respectively. For clarity of the present invention, when it is assumed that the first and second frequency components are low-band components, that the cut-off frequency fc1 of the first filter 140 is 10 Hz, and that the cut-off frequency fc2 of the second filter 142 is 4 Hz, the feature amount detector 90B of FIG. 7 generates a portion having a change in the size of the result of sensing as follows.
  • FIGS. 8A through 8D are waveform diagrams of the respective parts of FIG. 7. FIG. 8A is a waveform diagram of the result of sensing input to the first and second filters 140 and 142. FIG. 8B is a waveform diagram of the result of low-pass filtering of the first filter 140. FIG. 8C is a waveform diagram of the result of low-pass filtering of the second filter 142. FIG. 8D is a waveform diagram of a difference component output from the differential calculator 144.
  • The first filter 140 having the cut-off frequency fc1 of 10 Hz low-pass filters the first frequency component of the result of sensing, which is input through the input terminal IN4 and shown in FIG. 8A, and outputs the result of filtering shown in FIG. 8B to the differential calculator 144. The second filter 142 having the cut-off frequency fc2 of 4 Hz low-pass filters the second frequency component of the result of sensing, which is input through the input terminal IN4 and shown in FIG. 8A, and outputs the result of filtering shown in FIG. 8C to the differential calculator 144. The differential calculator 144 calculates the difference between the result of filtering of the first filter 140 shown in FIG. 8B and the result of filtering of the second filter 142 shown in FIG. 8C and outputs the calculated difference shown in FIG. 8D as the portion having a change in size of the result of sensing to the signal extractor 146. The signal extractor 146 extracts only the positive or negative component from the difference received from the differential calculator 144 as a feature amount and outputs the extracted feature amount through an output terminal OUT7.
  • Let us know suppose that the motion unit 40 is attached to the thumb of a glove-shaped member (not shown) and a user wearing the glove-shaped member on his/her hand clicks information by moving his/her thumb to the left or right. Here, since the thumb usually moves to the left and right when the user clicks the thumb, it is necessary to set only one direction effective in clicking. Otherwise, when the thumb is moved for one click, two clicks may be recognized. To recognize an effective motion only, the signal extractor 124 or 146 shown in FIG. 5 or 7 extracts a negative or positive component as a feature amount from the portion having a change in size.
  • FIG. 9 is a block diagram of a first embodiment of the signal extractor 124 or 146 of FIG. 5 or 7 according to the present invention. In this embodiment, the signal extractor 124 or 146 is realized as a first rectifier 160.
  • The first rectifier 160 shown in FIG. 9 rectifies the portion, which has a change in size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN5, or the difference received from the differential calculator 144 through the input terminal IN5 and outputs the result of rectification as the feature amount through an output terminal OUT8. Accordingly, only the portion having a change in size of the result of sensing output from the high-pass filter 122 or only the positive component of the difference output from the differential calculator 144 can be extracted as the feature amount.
  • FIG. 10 is a block diagram of a second embodiment of the signal extractor 124 or 146 of FIG. 5 or 7 according to the present invention. In this embodiment, the signal extractor 124 or 146 includes a first inverter 180, a second rectifier 182, and a second inverter 184.
  • The first inverter 180 shown in FIG. 10 inverts the portion, which has a change in the size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN6, or the difference received from the differential calculator 144 through the input terminal IN6 and outputs the result of inversion to the second rectifier 182. The second rectifier 182 rectifies the result of inversion received from the first inverter 180 and outputs the result of rectification to the second inverter 184. The second inverter 184 inverts the result of rectification received from the second rectifier 182 and outputs the result of inversion as the feature amount through an output terminal OUT9. Accordingly, only the size-changed portion of the result of sensing output from the high-pass filter 122 or only the negative component of the difference output from the differential calculator 144 can be extracted as the feature amount.
  • Meanwhile, after step 70 shown in FIG. 3, it is determined whether the feature amount is equal to or greater than a predetermined threshold in step 72. The predetermined threshold is previously set according to the motion range of the motion unit 40 can be moved. For example, when the motion unit 40 is attached to a user's each finger, the amplitudes of feature amounts detected when each finger is clicked are acquired in advance, and the predetermined threshold can be set based on the result of analyzing the acquired amplitudes of the feature amounts, that is, the motion degrees of the fingers.
  • To perform step 72, the second comparator 94 compares the feature amount received from the feature amount detector 90 with the externally received predetermined threshold and outputs the result of comparison to the first counter 96 and to the sensing unit 42 through an output terminal OUT2. If it is determined that the feature amount is less than the predetermined threshold, the procedure goes to step 10. For this, the sensing unit 42 senses a new motion of the motion unit 40 when the feature amount is recognized as being less than the predetermined threshold based on the result of comparison performed by the second comparator 94.
  • FIG. 11 is a waveform diagram showing first and second predetermined periods T1 and T2 for explaining steps 74 and 76 shown in FIG. 3. The vertical axis refers to time, and the horizontal axis refers to amplitude values.
  • Referring to FIG. 11, if it is determined that a feature amount 200 is at least of the same value as the predetermined threshold, it is determined whether the feature amount 200 is maintained to be at least the predetermined threshold during the first predetermined period T1 in step 74. To perform step 74, the effective signal detection unit 48A can be further provided with the first counter 96 and the third comparator 98. The first counter 96 performs a counting operation in response to the result of comparison received from the second comparator 94 and outputs the result of counting to the third comparator 98. For example, the first counter 96 performs a counting operation when recognizing that the feature amount is at least of the same value as the predetermined threshold based on the result of comparison performed by the second comparator 94 and does not perform the counting operation when it is recognized that the feature amount 200 is less than the predetermined threshold. Then, the third comparator 98 compares the result of counting received from the first counter 96 with the first predetermined period T1 externally received and outputs the result of comparison to the effective signal generator 100 and to the sensing unit 42 through an output terminal OUT3.
  • If it is determined that the feature amount 200 is not maintained to be at least the predetermined threshold for the first predetermined period T1, the procedure goes to step 10. For this, the sensing unit 42 senses a new motion of the motion unit 40 if it is determined that the feature amount 200 is not maintained to be at least the predetermined threshold for the first predetermined period T1 based on the resuit of comparison performed by the third comparator 98. This is because a feature amount should be maintained to be at least a predetermined threshold for at least the first predetermined period T1 in order to determine a user's motion as an intentional motion to select information. Otherwise, the user's motion is not determined as an intentional effective motion.
  • In contrast, if it is determined that the feature amount 200 is maintained to be at least the predetermined threshold for the first predetermined period T1, the sensed motion of the motion unit 40 is determined as an effective motion in step 76, and the procedure goes to step 18. Here, the first predetermined period T1 is set to the minimum time taken for the user to move the motion unit 40 to intentionally select information. For performing step 76, the effective signal generator 100 generates an effective signal indicating that the motion of the motion unit 40 is an effective motion in response to the result of comparison received from the third comparator 98 and outputs the effective signal to the effective information determination unit 54 through an output terminal OUT4. Here, if it is determined that the feature amount 200 is maintained to be at least the predetermined threshold for the first predetermined period T1 based on the result of comparison of the third comparator 98, the sensing unit 42 may not sense a new motion of the motion unit 40 or may not output the result of sensing.
  • Step 74 may be selectively provided. Accordingly, the first counter 96 and the third comparator 98 of FIG. 4 may also be selectively provided. In this case, the effective signal generator 100 generates an effective signal in response to the result of comparison received from the second comparator 94. For example, the effective signal generator 100 generates an effective signal if it is determined that the feature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison received from the second comparator 94 and does not generate an effective signal if it is determined that the feature amount 200 is less than the predetermined threshold.
  • Meanwhile, according to the present invention, when it is determined whether the sensed motion is effective in step 16, the result of sensing obtained for a period other than the first predetermined period T1 in the second predetermined period T2 of FIG. 11 is not used because undesirable cross-talk or noise may occur when the user selects information. For example, when the user having the motion unit 40 attached to each finger moves the middle finger in order to input desired information, the ring finger may be moved together, which causes cross-talk occurrence. To prevent such cross-talk from occurring, the effective signal detection unit 48A can be provided with the fourth comparator 102. The fourth comparator 102 compares the result of counting received from the first counter 96 with the second predetermined period T2 received externally and outputs the result of comparison to the effective signal generator 100 and to the sensing unit 42 through an output terminal OUT5. Then, the effective signal generator 100 generates an effective signal in response to the result of comparison received from the fourth comparator 102. For example, if it is recognized that the second predetermined period T2 has not elapsed since the first predetermined period T1 elapsed, based on the result of comparison performed by the fourth comparator 102, the effective signal generator 100 does not generate a new effective signal even if it is recognized that the feature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison of the second comparator 94. According to the present invention, if it is recognized that a current time is in the period other than the first predetermined period T1 in the second predetermined period T2 based on the result of comparison performed by the fourth comparator 102, the sensing unit 42 may not sense a new motion of the motion unit 40 or may not output the result of sensing. This is for preventing the sensing unit 42 from unnecessarily performing a sensing operation during the period other than the first predetermined period T1 in the second predetermined period T2. According to the present invention, the second predetermined period T2 is set according to a time period for which the motion unit 40 may be unnecessarily moved when the user selects information. Alternatively, the second predetermined period T2 may be set to be different depending on the type of motion unit 40. For example, when it is assumed that the motion unit 40 is attached to each finger of the user's hands and a clicking motion is performed by moving the thumb, the second predetermined period T2 is set to be longer than it is set on the assumption that the clicking operation is performed by moving a finger other than the thumb, in order to prevent two feature amounts from being detected. Here, since the thumb is moved two times to the left and right for the clicking motion unlike the other fingers, two feature amounts may be detected. According to the present invention, the fourth comparator 102 shown in FIG. 4 can be selectively provided. In this case, the effective signal generator 100 generates an effective signal in response to only the result of comparison received from the third comparator 98 regardless of whether the second predetermined period T2 has elapsed.
  • The effective information determination unit 54 of FIG. 2 determines the information received through an input terminal IN1 as effective information in response to the effective signal received from the effective signal detection unit 48 and outputs the effective information through an output terminal OUT1 in step 18. For example, if it is recognized that the motion of the motion unit 40 is an effective motion based on the effective signal, the effective information determination unit 54 determines the information, which is selected by the effective motion and received through the input terminal IN1, as effective information and outputs the determined information through the output terminal OUT1. However, if it is recognized that the motion of the motion unit 40 is not an effective motion based on the effective signal, the effective information determination unit 54 determines the information, which is selected by the motion of the motion unit 40 and received through the input terminal IN1, as ineffective information.
  • For example, the effective information determination unit 54 shown in FIG. 2 may be applied as an information selection unit which is disclosed in the Korean Patent Application No. 2001-41560 mentioned above. In such an application, the effective information determination unit 54 establishes a one-dimensional position of an information screen from a first and/or second displacement and an angle, determines the information, which is located at the established one-dimensional position and received through the input terminal IN1, as effective information selected by the user in response to the effective signal received from the effective signal detection unit 48, and outputs the established effective information through the output terminal OUT1.
  • More specifically, the effective information determination unit 54 acts as an information recognizer disclosed in the Korean Patent Application No. 2001-41560. In other words, the effective information determination unit 54 searches for the information which is mapped to a one-dimensional position designated by a user on the information screen, recognizes the searched information which is received through the input terminal IN1 as effective information which is selected by the user in response to the effective signal received from the effective signal detection unit 48, and outputs the recognized effective information through the output terminal OUT1. Alternatively, the effective information determination unit 54 searches for the information, which is mapped to the horizontal and vertical coordinate values corresponding to a two-dimensional position determined from the horizontal and vertical positions of information designated by the user on the information screen, recognizes the searched information which is received through the input terminal IN1 as effective information which is selected by the user in response to the effective signal received from the effective signal detection unit 48, and outputs the recognized effective information through the output terminal OUT1.
  • Meanwhile, at least two effective motions may be detected. For example, when the motion unit 40 is provided at each finger, the clicking motion of a middle finger can be accompanied with the motion of a ring finger and the motion of a little finger. In this case, the unintentional motions of the ring and little fingers must be considered as ineffective motions. Otherwise, the motions of the ring and little fingers may act as cross-talk when it is determined whether the motion of the middle finger is an effective motion.
  • Hereinafter, in the case where at least two effective motions are generated, an information selection method according to the present invention and the structure and operations of an information selection apparatus according to the present invention for performing the above method will be described with reference to the attached drawings.
  • FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining effective information using one motion among a plurality of effective motions in steps 220 through 226.
  • FIG. 13 is a block diagram of an information selection apparatus for performing the method of FIG. 12 according to the present invention. The information selection apparatus includes a first storage unit 240, a second counter 242, a first feature amount selector 244, and an effective information determination unit 246.
  • If it is determined that the motion of the motion unit 40 is an effective motion in step 16 shown in FIG. 1, it is determined whether there are at least two effective motions in step 220. For this, the second counter 242 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN8 and outputs the result of counting to the first feature amount selector 244 and to the effective information determination unit 246.
  • If it is determined that there are at least two effective motions, the largest effective motion is selected from the effective motions in step 224. For this, the first storage unit 240 receives one or more feature amounts corresponding to one or more effective motions from the feature amount detector 90 through an input terminal IN7 and stores the one or more feature amounts. The first feature amount selector 244 selects the biggest feature amount from the feature amounts stored in the first storage unit 240 in response to the result of counting received from the second counter 242 and outputs the selected feature amount to the effective information determination unit 246. For example, only if it is recognized that there are at least two effective motions based on the result of counting received from the second counter 242, the first feature amount selector 244 performs step 224.
  • The steps 220 and 224 may be performed between steps 16 and 18 shown in FIG. 1. The first storage unit 240, the second counter 242, and the first feature amount selector 244 shown in FIG. 13 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2. In this case, the effective information determination unit 246 acts as the effective information determination unit 54.
  • Here, if it is determined that there are not at least two effective motions based on the result of counting performed by the second counter 242, the effective information determination unit 246 determines the information, which is selected by a single effective motion and received through an input terminal IN9, as effective information and outputs the determined effective information through an output terminal OUT10 in step 222. Alternatively, if it is determined that there are at least two effective motions based on the result of counting performed by the second counter 242, after step 224, the effective information determination unit 246 determines information, which is selected by an effective motion corresponding to the feature amount selected by the first feature amount selector 244 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN9, as the effective information and outputs the determined effective information through the output terminal OUT10 in step 226.
  • FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining the effective information using one motion among a plurality of effective motions, in steps 260 through 266.
  • FIG. 15 is a block diagram of an information selection apparatus for performing the method of FIG. 14 according to the present invention. The information selection apparatus includes a second storage unit 280, a third counter 282, a first time selector 284, and an effective information determination unit 286.
  • If it is determined that the motion of the motion unit 40 is an effective motion in step 16 shown in FIG. 1, it is determined whether there are at least two effective motions in step 260. For this, the third counter 282 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN11 and outputs the result of counting to the first time selector 284 and to the effective information determination unit 286.
  • If it is determined that there are at least two effective motions, a first determined effective motion is selected from the effective motions in step 264, and the procedure goes to step 266.
  • For clarity of step 264, it is assumed that the motion unit 40 is attached to each finger of a user's hands intending to select information, and information is selected by moving one of the user's fingers. Here, at least one finger near to a finger which is intentionally moved may be moved together or following with the intentionally moved finger regardless of the user's intention. Accordingly, in step 264 it is determined which finger is intentionally moved based on the fact that a feature amount generated by the motion of the intentionally moved finger is detected prior to a feature amount generated by the motion of a near finger. To perform step 264, the second storage unit 280 stores points (that is, instants of time) when one or more feature amounts corresponding to one or more effective motions are received from the feature amount detector 90 through an input terminal IN10. The first time selector 284 selects an earliest time from the instants of time stored in the second storage unit 280 in response to the result of counting received from the third counter 282 and outputs the selected time to the effective information determination unit 286. For example, only if it is recognized that there are at least two effective motions based on the result of counting received from the third counter 282, the first time selector 284 performs step 264. Steps 260 and 264 may be performed between steps 16 and 18 shown in FIG. 1. The second storage unit 280, the third counter 282, and the first time selector 284 shown in FIG. 15 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2. In this case, the effective information determination unit 286 acts as the effective information determination unit 54.
  • Here, if it is determined that there are not at least two effective motions based on the result of counting performed by the third counter 282, the effective information determination unit 286 determines the information, which is selected by a single effective motion and received through an input terminal IN12, as effective information and outputs the determined effective information through an output terminal OUT11 in step 262. Alternatively, if it is determined that there are at least two effective motions based on the result of counting performed by the third counter 282, after step 264, the effective information determination unit 286 determines the information, which is selected by the first determined effective motion corresponding to a feature amount generated at the time selected by the first time selector 284 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN12, as the effective information and outputs the determined effective information through the output terminal OUT11 in step 266.
  • FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining the effective information using one motion among a plurality of effective motions, in steps 300 through 310.
  • FIG. 17 is a block diagram of an information selection apparatus for performing the method of FIG. 16 according to the present invention. The information selection apparatus includes a third storage unit 330, a fourth storage unit 332, a fourth counter 334, a fifth comparator 336, a second feature amount selector 338, a second time selector 340, and an effective information determination unit 342.
  • If it is determined that the motion of the motion unit 40 is an effective motion in step 16 shown in FIG. 1, it is determined whether there are at least two effective motions in step 300. For this, the fourth counter 334 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN15 and outputs the result of counting to the fifth comparator 336 and to the effective information determination unit 342.
  • If it is determined that there are at least two effective motions, it is determined whether the effective motions are determined simultaneously in step 304. For this, the fourth storage unit 332 stores instants of time when one or more feature amounts corresponding to one or more effective motions are received from the feature amount detector 90 through an input terminal IN12. The fifth comparator 336 compares the instants of time stored in the fourth storage unit 332 and outputs the result of comparison to the second feature amount selector 338, the second time selector 340, and the effective information determination unit 342. According to the present invention, the fifth comparator 336 may perform a comparison operation in response to the result of counting received from the fourth counter 334. For example, if it is recognized that there are not at least two effective motions based on the result of counting performed by the fourth counter 334, the fifth comparator 336 does not perform the comparison operation.
  • If it is determined that the effective motions are not determined simultaneously, a first determined effective motion is selected from the effective motions in step 306, and the procedure goes to step 310. Like step 264, step 306 is performed based on the fact that a feature amount corresponding to the first determined effective motion is first detected by the feature amount detector 90. To perform step 306, the second time selector 340 selects the earliest instant of time from the instants of time stored in the fourth storage unit 332 in response to the result of comparison received from the fifth comparator 336 and outputs the selected instant of time to the effective information determination unit 342. For example, only if it is recognized that the effective motions are not determined simultaneously based on the result of comparison received from the fifth comparator 336, the second time selector 340 performs step 306.
  • If it is determined that the effective motions are determined simultaneously, the largest effective motion is selected from the effective motions in step 308, and the procedure goes to step 310. For this, the third storage unit 330 receives one or more feature amounts corresponding to one or more effective motions from the feature amount detector 90 through an input terminal IN13 and stores the one or more feature amounts. The second feature amount selector 338 selects a biggest feature amount from among the feature amounts stored in the third storage unit 330 in response to the result of comparison received from the fifth comparator 336 and outputs the selected feature amount to the effective information determination unit 342. For example, only if it is recognized that the effective motions are determined simultaneously based on the result of comparison received from the fifth comparator 336, the second feature amount selector 338 performs step 308.
  • The steps 300 through 308 may be performed between steps 16 and 18 shown in FIG. 1. The third and fourth storage units 330 and 332, the fourth counter 334, the fifth comparator 336, the second feature amount selector 338, and the second time selector 340 shown in FIG. 17 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2. In this case, the effective information determination unit 342 acts as the effective information determination unit 54.
  • Here, if it is determined that there are not at least two effective motions based on the result of counting performed by the fourth counter 334, the effective information determination unit 342 determines the information, which is selected by a single effective motion and received through an input terminal IN16, as effective information and outputs the determined effective information through an output terminal OUT12 in step 302. Alternatively, if it is determined that there are at least two effective motions based on the result of counting performed by the fourth counter 334, after step 306 or 308, the effective information determination unit 342 determines the information, which is selected by the effective motion corresponding to the feature amount selected by the second feature amount selector 338 or the feature amount generated at the instant of time selected by the second time selector 340 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN16, as the effective information in response to the result of comparison received from the fifth comparator 336 and outputs the determined effective information through the output terminal OUT12 in step 310.
  • FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining the effective information using one motion, among a plurality of effective motions, in steps 300, 306 through 310, and 370.
  • FIG. 19 is a block diagram of an information selection apparatus for performing the method of FIG. 18 according to the present invention. The information selection apparatus includes a third storage unit 330, a fourth storage unit 332, a fourth counter 334, a sixth comparator 360, a second feature amount selector 338, a second time selector 340, and an effective information determination unit 342.
  • The information selection method of FIG. 18 is the same as that of FIG. 16 with the exception that, step 370 in FIG. 18 is performed instead of step 304. In addition, the structure and operations of the information selection apparatus shown in FIG. 19 are the same as those of the information selection apparatus shown in FIG. 17 with the exception that the sixth comparator 360 in FIG. 19 is used instead of the fifth comparator 336. Accordingly, in describing FIGS. 18 and 19, repeated portions will be omitted.
  • Unlike the method shown in FIG. 16, in the information selection method shown in FIG. 18, if it is determined that there are at least two effective motions, it is determined in step 370 whether the amounts of the effective motions, that is, the degrees of the effective motions, are the same. If it is determined that the amounts of the effective motions are the same, the procedure goes to step 306. If it is determined that the amounts of the effective motions are not the same, the procedure goes to step 308. For this, the sixth comparator 360 of FIG. 19 compares the feature amounts received from the third storage unit 330 and outputs the result of comparison to the second feature amount selector 338, the second time selector 340, and the effective information determination unit 342. Accordingly, if it is determined that the feature amounts corresponding to the effective motions are the same based on the result of comparison performed by the sixth comparator 360, that is, if it is determined that the degrees of the effective motions are the same, the second time selector 340 performs step 306. In contrast, if it is determined that the feature amounts corresponding to the effective motions are not the same based on the result of comparison performed by the sixth comparator 360, the second feature amount selector 338 performs step 308.
  • According to the present invention, the effective information determination unit 246, 286, or 342 shown in FIG. 13, 15, 17, or 19 may recognize which motion unit 40 among one or more motion units 40 generates the effective motion selected in step 224, 264, 306, or 308. For this, instead of outputting the selected feature amount, the first or second feature amount selector 244 or 338 outputs a unique identification number for identifying the motion unit 40, which generates a motion corresponding to the selected feature amount, to the effective information determination unit 246 or 342. Instead of outputting the selected time, the first or second time selector 284 or 340 outputs the unique identification number of the motion unit 40, which generates a motion corresponding to the feature amount generated at the selected time, to the effective information determination unit 286 or 342. Accordingly, the effective information determination unit 246 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the first feature amount selector 244. Similarly, the effective information determination unit 286 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the first time selector 284. The effective information determination unit 342 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the second feature amount selector 338 or the second time selector 340.
  • The information selection apparatus shown in FIG. 2 may be provided with a separate communication unit (not shown) for converting the format of an effective signal received from the effective signal detection unit 48, converting the signal having the converted format into a wireless signal, and wirelessly transmitting the wireless signal to the effective information determination unit 54.
  • As described above, the motion unit 40 can be attached to a user's predetermined body part. In the case where the predetermined body part is a finger, the sensing unit 42 senses the motion of a finger joint. In the case where the predetermined body part is a hand, the sensing unit 42 senses the motion of the wrist. In the case where the predetermined body part is a neck, the sensing unit 42 senses the motion of the neck joint. In addition, in the case where the sensing unit 42 senses the motion of a third joint from the end of the finger, an information selection method and apparatus according to the present invention can be used for recognizing whether the clicking motion of a finger such as an index finger, middle finger, ring finger, or little finger is effective, because the third joint of a finger is usually moved when a user clicks a key on a widely known QWERY keyboard.
  • For example, let us assume that a user inputs information in a three-dimensional space by moving a glove-shaped member endowed with the sensing unit 42, and the sensing unit 42 is composed of inertial sensors attached to fingers and the back of a hand. Here, an information selection method according to the present invention can be used for recognizing whether the information pointed at by the motion angle of a finger at its joint is effective or for recognizing whether a finger's clicking motion for determining the input of information pointed at by the finger is effective.
  • Consequently, when a user intends to point or input information by moving the motion unit 40 in a two- or three-dimensional space, an information selection method and apparatus according to the present invention can recognize whether the motion of the motion unit 40 is effective in apparatuses for sensing the motion of the motion unit 40.
  • As described above, considering that a change in the size of the motion sensing result of the motion unit 40 can be large or small when information is selected by slowly or quickly moving the motion unit 40, a method and apparatus for selecting information in a multi-dimensional space according to the present invention detect, as a portion having a change in size, the difference between the results of filtering performed using the first and second filters 140 and 142 having different cut-off frequencies, thereby overcoming difficulty in setting a predetermined threshold to a single value. In addition, even the very slight motion of the motion unit 40 can be accurately detected without being influenced by gravity and offsets which can be provoked by using an inertial sensor as the sensing unit 42. Moreover, the present invention can accurately determine whether a user's two- or three-dimensional motion is an effective motion for selecting information and which motion unit 40, among at least two motion units 40, has generated the effective motion, thereby achieving a high correct recognition rate and high reliability and allowing a user to easily select the desired information.

Claims (22)

1. A method of selecting information in a multi-dimensional space, the method comprising the steps of:
(a) sensing the motion of a user for information selection;
(b) determining, using the amount of the sensed motion, whether the sensed motion is an effective motion of the intended information selection and returning to step (a) if it is determined that the motion is not the effective motion; and
(c) determining whether the amount of the sensed motion exceeds a predetermined amount after step (a) and going to step (b) if it is determined that the amount of the motion does not exceed the predetermined amount.
2. The method of claim 1, further comprising the step of converting the result of sensing from an analog form into a digital one after step (a) and going to step (b), wherein step (b) comprises determining whether the motion is the effective motion based on the result of conversion.
3. The method of claim 1, further comprising the step of (d) if it is determined that the motion is the effective motion in step (b), determining the information selected by the effective motion as effective information.
4. The method of claim 1, wherein step (a) comprises visually sensing the motion.
5. The method of claim 1, wherein the motion is a three-dimensional motion.
6. The method of claim 1, wherein the motion is a two-dimensional motion.
7. The method of claim 1, wherein the information selection implies pointing the information.
8. The method of claim 1, wherein the information selection denotes inputting the information.
9. An apparatus for selecting information in a multi-dimensional space, the apparatus comprising:
at least one motion unit moved by a user intending to select information;
at least one sensing unit for sensing the motion of the motion unit and outputting the result of sensing;
at least one effective signal detection unit for checking whether the motion of the motion unit is an effective motion intending to select the information based on the result of sensing and outputting the result of checking as an effective signal;
a motion amount detection unit for detecting the amount of the motion from the result of sensing; and
a first comparator for comparing the amount of the motion received from the motion amount detection unit with a predetermined amount and outputting the result of comparison,
wherein the effective signal detection unit checks whether the motion of the motion unit is the effective motion in response to the result of comparison performed the first comparator.
10. The apparatus of claim 9, further comprising an analog-to-digital converter for converting the sensing result from an analog form into a digital form and outputting the result of conversion to the effective signal detection unit,
wherein the effective signal detection unit checks whether the motion of the motion unit is the effective motion based on the result of conversion.
11. The apparatus of claim 10, wherein the analog-to-digital converter converts the result of sensing from the analog form into the digital form in response to the result of comparison performed by the first comparator.
12. The apparatus of claim 9, further comprising an effective information determination unit for determining information selected by the motion as effective information in response to the effective signal received from the effective signal detection unit.
13. The apparatus of claim 9, wherein the sensing unit visually senses the motion of the motion unit.
14. The apparatus of claim 9, wherein the motion unit is moved by the user in a three-dimensional space.
15. The apparatus of claim 9, wherein the motion unit is moved by the user in a two-dimensional space.
16. The apparatus of claim 9, wherein the selection of the information implies pointing the information.
17. The apparatus of claim 9, wherein the selection of the information denotes inputting the information.
18. The apparatus of claim 9, wherein the motion unit is attached to a predetermined body part of the user and moved by the user.
19. The apparatus of claim 9, wherein the user points the information by moving the motion unit.
20. The apparatus of claim 9, wherein the user determines input of the information by moving the motion unit.
21. The apparatus of claim 18, wherein the predetermined body part is at least one hand.
22. The apparatus of claim 21, wherein the motion corresponds to a third joint of a finger.
US11/697,670 2001-07-24 2007-04-06 Method and apparatus for selecting information in multi-dimensional space Abandoned US20070273642A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/697,670 US20070273642A1 (en) 2001-07-24 2007-04-06 Method and apparatus for selecting information in multi-dimensional space

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
KR10-2001-0044588A KR100446612B1 (en) 2001-07-24 2001-07-24 Method and apparatus for selecting information in multi-dimensional space
KR2001-44588 2001-07-24
US10/484,505 US7259756B2 (en) 2001-07-24 2002-07-22 Method and apparatus for selecting information in multi-dimensional space
PCT/KR2002/001369 WO2003010652A1 (en) 2001-07-24 2002-07-22 Method and apparatus for selecting information in multi-dimensional space
US11/697,670 US20070273642A1 (en) 2001-07-24 2007-04-06 Method and apparatus for selecting information in multi-dimensional space

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US10/484,505 Continuation US7259756B2 (en) 2001-07-24 2002-07-22 Method and apparatus for selecting information in multi-dimensional space
PCT/KR2002/001369 Continuation WO2003010652A1 (en) 2001-07-24 2002-07-22 Method and apparatus for selecting information in multi-dimensional space

Publications (1)

Publication Number Publication Date
US20070273642A1 true US20070273642A1 (en) 2007-11-29

Family

ID=19712483

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/484,505 Expired - Fee Related US7259756B2 (en) 2001-07-24 2002-07-22 Method and apparatus for selecting information in multi-dimensional space
US11/697,670 Abandoned US20070273642A1 (en) 2001-07-24 2007-04-06 Method and apparatus for selecting information in multi-dimensional space

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/484,505 Expired - Fee Related US7259756B2 (en) 2001-07-24 2002-07-22 Method and apparatus for selecting information in multi-dimensional space

Country Status (5)

Country Link
US (2) US7259756B2 (en)
JP (1) JP2004537055A (en)
KR (1) KR100446612B1 (en)
CN (1) CN1554044B (en)
WO (1) WO2003010652A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150084849A1 (en) * 2013-09-23 2015-03-26 Hyundai Motor Company Vehicle operation device
US20150219474A1 (en) * 2014-01-31 2015-08-06 Microchip Technology Incorporated Digital period divider
US11829531B2 (en) * 2021-09-13 2023-11-28 Htc Corporation Human-computer interaction method and system and non-transitory computer readable storage medium

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6834249B2 (en) 2001-03-29 2004-12-21 Arraycomm, Inc. Method and apparatus for controlling a computing system
US7184020B2 (en) * 2002-10-30 2007-02-27 Matsushita Electric Industrial Co., Ltd. Operation instructing device, operation instructing method, and operation instructing program
KR100501721B1 (en) * 2003-03-19 2005-07-18 삼성전자주식회사 Pen-shaped input device using magnetic sensor and method thereof
KR100543710B1 (en) * 2004-02-25 2006-01-20 삼성전자주식회사 Spatial information input apparatus and method for recognizing an information-completion signal from a plurality of concurrent spatial motions
JP4410051B2 (en) * 2004-07-22 2010-02-03 本田技研工業株式会社 Angular velocity measuring device and legged mobile robot
NL1026945C2 (en) * 2004-09-01 2006-03-02 Access Engineering Method and device for controlling a pointer on a computer screen by spatial movements such as head movements.
US7539513B2 (en) * 2005-02-02 2009-05-26 National Telephone Products, Inc. Portable phone with ergonomic image projection system
KR100537279B1 (en) * 2005-05-12 2005-12-16 삼성전자주식회사 Portable terminal with motion detecting function and method of motion detecting thereof
KR100651368B1 (en) * 2005-09-15 2006-11-29 삼성전자주식회사 Method for controlling image according to movement of wireless terminal
TWI348639B (en) * 2005-12-16 2011-09-11 Ind Tech Res Inst Motion recognition system and method for controlling electronic device
US7903092B2 (en) * 2006-05-25 2011-03-08 Atmel Corporation Capacitive keyboard with position dependent reduced keying ambiguity
US8786554B2 (en) * 2006-07-10 2014-07-22 Atmel Corporation Priority and combination suppression techniques (PST/CST) for a capacitive keyboard
US20090146953A1 (en) * 2006-10-30 2009-06-11 Imu Solutions, Inc. Methods for processing data from accelerometer in anticipating real-time cursor control movements
EP2083276B1 (en) * 2008-01-22 2014-10-29 STMicroelectronics Srl Method and device for detecting anomalous events for an electronic apparatus, in particular a portable apparatus
TWI396967B (en) * 2008-05-16 2013-05-21 Htc Corp Signal filtering method and electronic device and readable recording medium using the same
US8508498B2 (en) * 2009-04-27 2013-08-13 Empire Technology Development Llc Direction and force sensing input device
US20100289743A1 (en) * 2009-05-15 2010-11-18 AFA Micro Co. Laser pointer and gesture-based input device
US8482678B2 (en) * 2009-09-10 2013-07-09 AFA Micro Co. Remote control and gesture-based input device
US8717291B2 (en) * 2009-10-07 2014-05-06 AFA Micro Co. Motion sensitive gesture device
US8494544B2 (en) * 2009-12-03 2013-07-23 Osocad Remote Limited Liability Company Method, apparatus and computer program to perform location specific information retrieval using a gesture-controlled handheld mobile device
KR101795574B1 (en) 2011-01-06 2017-11-13 삼성전자주식회사 Electronic device controled by a motion, and control method thereof
KR101858531B1 (en) 2011-01-06 2018-05-17 삼성전자주식회사 Display apparatus controled by a motion, and motion control method thereof
ES2693060T3 (en) * 2011-03-17 2018-12-07 Ssi Schäfer Automation Gmbh Control and supervision of a warehouse installation and order preparation through movement and voice
CN103164049A (en) * 2011-12-09 2013-06-19 捷达世软件(深圳)有限公司 Swing identification control system and method of handheld action electronic device
US9891718B2 (en) * 2015-04-22 2018-02-13 Medibotics Llc Devices for measuring finger motion and recognizing hand gestures
US20140085177A1 (en) * 2012-09-21 2014-03-27 Nokia Corporation Method and apparatus for responding to input based upon relative finger position
JP2014151149A (en) * 2013-02-14 2014-08-25 Seiko Epson Corp Motion analysis apparatus and motion analysis method
KR101550604B1 (en) 2013-09-25 2015-09-07 현대자동차 주식회사 Vehicle operation device
CN105843429A (en) * 2015-01-14 2016-08-10 深圳市华星光电技术有限公司 Floating touch method
TWI621968B (en) * 2016-02-05 2018-04-21 財團法人工業技術研究院 Method for controlling electronic equipment and wearable device
US20170249561A1 (en) * 2016-02-29 2017-08-31 GM Global Technology Operations LLC Robot learning via human-demonstration of tasks with force and position objectives
US11314409B2 (en) 2018-12-03 2022-04-26 Microsoft Technology Licensing, Llc Modeless augmentations to a virtual trackpad on a multiple screen computing device
US11294463B2 (en) 2018-12-03 2022-04-05 Microsoft Technology Licensing, Llc Augmenting the functionality of user input devices using a digital glove
US11199901B2 (en) * 2018-12-03 2021-12-14 Microsoft Technology Licensing, Llc Augmenting the functionality of non-digital objects using a digital glove
US10564719B1 (en) 2018-12-03 2020-02-18 Microsoft Technology Licensing, Llc Augmenting the functionality of user input devices using a digital glove
US11137905B2 (en) 2018-12-03 2021-10-05 Microsoft Technology Licensing, Llc Modeless augmentations to a virtual trackpad on a multiple screen computing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5146566A (en) * 1991-05-29 1992-09-08 Ibm Corporation Input/output system for computer user interface using magnetic levitation
US5982352A (en) * 1992-09-18 1999-11-09 Pryor; Timothy R. Method for providing human input to a computer
US6346929B1 (en) * 1994-04-22 2002-02-12 Canon Kabushiki Kaisha Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process
US6529130B2 (en) * 2001-02-16 2003-03-04 General Phosphorix Llc System for detecting intruders

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04137027A (en) * 1990-09-28 1992-05-12 Ezel Inc Input device for computer
JPH08272520A (en) * 1995-03-29 1996-10-18 Asako Hanno Glove instruction call-originating equipment
JP3777650B2 (en) * 1995-04-28 2006-05-24 松下電器産業株式会社 Interface equipment
JPH0944297A (en) * 1995-07-25 1997-02-14 Canon Inc Data inputting method and device
JPH0981309A (en) * 1995-09-13 1997-03-28 Toshiba Corp Input device
JP3272960B2 (en) * 1996-08-19 2002-04-08 株式会社データ・テック Driving recorder and vehicle operation analyzer
KR100221335B1 (en) * 1996-12-26 1999-09-15 전주범 Transmission system of glove sensor value in a virtual reality system and method thereof
KR19980053567A (en) * 1996-12-27 1998-09-25 배순훈 Digital Glove Sensor
KR100244523B1 (en) * 1997-05-02 2000-02-01 정선종 Real-time interfacing for virtual environment
JPH11338614A (en) * 1998-05-27 1999-12-10 Noritz Corp Operation input device
CN1105347C (en) * 1998-07-08 2003-04-09 大腾电子企业股份有限公司 Computer input pointer device
JP2000181601A (en) * 1998-12-18 2000-06-30 Fujitsu General Ltd Information display system
CN2396443Y (en) * 1999-10-15 2000-09-13 曾信得 Single-hole multi-roller signal input device
KR100682579B1 (en) * 2000-05-04 2007-02-15 (주)태민메카트로닉스 Pointing device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5146566A (en) * 1991-05-29 1992-09-08 Ibm Corporation Input/output system for computer user interface using magnetic levitation
US5982352A (en) * 1992-09-18 1999-11-09 Pryor; Timothy R. Method for providing human input to a computer
US6346929B1 (en) * 1994-04-22 2002-02-12 Canon Kabushiki Kaisha Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process
US6529130B2 (en) * 2001-02-16 2003-03-04 General Phosphorix Llc System for detecting intruders

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150084849A1 (en) * 2013-09-23 2015-03-26 Hyundai Motor Company Vehicle operation device
US20150219474A1 (en) * 2014-01-31 2015-08-06 Microchip Technology Incorporated Digital period divider
US10048089B2 (en) * 2014-01-31 2018-08-14 Microchip Technology Incorporated Digital period divider
US11829531B2 (en) * 2021-09-13 2023-11-28 Htc Corporation Human-computer interaction method and system and non-transitory computer readable storage medium

Also Published As

Publication number Publication date
KR100446612B1 (en) 2004-09-04
CN1554044A (en) 2004-12-08
US7259756B2 (en) 2007-08-21
KR20030009918A (en) 2003-02-05
WO2003010652B1 (en) 2004-04-08
WO2003010652A1 (en) 2003-02-06
US20040169636A1 (en) 2004-09-02
CN1554044B (en) 2012-07-04
JP2004537055A (en) 2004-12-09

Similar Documents

Publication Publication Date Title
US7259756B2 (en) Method and apparatus for selecting information in multi-dimensional space
CN105824431B (en) Message input device and method
EP0666544B1 (en) Gesture input method and apparatus
EP1810217B1 (en) Automated gesture recognition
CN108196668B (en) Portable gesture recognition system and method
KR100674090B1 (en) System for Wearable General-Purpose 3-Dimensional Input
US7427979B2 (en) Pointing apparatus and method
KR100630806B1 (en) Command input method using motion recognition device
KR101234111B1 (en) Apparatus for contact-free input interfacing and contact-free input interfacing method using the same
US20030132950A1 (en) Detecting, classifying, and interpreting input events based on stimuli in multiple sensory domains
US9619024B2 (en) Virtual input device and virtual input method
WO2010084498A1 (en) Device and method for monitoring an object's behavior
KR100777107B1 (en) apparatus and method for handwriting recognition using acceleration sensor
KR20030008066A (en) Information input method using wearable information input device
JP2002278673A (en) System for inputting information using bio-feedback and method for the same
US10048768B2 (en) Systems and methods for determining input movement
KR101553484B1 (en) Apparatus for detecting hand motion and method thereof
CN111580660A (en) Operation triggering method, device, equipment and readable storage medium
JP3678388B2 (en) Pen-type input device and pattern recognition method for pen-type input device
Yamagishi et al. A system for controlling personal computers by hand gestures using a wireless sensor device
KR100480770B1 (en) Method for pointing information in three-dimensional space
CN106155277B (en) Electronic equipment and information processing method
CN117055738B (en) Gesture recognition method, wearable device and storage medium
KR101805111B1 (en) Input interface apparatus by gripping and the method thereof
Hein et al. Gesture spotting for controlling a mobile assistance system for service and maintenance

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION