CN100479029C - Systems and methods for interfacing with computer devices - Google Patents

Abstract

The present invention provides a systems, methods, and products for enhanced user navigation to compliment (but not necessarily replace) a computer keyboard and mouse by providing a robust navigation interface. The present invention may comprise: a minimally necessary group of commands; combining the functionality a set of at least two command calls into a single logical button; for a single button, prioritizing a set of command calls from first to last and then calling each until one is accepted; logically remapping commands to buttons for a navigational device coupled to a physically rotate-able display device; and mapping a substitute command to a logical button for when the button is engaged in a predetermined manner other than the primary manner in which the logical button is engaged (e.g., double-clicking, flicking, press-and-hold, etc.) so that a substitute command can in fact be issued, among others.

Description

System and method with the computer installation interface

Cross

The application requires to be numbered 60/433.914, title is the right of priority of the U.S. Provisional Application case of " with the system and method for computer installation interface ", its filling time is on Dec 16th, 2002 (agent certificate number for MSFT-1643), this with it in full as with reference to quoting.

According to theme, below the application relates to above-mentioned provisional application is also required the invention that application exposed to the open air of generally appointing of right of priority, the application of generally appointing refers to: be numbered. (also specifying) (agent certificate number be MSFT-1819), that file, that be entitled as " with the system and method for computer installation interface " on the same day U.S. Patent application therewith; Be numbered. (also specify) (agent certificate number be MSFT-1820), that file, that be entitled as " with the system and method for computer installation interface " on the same day U.S. Patent application therewith; Be numbered. (also specify) (agent certificate number be MSFT-1822), that file, that be entitled as " with the system and method for computer installation interface " on the same day U.S. Patent application therewith; Be numbered. (also specify) (agent certificate number be MSFT-1823), that file, that be entitled as " with the system and method for computer installation interface " on the same day U.S. Patent application therewith.

FIELD OF THE INVENTION

The present invention relates generally to the field of user interface, more specifically, the present invention relates to be used to the user interface that navigates in computer environment.But, the invention is not restricted to use on computers.On the contrary, the present invention can be used for various daily devices or in other such systems of this use various embodiments of the invention that expose to the open air.

The background of invention

For a long time, computer industry concentrates on so for a long time and uses navigation keys, roller and button screen---so that in fact need order button, mouse and some screen interfaces of full-scale keyboard, application-specific to come together to support employed various navigation mode today.But this guider is not suitable for computerized technology---as the Tablet PC (dull and stereotyped PC) that just seeks to become the kneetop computer succession---keyboard, mouse or other conventional device new, innovation or these new developing technology of navigation are not supported in combination comprehensively or fully.In brief, computer industry does not also fully solve in this field the obvious demand for simpler navigation mode, to replenish or to replace existing other model.

The summary of invention

The object of the present invention is to provide user's navigation interface, it is suitable for computing system environments in various embodiments very much, yet the invention is not restricted to use in computing machine.The invention provides the system and method for the user navigation of enhancing, by providing more healthy and stronger but replenish (needn't replace) computer keyboard and mouse not as single user's navigation interface of keyboard complexity than mouse.In numerous embodiment, estimate that the present invention will be used as the only device (as mouse) of need one-handed performance, but it have so far a large amount of functions that can only directly call by computer keyboard.

Disclose in certain embodiments of the present invention, user interface system comprises the interface of the logic input that the user can be produced be used for an order of command group that will be applied to object, and the grouping of described order comprises the command packet that bottom line is required.In an alternative embodiment, the required command packet of bottom line comprises four user commands of user interface system, as ENTER, and UP, DOWN and OUT.In other embodiments, some order can be realized by the change operation of roller or " dog bone " type device (after this introducing).

Other embodiments of the invention expose the method that is used for one group of function that has two command calls (including but not limited to keyboard) at least is attached to single logical button to the open air, in certain embodiments, the priority of calling by arranging order from the beginning to the end, order according to priority then, the shell hook of use operating system carries out application command to all orders except last and calls, up to one of them order quilt " acceptance " (is identified or carries out), if perhaps the order of all except last is issued the order of last order as operating system so all by " refusal " (unrecognized).For example, though in some standby embodiment, OUT can equal Back or Escape command calls, and the important combination of using in numerous other embodiments of the invention is that Back and Escape command calls are merged in the OUT order.In numerous embodiment, by using the issue an order of operating system shell hook as the program command of giving application program, if and application command is rejected, issuing the method for this cascade order of the different command of directly giving operating system, is the key of successful function in the simple relatively singlehanded guider.Other embodiment uses other strategy that the core commands function that is provided by a limited number of logical button is provided.

In each cascade embodiment, some cascade combination is particularly useful to numerous embodiment of the present invention.Some cascade event by its logical button name and corresponding cascade order (from the high priority order progressively to the low priority order) expression are as follows:

UP (on): APPCOMMAND_UP-＞UP Arrow (arrow)-＞Scroll up (scrolling up)-＞PageUp (going up page or leaf)

DOWN (descending): APPCOMMAND_DOWN-＞DOWN Arrow (arrow)-＞Scroll DOWN (rolling downwards)-＞Page DOWN (nextpage)

NEXT (next one): APPCOMMAND_NEXT-＞Tab-＞Right Arrow (right arrow)

PREV:APPCOMMAND_PREV-＞Shift-Tab-＞Left Arrow (left arrow)

ENTER:APPCOMMAND_ENTER-＞Return (returning)-＞Enter (carriage return)-＞" play " (" broadcast ")

OUT:APPCOMMAND_OUT-＞Browser Back (browsing rollback)-＞Escape (withdrawing from)-＞" Stop " (" stopping ")-＞Alt-F4

SWITCH:APPCOMMAND_SWITCH-＞Alt-Escape-＞Alt-Tab-＞Windows button-＞Home

MENU:APPCOMMAND_MENU-＞Shift-F10-＞" setting " (" setting ")

In this used " broadcast " and " stopping " is the special command that is used for such as concrete context environmentals such as media applications, and " setting " also is the special command that is used at concrete context environmental setup menu or the like.

Other alternative exposes method and system, by at first determining the direction of display device, direction according to display device is mapped to logical button with the command logic replay then, but the replay of command logic ground is mapped to the button of the guider of the display device that is used to be connected to the physics rotation.In certain embodiments, suppose and if the display on the display device has changed to different directions, order the logical mappings of logical button to take place automatically so in order to mate the variation of display device physical direction.In other embodiments, the direction of determining display is the direction according to display device self display.In some special embodiment, navigation interface is asymmetricly perpendicular to horizontal line, and logic remaps to use corresponding to predetermined way with terminal user's logic, will order replay to be mapped to logical button.

System that other alternative exposes and product, by the command mapping of replacing is expanded the function of Navigation Control Unit to logical button, in a predetermined manner rather than the initial mode of logical button when carrying out (for example, double-click, move trippingly, keep by inferior), the replacement order can be issued practically.

The summary of accompanying drawing

In conjunction with the accompanying drawings, when reading, will better understand the front summary and below the detailed description of embodiment.Purpose of the present invention presented for purpose of illustration, schematic configuration of the present invention shown in the accompanying drawing; But, concrete grammar shown in the invention is not restricted to and means.In the accompanying drawings:

Fig. 1 is a figure, the computer system that expression wherein can some aspects of integrated the present invention

Fig. 2 is a synoptic diagram, the network that expression wherein can some aspects of integrated the present invention.

Fig. 3 A is a process flow diagram, describes in certain embodiments of the present invention the logic of ENTER button.

Fig. 3 B is a process flow diagram, has described in certain embodiments of the present invention the variation in the ENTER button logic.

Fig. 4 A is a process flow diagram, describes in certain embodiments of the present invention the logic of UP button.

Fig. 4 B is a process flow diagram, describes in certain embodiments of the present invention the variation in the UP button logic.

Fig. 5 A is a process flow diagram, describes in certain embodiments of the present invention the logic of DOWN button.

Fig. 5 B is a process flow diagram, describes in certain embodiments of the present invention the variation in the DOWN button logic.

Fig. 6 A is a process flow diagram, describes in certain embodiments of the present invention the logic of OUT button method.

Fig. 6 B is a process flow diagram, describes in certain embodiments of the present invention, for the more complicated logic of OUT button method.

Fig. 7 A illustrates in certain embodiments of the present invention, the arrangement of four buttons.

Fig. 7 B illustrates has similar orientation but the of the present invention standby embodiment of four button homeotropic alignments.

Fig. 7 C illustrates horizontal another the standby embodiment of the present invention of button.

Fig. 7 D illustrates the another embodiment of the present invention that button is arranged with the vertical mode of revising,

Fig. 7 E illustrates in certain embodiments of the present invention, the standby arrangement of four buttons.

Fig. 8 A illustrates in certain embodiments of the present invention, the combination of scroll wheel/button.

Fig. 8 B illustrates in certain embodiments of the present invention, the standby layout of scroll wheel/button combination embodiment.

Fig. 8 C illustrates in certain embodiments of the present invention, the standby layout of scroll wheel/button combination embodiment.

Fig. 9 illustrates a striking wheel.

Figure 10 illustrates and waves wheel

Figure 11 A illustrates in certain embodiments of the present invention, the combination of dog bone/button.

Figure 11 B illustrates in certain embodiments of the present invention, the standby layout of dog bone/button embodiment.

Figure 11 C illustrates in certain embodiments of the present invention, the standby layout of dog bone/button embodiment.

Figure 12 illustrates and clicks the dog bone.

Figure 13 illustrates and waves the dog bone

Figure 14 A illustrates and uses super one embodiment of the present of invention of taking turns.

Figure 14 B illustrates an alternative embodiment of the invention of using super dog bone.

Figure 15 A illustrates the device of 9 buttons.

Figure 15 B illustrates the device of 8 buttons.

Figure 15 C is a table, lists the direct command (or logic input) of each button among Figure 15 A.

Figure 16 A illustrates the display device of " right hand is vertical " direction, and its right side is with waving the dog bone.

Figure 16 B illustrates the device of Figure 16 A in the example of quilt after right rotation 90 degree (1/4th) obtain " bottom transverse " direction.

Figure 16 C is that Figure 16 B device is formed the example of " left hand is vertical " again to right rotation 90 degree (be Rotate 180 degree to the right now altogether, or half).

Figure 16 D is that Figure 16 C device is formed the example of " top cross " again to right rotation 90 degree (be to right rotation 270 degree now altogether, or 3/4ths).

Figure 17 is for some embodiment of the present invention, the guider that uses logic rotation scheme to be used for fixing, and the direction that makes logical button depend on them meets concrete order, and these directions are the logical button that accurately are mapped on the various directions about ordering;

Figure 18 A be illustrated in " front end is horizontal " direction top base integrated wave the standby of dog bone.

Figure 18 B illustrates the example of the device of Figure 18 A to right rotation 1/4th.

Figure 18 C illustrates the example of the device of Figure 18 A to right rotation 1/2nd.

Figure 18 D illustrates the example of the device of Figure 18 A to right rotation 3/4ths.

Figure 19 A is illustrated in right hand longitudinal direction (inceptive direction) and has the display device of rotatable guider.

The display device that Figure 19 B illustrates Figure 19 A is by the example to right rotation 90 degree, and from the angle of display device, rotatable guider is kept same absolute direction to anticlockwise 90 degree.

The device that Figure 19 C illustrates Figure 19 B revolves again and turn 90 degrees and guider keeps the example of same absolute direction.

The device that Figure 19 D illustrates Figure 19 C revolves again and turn 90 degrees and guider keeps the example of same absolute direction.

Figure 20 A illustrates four buttons that diamond structure is arranged.

Figure 20 B illustrates four buttons of line spread.

Figure 20 C illustrates the not button of Figure 20 A of tape label.

Figure 20 D illustrates the not button of Figure 20 B of tape label.

Figure 21 A illustrates 8 buttons of the not tape label of arranging with " compass " type.

Figure 21 B illustrates the button of Figure 21 A that has direction label; And

Figure 21 C illustrates the button of Figure 21 A that has the compass label.

The detailed description of example embodiment

Introduce

With the feature description theme to satisfy legal requirement.But, the scope of self not attempting to limit this patent is described.And in order to comprise the combination at different elements of element described in this document or element of being similar in conjunction with current or in the future other technology, the main body that the inventor has imagined request also can be embodied as other mode.

Computing environment

Numerous embodiment of the present invention can carry out on the computing machine of Fig. 1, and following discussion attempts to provide the succinct general description that can realize suitable computing environment of the present invention.Though not necessarily, the present invention will be described in by the general context environment of carrying out such as computing machines such as client workstation or servers such as computer executable instructions such as program modules.Usually, program module comprises routine, program, object, assembly, data structure etc., and they carry out specific work or realize specific abstract data type.And, skilled person in those this areas will understand the present invention and can implement with other computer system configurations, comprise hand-held device, multicomputer system, based on microprocessor or programmable consumer electronics device, network PC, small-size computer, mainframe etc.The present invention also is implemented on distributed computing environment, and its task is carried out by the teleprocessing device that connects by communication network.In distributed computing environment, program module can be arranged in the Local or Remote memory storage device.

As shown in Figure 1, the general-purpose computing system of signal comprises traditional personal computer 20 etc., and it comprises processing unit 21, system storage 22 and is connected various system components, comprises that the connected system storer is to the system bus 23 of handling unit 21.System bus 23 can be the bus structure of any kind, comprises the various bus-structured local bus of rambus or memory controller, peripheral bus and use.System storage comprises ROM (read-only memory) (ROM) 24 and random access storage device (RAM) 25.Basic input/output 26 (BIOS) comprises the elementary instruction that for example helps the information that transmits in start-up course between the element of personal computer 20, is stored among the ROM24.Personal computer 20 can further comprise the hard disk drive 27 that is used for reading writing harddisk, and is not shown, is used to read and write the disc driver 28 and the CD drive 30 that is used to read and write such as removable CDs 31 such as CD ROM or other CD media of moveable magnetic disc 29.Hard disk drive 27, disc driver 28 and CD drive 30 are connected to system bus 23 by hard disk drive interface 32, disk drive interface 33, CD drive interface 34 separately.Driver and relevant computer-readable medium thereof provide the non-volatile memory of computer-readable instruction, data structure, program module and other data to personal computer 20.Though example context described herein is used hard disk, moveable magnetic disc 29 and removable CD 31, but those those skilled in the art are to be understood that in the operating environment of example, also can use the computer-readable medium that to store by other type of the data of computer access, as magnetic tape cassette, flash card, digital video disc, Bernoulli cartridges, random access storage device (RAMs), ROM (read-only memory) (RAMs) etc.

The many program modules that comprise operating system 35, one or more application program 36, other program module 37 and routine data 38 can be stored on hard disk, disk 29, CD 31, ROM 24 or the RAM 25.The user can pass through such as input medias such as keyboard 40 and fixed-point apparatus 42, to PC 20 input commands and information.Other input media (not shown) can comprise microphone, operating rod, game paddle, satellite tv antenna, scanner etc.The input media of these and other often is connected to processing unit 21 by the serial line interface 46 that is connected to system bus, but also can be connected by other interface, as parallel port, game port or USB (universal serial bus) (USB).The display device of monitor 47 or other type also can be by being connected to system bus 23 such as interfaces such as video adapters 48.Except monitor 47, personal computer often comprises other peripheral output devices (not shown), as loudspeaker and printer.The example system of Fig. 1 also comprises host adapter 55, small computer system interface (SCSI) bus 56 and is connected to the external memory 62 of SCSI bus 56.

Personal computer 20 can use the logic connection of one or more remote computers such as remote computer 49 and move under network environment.Remote computer 49 can be another person's computing machine, server, router, network PC, peer or other common network node, although memory storage 50 only is shown among Fig. 1, it often comprises the above-mentioned many or all elements that relates to personal computer 20.The logic that Fig. 1 describes connects and comprises Local Area Network 51 and wide area network (WAN) 52, and such network environment is all very common in computer network, Intranet and the internet of office, enterprise-wide.

When using in the network environment of LAN (Local Area Network), personal computer 20 is connected to LAN (Local Area Network) 51 by network interface or adapter 53.When using in the network environment of wide area network, personal computer often comprises modulator-demodular unit 54 or set up other means of communicating by letter on such as wide area networks such as internets.Modulator-demodular unit can be internal or external, is connected to system bus 23 by serial port interface 46.In network environment, describedly relate to the program module of personal computer 20 or part wherein can be stored in the remote storage.Be understandable that it is example that shown network connects, and also can otherwise establish a communications link at intercomputer.

Be particularly suitable for computerized system though can imagine numerous embodiment of the present invention, do not attempt to limit the invention to such embodiment in this document.On the contrary, whether at this used term " computer system " is to want to include to comprise button or can ACK button press or be equal to any and all devices that button is pressed, and does not consider that whether this device is that electronics, machinery, logical OR are virtual in essence.

Network environment

Fig. 2 illustrates and can use example network environment of the present invention therein.Certainly, in various configurations, can arrange actual network and database environment; Yet example context shown here only provides framework, is used to understand the type of the environment of the present invention's operation.

Network can comprise client computer 20a, server computer 20b, data source computers 20c and database 70,72a and 72b.Client computer 20a and data source computers 20c carry out electronic communication by communication network 80 as Intranet and server computer 20b.Client computer 20a and data source computers 20c are connected to communication network via communication interface 82.Communication interface 82 can be any one famous communication interface, as Ethernet connection, modulator-demodular unit connection etc.

Server computer 20b provides management to database by the database server system software, has below more fully to describe.Same, server 20b offers each data consumer as the data warehouse of various data sources and with data.

In the example of Fig. 2, data source is provided by data source computers 20c.Data source computers 20c transfers data to server computer 20b via communication network 80, and communication network 80 can be LAN (Local Area Network), wide area network, Intranet, internet etc.Data source computers 20c preserves data in local data base 72a, 72b in this locality, database can be relational database server, excel electrical form, file etc.For example, database 72a shows the data that are kept in the table 150,152,154.The data that provided by data source 20c are merged and are saved in such as in the big databases such as the data warehouse of being safeguarded by server 20b.Want to use the client computer 20a of the data that server computer 20b preserved can be via communication network 80 access databases 70.Client computer 20a is by carrying out SQL query (for example, upgrade, insert and deletion) and come request msg being kept at data on the database 70.

Overview

" object " described herein, for following some embodiment of the present invention be, and unrestricted, dialog box, menu, webpage, page of text, other the such item in object or the computer system of drawing movably are as known to the skilled person in this area and understand.For the purpose of describing invention, suppose that all objects can be divided in four classifications easily: (1) alternative, as dialog box, menu etc., the user selects a certain element in a plurality of elements; (2) content object is as the editable text object; (3) Huo Dong picture object (MDOs); And (4) target voice.Though it is possible, desirable having more multi-class in the reality, only need expand the characteristic of logic described herein with the uniqueness of holding such extra objects grouping the personnel that association area has a sufficient technology but comprise these classifications, therefore this expansion should be regarded as that the present invention predicts and expose to the open air.

As long as on input media, press the button or roll, rotate or shake roller or dog bone (after this introducing), these basic physical just produce suitable electronic signal alternately, constitute the logic input and are used for the present invention described herein (such logic input is widely known by the people and the people that has enough technology by association area is understood).Certainly, the logic input is mutual (for example from the physics that with input media is not only button, roller or dog bone, the input of speech recognition input, infrared signal, patent identification input etc. and have no restriction), it is applicable to the of the present invention various embodiment that expose to the open air at this, therefore should not be construed as the logic input and only is only limited at this clear this group device that exposes to the open air.But for convenience, the reference that can be used for the mutual element of physics (for example, button) will constitute the direct reference of the logic input that each such physics is obtained alternately.In other words, the element of input media---comprises button, roller, dog bone and other such device---when they are played physical action, constitutes the logic input of embodiment described herein.Therefore, just as the example of non-limit, " ENTER button " is a kind of form of " the logic input of ENTER ".

The core of each embodiment of the present invention is main button/roller/dog bone grouping, and it provides the basis for interface arrangement, and the user can discern this interface arrangement immediately and come navigation information with it with simple, consistent mode.Embodiment mainly comprise with the core logic button grouping of the required command packet (core commands) of subthreshold and, in certain embodiments, be used for other logical button of secondary navigation command set (secondary command).Logical button can comprise single button or from the logic equivalent of the different incoming events of roller or dog bone (after this more fully define and describe) or even the combination of logical button, can be by various embodiment as producing core commands and secondary command.In other embodiments, because comprising few relatively physical assemblies but has a large amount of logical button, huge navigation feature may be considerably beyond core commands and secondary command, but also can comprise general order, can be object, application program or concrete and amendable device in some cases.

Core commands among the numerous embodiment of the present invention is substantially equal to UP, DOWN, ENTER and ESCAPE keyboard incident because these be the most normal with check, select relevant command calls.Checking and selecting is two navigation features the most basic---promptly, check view and selection, accept or refusal view and selection.Though UP and DOWN arrow button are not the unique methods of checking, they are the most definite for the elemental user task, because menu, tabulation and rolling view are all arranged and the use of corresponding these two keys along Z-axis.This association forms among the present invention the basis about the user's conceptual model of checking axle one by one.Similarly, the computer user knows that nearly all "enter" key" is to activate or carry out screen (graphical user interface, or be called GUI) go up the method quite reliably of current selected any function, and Escape often is regarded as the opposite semanteme of Enter, handle many common scenes that retreat, as turn off email message or turn off dialog box.Yet, the importance of the numerous embodiment of the present invention be navigation feature based on context environment and by the application object that navigated and different, additional navigation feature can realize by secondary command.

Function about Escape, another importance of each embodiment of the present invention described herein is, although traditional Escape function enough facts so far, but the realization of long-standing Escape function is in fact very limited---to the limit, in fact, be used as the core commands of the numerous embodiment of the present invention described herein.For example, the object that in application program, closes window, what be widely known by the people is that in fact most windows do not respond the Escape key, and only in response to the keyboard of " Alt-F4 ".Same, for application program with navigation " history "---promptly, navigation wherein is along the result's of normally navigate any tree-type structure data or other such object certain type logical path---and the action that closes window resembles the user hardly and carries out the Back operation (promptly, keep window to open, return based on before in the current context environment of view history or different contents) needs and hope important like that, be not widely used yet.So, in numerous embodiment of the present invention, the notion that we have replaced Escape with stronger " Out " that be used for the OUT button (after this describing in detail), though in due course, other embodiment will continue to shine upon Escape or Back to OUT.

Based on this ultimate principle, various embodiment of the present invention is used to have OUT, the device of UP, DOWN and four logical button of ENTER, common expression core navigation command, and this basic functions grouping is to use the basis of the many enhancing embodiment of the present invention of secondary command.Compare with core commands, this basic button grouping and function corresponding can modify according to the user application that does not stop to change.For example, the function of four basic navigation buttons, or " the navigation button " can be applicable to each different control surface, as radio display, remote controllers, key-ring, watch, smart phone, music apparatus and the user application other, and have no restriction, no matter whether it is regarded as the traditional calculations device.

And for the embodiment that exposes in fact visible result to the open air, as visible effect on the display monitor, but sightless effect is also predicted and is included.For example, move up and down cursor on the display device if one group of button is described as be in, effect is that non-visible alternative is also predicted so, as sound effect (for example, increase or reduce volume) or haptic effect (for example, just increase or reduce in the temperature of the area of heating surface).So here nothing should be interpreted as limiting various embodiment of the present invention to towards visible result, because also expected non-visible result fully at this.

At last, the numerous embodiment that exposed to the open air here though ideal situation is to be arranged in independent device, also can be integrated into the more part of bigger device.For example, can estimate that many embodiment will oneself be shown in a string button on the keyboard (may between a string arrow key and a string two-page separation key), at display other (with other button and interface), as the virtual push button on touch-screen (or any other virtual embodiment), or the like have no restriction.In any case here nothing should be interpreted as limiting any aspect of the present invention and arrive independently embodiment.

Core commands and relevant embodiment

Below order be included in these some important core commands of using everywhere and in concrete context environmental system how to explain them:

UP: (stepping) unit that moves up, row, unit, scroll increment, page or leaf or screen; The APPCOMMAND_NAVPAD_UP incident of Microsoft's Window; Or USB HID NAVPD_PAD incident.

DOWN: move down (stepping) unit, row, unit, scroll increment, page or leaf or screen; The APPCOMMAND_NAVPAD_DOWN incident of Microsoft's Window; Or USB HID NAVPD_DOWN incident.

NEXT: move (jumping) to next object, territory, link or panel; The APPCOMMAND_NAVPAD_NEXT incident of Microsoft's Window; Or USB HID NAVPD_DOWN incident.

PREV: move (jumping) to last object, territory, link or a panel; The APPCOMMAND_NAVPAD_PREV incident of Microsoft's Window; Or USB HID NAVPD_PREV incident.

ENTER: current object is taked action (execution) (being similar to "enter" key" on the keyboard or the OK button in other context environmental); The APPCOMMAND_NAVPAD_ENTER incident of Microsoft's Window; Or USB HIDNAVPD_ENTER incident.

CENTER: current object is taked action (execution) (be similar to but be different from "enter" key" on the keyboard); The APPCOMMAND_NAVPAD_CENTER incident of Microsoft's Window; Or USB HID NAVPD_CENTER incident.

OUT: the object, page or leaf or the view that return first front opening; Close moving object (being similar to the Esc/Back combination of described elsewhere Esc, Back or cascade, when being suitable for context environmental); The APPCOMMAND_NAVPAD_OUT incident of Microsoft's Window; Or USB HID NAVPD_OUT incident.

MORE: show about the details of current object available options or execution can be used for current for option; The APPCOMMAND_NAVPAD_MORE incident of Microsoft's Window; Or USB HID NAVPD_MORE incident.

SWITCH: being transformed into next forms, screen, page or leaf, application program or function provides; The APPCOMMAND_NAVPAD_SWITCH incident of Microsoft's Window; Or USB HID NAVPD_SWITCH incident.

Fig. 3 A is a process flow diagram, describes in certain embodiments of the present invention the logic of ENTER button.After pressing the ENTER button at piece 302, the ENTER button system will determine whether this object is an alternative (rather than content object or movable picture object) at piece 304, if not, present embodiment does not have other incident to be taken place, and piece 350 is got back to by system.(for content object and movable picture object, the present invention may also have other incident certainly except null event, as those have enough the technology of association area the people understood.) on the other hand,, determine in piece 306 systems whether the mobile element in the object is selected so if this object is an alternative really.If mobile element is selected, at piece 312 " execution " incident takes place so, be equal to by the ENTER key on the lower keyboard (in suitable, it causes the opening of selected element, acceptance or OK, and those those skilled in the art know and understand such incident); So system returns at piece 350.On the other hand, selected if mobile element does not also have, so at piece 308, whether system is marked as initial focus (as the selection element of acquiescence) with regard to the element of object judges, if, so at piece 314, selection is marked as the element of initial focus, and system returns at piece 350 then.At last, if there is not initial focus, so at piece 316, first object elements of listing is selected by system, and returns at piece 350.

Naturally, in some cases, the variation of the logic flow of describing among Fig. 3 B can and will be worth.For example, consider Fig. 3 B, it is a process flow diagram, the variation in the logic of the described ENTER button of this just Fig. 3 A of description.In this embodiment, (a) determines liking alternative at piece 304, (b) determine that at piece 306 moving object does not also have selected, and (c) determine that at piece 308 objects do not have initial focus (the same with the method for Fig. 3 A) afterwards---at piece 310, the system of Fig. 3 B has determined whether that further any mobile element is visible, if will select first visible element in piece 308 systems, perhaps if not, the element that will select first to list in piece 316 systems.The present invention exposes this and other such minor variations in the logic to the open air at this.

Note by the method for these specific embodiments of use and other method here, can estimate in some cases, the user can select element (when also not selecting element) by an ENTER button, and then presses the ENTER button and carry out this element (being equal to by the ENTER key on the lower keyboard).

Fig. 4 A is a process flow diagram, describes in certain embodiments of the present invention the logic of UP button.When piece 402 is pressed the UP button, the UP button system determines at piece 404 whether object is alternative.If not, determine in piece 422 systems whether object is content object or movable picture object.If to liking movable picture object, (for example simply this object is upwards touched (moving) predetermined distance in piece 432 systems so, a pixel), or according to (and other position in the drawings) of supposing here, if can not or not allow to do further to move on this direction, that is just done nothing.Although this point does not illustrate moving when can not or not allow on wanting direction, be used to handle the logic of this " null event ", frame of broken lines illustrates the sample of such logic and after this only is being described for content object among the figure, although this logic can and must be assumed to be and imply the appropriate location that is used for this figure remainder.

Get back to this figure once more, if object is actually content object, so at piece 424, system determines whether the text in the object is made up of delegation or multirow line.If text object is made up of multirow, so (when wanting moving of direction can not or not allow, show the logic of handling " null event ", as early mentioning indirectly here) determine further that in piece 426 systems the insertion point is current whether at first row, if, anything is not done by system so, return at piece 450 then, otherwise, at piece 434, system returns the insertion point delegation that moves up at piece 450.On the contrary, if text object includes only delegation, before piece 428 determines whether the insertion point appears at first character of this row,, return so at piece 450 if system does not do anything so; Otherwise, in piece 436 systems the insertion point is moved to the left a character, return at piece 450 then.

If at piece 404, system determines that object is alternative really, determines in piece 406 systems whether the mobile element in the object is selected so.If chosen mobile element, preceding element in the selective listing of piece 412 systems (and implicitly, the element of before choosing becomes not to be chosen) returns in piece 450 systems then.On the other hand, selected if mobile element does not also have, whether be marked as initial focus (as the selection element of acquiescence) in piece 408 systems with regard to the element of object so and decision making, if, at piece 414, selected marker is the element of initial focus, returns in piece 450 systems then.At last, if there is not initial focus, select first object elements of listing in piece 416 systems so, and return at piece 450.

Fig. 4 B is a process flow diagram, describes the variation of the UP button logic shown in Fig. 4 A, and it is different from the similar variation of Fig. 3 A based on Fig. 3 B that introduces before this.In the embodiment of Fig. 4 B---again, (a) determines liking alternative at piece 404, (b) determine that at piece 406 mobile element does not also have selected, and (c) determining that at piece 408 objects do not have initial focus (the same with the method for Fig. 4 A) afterwards---the system at piece 410 Fig. 4 B has determined whether that further any mobile element is visible, if, select first visible elements at piece 418, perhaps if not, the element of selecting first to list in piece 416 systems so.

Fig. 5 A is a process flow diagram, describes among some embodiment of the present invention the logic of DOWN button.When piece 502 is pressed the DOWN button, at piece 504, the DOWN button system determines whether this object is alternative.If not, determine in piece 522 systems whether object is content object or movable picture object.If to liking movable picture object, (for example simply object is touched (moving) predetermined distance downwards in piece 532 systems, a pixel), perhaps according to supposition (and other position in the drawings) here, if can not or not allow to do further to move on this direction, that is just done nothing.On the other hand, if, determine in piece 524 systems whether the text in the object comprises delegation or multirow so to liking content object.If text object comprises more than delegation, determine further in piece 526 systems whether the insertion point appears on last column, if then system does nothing, returns at piece 550 so; Otherwise 534 systems move down delegation with the insertion point at piece, return at piece 550 then.On the contrary, if text object includes only delegation, after piece 528 determines whether the insertion point appears at last character of this row,, return so at piece 550 if system does nothing so; Otherwise, with the insertion point character that moves right, return at piece 550 then in piece 536 systems.

If determine that in piece 504 systems object is alternative really, determine in piece 506 systems whether the mobile element in the object is selected so.If mobile element is selected, the next element in the selective listing of piece 512 systems (and implicitly, the element of before choosing becomes not to be chosen), system returns at piece 550 then.On the other hand, selected if mobile element does not also have, whether be marked as initial focus (as the selection element of acquiescence) in piece 508 systems with regard to the element of object so and decision making, if, at piece 514, selected marker is the element of initial focus, and system returns at piece 550 then.At last, if there is not initial focus, the object elements of selecting last to list in piece 516 systems so, and return at piece 550.

Fig. 5 B is a process flow diagram, describes the variation of the logic of the DOWN button shown in Fig. 5 A, and it is different from the similar variation that Fig. 3 A and Fig. 4 B are different from Fig. 4 A based on Fig. 3 B that introduces before this.In the embodiment of Fig. 5 B---again, (a) determines liking alternative at piece 504, (b) determine that at piece 506 mobile element does not also have selected, and (c) determining that at piece 508 objects do not have initial focus (the same with the method for Fig. 5 A) afterwards---whether as seen the system at piece 510 Fig. 5 B further determines mobile element, if, select last visible element at piece 518, perhaps if not, the element of selecting last to list in piece 516 systems.

Although in fact use traditional Escape function for a long time always, the very limited and highly particularization of this function.For example, for closing window, in fact most of windows do not respond the Escape key, and only in response to " Alt-F4 " keying.Similarly, for application program with navigation " history "---promptly, navigation wherein is along certain logical path---and the action that closes window resembles the user hardly and carries out the Back operation (promptly, keep window to open, return based on before in the current context environment of view history or different contents) needs and hope important like that (using also not extensive).So about the OUT button, we replace the notion of Escape or Back with more strong notion " OUT " in certain embodiment of the present invention.

In the embodiment of some cascade, OUT can be the logic and the control combination of the function that provided by Back and Escape command calls.All respond in the operating system of Escape at all windows, the merging of these two buttons is very favourable, because these keys seldom fully, are as one man used in the context environmental of various application programs.Certainly, use Back and Escape and each all to have in the context environmental of minority application program of difference in functionality simultaneously at those, desired user goes to guess that the OUT button duplicates is that the idea of which keyboard is unrealistic, poor efficiency.A solution shown in the certain embodiments of the invention is when the application program of arguement is understood order, use the OUT button to produce the order of Back key, and when application program is not understood the order of Back key, change the order that produces the Escape key into---promptly, cascade Escape order after the Back order.In this way, have historical application program---and so all, the function ratio of wherein carrying out Back is more commonly used and more important via the function that Escape closes window---and obtain more benefit, and do not have the application program of Back key function to obtain all functions that the Escape key is provided automatically than the function of Back key.In order to realize the system of selection of Back/Escape key via the OUT button, at first use operating system shell to link up with at this some embodiment of the present invention that exposes to the open air and produce the order of Back key as " APP Command " (application command of application programs), then, if application program refusal Back order produces the Escape order that equals by Escape key on the lower keyboard so.Certainly, as long as suitable, other embodiment can shine upon Escape or Back simply to OUT, does not want to limit the potential function of OUT fully at this; Although we refer to the cascade function of Back/Escape at this supposition OUT.

Fig. 6 A is a process flow diagram, is described in some example of the present invention the logic of OUT button method.When piece 602 is pressed the OUT button, use the OUT button system of operating system shell hook to the application issued application command at piece 604, it is equal to the order that the user produces by the Back key on the lower keyboard (also be noted as Browser Back key or some other equivalent sometimes, these operations also realize with the right click of mouse sometimes).Then, determine in piece 606 systems whether the Back application command is rejected, if not, return in piece 650 systems so; Otherwise, send Escape order and return at piece 650 in piece 608 systems.

Fig. 6 B is a process flow diagram, describes the more complicated logic based on the OUT button method of method shown in Fig. 6 A.In Fig. 6 B, when when piece 602 is pressed the OUT button, system determines at first that at piece 610 whether window begins place (place that does not therefore have " returning ") in its history.Have only in this case, this method just can be done one of following two things: (a) it can be ignored OUT button (null event) and return at once, and is perhaps better, (b) can turn off window via Escape.In order to realize the option of back, in available following two methods one: (i) system can continue to send the Back order, when if application program is refused this application command (owing to the place that does not have " to return "), system continues to send Escape order (it is the method shown in Fig. 6 A), or (ii) system sends the Escape order immediately, among this figure this is stated.Therefore, if determine the begin place of window in its history really in piece 610 systems, system advances to piece 608 at once so, and issue Escape order is returned at piece 650 then.Otherwise, reuse the operating system shell hook at piece 604, system is to application issued Back application command, determine in piece 606 systems whether the Back application command is rejected then, if not, 650 systems return at piece, otherwise return in the issue Escape order of piece 608 systems and at piece 650.

Certainly have some different specific embodiments of the invention.Such an embodiment shown in Fig. 7 A is for example arrangement of four buttons on handle or device, shown in comprising with ENTER702, OUT704, UP706 and the DOWN708 button of diamond array.Fig. 7 B is for example along the right of calculation element, has similar direction but the standby embodiment of the present invention of four button homeotropic alignments.Fig. 7 C is another standby embodiment of the present invention, and horizontal button is shown as the front along calculation element.On the other hand, Fig. 7 D is another standby embodiment of the present invention, the button of arranging with the vertical mode of changing is shown, and ENTER702 is placed in the middle, UP706 is positioned at the ENTER702 upper and lower with DOWN708 is vertical respectively, and OUT704 is positioned at the upper left quarter of three linear array buttons.Certainly, can select different command in combination for use for the device of some four button.The device of Fig. 7 E illustrates the device that is similar to Fig. 7 A, just the corresponding order of four buttons UP, DOWN, PREV and the NEXT of device.

But, the pattern of these four buttons that expose to the open air be logic rather than physics, some embodiment of the present invention also can utilize different physical assemblies.For example, one embodiment of the present of invention shown in Fig. 8 A comprise the combination of scroll wheel/button, vertical roller 802 and two buttons 804 and 806, wherein roller 802 (is respectively to go up or down based on the function that the roller rotation direction equals UP and DOWN in logic, button 804 and 806 is associated with ENTER and OUT respectively when pressing as shown in the figure).Roller 802 among this embodiment can be operated in the mode that is similar to the mouse apparatus upper roller, make on the roller or under each slight rolling form input---as known in the art and understand.Fig. 8 B illustrates the alternate layout of scroll wheel/button combination embodiment, and Fig. 8 C then illustrates another such embodiment layout.

Fig. 9 illustrates another alternative of the present invention, and wherein roller 902 is not only supported corresponding to the moving up and down of UP and DOWN, and when applying predetermined pressure minimum threshold, it is just as the ENTER button.Make by the power input feature vector to refer to the click roller here by roller 902, can receive three different inputs, and the 4th the corresponding contiguous button 904 of clicking roller 902 of input OUT.

In other embodiments of the invention, as shown in figure 10, by the pattern of waving four buttons of wheel 1002 these single physical elements uses.Wave wheel 1002 and be similar to regular roller, just it supports that more waving of edge-to-edge is mobile, does not move and do not jeopardize vertical rolling.These functions have been arranged, waved left part and be associated with ENTER, waved right part and be associated with OUT, and UP and DOWN continue to obtain (as shown in the figure) from the scroll-up/down of roller 1002.And, if shown present embodiment wave roller further combined with clicking importing of roller among Fig. 9 by power, so such embodiment will obtain the function of the 5th button, in the 5+ that some other interesting embodiment the is provided button arrangement that can be used for after this going through.

Figure 11 A illustrates alternative of the present invention, and it is similar to the invention that Fig. 8 A is exposed to the open air, and just usefulness is dog bone 1102 rather than traditional roller.Dog bone 1102 is the roller devices that hommization is revised in essence, be particularly suitable for using thumb manipulation, and traditional roller is more suitable in using with forefinger.In this embodiment, dog bone 1102 vertically upward or downward rolling move the function (described in figure) that equals UP and DOWN in logic respectively, and button 1104 and 1106 is associated with ENTER and OUT respectively when pressing.Figure 11 B illustrates the standby layout of dog bone/button combination embodiment, and Figure 11 C then illustrates another such embodiment layout.

Figure 12 illustrates another alternative of the present invention, and wherein dog bone 1202 is not only supported corresponding to the moving up and down of UP and DOWN, and when applying predetermined pressure minimum threshold, it is just as the ENTER button.Make dog bone 1202 by the power input feature vector, referred to herein as and click the dog bone, can receive three different inputs, and the 4th the corresponding contiguous button 1204 of clicking dog bone 1202 of input OUT.

At last, in another embodiment of the present invention as shown in figure 13, use four button mode by waving dog bone 1302 these single physical elements.Wave dog bone 1302 and be similar to the roller that waves shown in Figure 10, support that further waving of edge-to-edge is mobile, do not move and do not jeopardize vertical rolling.This function has been arranged, waved dog bone 1302 left parts and be associated with ENTER, the right part that waves is associated with OUT, and UP and DOWN continue to obtain (as shown in the figure) from the scroll-up/down of dog bone 1302.And, if shown present embodiment wave the dog bone further combined with clicking importing of dog bone among Figure 12 by power, so such embodiment will obtain the function of the 5th button, and it provides some other interesting embodiment the 5+ that can be used for after this a going through button arrangement.

The order and relevant embodiment of expansion

Concentrate at present and comprise the directly pattern of mapping four basic command ENTER, UP, DOWN, OUT (or equal in logic under roller and dog bone situation button) of four buttons in this embodiment of the invention that exposes to the open air.Though do not deny this comprising, by physically, provisionally, logically can obtain function widely in conjunction with the function of an expansion button in these four kinds of methods with inside for the navigation object ability of the simple mode of useful order.For example, except these four basic command ENTER, UP, DOWN and OUT, the additional command that some embodiment can shine upon comprises for the PREV of six logical button embodiment and NEXT with for PREV, NEXT, MORE and the SWITCH of eight logical button embodiment.

A method of expansion logic four command aligning is to expand four command aligning of physics by the order of adding more button (or logic equivalent of button) simply and shining upon other.For example, if further comprising, four push button function that wave roller shown in Figure 10 click importing of roller among Fig. 9 by power, the roller of this enhancing---after this is called super wheel---and represents the 5th button in logic so, therefore can directly use the 5th order (or in the pattern that logical OR mutually combines, to use, as hereinafter described).Similarly, if the function of four buttons that wave the dog bone shown in Figure 12 further comprise among Figure 13 click roller by the power input function, this enhancing dog bone---after this is called super dog bone---and represents the 5th button in logic so, therefore can directly use the 5th order (or in the pattern that logical OR mutually combines, to use once more, as hereinafter described).Figure 14 A illustrates embodiments of the invention that use super wheel, and Figure 14 B illustrates embodiments of the invention that use super dog bone.

When super wheel or super other button of dog synosteosis, the strong guider of operation that just producing can enough hand (or or even finger or thumb).For example, in certain embodiments, device can use and wave the dog bone and add two buttons (six logical button altogether) or wave the dog bone and add four buttons (eight logical button altogether), and each all has the corresponding order of the logical button of being mapped to.Similarly, wave the dog bone among each these embodiment, obtain the device of seven buttons and nine buttons respectively by replacing with super dog bone.

Figure 15 A illustrates the embodiment of such guider, and it uses the physical button of super dog bone and four additional homeotropic alignments, and the wherein super dog position of bone is in the central authorities of arranging.The device of this 9 buttons is called as nine button devices (niners) later on.And the nine concrete PBU pushbutton units shown in Figure 15 A are called as nine vertical button devices.With reference to Figure 15 A, have above nine vertical button devices 1502 comprise two buttons 1506 and 1508 and below the super dog bone 1504 of two buttons 1510 and 1512 is arranged.The direct command of each button (or logic input) is listed in the table of Figure 15 C.Notice that in this embodiment, ENTER, UP, DOWN and OUT and described before ENTER, UP, DOWN and OUT have same function, and ENTER is corresponding to two logical button (permission but not necessarily).Similarly, alternative embodiment can comprise the device of eight buttons, and shown in Figure 15 B, it has similar command mapping but wherein the only corresponding single logical button of ENTER.Also it should be noted because the function of PREV and NEXT is more useful in the context environmental of navigation, so replace the function of left arrow and right arrow to realize PREV and NEXT corresponding to Tab and Alt-Tab command calls; But, in some cases, want to combine to be similar in OUT order in conjunction with the order of the mode of Escape and Back with PREV and Left arrow.

The other method of expansion logical button function provides the specific function that presses the button also after " pushing down " predetermined a period of time.For example, if the user presses and push down the UP button, some embodiment of the present invention can logically be interpreted as it different orders, for example, duplicates PAGEUP (page turning forward) order of PageUP key on the keyboard.Alternatively, system also can repeat the UP order apace automatically, is similar to the effect of pressing and push down UP arrow key on the keyboard.

The other method of expanding said button mode function is to distinguish two kinds different " motion ", is similar to mouse and distinguishes the method for clicking and double-clicking.For example, when utilizing roller or dog bone pattern, with on the roller or under brisk move (brisk moving is at short notice big moving) to be considered as different logical button be a kind of rational expansion.For example, on the dog bone or under the normal rolling order that produces UP or DOWN respectively, and up or down trippingly shifting roller can obtain PAGEUP or PAGEDOWN order respectively, equal PageUP and PageDown key on the keyboard respectively successively.

Another strong method of expansion push button function is to consider the various combinations of button, when button is pressed simultaneously, is used for representing to be different from the order that is associated with indivedual button commands usually.For example, one embodiment of the present of invention can comprise four physical navigation buttons, wave the dog bone or wave roller as main navigational logic button groups, may add to make four logical button have the correction button of secondary mapping.Revising button equals on a lot of methods as " Fn " key on the computerized device such as kneetop computer, dull and stereotyped PC.And, revising button also can be " two tunking ", in order to realize other order, as call for the certain computer makeup that realizes it and put the useful especially special menu of possibility---for example, the menu that rotating display device between the vertical and horizontal direction is arranged on the device, this function will be correlated with and useful (below have more detailed discussion) especially.

Present described embodiment is based on to a great extent according to physical user interaction different in the given context environmental, shines upon different logical consequences.But alternative embodiment also can make single concrete physics produce different logical consequences (for example, stepping, rolling or page turning) alternately in different context environmental (for example, respectively at text document, virtual book or lantern slide).For example, when the dog bone is waved in use, roll downwards and equal in a context environmental, to walk next line, downward scroll through pages in another context environmental, and in another context environmental to the document page turning, and in each such context environmental, scroll up its corresponding reverse logic result is arranged also.Similarly, reuse and wave the dog bone, waving left part can jump between the panel of a context environmental, in the link of another context environmental, skip, or in the tree hierarchy of another context environmental again, enter lower branch, and wave right part corresponding reverse logic result is arranged also in each such context environmental.Be similar to along the class of operation of other embodiment of these row and use four buttons waving roller, super dog bone, super wheel, pendulum diamondwise structure, arrange eight buttons, control rod, directional lever, touch handle, touch band etc., have no restriction as compass points along branches such as circles.Other order except stepping, rolling and page turning, can comprise the order (general " abstract ") of ENTER and OUT (" access " altogether) and other two-part abstract opposition.

Direction flexibly

On such device, wherein the menu that display is rotated between the vertical and horizontal direction will be correlated with especially and be useful, and another important element of the present invention that is combined among each embodiment is the ability that the logical button order is redirected to physical button.For example, consider the device of Figure 16 A, Figure 16 A illustrates the display device 1602 in " right hand is vertical " direction such as dull and stereotyped PC etc., waves dog bone 1604 and is attached to its right side.For convenience, wave the function of each logical button of dog bone 1604, that is, scroll up, roll downwards, wave and wave to the right left and be noted as A, B, C, D (label) respectively, and wave dog bone 1604 and be consistent.Yet the order of waving dog bone 1604 each logical button is noted as U.D.P.N, corresponding UP, DOWN, PREV and NEXT order respectively, these the order actual be about on this specific physical direction (promptly, right hand longitudinal direction) wave dog bone 1604, logical button can be expressed as follows (label on the left side, order are on the right) to the logical mappings of order:

A＝U

B＝D

C＝P

D＝N

But for some embodiment of the present invention, when display device 1602 rotations, the distribution of logical button is remapped aptly.For example, consider Figure 16 B, it is illustrated in by the device 1602 after arriving " bottom transverse " direction to right rotation 90 degree (1/4th).This occurs in after the direction that this device of user command changes display, thereby ensuing remapping order even can take place automatically to logical button.In this postrotational direction, the logical mappings of waving dog bone 1604 can be expressed as follows (label on the left side, order are on the right):

A＝D

B＝U

C＝P

D＝N

Though the order of noting logical button A and B is by transposing (that is, UP and DOWN order are changed), the order of logical button C and D remains unchanged.Its reason is that dog bone 1604 in fact only rolls along an axle, axle shown here is initially vertical direction, and this is more suitable for being mapped to the vertical direction of display, because vertical the demonstration moves usually than the mobile more important and more normal use of level demonstration, thereby the rolling function of dog bone 1604 should always logically be mapped to vertical moving, and to the right rolling is mobile in this example equals downward moving on the display (or at least with other direction and to read the mode of text document consistent) naturally.Similarly, remapping that to wave also be very natural (or at least with other direction and to read the mode of text document consistent), is waving and equal moving of left-hand on the display upwards in this example.By remapping the logical relation between the order of (actual, partly remap) logical button and they calling, the direction that the user can modifier but still can be used user interface in mode unanimous on the whole from the direction to the direction.

Figure 16 C illustrates to same device of right rotation 90 degree (be 180 degree to the right now altogether, or half) and in order to observe from this device direction again, and the result that display oneself produces when being redirected automatically or manually remaps.On this direction, the logical mappings of waving dog bone 1604 can be expressed as follows (label on the left side, order are on the right):

A＝D

B＝U

C＝N

D＝P

The direction of this " left hand vertically ", particularly useful for the user of left hand.With the direction ratio of front than the time, should notice that also the order of logical button C and D is changed now, and the order of logical button A and B remains unchanged.Similarly, though this remap (180 degree) in fact just from before the part of direction (90 degree to the right) remap, it also is to remap from the complete of inceptive direction.

It (is 270 degree to the right now altogether that Figure 16 D illustrates to right rotation 90 degree again, or 3/4ths) same that forms " top cross " direction is installed and observes in order to install direction from this, and the result that display oneself produces when being redirected automatically or manually remaps.In this direction, the logical mappings of waving dog bone 1604 can be expressed as follows (the label on the left side, the order on the right:

A＝U

B＝D

C＝N

D＝P

With the direction ratio of front than the time, notice that the order of logical button A and B is changed now, and the order of logical button C and D remains unchanged.Got back to initial position if this device rotates once more, the order of logical button C and D will be changed so, and the order of logical button A and B remains unchanged.In a word, some embodiment of the present invention uses the fixedly logic rotary mode of guider, makes logical button depend on separately the corresponding concrete order of direction, and its definite mapping is shown in the table of Figure 17.This mapping is suitable for along an axisymmetric device of physics most, as has the situation of roller and dog bone.

Figure 18 A illustrates alternative display device 1802, here the display device of pocket size is as unrestriced example, in " front end is horizontal " direction, wave dog bone 1804 and be integrated in bottom of device, described device next continuous three times to right rotation 1/4th, described device remaps logical order to be similar to the mode of installing among Figure 16 A-D.

Another solution for the awkward situation of rotating display device is also to rotate physical user interface oneself.Figure 19 A illustrates the display device 1902 with rotatable guider 1904, and described display device is at right hand longitudinal direction.Figure 19 B illustrates the display device 1902 to right rotation 90 degree, and from the angle of display device 1902, and rotatable guider 1904 is by to anticlockwise 90 degree, thereby has kept same absolute direction.Figure 19 C and 19D illustrate with a device and revolve situation about turning 90 degrees at every turn again.In each case, guider 1904 keeps same absolute direction.

In a similar fashion, the time physically be some guider that can not differentiate for rotation, rotation also can be like the void, therefore has only the logic rotation to produce.Though this method is not suitable for using the roller with main axis of rolling or the guider of dog bone, but other embodiment, four buttons shown in Fig. 7 A are with the guider of diamond array button, can in physical button, simply directly remap (logic rotation), in whirligig, obtain function class and be similar to the function that display device with rotatable guider obtains, shown in Figure 19 A-D.The rotation of ordering in the physical button is well suited for any guider all symmetrical on vertical and the horizontal direction, has the situation of diamond array as discussed earlier.

The incoherent dimension of navigating

In present described numerous embodiment, particularly those comprise the embodiment of a plurality of buttons of symmetry, and the function of logical button is corresponding to the physical location of this class button---promptly, and logic dimension reflection Li Weidu.But alternative of the present invention is broken this related between physics and logic, so that further expand the function of this user's interface device.

A plurality of buttons of symmetry be one group of logical button (all logical button that can or can not comprise device) and their physics equivalent (for example, button, roller or dog bone), wherein the latter with the mode of multidimensional physically be arranged on the device function with recommendation button be logic relevant and be confirmable according to physical layout.For example, consider to comprise Figure 20 A and the 20B of four buttons arranging with different physical arrangements; These embodiment have same button, and just the button of Figure 20 A is arranged (UP and DOWN homeotropic alignment, and LEFT and RIGHT are horizontal) along two axle multidimensional ground, yet the button of Figure 20 B is arranged one-dimensionally along single transverse axis.Because the layout of physics, the function of each button of Figure 20 A is advised by the mutual relationship between button; But the function of each button of Figure 20 B be can not determine to a great extent.For example, the layout of the button of Figure 20 C is similar to the layout of Figure 20 A, just there is not clearly label, the function of each button can be considered to naturally that interrelated (A is relative with C, B is relative with D, the former is associated with Z-axis and the latter is associated with transverse axis), and moving of making progress of corresponding each button related side.Yet, be similar to the layout of Figure 20 B and the button layout of not knowing Figure 20 D of label do not provide to such relation or with two-dimensional space (vertical and level) in the suggestion of mobile function associated.

Really, " rhombus " of four buttons of Figure 20 A, 20C and equivalent thereof (comprise, for example, wave roller and wave the dog bone) arranged and so effectively advised moving along the multidimensional of level and Z-axis, so that such function is often automatically supposed.And, the relation of the physics between any this button (as level and vertical arrangement) can easily be assumed that the potential function (as level and vertical moving) of corresponding these buttons, automatically is assumed to the multidimensional that multidimensional in (and being defined in) space moves (in the relation to X, Y and axle and various angles) previous technology is baffled.For example, consider among Figure 21 A even do not have the arrangement of " compass " button of label, suppose naturally it with two-dimensional space in the directional correlation of four axles, just as Figure 21 B of similar arrangement and the clear suggestion of 21C.But in the context environmental of many users navigation, this correlation function based on the physical relation of button may not be the most efficiently, and be important but move horizontally unessential the time as vertical moving, otherwise too.

In order to maximize the diversity and the availability of single user interface device in various different context environmentals, other embodiments of the invention comprise a plurality of buttons (physically interrelated) of symmetry, corresponding to asymmetric (asymmetricly) relevant logical button (that is, logic is uncorrelated each other).For example, in have one embodiment of the present of invention that four button multidimensional arrange such as Fig. 7 A, though the corresponding vertical moving of vertical buttons, the horizontal buttons correspondence thing (in this embodiment, be ENTER and OUT) of translation beyond moving that dewater.Similarly, in another such embodiment of the invention, wherein the horizontal buttons correspondence moves horizontally, the corresponding thing except that vertical moving of vertical buttons.And, natch, in another such embodiment, the horizontal buttons correspondence dewater translation beyond moving thing and the corresponding thing except that vertical moving of vertical buttons.Use other embodiment of this method to comprise a plurality of situations of various symmetries, have no restrictedly to comprise diamond array, eight buttons of four buttons compass arrangement, wave dog bone (with super dog bone), wave roller (and super wheel), directional lever, control lever, various button is arranged and/or the combination of any front and equivalent thereof.And this method is not limited to the physics of two dimension or the embodiment of logic, but about the real multidimensional of physical element and logic function.

Conclusion

Various technology available hardware described herein or software are realized, or the combination with both realizes in suitable place.Therefore, method and apparatus of the present invention or its some aspect or part can adopt and be embodied as such as the program code in the tangible mediums such as floppy disk, CD-ROM, hard disk or any other machine-readable storage medium (promptly, instruction) form, wherein, when program code is written into and when carrying out such as the machine of computing machine, machine just becomes implements device of the present invention.When program code under situation about carrying out on the programmable calculator, the storage medium (comprising easily become estranged nonvolatile memory and/or storage element) that computing machine generally includes processor, can be read by processor comprises at least one input media and at least one output unit.One or more programs are more suitable for realizing in high-rise process or OO program language, so that communicate with computer system.But if be ready, program can realize with compilation or machine language.Under any circumstance, language can be language compiling or that explain, but and combined with hardware realization.

Method and apparatus of the present invention also can be embodied as the form of program code, and described program code transmits by some transmission medium such as electric wire, cable, optical fiber or any other form transmission.Wherein, be received, be written into and by such as EPROM, when gate array, programmable logic units (PLD), client computer, video video recorder etc. were carried out, this machine becomes implemented device of the present invention when program code.When realizing on general processor, the program code associative processor provides unique device to carry out calibration function of the present invention.

Though the embodiment in conjunction with each figure has described the present invention, should be understood that and also can use other similar embodiment, perhaps do not depart from the present invention in order to move the same function of the present invention, can make amendment and add described embodiment.For example, though example embodiment of the present invention is described in the context environmental of the digital device of imitating personal computer function, but those skilled in the art know and the invention is not restricted to this digital device, described in the application, can use the existing or emerging calculation element or the environment of any amount, such as game console, handheld computer, portable computer, mobile phone, wrist-watch, music player, some mechanical hook-up etc., no matter be wired or wireless, and can be applicable to connect and this calculation element of any amount by this network interaction via communication network.Again for example, in order to obtain the benefit of some hommization, " button " (with other physical unit as used herein) can be different size, shape, interval etc.Similarly, each button can mark word, symbol or according to not marking, and each button can have different colors, shape or further feature to make a distinction in order to the button (or nothing) with it and other.

It must be emphasized that at this and considered multiple computer platform, comprise the operating system of hand-held device and other special purpose operating system, particularly under the situation that the continuation of radio network device quantity increases sharply.So the present invention should not be limited to any single embodiment, and will analyze on width and scope according to appending claims.

Claims (41)

1. one group of function that has two command calls at least is attached to the method in the single logical button, described method comprises:

This group command called from the limit priority to the lowest priority arrange;

Discern when command calls is employed the program refusal, and send at least one more command calls of low priority.

2. the method for claim 1 is characterized in that,

Wherein the order of combination is keyboard commands Back and Escape.

3. method as claimed in claim 2 is characterized in that,

The Back key is classified first priority as, and the Escape key is classified last priority level as.

4. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_UP.

5. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_UP, and the order of lower priority is keyboard commands UPArrow.

6. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_UP, and the order of lower priority is keyboard commands Scroll UP.

7. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_UP, and the order of lower priority is keyboard commands PageUP.

8. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_DOWN.

9. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_DOWN, and the order of lower priority is keyboard commands DOWN Arrow.

10. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_DOWN, and the order of lower priority is keyboard commands Scroll DOWN.

11. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_DOWN, and the order of lower priority is keyboard commands Page DOWN.

12. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_NEXT.

13. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_NEXT, and the order of lower priority is keyboard commands Tab.

14. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_NEXT, and the order of lower priority is keyboard commands Right Arrow.

15. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_PREV.

16. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_PREV, and the order of lower priority is keyboard commands Shift-Tab.

17. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_PREV, and the order of lower priority is keyboard commands Left Arrow.

18. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_ENTER.

19. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_ENTER, and the order of lower priority is keyboard commands Return.

20. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_ENTER, and the order of lower priority is keyboard commands Enter.

21. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_ENTER, and the order of lower priority is special command Play.

22. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_OUT.

23. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_OUT, and the order of lower priority is keyboard commands Browser Back.

24. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_OUT, and the order of lower priority is keyboard commands Escape.

25. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_OUT, and the order of lower priority is special command Stop.

26. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_OUT, and the order of lower priority is keyboard commands Alt-F4.

27. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_SWITCH.

28. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_SWITCH, and the order of lower priority is keyboard commands Alt-Escape.

29. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_SWITCH, and the order of lower priority is keyboard commands Alt-Tab.

30. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_SWITCH, and the order of lower priority is WindowsKey.

31. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_SWITCH, and the order of lower priority is keyboard commands Home.

32. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_MENU.

33. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_MENU, and the order of lower priority is keyboard commands Shift-F10.

34. the method for claim 1 is characterized in that,

The order of limit priority is APPCOMMAND_MENU, and the order of lower priority is the special command that is used to be provided with.

35. be used for the method for cascade order, it is characterized in that this method comprises:

Use the issue an order of operating system shell hook, as the application command of giving application program;

If application command is rejected, the different command of operating system is directly given in issue.

36. user interface system is characterized in that, this system comprises

For one in command group order produces the interface of the logic input that is applied to object, described command group comprises ENTER, UP, DOWN and OUT;

Handle the subsystem of ENTER order;

Handle the subsystem of UP order;

Handle the subsystem of DOWN order;

Handle the subsystem of OUT order;

And for the OUT order, described system realizes the described method of claim 1.

37. a method that is used for one group of function that has two command calls at least is attached to single logical button, described method comprises:

This group command called carry out priority arrangement from the beginning to the end;

Use the operating system shell hook to call carrying out application command except the command calls of last with priority orders, up to there being first such key not to be rejected, and the program that therefore is employed is accepted, or up to only remaining last keyboard;

If except that last keyboard,, issue last keyboard so as operating system command all by the application program refusal in the previous element.

38. method as claimed in claim 37 is characterized in that,

Wherein the order of combination is keyboard commands Back and Escape.

39. method as claimed in claim 38 is characterized in that,

The Back key is classified first priority as, and the Escape key is classified last priority as.

40. by producing the hardware controller that the logic input that will be applied to object is come navigation object for one in command group order, described command group comprises ENTER, UP, DOWN and OUT, produces ENTER order, UP order, DOWN order and OUT order for computer system; For the OUT order, described device is realized the described method of claim 1.

41. hardware controller, this device comprises

The device of navigation object, by being the input of one in the command group that will be applied to object order generation logic, described command group comprises ENTER, UP, DOWN and OUT, described device is realized the described method of claim 1.

Images