US8332769B2 - Directional focus navigation - Google Patents

Directional focus navigation Download PDF

Info

Publication number
US8332769B2
US8332769B2 US12/784,755 US78475510A US8332769B2 US 8332769 B2 US8332769 B2 US 8332769B2 US 78475510 A US78475510 A US 78475510A US 8332769 B2 US8332769 B2 US 8332769B2
Authority
US
United States
Prior art keywords
focus
focusable
directional input
location
directional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US12/784,755
Other versions
US20100299623A1 (en
Inventor
Tantek Celik
Ada Y. Chan
Bradley R. Pettit
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Priority to US12/784,755 priority Critical patent/US8332769B2/en
Publication of US20100299623A1 publication Critical patent/US20100299623A1/en
Assigned to MICROSOFT CORPORATION reassignment MICROSOFT CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CELIK, TANTEK, CHAN, ADA Y., PETTIT, BRADLEY R.
Priority to US13/618,207 priority patent/US20130014043A1/en
Application granted granted Critical
Publication of US8332769B2 publication Critical patent/US8332769B2/en
Assigned to MICROSOFT TECHNOLOGY LICENSING, LLC reassignment MICROSOFT TECHNOLOGY LICENSING, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MICROSOFT CORPORATION
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Definitions

  • This invention relates to focus navigation and, in particular, to directional focus navigation.
  • a graphical user interface may include multiple elements that can receive input.
  • the target of the input is said to have focus, and elements eligible for focus within a document are called focusable elements.
  • input that is received is processed according to an element that currently has focus. For example, if a GUI contains two editable text boxes, when a user enters text through a keyboard, the text is rendered in the text box that currently has focus.
  • the currently focused element is determined based on the location of a cursor or pointer when a user submits a select command (e.g., clicks a mouse button). If the cursor or pointer is over a text box when the user clicks the mouse button, then that text box is given focus and future input, such as through a keyboard, is directed to the text box until the focus is moved to another element.
  • a select command e.g., clicks a mouse button
  • an alternative mechanism is implemented to allow a user to specify an element to be given focus, and thus, the target of keyboard (or other device) input.
  • Browser or other rendering engine applications that provide a mechanism for displaying documents that include focusable elements (e.g., hypertext markup language (HTML) documents, dynamic HTML documents, or web pages) are implemented to support navigation between focusable elements in a document by way of a mouse or other similar pointing device. Some such documents also support navigation through the focusable elements of the document according to a tab order that defines a sequential order that determines which element is focused next when a user presses a tab key.
  • focusable elements e.g., hypertext markup language (HTML) documents, dynamic HTML documents, or web pages
  • Some such documents also support navigation through the focusable elements of the document according to a tab order that defines a sequential order that determines which element is focused next when a user presses a tab key.
  • Such devices may include, but are not limited to, a television set, a cellular phone display, and a multi-modal device, such as the NOKIA 9110 Communicator. Such devices do not typically include a pointer input device, such as a mouse.
  • Rendering engines implemented on such devices may be programmed to receive an input that behaves like the press of a tab key to allow a user to move sequentially from one focusable element in a document to another.
  • cascading style sheets, dynamic HTML, and the like support dynamic rendering of documents in such a way that the visual layout of a rendered document may differ from the layout that was intended when the document was generated and possibly, when the tab order of focusable elements in the document was established. Accordingly, moving from one focusable element to another either sequentially or based on an established tab order may not result in visually logical focus navigation, and it is desirable for a rendering engine to support directional focus navigation based on directional inputs, such as an arrow key press.
  • a browser or other rendering engine that supports directional focus navigation determines focusable elements that are candidates to receive focus based on a directional input and a display layout of the focusable elements. After candidate focusable elements are identified, the rendering engine determines the most appropriate candidate, and moves the focus to that element.
  • FIG. 1 a illustrates a portion of an exemplary method for implementing directional focus navigation.
  • FIG. 1 b illustrates a portion of an exemplary method for implementing directional focus navigation.
  • FIG. 2 illustrates a view of a document with three focusable elements.
  • FIG. 3 illustrates a view of a document with several focusable elements and a table structure.
  • FIG. 4 illustrates a view of a document with several focusable elements.
  • FIG. 5 illustrates a view of a document that includes focusable areas.
  • FIG. 6 a illustrates a view of a scrollable document with several focusable elements.
  • FIG. 6 b illustrates a view of a scrollable document with several focusable elements.
  • FIG. 6 c illustrates a view of a scrollable document with several focusable elements.
  • FIG. 7 a illustrates a view of a parent document that includes a scrollable element.
  • FIG. 7 b illustrates a view of a parent document that includes a scrollable element.
  • FIG. 8 illustrates a view of two documents with focusable elements displayed using frames.
  • FIG. 9 illustrates components of an exemplary environment in which directional focus navigation may be implemented.
  • FIG. 10 illustrates select components of a client device implemented to support directional focus navigation.
  • Directional focus navigation as described herein may be implemented using a browser or other interface or rendering engine that renders documents (e.g., HTML or dynamic HTML) that may contain focusable elements to provide a mechanism for navigating among those focusable elements using directional inputs (e.g., left, right, up, and down arrow keys) instead of a traditional pointing device such as a mouse.
  • documents e.g., HTML or dynamic HTML
  • directional focus navigation may be implemented to support web site navigation using a television remote control, when an HTML rendering engine is implemented as part of a television or television set-top box.
  • directional focus navigation may be implemented to support web site navigation using a cellular telephone or multi-modal device.
  • Directional focus navigation may be described in the general context of computer-executable instructions, such as application modules, being executed by a computer.
  • application modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
  • Directional focus navigation may be implemented using any number of programming techniques and may be implemented in local computing environments or in distributed computing environments where tasks are performed by remote processing devices that are linked through various communications networks based on any number of communication protocols.
  • application modules may be located in both local and remote computer storage media including memory storage devices.
  • FIGS. 1 a and 1 b illustrate a method 100 for implementing directional focus navigation among focusable elements and/or focusable areas of a rendered document.
  • FIG. 1 a illustrates a portion of the method 100 that pertains to directional focus navigation when candidate focusable elements are within a display area associated with a document.
  • FIG. 1 b illustrates a portion of the method 100 that pertains to directional focus navigation when candidate focusable elements are not within a display area associated with a document.
  • Documents that may be rendered as described herein can be represented by a hierarchical tree structure that illustrates the relationships between elements of the document.
  • the document itself may be represented by an element (e.g., an HTML document element) that contains the other elements of the document, such as buttons, hyperlinks, tables, and so on.
  • elements within the document element may also contain other elements.
  • a table element may contain cell elements.
  • a browser receives an indication of a directional input.
  • the indication is received when a user presses an arrow key (e.g., up, down, left, or right) on a keyboard, remote control, phone keypad, or other such device.
  • an arrow key e.g., up, down, left, or right
  • the browser determines whether or not the current focus is on an element associated with the currently rendered document. If the browser determines that the current focus is not on an element associated with the document (the “No” branch from block 104 ), then at block 106 the browser identifies the first focusable element. The method continues at block 108 , setting the focus to the identified first focusable element.
  • the first focusable element of a document is a focusable element that is a child of the element representing the entire document that is displayed above and to the left of any other focusable elements that are children of the element representing the entire document.
  • the browser determines that there is a currently focused element associated with the document (the “Yes” branch from block 104 ), then at block 110 , the browser identifies the element that currently has the focus.
  • a focus candidate is a focusable element that is within the viewable area of the document and displayed at a location that is indicated by the received directional input in relation to the display location of the currently focused element. If it is determined that there is not a focus candidate associated with the current document (the “No” branch from block 112 ), then the method continues at block 122 (shown in FIG. 1 b ). On the other hand, if it is determined that there is a focus candidate associated with the current document (the “Yes” branch from block 112 ), then the method continues at block 114 .
  • the browser selects a focus candidate that is associated with the current document.
  • the browser determines whether or not the selected element is the most appropriate element to receive the focus based on the display location of the selected element in relation to the display location of the element that currently has the focus. If the selected element is an appropriate element to receive the focus based on its display location, and no other focusable element has been identified as an appropriate element, then the selected element is identified as the most appropriate element thus far. If the selected element is an appropriate element to receive the focus based on its display location, and another focusable element has previously been identified as the most appropriate element thus far, then the browser compares the locations of the two identified appropriate elements to determine which one is the most appropriate element thus far.
  • the method continues at block 118 .
  • the browser determines that the selected element is not the most appropriate element to receive the focus (the “No” branch from block 116 )
  • the method continues at block 120 .
  • the browser identifies the selected element as the element to which the focus will be given.
  • the browser determines whether or not there is another focusable element within the viewable area of the document that has not been selected as described with reference to block 114 . If the browser determines that there is another focusable element that has not been selected (the “Yes” branch from block 120 ), then the method continues at block 114 , as described above. On the other hand, if the browser determines that there are no other focusable elements that have not been selected (the “No” branch from block 120 ), then the method continues at block 108 , setting the current focus to the focusable element identified as described above with reference to block 118 .
  • the browser determines whether or not the current document is scrollable in the direction indicated by the received directional input (described above with reference to block 102 ). If the document is scrollable in the direction indicated (the “Yes” branch from block 122 ), then at block 124 the browser scrolls the document in the direction indicated. On the other hand, if the document is not scrollable in the direction indicated (the “No” branch from block 122 ), then the method continues at block 126 .
  • the browser determines whether the document associated with currently focused element is a child document associated with another parent document. If the browser determines that there is not a parent document (the “No” branch from block 126 ), then at block 128 , the method terminates with the focus remaining on the currently focused element. On the other hand, if the browser determines that there is a parent document (the “Yes” branch from block 126 ), then the method continues at block 130 .
  • the browser determines whether there are focusable elements within the viewable area of the parent document that are appropriate based on the display location of the elements in relation to the display location of the element with the current focus based on the direction indicated by the directional input. If there are no appropriate focusable elements within the viewable area of the parent (the “No” branch from block 130 ), then at block 132 the browser sets the focus to the parent document. On the other hand, if there is at least one appropriate focusable element within the viewable area of the parent document (the “Yes” branch from block 130 ), the method continues at block 134 .
  • the browser identifies the most appropriate focusable element in the parent document to receive the focus.
  • the browser sets the current focus to the element identified as described with reference to block 134 .
  • Horizontal focus navigation pertains to the moving of focus from one element to another element in response to a left or right directional input.
  • directional focus navigation when moving focus horizontally, preference is given to a focusable element with a display position that has more vertical overlap with the display position of the currently focused element over a focusable element that has less vertical overlap with the display position of the currently focused element. Details of a horizontal focus navigation implementation will be described below with reference to FIG. 2 .
  • FIG. 2 illustrates a view of a document that includes three focusable elements.
  • Box 202 represents the viewable area supported by a rendering engine.
  • Box 204 represents the document.
  • Hyperlink 206 is the element that currently has the focus (indicated by the dashed box).
  • the rendering engine receives a right directional input (e.g., a user presses a right arrow key)
  • the rendering engine determines which, if any, of the other focusable elements (i.e., hyperlink 208 or hyperlink 210 ) is the most appropriate element to receive the focus next. (This process is described above with reference to blocks 102 - 120 shown in FIG. 1 a .)
  • E is considered a focus candidate (an appropriate element to receive focus) when the directional input indicates moving focus to the right:
  • Comparing the horizontal midpoints provides a mechanism for handling the special case in which two focusable elements have overlapping display areas.
  • hyperlinks 208 and 210 both qualify as appropriate elements to receive focus when a right directional input is received while the current focus is on hyperlink 206 .
  • the browser compares the elements that qualify as appropriate elements to receive the focus to determine the most appropriate element to receive the focus.
  • element E is determined to be the most appropriate element to receive the focus when a right directional input is received if any of the following is true:
  • hyperlink 208 is determined to be the most appropriate element to receive the focus in response to a right directional input when hyperlink 206 is the element that currently has the focus because although hyperlink 210 is horizontally closer to the currently focused element, hyperlink 208 vertically overlaps hyperlink 206 and hyperlink 210 does not vertically overlap hyperlink 206 .
  • E is considered an appropriate element to receive focus when the directional input indicates moving focus to the left:
  • Element E is determined to be the most appropriate element to receive the focus when compared to element W when a left directional input is received if any of the following is true:
  • Vertical focus navigation pertains to the moving of focus from one element to another element in response to an up or down directional input.
  • directional focus navigation when moving focus vertically, preference is first given to a focusable element that is structurally close to the element that currently has the focus. Preference is next given to a focusable element that has horizontal coordinates closest to the horizontal coordinates of the last element that got focus by means other than an up or down directional input. Details of a vertical focus navigation implementation will be described below with reference to FIGS. 3 and 4 .
  • FIG. 3 illustrates a view of a document that includes several focusable elements, including a table structure.
  • Box 302 represents the viewable area supported by the browser.
  • Box 304 represents the document.
  • Table 306 is table structure within document 304 .
  • Cell 4 308 is the element that currently has the focus (indicated by the dashed box) and cell 7 310 is another cell in table 306 that is also a focusable element.
  • Button 312 is another focusable element within document 304 that is not within table structure 306 .
  • Documents that can be rendered using a rendering engine can be defined in terms of hierarchical tree structure of elements.
  • the document 304 illustrated in FIG. 3 can be described in terms of a tree structure in which the document itself is the root element of the tree structure.
  • Table 306 and button 312 are child elements of the root element.
  • Cell 4 308 and cell 7 310 are focusable elements that are children of the table element in the tree structure.
  • the rendering engine determines which, if any, of the other focusable elements (i.e., hyperlink 310 or button 312 ) is the most appropriate element to receive the focus next. (This process is described above with reference to blocks 102 - 120 shown in FIG. 1 a. )
  • E is considered an appropriate element to receive focus when the directional input indicates moving focus down:
  • hyperlink 310 and button 312 both qualify as appropriate elements to receive focus when a down directional input is received while the focus is on hyperlink 308 .
  • the browser compares the elements that qualify as appropriate elements to receive the focus to determine the most appropriate element to receive the focus.
  • element E is determined to be the most appropriate element to receive the focus when a down directional input is received if any of the following is true:
  • hyperlinked Cell 7 310 is determined to be the most appropriate element to receive the focus in response to a down directional input when hyperlinked Cell 4 308 is the element that currently has the focus.
  • Hyperlinked Cell 7 310 is given preference because although focusable button 312 is vertically closer to hyperlink 308 , hyperlinked Cell 7 310 is structurally closer to hyperlinked Cell 4 308 based on the element tree structure that represents document 304 .
  • hyperlink 310 is selected as the next element to receive focus because it has the closest ancestor element in common with the currently focused element, according to an element tree structure that represents the document.
  • FIG. 4 illustrates a view of a document that includes several focusable elements that are structurally equivalent based on an element tree structure representation of the elements in the document.
  • hyperlink 406 is the element that currently has focus (indicated by the dashed line).
  • hyperlink 406 received the focus based on something other than an up or down directional input.
  • hyperlink 406 may have been given the focus when the document was initially rendered or in response to a left or right directional input.
  • the rendering engine receives a down directional input (e.g., a user presses a down arrow key)
  • the rendering engine determines, based on the equations described above, the most appropriate focusable element to receive the focus in response to the down directional input.
  • Link 02 -Link 22 are all identified as appropriate elements to receive focus in response to the down directional input because each is within the focusable area of the document (indicated by box 402 ), the midpoint of each is below the midpoint of the currently focused element, and the top of each is below the bottom of the currently focused element.
  • element 408 is given focus because it is vertically closer to the currently focused element 406 than any of the other elements that were determined appropriate for receiving focus.
  • Link 03 -Link 22 are all identified as appropriate elements to receive focus because they are below the currently focused element, 408 . Because they are vertically closer to the currently focused element, Link 03 and Link 04 are given preference.
  • the rendering engine compares the horizontal location of each with the horizontal location of the element that had focus when the up/down navigation began, which is hyperlink 406 . Because Link 04 is horizontally closer to hyperlink 406 than is Link 03 , hyperlink 410 (Link 04 ) is given the focus in response to a down directional input received when the focus is on hyperlink 408 .
  • Link 05 -Link 22 are all identified as appropriate elements to receive focus because they are below the currently focused element, 410 . Because they are vertically closer to the currently focused element, Link 05 -Link 07 are given preference.
  • the rendering engine compares the horizontal location of each with the horizontal location of the element that had focus when the up/down navigation began, which is hyperlink 406 . Because Link 07 is horizontally closer to hyperlink 406 than are Link 05 or Link 06 , hyperlink 412 (Link 07 ) is given the focus in response to a down directional input received when the focus is on hyperlink 410 .
  • E is considered an appropriate element to receive focus when the directional input indicates moving focus up:
  • Element E is determined to be the most appropriate element to receive the focus when an up directional input is received if any of the following is true:
  • a rendering engine as described herein can be implemented to support directional focus navigation across arbitrarily shaped areas, such as areas defined for an image map.
  • FIG. 5 illustrates a rendered view of a document that includes an image map of the United States of America in which each state is a focusable area.
  • Area 502 is the area that currently has the focus (indicated by the solid outline).
  • the rendering engine receives a directional input (e.g., a user presses a right arrow key)
  • the rendering engine determines which, if any, of the other focusable areas (i.e., the other focusable areas in the image map) is the most appropriate area to receive the focus next. (This process is described above with reference to blocks 102 - 120 shown in FIG. 1 a. )
  • E is considered an appropriate area to receive focus when the directional input indicates moving focus to the right:
  • the browser compares the elements (or areas) that qualify as appropriate elements (or areas) to receive the focus to determine the most appropriate element (or area) to receive the focus.
  • area E is determined to be the most appropriate area to receive the focus when a right directional input is received if the distance between a representative point of E and a representative point of F is shorter than the distance between the representative point of F and any of the other appropriate elements or areas to receive focus.
  • the representative point of an area has a horizontal coordinate and a vertical coordinate.
  • the horizontal coordinate of the representative point of an area is the average of the horizontal coordinates of all of the points of the area
  • the vertical coordinate of the representative point is the average of the vertical coordinates of all of the points of the area.
  • the representative point of an area may be the midpoint of a particular side of the area.
  • E is considered an appropriate area to receive focus when the directional input indicates moving focus to the left:
  • area E is determined to be the most appropriate area to receive the focus when a left directional input is received if the distance between the representative point of E and the representative point of F is shorter than the distance between the representative point of F and any of the other appropriate elements or areas to receive focus.
  • E is considered an appropriate area to receive focus when the directional input indicates moving focus down:
  • the browser compares the elements (or areas) that qualify as appropriate elements (or areas) to receive the focus to determine the most appropriate element (or area) to receive the focus. Similar to the implementation described above for horizontal focus navigation across arbitrarily shaped areas, area E is determined to be the most appropriate area to receive the focus when a down directional input is received if the distance between the representative point of E and a vertical representative point of F is shorter than the distance between the vertical representative point of F and any of the other appropriate elements or areas to receive focus.
  • the representative point of an area has a horizontal coordinate and a vertical coordinate.
  • the horizontal component of the representative point of F is derived from the horizontal coordinate of the representative point of the element that had the focus when the first of the current sequence of up and/or down directional inputs was received.
  • E is considered an appropriate area to receive focus when the directional input indicates moving focus up:
  • Area E is determined to be the most appropriate area to receive the focus when an up directional input is received if the distance between the representative point of E and a vertical representative point of F is shorter than the distance between the vertical representative point of F and any of the other appropriate elements or areas to receive focus.
  • FIG. 6 a illustrates a scrollable document that includes focusable elements.
  • Window 602 represents a display area
  • box 604 represents the document.
  • the document 604 is vertically larger than the display area 602 . To view portions of the document 604 that are outside of the display area 602 , the document can be scrolled.
  • the browser in response to directional input (e.g., an arrow key press), if the document currently being rendered is scrollable, then the browser scrolls the document in the direction indicated by the directional input.
  • directional input e.g., an arrow key press
  • the browser can move focus from one focusable element to another, as described above, or can cause the document to scroll in the direction indicated by the directional input.
  • focus is moved from hyperlink 606 to hyperlink 608 . If the rendering engine receives another down directional input, focus moves from hyperlink 608 to hyperlink 610 . If the rendering engine then receives another down directional input, focus does not move from hyperlink 610 because there is not another focusable element below hyperlink 610 and within the displayable area. Because there is not another focusable element below and within the displayable area, the browser scrolls the document based on the down directional input.
  • FIG. 6 b illustrates the scrollable document that is described above with respect to FIG. 6 a , after the above-described down directional inputs are received by the browser and the browser has scrolled the document until hyperlink 612 is within the displayable area 602 . If focus is on hyperlink 610 and the rendering engine receives another down directional input, then focus is moved to hyperlink 612 . If the rendering engine then receives another down directional input, focus does not move from hyperlink 612 because there is not another focusable element below hyperlink 612 and within the displayable area. Because there is not another focusable element below and within the displayable area, the browser scrolls the document according to the directional input.
  • the browser in response to a directional input, may both scroll and move focus. For example, if a browser receives a down directional input, and the only focus candidate element is located outside the viewable area, the browser may scroll the document in the down direction until the focus candidate is within the viewable area, and then move focus to that element.
  • FIG. 6 c illustrates the scrollable document that is described above with respect to FIGS. 6 a and 6 b , after the above-described down directional inputs are received by the browser and the browser has scrolled the document until the lower-most point of the document is within the displayable area 602 .
  • FIG. 7 a illustrates a document that includes focusable elements where one of the focusable elements is scrollable and contains other focusable elements.
  • Document 702 includes focusable elements 704 (a hyperlink), 706 (a scrollable frame), and 708 (a button).
  • Element 706 is representative of any scrollable element, which, in HTML, may include, but is not limited to, frame elements, object elements, div elements, and iframe elements.
  • Document 710 is displayed in scrollable frame 706 and includes focusable elements 712 , 714 , 716 , and 718 (all hyperlinks). Assuming in this example that the browser or rendering engine that is rendering document 702 receives several sequential down directional inputs.
  • scrollable frame 706 Assuming that focus is initially on hyperlink 702 (as indicated by the dashed line), when the browser receives the first down directional input, the browser identifies scrollable frame 706 as the most appropriate element to receive the focus. Because scrollable frame 706 includes focusable elements, the focus moves to the first identified focusable element in document 710 , which is hyperlink 712 .
  • the browser When the browser receives a third down directional input, the focus remains on hyperlink 714 and the browser scrolls document 710 . Depending on the amount that document 710 is scrolled, several down directional inputs may be received before 716 is scrolled into the displayable area (indicated by the boundaries of scrollable frame 706 ). Once 716 is within the displayable area, when another down directional input is received, focus moves to hyperlink 716 .
  • a similar process of receiving down directional inputs and scrolling is repeated until hyperlink 718 is within the displayable area, and then in response to the next down directional input hyperlink 718 receives the focus.
  • hyperlink 718 Once hyperlink 718 has focus, additional down directional inputs will continue to scroll document 710 (while the focus remains on hyperlink 718 ) until the lowermost portion of document 710 is within the displayable area.
  • FIG. 7 b illustrates the visual state of document described with reference to FIG. 7 a after the described down directional inputs are received and processed.
  • the browser receives an additional down directional input, focus moves from hyperlink 718 to button 708 .
  • the browser determines that there is not another focusable element below hyperlink 718 and within the displayable area of document 710 , and the browser determines that document 710 cannot be scrolled in the down direction any further. Accordingly, the browser identifies button 708 as the next focusable element below scrollable frame 706 in document 710 .
  • FIG. 8 illustrates a rendered view of two documents that include focusable elements that are displayed using frames.
  • Documents 802 and 804 are displayed in frames 806 and 808 , respectively.
  • Document 802 includes hyperlinks 810 , 812 , 814 , and 816 .
  • Document 804 includes hyperlink 818 .
  • hyperlink 812 when a browser application that is rendering the document receives a down directional input, focus moves to hyperlink 814 .
  • hyperlink 812 when a browser application that is rendering the document receives a right directional input, focus moves to hyperlink 818 because even though it is associated with a different document, it is the first focusable element that has a display location that is to the right of hyperlink 812 .
  • Some focusable elements may, as a standard, exhibit a particular behavior in response to directional input. For example, if a pop-up menu has focus and a user presses a down arrow key, the next element down in the menu may become highlighted, indicated that it is the currently selected menu item. As another example, if a text box has focus and a user presses a right arrow key, a cursor in the text box may shift one character to the right.
  • the browser application is implemented to support directional focus navigation while allowing standard behavior in those focusable elements that may respond in and of themselves to directional input.
  • the browser may be implemented such that when an element has focus, a user can send a “select” input to indicate that directional inputs from that point on are to be directed to the focused element.
  • a subsequent “select” input can be used to indicate that directional inputs from that point are to be directed to the document in such a way that they drive focus navigation.
  • a user may press the Enter key (or other designated “select” input device) to select the pop-up menu as the element that will be affected by subsequent directional input.
  • the Enter key or other designated “select” input device
  • the user may press the Enter key again to indicate that a selection has been made and to signify to the browser that additional directional inputs will now drive focus navigation.
  • the user may press the Escape key (or other designated “cancel” input device).
  • FIG. 9 is a block diagram of an example client device 902 , display device 904 , and various input devices that interact with the client device.
  • Client device 902 may also be referred to as a set-top box, game console or a satellite receiver.
  • Client device 902 includes a wireless receiving port 906 (e.g., an infrared (IR) wireless port) for receiving wireless communications from a remote control device 908 , a handheld device 910 (such as a personal digital assistant (PDA) or handheld computer), or other wireless device, such as a wireless keyboard. Additionally, a wired keyboard 912 is coupled to client device 902 for communicating with the client device.
  • remote control device 908 , handheld device 910 , and/or keyboard 912 may us an RF communication link (or other mode of transmission) to communicate with client device 902 .
  • client device 902 , display device 904 , and an input device may be implemented as a single hardware unit, such as a cellular telephone or as a handheld device similar to handheld device 910 .
  • directional inputs are provided by pressing keys arrow keys 914 of remote control 908 , arrow keys or other inputs associated with handheld device 910 , or arrow keys 916 of keyboard 912 .
  • Such keys might comprise four orthogonal direction keys (up, down, left, and right), or might allow movement in additional directions.
  • a particular input device might utilize a joystick or similar mechanism for directional input, and such an input device might provide increased angular granularity as opposed to the four-direction granularity provided by four orthogonal direction keys.
  • FIG. 10 is a block diagram illustrating select components of a client device implemented to support directional focus navigation as described herein.
  • Client device 902 may be implemented as, but is not limited to, a personal computer system, a cellular telephone, a personal multi-modal device, a television, or a television set-top box.
  • Client device 902 includes a processor 1002 , a memory 1004 , a display interface 1006 , an audio output 1008 , and a video output 1010 .
  • Operating system 1012 , rendering engine 1014 , and other applications 1016 are stored in memory 1004 and executed on processor 1002 .
  • Display interface 1006 provides a mechanism for client device 902 to display documents rendered by rendering engine 1014 .
  • rendering engine 1014 includes directional input interface 1018 for receiving directional input, candidate element identifier 1020 for identifying focusable elements that may receive focus based on received directional input, and optimal element selector 1022 for selecting an optimal focusable element to receive focus when multiple candidate elements are selected based on received directional input.

Abstract

A rendering engine that supports directional focus navigation, in response to a directional input, shifts the focus to an appropriate focusable element. The rendering engine determines one or more focusable elements that are candidates to receive the focus based on the received directional input and based on the relative display locations of the focusable elements. The rendering engine selects the most appropriate candidate focusable element based on each candidate element's display location in relation to the display location of the element that currently has focus.

Description

RELATED APPLICATIONS
This U.S. Non-Provisional Application for Letters Patent claims the benefit of priority under 35 U.S.C. §120 as a continuation of U.S. patent application Ser. No. 11/380,905, filed Apr. 28, 2006, and titled “Directional Focus Navigation”, which claims the benefit of priority to U.S. Pat. No. 7,134,089, filed Nov. 13, 2002, and titled “Directional Focus Navigation”, the entire disclosure of which is hereby incorporated by reference in its entirety.
TECHNICAL FIELD
This invention relates to focus navigation and, in particular, to directional focus navigation.
BACKGROUND
A graphical user interface (GUI) may include multiple elements that can receive input. The target of the input is said to have focus, and elements eligible for focus within a document are called focusable elements. In a GUI, input that is received is processed according to an element that currently has focus. For example, if a GUI contains two editable text boxes, when a user enters text through a keyboard, the text is rendered in the text box that currently has focus.
In a GUI that receives input from a pointing device, such as a mouse, the currently focused element is determined based on the location of a cursor or pointer when a user submits a select command (e.g., clicks a mouse button). If the cursor or pointer is over a text box when the user clicks the mouse button, then that text box is given focus and future input, such as through a keyboard, is directed to the text box until the focus is moved to another element.
In a GUI that receives input from devices without pointing mechanisms, such as keyboards or remote controls, an alternative mechanism is implemented to allow a user to specify an element to be given focus, and thus, the target of keyboard (or other device) input.
Browser or other rendering engine applications that provide a mechanism for displaying documents that include focusable elements (e.g., hypertext markup language (HTML) documents, dynamic HTML documents, or web pages) are implemented to support navigation between focusable elements in a document by way of a mouse or other similar pointing device. Some such documents also support navigation through the focusable elements of the document according to a tab order that defines a sequential order that determines which element is focused next when a user presses a tab key.
Recently introduced technology allows web pages (and potentially other types of documents that may include focusable elements) to be rendered using devices other than computers. These other devices may include, but are not limited to, a television set, a cellular phone display, and a multi-modal device, such as the NOKIA 9110 Communicator. Such devices do not typically include a pointer input device, such as a mouse.
Rendering engines implemented on such devices may be programmed to receive an input that behaves like the press of a tab key to allow a user to move sequentially from one focusable element in a document to another. However, cascading style sheets, dynamic HTML, and the like support dynamic rendering of documents in such a way that the visual layout of a rendered document may differ from the layout that was intended when the document was generated and possibly, when the tab order of focusable elements in the document was established. Accordingly, moving from one focusable element to another either sequentially or based on an established tab order may not result in visually logical focus navigation, and it is desirable for a rendering engine to support directional focus navigation based on directional inputs, such as an arrow key press.
SUMMARY
Directional focus navigation is described. A browser or other rendering engine that supports directional focus navigation determines focusable elements that are candidates to receive focus based on a directional input and a display layout of the focusable elements. After candidate focusable elements are identified, the rendering engine determines the most appropriate candidate, and moves the focus to that element.
BRIEF DESCRIPTION OF THE DRAWINGS
The same numbers are used throughout the drawings to reference like features and components.
FIG. 1 a illustrates a portion of an exemplary method for implementing directional focus navigation.
FIG. 1 b illustrates a portion of an exemplary method for implementing directional focus navigation.
FIG. 2 illustrates a view of a document with three focusable elements.
FIG. 3 illustrates a view of a document with several focusable elements and a table structure.
FIG. 4 illustrates a view of a document with several focusable elements.
FIG. 5 illustrates a view of a document that includes focusable areas.
FIG. 6 a illustrates a view of a scrollable document with several focusable elements.
FIG. 6 b illustrates a view of a scrollable document with several focusable elements.
FIG. 6 c illustrates a view of a scrollable document with several focusable elements.
FIG. 7 a illustrates a view of a parent document that includes a scrollable element.
FIG. 7 b illustrates a view of a parent document that includes a scrollable element.
FIG. 8 illustrates a view of two documents with focusable elements displayed using frames.
FIG. 9 illustrates components of an exemplary environment in which directional focus navigation may be implemented.
FIG. 10 illustrates select components of a client device implemented to support directional focus navigation.
DETAILED DESCRIPTION
The following discussion is directed to directional focus navigation among focusable elements of a document. Directional focus navigation as described herein may be implemented using a browser or other interface or rendering engine that renders documents (e.g., HTML or dynamic HTML) that may contain focusable elements to provide a mechanism for navigating among those focusable elements using directional inputs (e.g., left, right, up, and down arrow keys) instead of a traditional pointing device such as a mouse. For example, directional focus navigation may be implemented to support web site navigation using a television remote control, when an HTML rendering engine is implemented as part of a television or television set-top box. In another example, directional focus navigation may be implemented to support web site navigation using a cellular telephone or multi-modal device.
Method For Directional Focus Navigation
Directional focus navigation may be described in the general context of computer-executable instructions, such as application modules, being executed by a computer. Generally, application modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Directional focus navigation may be implemented using any number of programming techniques and may be implemented in local computing environments or in distributed computing environments where tasks are performed by remote processing devices that are linked through various communications networks based on any number of communication protocols. In such a distributed computing environment, application modules may be located in both local and remote computer storage media including memory storage devices.
FIGS. 1 a and 1 b illustrate a method 100 for implementing directional focus navigation among focusable elements and/or focusable areas of a rendered document. FIG. 1 a illustrates a portion of the method 100 that pertains to directional focus navigation when candidate focusable elements are within a display area associated with a document. FIG. 1 b illustrates a portion of the method 100 that pertains to directional focus navigation when candidate focusable elements are not within a display area associated with a document.
Documents that may be rendered as described herein can be represented by a hierarchical tree structure that illustrates the relationships between elements of the document. For example, the document itself may be represented by an element (e.g., an HTML document element) that contains the other elements of the document, such as buttons, hyperlinks, tables, and so on. Per the hierarchical structure, elements within the document element may also contain other elements. For example, a table element may contain cell elements. When a document is first rendered, the focus is given to some element associated with the document. That element may be the document element, or it may be any other focusable element contained within the document element
At block 102, a browser (or other type of rendering application) receives an indication of a directional input. For example, the indication is received when a user presses an arrow key (e.g., up, down, left, or right) on a keyboard, remote control, phone keypad, or other such device.
At block 104 the browser determines whether or not the current focus is on an element associated with the currently rendered document. If the browser determines that the current focus is not on an element associated with the document (the “No” branch from block 104), then at block 106 the browser identifies the first focusable element. The method continues at block 108, setting the focus to the identified first focusable element. In the described implementation, the first focusable element of a document is a focusable element that is a child of the element representing the entire document that is displayed above and to the left of any other focusable elements that are children of the element representing the entire document.
If the browser determines that there is a currently focused element associated with the document (the “Yes” branch from block 104), then at block 110, the browser identifies the element that currently has the focus.
At block 112 the browser determines whether a focus candidate exists. In the described implementation, a focus candidate is a focusable element that is within the viewable area of the document and displayed at a location that is indicated by the received directional input in relation to the display location of the currently focused element. If it is determined that there is not a focus candidate associated with the current document (the “No” branch from block 112), then the method continues at block 122 (shown in FIG. 1 b). On the other hand, if it is determined that there is a focus candidate associated with the current document (the “Yes” branch from block 112), then the method continues at block 114.
At block 114 the browser selects a focus candidate that is associated with the current document.
At block 116 the browser determines whether or not the selected element is the most appropriate element to receive the focus based on the display location of the selected element in relation to the display location of the element that currently has the focus. If the selected element is an appropriate element to receive the focus based on its display location, and no other focusable element has been identified as an appropriate element, then the selected element is identified as the most appropriate element thus far. If the selected element is an appropriate element to receive the focus based on its display location, and another focusable element has previously been identified as the most appropriate element thus far, then the browser compares the locations of the two identified appropriate elements to determine which one is the most appropriate element thus far. If the browser determines that the selected element is the most appropriate element to receive the focus (the “Yes” branch from block 116), then the method continues at block 118. On the other hand, if the browser determines that the selected element is not the most appropriate element to receive the focus (the “No” branch from block 116), then the method continues at block 120.
At block 118, the browser identifies the selected element as the element to which the focus will be given.
At block 120 the browser determines whether or not there is another focusable element within the viewable area of the document that has not been selected as described with reference to block 114. If the browser determines that there is another focusable element that has not been selected (the “Yes” branch from block 120), then the method continues at block 114, as described above. On the other hand, if the browser determines that there are no other focusable elements that have not been selected (the “No” branch from block 120), then the method continues at block 108, setting the current focus to the focusable element identified as described above with reference to block 118.
As described above with reference to block 112, if the browser determines that there is not another focusable element within the viewable area of the document, then at block 122 (shown in FIG. 1 b), the browser determines whether or not the current document is scrollable in the direction indicated by the received directional input (described above with reference to block 102). If the document is scrollable in the direction indicated (the “Yes” branch from block 122), then at block 124 the browser scrolls the document in the direction indicated. On the other hand, if the document is not scrollable in the direction indicated (the “No” branch from block 122), then the method continues at block 126.
At block 126 the browser determines whether the document associated with currently focused element is a child document associated with another parent document. If the browser determines that there is not a parent document (the “No” branch from block 126), then at block 128, the method terminates with the focus remaining on the currently focused element. On the other hand, if the browser determines that there is a parent document (the “Yes” branch from block 126), then the method continues at block 130.
At block 130 the browser determines whether there are focusable elements within the viewable area of the parent document that are appropriate based on the display location of the elements in relation to the display location of the element with the current focus based on the direction indicated by the directional input. If there are no appropriate focusable elements within the viewable area of the parent (the “No” branch from block 130), then at block 132 the browser sets the focus to the parent document. On the other hand, if there is at least one appropriate focusable element within the viewable area of the parent document (the “Yes” branch from block 130), the method continues at block 134.
At block 134 the browser identifies the most appropriate focusable element in the parent document to receive the focus.
At block 136 the browser sets the current focus to the element identified as described with reference to block 134.
Horizontal Focus Navigation
Horizontal focus navigation pertains to the moving of focus from one element to another element in response to a left or right directional input. In an implementation of directional focus navigation, when moving focus horizontally, preference is given to a focusable element with a display position that has more vertical overlap with the display position of the currently focused element over a focusable element that has less vertical overlap with the display position of the currently focused element. Details of a horizontal focus navigation implementation will be described below with reference to FIG. 2.
Right Directional Input
FIG. 2 illustrates a view of a document that includes three focusable elements. Box 202 represents the viewable area supported by a rendering engine. Box 204 represents the document. Hyperlink 206 is the element that currently has the focus (indicated by the dashed box). When the rendering engine receives a right directional input (e.g., a user presses a right arrow key), the rendering engine determines which, if any, of the other focusable elements (i.e., hyperlink 208 or hyperlink 210) is the most appropriate element to receive the focus next. (This process is described above with reference to blocks 102-120 shown in FIG. 1 a.)
The following mathematical definitions will be used below in horizontal focus navigation equations that may be used in an implementation of a rendering engine that supports directional focus navigation:
    • F=element that has the current focus
    • E=focusable element that is being evaluated
    • W=focusable element that is currently identified as the most appropriate focusable element to receive the focus so far
    • x.left=the left coordinate of the display location of element x
    • x.right=the right coordinate of the display location of element x
    • x.top=the top coordinate of the display location of element x
    • x.bottom=the bottom coordinate of the display location of element x
    • x.width=x.right−x.left
    • x.height=x.bottom−x.top
    • x.mid=x.left+(x.width)/2
    • x.vertoverlap=min(z, x.height, F.height), where:
      • z=min(x.bottom−F.top, F.bottom−x.top)
    • x.%vertoverlap=(x.vertoverlap)/(x.height)
The above (and all following) equations are written using the assumption that the display area can be mapped to a two-dimensional grid in which the upper-left-most corner has (x, y) coordinates (0, 0).
If a focusable element E meets the following criteria, then E is considered a focus candidate (an appropriate element to receive focus) when the directional input indicates moving focus to the right:
    • E is within the displayable area of the document.
    • E.mid>F.mid
      • (The midpoint of E is to the right of the midpoint of F.)
    • (F.bottom−E.bottom)<=LaxHeight1 OR
      • (F.top−E.top)<=LaxHeight1, where LaxHeight1 is a configurable tolerance value used to compare the vertical display locations of element E and element F. In the described implementation, LaxHeight1 is derived from F.height and E.height, such as LaxHeight1=(max(F.height, E.height))/4.
      • (E is at the same level or below F, or E is above F by no more than LaxHeight1.)
Comparing the horizontal midpoints (E.mid>F.mid) provides a mechanism for handling the special case in which two focusable elements have overlapping display areas.
Given the document illustrated in FIG. 2, hyperlinks 208 and 210 both qualify as appropriate elements to receive focus when a right directional input is received while the current focus is on hyperlink 206.
As described above with reference to block 116 shown in FIG. 1, the browser compares the elements that qualify as appropriate elements to receive the focus to determine the most appropriate element to receive the focus. In this implementation, element E is determined to be the most appropriate element to receive the focus when a right directional input is received if any of the following is true:
    • E.vertoverlap>=0 AND W.vertoverlap<0
      • (E vertically overlaps F, but W does not vertically overlap F.)
    • E.vertoverlap<0 AND W.vertoverlap<0 AND
      • E.vertoverlap>W.vertoverlap
      • (Neither E nor W vertically overlaps F, but E is vertically closer to F.)
    • abs(E.vertoverlap−W.vertoverlap)<=LaxHeight2 AND E.left<W.left, where LaxHeight2 is a configurable tolerance value used to compare the vertical overlap of E and W with respect to F. In the described implementation, LaxHeight2 is derived from the heights of each of the elements involved in the comparison, such as LaxHeight2=(min(F.height, E.height, W.height))/3.
      • (E and W have similar overlap values, but E is horizontally closer to F.)
    • E.vertoverlap>(W.vertoverlap+LaxHeight2) AND ((E.left<W.left)
      • (E has a greater vertical overlap and E is horizontally closer to F.)
    • E.vertoverlap>(W.vertoverlap+LaxHeight2) AND
      • (E.%vertoverlap>W.%vertoverlap)
      • (E has a greater vertical overlap and E has a greater percentage vertical overlap.)
    • (E.left<W.left) AND (E.%vertoverlap >W.%vertoverlap)
      • (E is horizontally closer to F and E has a greater percentage vertical overlap.)
In this implementation, preference is given to an element that vertically overlaps the currently focused element because most documents have a visual layout that suggests reading the document first from left to right and then from top to bottom. In alternate implementations, the specific algorithm can be modified to support other document layouts. Given the calculations above, in the document shown in FIG. 2, hyperlink 208 is determined to be the most appropriate element to receive the focus in response to a right directional input when hyperlink 206 is the element that currently has the focus because although hyperlink 210 is horizontally closer to the currently focused element, hyperlink 208 vertically overlaps hyperlink 206 and hyperlink 210 does not vertically overlap hyperlink 206.
Left Directional Input
Similarly, if a focusable element E meets the following criteria, then E is considered an appropriate element to receive focus when the directional input indicates moving focus to the left:
    • E is within the displayable area of the document.
    • E.mid<F.mid
      • (The midpoint of E is to the left of the midpoint of F.)
    • (E.bottom−F.bottom)<=LaxHeight1 OR (E.top−F.top)<=LaxHeight1, where LaxHeight1 is a configurable tolerance value used to compare the vertical display locations of element E and element F. In the described implementation, LaxHeight1 is derived from F.height and E.height, such as LaxHeight1=(max(F.height, E.height))/4.
      • (E is at the same level or above F, or E is below F by no more than LaxHeight1.)
Element E is determined to be the most appropriate element to receive the focus when compared to element W when a left directional input is received if any of the following is true:
    • E.vertoverlap>=0 AND W.vertoverlap<0
      • (E vertically overlaps F but W does not vertically overlap F.)
    • E.vertoverlap<0 AND W.vertoverlap<0 AND E.vertoverlap>W.vertoverlap
      • (Neither E nor W vertically overlap F, but E is vertically closer to F)
    • abs(E.vertoverlap−W.vertoverlap)<=LaxHeight2 AND E.right>W.right, where LaxHeight2 is a configurable tolerance value used to compare the vertical overlap of E and W with respect to F. In the described implementation, LaxHeight2 is derived from the heights of each of the elements involved in this comparison, such as LaxHeight2=(min(F.height, E.height, W.height))/3.
      • (E and W have similar overlap values, but E is horizontally closer to F)
    • E.vertoverlap>(W.vertoverlap+LaxHeight2) AND ((E.right>W.right)
      • (E has a greater vertical overlap and E is horizontally closer to F.)
    • E.vertoverlap>(W.vertoverlap+LaxHeight2)
      • AND (E.%vertoverlap>W.%vertoverlap)
      • (E has a greater vertical overlap and E has a greater percentage vertical overlap.)
    • (E.right>W.right) AND (E.%vertoverlap>W.%vertoverlap)
      • (E is horizontally closer to F and E has a greater percentage vertical overlap.)
Vertical Focus Navigation
Vertical focus navigation pertains to the moving of focus from one element to another element in response to an up or down directional input. In an implementation of directional focus navigation, when moving focus vertically, preference is first given to a focusable element that is structurally close to the element that currently has the focus. Preference is next given to a focusable element that has horizontal coordinates closest to the horizontal coordinates of the last element that got focus by means other than an up or down directional input. Details of a vertical focus navigation implementation will be described below with reference to FIGS. 3 and 4.
Down Directional Input
FIG. 3 illustrates a view of a document that includes several focusable elements, including a table structure. Box 302 represents the viewable area supported by the browser. Box 304 represents the document. Table 306 is table structure within document 304. Cell4 308 is the element that currently has the focus (indicated by the dashed box) and cell7 310 is another cell in table 306 that is also a focusable element. Button 312 is another focusable element within document 304 that is not within table structure 306.
Documents that can be rendered using a rendering engine can be defined in terms of hierarchical tree structure of elements. For example, the document 304 illustrated in FIG. 3, can be described in terms of a tree structure in which the document itself is the root element of the tree structure. Table 306 and button 312 are child elements of the root element. Cell4 308 and cell7 310 are focusable elements that are children of the table element in the tree structure.
When the rendering engine receives a down directional input (e.g., a user presses a down arrow key), the rendering engine determines which, if any, of the other focusable elements (i.e., hyperlink 310 or button 312) is the most appropriate element to receive the focus next. (This process is described above with reference to blocks 102-120 shown in FIG. 1 a.)
The following mathematical definitions will be used below in vertical focus navigation equations that may be used in an implementation of a rendering engine that supports directional focus navigation:
    • F=element that has the current focus;
    • E=focusable element that is being evaluated;
    • W=focusable element that is currently identified as the most appropriate focusable element to receive the focus so far;
    • x.left=the left coordinate of the display location of element x;
    • x.right=the right coordinate of the display location of element x;
    • x.top=the top coordinate of the display location of element x;
    • x.bottom=the bottom coordinate of the display location of element x;
    • x.width=x.right−x.left;
    • x.height=x.bottom−x.top;
    • x.mid=x.top+(x.height)/2;
    • x.DistanceToCommonAncestor=the number of hierarchical levels, according to an element tree structure, between element x and the closest ancestor element that is common to both element x and element F;
    • CurrentLeft=the left coordinate of the last element that got focus by means other than an up or down directional input;
    • CurrentRight=the right coordinate of the last element that got focus by means other than an up or down directional input; and
    • x.horizoverlap=min(x.right−CurrentLeft, CurrentRight−x.left).
The above (and all following) equations are written using the assumption that the display area can be mapped to a two-dimensional grid in which the upper-left-most corner has (x, y) coordinates (0, 0).
If a focusable element E meets the following criteria, then E is considered an appropriate element to receive focus when the directional input indicates moving focus down:
    • E is within the displayable area of the document;
    • (F.bottom−E.top)<LaxHeight3, where LaxHeight3 is a configurable tolerance value used to compare the vertical display locations of element E and element F. In the described implementation, LaxHeight3 is derived from F.height and E.height, such as LaxHeight3=(min(F.height, E.height))/4.
      • (E is lower than F or the top edge of E is above the bottom edge of F by no more than LaxHeight3.)
Given the document illustrated in FIG. 3, hyperlink 310 and button 312 both qualify as appropriate elements to receive focus when a down directional input is received while the focus is on hyperlink 308.
As described above with reference to block 116 shown in FIG. 1, the browser compares the elements that qualify as appropriate elements to receive the focus to determine the most appropriate element to receive the focus. In this implementation, element E is determined to be the most appropriate element to receive the focus when a down directional input is received if any of the following is true:
    • E.DistanceToCommonAncestor>W.DistanceToCommonAncestor
      • (E is structurally closer to F.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (W.bottom−E.top>=compareHeight) AND (E.horizoverlap >W.horizoverlap), where compareHeight is a configurable tolerance value used to compare the vertical display locations of element E and element W. In the described implementation, compareHeight is derived from the heights of element E and element W, such as compareHeight=(min(E.height, W.height))/4.
      • (E is structurally equal to W, E is vertically closer to F (or the vertical distance between E and F is approximately equal to the vertical distance between W and F), and E has more horizontal overlap with the element that had focus when up/down navigation began than does W.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (W.bottom−E.top>=compareHeight AND (W.width>=E.width) AND (W.left<=E.left), where compareHeight is a configurable tolerance value used to compare the vertical display locations of element E and element W. In the described implementation, compareHeight is derived from the heights of element E and element W, such as compareHeight=(min(E.height, W.height))/4.
      • (E is structurally equal to W, E is vertically closer to F (or the vertical distance between E and F is approximately equal to the vertical distance between W and F), and W horizontally contains E.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (W.bottom−E.top>=compareHeight AND (E.width>=W.width) AND (E.left<=W.left), where compareHeight is a configurable tolerance value used to compare the vertical display locations of element E and element W. In the described implementation, compareHeight is derived from the heights of element E and element W, such as compareHeight=(min(E.height, W.height))/4.
      • (E is structurally equal to W, E is vertically closer to F (or the vertical distance between E and F is approximately equal to the vertical distance between W and F), and E horizontally contains W.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (E.bottom<=W.top).
      • (E is structurally equal to W, and E is completely above W.)
In this implementation, preference is given first to an element that is structurally closer to the currently focused element, as defined by the tree structure that represents the document. If a decision between multiple focusable elements remains, preference is then given to an element that is horizontally closer to the element that had focus when up/down navigation began. Therefore, in the document shown in FIG. 3, hyperlinked Cell7 310 is determined to be the most appropriate element to receive the focus in response to a down directional input when hyperlinked Cell4 308 is the element that currently has the focus. Hyperlinked Cell7 310 is given preference because although focusable button 312 is vertically closer to hyperlink 308, hyperlinked Cell7 310 is structurally closer to hyperlinked Cell4 308 based on the element tree structure that represents document 304. That is, the common ancestor between hyperlink 308 and Cell7 310 (i.e., table 306) is closer to hyperlink 308 than the common ancestor between hyperlink 308 and button 312 (i.e., document 304) is to hyperlink 308. As a result, hyperlink 310 is selected as the next element to receive focus because it has the closest ancestor element in common with the currently focused element, according to an element tree structure that represents the document.
FIG. 4 illustrates a view of a document that includes several focusable elements that are structurally equivalent based on an element tree structure representation of the elements in the document. For this discussion, it is assumed that hyperlink 406 is the element that currently has focus (indicated by the dashed line). Furthermore, it is assumed that hyperlink 406 received the focus based on something other than an up or down directional input. For example, hyperlink 406 may have been given the focus when the document was initially rendered or in response to a left or right directional input. When the rendering engine receives a down directional input (e.g., a user presses a down arrow key), the rendering engine determines, based on the equations described above, the most appropriate focusable element to receive the focus in response to the down directional input.
Link02-Link22 are all identified as appropriate elements to receive focus in response to the down directional input because each is within the focusable area of the document (indicated by box 402), the midpoint of each is below the midpoint of the currently focused element, and the top of each is below the bottom of the currently focused element.
When the focus is on element 406 and the rendering engine receives a down directional input, element 408 is given focus because it is vertically closer to the currently focused element 406 than any of the other elements that were determined appropriate for receiving focus.
When the focus is on element 408 and the rendering engine receives another down directional input, Link03-Link22 are all identified as appropriate elements to receive focus because they are below the currently focused element, 408. Because they are vertically closer to the currently focused element, Link03 and Link 04 are given preference. To decide between Link03 and Link04, the rendering engine compares the horizontal location of each with the horizontal location of the element that had focus when the up/down navigation began, which is hyperlink 406. Because Link04 is horizontally closer to hyperlink 406 than is Link03, hyperlink 410 (Link04) is given the focus in response to a down directional input received when the focus is on hyperlink 408.
Similarly, when the focus is on element 410 and the rendering engine receives another down directional input, Link05-Link22 are all identified as appropriate elements to receive focus because they are below the currently focused element, 410. Because they are vertically closer to the currently focused element, Link05-Link 07 are given preference. To decide between Link05, Link06, and Link07, the rendering engine compares the horizontal location of each with the horizontal location of the element that had focus when the up/down navigation began, which is hyperlink 406. Because Link07 is horizontally closer to hyperlink 406 than are Link05 or Link06, hyperlink 412 (Link07) is given the focus in response to a down directional input received when the focus is on hyperlink 410.
By the same rationale, if the rendering engine receives another down directional input while focus is on element 412, focus will move to element 414. When focus is on element 414 and the rendering engine receives another down directional input, focus moves to element 416. Finally, when focus is on element 414 and the rendering engine receives another down directional input, focus move to element 418.
Up Directional Input
Similarly, if a focusable element E meets the following criteria, then E is considered an appropriate element to receive focus when the directional input indicates moving focus up:
    • E is within the displayable area of the document;
    • (E.bottom−F.top)<LaxHeight3, where LaxHeight3 is a configurable tolerance value used to compare the vertical display locations of element E and element F. In the described implementation, LaxHeight3 is derived from the heights of element E and element F, such as LaxHeight3=(min(F.height, E.height))/4.
      • (E is above F or the lower edge of E is below the top edge of F by no more than LaxHeight3.)
Element E is determined to be the most appropriate element to receive the focus when an up directional input is received if any of the following is true:
    • E.DistanceToCommonAncestor>W. DistanceToCommonAncestor
      • (E is structurally closer to F.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (E.bottom−W.top>=compareHeight) AND (E.horizoverlap>W.horizoverlap), where compareHeight is a configurable tolerance value used to compare the vertical display locations of element E and element W. In the described implementation, compareHeight is derived from the heights of element E and element W, such as compareHeight=(min(E.height, W.height))/4.
      • (E is structurally equal to W, E is vertically closer to F (or the vertical distance between E and F is approximately equal to the vertical distance between W and F), and E has more horizontal overlap with the element that had focus when up/down navigation began than does W.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (E.bottom−W.top>=compareHeight) AND (W.width>=E.width) AND (W.left<=E.left), where compareHeight is a configurable tolerance value used to compare the vertical display locations of element E and element W. In the described implementation, compareHeight is derived from the heights of element E and element W, such as compareHeight=(min(E.height, W.height))/4.
      • (E is structurally equal to W, E is vertically closer to F (or the vertical distance between E and F is approximately equal to the vertical distance between W and F), and W horizontally contains E.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (E.bottom−W.top>=compareHeight) AND (E.width>=W.width) AND (E.left<=W.left), where compareHeight is a configurable tolerance value used to compare the vertical display locations of element E and element W. In the described implementation, compareHeight is derived from the heights of element E and element W, such as compareHeight=(min(E.height, W.height))/4.
      • (E is structurally equal to W, E is vertically closer to F (or the vertical distance between E and F is approximately equal to the vertical distance between W and F), and E horizontally contains W.)
    • (E.DistanceToCommonAncestor=W.DistanceToCommonAncestor) AND (E.top>=W.bottom).
      • (E is structurally equal to W, and E is completely below W.)
Directional Focus Navigation Among Focusable Areas
A rendering engine as described herein can be implemented to support directional focus navigation across arbitrarily shaped areas, such as areas defined for an image map. FIG. 5 illustrates a rendered view of a document that includes an image map of the United States of America in which each state is a focusable area. Area 502 is the area that currently has the focus (indicated by the solid outline). When the rendering engine receives a directional input (e.g., a user presses a right arrow key), the rendering engine determines which, if any, of the other focusable areas (i.e., the other focusable areas in the image map) is the most appropriate area to receive the focus next. (This process is described above with reference to blocks 102-120 shown in FIG. 1 a.)
The following mathematical definitions will be used below in focus navigation equations that may be used in an implementation of a rendering engine that supports directional focus navigation across areas of arbitrary shape:
    • F=area that has the current focus
    • E=focusable area that is being evaluated
    • W=focusable area that is currently identified as the most appropriate focusable area to receive the focus so far
    • x.left=the left coordinate of the left-most point of area x
    • x.right=the right coordinate of the right-most point of area x
    • x.top=the top coordinate of the top-most point of area x
    • x.bottom=the bottom coordinate of bottom-most point of area x
    • x.width=x.right−x.left
    • x.height=x.bottom−x.top
The above (and all following) equations are written using the assumption that the display area can be mapped to a two-dimensional grid in which the upper-left-most corner has (x, y) coordinates (0, 0).
Right Directional Input
If a focusable area E meets the following criteria, then E is considered an appropriate area to receive focus when the directional input indicates moving focus to the right:
    • E is within the displayable area of the document.
    • E.right−F.right>=LaxWidth, where LaxWidth is a configurable tolerance value used to compare the horizontal display locations of element E and element F. In the described implementation, LaxWidth is derived from the widths of element E and element F, such as LaxWidth=(min(E.width, F.width))/5.
      • (The right-most point of E is to the right of the right-most point of F by a distance of at least LaxWidth.)
As described above with reference to block 116 shown in FIG. 1, the browser compares the elements (or areas) that qualify as appropriate elements (or areas) to receive the focus to determine the most appropriate element (or area) to receive the focus. In this implementation, area E is determined to be the most appropriate area to receive the focus when a right directional input is received if the distance between a representative point of E and a representative point of F is shorter than the distance between the representative point of F and any of the other appropriate elements or areas to receive focus.
In the described implementation, the representative point of an area has a horizontal coordinate and a vertical coordinate. In one implementation, the horizontal coordinate of the representative point of an area is the average of the horizontal coordinates of all of the points of the area, while the vertical coordinate of the representative point is the average of the vertical coordinates of all of the points of the area. In an alternate implementation, the representative point of an area may be the midpoint of a particular side of the area. Although the described implementation suggests representative points that are calculated as average points, it is recognized that any number of methods and/or calculations may be used to determine a representative point associated with an area.
Left Directional Input
If a focusable area E meets the following criteria, then E is considered an appropriate area to receive focus when the directional input indicates moving focus to the left:
    • E is within the displayable area of the document.
    • F.left−E.left>=LaxWidth, where LaxWidth is a configurable tolerance value used to compare the horizontal display locations of element E and element F. In the described implementation, LaxWidth is derived from the widths of the element E and element F, such as LaxWidth=(min(E.width, F.width))/5.
      • (The left-most point of E is to the left of the left-most point of F by a distance of at least LaxWidth.)
In this implementation, area E is determined to be the most appropriate area to receive the focus when a left directional input is received if the distance between the representative point of E and the representative point of F is shorter than the distance between the representative point of F and any of the other appropriate elements or areas to receive focus.
Down Directional Input
If a focusable area E meets the following criteria, then E is considered an appropriate area to receive focus when the directional input indicates moving focus down:
    • E is within the displayable area of the document.
    • E.bottom−F.bottom>=LaxHeight, where LaxHeight is a configurable tolerance value used to compare the vertical display locations of element E and element F. In the described implementation, LaxHeight is derived from the heights of element E and element F, such as LaxHeight=(min(E.height, F.height))/4.
      • (The bottom-most point of E is below the bottom-most point of F by a distance of at least LaxHeight.)
As described above with reference to block 116 shown in FIG. 1, the browser compares the elements (or areas) that qualify as appropriate elements (or areas) to receive the focus to determine the most appropriate element (or area) to receive the focus. Similar to the implementation described above for horizontal focus navigation across arbitrarily shaped areas, area E is determined to be the most appropriate area to receive the focus when a down directional input is received if the distance between the representative point of E and a vertical representative point of F is shorter than the distance between the vertical representative point of F and any of the other appropriate elements or areas to receive focus.
In the described implementation, the representative point of an area, as described above, has a horizontal coordinate and a vertical coordinate. In the described implementation, when comparing focus candidates in response to vertical directional input (e.g., up or down), the horizontal component of the representative point of F is derived from the horizontal coordinate of the representative point of the element that had the focus when the first of the current sequence of up and/or down directional inputs was received.
By defining the horizontal coordinate of the vertical representative point of F in this way, priority is given to areas and/or elements that are horizontally closest to the area or element that had focus when a user first submitted an up or down directional input.
Up Directional Input
If a focusable area E meets the following criteria, then E is considered an appropriate area to receive focus when the directional input indicates moving focus up:
    • E is within the displayable area of the document.
    • F.top−E.top>=LaxHeight, where LaxHeight is a configurable tolerance value used to compare the vertical display locations of element E and element F. In the described implementation, LaxHeight is derived from the heights of element E and element F, such as LaxHeight=(min(E.height, F.height))/4.
      • (The top-most point of E is above the top-most point of F by a distance of at least LaxHeight.)
Area E is determined to be the most appropriate area to receive the focus when an up directional input is received if the distance between the representative point of E and a vertical representative point of F is shorter than the distance between the vertical representative point of F and any of the other appropriate elements or areas to receive focus.
Focus Navigation In Scrollable Documents
FIG. 6 a illustrates a scrollable document that includes focusable elements. Window 602 represents a display area, box 604 represents the document. The document 604 is vertically larger than the display area 602. To view portions of the document 604 that are outside of the display area 602, the document can be scrolled.
In typical browser implementations, in response to directional input (e.g., an arrow key press), if the document currently being rendered is scrollable, then the browser scrolls the document in the direction indicated by the directional input. In the described browser implementation that supports directional focus navigation, when directional input is received, the browser can move focus from one focusable element to another, as described above, or can cause the document to scroll in the direction indicated by the directional input.
In the example illustrated in FIG. 6 a, if focus is initially on hyperlink 606 and the rendering engine receives a down directional input, focus is moved from hyperlink 606 to hyperlink 608. If the rendering engine receives another down directional input, focus moves from hyperlink 608 to hyperlink 610. If the rendering engine then receives another down directional input, focus does not move from hyperlink 610 because there is not another focusable element below hyperlink 610 and within the displayable area. Because there is not another focusable element below and within the displayable area, the browser scrolls the document based on the down directional input.
FIG. 6 b illustrates the scrollable document that is described above with respect to FIG. 6 a, after the above-described down directional inputs are received by the browser and the browser has scrolled the document until hyperlink 612 is within the displayable area 602. If focus is on hyperlink 610 and the rendering engine receives another down directional input, then focus is moved to hyperlink 612. If the rendering engine then receives another down directional input, focus does not move from hyperlink 612 because there is not another focusable element below hyperlink 612 and within the displayable area. Because there is not another focusable element below and within the displayable area, the browser scrolls the document according to the directional input.
In an alternate implementation, in response to a directional input, the browser may both scroll and move focus. For example, if a browser receives a down directional input, and the only focus candidate element is located outside the viewable area, the browser may scroll the document in the down direction until the focus candidate is within the viewable area, and then move focus to that element.
FIG. 6 c illustrates the scrollable document that is described above with respect to FIGS. 6 a and 6 b, after the above-described down directional inputs are received by the browser and the browser has scrolled the document until the lower-most point of the document is within the displayable area 602.
FIG. 7 a illustrates a document that includes focusable elements where one of the focusable elements is scrollable and contains other focusable elements. Document 702 includes focusable elements 704 (a hyperlink), 706 (a scrollable frame), and 708 (a button). Element 706 is representative of any scrollable element, which, in HTML, may include, but is not limited to, frame elements, object elements, div elements, and iframe elements. Document 710 is displayed in scrollable frame 706 and includes focusable elements 712, 714, 716, and 718 (all hyperlinks). Assuming in this example that the browser or rendering engine that is rendering document 702 receives several sequential down directional inputs. Assuming that focus is initially on hyperlink 702 (as indicated by the dashed line), when the browser receives the first down directional input, the browser identifies scrollable frame 706 as the most appropriate element to receive the focus. Because scrollable frame 706 includes focusable elements, the focus moves to the first identified focusable element in document 710, which is hyperlink 712.
When the browser receives a second down directional input, the focus moves to hyperlink 714.
When the browser receives a third down directional input, the focus remains on hyperlink 714 and the browser scrolls document 710. Depending on the amount that document 710 is scrolled, several down directional inputs may be received before 716 is scrolled into the displayable area (indicated by the boundaries of scrollable frame 706). Once 716 is within the displayable area, when another down directional input is received, focus moves to hyperlink 716.
A similar process of receiving down directional inputs and scrolling is repeated until hyperlink 718 is within the displayable area, and then in response to the next down directional input hyperlink 718 receives the focus.
Once hyperlink 718 has focus, additional down directional inputs will continue to scroll document 710 (while the focus remains on hyperlink 718) until the lowermost portion of document 710 is within the displayable area.
FIG. 7 b illustrates the visual state of document described with reference to FIG. 7 a after the described down directional inputs are received and processed.
If the browser receives an additional down directional input, focus moves from hyperlink 718 to button 708. The browser determines that there is not another focusable element below hyperlink 718 and within the displayable area of document 710, and the browser determines that document 710 cannot be scrolled in the down direction any further. Accordingly, the browser identifies button 708 as the next focusable element below scrollable frame 706 in document 710.
Focus Navigation Between Frames
FIG. 8 illustrates a rendered view of two documents that include focusable elements that are displayed using frames. Documents 802 and 804 are displayed in frames 806 and 808, respectively. Document 802 includes hyperlinks 810, 812, 814, and 816. Document 804 includes hyperlink 818.
If focus is on hyperlink 812 (as indicated by the dashed line) when a browser application that is rendering the document receives a down directional input, focus moves to hyperlink 814.
However, if focus is on hyperlink 812 when a browser application that is rendering the document receives a right directional input, focus moves to hyperlink 818 because even though it is associated with a different document, it is the first focusable element that has a display location that is to the right of hyperlink 812.
Allowing Standard Behavior In Focusable Elements
Some focusable elements may, as a standard, exhibit a particular behavior in response to directional input. For example, if a pop-up menu has focus and a user presses a down arrow key, the next element down in the menu may become highlighted, indicated that it is the currently selected menu item. As another example, if a text box has focus and a user presses a right arrow key, a cursor in the text box may shift one character to the right.
In the implementation described, the browser application is implemented to support directional focus navigation while allowing standard behavior in those focusable elements that may respond in and of themselves to directional input. To allow this behavior, the browser may be implemented such that when an element has focus, a user can send a “select” input to indicate that directional inputs from that point on are to be directed to the focused element. A subsequent “select” input can be used to indicate that directional inputs from that point are to be directed to the document in such a way that they drive focus navigation.
For example, when a pop-up menu element receives the focus, a user may press the Enter key (or other designated “select” input device) to select the pop-up menu as the element that will be affected by subsequent directional input. Once the user has navigated to the desired menu item, the user may press the Enter key again to indicate that a selection has been made and to signify to the browser that additional directional inputs will now drive focus navigation. To cancel a selection, the user may press the Escape key (or other designated “cancel” input device).
Exemplary Implementation
FIG. 9 is a block diagram of an example client device 902, display device 904, and various input devices that interact with the client device. Client device 902 may also be referred to as a set-top box, game console or a satellite receiver.
Client device 902 includes a wireless receiving port 906 (e.g., an infrared (IR) wireless port) for receiving wireless communications from a remote control device 908, a handheld device 910 (such as a personal digital assistant (PDA) or handheld computer), or other wireless device, such as a wireless keyboard. Additionally, a wired keyboard 912 is coupled to client device 902 for communicating with the client device. In alternate embodiments, remote control device 908, handheld device 910, and/or keyboard 912 may us an RF communication link (or other mode of transmission) to communicate with client device 902. In another alternate embodiment, client device 902, display device 904, and an input device may be implemented as a single hardware unit, such as a cellular telephone or as a handheld device similar to handheld device 910.
In the exemplary system described herein, directional inputs are provided by pressing keys arrow keys 914 of remote control 908, arrow keys or other inputs associated with handheld device 910, or arrow keys 916 of keyboard 912. Such keys might comprise four orthogonal direction keys (up, down, left, and right), or might allow movement in additional directions. Alternatively, a particular input device might utilize a joystick or similar mechanism for directional input, and such an input device might provide increased angular granularity as opposed to the four-direction granularity provided by four orthogonal direction keys.
Client device 902 includes a rendering engine for generating a video signal and/or an audio signal, both of which are communicated to display device 904. The video signals and audio signals can be communicated from client device 902 to display device 904 via an RF (radio frequency) link, S-video link, composite video link, component video link, or other communication link. Although not shown in FIG. 9, a particular client device 902 may include one or more lights or other indicators identifying the current status of the client device. Additionally, a particular client device 902 may include one or more control buttons or switches (not shown) for controlling operation of the client device.
FIG. 10 is a block diagram illustrating select components of a client device implemented to support directional focus navigation as described herein. Client device 902 may be implemented as, but is not limited to, a personal computer system, a cellular telephone, a personal multi-modal device, a television, or a television set-top box.
Client device 902 includes a processor 1002, a memory 1004, a display interface 1006, an audio output 1008, and a video output 1010. Operating system 1012, rendering engine 1014, and other applications 1016 are stored in memory 1004 and executed on processor 1002. Display interface 1006 provides a mechanism for client device 902 to display documents rendered by rendering engine 1014.
To support directional focus navigation, rendering engine 1014 includes directional input interface 1018 for receiving directional input, candidate element identifier 1020 for identifying focusable elements that may receive focus based on received directional input, and optimal element selector 1022 for selecting an optimal focusable element to receive focus when multiple candidate elements are selected based on received directional input.
Conclusion
Although the systems and methods have been described in language specific to structural features and/or methodological steps, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or steps described. Rather, the specific features and steps are disclosed as preferred forms of implementing the claimed invention.

Claims (17)

1. A method executed via one or more processors on a client device, the method comprising:
identifying a first focusable element in a rendered document;
receiving a first directional input;
moving focus from the first focusable element to a second focusable element located in the rendered document based at least in part on a location of the first focusable element, a location of the second focusable element, and the first directional input,
wherein subsequent to the moving focus from the first focusable element to the second focusable element, the first focusable element no longer has focus;
receiving a second directional input sequential to the first directional input, the second directional input being a single input;
identifying one or more candidate elements in response to receiving the second directional input; and
moving the focus from the second focusable element to a third focusable element in the rendered document, the third focusable element being selected from the one or more candidate elements based at least in part on the location of the second focusable element, a distance relationship between a location of the third focusable element and the location of the first focusable element that no longer has focus, and the second directional input.
2. A method as described in claim 1, wherein moving the focus from the second focusable element to the third focusable element is further based on a relationship between the location of the third focusable element and the location of the second focusable element.
3. A method as described in claim 1, wherein the location of the second focusable element is along a direction indicated by the first directional input in relation to the location of the first focusable element.
4. A method as described in claim 1, wherein the rendered document is a scrollable document, and identifying the second focusable element comprises scrolling the rendered document until the second focusable element is within a displayable area.
5. A method as described in claim 3, wherein the location of the third focusable element is along another direction indicated by the second directional input and the direction indicated by the first directional input and the another direction indicated by the second directional input are a same direction.
6. A method as described in claim 5, wherein the same direction is a downward direction.
7. A method as described in claim 1, wherein the first focusable element is not one of the one or more candidate elements at least because the first focusable element is not located along a direction indicated by the second directional input.
8. A method as described in claim 1, further comprising:
receiving a third directional input sequential to the first directional input and the second directional input; and
moving the focus from the third focusable element to a fourth focusable element in the rendered document based at least in part on the location of the third focusable element, a distance relationship between a location of the fourth focusable element and the location of the first focusable element that no longer has focus, and the third directional input.
9. A method executed via one or more processors on a client device, the method comprising:
determining a first element that currently has focus;
receiving a first directional input corresponding to a first direction;
identifying a second element located a distance along the first direction from the first element;
moving focus from the first element that currently has focus to the second element,
wherein after the moving, the first element no longer has focus;
receiving a second directional input sequential to the first directional input, the second directional input corresponding to a second direction, wherein the second directional input is a single input;
identifying a third element and a fourth element as candidate focusable elements based at least in part on the second directional input and a location of the second element;
determining a first directional distance between a location of the first element and a location of the third element;
determining a second directional distance between the location of the first element and a location of the fourth element, wherein the second directional distance is shorter than the first directional distance; and
moving the focus from the second element to the fourth element based at least in part on the second directional distance being shorter than the first directional distance.
10. A method as described in claim 9, wherein identifying the third element and the fourth element as candidate focusable elements is further based at least in part on a relationship between the locations of the third and fourth elements and the location of the second element.
11. A method as described in claim 9, wherein the first element, the second element, the third element, and the fourth element are displayed within a scrollable rendered document.
12. A method as described in claim 9, wherein the first element is not identified as one of the candidate focusable elements at least because the first element is not displayed along the second direction in accordance with the second directional input.
13. A method as described in claim 9, wherein the first direction and the second direction are both a downward direction.
14. One or more computer storage media storing instructions that, when executed by the one or more processors, direct the one or more processors to perform the method as described in claim 9.
15. One or more computer storage media storing instructions that, when executed by the one or more processors, direct a computing device to perform operations comprising:
determining a first element that currently has focus;
receiving a first directional input corresponding to a first direction;
identifying a second element located along the first direction;
moving the focus from the first element to the second element such that the first element no longer has focus;
receiving a second directional input sequential to the first directional input, the second directional input corresponding to a second direction, wherein the second directional input is a single input;
identifying a third element and a fourth element as candidate focusable elements based at least in part on the second directional input and proximity of the third element and the fourth element to the second element along the second direction;
determining a first distance between a location of the first element and a location of the third element along a direction perpendicular to the second direction;
determining a second distance between the location of the first element and a location of the fourth element along the direction perpendicular to the second direction, wherein the second distance is shorter than the first distance; and
moving the focus from the second element to the fourth element based at least in part on the second distance being shorter than the first distance.
16. One or more computer storage media as described in claim 15, wherein the first element is not identified as one of the candidate focusable elements at least because the first element is not displayed along the second direction in accordance with the second directional input.
17. One or more computer storage media as described in claim 15, wherein the first direction and the second direction are both a downward direction.
US12/784,755 2002-11-13 2010-05-21 Directional focus navigation Expired - Fee Related US8332769B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US12/784,755 US8332769B2 (en) 2002-11-13 2010-05-21 Directional focus navigation
US13/618,207 US20130014043A1 (en) 2002-11-13 2012-09-14 Directional Focus Navigation

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/293,447 US7134089B2 (en) 2002-11-13 2002-11-13 Directional focus navigation
US11/380,905 US7735016B2 (en) 2002-11-13 2006-04-28 Directional focus navigation
US12/784,755 US8332769B2 (en) 2002-11-13 2010-05-21 Directional focus navigation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/380,905 Continuation US7735016B2 (en) 2002-11-13 2006-04-28 Directional focus navigation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/618,207 Continuation US20130014043A1 (en) 2002-11-13 2012-09-14 Directional Focus Navigation

Publications (2)

Publication Number Publication Date
US20100299623A1 US20100299623A1 (en) 2010-11-25
US8332769B2 true US8332769B2 (en) 2012-12-11

Family

ID=32229653

Family Applications (4)

Application Number Title Priority Date Filing Date
US10/293,447 Expired - Fee Related US7134089B2 (en) 2002-11-13 2002-11-13 Directional focus navigation
US11/380,905 Expired - Fee Related US7735016B2 (en) 2002-11-13 2006-04-28 Directional focus navigation
US12/784,755 Expired - Fee Related US8332769B2 (en) 2002-11-13 2010-05-21 Directional focus navigation
US13/618,207 Abandoned US20130014043A1 (en) 2002-11-13 2012-09-14 Directional Focus Navigation

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US10/293,447 Expired - Fee Related US7134089B2 (en) 2002-11-13 2002-11-13 Directional focus navigation
US11/380,905 Expired - Fee Related US7735016B2 (en) 2002-11-13 2006-04-28 Directional focus navigation

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/618,207 Abandoned US20130014043A1 (en) 2002-11-13 2012-09-14 Directional Focus Navigation

Country Status (1)

Country Link
US (4) US7134089B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080222530A1 (en) * 2007-03-06 2008-09-11 Microsoft Corporation Navigating user interface controls on a two-dimensional canvas
US20140019849A1 (en) * 2012-07-13 2014-01-16 Microsoft Corporation Extensible Content Focus Mode

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9722766D0 (en) 1997-10-28 1997-12-24 British Telecomm Portable computers
US7469381B2 (en) 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
US7296243B2 (en) 2002-03-19 2007-11-13 Aol Llc Animating display motion
JP3755499B2 (en) * 2002-09-06 2006-03-15 ソニー株式会社 GUI application development support apparatus, GUI display apparatus and method, and computer program
US7290220B2 (en) * 2003-04-03 2007-10-30 International Business Machines Corporation Method and apparatus for non-sequential access of form fields
US20050021851A1 (en) * 2003-06-09 2005-01-27 Kimmo Hamynen System, apparatus, and method for directional control input browsing in smart phones
US20050015730A1 (en) * 2003-07-14 2005-01-20 Srimanth Gunturi Systems, methods and computer program products for identifying tab order sequence of graphically represented elements
US7272790B2 (en) * 2004-03-05 2007-09-18 Nokia Corporation Method and device for automatically selecting a frame for display
US7631278B2 (en) 2004-11-19 2009-12-08 Microsoft Corporation System and method for directional focus navigation
US7636897B2 (en) * 2004-11-19 2009-12-22 Microsoft Corporation System and method for property-based focus navigation in a user interface
EP1896926A4 (en) * 2005-06-30 2012-08-22 Nokia Corp Electronic device and enhancing document viewing in electronic device
US20070094267A1 (en) * 2005-10-20 2007-04-26 Glogood Inc. Method and system for website navigation
US10983695B2 (en) * 2005-10-24 2021-04-20 Kinoma, Inc. Focus management system
DE602007004057D1 (en) * 2006-05-16 2010-02-11 Research In Motion Ltd SYSTEM AND METHOD FOR INTEGRATED INFORMATION DISPLAY
US7626573B2 (en) * 2006-07-10 2009-12-01 Microsoft Corporation Trackball for a mobile device
US20080109735A1 (en) * 2006-11-03 2008-05-08 Research In Motion Limited System and method for replying to an electronic mail message
KR20080048795A (en) * 2006-11-29 2008-06-03 삼성전자주식회사 Method for providing program guide and image display apparatus using the same
US7996784B2 (en) * 2006-12-11 2011-08-09 International Business Machines Corporation Method and apparatus for controlling tab indexes in a web page
US7844915B2 (en) 2007-01-07 2010-11-30 Apple Inc. Application programming interfaces for scrolling operations
US8108793B2 (en) * 2007-05-21 2012-01-31 Amazon Technologies, Inc, Zone-associated objects
US8201096B2 (en) 2007-06-09 2012-06-12 Apple Inc. Browsing or searching user interfaces and other aspects
WO2009008161A1 (en) * 2007-07-11 2009-01-15 Access Co., Ltd. Portable information terminal
US9454283B1 (en) * 2008-01-07 2016-09-27 The Mathworks, Inc. Three-dimensional visualization
JP5226588B2 (en) * 2008-04-14 2013-07-03 キヤノン株式会社 Information processing apparatus and control method thereof
US20100325565A1 (en) * 2009-06-17 2010-12-23 EchoStar Technologies, L.L.C. Apparatus and methods for generating graphical interfaces
US8843849B2 (en) * 2009-11-09 2014-09-23 Blackberry Limited Directional navigation of page content
US20110179390A1 (en) * 2010-01-18 2011-07-21 Robert Paul Morris Methods, systems, and computer program products for traversing nodes in path on a display device
US8281258B1 (en) * 2010-03-26 2012-10-02 Amazon Technologies Inc. Object traversal to select focus
EP2385452A1 (en) * 2010-05-06 2011-11-09 Amadeus S.A.S. Computer navigation method
TW201217995A (en) 2010-10-29 2012-05-01 Ibm Mechanism for facilitating navigation of a webpage on computer device
JP2012128662A (en) * 2010-12-15 2012-07-05 Samsung Electronics Co Ltd Display control device, program and display control method
US9430118B2 (en) 2011-04-19 2016-08-30 International Business Machines Corporation Spatially-oriented traversal animations for network address transitions
US8977966B1 (en) * 2011-06-29 2015-03-10 Amazon Technologies, Inc. Keyboard navigation
US9569057B2 (en) * 2012-01-05 2017-02-14 Sony Corporation Information processing apparatus and method for outputting a guiding operation to a user
KR101958747B1 (en) * 2012-05-02 2019-03-15 삼성전자주식회사 Method for apparatus for inputting text in a portable terminal
US9342619B2 (en) * 2012-07-24 2016-05-17 Google Inc. Renderer-assisted webpage navigating tool
US20140108981A1 (en) * 2012-10-12 2014-04-17 Microsoft Corporation Weighted focus navigation of graphical user interface
US9591339B1 (en) 2012-11-27 2017-03-07 Apple Inc. Agnostic media delivery system
US9774917B1 (en) 2012-12-10 2017-09-26 Apple Inc. Channel bar user interface
US10200761B1 (en) 2012-12-13 2019-02-05 Apple Inc. TV side bar user interface
US9532111B1 (en) 2012-12-18 2016-12-27 Apple Inc. Devices and method for providing remote control hints on a display
US10521188B1 (en) 2012-12-31 2019-12-31 Apple Inc. Multi-user TV user interface
JP5991538B2 (en) * 2013-02-20 2016-09-14 富士ゼロックス株式会社 Data processing apparatus, data processing system, and program
US20140245205A1 (en) * 2013-02-27 2014-08-28 Microsoft Corporation Keyboard navigation of user interface
US10275109B2 (en) * 2013-05-21 2019-04-30 Oracle International Corporation Traversing between nodes
EP3026576A4 (en) * 2013-07-24 2016-07-27 Zte Corp Method and system for controlling focus moving on webpage
CN111782128B (en) 2014-06-24 2023-12-08 苹果公司 Column interface for navigating in a user interface
TWI585673B (en) 2014-06-24 2017-06-01 蘋果公司 Input device and user interface interactions
JP6494215B2 (en) * 2014-08-25 2019-04-03 キヤノン株式会社 Electronic device, control method thereof and program
US10592070B2 (en) * 2015-10-12 2020-03-17 Microsoft Technology Licensing, Llc User interface directional navigation using focus maps
EP3338203A4 (en) * 2015-11-18 2018-06-27 Samsung Electronics Co., Ltd. Method and apparatus for navigation in webpage
DK201670581A1 (en) 2016-06-12 2018-01-08 Apple Inc Device-level authorization for viewing content
DK201670582A1 (en) 2016-06-12 2018-01-02 Apple Inc Identifying applications on which content is available
US20180113579A1 (en) 2016-10-26 2018-04-26 Apple Inc. User interfaces for browsing content from multiple content applications on an electronic device
US10552236B2 (en) 2017-06-28 2020-02-04 Microsoft Technology Licensing, Llc Serialization of focus movement between elements in web applications
DK201870354A1 (en) 2018-06-03 2019-12-20 Apple Inc. Setup procedures for an electronic device
EP3928194A1 (en) 2019-03-24 2021-12-29 Apple Inc. User interfaces including selectable representations of content items
US11467726B2 (en) 2019-03-24 2022-10-11 Apple Inc. User interfaces for viewing and accessing content on an electronic device
US11683565B2 (en) 2019-03-24 2023-06-20 Apple Inc. User interfaces for interacting with channels that provide content that plays in a media browsing application
CN113906380A (en) 2019-05-31 2022-01-07 苹果公司 User interface for podcast browsing and playback applications
US11863837B2 (en) 2019-05-31 2024-01-02 Apple Inc. Notification of augmented reality content on an electronic device
EP4004811A4 (en) * 2019-07-26 2023-07-12 Patnotate LLC Technologies for content analysis
CN110704146A (en) * 2019-08-30 2020-01-17 华为技术有限公司 Focus management method applied to electronic equipment and electronic equipment
US11843838B2 (en) 2020-03-24 2023-12-12 Apple Inc. User interfaces for accessing episodes of a content series
US11899895B2 (en) 2020-06-21 2024-02-13 Apple Inc. User interfaces for setting up an electronic device
US11720229B2 (en) 2020-12-07 2023-08-08 Apple Inc. User interfaces for browsing and presenting content

Citations (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5510811A (en) * 1992-11-25 1996-04-23 Microsoft Corporation Apparatus and method for controlling cursor movement
US5548703A (en) 1993-11-30 1996-08-20 International Business Machines Corporation Navigation within a compound graphical object in a graphical user interface
US5625763A (en) 1995-05-05 1997-04-29 Apple Computer, Inc. Method and apparatus for automatically generating focus ordering in a dialog on a computer system
US5682511A (en) * 1995-05-05 1997-10-28 Microsoft Corporation Graphical viewer interface for an interactive network system
US5808604A (en) 1994-03-10 1998-09-15 Microsoft Corporation Apparatus and method for automatically positioning a cursor on a control
US5861906A (en) * 1995-05-05 1999-01-19 Microsoft Corporation Interactive entertainment network system and method for customizing operation thereof according to viewer preferences
US6028600A (en) * 1997-06-02 2000-02-22 Sony Corporation Rotary menu wheel interface
US6034689A (en) 1996-06-03 2000-03-07 Webtv Networks, Inc. Web browser allowing navigation between hypertext objects using remote control
US6072485A (en) 1997-08-28 2000-06-06 Microsoft Corporation Navigating with direction keys in an environment that permits navigating with tab keys
US6101510A (en) 1997-01-29 2000-08-08 Microsoft Corporation Web browser control for incorporating web browser functionality into application programs
US6144378A (en) * 1997-02-11 2000-11-07 Microsoft Corporation Symbol entry system and methods
US6154205A (en) 1998-03-25 2000-11-28 Microsoft Corporation Navigating web-based content in a television-based system
US6249284B1 (en) 1998-04-01 2001-06-19 Microsoft Corporation Directional navigation system in layout managers
US20010017634A1 (en) 1999-12-30 2001-08-30 Nokia Corporation Display device
US6317144B1 (en) 1998-11-30 2001-11-13 Sun Microsystems, Inc. Method and apparatus for navigating displayed elements
US20020070961A1 (en) * 2000-11-29 2002-06-13 Qi Xu System and method of hyperlink navigation between frames
US20020075315A1 (en) * 2000-06-30 2002-06-20 Nokia Corporation Method of selecting an object
US20020178142A1 (en) 2001-03-26 2002-11-28 Fujitsu Limited Link tree forming apparatus, link tree forming method, and link tree forming program
US20030004638A1 (en) * 1999-12-24 2003-01-02 Jean-Stephane Villers Navigation
US20030001907A1 (en) * 2001-06-28 2003-01-02 Nokia Corporation Method and apparatus for scrollable cross-point navigation in a user interface
US20030014401A1 (en) 2001-07-13 2003-01-16 Alexey Goloshubin Directional focus manager
US20030028885A1 (en) * 1998-11-19 2003-02-06 Scott Wilcox Navigational user interface for interactive television
US6549221B1 (en) 1999-12-09 2003-04-15 International Business Machines Corp. User interface management through branch isolation
US6606106B1 (en) 2000-06-02 2003-08-12 Sun Microsystems, Inc. Hierarchical model for expressing focus traversal
US6614457B1 (en) 1998-10-27 2003-09-02 Matsushita Electric Industrial Co., Ltd. Focus control device that moves a focus in a GUI screen
US6622306B1 (en) 1996-09-18 2003-09-16 Access Co., Ltd. Internet television apparatus
US20030174170A1 (en) 2002-03-16 2003-09-18 Samsung Electronics Co., Ltd. Multi-layer focusing method and apparatus therefor
US20030233652A1 (en) 2002-06-18 2003-12-18 Kinpo Electronics, Inc. Method and apparatus for intuitionally moving the focus within a window
US20030231210A1 (en) 2002-06-04 2003-12-18 Anderson David R. Seamless tabbed focus control in active content
US6683626B1 (en) * 2000-10-04 2004-01-27 Sun Microsystems, Inc. Focus-based scrolling
US20040041837A1 (en) 2001-09-13 2004-03-04 Naoto Yamaguchi Gui part focus movement destination setter and focus moving device
US20040100500A1 (en) * 2002-11-22 2004-05-27 Samsung Electronics Co., Ltd. Method of focusing on input item in object picture embedded in markup picture, and information storage medium therefor
US20040210851A1 (en) 2003-04-15 2004-10-21 Microsoft Corporation Method for navigation between elements on a page of content in a handheld device
US6822664B2 (en) 2000-10-11 2004-11-23 Microsoft Corporation Browser navigation for devices with a limited input system
US20050086611A1 (en) * 2003-04-21 2005-04-21 Masaaki Takabe Display method and display device
US20050097479A1 (en) 2003-10-16 2005-05-05 Sony Corporation Electronic apparatus, program, and focus control method of electronic apparatus
US6892360B1 (en) 1998-08-05 2005-05-10 Sun Microsystems, Inc. Focus traversal mechanism for graphical user interface widgets
US20050114788A1 (en) 2003-11-26 2005-05-26 Nokia Corporation Changing an orientation of a user interface via a course of motion
US20050125740A1 (en) 2002-05-10 2005-06-09 Microsoft Corporation Method and apparatus for managing input focus and Z-order
US6947062B2 (en) 2001-07-23 2005-09-20 Koninklijke Philips Electronics N.V. Seamlessly combined freely moving cursor and jumping highlights navigation
US20050210399A1 (en) 2004-03-18 2005-09-22 Microsoft Corporation Method and system for improved viewing and navigation of content
US6966037B2 (en) 2001-11-19 2005-11-15 Nokia Corporation Method and apparatus for scrollable cross-point navigation in a calendar user interface
US6983426B1 (en) * 1999-10-28 2006-01-03 Sony Corporation Method and apparatus for displaying content in an array hierarchical structure
US20060112346A1 (en) 2004-11-19 2006-05-25 Microsoft Corporation System and method for directional focus navigation
US7240299B2 (en) * 2001-04-26 2007-07-03 International Business Machines Corporation Method for improving usage of a graphic user interface pointing device
US20080222530A1 (en) 2007-03-06 2008-09-11 Microsoft Corporation Navigating user interface controls on a two-dimensional canvas

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR930009639B1 (en) * 1989-07-09 1993-10-08 가부시끼가이샤 히다찌세이사꾸쇼 Method of text data processing using image data
US5566292A (en) * 1992-04-17 1996-10-15 International Business Machines Corporation Methods for detecting the closest existing point on a spline or polyline
US5983224A (en) * 1997-10-31 1999-11-09 Hitachi America, Ltd. Method and apparatus for reducing the computational requirements of K-means data clustering
US6154206A (en) * 1998-05-06 2000-11-28 Sony Corporation Of Japan Method and apparatus for distributed conditional access control on a serial communication network
JP4261145B2 (en) * 2001-09-19 2009-04-30 株式会社リコー Information processing apparatus, information processing apparatus control method, and program for causing computer to execute the method

Patent Citations (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5510811A (en) * 1992-11-25 1996-04-23 Microsoft Corporation Apparatus and method for controlling cursor movement
US6256030B1 (en) 1993-11-30 2001-07-03 International Business Machines Corp. Navigation within a graphical user interface for a compound graphical object using pointing device input
US5548703A (en) 1993-11-30 1996-08-20 International Business Machines Corporation Navigation within a compound graphical object in a graphical user interface
US5808604A (en) 1994-03-10 1998-09-15 Microsoft Corporation Apparatus and method for automatically positioning a cursor on a control
US5625763A (en) 1995-05-05 1997-04-29 Apple Computer, Inc. Method and apparatus for automatically generating focus ordering in a dialog on a computer system
US5682511A (en) * 1995-05-05 1997-10-28 Microsoft Corporation Graphical viewer interface for an interactive network system
US5861906A (en) * 1995-05-05 1999-01-19 Microsoft Corporation Interactive entertainment network system and method for customizing operation thereof according to viewer preferences
US6034689A (en) 1996-06-03 2000-03-07 Webtv Networks, Inc. Web browser allowing navigation between hypertext objects using remote control
US6622306B1 (en) 1996-09-18 2003-09-16 Access Co., Ltd. Internet television apparatus
US6101510A (en) 1997-01-29 2000-08-08 Microsoft Corporation Web browser control for incorporating web browser functionality into application programs
US6144378A (en) * 1997-02-11 2000-11-07 Microsoft Corporation Symbol entry system and methods
US6028600A (en) * 1997-06-02 2000-02-22 Sony Corporation Rotary menu wheel interface
US6072485A (en) 1997-08-28 2000-06-06 Microsoft Corporation Navigating with direction keys in an environment that permits navigating with tab keys
US6154205A (en) 1998-03-25 2000-11-28 Microsoft Corporation Navigating web-based content in a television-based system
US6249284B1 (en) 1998-04-01 2001-06-19 Microsoft Corporation Directional navigation system in layout managers
US6892360B1 (en) 1998-08-05 2005-05-10 Sun Microsystems, Inc. Focus traversal mechanism for graphical user interface widgets
US6614457B1 (en) 1998-10-27 2003-09-02 Matsushita Electric Industrial Co., Ltd. Focus control device that moves a focus in a GUI screen
US20030028885A1 (en) * 1998-11-19 2003-02-06 Scott Wilcox Navigational user interface for interactive television
US6317144B1 (en) 1998-11-30 2001-11-13 Sun Microsystems, Inc. Method and apparatus for navigating displayed elements
US6983426B1 (en) * 1999-10-28 2006-01-03 Sony Corporation Method and apparatus for displaying content in an array hierarchical structure
US6549221B1 (en) 1999-12-09 2003-04-15 International Business Machines Corp. User interface management through branch isolation
US20030004638A1 (en) * 1999-12-24 2003-01-02 Jean-Stephane Villers Navigation
US20010017634A1 (en) 1999-12-30 2001-08-30 Nokia Corporation Display device
US6606106B1 (en) 2000-06-02 2003-08-12 Sun Microsystems, Inc. Hierarchical model for expressing focus traversal
US7788601B2 (en) * 2000-06-30 2010-08-31 Nokia Corporation Method of selecting an object
US20020075315A1 (en) * 2000-06-30 2002-06-20 Nokia Corporation Method of selecting an object
US6683626B1 (en) * 2000-10-04 2004-01-27 Sun Microsystems, Inc. Focus-based scrolling
US6822664B2 (en) 2000-10-11 2004-11-23 Microsoft Corporation Browser navigation for devices with a limited input system
US20020070961A1 (en) * 2000-11-29 2002-06-13 Qi Xu System and method of hyperlink navigation between frames
US6907574B2 (en) 2000-11-29 2005-06-14 Ictv, Inc. System and method of hyperlink navigation between frames
US20020178142A1 (en) 2001-03-26 2002-11-28 Fujitsu Limited Link tree forming apparatus, link tree forming method, and link tree forming program
US6862598B2 (en) 2001-03-26 2005-03-01 Fujitsu Limited Link tree forming apparatus, link tree forming method, and link tree forming program
US7240299B2 (en) * 2001-04-26 2007-07-03 International Business Machines Corporation Method for improving usage of a graphic user interface pointing device
US20030001907A1 (en) * 2001-06-28 2003-01-02 Nokia Corporation Method and apparatus for scrollable cross-point navigation in a user interface
US7055108B2 (en) 2001-07-13 2006-05-30 Wind River Systems, Inc. Directional focus manager
US20030014401A1 (en) 2001-07-13 2003-01-16 Alexey Goloshubin Directional focus manager
US6947062B2 (en) 2001-07-23 2005-09-20 Koninklijke Philips Electronics N.V. Seamlessly combined freely moving cursor and jumping highlights navigation
US20040041837A1 (en) 2001-09-13 2004-03-04 Naoto Yamaguchi Gui part focus movement destination setter and focus moving device
US6966037B2 (en) 2001-11-19 2005-11-15 Nokia Corporation Method and apparatus for scrollable cross-point navigation in a calendar user interface
US20030174170A1 (en) 2002-03-16 2003-09-18 Samsung Electronics Co., Ltd. Multi-layer focusing method and apparatus therefor
US20050125740A1 (en) 2002-05-10 2005-06-09 Microsoft Corporation Method and apparatus for managing input focus and Z-order
US20030231210A1 (en) 2002-06-04 2003-12-18 Anderson David R. Seamless tabbed focus control in active content
US20030233652A1 (en) 2002-06-18 2003-12-18 Kinpo Electronics, Inc. Method and apparatus for intuitionally moving the focus within a window
US20040100500A1 (en) * 2002-11-22 2004-05-27 Samsung Electronics Co., Ltd. Method of focusing on input item in object picture embedded in markup picture, and information storage medium therefor
US20040210851A1 (en) 2003-04-15 2004-10-21 Microsoft Corporation Method for navigation between elements on a page of content in a handheld device
US20050086611A1 (en) * 2003-04-21 2005-04-21 Masaaki Takabe Display method and display device
US20050097479A1 (en) 2003-10-16 2005-05-05 Sony Corporation Electronic apparatus, program, and focus control method of electronic apparatus
US20050114788A1 (en) 2003-11-26 2005-05-26 Nokia Corporation Changing an orientation of a user interface via a course of motion
US20050210399A1 (en) 2004-03-18 2005-09-22 Microsoft Corporation Method and system for improved viewing and navigation of content
US20060112346A1 (en) 2004-11-19 2006-05-25 Microsoft Corporation System and method for directional focus navigation
US20080222530A1 (en) 2007-03-06 2008-09-11 Microsoft Corporation Navigating user interface controls on a two-dimensional canvas

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080222530A1 (en) * 2007-03-06 2008-09-11 Microsoft Corporation Navigating user interface controls on a two-dimensional canvas
US20140019849A1 (en) * 2012-07-13 2014-01-16 Microsoft Corporation Extensible Content Focus Mode
US9268875B2 (en) * 2012-07-13 2016-02-23 Microsoft Technology Licensing, Llc Extensible content focus mode

Also Published As

Publication number Publication date
US20040090463A1 (en) 2004-05-13
US7134089B2 (en) 2006-11-07
US7735016B2 (en) 2010-06-08
US20100299623A1 (en) 2010-11-25
US20060206832A1 (en) 2006-09-14
US20130014043A1 (en) 2013-01-10

Similar Documents

Publication Publication Date Title
US8332769B2 (en) Directional focus navigation
US6211879B1 (en) System and method for navigating in multiple windows
US7441207B2 (en) Method and system for improved viewing and navigation of content
US9575638B2 (en) Browser navigation for devices with a limited input system
US8482522B2 (en) Method and system for navigating within an image
KR101068509B1 (en) Improved presentation of large objects on small displays
US7176943B2 (en) Intelligent windows bumping method and system
CN101192131B (en) Method for processing table top background, device and operation system table top interface system
US7571393B2 (en) Method for navigation between elements on a page of content in a handheld device
US20060294273A1 (en) Apparatus and method for inputting characters using circular key arrangement
US8689144B2 (en) Electronic apparatus, program, and focus control method of electronic apparatus
US6683626B1 (en) Focus-based scrolling
US7055108B2 (en) Directional focus manager
US7421666B2 (en) Browser navigation for devices with a limited input system
JPH11327733A (en) Device and method for changing window size
JPH07199900A (en) Window system
KR20060124471A (en) The method for navigating between hyperlinks within a hypertext document

Legal Events

Date Code Title Description
AS Assignment

Owner name: MICROSOFT CORPORATION, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CELIK, TANTEK;PETTIT, BRADLEY R.;CHAN, ADA Y.;REEL/FRAME:027389/0578

Effective date: 20021111

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034544/0001

Effective date: 20141014

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20201211