CA2791284A1 - Multi-axis navigation - Google Patents

Multi-axis navigation Download PDF

Info

Publication number
CA2791284A1
CA2791284A1 CA2791284A CA2791284A CA2791284A1 CA 2791284 A1 CA2791284 A1 CA 2791284A1 CA 2791284 A CA2791284 A CA 2791284A CA 2791284 A CA2791284 A CA 2791284A CA 2791284 A1 CA2791284 A1 CA 2791284A1
Authority
CA
Canada
Prior art keywords
axis
parameters
user interface
computing device
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA2791284A
Other languages
French (fr)
Inventor
Donald A. Barnett
Veronica Y. Law
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CA2791284A1 publication Critical patent/CA2791284A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4314Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4532Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4821End-user interface for program selection using a grid, e.g. sorted out by channel and broadcast time

Abstract

Multi-axis navigation techniques are described. In implementations, a user interface is output by a computing device, the user interface includes a first axis and a second axis that include parameters that are navigable via one or more gestures. One or more items are chosen by the computing device for concurrent display with the first and second axes that correspond to a first one of the parameters of the first axis and a second one of the parameters of the second axis.

Description

Multi-axis Navigation BACKGROUND
[0001] The amount of content that is encountered by users in a typical day is ever increasing. For example, due to the inclusion of cameras on mobile phones a user may take have access to hundreds of pictures both taken by the user as well as from other users. Further, the user may also be confronted with thousands of other items of content, such as other media (e.g., videos), documents, emails, text messages, and so on.
[0002] Consequently, it may be difficult for a user to locate content of interest to using traditional techniques, such as to manually navigate through a hierarchy of folders used to organize the content. Further, it may be even more difficult for a user to locate related content using traditional techniques. Accordingly, traditional techniques may lead to user frustration and even to forgo functionality due to the complexities involved with relatively large amounts of content.

SUMMARY
[0003] Multi-axis navigation techniques are described. In implementations, a user interface is output by a computing device, the user interface includes a first axis and a second axis that include parameters that are navigable via one or more gestures. One or more items are chosen by the computing device for concurrent display with the first and second axes that correspond to a first one of the parameters of the first axis and a second one of the parameters of the second axis.
[0004] In implementations, one or more inputs are recognized as selecting a first one of a plurality of parameters in a first axis and a second one of a plurality of parameters in a second axis in a user interface output by a computing device using one or more gestures. The first axis is arranged in the user interface as generally perpendicular to the second axis. One or more items are output in the user interface that correspond the first and second parameters.
[0005] In implementations, a computing device includes a housing, a display device disposed on the housing, and one or more modules disposed within the 3o housing. The one or more modules are configured to display a user interface on the display device, the user interface including a first axis and a second axis that include parameters that are navigable via one or more gestures detected via touchscreen functionality of the computing device, that are positioned as generally perpendicular, one or another; and that are selectable via the gestures to cause output of items in the user interface that correspond to the parameters.
[0006] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description.
This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items.
[0008] FIG. 1 is an illustration of an environment in an example implementation that is operable to employ multi-axis navigation techniques described herein.
[0009] FIG. 2 is an illustration of an example system showing a multi-axis navigation module of FIG. 1 as being implemented using in an environment where multiple devices are interconnected through a central computing device.
[0010] FIG. 3 is an illustration of a system in an example implementation in which multi-axis navigation technqiues through a first and second axis that may be used to specify a particular point in time are described.
[0011] FIG. 4 illustrates a system in another example implementation in which multi-axis navigation technqiues are described through a first and second axis that may be used to specify a particular point in time.
[0012] FIG. 5 illustrates a system in another example implementation in which multi-axis navigation technqiues are described through a first and second axis that are used to specify a particular point in time as a day.
[0013] FIG. 6 depicts a procedure in an example implementation in which multi-axis navigation techniques are used to output content that corresponds to included parameters.
[0014] FIG. 7 illustrates various components of an example device that can be implemented as any type of portable and/or computer device as described with reference to FIGS. 1-5 to implement embodiments of the multi-axis navigation techniques described herein.

DETAILED DESCRIPTION
Overview
[0015] Traditional techniques that were used to organize and locate content may become inefficient when confronted with a large number of content. For example, it may become cumbersome to locate a particular item of content a hierarchical arrangement of menus. It may be even more difficult to locate related items of content using traditional techniques, thus leading to potential user frustration.
[0016] Multi-axis navigation techniques are described. In implementations, a user interface includes a first axis and a second axis that is arranged generally perpendicular to the first axis. Each axis may be navigated using a gesture to select a particular parameter included in the axis. For example, the first axis may describe particular months and the second axis may describe particular years. Selection of the month and year may then serve as a basis to locate content for output in the user interface, such as images that were captured at that point in time. The multi-axis navigation may also be leveraged to locate related content, such as to navigate through Halloween photos through multiple years for the month of October. In this way, a user may readily navigate through a large amount of content to locate content of interest as well as to navigate through related content. Further discussion of the multi-axis navigation techniques may be found in relation to the following sections.
[0017] In the following discussion, an example environment is first described that is operable to employ the multi-axis navigation techniques described herein.
3o Example illustrations of the techniques and procedures are then described, which may be employed in the example environment as well as in other environments.

Accordingly, the example environment is not limited to performing the example techniques and procedures. Likewise, the example techniques and procedures are not limited to implementation in the example environment.

Example Environment
[0018] FIG. 1 is an illustration of an environment 100 in an example implementation that is operable to employ multi-axis navigation techniques.
The illustrated environment 100 includes an example of a computing device 102 that may be configured in a variety of ways. For example, the computing device 102 may be configured as a traditional computer (e.g., a desktop personal computer, laptop computer, and so on), a mobile station, an entertainment appliance, a set-top box communicatively coupled to a television, a wireless phone, a netbook, a game console, and so forth as further described in relation to FIG. 2. Thus, the computing device 102 may range from full resource devices with substantial memory and processor resources (e.g., personal computers, game consoles) to a low-resource device with limited memory and/or processing resources (e.g., traditional set-top boxes, hand-held game consoles). The computing device 102 may also relate to software that causes the computing device 102 to perform one or more operations.
[0019] The computing device 102 is illustrated as including an input module 104.
The input module 104 is representative of functionality relating to inputs of the computing device 102. For example, the input module 104 may be configured to receive inputs from a keyboard, mouse, to identify gestures and cause operations to be performed that correspond to the gestures, and so on. The inputs may be identified by the input module 104 in a variety of different ways.
[0020] For example, the input module 104 may be configured to recognize an input received via touchscreen functionality of a display device 106, such as a finger of a user's hand 108 as proximal to the display device 106 of the computing device 102, from a stylus 110, and so on. The input may take a variety of different forms, such as to recognize movement of the stylus 110 and/or a finger of the user's 3o hand 108 across the display device 106, such as a tap, drawing of a line, and so on.
In implementations, these inputs may be recognized as gestures.
[0021] A variety of different types of gestures may be recognized, such a gestures that are recognized from a single type of input (e.g., touch gestures) as well as gestures involving multiple types of inputs. For example, the computing device 102 may be configured to detect and differentiate between a touch input (e.g., provided by one or more fingers of the user's hand 108) and a stylus input (e.g., provided by a stylus 110). Thus, the input module 104 may support a variety of different gesture techniques by recognizing and leveraging a division between stylus and touch inputs.
[0022] Additionally, although the following discussion may describe specific 1o examples of touch and stylus inputs, in instances the types of inputs may be switched (e.g., touch may be used to replace stylus and vice versa) and even removed (e.g., both inputs may be provided using touch or a stylus) without departing from the spirit and scope thereof. Further, although in instances in the following discussion the gestures are illustrated as being input using touchscreen functionality, the gestures may be input using a variety of different techniques by a variety of different devices, such as to be captured by a camera for use as part of a natural user interface (NUI).
[0023] The computing device 102 is further illustrated as including a multi-axis navigation module 112. The multi-axis navigation module 112 is representative of functionality of the computing device 102 to configure a user interface for multi-axis navigation. As illustrated on the display device 106, an example user interface is shown having a first axis 114 and a second axis 116 that is arranged as generally perpendicular to the first axis 114, although other arrangements are also contemplated, e.g., parallel.
[0024] Each of the axes includes parameters that are selectable to identify corresponding content to be output in the user interface. For instance, the first axis 114 is illustrated as referencing particular months and the second axis 116 is illustrated as representing particular years. Selection of the parameters from each of the axes may serve as a basis for outputting content that corresponds to the parameters. Thus, in this way a user may readily select parameters to locate content of interest and also readily navigate through related content, further discussion of which may be found in relation to the implementation examples below.
[0025] FIG. 2 illustrates an example system 200 that includes the computing device 102 as described with reference to FIG. 1. The example system 200 enables ubiquitous environments for a seamless user experience when running applications on a personal computer (PC), a television device, and/or a mobile device.
Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
[0026] In the example system 200, multiple devices are interconnected through a central computing device. The central computing device may be local to the multiple devices or may be located remotely from the multiple devices. In one embodiment, the central computing device may be a cloud of one or more server computers that are connected to the multiple devices through a network, the Internet, or other data communication link. In one embodiment, this interconnection architecture enables functionality to be delivered across multiple devices to provide a common and seamless experience to a user of the multiple devices. Each of the multiple devices may have different physical requirements and capabilities, and the central computing device uses a platform to enable the delivery of an experience to the device that is both tailored to the device and yet common to all devices. In one embodiment, a class of target devices is created and experiences are tailored to the generic class of devices. A class of devices may be defined by physical features, types of usage, or other common characteristics of the devices.
[0027] In various implementations, the client device 102 may assume a variety of different configurations, such as for computer 202, mobile 204, and television uses. Each of these configurations includes devices that may have generally different constructs and capabilities, and thus the computing device 102 may be configured according to one or more of the different device classes. For instance, the computing device 102 may be implemented as the computer 202 class of a device that includes a personal computer, desktop computer, a multi-screen computer, laptop computer, netbook, and so on.
[0028] The computing device 102 may also be implemented as the mobile 202 class of device that includes mobile devices, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on. The computing device 102 may also be implemented as the television 206 class of device that includes devices having or connected to generally larger screens in casual viewing environments. These devices include televisions, set-top boxes, gaming consoles, and so on. The multi-axis navigation techniques described to herein may be supported by these various configurations of the client device 102 and are not limited to the specific examples of multi-axis navigation technqiues described herein.
[0029] The cloud 208 includes and/or is representative of a platform 210 for content services 212. The platform 210 abstracts underlying functionality of hardware (e.g., servers) and software resources of the cloud 208. The content services 212 may include applications and/or data that can be utilized while computer processing is executed on servers that are remote from the client device 102. Content services 212 can be provided as a service over the Internet and/or through a subscriber network, such as a cellular or WiFi network.
[0030] The platform 210 may abstract resources and functions to connect the computing device 102 with other computing devices. The platform 210 may also serve to abstract scaling of resources to provide a corresponding level of scale to encountered demand for the content services 212 that are implemented via the platform 210. Accordingly, in an interconnected device embodiment, implementation of functionality of the multi-axis navigation module 112 may be distributed throughout the system 200. For example, the multi-axis navigation module 112 may be implemented in part on the computing device 102 as well as via the platform 210 that abstracts the functionality of the cloud 208.
[0031] Generally, any of the functions described herein can be implemented using software, firmware, hardware (e.g., fixed logic circuitry), or a combination of these implementations. The terms "module," "functionality," and "logic" as used herein generally represent software, firmware, hardware, or a combination thereof. In the case of a software implementation, the module, functionality, or logic represents program code that performs specified tasks when executed on a processor (e.g., CPU or CPUs). The program code can be stored in one or more computer readable memory devices. The features of the multi-axis navigation techniques described below are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.

Multi-axis Navigation Implementation Example
[0032] FIG. 3 illustrates a system 300 in an example implementation in which 1o multi-axis navigation technqiues through a first and second axis that may be used to specify a particular point in time are described. The system 300 is illustrated using first and second stages 302, 304. At the first stage 302, the computing device is illustrated as outputting a user interface configured for multi-axis navigation having first and second axes 114, 116.
[0033] As before, the first axis 114 is configured to include parameters relating to months and the second axis 114 is configured to include parameters relating to years. Therefore, parameters may be selected using the first and second axes to specify a particular month, an example of which is illustrated as "May 2009"
by giving focus to the selected parameters in the first and second axes 114, 116.
Content that corresponds to the selected parameters is illustrated as output in conjunction with the first and second axes 114, 116, which in this example are images captured at the particular point in time specified, e.g., May 2008.
[0034] To select different parameters, and therefore specify content for output that corresponds to the different parameters, the user may interact with the first and/or second axes 114, 116 in a variety of ways. For example, a drag gesture may be used which involves selecting a point along an axis and subsequent movement in a direction to change which parameter of the axis is highlighted. The illustrated example is shown as a selection made using a finger of the user's hand 108 of a parameter "July" and subsequent movement (illustrated through use of a phantom 3o arrow) along the first axis 114 toward a point of the first axis that is given focus.
[0035] A result of the drag gesture is illustrated at the second stage 304.
The month "July" is illustrated as being selected through the use of focus in this example. Therefore, at this point the parameter "July" is selected for the first stage 114 while the parameter "2008" is still selected for the second stage 116 thereby referencing a particular point in time, e.g., July 2008. Accordingly, the multi-axis navigation module 112 may cause output of content (e.g., images) that correspond to the particular point in time. In an implementation, this output may be performed in real time as one or more axes are scrolled. Naturally, other implementations are also contemplated, such as to update the user interface when the drag gesture is 1o completed. Thus, in this example a user may quickly navigate through months in a year using the first axis 114. The user may also interact with the second axis to navigate through years, further discussion of which may be found in relation to the following figure.
[0036] FIG. 4 illustrates a system 400 in another example implementation in which multi-axis navigation technqiues through a first and second axis that may be used to specify a particular point in time are described. As before, system 400 is illustrated using first and second stages 402, 404. At the first stage 402, the computing device 102 is again illustrated as outputting a user interface configured for multi-axis navigation having first and second axes 114, 116.
[0037] In this example, a drag gesture is illustrated as being input in conjunction with the second axis 116. The finger of the user's hand 108 is shown as selecting a particular parameter (e.g., 2010) and subsequently moved (e.g., illustrated through use of a phantom line) to complete the gesture, such as by moving toward an area having focus. A result of this gesture is illustrated in the second stage 404 in which the parameter for a year "2010" is shown as selected. Accordingly, the multi-axis navigation module 112 may output the content that corresponds to the month "May" in the first axis 114 and the year "2010" in the second axis 116.
[0038] By scrolling through the parameters in the axes, the user may navigate through corresponding content that is related. For example, the user may select the month "December" in the first axis 114 and then navigate through different years in the second axis 116 to view images taken during the holiday season. Although the examples of FIGS. 3 and 4 described parameters such as "month" and "year" to specify a particular point in time, a variety of different parameters may be utilized to specify a particular point in time, another example of which may be found in relation to the following figure.
[0039] FIG. 5 illustrates a system 500 in another example implementation in which multi-axis navigation technqiues through a first and second axis that may be used to specify a particular point in time as a day are described. In this example, the first axis 114 is again show as including parameters that reference particular months. The second axis 116, however, is shown as referencing particular days.
1o Therefore, in this example day "May 19" is selected using the first and second axes 114, 116 and the multi-axis module may output content that corresponds to the particular day. Thus, it should be readily apparent that a wide variety of points to time may be specified using the multi-axis technqiues described herein, such as particular days, weeks, months, and so on.
[0040] A wide variety of other parameters may also be specified using the multi-axis techniques described herein to locate and determine relatedness of a wide variety of different content. For example, the multi-axis techniques may specify a particular type of document and author to locate documents, a particular type and title to locate media, a particular sender or recipient along with a parameter relating to time to locate emails, text messages, voicemails, or other communications, and so on. Additionally, in an implementation a user interface may be output to specify parameters to be used by the first and/or second axes 114, 116 as well as to specify a type of content that is to be subject of a search using the parameters.
Further, more than two axes may be employed without departing from the spirit and scope thereof. A variety of other examples are also contemplated as further discussed below.

Example Procedure
[0041] The following discussion describes multi-axis navigation techniques that may be implemented utilizing the previously described systems and devices.
3o Aspects of each of the procedures may be implemented in hardware, firmware, software, or a combination thereof. The procedures are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks.
In portions of the following discussion, reference will be made to the environment 100 of FIG. 1 and the systems 300-500 of FIGS. 3-5.
[0042] FIG. 6 depicts a procedure 600 in an example implementation in which multi-axis navigation techniques are used to output content that corresponds to included parameters. A user interface is output by a computing device, the user interface including a first axis and a second axis that include parameters that are navigable via one or more gestures (block 602). The first and second axes may be 1o arranged in a variety of ways, such as generally perpendicular as shown in FIGS. 3-5, as generally parallel, at angle to each other, as partially or substantially overlapping, and so on.
[0043] Additionally, a variety of different parameters may be included on the axes. For example, the axes may be used to describe a particular point in time through inclusion of parameters that specify a time of day, day (e.g., a day of a week, a day of a year), week (e.g., in a month, year, and so on), year, and so forth.
A variety of other parameters may also be leveraged by the first and/or second axes, such as author, genre, composer, musician, group, type (e.g., email, instant message, document, media, video, blog, micro-blog, etc.), source (e.g., local, remote, streaming), topic, and so on. For instance, a user may configure the parameters manually as well as what is being searched (e.g., document, images, or other type as described above) manually through interaction with a user interface.
A variety of other examples are also contemplated.
[0044] One or more inputs are recognized as selecting a first one of a plurality of parameters in the first axis and a second one of a plurality of parameters in a second axis in a user interface, the first axis arranged in the user interface as generally perpendicular to the second axis (block 604). For example, a drag or other gesture may be utilized to scroll one or more of the axes to select particular parameters included in the axes. A variety of other techniques may also be employed, such as 3o a "tap" gesture to select a parameter, use of a cursor control device, and so forth.
[0045] One or more items are chosen by the computing device for concurrent display with the first and second axes that correspond to a first parameter in the first axis and a second parameter in the second axis (block 606). For example, a gesture may be received to select a parameter "July" in the first axis 114 and the parameter "2008" that is already referenced in the second axis 116.
Accordingly, the multi-axis navigation module 112 may output content (e.g., images) that corresponds to the first and second parameters (block 608), such as to view representations of the content (e.g., icons of documents or music files, thumbnails of videos or images, etc.) and/or the content itself, e.g., images in their entirety.
[0046] A selection is received of one or more of the items in the user interface (block 610). Continuing with the previous example, the content shown with the first and second axes may be selectable to initiate output of the content, such as to show an image full screen, begin rendering of a video, music or other media, output of a document for editing, and so on. Thus, a user may navigate to content of interest using the multi-axis navigation technqiues and then initiate the content through interaction with the user interface. Naturally, a variety of other examples are also contemplated, such as to initiate output automatically.

Example Device
[0047] FIG. 7 illustrates various components of an example device 700 that can be implemented as any type of portable and/or computer device as described with reference to FIGS. 1 and 2 to implement embodiments of the gesture techniques described herein. Device 700 includes communication devices 702 that enable wired and/or wireless communication of device data 704 (e.g., received data, data that is being received, data scheduled for broadcast, data packets of the data, etc.).
The device data 704 or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with a user of the device. Media content stored on device 700 can include any type of audio, video, and/or image data. Device 700 includes one or more data inputs via which any type of data, media content, and/or inputs can be received, such as user-selectable inputs, messages, music, television media content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source.
[0048] Device 700 also includes communication interfaces 708 that can be implemented as any one or more o\f a serial and/or parallel interface, a wireless interface, any type of network interface, a modem, and as any other type of communication interface. The communication interfaces 708 provide a connection and/or communication links between device 700 and a communication network by which other electronic, computing, and communication devices communicate data with device 700.
[0049] Device 700 includes one or more processors 710 (e.g., any of microprocessors, controllers, and the like) which process various computer-executable instructions to control the operation of device 700 and to implement embodiments of a touch pull-in gesture. Alternatively or in addition, device can be implemented with any one or combination of hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits which are generally identified at 712. Although not shown, device 700 can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
[0050] Device 700 also includes computer-readable media 714, such as one or more memory components, examples of which include random access memory (RAM), non-volatile memory (e.g., any one or more of a read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device. A
disk storage device may be implemented as any type of magnetic or optical storage device, such as a hard disk drive, a recordable and/or rewriteable compact disc (CD), any type of a digital versatile disc (DVD), and the like. Device 700 can also include a mass storage media device 716.
[0051] Computer-readable media 714 provides data storage mechanisms to store the device data 704, as well as various device applications 718 and any other types of information and/or data related to operational aspects of device 700. For example, an operating system 720 can be maintained as a computer application with the computer-readable media 714 and executed on processors 710. The device applications 718 can include a device manager (e.g., a control application, software application, signal processing and control module, code that is native to a particular device, a hardware abstraction layer for a particular device, etc.). The device applications 718 also include any system components or modules to implement embodiments of the gesture techniques described herein. In this example, the device applications 718 include an interface application 722 and an input module l0 724 (which may be the same or different as input module 114) that are shown as software modules and/or computer applications. The input module 724 is representative of software that is used to provide an interface with a device configured to capture inputs, such as a touchscreen, track pad, camera, and so on.
Alternatively or in addition, the interface application 722 and the input module 724 can be implemented as hardware, software, firmware, or any combination thereof.
Additionally, the input module 724 may be configured to support multiple input devices, such as separate devices to capture touch and stylus inputs, respectively.
For example, the device may be configured to include dual display devices, in which one of the display device is configured to capture touch inputs while the other stylus inputs.
[0052] Device 700 also includes an audio and/or video input-output system 726 that provides audio data to an audio system 728 and/or provides video data to a display system 730. The audio system 728 and/or the display system 730 can include any devices that process, display, and/or otherwise render audio, video, and image data. Video signals and audio signals can be communicated from device to an audio device and/or to a display device via an RF (radio frequency) link, S-video link, composite video link, component video link, DVI (digital video interface), analog audio connection, or other similar communication link. In an embodiment, the audio system 728 and/or the display system 730 are implemented 3o as external components to device 700. Alternatively, the audio system 728 and/or the display system 730 are implemented as integrated components of example device 700.

Conclusion
[0053] Although the invention has been described in language specific to structural features and/or methodological acts, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed invention.

Claims (10)

What is claimed is:
1. A method comprising:

outputting a user interface by a computing device, the user interface including a first axis and a second axis that include parameters that are navigable via one or more gestures; and choosing one or more items by the computing device for concurrent display with the first and second axes that correspond to a first said parameter of the first axis and a second said parameter of the second axis.
2. A method as described in claim 1, wherein the first axis is arranged in the user interface as generally perpendicular to the second axis.
3. A method as described in claim 1, wherein the first and second said parameters are selected via the one or more gestures.
4. A method as described in claim 3, wherein the one or more gestures include a drag gesture.
5. A method as described in claim 1, wherein the first said parameter and the second said parameter reference a point in time and the one or more items correspond to the point in time.
6. A method as described in claim 5, wherein the point in time is a particular day, week, or month.
7. A method as described in claim 5, wherein the one or more items correspond to the point in time by being created at that point in time.
8. A method comprising:

recognizing one or more inputs as selecting a first one of a plurality of parameters in a first axis and a second one of a plurality of parameters in a second axis in a user interface output by a computing device using one or more gestures, the first axis arranged in the user interface as generally perpendicular to the second axis; and outputting one or more items in the user interface that correspond the first and second parameters.
9. A method as described in claim 8, wherein parameters in the first axis specify months and parameters in the second axis specify years.
10. A method as described in claim 8, wherein at least one of the items is selectable to cause an output of the item.
CA2791284A 2010-03-24 2011-03-15 Multi-axis navigation Abandoned CA2791284A1 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US31721410P 2010-03-24 2010-03-24
US61/317,214 2010-03-24
US12/822,063 US8957866B2 (en) 2010-03-24 2010-06-23 Multi-axis navigation
US12/822,063 2010-06-23
PCT/US2011/028561 WO2011119380A2 (en) 2010-03-24 2011-03-15 Multi-axis navigation

Publications (1)

Publication Number Publication Date
CA2791284A1 true CA2791284A1 (en) 2011-09-29

Family

ID=44655803

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2791284A Abandoned CA2791284A1 (en) 2010-03-24 2011-03-15 Multi-axis navigation

Country Status (10)

Country Link
US (1) US8957866B2 (en)
EP (1) EP2550589A4 (en)
JP (1) JP2013522797A (en)
KR (1) KR20130018701A (en)
CN (1) CN102822786A (en)
AU (1) AU2011229817B2 (en)
CA (1) CA2791284A1 (en)
CL (1) CL2012002530A1 (en)
WO (1) WO2011119380A2 (en)
ZA (1) ZA201206432B (en)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7509588B2 (en) 2005-12-30 2009-03-24 Apple Inc. Portable electronic device with interface reconfiguration mode
US10313505B2 (en) 2006-09-06 2019-06-04 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US8519964B2 (en) 2007-01-07 2013-08-27 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US8619038B2 (en) 2007-09-04 2013-12-31 Apple Inc. Editing interface
JP4656218B2 (en) * 2008-09-10 2011-03-23 カシオ計算機株式会社 Image display device, image display method, and image display program
US10007393B2 (en) * 2010-01-19 2018-06-26 Apple Inc. 3D view of file structure
US20110239149A1 (en) * 2010-03-24 2011-09-29 Microsoft Corporation Timeline control
US8423911B2 (en) 2010-04-07 2013-04-16 Apple Inc. Device, method, and graphical user interface for managing folders
US10788976B2 (en) 2010-04-07 2020-09-29 Apple Inc. Device, method, and graphical user interface for managing folders with multiple pages
US9473614B2 (en) * 2011-08-12 2016-10-18 Htc Corporation Systems and methods for incorporating a control connected media frame
US20130067366A1 (en) * 2011-09-14 2013-03-14 Microsoft Corporation Establishing content navigation direction based on directional user gestures
US9213479B2 (en) * 2012-02-16 2015-12-15 Samsung Medison Co., Ltd. Method and apparatus for displaying image
US9569083B2 (en) * 2012-12-12 2017-02-14 Adobe Systems Incorporated Predictive directional content queue
US9575998B2 (en) 2012-12-12 2017-02-21 Adobe Systems Incorporated Adaptive presentation of content based on user action
US20140282191A1 (en) * 2013-03-12 2014-09-18 Microsoft Corporation Dynamic navigation of ranges in calendar views
US9471200B2 (en) * 2013-03-15 2016-10-18 Apple Inc. Device, method, and graphical user interface for organizing and presenting a collection of media items
CN105122200A (en) * 2013-03-29 2015-12-02 惠普发展公司,有限责任合伙企业 Adjustable timeline user interface
WO2015019556A1 (en) * 2013-08-07 2015-02-12 パナソニックIpマネジメント株式会社 Case display device, case display method and program
EP3063608B1 (en) 2013-10-30 2020-02-12 Apple Inc. Displaying relevant user interface objects
JP2015194848A (en) * 2014-03-31 2015-11-05 ブラザー工業株式会社 Display program and display device
JP6424592B2 (en) * 2014-11-28 2018-11-21 株式会社バッファロー INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING SYSTEM, DISPLAY CONTROL METHOD IN INFORMATION PROCESSING DEVICE, AND PROGRAM
US10203843B2 (en) * 2015-09-21 2019-02-12 Microsoft Technology Licensing, Llc Facilitating selection of attribute values for graphical elements
JP6147825B2 (en) * 2015-09-29 2017-06-14 株式会社東芝 Electronic apparatus and method
US10327036B2 (en) 2015-11-17 2019-06-18 Rovi Guides, Inc. Systems and methods for implementing a timeline scroller to navigate media asset identifiers
US10846475B2 (en) * 2015-12-23 2020-11-24 Beijing Xinmei Hutong Technology Co., Ltd. Emoji input method and device thereof
DK201670595A1 (en) 2016-06-11 2018-01-22 Apple Inc Configuring context-specific user interfaces
US11816325B2 (en) 2016-06-12 2023-11-14 Apple Inc. Application shortcuts for carplay
JP2021119426A (en) * 2018-04-24 2021-08-12 ソニーグループ株式会社 Information processing device, information processing method and program
US11675476B2 (en) 2019-05-05 2023-06-13 Apple Inc. User interfaces for widgets

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000010706A (en) * 1998-06-25 2000-01-14 Fujitsu Ltd Method and device for display control and record medium
US7469381B2 (en) 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
JP2002537695A (en) * 1999-02-08 2002-11-05 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Method and apparatus for displaying electronic program guide
SE514282C2 (en) * 1999-04-22 2001-02-05 Nokia Multimedia Terminals Oy Method and device for scrollable cross-point navigation in a user interface
US6337694B1 (en) * 1999-09-07 2002-01-08 International Business Machines Corporation Method and system for variable speed scrolling within a data processing system
US7107532B1 (en) * 2001-08-29 2006-09-12 Digeo, Inc. System and method for focused navigation within a user interface
US20050160113A1 (en) * 2001-08-31 2005-07-21 Kent Ridge Digital Labs Time-based media navigation system
US7146574B2 (en) * 2001-12-21 2006-12-05 Microsoft Corporation Systems and methods for interfacing with digital history data
KR101104921B1 (en) 2003-08-08 2012-01-12 코닌클리케 필립스 일렉트로닉스 엔.브이. Method of scrolling through a document
US7398479B2 (en) * 2003-08-20 2008-07-08 Acd Systems, Ltd. Method and system for calendar-based image asset organization
US6990637B2 (en) * 2003-10-23 2006-01-24 Microsoft Corporation Graphical user interface for 3-dimensional view of a data collection based on an attribute of the data
US8990255B2 (en) * 2003-11-17 2015-03-24 Nokia Corporation Time bar navigation in a media diary application
US8010579B2 (en) * 2003-11-17 2011-08-30 Nokia Corporation Bookmarking and annotating in a media diary application
US20050134945A1 (en) * 2003-12-17 2005-06-23 Canon Information Systems Research Australia Pty. Ltd. 3D view for digital photograph management
EP1842142A1 (en) * 2005-01-20 2007-10-10 Koninklijke Philips Electronics N.V. A user interface for browsing image
KR100708135B1 (en) * 2005-05-25 2007-04-17 삼성전자주식회사 Method and device for scrolling through blocked items
JP2007018352A (en) * 2005-07-08 2007-01-25 Olympus Imaging Corp Image display device, image display program, image display method and recording medium
US7404150B2 (en) * 2005-11-14 2008-07-22 Red Hat, Inc. Searching desktop objects based on time comparison
US7657849B2 (en) 2005-12-23 2010-02-02 Apple Inc. Unlocking a device by performing gestures on an unlock image
KR100877829B1 (en) * 2006-03-21 2009-01-12 엘지전자 주식회사 Terminal with scrolling function and scrolling method thereof
US9395905B2 (en) * 2006-04-05 2016-07-19 Synaptics Incorporated Graphical scroll wheel
KR101304461B1 (en) 2006-12-04 2013-09-04 삼성전자주식회사 Method and apparatus of gesture-based user interface
US7954065B2 (en) * 2006-12-22 2011-05-31 Apple Inc. Two-dimensional timeline display of media items
US20080244453A1 (en) * 2007-04-01 2008-10-02 Jason Edward Cafer Iconic event timeline with latitude snapping and method for providing the same
US7539659B2 (en) * 2007-06-15 2009-05-26 Microsoft Corporation Multidimensional timeline browsers for broadcast media
US20090193034A1 (en) * 2008-01-24 2009-07-30 Disney Enterprises, Inc. Multi-axis, hierarchical browser for accessing and viewing digital assets
US8443011B2 (en) * 2008-04-30 2013-05-14 Netapp, Inc. Graphical storage system visualization, timeline based event visualization, and storage system configuration visualization
JP4675995B2 (en) * 2008-08-28 2011-04-27 株式会社東芝 Display processing apparatus, program, and display processing method
US8681106B2 (en) * 2009-06-07 2014-03-25 Apple Inc. Devices, methods, and graphical user interfaces for accessibility using a touch-sensitive surface
KR20100136649A (en) * 2009-06-19 2010-12-29 삼성전자주식회사 Method for embodying user interface using a proximity sensor in potable terminal and apparatus thereof
US20110239149A1 (en) * 2010-03-24 2011-09-29 Microsoft Corporation Timeline control

Also Published As

Publication number Publication date
KR20130018701A (en) 2013-02-25
US20110234504A1 (en) 2011-09-29
AU2011229817B2 (en) 2014-04-17
US8957866B2 (en) 2015-02-17
EP2550589A4 (en) 2016-03-16
AU2011229817A1 (en) 2012-09-20
EP2550589A2 (en) 2013-01-30
ZA201206432B (en) 2013-10-30
WO2011119380A3 (en) 2011-12-29
CL2012002530A1 (en) 2012-12-21
JP2013522797A (en) 2013-06-13
CN102822786A (en) 2012-12-12
WO2011119380A2 (en) 2011-09-29

Similar Documents

Publication Publication Date Title
US8957866B2 (en) Multi-axis navigation
US20230022781A1 (en) User interfaces for viewing and accessing content on an electronic device
US10191633B2 (en) Closing applications
JP6151242B2 (en) Desktop as an immersive application
US8458609B2 (en) Multi-context service
US8635555B2 (en) Jump, checkmark, and strikethrough gestures
US20130067392A1 (en) Multi-Input Rearrange
US20110304556A1 (en) Activate, fill, and level gestures
US20130014053A1 (en) Menu Gestures
US20110239149A1 (en) Timeline control
EP2354913A2 (en) Method and system for providing a user interface for accessing multimedia items on an electronic device
US20170300221A1 (en) Erase, Circle, Prioritize and Application Tray Gestures
JP2017523515A (en) Change icon size
US20130169649A1 (en) Movement endpoint exposure
US20130019201A1 (en) Menu Configuration
JP6151248B2 (en) Immersive shell and desktop shell display
US20130067346A1 (en) Content User Experience
US20110304649A1 (en) Character selection
US10606924B2 (en) Contextual file manager
US20150074572A1 (en) Navigable wall
US8769169B2 (en) Assistive buffer usage techniques
JP6405143B2 (en) Content display apparatus and display method
US9176573B2 (en) Cumulative movement animations
US20130290907A1 (en) Creating an object group including object information for interface objects identified in a group selection mode
TWI427495B (en) Operation platform system, operation method and host apparatus

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20160315

FZDE Discontinued

Effective date: 20180315