CA2507741A1 - Multi-planar three-dimensional user interface - Google Patents

Abstract

A 10-Foot media user interface is herein described. A computer user interface may be designed for primary use as a 10-Foot user interface, where a user controls the computer using a remote control device, instead of as a traditional 2-Foot user interface where the user controls the computer using keyboard and mouse from directly in from of the computer. The 10-Foot user interface uses 3D space and animations to more clearly indicate navigation and selection of items in the user interface to the controlling user. Use of three-dimensional space also increases the display screen real estate that is available for content items, and allows the media user interface to move unselected items out of primary view of the user.
The user interface may animate movement in three-dimensions to allow the user to more easily conceptually follow navigation of the user interface.

Description

...~~1~654 121?~.~.....> . . . ... ...". . .. . . .. . , .... . .r . . .. . .
.... . ~......
mu~.T~-r~.,~.IrAR THIIZ~r~mME~s>r~~A~, v~lE» ~rIT»R~~c~
[QO()7 ] A portion of th.e disclosure of this patent document contains material which is subject to copyright pratection. The copyright owner has no abjection to the facsimile reproduction by anyone of the patent document or the patent disc.lasure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights w hatsaever.
hIELD OF THE INVENTI~N' j0002j The invention relates generally to user interfaces of computer systems.
More spec.i~caliy, the invention provides a three dimensional space and enhancedrusability animatians fo.r a mufti-planar user interface of a data processing device primarily intended for interaction by a user via a remote control or other extended control device.

[4003] As technology development progresses, prices decrease, and computing power increases, e.g., memory, storage, processor speed, graphics, and the like, computers are more often used far special purposes instead of being used as a general purpose machine. Eor example, computers have replaced video cassette recorders (VCRs) in the form of a personal video recorder (PVR), able to retard and pause live TV, something which a VCR
could never do. As computers replace devices which are not inherently meant for a user to interact ~.vith i.n the same manner as a user might interact with a traditional PC, traditional user interfaces include perceived drawbacks making them unsuitable as user interfaces for these special purpose computers, and thus new user interfaces are needed to allow a user to efficiently utilize the new device.
i Jt1004J In a conventional scenario a user might interact with a Name PC or laptop via a keyboard arid mousy for providing primary input to the PC, and via a display screen and speakers for receiving primary output from the PC (other input and output devices may be s used, such as a video camera. printer, scanner, and the like, but such devices are generally used less often for secondary input anti output). The keyboard, mouse, display screen and speaker are all typically placed within close proximity io the user, e.g., on a desk. The user interface of the PC"s operating system is likewise designed unden~ the expectation that the user :.... .. _........., ....,. _:. , ,.._...: ._.... ...... .. .._,..., .:.......
,....._ ......... .._.~... _.. ... .....,~.. .......
.ra~~5~. f~4t~~
will interact w°iti the operating system using the. proximately located keyboard, mouse, display device. and speakers. This traditional computer anputloutput configuration is colloquially referred to as a "?-Foot°" user interface. because the user is primarily intended to interact v4°ith the :l'C: from approximately 2 feet. away froth the input or output device, e.g., sitting at a chair in front oftlae desk on which the keyboard, mouse, display, and speakers are located.
[000"j However, the 2-Foot user interface does not provide the same level of usability to a user when implemented on. a device not intended to be used urith a. 2-Foot interface, hut rather is intended to be used or controlled via an infrared rerrtote control or some other remote control device. Devices that are primarily intended to be used with a remote control device have a user interface colloquially referred to as a 1G-Foot user interface, because the user i.s primarily intended to interact with the device from father away than 2 feet, and generally sits about 20 feet away from the output display screen attached to the device.
Examples of devices that benefit from a 1G-Foot user interface include 1'~'Rs and Media Center PCs. A
Media Center 1'C is a data processing device with .features that allow a user to watch and record TV, manage music and listen to the radio. play DVDs, organize photos, and perform other media related activities, primarily via interaction with a remote control device, e..g., at a similar distance as a user might watch TV in his or her home.
[0006] As will be appreciated, a 2-Foot user interface does not work as well when implemented on a device intended to have a l G-Foot user interface because text and graphics are usually too small to be effectively seen from the user's farther distance from the display device. While a first generation of 1 G-Foot user interfaces have been developed for existing devices, these first generation 1G-boot user interfaces have inherent usability deficiencies that hinder the user experience ~~°ith the devices on which they are implemented. Thus, it would be an advancement in the arc to provide an improved user intc;rface For devices whose primary interaction by a user is via remote a remote control device.
BRIEC' SL~IvIMARY t~F Tl-lF.. IN~'~~1';'It~~
j0007j The following presc;nts a simplified summary of the invep~tion in order to provide a basic understanding of some aspects of the invention. This summary is not an extensive overview of the invention. It is not intended to identify k.ey or critical elements of the invention or to delineate the scope of the invention. The following summary merely presents -z-~, .... . .... ..... , '~y~~~~ s~~..i ~~:
some: cancepts of the invention in a simplified form as a prelude to the more detailed description provided below.
[U008;] 'I'o overcome limitations in t~'ae prior art described above, and to overcome other limitations that will be apparent upon reading and understanding the. present specification, the present invention is generally directed to a 1.0-Foat user interface for a computer system controllabke bZ~ a remote control device such as an infrared remote control.
The user interface displays a menu listing multiple menu items navigable and selectable by a user of the computer system using the renwte control device. When the user selects one of th.e menu items, the user interface splits content onto two dif~'ereuat planes in a three-dimensional space in which the user interface is drawn, and puts the selected n aenu item on a prominent first plane, and the unselected menu items on a less prominent second plane.
~O(109] According to another aspect ofd the invention, a computer on which the user interface is executing may animate transitions from single plaane to uraulti-plane views of the user interface. A user of the data processing system can central the data processing system with a remote control device, e.g., an infrared remote control. The computer has a processor configured, by executing software stored in memory, to provide the user interface as a three-dimensional user interface drawaa on a display device connected to the computer system. The software stored in memory may include a user interface software module that provides the user interface in the three-dimensional space, where the user interface includes multiple menus navigable by the user using the remote control device. The software may also include an animation module which, under central of the user interface sofiware module, provides a sequence of frames for an animation when the user selects an item from a menu.
The animation sequence splits the menu items o-f the menu from which the user selected an item between a two planes in fl~~ three-dimensional space, and animates the first and second planes moving away from each other in the three-dimensionak space.
]OplO] According to another aspect of the invention, a computer readable medium stored computer executable instructions for perfaraning a method of providing a user interface. The method includes generating a three-dimensional graphical space for providing a user interface of a data processing device, and displaying on a display device connected to the data processing device a first list of a plurality of menu items selectable by a user navigating the user interface atsing a remote control d~:vice. When the user selects one of the menu items, the user interface displays the selected menu item on a first plane in the three-dimensional _.,_ "-~(t~j6~~:lill~t%~3 ~~.'i. ..-.. .. . .. ..... . .... ... . . .., ... . ..
... ... . ._........
graphical space, and displays the other menu items on a second plane in the tlaree-dimensioaaal graphical space. Tlae user interface then animates the two planes moving away tiom each other in the three dimensional space such that, when the animation is completed, the first plane has a more prominent display position than the second plane in the three-dimensi.onal space in ~~hicla tlae user interface is dra~~~n.
I3R1.EF I~E~C'Rll''fION t~F 1'lrF. DRAW1NCTS
[0011 ~ A more complete understanding of the present invention and the advantages thereof may be acquired by referring to the following description in consideration of the accompany ing drawings, in which like reference nmnbers indicate like features, and wherein:
[0012] Figure 1 illustrates a general operating environment suitable for implementation of a media user interface according to an illustrative embodiment of the invention.
(0013] Figure 2 illustrates a user interface infrastructure that rnay be used to support a media user interface according to an illustrative embodiment of the invention.
(0014] Figure 3 illustrates a start menu of a media user interface according to an illustrative embodiment of the invention.
[4015] Figure 4 illustrates control zones of the start menu illustrated in Figure 3 according to an illustrative embodiment of the invention.
(001.6] Figure 5 illustrates the start menu illustrated in Figure 3 when a different menu item is highlighted by the selection cursor according to an illustrative embodiment of tlae invention.
(0017] Figure 6 illustrates a first frame in a most recently used (~RU} list reveal animation according to an illustrative embodiment of the invention.
(001.8j Figure 7 illustrates an intermediate frame in a iVIRU list reveal animation according to an illustrative embodiment of floe invention.
(0019) Figure 8 illustrates a (anal frame in a MRIlist reveal animation according to an illustrative embodime-nt of the invention.
(0020] Figure 9a illustrates a top perspective vieul of a single plane menu according to an ilhistrative embodiment of the invention.
i -4- y ~. ~~.~ ... , . ,..> , - . ~~~ >. ~ . .-.~, "':3t~~ti5~4.1<'t~~Cl-'-' (0021] Figure 9b illustrates a top plizn view of the single plane menu illustrated i.n Figure 9a according to an illustrative embodiment of the invention.
]0022] Figure l0a illustrates a top perspective view of a double-hinged double plane menu according to an illustrative embodiment of the invention.
[0023] Figure lOb illustrates a top plan view° of the double-hinged double plane menu 311ustrated in Figure l0a according to an ilh~strativc emt~diment of the invention.
[oo2al .Figure l l illustrates a first intermediate frame of a IvIl2U list tilt animation accordin;
to an illustrative embodiment of the i.nve.ntion.
[002Sj Figure 12 illustrates a seco~.~d intermediate frame of a MRU list tilt animation according to an illustrative embodiment of the invention.
[0026] Fibure 13 illustrates a final frame of a MRU list tilt animation according to an illustrative embodiment of the invention.
[0027] Figure 14a illustrates a top perspective view of a double-wall double plane menu according to an illustrative embodiment of the invention.
[0028] Figure 14b illustrates a top plan view of the double-wall double plane menu illustrated in Figure 14a according to an illustrative embodiment of the invention.
[0029] Figure 15 illustrates a first intermediate frame of a power menu reveal animation according to an illustrative embodiment of the invention.
[0030] Figure 16 illustrates a second intermediate frame of a power menu reveal animation according to an illustrative embodiment of the invention.
(0031 j Figure 17 illustrates a third intermediate frame of a power menu reveal animation according to an illustrative embodiment of the invention.
[0032] Figure 18 illustrates a final frame of a power menu reveal animation according to an illustrative embodiment of the invention.
[0033] Figure 19 illustrates a 1~1~~ Masic~ .menu according to a~z illustrative embodiment of the invention.
-$- l G
i t j" .., ....
..~.d~6~~.1,.'t~0 ~.~
(0034] Figure 20 illustrates a first intermediate frame of a c.or~text menu reveal animation according to an illustrative embodiment ofthe invention.
[(1035] 1~igure 21 illustrates a second intermediate frame of a context menu reveal animation according to an. illustrative embodiment of the invention.
[fl03G] Figure 22 illustrates a lnna.l frame of a coa~teat menu reveal animation according to an illustrative embodiment of the invention.
[0037] Figure 23 illustrates a top plan view of a double ,plane single-hinge menu according to an illustrative embodiment of the invention.
[0038] Figure 24 illustrates a flowchart for a met.ltad of performing alpha fadini; according to an illustrative embodiment of the invention.
[0039 Figure 25 illustrates a folder navigation menu according to an illustrative embodiment of the invention.
[0040] Figure 2f illustrates a volume window according to an illustrative embodiment of the invention.
[0041] Figure 27 illustrates a second view of the volume window according to an illustrative errtbodiment of the invention.
[0042] Figure 28 illustrates a view of the volume window when the volume. is muted according to an illustrative embodimetat of the invention.
[;0043] Figure 29 illustrates a top plan 'view of an alternative mufti-plane media user interface according to an illustrative embodiment of the invention.
(fl044Figure 30 illustrates a tap plan view of an alternative mufti-plane media user interface according to an illustrative embodiment of the invention.
DI=TALLED DESCRIPTI~N
[0045 In the following description of the various embodiments, reference is made to tl-~e accompanying drawings, which form a Dart hereof, and in which is shown by way of illustration various embodiments in which the. invention may he practiced. It is to be , . . .. ..H.' ~. ... .. ... ..,., .. . ..- .. .. -. ... >. . .. .,... .~ ..n.
... . . . .... . ,~.. .. . . ....
'31'f~~54:1"?'L1 C~
understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the scope of the present invention.
[0046] Figure I illustratES an example of a suitable computing system environment 100 on which the invention may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of th.e inVOnt~On. hleither should the computing environanent I (10 be interpreted as having any dependency ox reduirement relating to any one nr combination of components illustrated in the .illustrative operating environment 1. 00.
[00~7j The invention is operational with numerous other genr:ral purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited ta, personal computers. server computers, hand-held or laptop devices, muh.iprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
[0048) The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer.
Generally, program modules include routines, pro,gran~s, objects, components, data structures, etc, that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. Tn a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
[0049 With reference to l:igure i, an illustrative system for implementing the invention includes a general purpose computing device in the form of a computer 110.
Components of .
computer l l (~ may include, but are not limited to. a processing unit I20, a system memory 130, and a system bus 12I that couples various system components including the system memory to the processing unit 120. The system bus I2I may be al~Y of several types of bus structures including a memory bus or memory controller, a peripheral bus. and a local bus using any of a variety of bus architectures. By evay of example, and not limitation, such ... ~:_ ~. t'~''t~T'U -' architectures include htdustry Standard Architecture {ISA) bus, h9icro Channel Architecture (MCA) bus. Enhanced ISA {E1SA) bus, 'Video Electronics Standards Association {VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.
[0050] Computer 110 typically includes a variety of computer readable media.
Computer readable media can be any available media that can be accessed by computer 110 and includes both volatile and nonvolatile media, removable and non-removable media. By way o.f example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes both volatile and ~tonvolatile, removable and .non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures. program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, Elc',PROiVI, flash memory or other memory technology. CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, ma~,lnetic disk storage or other magnetic storage devices, or any other medium which can be used to stare the desired information and which can accessed by computer 110. Communication media typically embodies computer readable instructions. data structures, program modules or other data in a modulated data signal such as a carrier wave ox other transport mechanism and includes any information delivery media. The term ''modulated data signal"
means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the si~t,nal. By way of example, and not linxitafiion, communication media includes wired media such as a wired n etwork or direct-wired connection, and wireless media such as acoustic. RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.
[0051 The system memory 1.30 incl.~ades computer storage media in the form of volatile and/or nonvolatile memory such as read only memory {ROM) 131 and random access memory (RAM) 132. A basic input)"output system 133 {3105), containing the basic routines that help to transfer information befween elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, Figure 1 illustrates operating system 134, application programs 135. other program modules 136, and program data 137.
_g_ :.;.w,.,... . ., ...
' -'g q_""~9'y r~t~. ~s ~ ~
X0052] The computer I10 snag also include other remavablelnon-removable, volatileln.anvolatile computer storage media. 13y way of example only, h'igure I illustrates a hard disk drive 140 that reads from or writes to nan~removabie, nonvolatile magnetic media, a magnetic disk drive 151 that reads fxom ar writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 15S that reads from or writes to a removable, nonvolatile optical disk 156 such as a C1~ ROM or outer optical media. Other removablelnon-removable, valatilelnonvol.atile computer storage media that can be used in the illustrative operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid slate ROM, and the tike. The hard disk. drive 141 is typically connected to the s;~stem bus 121 through an non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 1 S0.
[0053] The drives and their associated computer storage media discussed above and illustrated in Figure I, provide storage of computer readable instnrctians, data structures, progxam modules and ether data for the eamputer I 10, In Figure l , for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146, and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers here to illustrate that, at a minimum, they are different copies. A user may entex commands and information into the computer 20 through input devices such as a keyboard 162 and pointing device 161, canunonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) may include. a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor I 91 or other type of display device (e_g., a TV) is also connected to the system bus 121 via an interface, such as a video interface 190. In addition to the monitor, computers may also include other peripheral output devices such as speakers 1 X37 and printer 196, which may be connected through an output peripheral interface 190.
g_ t.,..... . . .. .. ..... ..., ..., ... - ~-, 3096~4.,2C~.0 ~0(154~ In some aspects, a pen digitizer 165 and accompanying pen or stylccs 166 are provided in order to digitally° capture .freehand input. Although a direct connection between the pen digitizer 165 and the user input interface 160 is shnvn, in practice, the pen digitizer 165 may be coupled to tl~e processing a~nit I 10 directly. parallel port or other interface and the s~rstem bus 130 by any technique including wirelessly. Also,. the pen 166 may have a camera associated with it and a transceiver for wirelessly transmitting image information captured by the camera to an interface intek°acting with bus 130. FuF-ther; the pen may have other sensing systems in. addition to or in place of~ the camea°a for determining strokes of electronic ink including accelerometers, magnetometers, and gyroscopes.
[0~55~ The computer 110 may operate in a networked et~virontr~cnt using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 3 80 may be a personal computer, a s~rve~-, a muter, a network PC, a peer device.
or other common network node, and typically includes many or- all of the elements described above relative to the computer 110, although only a memory storabe device 181 has been illustrated in Figure 1. The logical connections depicted in Figure 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks.
Such networking environments are commonplace in offices, enterprise-vv~ide computer networks, intranets and the Internet. Further, the system may include wired and/or wireless capabilities.
For example, network interface 170 may include Blutetooth, SWI,an, and/or IEEE
802.11 class of combination abilities. It i.s appreciated that other wireless communication protocols may be used i.n conjunction with these protoca.ls or in place of these protocols.
[0056] When used in a 1,AN networking environment, tile computer 1 10 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN
networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173. such as the lntemet. The modem 172.
which may be internal or external, may be connected to the. system bus 121 via the user input interface 160, or other appropriate mechanism. In a networked environment, program modules depicted relative to th.e com.putcr 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, Figure 1 illustrates remote application programs 185 as residing on memory device 181. It wiLI be appreciated that the network connections shown arc illustrative and other means of establishing a communications link between the computers may be used.
_ a0_ ....~:.., . .,~ ..., . . . . .. . .. . ......._, ~.~Og65~1:1 ~VJt~ ~ .
[~057] It will be appreciated that the network connections shores are illustrative and other techniques for establishing a catn.munications link between the oomputei°s can bz used. The existence of any of various well-known ,protocols such as TCPI1P, 1~thenaet.
FTP, HTTP and the like is presumed, and the system cuff be operated ire a client-server configuration to permit a user to retrieve web pages from a web-based server. Any of various conventional web browsers can be used to display and manipulate data on web pales.
[0058] One or more aspes;ts of they invention may be embodied in computer-executable instructions, such as in one or more program modules, executed by one or more computers or other devices. Generally, pro~aram modules include routines, prol;rarns, objects, components, data structures, etc. that porforn~ particular tasks or implement particular abstract data types when executed by a processor in a computer or other device. 'hlte computer executable instructions may be stored on a computer readable medium such as a hard disk, optical disk, removable storage media, solid state memory, RAM, etc. As will be appreciated by one of skill in the art, the functionality of the pro~,~ram modules may be combined or distributed as desired in various embodiments. In addition, th.e functionality may be embodied in whole or in part in firmware or hardware equivalents such as integrated circuits, ~etd programmable bate arrays {FPGA}, and the like.
X0059] Illustrative F.mbadinaents of'the Itaventioh [0060] In addition to the about;, computer 110 tnay additionally be configured with a TV
tuner e.ard, and computer 1 & 0 may be controllable by a remote control device 163, such as art infrared remote control. The remote control device 163 tnay be configured with a plurality of input, e.n., buttons, keys, touehpad, finger pointing device, scroll control, etc., each configured to send a unique command to the computer 11 Ct via atl infrared control signal.
Remote control 163 may be configured to provide navigation buttons {e.g., left, right, up down, forward, back, etc.}. selection buttons (e.~;., primary select, secondary select, enter.
escape, cancel, etc.}, alphanumeric input buttons (e.g., 1, 2, .. , 9, 0, A, B, C, etc.}, application buttons to launch curtain applications or navigate to a certain type of data (e.g., Internet Explorer, Music, T~', Photos, etc. j, as well as conventional. remote control itaputs {e.g., channel up, channel down, volume up, volume down, eat.), t j0061 j Computer 11 Q may be. configured with a media mode of operation in which a user interacts with computer 11 a using remote control device 163 and a so-called "10-Foot" user ._..,.,.. , _ . .._.. . , .. -. .. . .... _ ..
. >:-~~~~~~. ~.y.~,w'w interface displayed on TV 391. 'fhe media mode of operation may allow a user to watch or record 'fV, watch a IW'D, listen to trtusic (via digital music file or via radio or optical disc), review and!or edit digital photos, and perform outer media-related operations.
)3ec.ause a user of the media triode of operation urill often be sitting farther than a user ~,°ould sit to interact with the computer I 10 in its normal mode of operation. the user interface of the media made of operation should pz~ovide features that st3f~ciently convey receipt of remote control user input back to the user, and convey navigation of the user interface to the more distantly located user. That is, the display of the user intexface should not only be easily recognizable when a user i.s sitting directly in frt~nt of the computer monitor (e.~;., about 2 feet away, as w-iih a conventional 2-Foot user interface), but should also be clearly recognizable and usable when the user is controlling the user interface .irom farther away (e.g,, about 10 feat) using the remote c-ontrol devico 3.63. For example, a 10-Foot user interface typically has less information on the screen at one iirrte than a 2-I;ctot user i.ntertace because of the distance through which the user is interacting with the user interface. That is, the information on the screen must be larger so that the user can see the user intorfac;e from farther away, l~eeause the information on a 10-foot user interface is typically Iarg~r than the same information displayed on a 2-Foot user interface, less information tits in the same amount of display screen real estate. The l El-Foot user interface of the media. mode of operation is referred to herein as the media user interface.
[0062] According to an aspect of the invention, in order to convey a sense of depth to a user of the media user interface, the media user interface may be constructed in a three-dimensional space. That is, while the media user interface might be displayed on a two-dimensional display device such as a motaitor or "rV, the media user interface. rnay be constructed in a 3I~ graphical space having X, Y, and Z dimensions, as well as have an alpha channel, a, to provide transparency according to certain features of the media user interface (described further below). l,ssing the Z-dimension allows the media user interface to have more information on the screen while still providing the information in a large enough size to be o~isible from lather away than a traditi.onai 2-foot user interface, becaLtse infornlation can be presented with varying Z-values, as well as with varying X. and Y values.
[0063] According to another aspect of the invention, in order to provide fluidity between the various displays of the media user interface based on user inputs, the media user interface may be animated. F3ecause the user of the media user interface is typically going to be -rz.

°-., - - -. . , ... ." . . ., . ., . ~ ~ °.
,Q96~'~~:~2'2t~i0 located farther from the screen than a 2-Foot user interface, it is generally more difficult for a user to see smaller details on the user interface. Instead of instantly changing from one menu to the text, or from one .menu item selection to the next, either of which a user might miss if not paying careful attentiot, animation may be used to illustrate to the user the result of his or he.r user input, or the changing of one menu to the next, thus making it easier for the user to conceptually follow his or her navigation through the media user interface.
Furthermore, animation may be used to provide l:eedback that a user has performed some action ort the user interface.. such as (a) moving faces from one menu selection to another or (b) selecting an item from a menu.
~DI164~ In order to pravid~. three-dimensionality and animations, the media user interface may be developed using any software package that provides three-dimensionality and graphics acceleration, such as the Direc.tX~ 9.0 software development kit with DirectX
9.Ob runtime, available from Microsoft Corporation. of Redmond, Washington. The underlying software architecture is secondary to the services it provides the media user interface. Microsoft's DirectX & is a suite of multimedia application pragraxnm.ing interfaces (APIs) built into Microsofi.'s Windows operating systems, and provides a standard development platform i:or Windows-based PCs by ~:nabling software developers to access specialized hardware features without having to write hardware-specific code. The APIs act as a bridge for the hardware and the software to communicate. The DirectX~ APIs give multimedia applications access to the advanced features of high-performance hardware such as three-dimensional (3-D) graphics acceleration chips and sound cards. The APTs also control low-level.
functions.
including two-dimensional (2-D) graphics acceleration; support .for input devices such as .joysticks, keyboards, and mice; and control of sound mixing and sound output.
Versions of DirecL~YC~ prior to versions 9.0 may also or alternatively be used.
~OObSj While the specify software architecture will vary from system to system, an illustrative media center interface infrastructure 2t3t3 will now be described with g~eference to Figure 2. The reference to the specif:~c media user interface infrastructure is not intended to limit the invention to the use of a specific infrastructure such as the infrastructure 20~ nor to a specific software package such a.s DirectX~~. The illustrative infrastructure 200 of Figure 2 is provided merely as an example ofhow a media usex interface infrastructure may be designed.
The infrastructure used is a secondary consideration behind the actual operation and features afthe resulting media user interface described below beginning with figure 3.
_ t3 _ .. ~~ fi .. ...... . .. _ . .... . . ~ ~ . . , . .., .. .....r,. . . , ,r...
v.~~~6s.t:-~'~~,a .~
j0066] Infrastructure 200 may include a top level media user interface application 205, a controls interface 210, a Ul fr'amew°ork 23.5, component model serr~'ices 220, and renderer 2G0_ UI application 205 is the top level control application that manages operation of the media user interface by calling control routines and the Ul framework based tin a user's interaction with the nxedia user interface. The operation of the application 205 will be discussed further below. °l'he remaining infrastructure will now be described from the bottom up.
[0067] Renderer 260 draws the end result media user interface to video memory.
The renderer may run on its ov,~x thread, and z~eeeives information from the LTI
framework 215 regarding what to draw. ~1 unit of drawing for the renderer nxay be referred to as a Visual:
Visuals may be ac-ranged in a tree that describes painting order and eontainership. Visuals may also contain content to be drawax, such as an inxage, text, color, etc.
There may be a Visual object in LTI framework 2I ~ eomesponding to each renderer Visual so that the UI
framework 215 can tell the renderer 260 what to draw. Renderer 260 may include or comnxunicate with rendering modules 261, 2b3, 265 depending on the graphical development application used for the media user interface, DirectXcx~ 9, GDI, or DirectX~
7, respectively.
[fl068~ Component model services 220 nxay include four primary service modules; Visuals 221, Common Services 231, UI Framework-specific (UIF'Vv'j services 241, and messaging and state services 251. Messaging and state services are managed by dispatcher 253 and UI
Session 255. Similar to a standard W'indowsQ message queue, dispatcher 253 manages all processing time requests for components in the shell for the media mode of operation that is the platform for all the 14-Foot user interface. experiences. The UI
infrastructure components run as part of the shell process, I-Iowever, dispatcher 253 may be extensible to allow the.
creation and expression of new priority rules as needed, e.g,, to allow a new rule that runs a particular task after all painting tasks but before any tinier tasks. UI
Session 255 is a state container that nxanages all the data related to a set o'!' objects. Ul session 255 manages data, while dispatcher 253 manages timing. t?ther services of infrastructure 200.
e.g., renderer 260, layout 223, drawing 227. etc., may store their data as sub-objects on the session 255.
Session 255 may create a port to communicate with each service so that each service can refer to its portion of the data to handle its own tasks.
_ tq _ '~ ~,~~~y~,>... .,..... > ....>-, .. . . . . ...~.,.. ...,.. .. ... ~.._ ....>........
.,.:3~i ~..
[t1E169:~ Remoting 257 is responsible foe z~endering the user interface on a remote device at high. fidelity, if desired. Remotin~; is optional. and is nat required for rendering the user interface on a directi~f or indirectly connected monitor or TV.
~OtI'70~ Visual services 221 may include layout services 223. video memory management 225, drawings sen~ices 227, and animation sezvices 229. Layout services 223 positians the Visuals prior to rendering by the Ul framework 215 and renderer 260. Video memory mgmt 225 manages data and instructions that go to the video Bard, including, e.g., management of surl.'aces, vez~tex buffers, and pixel shaders. Drawing services .227 manages any non-animated visual component to be drawn on the user interface. including text. Animation services 229 izxclude a portion used by the component model 220 and a poiion used by renderer 260. The c~om.ponent model portion builds an animation template that specifies an object, a destination, a timer-period, an animation method, stop points, and any other necessary animation data.
'fhe template may include Keyframes that describe a value for some point in time and the manner in which to interpolate between that keyti'ame and the. next defined lzeyframe. The renderer then plays the template, at which time the. animation services builds an active animation, which the rendered 260 executes per frame. to move the Visuals on the screen.
j(3071) Non-visual common sere~ices 231 may include input services 233 and directional navigation 235. Input services 233 manage a state machine that determines how to process input (remote control navigation, click down/up, mouse moves, etc.} to a specific view of the media user interface. Directional navigation services 235 identify a same-page move destination based on a center point of a ctu-rent screen selection, other targets on-screen, and direction indicated by the user.
~~072] UIFW services 24I may include data services 243, parsing services 245, and .page navigation services 247. Data services 243 provide data sources for objects, manage binding according to predetermined binding rules, and allow variables to reference:
data to be defned as needed. For example, data ser~~ices 243 may be used to associate a photo item's display name propez~tyx~ith a thumbnail button's '.l~ext View l em Content property so that when a property on one of the objects i.s set or changes, the related property on the other object is set or changes as well. A relationship need not be one-to-one. When a value on a bound object changes, the binding is marked ''dirty" and, at some later time. the dispatcher 253 will call a process to reevaluate dirty bindings, cai.isin~, data services 243 to propagate new values to each dirty binding's destination. Parsing services 245 ,parse XNIL
descriptions of the media -!5-~. . ....,. ... . ~ . . ......... ,. .. , ~. .._ 3(y.963~.1 ~.Vdt) user interface. That is, .~iMl, may bE used to ece:ate visual aspects of°the media user interface, in addition to hand-authoring visual aspects of the media user interface in C, C++, and;'or C#.
fags navigation sen~ices 2~a'l identify inter page navigtations I~ased on a selected content item.
jt1073J UI 1~ramework 21 S provides an abstraction layer between tlae application 20S and component model 220. Controls user interface 210 manages the operation of items displayed on. the display screen. T'laat is, simply drawing a button on a screen does not inherently make the user's selection of that button result in ara action. 'I°he Controls user interface 210 manages the actual operation of items, such as buttons, radio lists, spinner controls, and the like, as well as views and view items. A Control is someth.in~; on the media user interface that the user can interact with, handling input, focus, and navigation. A View is an owner of the display of a Control. The View requests that a Visual of the Control tae drawn on the screen. That is, the View causes a visual representation of the Control to be displayed as part of the media user interface. A View may manage Visuals by creating a tree of ViewItems. A
Viewltem. stores content to draw {i.e., a Visual), as well as logic for how that content gets used (e.g., as a Control or as part of an animation).
[00'74] The above infrastructure provides a managed UI description Layer on top of a rendering system whose basic unit is the Visual, as discussed above. Visuals may be represented as tree nodes that estahlish containerslaip for transforms.
'I°he managed layer (the component model) creates a .higher Level programming interface for the rendering system.
The infrastructure may use olajects to describe images, animations, transforms, and the like.
using XML andi or source code written in a language such as C, C'-t-+, or C#.
Those of skill in the art will appreciate that the underlying UT infrastructure is secoaadary to the. services it provides.
~~0"7Sj Using the aforementioned infrastructure and the services the infrastructure provides, the UI application 20S (i.e., the managed description layer) provides the routines and definitions that make up, define, and control the operation of" the media user interface. An illustrative media user interface provided by UI application 20S will now be described with further reference to Figures 3-31.
[00'76) Media user interface start page 300 may include a plurality of high level menu selections 301, a List (of text, icons, graphics, etc.) caf most recently used (MRU) items 303, a power menu icon 30S, and a clock. hligla level menu selections may include options for _y _ . ., , ..
.itt~~5%f';'l'?~C ~ -' .
Online Spotlight, My Pictures, My Videos, My TV, My Music, My Radio. :i%Iy Programs, My Tasks, and Settings. Other laigh level selections may also or alternatively be included. MRIaT
list 303 may at al.l times correspond to a currently highlighted menu seiection item 307, as indicatc:.d by a selection curso~~ 309. 'That is, MRU list 303 maST include up to the three most recent user-selected media items 303a, 303b, and 303c correspanding to the currently highlighted menu selection item 30'7. For example, when the .My TV menu item is highlighted, the MRU items ~ni.ght include media sele:.ctions for DVI~. TV, or Mavies; when the My Music menu item is highlighted, the MRU list night include the three;most recent songs played by the user: when the My Radio menu itc,m is highlighted, the MRU
list might include the three mast recent radio stations listed to by the user; etc. As the user moves the control cursor 309 over a revs menu item, the U.I applicatian refreshes the MRU list 303 to correspond to the newly highlighted menu item. If thi user has never selected three media items corresponding to the current item 307, the 1:1I application 205 may alternatively cause the media user interface to display default items or action, ar no items at all in the MRU last 303. According to an aspect of the invention, the MRU list might contain icons or graphics, or text, ar a combinatian o:l'the two. Icons are preferably used, with or witlaaut text, as visual stimulation is more easily perceived and recognized fram distances (such as are typical .in use with a 10-Feat user interface} than is text. In order to perceive and recognize teat at the same diatanee, the text would necessarily be quite large and take up more display real estate than is necessary for graphics or icons. Thus, a camhinatian of text and graphics suits the media user interface for use as a IO-Foat user interface as well as a 2-Foot user interface.
[(1077) Power ieon 305 launches a power sub-menu, described further below with respect to Figures i5-18.
X0078] Figure 4 illustrates zanes 40I-41'7 of~the media user interface 300 selectabie by a user using remote control device 163. The user, using up, down, left, and right navigation buttons on remote contras device 163, can navigate to each zone when selectable content is displayed i.n each zone. Zone 401 includes menu items selectable by the user; zone 403 includes a first hiRU item selectable by th.e user; zone 4U5 includes a second MRU selectable by the users zone 407 includes a third MRU item selectable by the user; zone 409 include action buttons corresponding to currently highlighted selection item 30?; zone 411 includes system controls, e.g., the power menu icon 305; zone 413 may include a selectable content item indicating a currently occurring action, such as a currently piaying song (see, e.g., Figure 5}. 1~aeh zone _ 1'7 -,.::,..,-~ >... ...,..
.~, 3fJ965~.12 may be set to inc=lude selectable items or not, depending on currently selected items. currently OCG11rr1rf~ actions (such as a song or radio station currently playing). Whon the MRU list contaizts one or more items, the user can navigate and select the M12U item displayed in zone X03, 405. or 407, depezzding on whether ane, two, or three M12U items are available, respectively.
[0079] Vs'ith further reference to Figure. 5, as a user scrolls through rnetzu items 301, the menu items animatedly scroll up or down, while the selection cursor 309 remains fixed in the same position. When the user presses the down navigational button on remote control 163, the content shifts 'up: when the user presses the up navigational button on renaate control 163, the content shifts down. For example, to navigate froze the media user interface shown in Figure 3 to the media user interface shown in Figure 5, the user need only press the do«=rt navigation button on remote control device 163. ~"hen the user pa~esses the down navigation button, the media user interface: animates through a series of intermediate frames from the view shop°n in Figure 3 to the view shown in Figure 5, shifting content as appropriate.
[0080] While the media user interface: is idle, i.e., th a user is not inputting anything, the selection cursor 309 may be. accentuated, e.g., by appearing to glow or pulsate, to indicate to the user the currently highlighted menu item, as well as to indicate. that the computer has zyat frozen (i.e.; crashed). 3'his is especially useful foz- use with a 10-Foot user interface because, due to the distance from which a user might interact with the izzterface, the user can more easily lose track of the cursor if the cursor is not big enough or prominent enough for the user to track.. When the user selects the highlighted item., the selection cursor 309 may flash or provide some other visual indication that the user has prov3de~.1 input. An audio signal may also or alternatively he used to provide selection feedback to the user.
[0081] As d15C11SSed above, when the user navigates from one menu item in list 30I to another, the MRU list refreshes itself to contain the nevv MRLT list items corresponding to the item to which the user has navigated. According to an aspect of the invention, the MRU list may refresh itself in using a variety o.f' aniznations. In one embodiment, the MRU list 303 might he animated with menu list 3(71, except that the MRL' list items corresponding to th.e item from menu list 301 from which the user is navigating away slowly fade from view as they move away, and the MRU list items corresponding to the item fiom menu list 301 to which the user is navigating slowly fade into view as tl.7ey move to their i~inal positions on media user interface 3C)0. While menu items remain visible as they move above or below the -t8-"~y~~~:-~~~~-~>.~.. . . ~.. t . . . - . ...... .. ... . - . r ...> .. .
..~..~........, . ....... ,.
selection cursor 309, the MRI~ list items do not. For example, suppose a user navigates ti~om the My TV menu item as shoee~n in Figure 3 to tlje My Music menu item as shown in Figure ~. In order to navigate from My 7~V to My Music, the user selects the down.
navigation key on the remote control or k~y~bc~ard to send a navigate down command to the IlI
application.
When the LTI application rece ives tlae navigate down cozatmand from the state shown in Figure 3, the UI application 205 animates the menu items sliding up to shift the My Music menu item within the selection cursor 309, also fading the .~~ly Videos menu item partially l:rorn view, and fading the More Progr~rms menu iteno fully into view as part of the animation.
Also as part of the animation. the Online Spotlight menu item disappears completely .froze view, and the Settings menu item comes partially into view. Simultaneous with the animated sliding of the. menu items, the My TV MRU list items move up with the My TV
menu item.
however, the My TV MRU Iist items fade from viou~ from top to bottom, consistent with their movement upward as they move From their original positions, thus graphically simulating the .MRU list items passing under a cover gradually increasing opaelueness from fizlly transparent to fully opaque.. Similarly, as the My Music MRU list items come into view from below the My TV Mlttl list item:;, they fade into view as if coming out txom underneath a cover, gradually increasing transparency from fully opaque to iixlly transparent. This same el:fect may be used with the MRU list items in focus, as shown in Figure 13 (described below).
[0082] According to another embodiment, with reference to Figures 6-8, MRU
icons may animatedly slide, sweep or fly into view, graphically appearing to originate from behind the list of menu selection items 301, moving from left to right. Sliding into view provides a visual cue to the user that the change in focus of the menu item has caused a change of secondary content based on the focused menu item. Figures 6-~ illustrate a beginning frame 601, an intermediate frame 701, and a final frame 801, respectively, of a MRU
List Reveal animation that may occur to display MRU list items associated with the newly highlighted My Musie item. Figure 6 illustrates a first li-arne 601 of the animation after a user, starting from the media user interface sh.ow-n in Figure 3, ,presses the down navigation button on remote control device 163 to select My Music. As shor~~n in Figure 6, the 1V1RU list of items that was previously displayed for the previously selected My TV menu item has disappeared.
~(3083~ Figure 7 illustrates an intermediate. frame 701 of the animation as MR.LJ list items 303 sweep to the right, appearing to originate from behind menu list items 301. As shown in _ 19-~ ~ ...,... .. .. . . .. ..... .>_ ........ . . .. .
...~~9G.~.t~'r~~t~ ..
Figure 7, the IV1:RU list items may have an alpha value during the animation so that the items appear at least partially transparent. Alternatively. no alpi3a value is tried. Figure 8 illustrates a final frame 801 of the MRU list animation, illustrative of' the final position and appearance (i.e., no transparency) of ~MRL1 list items 303. Animating the appearazCe of the M.RIJ list items drawrs the user's attention to the MRLJ list so that the user can clearly see. that the ~4iRtJ
items has changed as a result of the newly highlighted menu item which is, in this exampie, the My Music item.
[Q084] Those of skill in the art will appreciate that, while three animation frames are provided herein for the MR~i list reveal animation, other animation frames exist between those provided in Figures 6-8. Figures tiw8 provide examples of .Kcyf~ames that may be used.
°fh.e Keyframes provide control points between wlz.ich the animation can be interpolated to transition from one Keyframe to the next, Using interpolation, the animation may be played at any frame rate and be correct (as opposed to frame-based animations). More or fewer Keyframes may alternatively be used.
(~0$S] According to another aspect of the invention, with furtl~zer reference to Figures 9-12, in order to draw the user's attention to the fact that the user has navigated away from menu list 301, the media user interface may provide three-dimensional feedback to the user when tlae user changes the focus from menu list 301 to an item in MRU list .303. In one illustrative embodiment of the invention, tl~L media user interface provides a graphically simulated double-hinged effect in 3-dimensional space as the user moves the navigation cursor to a MRU list item. Figures 9a and 9b illustrate a top perspective view and a top plan e~iew, respectively; of media user interface start pag-a 300 as the user is scrolling through menu items 301 with corresponding MRU list 303. In Figures 9a and 9b the user has not yet navigated the control cursor to a MR~J list item. Figures 9a: and 9b illustrate that all the content displayed on the start page 300 is on a single X,Y plans 901. Stated another vr~ay, aID
content on start page 300 has the same ~. dimension. Figure 8 illustrates start page 300 corresponding to Figures 9a and 9b, prior to the user selecting a MRU list item 301a, 301b, or 301 c.
jt9086) Figures I Oa and l Ob illustrate a fop perspective view and top plan view, respectively, of the media user interface in a double-hinged MFtU list item selection view 1301 (see corresponding Figure 13). Figures IOa and IOb illustrate that the content dispiayed in tire MRU list item selection view is split between two planes 3 001, 3 003 extending from "hinge' .:..... :......,., ,.n.. ., ..,... a.,... ...o.:. . . ..., ......~.. ;..,-...~~ , .~"...,_.. "....... ...:..:.., . ......... . ,~-..... . ~.......
......> ,....... ... .....
~~~~~~.~ ~ t~
axes 1005, 1007, respectively. front plane 1001 may include the selected menu list item 307 and its corresponding MI~IJ list hems 301a, 301b, 301c. .Back plane 1003 may include menu list items 301 other than selected men ~i item 307. Because each plane 1001, 1003 is optically hinged on virtual hinge axis 1005, 1007, respectively, the Z values of content on each respective plane will gradually change as the content moves away from the hinge axis on the plane. Content on back piano 1003 may be visible. behind content o.n front plane 1001, e.g., using alpha shading of the li~ont plane. higure 13 illustrates N1RU list item selection view 1301 of the media user interface according to this illustrative embodiment.
X0087] By shifting selected content to front plane 1001 and unselected content to back plane 1003, the media user interface conceptually conveys to a user which menu item is selected, along with its corresponding MRU list 301, and which menu hems wore not selected but are available should the user choose to navigate back to them. As shown in Figure 13, media ~rser interface content not in menu selection list 301 or MRL1 list 303 may be displayed on a third plane located in the position of starting plane 901. 13y keeping secondary content on original plane 901, the user of the media user interface can easily navigate to content located on plane 901, such as a power menu icon 305.
(0088] Figures 8 and 11-13, sequentially, illustrate frames in a MRU List 'lilt animation as the user moves the navigation cursor from the My Music menu item over to the first MRU
list item 301 a corresponding to the lvl.y Music menu item. During the animation, the two planes graphically pivot, or swing, forward and back, as applicable, from the hinge axes, and 1~9RU list items sweep outward. appearing to originate from the selected menu item 307.
1=figure S illustrates the sinl;le plane start menu while navigation cursor 309 is over the My Music menu item. Figure 11 illustrates a first intermediate frame 1101 as the media user interface splits the content between two planes and begins to virtually pivot the front plane 1001 forward in the Z-dimension on hinge axis 1005, and begins to pivot the back plane 1003 backward i~~ the Z-dimension on hinge axis .1007. Figure I 1 also illustrates the MRU list items 301 be~;innirrg to sweep outward, appearing to originate from bel3ind the. selected menu list item 307.
[0089] Figure 12 illustrates a second intermediate frame 1201 in the animation, illustrating the planes nearing their respective final positions. In Figure i2, the selected menu item ''My Music" continues to graplaieally move Forward and is beginning to take on a more prominent appearance as compared to the receding menu items that were not selected. A
sub-title, -2t ,.. , . ~ .... ..... .. .. ... .. ...... ....... .. .... ...... ... . ., .:
.:..:,. ..
''recent music," corresponding to the selected mezzu item is beginning to appear more clearly than in the frame 1101 illustrated in Figure 17. Also in lvigttre 12 the IvIRU
list items continue to sweep outward. nearing their fiP~al positions. Figure 13 illustrates a final frame 1301 of the animation, with menu items and I~IR.L~ list items in their final positions, selectable by a user as desired. l~he above illustration is provided as an c~cample use of dual hinged planes to provide clear visual and conceptual feedback to a user of a 10-Foot user intez-face.
The dual hinged planes may be used for any navigational feature of the media user interface, and should not be construed as limited to selection of a MRLI list item.
(0090] With further referez~PCe to Figures 9 and 14-22, according to another aspect of the invention, the media user interface may split content onto two planes, a more prominent front plane and less prominent back plane, but instead of hinging each plane as shown in Figures 9-13, the media user interface graphically pushes the back plane straight back from its original position, and pulls the front plane straight forward from its original position. The resulting graphical effect is a double-wall of content, where selected or accentuated content is bP°otight forward and highlighted, and unselected content is pushed backward in three-dimensional space, providing a clean conceptual and visual picture to the user of selected azad unselected content, or of a new menu tal:iP~Pg prominence over a prevPOUSI~r showing menu.
(0091) Figure 9a illustrates a virtual top perspective view, and Figure 9b illustrates a top plan view, of media user interface start page 3()0 as the user is scrolling through menu items 301 with corresponding MRU list 303. In r"figures 9a and 9b the user has not yet selected a now menu itePn to initiate the plane split. Figures 9a and 9b illustrate that all the content displayed on the start page 300 is on the same plane 901. Stated another way, all content on start page 300 has the same Z dimension. ~~ figure 8 illustrates start page. 300 corresponding to Figures 9a and 9b, prior to the user highlighting or selecting a menu list item or other menu item.
(0092] Figures 14a and 14b illustrate a Lop perspective view and top plan view. respectively, of the media user interface after splitting content between two planes, a front plane 1401 and back plane 14()3, w here front plane 1.40.1 is graphically pulled straight forward and back plane 1403 is graphically puahed straight backward. All confent on Front plane 1401 has substantially the saPne Z-value, and all content on back plane 1483 has substantially the same Z-value, although different from the Z-value of content on the front plane 1401. Front plane 1401 may include a new menu (e.g., a submenu) corresponding to a content item selected by the user from previous plane 901. Back plane 1403 may include the previous menu owvhich :;~.; . ~r -- . .> .,., ,. ~ ,>.....>. . . . ~ ~.,........ , . .
,pt~6~,t:1''tVI~O ~Y. ~ . A .. . ...
the user selected the content item to cause the new menu to appear, It will be appreciated that the amount that the front plane is pu.Iled forward ir1 Z-space and the amount the back plane is pushed hack in Z-space is a secondary consideration to the fact that the simulated planes are moved substantially straight forward and back, respectively, relative: to each other.
Alternatively, the back plane 1403 might moe~e backward. and front plane I401 might remain stationary and open new wntent, e.l;., a power menu, in its stationary position (wh~.~re starting plane 90I was originally located). In still another alternative, the back plane 1403 might remain stationary while front plane 1401 moves forward and displays new content as it moves forward, e.g., a context menu. 'hhe graphically simulated appearance of moving plane I401 forward, moving plane 1403 backward, or both, may be accomplished by enlarging content on plane 1.401 and: or reducing content on plane 1403, providing content on plane 1401 in focus while content on plane 1403 is unfocused to some extent, and/or by making content an ptane 1401 lighter or brighter and making content on plane 1'403 darker in appearance.
[0093 With further reference to Figure 18, the double-wall effect may be used to illustrate to the user that the user has selected a power menu. Figure I8 ilP,ustrates a media user interface wrth pOV~'Or menu 1801 on front plane 1401, and start menu content 30I on back plane 1.403.
As is evident by a comparison of Figure I8 to Figure 3, the start menu content in Figure 18 behind the power menu 1801 is graphicali.y simulated to appear smaller than the start menu content 301 irr Figure 3 because the start menu a:.ontent in Figurr: 18 is on a plane that has been pushed backward behind the power menu I 80I in Figure 18. Power menu 1801 may be considered a secondary menu because the user may quickly return from the power menu I801 to the start menu 300, e.g., if the user decides not to close the Ul application 205 from the power menu 1801 or perform any other option available on the power menu. In this example.
the power menu has buttons 1803-I 8I I to close the media center application 205, logofF the current user, shut down the computer, restart the computer, and go to Stand-~y power mode, respectively, eaeh button being selectable using, navigation and select buttons on remote control deuce 163.
~0094~ Use of the double-wall 3-dimensional ~;raphlcal effect may be advantageous to convey to a user that the user has select a secondary menu, such as a context menu or a power menu, from which the user might quickly return to the original menu from which the user selected the sub-menu. however, the double-w~alf effect can also be used for other purposes _ _a; _ w~.;v ~ . , ... ~ , ~, . ,,~g~,~~; t~~i~j:'..
in a 10-Foot user interface to conceptually-indicate to the user; by pushing content backward.
that current navigation has been temporarily interrupted, arid ne~~~ content in ki~ont of the interrupted content now has the focus.
(0095] Figures 1 S-18 illustrate a poorer menu reveal animation that may visually indicate to the user that the user has selected the power button 305 (Figure 3) on start menu 300. Figure 15 illustrates a frst intermediate frame 1501 of the animation after the user selecEs. power button 305. In frame 1.501, starting plane 901, now considered back plane 1403. has a.iready been pushed backward in the Z-dimension, thus making all content originally located on plane 901 {i.e., all start menu content) graphically appear smaller as it appears to move away from the user. Also in fa~ame 1501, window 1503 has begun to appear. Power menu 1801 will be placed in window 1503 when window 1503 becomes fully formed.
[0096] Figure 16 illustrates a second intermediate .frame 1~i01 of the power menu reveal animation. In Fi ;ure 16, the content on back plane 1 X03 ha.s not moved, as the back plane quickly reaches its destination in 2-space in this particular example (however, the speed of the animation and the speed with which any ,particular plane moves may be set as desired).
Also in frame 1601. windoasF 1503 continues to open, and is now~ approximately half its final size. higure 17 illustrates a third intermediate frame 1701 of the power menu reveal animation. In frame 1701 th.e power menu window 1503 has almost reached its final size, and buttons 1803-1811 have begun to fade into view. Figure I8 illustrates the final frame of the .power menu reveal animation, where window 1503 is fully forzxzed and power menu 1801 compIc;ted, including buttons 1803-18I 1.
]0097] With further reference to Figures .l 9-23, a variation of the double-wall effect znay be.
used to bring up a context n~~:nu in the media user interlace. 111ustrated by the top plan view of Figure 23, Figures 19-22 illustrate a context menu reveal animation that may be used to provide a context menu to a user of the media user interface. 1~igure 23 illustrates the resulting conceptual top plan vie~~° of the teva planes at the end of the animation, which begins from the conceptual top plan view shovl~n in Figure 9b. Figure 23 illustrates a single-hinge axis 2305 around wlziclz plane 2303 swings backward fi~orn the original position of plane 901.
[4098] Figure 19 illustrates a My Music menu, which resuats from the user selecting the highlighted My Music menu item froze Figure 8. The My Music menu 1901 includes icons ~~.~ .. ~~~°.: .., ....... -. ~.
~,(j9~.,4. l ~~v t?
1903-1911 re:,presentative of music stored on the computer 110 on which the media user interface is executinU. or on soma other networked computer to which computer 110 has access. In the example sJ~ov~~n in Figure 19, because the My Music rrtenu is presently in Album view, as indicated by view indicator 1925, the icons are re-presentative of musical albums. My Music Menu 1901 also has a plurality of n Menu buttons 1913-1.923, through u~lzich a user can view music. by album, artist, play list, song, or benre, as well as search for music, respectively. View indicator 1925 is placed next to whichever menu button represents the current ivlv Music menu view.
)fIU99) In Figure 19 the user selection cursor 309 lI7diCateS that the icon 1905 is presently highlighted fax selection by the user. "Right-clicking" on the icon 1905 initiates the animation sequence shown in Figures 20-22. Because the user might be using a remote control de~~ice l G3 to control the media user interface instead of a manse, the remote control device may have a secondary selection button, similar to right-clicking a right-handed configured computer mouse, the selection of which brings ttp a context menu instead of playing the selected music as might result from using the primary selection button on remote control device 163.
[OD100) Figure 20 illustrates a first intermediate ..frame 2001 shortly after the user right clicks icon 1905. In Figure 20, icon 1905 has been slightly enlarged to convey to the user that the user selected icon 190;1 (as opposed to any of the other icons). and icon 1905 is also placed on plane 2301 (Fig. 23). T'he remaining content, originating .from plane 901, is placed on plane 2303, and has been rendered to appear that it has begun to move backwards. In this example, plane 2303 is hinged at point 2305. such that the content on plane 2303 appears to swing back instead of straight back.
[OOltD1) Figure 21 illustrates a second intermediate frame 2101 of the context menu reveal animation. In frame 2101, window 2203 has begun to form, appearing to originate From. a vertical center pUSitFOn 2105 of final windov,~ 2205, and gradually enlarging the window 2203 in upward and downward directions. Content on plane 2303 continues to i swing backward on hinge axis 2305. 1~igure 22 i.ll.usirates a final frame 2201 of the context i menu reveal animation sequence. In frame 2201, window 2203 is bully formed and context menu 2205 is displayed for navigation and selection by the user. Window 2203 (including its contents) and icon. 1905 are on plane 2301, whereas the remaining content is fully swung s back on plane 2301. i -zs-...,_,-. .. . a....... . . . . .. .....
,p9gS4. i?i~JO
~0~102,j The si~~gle-hinge a~~irnation effect iilustratecl in .figure 19-23 tray be modified in various r~,~ays. .For example, the hin.~;e axis may be placed to the left of the corresponding hi..nged plane instead of to the right of the corresponding hinged plane as show°n in Figure 23, or the, hinge axis may be placed above: or belos~~ the corresponding hinged plane. Those of skill in tl7e art will appreciate that, by using a 317 enabled application such as DirectX~, the hinge axis may be placed anywhere io 3D space. According to an aspect of tla.e invention, the hinge axis may be placed conceptually distant ii~om the selected iz:on. 'that is, if the user selects an icon on the left hand side of the My Music menca 1901, the UI
application may plane hinge axis 2305 to the right of tl~e My Music menu, such as is shown in Figure 23, so that content on the back .plane 7303 appears farther behind the sele;eted icon than it would if the hinge axis were placed Co zhe left of the menu. Similarly, il'the user selects an icon on the right hand. side of'the My Music menu 1901, the Ul application may place.
hinge axis 2305 to the left of tl~e My Music menu; if the user selects an icon on the top of the My Music menu 1901, the LTI application may place hinge axis 2305 below the My Music menu;
if the user selects an icon on the bortom of the My Music menu 1901, the UI application may place hinge axis 2305 above the iuly Music menu. Similar hinge placements may be used in any direction, including diagonal, to swim; unused content as far as possible behind the selected content. According to an aspect of the invention. a user may .specify where the hinge axis is located, e.g., by changing a hinge axis location setting under the; Settings menu items.
~Ot1103~ Other mufti-planar effects and animations may be used to conceptually convey navigation and selection of menus and items to a user of tl~e media user interface. The specific mufti-planar effect or animation used is secondary to splitting the menu content onto two or more planes to canc.eptually convey to a user which item or items are relevant based on the user's navigation and selection of menus and items on the media user interface. In some effects and animations two planes may be used, such as are illustrated in Figures i0b (excluding plane 901), 14b (excluding plane 901 }, 23, or 30 (including planes 3301, 3303 and excluding plane 901). In other effects and animations, the CjI Application 205 may split content onto three or mare planes, such as are illustrated in 1~'igures 10b (including plane 901), 14b (including plane 9fl1~, 29 (i.ncl.uding planes 2901, 2903, 2905), and 30 (including planes 3001., 3003, 901). More; relevant content or content relating to the user's most recent selection is preferably places on the more prominent piano. typically the plane in the foreground as compared to the other planes) currently in use.
H_ ......~.~.., .~~~~ ..,yz.~ ..-::ry,,.. ,:...~.~,., . ~::v~.:., ...."", ,.......~:.....;:~ . :,.>.>.....~;=-.,..,.,. ".,...~ ,;;.:...;:.:,...,...~
:.,~.,,:...".:.,..::...." .;.....,.,.._..
J~~tix~, l.y~~
[OfDI()4] Using a 3D..enabled development application such as DirectXQ enables other novel features of the media user interface described herein. For example, the background of the media user interface nay remain somewhat constant from one menu to tl~e next while slightly changing to indicate to the user that the application ~',OS has not frozen, and also to prevent burn-in in the display device I~I. Tlms, the media user interface may have an animated background, as illustrated in Figures 3-8, I l-13, and 1S-22. In Figures 3-$, 11-13, and IS-22 the background appears similar in each figure. .1-ior~ever, on close inspection one will notice that the backgrounds are actually slightly dilTerent, while retaining overall similarities so as not to confuse the user. 'fh.e animated background illustrated in Figures 3-8, 11-13, and I S-22 may be created using two or more rotating layers in 3D
space, the .front layer preferable being almost transparent, each layer having an alpha value and a rotational cycle length. Preferably each cycle length is different, and the cycle lengths are not multiples of each other. The two layers may be connected as if by an invisible pole, and are spaced apart in Z space (along the axis of the ''invisible pole"). ~Jhen the ,parent plane (the background) rotates, the child plane (the foreground) may rotate as well. at a same or different speed. The animated effect is thus achieved by rotating the parent plane and having the depth between the two create a sense of motion t.o th.e user.
[f)0105J Another feature enabled by the use of 3D space and alpha shading is alpha-fading as illustrated in higures 13, 1 R, and 22. That is, conventionally when a display does not have enough allotted space to display the entire name of~ an item, or enough room to display all the text associated w°ith an item, the application will either abruptly cut off the text, or display ellipses (''..."') to indicate to thr; user that more text is available than is displayed. The media user interface, however, naay use the. alpha (cx) video channel of the text to gradually fade.-out the text. With reference to Figure 2~1, in step 2401 tTI application 20S determines how much space, S, is available for text ~f,~ to be written to the screen. In step 2403 UI application 20S determines laow much of text T~, will fit in the allotted space S. The amount of text that will fit in allotted space S is referred to as T,.. The text measurement may be acquired from "Ul%in32 6131 r~Pls. such as DrawText. In step 2405 LTI
application 20S
determines whether T, and Tn are equal. meaning fleet all of text T~, will fit in space S. if 1'~
and Tare equal, then tJI application 20S proceeds to draw text TO in step 2407 in the allotted space without alpha blending. if T, and T~ aa-e not equal, then U1 application 20S draws text T, in the allotted space. and alpha blends a last predetermined arr~ount of text T~, for example the Last 1-S characters, gradually changing the alpha le~~el from fully opaque to fully ~.-,~ .. .> . . . . .>. .... . ..- ...~.......>... - t "~0~6~~, f..V~~S "' transparent. The alpha gradation may use I~irect313's vertex color interpolation capabilities.
The need for ellipses is thus avoided through the use of ai,pha blending, referred to herein as alpha fading.
[001.06] In yet another feature of the media user interface, UI application 24S may provide additional features far media user interface in addition to those described above. For example. Figuxe 25 illustrates a tbld~:r navigation screen 2501. In Figure ?5, the folder na~~igation screen 2501 is being used to select (alders to search. for music to add to a music library. Ho4vever, the folder navigation illustrated in h'igure 25 may be.
used for any purpose for which folder navigation is useful.
[OOt07] Figures 26-28 illustrate a volume window 2601 that appears when the user adjusts the sound volume, e.g.. using remote control device 163. Volume window includes a numerical indicator 2603 of the volume level, as well as a visual indicator 2605 of the volume level in the form of a volume bar that fills from left to right as the volume moves from the minimum volume level to the maximum volume lever. The volume windor~l 2601 is beneficial because the user can easily determine, upon turning mute o#~', what volume level the volume will return to. That is, as shown in Figure 31, the numerical indicator may switch to ''mute" when the mute is on, while volume bar 2605 indicates the volume that will result when mute is turned ofF The volume window 2601 may appear on the single plane (Figure 9), or may appear using any of the double plane effects described above.
[00108] The media user interface described above, while rendered an a flat or slightly convex display device, such as a monitor or TV, i.s graphically simulated to appear three-dimensionai. Using the features described herein, fhe LEI Application 2t35 provides a media user interface that is suiiable for use as a 10-Foot user interface by placing prominent icons and menu items on the display, using three-dimensional transformations to increase the display real estate on which content can be displayed, and using animation to conceptually convey navibation between view's to the user. 3'he media user interface is also especially useful vrhen used with. a media mode of operation of a data processinf;
device, although a media mode is not required. While the. invention has been described with respect to specific i examples including presently preferred modes of carrying out the invention, those skilled it3 the art will appreciate that there are numerous variations and permutations of the above.
described systems and teclaniducs. Thus. the spirit arid scope of the invention should be construed broadly as set forth i.n the appended claims.

Claims (36)

I/ We Claim:

1. A method for displaying content to user through a user interface, comprising steps of:
displaying on a display device connected to a data processing device on which the user interface is rendered a first plurality of selectable menu items selectable by a user using a remote control device;
responsive to the user selecting one of the plurality of menu items, displaying the selected one menu item on a simulated first plane in a three-dimensional graphical space, and displaying the plurality of menu items other than the one selected item on a simulated second plane in the three-dimensional graphical space, wherein the first plane has a more prominent display position than the second plane.

2. The method of claim 1, wherein the first plane having a more prominent display position than the second plane comprises the first plane being in front of the second plane in the three dimensional graphical space as viewed by a user of the user interface.

3. The method of claim 1, further comprising displaying on the first plane a second plurality of menu items corresponding to the selected one item.

4. The method of claim 1, further comprising pivoting the first plane on a first hinge axis.

5. The method of claim 4, further comprising pivoting the second plane on a second hinge axis.

6. The method of claim 5, wherein the first hinge axis has a different location in the three-dimensional space than the second hinge axis.

7. The method of claim 1, further comprising simulating pushing the second plane back in a Z-dimension of the three-dimensional space as compared to the first plane.

8. The method of claim 7, further comprising pulling the first plane forward in the Z-dimension.

9. The method of claim wherein the first and second hinge axes are on substantially opposite sides of the display device in an X-dimension of the three dimensional space.

10. The method of claim 3, wherein the second plurality of menu items comprise items of a context menu corresponding to the selected one item.

11. The method of claim 3, wherein the selected one item comprises a type of media, and the second plurality of menu items comprise a list of most recently used media of the selected one type of media.

12. The method of claim 3, wherein the second plurality of menu items comprises a sub-menu underneath the selected one menu item.

13. A computer readable medium storing computer executable instructions for performing the method of claim 1.

14. A data processing system, comprising:
a remote control device for controlling the data processing system;
a data processor configured to provide a three-dimensional user interface on a display device connected to the data processing system by executing computer executable software modules stored in a memory of the data processing system; and the memory staring computer executable software modules, comprising:
a user interface software module configured to provide the user interface in a three-dimensional space displayed on the display device, said user interface including a plurality of menus navigable by a user using the remote control device: and an animation module which, under control of the user interface software module, provides a sequence of frames of an animation when the user selects one of a plurality of menu items from a first menu of the plurality of menus, wherein the animation sequence splits the plurality of menu items between a first plane and a second plane and animates the first and second planes, moving away from each other in the three-dimensional space.

15. The data processing device of claim 14, wherein the selected one menu item is on the first plane and the plurality of menu items other than the selected one menu item are on the second plane.

16. The data processing device of claim 14, wherein the first plane has a more prominent display position than the second plane.

17. The data processing device of claim 16, wherein the first plane having a more prominent display position than the second plane comprises placing the first plane in front of the second plane in the three dimensional graphical space as viewed by a user of the user interface.

18. The data processing device of claim 14, wherein the animation module pivots the first plane on a first hinge axis.

19. The data processing device of claim 18, wherein the animation module pivots the second plane on a second hinge axis.

20. The data processing device of claim 19, wherein the first and second hinge axes are on substantially opposite sides of the display device in an X-dimension of the three dimensional space.

21. The data processing device of claim 14, wherein the animation module pivots the second plane on a first hinge axis.

22. The data processing device of claim 14, wherein the first hinge axis has a different location in the three-dimensional space than the second hinge axis.

23. The data processing device of claim 14, wherein the animation module pushes the second plane back in a Z-dimension of the three-dimensional space as compared to the first plane.

24. The data processing device of claim 14, wherein the animation module pulls the first plane forward in the Z-dimension.

25. The data processing device of claim 14, wherein the user interface software module causes a second plurality of menu items corresponding to the selected one item to be displayed on the first plane.

26. The data processing device of claim 25, wherein the second plurality of menu items comprise items of a context menu corresponding to the selected one item.

27. The data processing device of claim 25, wherein the selected one item comprises a type of media, and the second plurality of menu items comprise a list of most recently used media of the selected one type of media.

28. The data processing device of claim 27, wherein the animation module makes the second plurality of menu items appear to slide into view from behind the selected one menu item.

28. The data processing device of claim 25, wherein the second plurality of menu items comprises a sub-menu underneath the selected one menu item.

29. A computer readable medium storing computer executable instructions for a method of providing a three-dimensional user interface, comprising steps of:
generating a three-dimensional graphical space for providing a user interface of a data processing device;
graphically displaying on a display device connected to the data processing device a first list of a plurality of menu items selectable by a user navigating the user interface using a remote control device;
responsive to the user selecting one of the plurality of menu items, displaying the selected one menu item an a first plane in the three-dimensional graphical space, and displaying the plurality of menu items other than the one selected item on a second plane in the three-dimensional graphical space;
animating the first and second planes moving away from each other in the three dimensional space, wherein, when the animation is completed, the first plane has a more prominent display position than the second plane.

30. The computer readable medium of claim 29, wherein animating the first and second planes further comprises pivoting the first plane around a first hinge axis in the three-dimensional space.

31. The computer readable medium of claim 29, wherein animating the first and second planes further comprises pivoting the second plane around a first hinge axis in the three-dimensional space.

32. The computer readable medium of claim 30, wherein animating the first and second planes further comprises pivoting the second plane around a second hinge axis in the three-dimensional space.

33. The computer readable medium of claim 32, wherein said first hinge axis is different from said second hinge axis.

34. The computer readable medium of claim 29, wherein animating the first and second planes comprises moving the first and second planes in a Z-dimension of the three-dimensional space without altering X and Y dimensions of content on either the first or second plane.

35. A user interface stored as executable instructions in a memory of a computer system and displayable on a display device connected to the computer system, said user interface comprising:
in a first state:
a first plurality of selectable menu items, wherein a user can highlight one of the first plurality of selectable menu items at a time with a selection cursor, and a second plurality of menu items that remain corresponding to the highlighted one of the first plurality of menu items, wherein the second plurality of menu items change to remain corresponding to the highlighted one of the first menu items if the user moves the selection cursor from a first menu item to a second menu item;
and in a second state:
a first graphically simulated plane having a user selected one of the first plurality of menu items and the second plurality of menu items corresponding to the selected one of the first plurality of menu items; and a second graphically simulated plane having the remaining first plurality of menu items other than the user selected one of the first plurality of menu items, wherein the first graphically simulated plane has a more prominent appearance than the second graphically simulated plane, wherein the user interface animatedly transitions from the first state to the second state when the user moves the selection cursor to highlight one of the second plurality of menu items.

36. The user interface of claim 35, wherein the animated transition comprises pivoting at least one of the first plane and the second plane on a hinge axis.