WO2014098207A1

WO2014098207A1 - Mobile terminal, and user-interface control program and method

Info

Publication number: WO2014098207A1
Application number: PCT/JP2013/084190
Authority: WO
Inventors: 宗人松田
Original assignee: 京セラ株式会社
Priority date: 2012-12-21
Filing date: 2013-12-20
Publication date: 2014-06-26
Also published as: US9891805B2; JP2014123253A; US20150339044A1; JP6053500B2

Abstract

A mobile terminal (10) is provided with a touch screen (TS) capable of displaying objects (Ob). When a sliding operation from an edge to the inside of the touch screen (TS) is performed, a CPU (24) of the mobile terminal determines (S1, S3, S21) that said operation is a specific sliding operation, and displays (S27, S35), in accordance with the specific-sliding-operation determination, functional icons (FI) associated with user interface functions such as a cursor or speech input, in an area of the touch screen (TS) which is capable of being touched after the specific sliding operation. Furthermore, when a current touch position (PTP) of the specific sliding operation enters a display area of one of the functional icons (FI), an interface function associated with the functional icon (FI) is activated (S37, S39, S43, S59).

Description

Portable terminal and user interface control program and method

The present invention relates to a portable terminal and a user interface control program and method, and more particularly to a portable terminal and a user interface control program and method having a touch screen capable of displaying objects such as icons and widgets.

In this type of conventional portable terminal, the object is displayed around the corner of the touch screen (for example, the lower right corner).

However, in the above background art, when the portable device is held and operated with one hand (one hand), the object is located near the corner of the touch screen, so that the finger is forcibly bent or stretched, and the hand is held. It is necessary to change the position. That is, this type of conventional portable terminal has a problem that it is difficult to hold and operate with one hand.

Therefore, a main object of the present invention is to provide a novel portable terminal and user interface control program and method.

Another object of the present invention is to provide a portable terminal and a user interface control program and method which can be easily operated by one hand.

1st aspect of this invention is a portable terminal, Comprising: When operation which slides to the inner side of the said touch screen from the touch screen which can display an object, and the said touch screen is performed, said operation is specified slide operation | movement In response to the determination of the specific slide operation by the determination unit and the determination unit, the icon associated with the user interface function is displayed in an area that can be subsequently touched in the specific slide operation of the touch screen. An icon display unit is provided.

The second aspect is a user interface control program, and when an operation of sliding a processor of a mobile terminal having a touch screen capable of displaying an object from the end of the touch screen to the inside of the touch screen is performed, A determination unit that determines that the operation is a specific slide operation, and an icon associated with the user interface function is touched after that in the specific slide operation on the touch screen according to the determination of the specific slide operation by the determination unit. It is made to function as an icon display part to be displayed in the area.

A third aspect is a user interface control method performed by a mobile terminal having a touch screen capable of displaying an object. When an operation of sliding from the end of the touch screen to the inside of the touch screen is performed, In accordance with the determination step of determining the operation as a specific slide operation and the determination of the specific slide operation in the determination step, an icon associated with the user interface function can be touched afterwards in the specific slide operation on the touch screen. A display step for displaying in the area is included.
According to the present invention, a portable terminal and a user interface control program and method that can be easily operated by one hand are realized.

The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of a mobile terminal according to an embodiment of the present invention. FIG. 2 is an illustrative view showing an example of a specific slide operation performed on a display screen (touch screen) of a display provided with a touch panel. FIG. 3 is an illustrative view showing an example of an animation in which a function icon is ejected from an end portion (screen end portion) of a touch screen by a specific slide operation. FIG. 3A shows a display immediately after the start of the specific slide operation. 3B shows a display when the lateral displacement amount of the specific slide operation reaches the threshold value, and FIG. 3C shows a display immediately after the displacement amount exceeds the threshold value (a function icon is displayed from the end of the screen). FIG. 3D shows a display after the function icon is discharged from the edge of the screen. FIG. 4 is an illustrative view following FIG. 3 (D), and FIG. 4 (A) shows a display immediately before the “cursor” icon, which is one of the function icons, is selected by continuing the specific slide operation. FIG. 4B shows a display at the time when the cursor appears when the “cursor” icon is selected, and FIG. 4C moves the cursor to select one of the objects by further continuing the specific slide operation. The previous display is shown respectively. FIG. 5 is an illustrative view showing the display position of the function icon that changes depending on the start point of the specific slide operation. FIG. 5A shows the case where the start point is located in the middle of the right end of the screen, and FIG. Each of the cases where the start point is located on the upper right side of the screen is shown. FIG. 6 is an illustrative view showing an example in which the bulge of the screen end due to the specific slide operation is deformed according to the slide direction. FIG. 7 is an illustrative view showing an example of icon discharge by a specific slide operation from the left end of the screen. FIG. 8 is an illustrative view showing an example of icon discharge when the mobile terminal is held sideways. FIG. 9 is a memory map diagram showing the contents of the main memory of the mobile terminal. FIG. 10 is an illustrative view showing one example of function icon information stored in the main memory. FIG. 11 is a flowchart showing GUI control processing by the CPU. FIG. 12 is a flowchart showing details of the function icon control process included in the GUI control process. FIG. 13 is a flowchart showing the cursor control process executed when the “cursor” icon is selected in the function icon control process.

FIG. 1 shows the hardware configuration of the mobile terminal 10. Referring to FIG. 1, mobile terminal 10 according to an embodiment of the present invention includes a CPU 24. The CPU 24 is connected to a key input device 26, a touch panel 32, a main memory 34, a flash memory 36, a direction / tilt sensor 38, and a vibrator 40, and the antenna 12 is connected to the A / D converter 16 via the wireless communication circuit 14. Are connected to the microphone 18, the D / A converter 20 is connected to the speaker 22, and the driver 28 is connected to the display 30.

The antenna 12 receives a radio signal from a base station (not shown). The antenna 12 transmits a radio signal from the radio communication circuit 14. The radio communication circuit 14 demodulates and decodes a radio signal received by the antenna 12, and encodes and modulates a signal from the CPU 24. The microphone 18 converts the sound wave into an analog audio signal, and the A / D converter 16 converts the audio signal from the microphone 18 into digital audio data. The D / A converter 20 converts the audio data from the CPU 24 into an analog audio signal, and the speaker 22 converts the audio signal from the D / A converter 20 into a sound wave.

The key input device 26 includes various keys and buttons (not shown) operated by a user (user), and inputs signals (commands) corresponding to the operation to the CPU 24. The driver 28 displays an image corresponding to the signal from the CPU 24 on the display 30. The touch panel 32 is provided on the display surface 30a of the display 30 and inputs a signal (X, Y coordinates: see FIG. 2) indicating the position of the touch point to the CPU 24. Hereinafter, a screen that is capable of displaying objects such as icons and widgets on the display surface 30a of the display 30 provided with the touch panel 32 is referred to as a “touch screen TS”.

The main memory 34 is composed of, for example, an SDRAM or the like, and stores programs, data, and the like (see FIG. 9) for causing the CPU 24 to execute various processes and provides a necessary work area for the CPU 24. The flash memory 36 is composed of, for example, a NAND flash memory, and is used as a storage area for programs and the like and a recording area for data such as images.

The direction / tilt sensor 38 is composed of a gyroscope, an acceleration sensor, and the like, and determines the direction of the mobile terminal 10 (for example, distinction between vertical / horizontal holding) and the tilt (for example, the tilt angle of the display surface 30a of the display 30 with respect to the horizontal plane). The indicated data is input to the CPU 24. Vibrator 40 is composed of an eccentric motor or the like, and vibrates portable terminal 10 in response to a command from CPU 24.

The CPU 24 executes various processes according to the programs (52 to 58) stored in the main memory 34 while using other hardware (12 to 22, 26 to 40).

In the mobile terminal 10 configured as described above, for example, various applications such as a telephone application for making a call and a browser application for browsing a Web page through a touch screen TS as shown in FIG. You can choose.

Specifically, on the touch screen TS, various objects (icons and widgets) Ob associated with the telephone application and the data communication application are arranged on the background (wallpaper such as a portrait) Wp, and to any of the objects Ob By performing the touch operation, a desired application is selected, and a telephone call or data communication can be performed.

When the telephone application is selected, the mobile terminal 10 causes the display 30 to display a display for making a telephone call. When the number is input by the touch panel 32, the CPU 24 controls the wireless communication circuit 14 to output a calling signal. The output call signal is output via the antenna 12 and transmitted to the other telephone through a mobile communication network (not shown). The other party's telephone starts calling with a ring tone. When the other party receiving the incoming call performs an incoming call operation on the telephone, the CPU 24 starts a call process. On the other hand, when the call signal from the other party is captured by the antenna 12, the wireless communication circuit 14 notifies the CPU 24 of the incoming call, and the CPU 24 starts calling by the incoming sound from the speaker 22 or the vibration of the vibrator 40. When an incoming call operation is performed by the key input device 26, the CPU 24 starts a call process.

Call processing is performed as follows, for example. The received voice signal sent from the other party is captured by the antenna 12, demodulated and decoded by the wireless communication circuit 14, and then given to the speaker 22 via the D / A converter 20. As a result, the received voice is output from the speaker 22. On the other hand, the transmitted voice signal captured by the microphone 18 is sent to the wireless communication circuit 14 via the A / D converter 16, encoded and modulated by the wireless communication circuit 14, and then transmitted to the other party through the antenna 12. Is done. The other party's telephone also demodulates and decodes the transmitted voice signal and outputs the transmitted voice.

When the browser application is selected, the mobile terminal 10 causes the display 30 to display a display for browsing a Web page. Specifically, when an address input operation is performed by the touch panel 32, the CPU 24 controls the wireless communication circuit 14 to connect to a network (not shown), and from a Web server (not shown) corresponding to the input address, HTML. Receive a document. Then, the driver 28 is controlled to display a Web page based on the HTML document on the display 30.

In the mobile terminal 10 configured as described above, operability suitable for one hand (comfortable one-handed operation) is realized by a characteristic GUI (Graphical User Interface). In this GUI, a slide operation (referred to as “specific slide operation”) having a screen end (right end, left end, upper end, or lower end) as a starting point SP as shown in FIG. 2 is used. .

Specifically, when the user holds the mobile terminal 10 vertically with the right hand, the user operates the touch screen TS exclusively with the thumb of the right hand, but at that time, the base of the thumb is located at the lower right of the touch screen TS. Naturally, the movement of the tip of the thumb (current touch point PTP) is from the start point SP on the right end of the touch screen TS toward the lower left (preferably along the circumference centered on the base of the thumb). is there.

That is, the specific slide operation in the case where the mobile terminal 10 is held vertically with the right hand draws a locus that goes diagonally downward to the left from the start point SP on the right end portion of the touch screen TS. Similarly, the specific slide operation in the case of holding the left hand vertically draws a trajectory going diagonally downward to the right from the start point SP on the left end portion of the touch screen TS. Therefore, when performing the specific slide operation, the user is less required to hold the device in a special manner, forcibly bend or extend the finger, or to change the gripping position on the way.

For example, FIGS. 3 to 8 show GUI control when a desired application is selected using such a specific slide operation. 3 to 6 show the touch screen TS in the case of right-hand vertical holding, and FIG. 7 shows the touch screen TS in the case of left-hand vertical holding. A touch screen TS in the case of right-hand holding is shown in FIG. In addition, it is assumed that the touch screen TS defines an (X, Y) coordinate system having an origin O at the upper left corner of the screen as shown in FIG.

First, referring to FIGS. 3A to 3B, when the fingertip touches the right end portion of the touch screen TS and starts to move sideways or diagonally downward in the contact state (displacement in the X direction is detected). The CPU 24 determines that the specific slide operation is started, and displays the mark M indicating the current touch point PTP, while temporarily raising the vicinity of the start point SP at the right end portion, and the function icon FI (described later) from the protrusion Pr at the right end portion. ) Starts an animation that appears to have been ejected.

In displaying the mark M, it is preferable to periodically change at least one of the display size and the transmittance so that the wallpaper Wp is not easily seen.

Next, referring to FIGS. 3B to 3C, when the displacement amount (dX) in the X direction of the specific slide operation reaches a threshold value (for example, 1/10 of the horizontal width of the touch screen TS), The ridge Pr at the right end is maximized, and one or more (three in this case) function icons FI are discharged from the ridge Pr at the right end. It should be noted that there is one function icon at the time of discharging from the ridge Pr, and an effect may be added such that this is separated into a plurality of parts in the middle. More preferably, a semi-transparent band Bn including the locus of the function icon FI may be displayed in order to emphasize or make it easy to see the pop-up of the function icon FI. In addition, the three function icons FI have a line segment L that intersects (for example, is orthogonal to) the trajectory of the specific slide operation (for example, a circle having a radius about half the diagonal line of the touch screen TS with the start point SP as the center). Part).

Also, at the timing when the function icon FI is discharged in this way, a sound effect such as “Pon” is output from the speaker 22 and the vibrator 40 vibrates for a fraction of a second. Thus, by generating sound and vibration in conjunction with the animation display, it is possible to give the user a sense of discharging the function icon FI through visual, auditory, and tactile sensations. In addition, the effect which increases a feeling of discharge | emission is acquired only by any one of a sound or a vibration.

Next, referring to FIGS. 3C to 3D, after the function icon FI is discharged, the ridge Pr at the right end is attenuated and disappears. The discharged function icon FI moves to a predetermined position with respect to the start point SP, for example, along a circumference centered on the base of the thumb, and then is stopped and displayed at that position.

Therefore, the function icon FI is displayed (moved and displayed and then stopped) in an area (for example, in the display area of the band Bn) that can be touched after the specific slide operation. Alternatively, the function icon FI may be paraphrased as being displayed in a direction in which the current touch point PTP of the specific slide operation is predicted to advance (sometimes simply referred to as “the direction of the specific slide operation”). .

Next, referring to FIGS. 3D to 4A, when the current touch point PTP of the specific slide operation enters the display area of any one function icon FI, the CPU 24 displays the function icon FI. Is selected, and the function associated therewith is activated. Here, it is assumed that the three function icons in the touch screen TS are “voice input”, “cursor”, and “loupe” in order from the upper left, and the middle “cursor” icon is selected.

Next, referring to FIGS. 4A to 4B, when the cursor function is activated in response to the selection of the “cursor” icon, the three function icons FI are deleted together with the band Bn, and the current function icon FI is deleted. A cursor Cr having the same or substantially the same size as the mark M (here, slightly larger than the mark M) appears at the position of the touch point PTP. Alternatively, the function icon FI other than the selected one is erased together with the band Bn, while the selected function icon, that is, the “cursor” icon is changed to “cursor Cr” and moved to the position of the current touch point PTP. You may make a special performance.

As described above, the cursor Cr is initially displayed at the same position as the mark M, but the size or the transmittance of the mark M changes periodically, so that the two can be identified. In addition, the display mode of the mark M and the cursor Cr described here is an example, and may be changed as appropriate. For example, if both shapes and display colors are different, the identification becomes easier.

Next, with reference to FIGS. 4B to 4C, the initial display position of the cursor Cr as described above is stored as the cursor origin OP. Thereafter, when the specific slide operation is continued and the current touch point PTP leaves the cursor origin OP, the cursor Cr moves according to the position of the current touch point PTP with respect to the cursor origin OP. Specifically, the cursor Cr is a position obtained by extending a straight line from the cursor origin OP to the current touch point PTP at a certain ratio (for example, a distance from the cursor origin OP to the current touch point PTP, and from the current touch point PTP to the cursor Cr). At a position where the ratio to the distance is 3: 4). In addition, the ratio quoted here is only an example, and may be changed as appropriate.

Thus, by displaying the cursor Cr at a position where a straight line extending from the cursor origin OP to the current touch point PTP is extended at a constant ratio, the object Ob located near the upper end of the touch screen TS can be easily (for example, forcibly extending the thumb). You can choose).

Then, when the specific slide operation is terminated (the fingertip leaves the touch screen TS) with the cursor Cr hitting any one object Ob, the CPU 24 determines that the application associated with the object Ob is selected. The program (58) corresponding to this application is activated.

Therefore, since a desired user interface function (for example, a cursor function) can be selected by one specific slide operation and an application can be selected using the function, a GUI more suitable for one hand is realized. In particular, when the “cursor” function is selected, the cursor Cr moves greatly according to the movement of the fingertip, so that the object Ob near the upper end of the screen can be easily selected.

Although illustration is omitted, when the function icon FI selected by the specific slide operation is a “voice input” icon, the voice input function is activated, and the user inputs the desired application name by voice input, You can choose. When the function icon FI selected by the specific slide operation is a “loupe” icon, the loupe function is activated and, for example, the vicinity of the current touch point PTP is enlarged and displayed. Thereby, even if the objects Ob are small and dense, the user can easily select an application by continuing the specific slide operation.

As a modification, the function icon FI can be displayed not only when the object Ob such as an icon or widget is displayed but also when a specific slide operation is performed on the Web screen. For example, it is possible to perform control such that a “loupe” icon is displayed on the Web screen after the browser application is activated using the cursor function or the voice input function.

In the above example, the three function icons FI in the touch screen TS are “voice input”, “cursor”, and “loupe”, but are not limited thereto. For example, by selecting the function icon FI by a specific slide operation, a notification bar that is difficult to confirm when performing a one-hand operation may be displayed. Also, by performing a specific slide operation, a function icon FI that is not normally displayed on the launcher screen is displayed, and by selecting the function icon FI, a secret application that the user does not want to display an icon on the home screen is activated. It is also possible to make it. Furthermore, the function icon FI displayed by the specific slide operation may be set (changed) by the user.

Also, as shown in FIGS. 5A and 5B, the display position of the function icon FI varies depending on the position of the start point SP of the specific slide operation. For example, if the position of the start point SP is upward, the display position of the function icon FI is also upward. On the other hand, the relationship between the position of the start point SP and the display position of the function icon FI is fixed (but may be changed as appropriate).

Also, as shown in FIG. 6, the ridge Pr generated at the end of the screen in response to the specific slide operation may be deformed in accordance with the direction of the specific slide operation. In the illustrated example, since the specific slide operation is directed obliquely downward, the protuberance Pr also hangs downward on the tip side.

In addition, as shown in FIG. 7, when the mobile terminal 10 is held vertically with the left hand and a specific slide operation is performed with the left hand of the left hand of the touch screen TS as the start point SP, the left and right are interchanged. Except for this, the same GUI control is performed as described with reference to FIGS.

Further, as shown in FIG. 8, when the mobile terminal 10 is horizontally held with the right hand and a specific slide operation is performed with the thumb of the right hand as the starting point SP at the right end of the touch screen TS, FIGS. The same GUI control is performed as described above. However, since the aspect ratio of the touch screen TS changes, the threshold value to be compared with the displacement amount in the X direction, the arrangement of the function icon FI with respect to the start point SP, etc. are different from those in the vertical holding (for example, expanded in the horizontal direction). Will be).

Although illustration is omitted, GUI control similar to that in the case of right-hand side holding described above is performed except that left and right are interchanged even when a specific slide operation is performed while holding the mobile terminal 10 with the left hand. Is called.

The GUI control as described above is performed by the CPU 24 based on various programs (52 to 58) and data (62 to 72) shown in FIGS. 9 and 10 stored in the main memory 34, for example. It implement | achieves by performing the process according to the flowchart shown in FIG.

The configuration of the main memory 34 will be described with reference to FIG. The main memory 34 includes a program area 50 and a data area 60. The program area 50 includes a GUI control program 52, a touch detection program 54, an animation program 56, an application program 58, and the like, and the data area 60 includes touch information 62 and a specific slide. Operation information 64, function icon information 66, cursor information 68, mark position 70, object information 72, and the like are stored.

The GUI control program 52 is a main program for performing GUI control (FIGS. 3 to 8) using a specific slide operation. Refer to the data area 60 in cooperation with the touch detection program 54 and the animation program 56. However, the CPU 24 is caused to execute processing according to the flow of FIGS.

The touch detection program 54 is a program used by the GUI control program 52, and causes the CPU 24 to execute a touch detection process (not shown) based on the output of the touch panel 32. The animation program 56 is a program used by the GUI control program 52, and causes the CPU 24 to execute animation processing relating to the discharge of the function icon FI from the end of the touch screen TS. The application program 58 causes the CPU 24 to execute processing related to various applications such as a telephone and a browser.

Touch information 62 is information indicating the result of the touch detection process, and is updated by the touch detection program 56 at a predetermined cycle (for example, every 1/60 seconds). The touch information 62 includes a current touch state (for example, a state in which nothing is in contact with the display surface 30a or a hand is in contact), a current touch coordinate, and a touch mode (tap or slide). , And information indicating a touch locus or the like.

The specific slide operation information 64 is position information indicating the start point SP and the current touch point PTP of the specific slide operation. The specific slide operation information 64 is created by the GUI control program 54 when the specific slide operation is detected, and the GUI control program during the specific slide operation is continued. 54.

In this embodiment, “a specific slide operation is detected” means “when the operation to slide inward from the end of the touch screen TS is performed, the CPU 24 determines that the operation is a specific slide operation”. Say.

The function icon information 66 is information indicating the display position and display size of the function icon FI, and is created based on the specific slide operation information 64. A specific example of the function icon information 66 is shown in FIG. The function icon information 66 of FIG. 10 includes display positions (for example, center coordinates (x1, y1,), (x2, y2,)) for each of the three types of function icons “voice input”, “cursor”, and “loupe”. , (X3, y3)) and information indicating the display size (for example, radii R1, R2, R3).

The cursor information 68 is information indicating the display position and display size of the cursor Cr, and is created by the GUI control program 54 when the “cursor” icon, which is one of the function icons FI, is selected. It is updated by the medium GUI control program 54. The mark information 70 is information indicating a display position of the mark M, a display size and / or a transmission coefficient, a cycle for changing the display size and / or the transmission coefficient, and the like, and the GUI control program 54 when a specific slide operation is detected. And updated by the GUI control program 54 while the specific slide operation is ongoing. The object information 72 is information indicating the display position and display size of the object Ob, and is created by the application program 58.

Next, the operation of the CPU 24 based on the above programs and data will be described with reference to FIGS. Referring to FIG. 11, first, in step S1, the CPU 24 determines whether or not there is a touch on the touch screen TS based on the touch information 62. If “NO” here, the CPU 24 performs the same after a predetermined waiting time. Repeat discrimination.

If “YES” in the step S 1, the process proceeds to a step S 3 so as to determine whether or not the touch is a touch to the screen end portion based on the touch information 62. If “NO” in the step S3, the process shifts to a step S11 to execute processing corresponding to the touch mode and / or position. For example, if the touch is a tap operation on the object Ob, the application program 58 is activated, and if the touch is a slide operation in the vertical (Y) direction or the horizontal (X) direction, page turning is executed. Then, it returns to step S1.

If “YES” in the step S3, the process proceeds to a step S5 to store the position coordinates of the touch as the start point SP of the specific slide operation. That is, the specific slide operation information 64 is created in the data area 60, and the touch point detected at the edge of the screen is written as the start point SP of the specific slide operation.

Next, in step S7, it is determined based on the output of the direction / tilt sensor 38 whether or not the tilt of the mobile terminal 10 (touch screen TS) is within a predetermined range. If “YES” in the step S7, the process proceeds to a step S9 to execute the function icon control as described in FIGS. 3A to 3D, and then returns to the step S1. If “NO” in the step S7, the possibility of an erroneous operation is increased, and the process returns to the step S1 without executing the function icon control.

The function icon control in step S9 is executed according to a subroutine shown in FIG. The CPU 24 first determines whether or not the touch position is displaced in the X direction based on the touch information 62 in step S21. If it is step S21, it will move to step S23 and will further discriminate | determine based on the touch information 62 whether the user lifted the hand from the touch screen TS. If NO in step S23, the process returns to step S21, and the same determination is repeated after a predetermined standby period.

If “YES” in the step S23, the predicted specific slide operation has not been started, and the process returns to the upper flow (FIG. 11).

If YES in step S21, the process proceeds to step S25, and the mark M whose size and / or transmittance changes periodically is displayed at the touch position based on the touch information 62 and the mark information 70 (see FIG. 3A). Next, in step S27, the animation program 58 is called, and an animation process for raising the edge of the screen and discharging the function icon FI from the raised Pr as shown in FIGS. 3 (A) to 3 (C) is started. To do.

Thereafter, whether or not the amount of displacement in the X direction exceeds the threshold value is determined in the next step S29, and if NO here, it is further determined in step S31 whether or not the user has released his / her hand from the touch screen TS. If NO in step S31, the process returns to step S29, and the same determination is repeated after a predetermined standby period.

If “YES” in the step S31, the started specific slide operation has not been continued, so the process jumps to the step S47 to erase the mark M, and then returns to the upper flow (FIG. 11). Along with this, the animation previously started in step S27 is ended halfway.

If “YES” in the step S29, the process proceeds to a step S33 to generate a sound effect from the speaker 22 and a vibration from the vibrator 40 at the same time as the function icon FI is discharged from the raised Pr at the end of the screen. Only one of sound effect and vibration may be generated. At the same time, a band Bn for emphasizing the discharge of the function icon FI for easy viewing is further displayed on the touch screen TS in step S34. The discharged function icon FI is stopped and displayed at a position corresponding to the start point SP based on the specific slide information 64 in the next step S35 (see FIGS. 3C to 3D).

Next, in step S37, it is determined based on the specific slide operation information 64 and the function icon information 66 whether or not the touch position (current touch point PTP) has entered the display area of the function icon FI other than “cursor”. If “NO” in the step S37, the process shifts to a step S39 to further determine whether or not the touch position enters the display area of the “cursor” icon. If “NO” in the step S39, the process shifts to a step S41 to further determine whether or not the user has released the hand from the touch screen TS based on the touch information 62. If NO in step S41, the process returns to step S37, and the same determination is repeated after a predetermined standby period.

In step S39, instead of determining whether or not the touch position has entered the “cursor” icon display area, it may be determined whether or not the touch position has passed within the “cursor” icon display area. Good. Preferably, when the finger is moved a certain distance by a specific slide operation, whether or not the touch position has passed within the display area of the “cursor” icon (in other words, the touch locus intersects the display area of the “cursor” icon) Whether or not: More specifically, whether or not the touch trajectory is orthogonal or substantially orthogonal to the outline of the display area of the “cursor” icon may be determined.

If “YES” in the step S37, the process proceeds to a step S43 to execute processing corresponding to the function icon FI (processing such as voice input and loupe display). Thereafter, returning to the upper flow (FIG. 11), the same processing is repeated. If “YES” in the step S41, the specific slide operation is completed without selecting any function icon FI. Therefore, the function icon FI is deleted in the step S45, and the mark M is further deleted in the step S47. Returning to the flow (FIG. 11), the same processing is repeated. And if it is YES at Step S39, processing of CPU24 will shift to cursor control shown in FIG.

Referring to FIG. 13, in step S51, CPU 24 first sets the touch position at the time when the determination result in step S39 changes from NO to YES (that is, current touch point PTP shown in FIG. 4A) as the cursor origin. Store as OP (PTP → OP). Next, in step S53, it is determined whether or not the touch position has changed. If NO here, the process proceeds to step S55 to further determine whether or not the user has released his / her hand from the touch screen TS. If NO in step S55, the process returns to step S53, and the same determination is repeated after a predetermined standby period.

If “YES” in the step S55, the cursor control is ended, and the GUI control (FIG. 11) is started again. If “YES” in the step S53, the position of the cursor Cr is calculated in a step S57 based on the positional relationship between the cursor origin OP and the current touch point PTP, and then the cursor Cr is displayed in the calculated position in a step S59. Specifically, a position obtained by extending a straight line from the cursor origin OP to the current touch point PTP at a certain ratio (for example, a distance from the cursor origin OP to the current touch point PTP and a distance from the current touch point PTP to the cursor Cr). The position where the ratio is 3: 4) is calculated as the cursor position, and the cursor Cr is displayed at this calculated position. The calculation method given here is only an example, and may be changed as appropriate.

Thereafter, the process proceeds to step S61, and it is further determined based on the object information 72 and the touch information 62 whether or not the user has released his / her hand from the touch screen TS within the display area of any object Ob. If “NO” in the step S61, the process returns to the step S53 to repeat the same processing as described above. If “YES” in the step S61, the process proceeds to a step S63, and the application program 58 corresponding to the object Ob is called to start the selected application. Thereafter, the cursor control is terminated, and application processing based on the application program 58 is started.

As apparent from the above, in this embodiment, the mobile terminal 10 has the touch screen TS that can display objects Ob such as icons and widgets. When an operation of sliding from the end of the touch screen TS to the inside of the touch screen TS is performed, the CPU 24 of the mobile terminal 10 determines that the operation is a specific slide operation (S1, S3, S21), and the specific slide operation In response to the determination, the function icon FI associated with the user interface function is displayed in an area that can be subsequently touched in the specific slide operation of the touch screen TS (S27, S35).

Therefore, in accordance with the specific slide operation (FIG. 2) starting from the end portion (screen end portion) of the touch screen TS, an area that can be touched thereafter in the specific slide operation (in other words, the current state of the specific slide operation). Since the function icon FI is displayed in the direction in which the touch point PTP is predicted to travel (which may be simply referred to as “the direction of the specific slide operation”) (FIGS. 3A to 3D), Easy one-handed operation. Further, since the function icon FI is displayed for the first time after a specific slide operation, the visibility of the background such as the wallpaper Wp is hardly hindered. Note that the area that can be touched thereafter in the specific slide operation may be, for example, a band (Bn) or a part thereof.

Further, the CPU 24 displays the function icon FI at a different position depending on the start point SP of the specific slide operation. Thereby, regardless of the holding position of the mobile terminal 10 (more specifically, the position of the thumb of the hand with respect to the touch screen TS), one-handed operation can be easily performed.

Also, the CPU 24 displays the function icon FI obliquely below the starting point SP of the specific slide operation. Accordingly, the function icon FI can be smoothly selected by performing a specific slide operation with the thumb of the hand holding the mobile terminal 10 around the base of the thumb (that is, the screen corner) or its periphery.

Further, the CPU 24 displays a plurality of function icons FI along a line segment L that intersects the locus of the specific slide operation obliquely below the start point SP of the specific slide operation. In this embodiment, the line segment L is a part of the circumference centering on the starting point SP of the specific slide operation or a point in the vicinity thereof, but in another embodiment, a part of the curve other than the circumference. However, it may be a part of a straight line. Thereby, the plurality of function icons FI are arranged in a direction intersecting (more preferably orthogonal) with respect to the direction of the specific slide operation, and thus any one of the plurality of function icons FI can be easily selected by the specific slide operation.

Further, in response to the detection of the specific slide operation, the CPU 24 applies a band Bn having the same width as the length of the line segment L along the locus of the specific slide operation (here, a slightly larger width) to the touch screen TS. Further, it is displayed (S34). Thus, by displaying the band Bn, a specific slide operation for selecting the function icon FI can be easily performed. In this embodiment, the band Bn is translucently displayed so that the background can be seen through it. However, in other embodiments, instead of the translucent display, a shaded display or a line drawing display may be used. Good.

Further, the CPU 24 temporarily raises the vicinity of the start point SP at the end of the screen according to the lateral displacement dX of the specific slide operation, and displays an animation that makes it appear as if the function icon FI has been ejected from the raised Pr at the end. Further display on the touch screen TS (S27). By displaying the animation in this way and producing the function icon FI as if it was ejected from the edge of the screen, a comfortable operational feeling can be given. Even if the animation is not displayed, the function icon FI is displayed as it is along the line L intersecting the locus of the specific slide operation as it is (immediately) according to the lateral displacement dX of the specific slide operation. Also good.

Here, the timing at which the function icon FI is discharged is the timing at which the lateral displacement dX of the specific slide operation exceeds the threshold (S29: YES). As a result, it is possible to give a feeling as if the function icon was pulled out of the screen edge by the specific slide operation.

Further, the CPU 24 further displays a mark M indicating the current touch position PTP of the specific slide operation on the touch screen TS (S25). By displaying the mark M and clearly indicating the current touch position PTP, erroneous operations can be reduced when the function icon FI is selected or when the object Ob is selected using the cursor Cr.

Preferably, at least one of the display size and the transmittance of the mark M periodically changes. Thereby, it can suppress that a background becomes difficult to see with the mark M. FIG.

The mobile terminal 10 further includes a speaker 22 and a vibrator 40, and the CPU 24 generates a sound effect from the speaker 22 and a vibration from the vibrator 40 at a timing when the function icon FI is discharged (S33). Thus, by generating sound effects and vibrations according to the discharge of the function icon FI, a more comfortable operational feeling can be given. Note that even when only one of sound effects or vibrations is generated, the comfort during operation is improved.

Further, when the current touch position PTP of the specific slide operation enters the function icon FI display area, the CPU 24 activates the interface function associated with the function icon FI (S37, S39, S43, S59). Alternatively, when the current touch position PTP of the specific slide operation passes through the function icon FI display area, the interface function associated with the function icon FI may be activated. Therefore, a desired interface function can be activated by continuing the specific slide operation.

For example, one function icon FI is associated with a cursor function that further displays a cursor Cr that moves in accordance with the current touch position PTP of the specific slide operation on the touch screen TS, and the CPU 24 displays the current touch position of the specific slide operation. When the PTP enters the display area of this function icon FI, the cursor function is activated (S39: YES → S59).
Therefore, the cursor function which is one of the interface functions is activated by the specific slide operation, and the specific slide operation can be continued (without releasing the hand from the touch screen TS) to move the cursor Cr.

The object displayed on the touch screen TS is associated with the application program 58, and when the cursor function is activated as described above, the CPU 24 indicates that the cursor Cr is in the display area of the object Ob. When the specific slide operation is finished, the application program 58 associated with the object Ob is started (S63). Therefore, the application can be started by activating the cursor function by the specific slide operation and moving the cursor Cr to the object Ob corresponding to the desired application by continuing the specific slide operation. That is, since the cursor function can be activated by selecting a function icon and the application can be activated by selecting an object using the cursor Cr by a single specific slide operation, the one-handed operation becomes more comfortable.

Here, the initial display position of the cursor Cr is the touch position when the cursor function is activated (that is, the cursor origin OP), and the display position of the cursor Cr thereafter is the distance from the cursor origin OP to the current touch position PTP. It changes according to. Thus, the cursor Cr is initially displayed at the cursor origin OP, which is the touch position when the cursor function is activated, and thereafter moves according to the change in the current touch position PTP, so that the cursor function is activated. It is possible to smoothly shift from the function icon selection to the object selection using the cursor Cr.

Also, the display position of the cursor Cr is in the direction from the cursor origin OP to the current touch position PTP. Therefore, the cursor Cr can be easily moved in a desired direction. In particular, the moving distance of the cursor Cr is larger than the moving distance from the cursor origin OP to the current touch position PTP. Therefore, since the cursor Cr can be moved greatly with a small operation amount, the one-hand operation becomes even more comfortable.

In addition, the mobile terminal 10 further includes a direction / tilt sensor 38, and the CPU 24 determines that the output value related to the tilt from the direction / tilt sensor 30 (for example, the tilt angle with respect to the horizontal plane of the touch screen TS) is not within a predetermined range. Does not display icons. Thereby, an erroneous operation of icon selection, which is likely to occur when the touch screen TS is horizontal or close to it, is avoided.

It should be noted that the specific number and arrangement of the icons mentioned in this specification are merely examples, and can be changed as appropriate according to changes in product specifications.

Although the mobile terminal 10 has been described above, this embodiment has a touch screen that can display objects such as icons and widgets (a touch screen such as a touch panel or a touch screen provided on the display surface of the display). The present invention can be applied to terminals (for example, smartphones, tablet PCs, various information terminals) and user interface control programs executed by a processor (CPU) of such portable terminals.

Here, the reference numerals in parentheses and the supplementary explanation in the following description show the correspondence with the above-described embodiment for the purpose of understanding, and do not limit the embodiment in any way. .

The first aspect is the mobile terminal (10), which is a touch screen (TS) capable of displaying an object (Ob), and when an operation of sliding from the end of the touch screen to the inside of the touch screen is performed. A determination unit (S1, S3, S21) that determines that the operation is a specific slide operation, and an icon (FI) associated with the user interface function in response to the determination of the specific slide operation by the determination unit, the touch screen An icon display unit (S27, S35) is provided that is displayed in an area that can be touched after the specific slide operation.

According to the first aspect, the end of the touch screen (hereinafter simply referred to as “screen end”: the end is also referred to as “edge”, “periphery”, “outer periphery”, “edge”, etc.) is the starting point (SP). In response to the specific slide operation (FIG. 2), an icon is displayed in an area that can be touched after that in the specific slide operation (FIGS. 3A to 3D). Easy to do. Further, since the icon is displayed for the first time after a specific slide operation, the visibility of the background (Wp) such as wallpaper is less likely to be hindered. In addition, the area | region which can be touched after that in the said specific slide operation may be the belt | band | zone (Bn) in the following 5th aspect, or its part, for example.

The second mode is dependent on the first mode, and the icon display unit displays the icons at different positions depending on the start point (SP) of the specific slide operation.

According to the second aspect, the one-handed operation can be easily performed regardless of the position of the portable terminal (more specifically, the position of the thumb of the hand relative to the touch screen).

The third aspect is dependent on the first or second aspect, and the icon display unit displays the icon obliquely below the start point (SP) of the specific slide operation.

According to the third aspect, the icon is smoothed by performing a specific slide operation with the thumb of the hand holding the mobile terminal so that the fingertip is swiveled around the base of the thumb (that is, the screen corner) or the periphery thereof. Can be selected.

The fourth aspect is dependent on the third aspect, and the icon display unit displays a plurality of icons diagonally below the start point (SP) of the specific slide operation and a line segment that intersects the trajectory of the specific slide operation ( L).

In some embodiments, the line segment is a part of the circumference centered on the start point (SP) of the specific slide operation or a point in the vicinity thereof. Or part of a straight line.

According to the fourth aspect, since the plurality of icons are arranged in a direction intersecting (more preferably orthogonal) with the direction of the specific slide operation, any one of the plurality of icons can be easily selected by the specific slide operation. .

The fifth mode is dependent on the fourth mode, and a band (Bn) having the same or substantially the same width as the length of the line segment along the trajectory of the specific slide operation according to the determination of the specific slide operation by the determination unit. ) Is further displayed on the touch screen, and a band display unit (S34) is further provided.

According to the fifth aspect, the specific slide operation for selecting the icon can be easily performed by displaying the band.

In some embodiments, the band is displayed translucently so that the background can be seen through the band. In another embodiment, a halftone display or a line drawing display may be used instead of the translucent display.

The sixth aspect is dependent on any one of the first to fifth aspects, and the icon display unit temporarily raises the vicinity of the start point of the screen edge according to the lateral displacement (dX) of the specific slide operation. Then, an animation showing that the icon has been ejected from the ridge (Pr) at the end is displayed (S27).

According to the sixth aspect, a comfortable operation feeling can be given by displaying an animation and producing the icon as if it were ejected from the edge of the screen.

The seventh aspect is dependent on the sixth aspect, and the timing at which the icon is ejected is the timing when the lateral displacement amount (dX) of the slide operation exceeds the threshold (S29: YES).

According to the seventh aspect, it is possible to give a feeling that the icon is pulled out from the edge of the screen by the specific slide operation.

The eighth aspect is dependent on the seventh aspect, and further includes a mark display unit (S25) that further displays a mark (M) indicating the current touch position (PTP) of the specific slide operation on the touch screen.

According to the eighth aspect, when the function icon FI is selected by displaying the mark and clearly indicating the current touch position (and when the object Ob is selected using the cursor Cr as described later). Also) can reduce misoperation.

The ninth aspect is dependent on the eighth aspect, and at least one of the display size and the transmittance of the mark changes periodically.

According to the ninth aspect, it is possible to suppress the background from becoming difficult to see with the mark.

A tenth aspect is dependent on any one of the seventh to ninth aspects, further includes at least one of a speaker (22) and a vibrator (40), and the sound from the speaker and the vibrator at a timing when the icon is ejected. A generator (S33) for generating at least one of vibrations from

According to the tenth aspect, by generating sound and / or vibration in accordance with the discharge of the icon, a more comfortable operational feeling can be given.

The eleventh aspect is dependent on any one of the first to tenth aspects, and when the current touch position (PTP) of the specific slide operation enters the icon display area, the interface function associated with the icon is activated. And an activation unit (S37, S39, S43, S59).

The twelfth aspect is dependent on any one of the first to tenth aspects. When the current touch position (PTP) of the specific slide operation passes through the icon display area, the interface function associated with the icon is activated. Further, an activation unit is provided (S37, S39, S43, S59).

In one embodiment, when a finger is moved a certain distance by a specific slide operation, if the locus of the current touch position PTP intersects the display area of the function icon FI, the interface associated with the function icon FI Activate the function. In another embodiment, if the locus of the current touch position PTP is orthogonal or substantially orthogonal to the contour line of the display area of the function icon FI, the interface function associated with the function icon FI is activated.

According to the eleventh or twelfth aspect, a desired interface function can be activated by continuing the specific slide operation.

A thirteenth aspect is dependent on the eleventh aspect, wherein the icon is associated with a cursor function that further displays a cursor (Cr) that moves in accordance with the current touch position of the specific slide operation on the touch screen, Activates the cursor function when the current touch position of the specific slide operation enters the icon display area (S39: YES → S59).

Note that, as described in the twelfth aspect, the activation unit may activate the cursor function when the current touch position of the specific slide operation passes through the icon display area.

According to the thirteenth aspect, the cursor function as one of the interface functions is activated by the specific slide operation, and the specific slide operation is continued (without releasing the hand from the touch screen) to move the cursor. be able to.

The fourteenth aspect is dependent on the thirteenth aspect, and the object is associated with the application (58). When the cursor function is activated by the activation unit, the cursor enters the object display area. An application activation unit (S63) is also provided that activates an application associated with the object when the specific slide operation is terminated.

According to the fourteenth aspect, the cursor function is activated by a specific slide operation, and the application can be activated by continuing the specific slide operation and moving the cursor to an object corresponding to a desired application. . That is, since the cursor function can be activated by selecting an icon and the application can be activated by selecting an object using the cursor by a single specific slide operation, the one-handed operation becomes more comfortable.

The fifteenth aspect is dependent on the thirteenth or fourteenth aspect, and the initial display position of the cursor is a touch position (OP) at the time when the cursor function is activated. It changes according to the distance from the touch position (OP) at the time of activation to the current touch position (PTP).

According to the fifteenth aspect, the cursor is initially displayed at the touch position (OP) when the cursor function is activated, and thereafter moves according to the change in the current touch position. You can move smoothly from selecting an icon to selecting an object using the cursor.

The sixteenth aspect is dependent on the fifteenth aspect, and the display position of the cursor is in the direction from the touch position (OP) when the cursor function is activated toward the current touch position (PTP).

According to the sixteenth aspect, the cursor can be easily moved in a desired direction.

The seventeenth aspect is dependent on the sixteenth aspect, and the movement distance of the cursor is larger than the movement distance from the touch position (OP) to the current touch position (PTP) when the cursor function is activated.

According to the seventeenth aspect, since the cursor can be moved largely with a small amount of operation, the one-handed operation becomes even more comfortable.

An eighteenth aspect is dependent on the first aspect, further comprising a sensor (38) that detects at least an inclination of the touch screen with respect to a horizontal plane, and the icon display unit has an inclination value detected by the sensor not within a predetermined range. In this case, no icon is displayed.

According to the eighteenth aspect, it is possible to avoid an erroneous icon selection that is likely to occur when the touch screen (TS) is horizontal or close to it.

A nineteenth aspect is a user interface control program (52), in which a processor (24) of a portable terminal (10) having a touch screen (TS) capable of displaying an object (Ob) is connected from an end of the touch screen. When an operation of sliding to the inside of the touch screen is performed, a determination unit (S1, S3, S21) that determines the operation as a specific slide operation, and a user interface according to the determination of the specific slide operation by the determination unit The icon (FI) associated with the function is caused to function as an icon display unit (S27, S35) that causes the icon to be displayed in an area that can be subsequently touched in the specific slide operation on the touch screen.

A twentieth aspect is a user interface control method performed by a mobile terminal (10) having a touch screen (TS) capable of displaying an object (Ob), and slides from an end of the touch screen to the inside of the touch screen. In response to the determination step (S1, S3, S21) for determining that the operation is a specific slide operation when the operation to be performed is performed, and the determination of the specific slide operation in the determination step ( FI) includes a display step (S27, S35) for displaying the icon in an area that can be touched after that in the specific slide operation on the touch screen.

According to the nineteenth or twentieth aspect, similar to the first aspect, one-hand operation can be easily performed.

Although the present invention has been described and illustrated in detail, it is clear that it has been used merely as an illustration and example and should not be construed as limiting, and the spirit and scope of the present invention are attached Limited only by the wording of the claims.

10 ... mobile terminal 24 ... CPU
28 ... Driver 30 ... Display 30a ... Display surface 32 ... Touch panel 34 ... Main memory Ob ... Object Cr ... Cursor Bn ... Band FI ... Function icon OP ... Cursor origin Pr ... Uplift PTP ... Current touch point SP ... Start point of specific slide operation

Claims

Touch screen capable of displaying objects,
When an operation of sliding from the end of the touch screen to the inside of the touch screen is performed, a determination unit that determines the operation as a specific slide operation, and a user according to the determination of the specific slide operation by the determination unit A mobile terminal comprising: an icon display unit configured to display an icon associated with an interface function in an area that can be subsequently touched in the specific slide operation on the touch screen.
The mobile terminal according to claim 1, wherein the icon display unit displays the icon at a different position depending on a start point of the specific slide operation.
The mobile terminal according to claim 1, wherein the icon display unit displays the icon obliquely below the start point of the specific slide operation.
The mobile terminal according to claim 3, wherein the icon display unit displays a plurality of the icons obliquely below the start point of the specific slide operation along a line segment intersecting the trajectory of the specific slide operation.
A band display unit that further displays a band having the same or substantially the same width as the length of the line segment along the trajectory of the specific slide operation according to the determination of the specific slide operation by the determination unit. The portable terminal according to claim 4, further comprising:
The icon display unit displays an animation that temporarily raises the vicinity of the start point of the end portion according to a lateral displacement amount of the specific slide operation and makes the icon appear to be discharged from the protrusion of the end portion. The mobile terminal according to claim 1, wherein:
The mobile terminal according to claim 6, wherein the timing at which the icon is ejected is a timing at which a lateral displacement amount of the specific slide operation exceeds a threshold value.
The mobile terminal according to claim 7, further comprising a mark display unit for further displaying a mark indicating a current touch position of the specific slide operation on the touch screen.
The mobile terminal according to claim 8, wherein at least one of a display size and a transmittance of the mark changes periodically.
Further comprising at least one of a speaker and a vibrator;
The mobile terminal according to claim 7, further comprising a generator that generates at least one of a sound from the speaker and a vibration from the vibrator at a timing when the icon is discharged.
The mobile terminal according to claim 1, further comprising an activation unit that activates an interface function associated with the icon when a current touch position of the specific slide operation enters the display area of the icon.
The mobile terminal according to claim 1, further comprising an activation unit that activates an interface function associated with the icon when a current touch position of the specific slide operation passes through a display area of the icon.
The icon is associated with a cursor function for further displaying on the touch screen a cursor that moves according to the current touch position of the specific slide operation,
The mobile terminal according to claim 11, wherein the activation unit activates the cursor function when a current touch position of the specific slide operation enters a display area of the icon.
The object is associated with an application;
In the case where the cursor function is activated by the activation unit, an application activation that activates an application associated with the object when the specific slide operation is terminated while the cursor is in the display area of the object The mobile terminal according to claim 13, further comprising a unit.
The initial display position of the cursor is a touch position when the cursor function is activated, and then the display position of the cursor is a distance from the touch position when the cursor function is activated to the current touch position. The mobile terminal according to claim 13, which changes in response.
The mobile terminal according to claim 15, wherein the display position of the cursor is in a direction from the touch position when the cursor function is activated toward the current touch position.
The mobile terminal according to claim 16, wherein a moving distance of the cursor is larger than a moving distance from a touch position when the cursor function is activated to a current touch position.
A sensor for detecting at least an inclination of the touch screen with respect to a horizontal plane;
The mobile terminal according to claim 1, wherein the icon display unit does not display an icon when an inclination value detected by the sensor is not within a predetermined range.
A user interface control method performed by a mobile terminal having a touch screen capable of displaying an object,
When an operation of sliding from the end of the touch screen to the inside of the touch screen is performed, a determination step of determining the operation as a specific slide operation, and a determination of the specific slide operation by the determination step A user interface control method, comprising: an icon display step of displaying an icon associated with an interface function in an area that can be subsequently touched in the specific slide operation on the touch screen.