Terminal device having virtual operation key

• US 10,146,343 B2
• Filed: 02/10/2015
• Issued: 12/04/2018
• Est. Priority Date: 06/26/2014
• Status: Active Grant

• Current Assignee: GungHo Online Entertainment, Inc.
• Original Assignee: GungHo Online Entertainment, Inc.
• Inventors: Sawada, Akira
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): Gyawali, Bipin
• Application Number:
  US14/618,112
• Publication Number:
  US 20150378459A1
• Time in Patent Office: 1,393 Days
• Field of Search: None
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The purpose is to provide a terminal device that can be operated by a virtual operation key which is easy to use. The terminal device according to an aspect of the present invention comprises a display unit for displaying a virtual operation key, a touch panel for detecting contact by an inputting object on the virtual operation key, and a control unit for assessing whether a drag operation by the inputting object has been carried out on the basis of contact with the virtual operation key by the inputting object detected via the touch panel and controlling the display position of the virtual operation key, wherein the control unit modifies the display position of the virtual operation key in accordance with the contact position of the inputting object if the contact position of the inputting object exceeds a display area of the virtual operation key due to the drag operation.

Claims

1. A terminal device comprising:

a memory that includes computer-readable instructions;

a display that is divided into first and second adjacent display areas and that is configured to display a virtual operation key, the display being configured to display a predetermined movable object which is continuously movable in the first and second display areas;

a touch panel that is provided directly adjacent to the display and that is configured to detect contact by an inputting object on the virtual operation key; and

a processor that is configured to execute the computer-readable instructions to;

assess a drag operation by the inputting object based on the contact with the virtual operation key by the inputting object;

control movement of the predetermined movable object according to the drag operation; and

selectively move the virtual operation key in the display based on the drag operation,

wherein an operation detection area is defined on the touch panel relative to the virtual operation key, and the virtual operation key is located in the operation detection area,

wherein the processor is further configured to;

maintain a display position of the virtual operation key at a current location when a contact position of the inputting object on the touch panel is anywhere within the operation detection area so that even when the contact position in the operation detection area is misaligned with the virtual operation key, the virtual operation key is kept stationary at the current location;

move the display position of the virtual operation key to a new location when the contact position of the inputting object on the touch panel is outside of the operation detection area, the new location corresponding to the contact position; and

restrict the display position of the virtual operation key to a virtual key display area that is located only in the first display area when the drag operation continuously moves from the first display area and crosses over into the second display area so that the virtual operation key does not cross over into the second display area,

wherein, when the drag operation continuously moves from the first display area and crosses over into the second display area, the processor is configured to move the predetermined movable object from the first display are and cross over into the second display area,

wherein, at a display area interface uninterruptedly transitioning the first display area directly to the second display area, a boundary of the first display area is coextensive with a boundary of the second display area, and

an edge of the virtual key display area is aligned with the display area interface.

2. The terminal device according to claim 1,

wherein the operation detection area is larger than the virtual operation key, and

the virtual operation key is completely located within the operation detection area.

3. The terminal device according to claim 1,

wherein the processor is configured to determine a movement direction of the predetermined movable object based on a predetermined reference position and a direction obtained based on a locational relationship between the contact position of the inputting object and the predetermined reference position.

4. The terminal device according to claim 1,

wherein the processor is configured to determine a movement distance of the predetermined movable object based on a distance between a predetermined reference position and the contact position of the inputting object.

5. The terminal device according to claim 3, wherein the predetermined reference position is located in the operation detection area in which the processor is configured to detect an operation of the virtual operation key by the inputting object, and

when the contact position of the inputting object is outside of the operation detection area due to the drag operation, the processor is configured to determine the movement direction and a movement distance of the predetermined movable object based on a distance between the predetermined reference position and a position at which a line connecting the predetermined reference position and the contact position intersects an outer periphery of a display area of the virtual operation key.

6. The terminal device according to claim 1, wherein the processor is configured to display the virtual operation key at an area in the first display area directly adjacent to the display area interface when the inputting object is contacted to the second display area.

7. The terminal device according to claim 6, wherein the processor is configured to display the virtual operation key in a fixed position set in advance prior to detection of the drag operation on the virtual operation key.

8. The terminal device according to claim 7, wherein the display is divided into a left area and a right area along a centerline of the display, and the fixed position is located in the left area corresponding to the first display area.

9. The terminal device according to claim 7, wherein the processor is configured to display the virtual operation key in the fixed position, and

the processor is configured to detect contact on any position of the touch panel in the first display area by the inputting object, and the processor is configured to move the virtual operation key to a position of the contact by the inputting object.

10. The terminal device according to claim 3, wherein the virtual operation key is circular, and

the predetermined reference position is located at a center of the circular virtual operation key.

11. The terminal device according to claim 10, wherein the processor is configured to display an operative object showing the contact position of the inputting object, and

the processor is configured to modify a display position of the operative object in accordance with movement of the contact position.

12. The terminal device according to claim 11, wherein the operative object is circular, and

when the contact position of the inputting object is located in the second display area due to the drag operation, the processor is configured to control the display position of the virtual operation key so that a center of the circular operative object is positioned outside the circular virtual operation key.

13. The terminal device according to claim 1, wherein the virtual operation key is semitransparently displayed.

14. The terminal device according to claim 1, wherein the virtual operation key is a virtual joystick, which virtually imitates a joystick.

15. A computer program product embodying computer readable instructions stored on a non-transitory computer-readable medium for causing a computer to execute the computer readable instructions by a processor so as to perform the steps of:

displaying a virtual operation key on a display, the display being divided into first and second adjacent display areas;

displaying a predetermined movable object which is continuously movable in the first and second display areas on the display;

causing a touch panel to detect contact by an inputting object on the virtual operation key;

assessing a drag operation by the inputting object based on the contact with the virtual operation key by the inputting object;

control movement of the predetermined movable object according to the drag operation; and

selectively moving the virtual operation key in the display based on the drag operation,

wherein an operation detection area is defined on the touch panel relative to the virtual operation key, and the virtual operation key is located in the operation detection area,

wherein the processor is further configured to;

maintain a display position of the virtual operation key in a current location when a contact position of the inputting object on the touch panel is anywhere within the operation detection area so that even when the contact position in the operation detection area is misaligned with the virtual operation key, the virtual operation key is kept stationary at the current location;

move the display position of the virtual operation key to a new location when the contact position of the inputting object on the touch panel is outside of the operation detection area, the new location corresponding to the contact position; and

restrict the display position of the virtual operation key to a virtual key display area that is located only in the first display area when the drag operation continuously moves from the first display area and crosses over into the second display area so that the virtual operation key does not cross over into the second display area, wherein when the drag operation continuously moves from the first display area and crosses over into the second display area, the processor is configured to move the predetermined movable object from the first display area and cross over into the second display area,

wherein, at a display area interface uninterruptedly transitioning the first display area directly to the second display area, a boundary of the first display area is coextensive with a boundary of the second display are, and

an edge of the virtual key display area is aligned with the display area interface.

16. A method for causing a processor to execute a process, the method comprising executing on the processor the steps of:

displaying a virtual operation key on a display, the display being divided into first and second adjacent display areas;

displaying a predetermined movable object which is continuously movable in the first and second display areas on the display;

causing a touch panel to detect contact by an inputting object on the virtual operation key;

assessing a drag operation by the inputting object by the contact with the virtual operation key by the inputting object;

control movement of the predetermined movable object according to the drag operation; and

selectively moving the virtual operation key in the display based on the drag operation,

wherein an operation detection area is defined on the touch panel relative to the virtual operation key, and the virtual operation key is located in the operation detection area,

wherein the processor is further configured to;

maintain a display position of the virtual operation key in a current location when a contact position of the inputting object on the touch panel is anywhere within the operation detection area so that even when the contact position in the operation detection area is misaligned with the virtual operation key, the virtual operation key is kept stationary at the current location;

move the display position of the virtual operation key to a new location when the contact position of the inputting object on the touch panel is outside of the operation detection area, the new location corresponding to the contact position; and

restrict the display position of the virtual operation key to a virtual key display area that is located only in the first display area when the drag operation continuously moves from the first display area and crosses over into the second display area so that the virtual operation key does not cross over into the second display area, wherein when the drag operation continuously moves from the first display area and crosses over into the second display area, the processor is configured to move the predetermined movable object from the first display area and cross over into the second display area,

wherein, at a display area interface uninterruptedly transitioning the first display area directly to the second display area, a boundary of the first display area is coextensive with a boundary of the second display area, and

an edge of the virtual key display area is aligned with the display area interface.

17. The computer program product according to claim 15,

wherein the processor is configured to determine a movement direction of the predetermined movable object based on a predetermined reference position and a direction obtained based on a locational relationship between the contact position of the inputting object and the predetermined reference position.

18. The computer program product according to claim 15,

wherein the processor is configured to determine a movement distance of the predetermined movable object based on a distance between a predetermined reference position and the contact position of the inputting object.

19. The method according to claim 16,

wherein the processor is configured to determine a movement direction of the predetermined movable object based on a predetermined reference position and a direction obtained based on a locational relationship between the contact position of the inputting object and the predetermined reference position.

20. The method according to claim 16,

wherein the processor is configured to determine a movement distance of the predetermined movable object based on a distance between a predetermined reference position and the contact position of the inputting object.