Interaction method and interaction device

• US 9,213,467 B2
• Filed: 09/27/2012
• Issued: 12/15/2015
• Est. Priority Date: 12/08/2011
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Li, Rui, Liu, Yong
• Primary Examiner(s): WENG, PEI YONG
• Application Number:
  US13/628,764
• Publication Number:
  US 20130268897A1
• Time in Patent Office: 1,174 Days
• Field of Search: 715/841
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

The present invention provides an interaction device including an interaction interface, where a display area is formed of multiple display boundaries among which a corner area is formed between every two adjacent display boundaries; an interface interaction unit, for generating two first boundaries at a position that is corresponding to at least one corner area in the display area, where the two first boundaries and corner sides display boundaries form a main menu selection area which includes a selectable object; a processing unit, configured to, when the selectable object in the main menu selection area is selected and moves towards a position where any one of the two first boundaries is located and the selected selectable object crosses over a predetermined position, replace the selected selectable object in the main menu selection area with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

Claims

1. An interaction device, comprising a touch-sensitive display having an interaction interface, wherein the interaction interface comprises a display area formed of multiple display boundaries, and among the multiple display boundaries, a corner area is formed between every two adjacent display boundaries, and the interaction device further comprises an interface interaction unit and a processing unit wherein the interface interaction unit and the processing unit comprises a processor and memory storing instructions that are executed on the processor such that:

the interface interaction unit generates two first boundaries at a position that is corresponding to at least one corner area in the display area;

the two first boundaries do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area;

the two first boundaries and the display boundaries that are at the two sides of the corner area form a main menu selection area;

the main menu selection area comprises a selectable object; and

the processing unit, when the selectable object in the main menu selection area is selected and moves towards a position where any one of the two first boundaries is located and the selected selectable object crosses over a predetermined position wherein the predetermined position is associated with at least one of the two first boundaries, replaces, upon the predetermined position associating with the at least one of the two first boundaries being crossed by a movement of the selected selectable object, the selected selectable object and a predetermined selectable object at a same level as the selected selectable object in the main menu selection area with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

2. The interaction device according to claim 1, wherein:

the interface interaction unit forms a second boundary and a third boundary in the display area outside the main menu selection area and adjacent to the main menu selection area;

the second boundary and the third boundary form a submenu selection area;

the third boundary is farther away from the main menu selection area than the second boundary is;

the submenu selection area comprises the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object; and

the processing unit, when the upper level selectable object or lower level selectable object in the submenu selection area is selected and moves towards a position where the second boundary of the submenu selection area is located and the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replaces the selectable objects in the main menu selection area with the selected upper level selectable objects or lower level selectable objects.

3. The interaction device according to claim 2, wherein when the processing unit replaces the selectable objects in the main menu selection area with the selected upper level selectable objects or lower level selectable objects, the interface interaction unit displays further upper level selectable objects correlated to the selected upper level selectable object or further lower level selectable objects correlated to the selected lower level selectable object in the submenu selection area.

4. The interaction device according to claim 2, wherein the processing unit, when the selectable object in the main menu selection area is selected and moves towards the first boundary that is adjacent to the second boundary of the submenu selection area and the selected selectable object crosses over a predetermined position, replaces the upper level selectable objects or lower level selectable objects correlated to the selected selectable object in the submenu selection area with the selectable objects in the main menu selection area.

5. The interaction device according to claim 2, wherein the third boundary and the second boundary do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the second boundary, the third boundary and the display boundaries that are at the two sides of the corner area form the submenu selection area;

and

correspondingly, the processing unit, when the upper level selectable object or lower level selectable object in the submenu selection area is selected and moves towards a position where the third boundary is located and the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replaces the upper level selectable objects or the lower level selectable objects in the submenu selection area with the selectable objects in the main menu selection area.

6. The interaction device according to claim 2, wherein the display area is a rectangle comprising four display boundaries, and the main menu selection area is formed at a lower right corner or a lower left corner of the display area for a user to perform an operation on the selectable objects in the main menu with a thumb.

7. The interaction device according to claim 1, wherein at least one of the first boundary, the second boundary and the third boundary is in an arc shape.

8. The interaction device according to claim 1, wherein the interface interaction unit generates a sub display area in a corner area that is corresponding to the main menu selection area, wherein the sub display area comprises a menu activation control;

and the processing unit activates the main menu selection area in the display area when the menu activation control is selected.

9. The interaction device according to claim 1, wherein:

the interface interaction unit comprises a touch sensing interface;

the touch sensing interface responds to a touch action that occurs on the interaction interface;

the touch action comprises a tap for selecting the selectable objects in the display area;

a slide for moving the selected selectable object; and

the processing unit executes corresponding interface interaction processing according to a response of the touch sensing interface.

10. The interaction device according to claim 1, wherein the processing unit, after the selectable object in the main menu selection area is selected and moves in an extending direction of the first boundary of the main menu selection area, alternately displays the predetermined selectable objects at the same level as the selected selectable object in the main menu selection area.

11. An interaction method of an interaction device, comprising:

displaying two first boundaries in a display area, wherein the display area comprises multiple display boundaries, a corner area is formed between every two adjacent display boundaries, the two first boundaries are located at a position that is corresponding to the at least one corner area in the display area, the two first boundaries do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the two first boundaries and the display boundaries that are at the two sides of the corner area form a main menu selection area;

displaying selectable objects in the display area, wherein the selectable objects are located in the main menu selection area in the display area;

detecting a first touch action that occurs in the main menu selection area to acquire a position where the first touch action occurs;

determining, according to the acquired position where the first touch action occurs, a selectable object selected by the first touch action;

detecting a first touch track of the first touch action towards a direction of any one of the first boundaries of the main menu selection area; and

moving, along the first touch track, the selectable object selected by the first touch action, and when the selectable object selected by the first touch action crosses over a predetermined position wherein the predetermined position is associated with at least one of the two first boundaries, replacing, upon the predetermined position associating with the at least one of the two first boundaries being crossed by a movement of the selected selectable object, the selectable object selected by the first touch action and a predetermined selectable object at a same level as the selected selectable object with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

12. The interaction method according to claim 11, wherein the method further comprises:

displaying a second boundary and a third boundary in the display area, wherein the second boundary and the third boundary are located outside the main menu selection area and the third boundary is farther away from the main menu selection area than the second boundary is; and

the second boundary and the third boundary form a submenu selection area;

displaying the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object, wherein the predetermined upper level selectable objects or predetermined lower level selectable objects correlated to the selected selectable object are located in the submenu selection area;

detecting a second touch action that occurs in the submenu selection area to acquire a position where the second touch action occurs;

determining, according to the acquired position where the second touch action occurs, the upper level selectable object or lower level selectable object selected by the second touch action;

detecting a second touch track of the second touch action towards a direction where the second boundary of the submenu selection area is located; and

moving, along the second touch track, the upper level selectable object or lower level selectable object selected by the second touch action, and when the upper level selectable object or lower level selectable object selected by the second touch action crosses over a predetermined position, replacing the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object.

13. The interaction method according to claim 12, wherein when replacing the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object, the method further comprises:

displaying further upper level selectable objects correlated to the selected upper level selectable object or further lower level selectable objects correlated to the selected lower level selectable object in the submenu selection area.

14. The interaction method according to claim 12, wherein the detecting the first touch track of the first touch action in the direction of one random first boundary of the main menu selection area specifically comprises:

detecting the first touch track of the first touch action towards a direction of the first boundary of the main menu selection area adjacent to the second boundary of the submenu; and

correspondingly, when replacing the selectable object selected by the first touch action and the predetermined selectable objects at the same level as the selected selectable object with the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object, the method further comprises;

replacing the upper level selectable objects or lower level selectable objects in the submenu selection area with the selectable objects in the main menu selection area.

15. The interaction method according to claim 12, wherein the third boundary and the second boundary do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the second boundary, the third boundary and the display boundaries that are at the two sides of the corner area form the submenu selection area;

and

correspondingly, the method further comprises;

detecting a third touch action that occurs in the submenu selection area to acquire a position where the third touch action occurs;

determining, according to the acquired position where the third touch action occurs, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area;

detecting a third touch track of the third touch action towards a direction of the third boundary of the submenu selection area; and

moving, along the third touch track, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area, and when the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replacing the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object with the selectable objects in the main menu selection area.

16. The interaction method according to claim 11, wherein the method further comprises:

displaying a menu activation control in a sub display area, wherein the sub display area is located in the corner area that is corresponding to the main menu selection area; and

detecting a fourth touch action that is located in the sub display area and corresponding to the menu activation control;

wherein

correspondingly, the displaying the main menu selection area in the display area specifically comprises;

displaying the main menu selection area in the display area according to the fourth touch action.

17. The interaction method according to claim 11, wherein the method further comprises:

detecting a fifth touch action that occurs in the main menu selection area to acquire a position where the fifth touch action occurs;

determining, according to the acquired position where the fifth touch action occurs, a selectable object selected by the fifth touch action;

detecting a fifth touch track of the fifth touch action moving along an extending direction of the first boundary of the main menu selection area; and

moving, along the fifth touch track, the selectable object selected by the fifth touch action, and displaying selectable objects at a same level as the selectable object selected by the fifth touch action in the main menu selection area in an alternating manner.

18. An interaction device having a touch-sensitive display, comprising:

a first display module having a number of instructions that cause a computer equipment to display two first boundaries in a display area;

wherein the display area comprises multiple display boundaries, a corner area is formed between every two adjacent display boundaries, the two first boundaries are located at a position that is corresponding to the at least one corner area in the display area, the two first boundaries do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the two first boundaries and the display boundaries that are at the two sides of the corner area form a main menu selection area;

a second display module having a number of instructions that cause a computer equipment to display selectable objects in the display area, wherein the selectable objects are located in the main menu selection area in the display area;

a first detection module having a number of instructions that cause a computer equipment to detect a first touch action that occurs in the main menu selection area to acquire a position where the first touch action occurs;

a first selection module having a number of instructions that cause a computer equipment to determine, according to the acquired position where the first touch action occurs, a selectable object selected by the first touch action;

a first touch track detection module having a number of instructions that cause a computer equipment to detect a first touch track of the first touch action towards a direction of any one of the first boundaries of the main menu selection area, and

a first object movement module having a number of instructions that cause a computer equipment to move, along the first touch track, the selectable object selected by the first touch action, and when the selectable object selected by the first touch action crosses over a predetermined position wherein the predetermined position is associated with at least one of the two first boundaries, replace, upon the predetermined position associating with the at least one of the two first boundaries being crossed by a movement of the selected selectable object, the selectable object selected by the first touch action and predetermined selectable objects at a same level as the selected selectable object with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

19. The interaction device according to claim 18, further comprising:

a third display module having a number of instructions that cause a computer equipment to display a second boundary and a third boundary in the display area, wherein the second boundary and the third boundary are located outside the main menu selection area and the third boundary is farther away from the main menu selection area than the second boundary is; and

the second boundary and the third boundary form a submenu selection area;

a fourth display module having a number of instructions that cause a computer equipment to display the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object, wherein the predetermined upper level selectable objects or predetermined lower level selectable objects correlated to the selected selectable object are located in the submenu selection area;

a second detection module having a number of instructions that cause a computer equipment to detect a second touch action that occurs in the submenu selection area to acquire a position where the second touch action occurs;

a second selection module having a number of instructions that cause a computer equipment to determine, according to the acquired position where the second touch action occurs, the upper level selectable object or lower level selectable object selected by the second touch action in the menu selection area;

a second track detection module having a number of instructions that cause a computer equipment to detect a second touch track of the second touch action towards a direction of the second boundary of the submenu selection area; and

a second object movement module having a number of instructions that cause a computer equipment to move, along the second touch track, the upper level selectable object or lower level selectable object selected by the second touch action, and when the upper level selectable object or lower level selectable object selected by the second touch action crosses over a predetermined position, replace the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object.

20. The interaction device according to claim 19, wherein when the second object movement module replaces the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object;

the second display module displays further upper level selectable objects correlated to the selected upper level selectable object or further lower level selectable objects correlated to the selected lower level selectable object in the submenu selection area.

21. The interaction device according to claim 20, wherein,

the first movement track detection module detects the first touch track of the first touch action towards a direction of the first boundary of the main menu selection area adjacent to the second boundary of the submenu;

and correspondingly, the second display module replaces the upper level selectable objects or lower level selectable objects in the submenu selection area with the selectable objects in the main menu selection area.

22. The interaction device according to claim 19, wherein the third boundary and the second boundary do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the second boundary, the third boundary and the display boundaries that are at the two sides of the corner area form the submenu selection area;

the second detection module detects a third touch action that occurs in the submenu selection area to acquire a position where the third touch action occurs;

the second selection module determines, according to the acquired position where the third touch action occurs, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area;

the second track detection module detects a third touch track of the third touch action towards a direction of the third boundary of the submenu selection area; and

the second object movement module, moves, along the third touch track, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area, and when the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replaces the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object with the selectable objects in the main menu selection area.

23. The interaction device according to of claim 19, wherein the interaction device further comprises:

a control generation module having a number of instructions that cause a computer equipment to display a menu activation control in a sub display area, wherein the sub display area is located in the corner area that is corresponding to the main menu selection area;

a third detection module having a number of instructions that cause a computer equipment to detect a fourth touch action that is located in the sub display area and corresponding to the menu activation control; and

correspondingly, the first display module displays the main menu selection area in the display area according to the fourth touch action.

24. The interaction device according to of claim 19, wherein,

the first detection module detects a fifth touch action that occurs in the main menu selection area to acquire a position where the fifth touch action occurs;

correspondingly, the first selection module determines, according to the acquired position where the fifth touch action occurs, a selectable object selected by the fifth touch action;

the first track detection module detects a fifth touch track of the fifth touch action moving along an extending direction of the first boundary of the main menu selection area; and

the first object movement module moves, along the fifth touch track, the selectable object selected by the fifth touch action, and displays selectable objects at a same level as the selectable object selected by the fifth touch action in an alternating manner in the main menu selection area.