INTERACTION METHOD AND INTERACTION DEVICE

• US 20130268897A1
• Filed: 09/27/2012
• Published: 10/10/2013
• Est. Priority Date: 12/08/2011
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Li, Rui, Liu, Yong
• Granted Patent: US 9,213,467 B2
• Time in Patent Office: Days
• US Class Current: 715/841
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

The present invention provides an interaction device including an interaction interface, where a display area is formed of multiple display boundaries among which a corner area is formed between every two adjacent display boundaries; an interface interaction unit, for generating two first boundaries at a position that is corresponding to at least one corner area in the display area, where the two first boundaries and corner sides display boundaries form a main menu selection area which includes a selectable object; a processing unit, configured to, when the selectable object in the main menu selection area is selected and moves towards a position where any one of the two first boundaries is located and the selected selectable object crosses over a predetermined position, replace the selected selectable object in the main menu selection area with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

Claims

1. An interaction device, comprising an interaction interface, wherein the interaction interface comprises a display area formed of multiple display boundaries, and among the multiple display boundaries, a corner area is formed between every two adjacent display boundaries, and the interaction device further comprises an interface interaction unit and a processing unit;

the interface interaction unit is configured to generate two first boundaries at a position that is corresponding to at least one corner area in the display area;

the two first boundaries do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area;

the two first boundaries and the display boundaries that are at the two sides of the corner area form a main menu selection area;

the main menu selection area comprises a selectable object; and

the processing unit is configured to, when the selectable object in the main menu selection area is selected and moves towards a position where any one of the two first boundaries is located and the selected selectable object crosses over a predetermined position, replace the selected selectable object and a predetermined selectable object at a same level as the selected selectable object in the main menu selection area with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

2. The interaction device according to claim 1, wherein:

the interface interaction unit is further configured to form a second boundary and a third boundary in the display area outside the main menu selection area and adjacent to the main menu selection area;

the second boundary and the third boundary form a submenu selection area;

the third boundary is farther away from the main menu selection area than the second boundary is;

the submenu selection area comprises the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object; and

the processing unit is further configured to, when the upper level selectable object or lower level selectable object in the submenu selection area is selected and moves towards a position where the second boundary of the submenu selection area is located and the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replace the selectable objects in the main menu selection area with the selected upper level selectable objects or lower level selectable objects.

3. The interaction device according to claim 2, wherein when the processing unit replaces the selectable objects in the main menu selection area with the selected upper level selectable objects or lower level selectable objects, the interface interaction unit is further configured to display further upper level selectable objects correlated to the selected upper level selectable object or further lower level selectable objects correlated to the selected lower level selectable object in the submenu selection area.

4. The interaction device according to claim 2, wherein the processing unit is configured to, when the selectable object in the main menu selection area is selected and moves towards the first boundary that is adjacent to the second boundary of the submenu selection area and the selected selectable object crosses over a predetermined position, replace the upper level selectable objects or lower level selectable objects correlated to the selected selectable object in the submenu selection area with the selectable objects in the main menu selection area.

5. The interaction device according to claim 2, wherein the third boundary and the second boundary do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the second boundary, the third boundary and the display boundaries that are at the two sides of the corner area form the submenu selection area;

and

correspondingly, the processing unit is further configured to, when the upper level selectable object or lower level selectable object in the submenu selection area is selected and moves towards a position where the third boundary is located and the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replace the upper level selectable objects or the lower level selectable objects in the submenu selection area with the selectable objects in the main menu selection area.

6. The interaction device according to claim 2, wherein the display area is a rectangle comprising four display boundaries, and the main menu selection area is formed at a lower right corner or a lower left corner of the display area for a user to perform an operation on the selectable objects in the main menu with a thumb.

7. The interaction device according to claim 1, wherein at least one of the first boundary, the second boundary and the third boundary is in an arc shape.

8. The interaction device according to claim 1, wherein the interface interaction unit is further configured to generate a sub display area in a corner area that is corresponding to the main menu selection area, wherein the sub display area comprises a menu activation control;

and the processing unit is further configured to activate the main menu selection area in the display area when the menu activation control is selected.

9. The interaction device according to claim 1, wherein:

the interface interaction unit comprises a touch sensing interface;

the touch sensing interface is configured to respond to a touch action that occurs on the interaction interface;

the touch action comprises a tap for selecting the selectable objects in the display area;

a slide for moving the selected selectable object; and

the processing unit is configured to execute corresponding interface interaction processing according to a response of the touch sensing interface.

10. The interaction device according to claim 1, wherein the processing unit is further configured to, after the selectable object in the main menu selection area is selected and moves in an extending direction of the first boundary of the main menu selection area, alternately display the predetermined selectable objects at the same level as the selected selectable object in the main menu selection area.

11. An interaction method of an interaction device, comprising:

displaying two first boundaries in a display area, wherein the display area comprises multiple display boundaries, a corner area is formed between every two adjacent display boundaries, the two first boundaries are located at a position that is corresponding to the at least one corner area in the display area, the two first boundaries do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the two first boundaries and the display boundaries that are at the two sides of the corner area form a main menu selection area;

displaying selectable objects in the display area, wherein the selectable objects are located in the main menu selection area in the display area;

detecting a first touch action that occurs in the main menu selection area to acquire a position where the first touch action occurs;

determining, according to the acquired position where the first touch action occurs, a selectable object selected by the first touch action;

detecting a first touch track of the first touch action towards a direction of any one of the first boundaries of the main menu selection area; and

moving, along the first touch track, the selectable object selected by the first touch action, and when the selectable object selected by the first touch action crosses over a predetermined position, replacing the selectable object selected by the first touch action and a predetermined selectable object at a same level as the selected selectable object with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

12. The interaction method according to claim 11, wherein the method further comprises:

displaying a second boundary and a third boundary in the display area, wherein the second boundary and the third boundary are located outside the main menu selection area and the third boundary is farther away from the main menu selection area than the second boundary is; and

the second boundary and the third boundary form a submenu selection area;

displaying the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object, wherein the predetermined upper level selectable objects or predetermined lower level selectable objects correlated to the selected selectable object are located in the submenu selection area;

detecting a second touch action that occurs in the submenu selection area to acquire a position where the second touch action occurs;

determining, according to the acquired position where the second touch action occurs, the upper level selectable object or lower level selectable object selected by the second touch action;

detecting a second touch track of the second touch action towards a direction where the second boundary of the submenu selection area is located; and

moving, along the second touch track, the upper level selectable object or lower level selectable object selected by the second touch action, and when the upper level selectable object or lower level selectable object selected by the second touch action crosses over a predetermined position, replacing the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object.

13. The interaction method according to claim 12, wherein when replacing the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object, the method further comprises:

displaying further upper level selectable objects correlated to the selected upper level selectable object or further lower level selectable objects correlated to the selected lower level selectable object in the submenu selection area.

14. The interaction method according to claim 12, wherein the detecting the first touch track of the first touch action in the direction of one random first boundary of the main menu selection area specifically comprises:

detecting the first touch track of the first touch action towards a direction of the first boundary of the main menu selection area adjacent to the second boundary of the submenu; and

correspondingly, when replacing the selectable object selected by the first touch action and the predetermined selectable objects at the same level as the selected selectable object with the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object, the method further comprises;

replacing the upper level selectable objects or lower level selectable objects in the submenu selection area with the selectable objects in the main menu selection area.

15. The interaction method according to claim 12, wherein the third boundary and the second boundary do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the second boundary, the third boundary and the display boundaries that are at the two sides of the corner area form the submenu selection area;

and

correspondingly, the method further comprises;

detecting a third touch action that occurs in the submenu selection area to acquire a position where the third touch action occurs;

determining, according to the acquired position where the third touch action occurs, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area;

detecting a third touch track of the third touch action towards a direction of the third boundary of the submenu selection area; and

moving, along the third touch track, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area, and when the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replacing the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object with the selectable objects in the main menu selection area.

16. The interaction method according to claim 11, wherein the method further comprises:

displaying a menu activation control in a sub display area, wherein the sub display area is located in the corner area that is corresponding to the main menu selection area; and

detecting a fourth touch action that is located in the sub display area and corresponding to the menu activation control;

wherein

correspondingly, the displaying the main menu selection area in the display area specifically comprises;

displaying the main menu selection area in the display area according to the fourth touch action.

17. The interaction method according to claim 11, wherein the method further comprises:

detecting a fifth touch action that occurs in the main menu selection area to acquire a position where the fifth touch action occurs;

determining, according to the acquired position where the fifth touch action occurs, a selectable object selected by the fifth touch action;

detecting a fifth touch track of the fifth touch action moving along an extending direction of the first boundary of the main menu selection area; and

moving, along the fifth touch track, the selectable object selected by the fifth touch action, and displaying selectable objects at a same level as the selectable object selected by the fifth touch action in the main menu selection area in an alternating manner.

18. An interaction device, comprising:

a first display module, configured to display two first boundaries in a display area;

wherein the display area comprises multiple display boundaries, a corner area is formed between every two adjacent display boundaries, the two first boundaries are located at a position that is corresponding to the at least one corner area in the display area, the two first boundaries do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the two first boundaries and the display boundaries that are at the two sides of the corner area form a main menu selection area;

a second display module, configured to display selectable objects in the display area, wherein the selectable objects are located in the main menu selection area in the display area;

a first detection module, configured to detect a first touch action that occurs in the main menu selection area to acquire a position where the first touch action occurs;

a first selection module, configured to determine, according to the acquired position where the first touch action occurs, a selectable object selected by the first touch action;

a first touch track detection module, configured to detect a first touch track of the first touch action towards a direction of any one of the first boundaries of the main menu selection area, and

a first object movement module, configured to, move, along the first touch track, the selectable object selected by the first touch action, and when the selectable object selected by the first touch action crosses over a predetermined position, replace the selectable object selected by the first touch action and predetermined selectable objects at a same level as the selected selectable object with predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object.

19. The interaction device according to claim 18, further comprising:

a third display module, configured to display a second boundary and a third boundary in the display area, wherein the second boundary and the third boundary are located outside the main menu selection area and the third boundary is farther away from the main menu selection area than the second boundary is; and

the second boundary and the third boundary form a submenu selection area;

a fourth display module, configured to display the predetermined upper level selectable objects or lower level selectable objects correlated to the selected selectable object, wherein the predetermined upper level selectable objects or predetermined lower level selectable objects correlated to the selected selectable object are located in the submenu selection area;

a second detection module, configured to detect a second touch action that occurs in the submenu selection area to acquire a position where the second touch action occurs;

a second selection module, configured to determine, according to the acquired position where the second touch action occurs, the upper level selectable object or lower level selectable object selected by the second touch action in the menu selection area;

a second track detection module, configured to detect a second touch track of the second touch action towards a direction of the second boundary of the submenu selection area; and

a second object movement module, configured to, move, along the second touch track, the upper level selectable object or lower level selectable object selected by the second touch action, and when the upper level selectable object or lower level selectable object selected by the second touch action crosses over a predetermined position, replace the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object.

20. The interaction device according to claim 19, wherein when the second object movement module replaces the selectable objects in the main menu selection area with the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object;

the second display module is further configured to display further upper level selectable objects correlated to the selected upper level selectable object or further lower level selectable objects correlated to the selected lower level selectable object in the submenu selection area.

21. The interaction device according to claim 20, wherein,

the first movement track detection module is specifically configured to detect the first touch track of the first touch action towards a direction of the first boundary of the main menu selection area adjacent to the second boundary of the submenu;

and correspondingly, the second display module is further configured to replace the upper level selectable objects or lower level selectable objects in the submenu selection area with the selectable objects in the main menu selection area.

22. The interaction device according to claim 19, wherein the third boundary and the second boundary do not intersect each other in the display area and cross the corner area, respectively, to intersect display boundaries that are at two sides of the corner area, and the second boundary, the third boundary and the display boundaries that are at the two sides of the corner area form the submenu selection area;

the second detection module is further configured to detect a third touch action that occurs in the submenu selection area to acquire a position where the third touch action occurs;

the second selection module is further configured to determine, according to the acquired position where the third touch action occurs, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area;

the second track detection module is further configured to detect a third touch track of the third touch action towards a direction of the third boundary of the submenu selection area; and

the second object movement module is further configured to, move, along the third touch track, the upper level selectable object or lower level selectable object selected by the third touch action in the submenu selection area, and when the selected upper level selectable object or lower level selectable object crosses over a predetermined position, replace the upper level selectable object or lower level selectable object selected by the second touch action and selectable objects at a same level as the selected upper level selectable object or selected lower level selectable object with the selectable objects in the main menu selection area.

23. The interaction device according to of claim 19, wherein the interaction device further comprises:

a control generation module, configured to display a menu activation control in a sub display area, wherein the sub display area is located in the corner area that is corresponding to the main menu selection area;

a third detection module, configured to detect a fourth touch action that is located in the sub display area and corresponding to the menu activation control; and

correspondingly, the first display module is further configured to display the main menu selection area in the display area according to the fourth touch action.

24. The interaction device according to of claim 19, wherein,

the first detection module is further configured to detect a fifth touch action that occurs in the main menu selection area to acquire a position where the fifth touch action occurs;

correspondingly, the first selection module is further configured to determine, according to the acquired position where the fifth touch action occurs, a selectable object selected by the fifth touch action;

the first track detection module is further configured to detect a fifth touch track of the fifth touch action moving along an extending direction of the first boundary of the main menu selection area; and

the first object movement module is further configured to move, along the fifth touch track, the selectable object selected by the fifth touch action, and display selectable objects at a same level as the selectable object selected by the fifth touch action in an alternating manner in the main menu selection area.