ENHANCED NAVIGATION FOR TOUCH-SURFACE DEVICE

• US 20140143688A1
• Filed: 11/19/2012
• Published: 05/22/2014
• Est. Priority Date: 11/19/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hou, Zhitao, Liang, Xiao, Zhang, Dongmei, Zhang, Haidong
• Application Number:
  US13/681,243
• Publication Number:
  US 20140143688A1
• Time in Patent Office: Days
• US Class Current: 715/760
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

An enhanced navigation system detects a predetermined input gesture from a user and presents one or more gesture panels at pre-designated positions on a display of a touch-surface device or positions determined based on where a user is likely to hold the device. The user may navigate content of the application currently presented in the display by providing one or more input gestures within the one or more gesture panels, thus saving the user from moving his/her hands around the display of the touch-surface device while holding the touch-surface device. The enhanced navigation system further enables synchronize one or more gesture definitions with a cloud computing system and/or one or more other devices.

Claims

1. A device comprising:

one or more processors;

a display;

memory storing executable instructions that, when executed by the one or more processors, configure the one or more processors to perform acts comprising;

receiving a user gesture to initiate a presentation of a navigation panel in the display of the device, the display currently presenting a web page of a website and the navigation panel configured to accept one or more navigation gestures from a user to navigate the web page and/or the website;

determining a location where a user is likely to hold the device;

designating, based on the determined location, a position where the navigation panel is to be presented;

injecting a program into the web page currently presented by the display without modifying programming codes associated with the website at a server end, the injecting enabling an overlaying of the navigation panel on top of a part of web page at the designated position, the navigation panel being transparent without blocking the part of the web page on which the navigation panel is overlaid;

detecting a navigation gesture from the user within the navigation panel; and

in response to detecting the navigation gesture, performing an action in accordance with the navigation gesture.

2. The device as recited in claim 1, wherein the navigation gesture comprises a predefined gesture.

3. The device as recited in claim 1, wherein the navigation gesture comprises a gesture defined by the user.

4. The device as recited in claim 1, wherein determining the location where the user is likely to hold the device is based on an orientation of the device.

5. The device as recited in claim 1, wherein determining the location where the user is likely to hold the device is based on a touch sensor of the device.

6. One or more computer-readable media storing executable instructions that, when executed by one or more processors, configure the one or more processors to perform acts comprising:

detecting a first user gesture from a user to actuate a predetermined control on a web browser application displayed in a display of a device, the web browser application presenting a web page of a website;

in response to detecting the first user gesture,

injecting a program to the web page without modifying programming codes associated with the website at a server end, the injecting enabling presenting a transparent gesture panel at a position on the display of the device, wherein the presenting comprises overlaying the transparent gesture panel on top of the web browser application at the position of the display of the device;

receiving a second user gesture from the user within the transparent gesture panel; and

enabling a navigation of the web page or the website by the user based on the second user gesture.

8. The one or more computer-readable media as recited in claim 6, the acts further comprising:

determining whether the second user gesture corresponds to a user gesture predefined for the web browser application; and

in response to determining that the second user gesture does not correspond to a user gesture predefined for the web browser application, prompting the user to resubmit a new user gesture or providing a message to the user to ask whether the user wants to define a new command based on the second user gesture.

9. The one or more computer-readable media as recited in claim 6, further comprising:

determining a location where the user is likely to hold the device; and

designating, based on the determined location, the position where the transparent gesture panel is presented.

10. The one or more computer-readable media as recited in claim 6, wherein determining the location where the user is likely to hold the device is based on an orientation of the device.

11. The one or more computer-readable media as recited in claim 6, wherein determining the location where the user is likely to hold the device is based on a touch sensor of the device.

7. The one or more computer-readable media as recited in 6, the acts further comprising:

determining whether the second user gesture corresponds to a user gesture predefined for the web browser application; and

in response to determining that the second user gesture corresponds to a user gesture predefined for the web browser application, performing an action in accordance with the predefined user gesture to enable the navigation of the web page or the website by the user.

12. A method comprising:

under control of one or more processors configured with executable instructions;

detecting a user gesture associated with an application that is currently presented on a display of a device;

determining a location where a user is likely to hold the device;

designating, based on the determined location, a position where a gesture panel is to be presented; and

overlaying the gesture panel on top of a page of the application at a designated position on the display of the device, the gesture panel comprising an area that is dedicated to accept one or more other user gestures for navigating the page of the application.

13. The method as recited in claim 12, further comprising:

detecting another user gesture on the gesture panel;

determining whether the other user gesture on the gesture panel corresponds to a predefined user gesture of a plurality of predefined user gestures; and

in response to determining that the other user gesture corresponds to a predefined user gesture of the plurality of predefined user gestures, performing an action on the application in accordance with the predefined user gesture.

14. The method as recited in claim 12, further comprising:

detecting another user gesture on the gesture panel that is overlaid on the page of the application;

determining whether the other user gesture on the gesture panel corresponds to a predefined user gesture of a plurality of predefined user gestures; and

in response to determining that the other user gesture does not correspond to any of the plurality of predefined user gestures, prompting a user with one or more options, the one or more options comprising;

indicating to the user that the other user gesture is undefined;

requesting the user to provide a new user gesture; and

/or

asking the user whether a new command based on the other user gesture is to be defined.

15. The method as recited in claim 12, wherein the application comprises a web browser application and the page of the application comprises a web page of a website.

16. The method as recited in claim 15, further comprising in response to detecting the user gesture associated with the application, injecting a program in the page of the application, the injecting causing the overlaying of the gesture panel on top of the page of the application.

17. The method as recited in claim 16, wherein the injecting enables overlaying the gesture panel on the page of the application without modifying programming codes associated with the website at a server end.

18. The method as recited in claim 12, further comprising:

in response to detecting the user gesture associated with the application, determining one or more hyperlinks in the page of the application; and

extracting the one or more hyperlinks to be displayed within the gesture panel.

19. The method as recited in claim 12, further comprising:

in response to detecting the user gesture associated with the application, determining one or more hyperlinks in the page of the application; and

extracting the one or more hyperlinks to be displayed within a hyperlink panel that is different from the gesture panel and located at another predetermined position on the display of the device.

20. The method as recited in claim 12, further comprising enabling a user to move the gesture panel to another position on the display of the device.

21. The method as recited in claim 12, wherein determining the location where the user is likely to hold the device is based on an orientation of the device.

22. The method as recited in claim 12, wherein determining the location where the user is likely to hold the device is based on a touch sensor of the device.

23. The method as recited in claim 12, wherein the detected user gesture comprises:

actuation of a soft control of the application and/or actuation of a hard control of the device.

24. The method as recited in claim 12, wherein the gesture panel is transparent, allowing a user to view content presented on the display of the device under the gesture panel.

25. A method comprising:

under control of one or more processors configured with executable instructions;

receiving a gesture definition from a first device, the gesture definition comprising information defining a relationship between a user gesture and an action actuated upon receiving the user gesture at the first device; and

sending information associated with the gesture definition to a second device.

26. The method as recited in claim 25, wherein sending the information associated with the gesture definition to the second device is performed in response to receiving a request from the second device.

27. The method as recited in claim 25, wherein sending the information associated with the gesture definition to the second device is performed automatically upon receipt of the gesture definition from the first device.

28. The method as recited in claim 25, wherein sending the information associated with the gesture definition to the second device is performed periodically.

29. The method as recited in claim 25, further comprising:

determining whether the second device is a same device type as the first device;

in response to determining that the second device is not the same device type as the first device, adapting the gesture definition received from the first device to a gesture definition supported by the second device.

30. The method as recited in claim 25, further comprising:

determining whether an application of the second device is a same application of the first device for which the gesture definition is originally defined;

in response to determining that the application of the second device is not the same application of the first device, adapting the gesture definition received from the first device to a gesture definition supported by the application of the second device.

31. The method as recited in claim 25, wherein the adapting comprises replacing the action of the gesture definition by a new action that produces a same effect and is supported by the application of the second device.

32. A device comprising:

one or more processors;

memory storing executable instructions that, when executed by the one or more processors, configure the one or more processors to perform acts comprising;

presenting a web page of a website to a user, the web page comprising information of a plurality of gesture definitions available for download to a device of the user, each gesture definition comprising information defining a relationship between a user gesture and an action actuated upon receiving the user gesture;

receiving a user selection of a gesture definition presented on the web page;

downloading the selected gesture definition from the website;

prior to enabling the user to use the selected gesture definition in the device of the user, determining whether the selected gesture definition is supported by the device;

in response to determining that the selected gesture definition is not supported by the device, adapting the selected gesture definition to a new gesture definition that is supported by the device; and

enabling the new gesture definition for use by the user in the device.

33. The device as recited in claim 32, wherein the adapting comprises:

determining one or more actions supported by the device that produce a same or similar effect as an effect of an action of the selected gesture definition;

replacing the action of the selected gesture definition by one of the one or more determined actions supported by the device.

34. The device as recited in claim 32, wherein the adapting further comprises:

enabling the user to select the one of the one or more determined actions supported by the device for replacing the action of the selected gesture definition.

35. A method comprising:

under control of one or more processors configured with executable instructions;

defining a group of multiple devices;

receiving one or more gesture definitions from a device of the group; and

propagating the one or more received gesture definitions to other devices of the group.

36. The method as recited in claim 35, wherein propagating the one or more received gesture definitions to the other devices of the group is performed over a network.

37. The method as recited in claim 35, wherein prior to propagating the one or more received gesture definitions to other devices of the group, the method further comprises determining whether a gesture definition the one or more received gesture definitions of is compatible with a device of the other devices.

38. The method as recited in claim 37, further comprising:

in response to determining that the gesture definition is not compatible with the device of the other devices, adapting the gesture definition to a gesture definition that is compatible with the device of the other devices;

propagating the adapted gesture definition to the device of the other devices.

39. The method as recited in claim 37, further comprising in response to determining that the gesture definition is not compatible with the device of the other devices, propagating the gesture definition to the device of the other devices with an adaptation instruction, the adaptation instruction indicating that the gesture definition is not compatible with the device of the other devices and directing the device of the other devices to perform an adaptation of the gesture definition.

40. The method as recited in claim 35, wherein the multiple devices comprise devices of different types.