INVISIBLE CONTROL

• US 20140223381A1
• Filed: 05/23/2011
• Published: 08/07/2014
• Est. Priority Date: 05/23/2011
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Huang, Xuedong, Chen, Zheng, Zhang, Zhimin, Sun, Jian-Tao, Bai, Peng, Ni, Xiaochuan, Esposito, Mario
• Application Number:
  US13/201,823
• Publication Number:
  US 20140223381A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

An invisible control may be implemented in a client device or in an application of the client device. A user may activate the invisible control by applying a gesture on a predetermined region of the client device or the application. In response to receiving the user gesture, a predetermined action associated with the invisible control may be activated. The predetermined action may be applied to the application or some or all of the content associated with the application. An Application Programming Interface may further be provided to allow the user, an application vendor or a content provider to customize the invisible control or operating modes associated with activation of the invisible control.

Claims

1. One or more computer-readable media configured with computer-executable instructions that, when executed by one or more processors, configure the one or more processors to perform acts comprising:

displaying content on a display of a computing device;

detecting a gesture at a border of the display of the computing device;

in response to detecting the gesture at the border of the display, changing from a current mode of operation of the computing device to a second mode of operation different from the current mode of operation, the second mode of operation being usable to perform a search;

detecting, on the display of the computing device, a second gesture from the user with regard to the content displayed on the display of the computing device, the second gesture identifying subject matter to be searched; and

automatically causing a search to be performed based at least in part on the identified subject matter in response to completion of the second gesture.

2. The one or more computer-readable media of claim 1, wherein the content on the display of the computing device includes an object, the acts further comprising:

enabling interaction with the object in the current mode of operation; and

disabling at least some interaction with the object in the second mode of operation.

3. The one or more computer-readable media of claim 1, wherein detecting the gesture comprises detecting a user input in proximity to an invisible button defined around at least a portion of the border of the display of the computing device.

4. A computing device comprising:

a display for displaying content;

one or more processors;

memory, communicatively coupled to the one or more processors, storing instructions that, when executed by the one or more processors, configure the one or more processors to perform acts comprising;

providing an invisible control disposed around at least a portion of a border of the display of the computing device;

detecting a gesture activating the invisible control;

in response to activation of the invisible control, changing a current operating mode of the computing device to a new operating mode.

5. The computing device as recited in claim 4, further comprising determining a location of the border of the display at which the gesture is detected, wherein the new operating mode to which the current operating mode is changed, is based on the location of the border of the display at which the gesture is detected.

6. The computing device as recited in claim 5, wherein determining the location of the border of the display comprises determining a side of the border of the display at which the gesture is detected, and the new operating mode is chosen based at least in part on the determined side of the border of the display.

7. The computing device as recited in claim 4, further comprising, after changing to the new operating mode:

receiving a second gesture from the user with regard to content displayed on the display of the computing device, the second gesture identifying subject matter to be searched; and

automatically causing a search to be performed based at least in part on the identified subject matter in response to completion of the second gesture.

8. The computing device as recited in claim 4, further comprising, after changing to the new operating mode:

receiving a plurality of selection gestures to select a plurality of disjoint objects displayed in the display; and

performing an operation based on the plurality of disjoint objects.

9. The computing device as recited in claim 8, wherein the plurality of disjoint objects comprise a region of text, an image, audio and/or video.

10. The computing device as recited in claim 4, wherein the current operating mode is based on an application being accessed at the time the invisible control is activated.

11. The computing device as recited in claim 10, wherein the new operating mode comprises a search mode.

12. The computing device as recited in claim 4, further comprising displaying a search box in response to changing to the second operating mode.

13. The computing device as recited in claim 4, further comprising:

interpreting the gesture; and

selecting the new operating mode from among a plurality of predetermined operating modes based on the interpretation of the gesture.

14. A method comprising:

under control of a computing device configured with executable instructions;

providing an invisible control disposed around at least a portion of a display of the computing device;

detecting a gesture at the portion of the display of the computing device, the gesture activating the invisible control; and

in response to activation of the invisible control, disabling an object displayed on the display of the computing device from moving or resizing.

15. The method of claim 14, further comprising disabling one or more hyperlinks, radio buttons, and/or interactive fields of the object displayed on the display of the computing device in response to activation of the invisible control.

16. The method as recited in claim 14, further comprising, in response to activation of the invisible control, displaying one or more predetermined actions that are applicable to the object or data associated with the object.

17. The method as recited in claim 16, further comprising:

receiving a selection of an action from among the one or more predetermined actions; and

applying the selected action to the object or data associated with the object.

18. The method as recited in claim 14, further comprising:

interpreting the gesture; and

selecting the new operating mode from among a plurality of predetermined operating modes based on the interpretation of the gesture.

19. The method as recited in claim 14, further comprising, in response to activation of the invisible control, enabling a predetermined action applicable to the object or data associated with the object based on a location of the portion of the display at which the gesture is received.

20. The method as recited in claim 14, further comprising, in response to activation of the invisible control, enabling a predetermined action applicable to the object or data associated with the object, the predetermined action being predefined by a developer of the object or a provider of data associated with the object.

21. The method as recited in claim 20, wherein the object comprises a web browser application and the provider of data comprises a website serving content of a web page that is currently displayed in the web browser application.

22. The method as recited in claim 14, further comprising indicating activation of the invisible button to the user by:

displaying a visible indicator along the border of the display;

illuminating at least a portion of the border;

changing a color of an icon on the display;

illuminating an icon on the display;

changing a color of a frame associated with the object;

illuminating a frame associated with the object; and

/or

playing a predetermined audio signal.

23. One or more computer-readable media configured with computer-executable instructions that, when executed by one or more processors, configure the one or more processors to perform acts comprising:

displaying content on a display of a computing device;

receiving input activating a control of the computing device; and

in response to receiving the input;

changing from a current mode of operation of the computing device to a second mode of operation different from the current mode of operation; and

disabling an object displayed on the display of the computing device from moving or resizing.

24. The one or more computer-readable media of claim 23, wherein the input comprises:

a selection gesture of an invisible soft button control on the display of the computing device;

a selection gesture of a visible soft button control on the display of the computing device;

a selection gesture of a transparent soft button control on the display of the computing device;

a selection gesture of a translucent soft button control on the display of the computing device;

a selection gesture of a physical button of the computing device;

a selection gesture of a capacitive or touch sensitive interface of the computing device; and

/or

a voice control input to activate the control.

25. The one or more computer-readable media of claim 23, the acts further comprising disabling one or more hyperlinks, radio buttons, and/or interactive fields of the object displayed on the display of the computing device in response to activation of the control.

26. The one or more computer-readable media of claim 23, the second mode of operation being usable to perform a search, and the acts further comprising:

receiving a second input from the user with regard to the content displayed on the display of the computing device, the second input identifying subject matter to be searched; and

automatically causing a search to be performed based at least in part on the identified subject matter in response to completion of the second input.

27. The one or more computer-readable media of claim 23, the second input comprising a gesture, a voice input, or a text input.