Systems and Methods of Gesture-Based Control

• US 20170329412A1
• Filed: 05/16/2017
• Published: 11/16/2017
• Est. Priority Date: 05/16/2016
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Schwesig, Carsten, Poupyrev, Ivan, Schmidt, Constantin, Wettach, Reto
• Application Number:
  US15/596,702
• Publication Number:
  US 20170329412A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 2200/1632 Pen holder integrated in the computer
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems and methods of providing gesture-based control are provided. For instance, signals indicative of a presence of a user within a first interaction zone proximate a user computing device can be received. A first feedback indication can be provided based at least in part on the signals indicative of the presence of the user in the first interaction zone. Signals indicative of a presence of the user in a second interaction zone proximate the user computing device can be received. A second feedback indication can be provided based at least in part on the signals indicative of the presence of the user in the second interaction zone. A control gesture performed by the user while in the second interaction zone can be determined. A third feedback indication can be provided based at least in part on the determined control gesture.

Claims

1. A computer-implemented method of providing gesture-based control, the method comprising:

receiving, by a user computing device, one or more signals indicative of a presence of a user within a first interaction zone proximate the user computing device;

providing, by the user computing device, a first feedback indication based at least in part on the one or more signals indicative of a presence of the user within the first interaction zone;

receiving, by the user computing device, one or more signals indicative of a presence of the user within a second interaction zone proximate the user computing device;

providing, by the user computing device, a second feedback indication based at least in part on the one or more signals indicative of the presence of the user within the second interaction zone;

determining, by the user computing device, a control gesture performed by the user while in the second interaction zone; and

providing, by the user computing device, a third feedback indication based at least in part on the determined control gesture.

2. The computer-implemented method of claim 1, further comprising:

identifying, by the user computing device, one or more actions to be performed based at least in part on the determined control gesture; and

performing, by the user computing device, the one or more actions.

3. The computer-implemented method of claim 1, wherein the second interaction zone comprises a predefined region relative to the user computing device wherein the user computing device can determine a control gesture performed by the user.

4. The computer-implemented method of claim 1, wherein the user computing device comprises a speaker device.

5. The computer-implemented method of claim 1, wherein the first feedback indication comprises a visual feedback indication or an audio feedback indication.

6. The computer-implemented method of claim 5, wherein providing, by the user computing device, a first feedback indication comprises controlling operation of one or more lighting elements associated with the user computing device to provide the first feedback indication.

7. The computer-implemented method of claim 1, wherein the third feedback indication comprises an audio indication.

8. The computer-implemented method of claim 7, wherein providing, by the user computing device, a third feedback indication comprises controlling operation of an audio playback device to provide the third feedback indication.

9. The computer-implemented method of claim 7, wherein the third feedback indication further comprises a visual feedback indication.

10. The computer-implemented method of claim 1, wherein the first feedback indication, the second feedback indication, and the third feedback indication are provided independent of a display device associated with the user computing device.

11. The computer-implemented method of claim 1, further comprising:

receiving, by the user computing device, one or more signals indicative of a presence of the user within a third interaction zone; and

determining, by the user computing device, a motion profile associated with the user based at least in part on the one or more signals indicative of the user in the presence of the user in the third interaction zone.

12. The computer-implemented method of claim 11, wherein the third interaction zone is a far interaction zone, the first interaction zone is an intermediate interaction zone, and the second interaction zone is a near interaction zone.

13. The computer-implemented method of claim 1, further comprising determining, by the user computing device, a motion profile associated with the user while the user is present in the second interaction zone;

and

wherein determining, by the user computing device, a control gesture performed by the user comprises comparing, by the user computing device, a motion of the user to a predetermined control gesture based at least in part on the determined motion profile.

14. The computer-implemented method of claim 13, wherein determining, by the user computing device, the motion profile comprises determining velocity data and location data associated with the user over one or more time periods.

15. The computer-implemented method of claim 14, wherein determining, by the user computing device, the motion profile comprises determining one or more changes in velocity or one or more changes in position of the user.

16. The computer-implemented method of claim 1, wherein determining, by the user computing device, a control gesture performed by the user while in the second interaction zone comprises determining a control gesture performed by a control article associated with the user while in the second interaction zone.

17. A computing system, comprising:

one or more processors; and

one or more memory devices, the one or more memory devices storing computer-readable instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising;

receiving one or more signals indicative of a presence of a user within a first interaction zone proximate the user computing device;

providing a first feedback indication based at least in part on the one or more signals indicative of a presence of the user within the first interaction zone;

receiving one or more signals indicative of a presence of the user within a second interaction zone proximate the user computing device;

providing a second feedback indication based at least in part on the one or more signals indicative of the presence of the user within the second interaction zone;

determining a control gesture performed by the user while in the second interaction zone; and

providing a third feedback indication based at least in part on the determined control gesture.

18. The computing system of claim 17, the operations further comprising:

identifying one or more actions to be performed based at least in part on the determined control gesture; and

performing the one or more actions.

19. One or more tangible, non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:

receiving one or more signals indicative of a presence of a user within a first interaction zone proximate the user computing device;

providing a first feedback indication based at least in part on the one or more signals indicative of a presence of the user within the first interaction zone;

receiving one or more signals indicative of a presence of the user within a second interaction zone proximate the user computing device;

providing a second feedback indication based at least in part on the one or more signals indicative of the presence of the user within the second interaction zone;

determining a control gesture performed by the user while in the second interaction zone; and

providing a third feedback indication based at least in part on the determined control gesture.

20. The one or more tangible, non-transitory computer-readable media of claim 19, the operations further comprising:

receiving one or more signals indicative of a presence of the user within a third interaction zone; and

determining a motion profile associated with the user based at least in part on the one or more signals indicative of the user in the presence of the user in the third interaction zone.