Radar-Based Gesture-Recognition through a Wearable Device

• US 20180196527A1
• Filed: 03/09/2018
• Published: 07/12/2018
• Est. Priority Date: 06/03/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Poupyrev, Ivan, Aiello, Gaetano Roberto
• Granted Patent: US 10,509,478 B2
• Time in Patent Office: Days
• CPC Class Codes: G01S 13/88 Radar or analogous systems specially adapted for specific applications electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00
• CPC Class Codes: G01S 13/89 for mapping or imaging
• CPC Class Codes: G01S 7/411 Identification of targets based on measurements of radar reflectivity G01S7/415 takes precedence
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

This document describes techniques and devices for radar-based gesture-recognition through a wearable device. The techniques enable an easy-to-use input interface through this wearable radar device, in contrast to small or difficult-to-use input interfaces common to wearable computing devices. Further, these techniques are not limited to interfacing with wearable computing devices, but may aid users in controlling various non-wearable devices, such as to control volume on a stereo, pause a movie playing on a television, or select a webpage on a desktop computer.

Claims

1. A system comprising:

a radar-based gesture-recognition system configured to sense gestures;

a microwave radio element;

one or more computer processors; and

one or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, perform operations comprising;

causing the microwave radio element to provide a localized radar field adjacent the system, the localized radar field corresponding to a surface radar field through which an interaction is sensed, the surface radar field conforming to a surface of an object and being divided into selectable control regions;

causing the radar-based gesture-recognition system to sense the interaction through the surface radar field, the interaction interrupting one or more of the selectable control regions of the surface radar field at or near the surface of the object;

determining a two-dimensional gesture or a three-dimensional gesture based on the sensed interaction through the surface radar field;

outputting data corresponding to the determined gesture.

2. The system of claim 1, wherein the microwave radio element is configured to emit microwave radiation in a 3 GHz to 300 GHz range and further comprising an antenna element configured to sense the interaction in the surface radar field to a resolution of approximately two to 25 millimeters, the resolution of the locations based on the 3 GHz to 300 GHz range of the emitted microwave radiation.

3. The system of claim 1, wherein the microwave radio element is configured to emit microwave radiation capable of substantially penetrating clothing and not substantially penetrating human tissue, and further comprising an antenna element or signal processor configured to differentiate between gesture interactions in the surface radar field caused by clothing from gesture interactions in the surface radar field caused by human tissue.

4. The system of claim 1, wherein the surface of the object to which the surface radar field conforms is at least partially curved.

5. The system of claim 1, wherein the surface of the object to which the surface radar field conforms is planar.

6. The system of claim 1, wherein the surface radar field conforms to a human hand adjacent to the radar-based gesture-recognition system.

7. The system of claim 1, wherein the surface radar field conforms to a shirt-sleeve collar adjacent to the radar-based gesture-recognition system.

8. The system of claim 1, wherein the microwave radio element is configured to emit continuously modulated radiation, ultra-wideband radiation, or sub-millimeter-frequency radiation.

9. The system of claim 1, wherein the microwave radio element is configured to form emitted radiation in beams, the beams enabling the antenna element and the signal processor to determine which of the beams are interrupted.

10. The system of claim 1, further comprising a remote device with a display and wherein the operations further comprise causing the display to present a visual approximation of a location corresponding to the sensed interaction.

11. The system of claim 10, wherein the display of the remote device presents an interface showing the one or more selectable control regions of the surface radar field and wherein the visual approximation of the location corresponding to the sensed interaction indicates selection of one of the selectable control regions responsive to sensing the interaction in the surface radar field.

12. A method implemented by a radar-based gesture recognition system comprising:

causing a microwave radio element of the radar-based gesture recognition system to provide a localized radar field, the localized radar field corresponding to a surface radar field through which an interaction is sensed, the surface radar field conforming to a surface of an object and being divided into one or more selectable control regions;

causing the radar-based gesture-recognition system to sense the interaction through the surface radar field, the interaction interrupting one or more of the one or more selectable control regions of the surface radar field at or near the surface of the object;

determining a two-dimensional gesture or a three-dimensional gesture based on the sensed interaction through the surface radar field;

outputting data corresponding to the determined gesture.

13. The method of claim 12, wherein the microwave radio element is configured to emit microwave radiation in a 3 GHz to 300 GHz range, and wherein the method further comprises:

sensing, by an antenna element of the radar-based gesture recognition system, the interaction in the surface radar field to a resolution of approximately two to 25 millimeters, the resolution based on the 3 GHz to 300 GHz range of the emitted microwave radiation.

14. The method of claim 12, wherein the microwave radio element is configured to emit microwave radiation capable of substantially penetrating clothing and not substantially penetrating human tissue, and further comprising an antenna element or signal processor configured to differentiate between gesture interactions in the surface radar field caused by clothing from gesture interactions in the surface radar field caused by human tissue.

15. The method of claim 12, wherein the surface of the object to which the surface radar field conforms is at least partially curved.

16. The method of claim 12, wherein the surface radar field conforms to a human hand adjacent to the radar-based gesture-recognition system or a shirt-sleeve collar adjacent to the radar-based gesture-recognition system.

17. An electronic apparatus comprising:

a radar-based gesture-recognition system configured to sense gestures;

a microwave radio element;

one or more computer processors; and

one or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, perform operations comprising;

causing the microwave radio element to provide a localized radar field adjacent the system, the localized radar field corresponding to a surface radar field through which an interaction is sensed, the surface radar field conforming to a surface of an object and being divided into selectable control regions;

causing the radar-based gesture-recognition system to sense the interaction through the surface radar field, the interaction interrupting one or more of the selectable control regions of the surface radar field at or near the surface of the object;

determining a two-dimensional gesture or a three-dimensional gesture based on the sensed interaction through the surface radar field;

outputting data corresponding to the determined gesture.

18. The electronic apparatus of claim 17, wherein the microwave radio element is configured to emit microwave radiation in a 3 GHz to 300 GHz range and further comprising an antenna element configured to sense the interaction in the surface radar field to a resolution of approximately two to 25 millimeters, the resolution of the locations based on the 3 GHz to 300 GHz range of the emitted microwave radiation.

19. The electronic apparatus of claim 17, wherein the microwave radio element is configured to emit microwave radiation capable of substantially penetrating clothing and not substantially penetrating human tissue, and further comprising an antenna element or signal processor configured to differentiate between gesture interactions in the surface radar field caused by clothing from gesture interactions in the surface radar field caused by human tissue.

20. The electronic apparatus of claim 17, further comprising a display having an interface showing selectable control regions of the surface radar field and wherein the operations further comprise causing the display to present a visual approximation of a location corresponding to the sensed interaction, the visual approximation indicating selection of one of the selectable control regions responsive to sensing the interaction in the surface radar field.