Radar-based gesture-recognition from a surface radar field on which an interaction is sensed

• US 10,509,478 B2
• Filed: 03/09/2018
• Issued: 12/17/2019
• Est. Priority Date: 06/03/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Poupyrev, Ivan, Aiello, Gaetano Roberto
• Primary Examiner(s): Ritchie, Darlene M
• Application Number:
  US15/917,238
• Publication Number:
  US 20180196527A1
• Time in Patent Office: 648 Days
• CPC Class Codes: G01S 13/88 Radar or analogous systems specially adapted for specific applications electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00
• CPC Class Codes: G01S 13/89 for mapping or imaging
• CPC Class Codes: G01S 7/411 Identification of targets based on measurements of radar reflectivity G01S7/415 takes precedence
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

This document describes techniques and devices for radar-based gesture-recognition through a wearable device. The techniques enable an easy-to-use input interface through this wearable radar device, in contrast to small or difficult-to-use input interfaces common to wearable computing devices. Further, these techniques are not limited to interfacing with wearable computing devices, but may aid users in controlling various non-wearable devices, such as to control volume on a stereo, pause a movie playing on a television, or select a webpage on a desktop computer.

Claims

1. A system comprising:

a radar-based gesture-recognition system configured to sense gestures, the radar-based gesture-recognition system comprising;

(1) a microwave radio element configured to emit microwave radiation capable of substantially penetrating clothing and not substantially penetrating human tissue, and

(2) an antenna element or signal processor configured to differentiate gesture interactions caused by clothing from gesture interactions caused by human tissue;

one or more computer processors; and

one or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, perform operations comprising;

causing the radar-based gesture-recognition system to provide, using the microwave radio element, a localized radar field adjacent the system, the localized radar field corresponding to a surface radar field on which an interaction is sensed, the surface radar field conforming to a surface of an object and being divided into selectable control regions;

causing the radar-based gesture-recognition system to sense the interaction on the surface radar field, the interaction interrupting one or more of the selectable control regions of the surface radar field at or near the surface of the object;

determining a two-dimensional gesture or a three-dimensional gesture based on the sensed interaction on the surface radar field; and

outputting data corresponding to the determined gesture.

2. The system of claim 1, wherein the microwave radio element is configured to emit the microwave radiation in a 3 GHz to 300 GHz range and the antenna element is configured to sense the interaction on the surface radar field to a resolution of approximately two to 25 millimeters, the resolution of the locations based on the 3 GHz to 300 GHz range of the emitted microwave radiation.

3. The system of claim 1, wherein the surface of the object to which the surface radar field conforms is at least partially curved.

4. The system of claim 1, wherein the surface of the object to which the surface radar field conforms is planar.

5. The system of claim 1, wherein the surface radar field conforms to a human hand adjacent to the radar-based gesture-recognition system.

6. The system of claim 1, wherein the surface radar field conforms to a shirt-sleeve collar adjacent to the radar-based gesture-recognition system.

7. The system of claim 1, wherein the microwave radio element is configured to emit continuously modulated radiation, ultra-wideband radiation, or sub-millimeter-frequency radiation.

8. The system of claim 1, wherein the microwave radio element is configured to form emitted radiation in beams, the beams enabling the antenna element and the signal processor to determine which of the beams are interrupted.

9. The system of claim 1, wherein outputting data corresponding to the determined gesture comprises outputting the data to a remote device, and wherein outputting the data to the remote device causes the remote device to control, based on the data, a user interface presented on a display of the remote device.

10. The system of claim 1, further comprising a remote device with a display and wherein the operations further comprise causing the display to present a visual approximation of a location corresponding to the sensed interaction.

11. The system of claim 10, wherein the display of the remote device presents an interface showing the one or more selectable control regions of the surface radar field and wherein the visual approximation of the location corresponding to the sensed interaction indicates selection of one of the selectable control regions responsive to sensing the interaction on the surface radar field.

12. A method implemented by a radar-based gesture recognition system comprising:

causing a microwave radio element of the radar-based gesture recognition system to provide a localized radar field by emitting microwave radiation capable of substantially penetrating clothing and not substantially penetrating human tissue, the localized radar field corresponding to a surface radar field on which an interaction is sensed, the surface radar field conforming to a surface of an object and being divided into one or more selectable control regions;

causing an antenna element or signal processor of the radar-based gesture-recognition system to sense the interaction on the surface radar field by differentiating between gesture interactions caused by clothing and gesture interactions caused by human tissue, the interaction interrupting one or more of the one or more selectable control regions of the surface radar field at or near the surface of the object;

determining a two-dimensional gesture or a three-dimensional gesture based on the sensed interaction on the surface radar field;

outputting data corresponding to the determined gesture.

13. The method of claim 12, wherein emitting the microwave radiation comprises emitting the microwave radiation in a 3 GHz to 300 GHz range;

and

differentiating between gesture interactions caused by clothing and gesture interactions caused by human tissue comprises differentiatinq between the gesture interactions caused by clothing and the gesture interactions caused by human tissue to a resolution of approximately two to 25 millimeters, the resolution based on the 3 GHz to 300 GHz range of the emitted microwave radiation.

14. The method of claim 12, wherein the surface radar field conforms to a human hand adjacent to the radar-based gesture-recognition system or a shirt-sleeve collar adjacent to the radar-based gesture-recognition system.

15. An electronic apparatus comprising:

a radar-based gesture-recognition system configured to sense gestures, the radar-based gesture-recognition system comprising;

(1) a microwave radio element configured to emit microwave radiation capable of substantially penetrating clothing and not substantially penetrating human tissue, and

(2) an antenna element or signal processor configured to differentiate gesture interactions caused by clothing from gesture interactions caused by human tissue;

one or more computer processors; and

one or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, perform operations comprising;

causing the radar-based gesture-recognition system to use the microwave radio element to provide a localized radar field adjacent the system, the localized radar field corresponding to a surface radar field on which an interaction is sensed, the surface radar field conforming to a surface of an object and being divided into selectable control regions;

causing the radar-based gesture-recognition system to sense the interaction on the surface radar field, the interaction interrupting one or more of the selectable control regions of the surface radar field at or near the surface of the object;

determining a two-dimensional gesture or a three-dimensional gesture based on the sensed interaction on the surface radar field;

outputting data corresponding to the determined gesture.

16. The electronic apparatus of claim 15, wherein the microwave radio element is configured to emit the microwave radiation in a 3 GHz to 300 GHz range and the antenna element is configured to sense the interaction on the surface radar field to a resolution of approximately two to 25 millimeters, the resolution of the locations based on the 3 GHz to 300 GHz range of the emitted microwave radiation.

17. The electronic apparatus of claim 15, further comprising a display having an interface showing selectable control regions of the surface radar field, and wherein the operations further comprise causing the display to present a visual approximation of a location corresponding to the sensed interaction, the visual approximation indicating selection of one of the selectable control regions responsive to sensing the interaction on the surface radar field.