GESTURE RECOGNITION METHOD AND APPARATUS

• US 20180239438A1
• Filed: 04/20/2018
• Published: 08/23/2018
• Est. Priority Date: 10/21/2015
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: XUE, Jiantao, LI, Anjian, SU, Bin
• Granted Patent: US 10,732,724 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/214 Generating training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06F 2218/00 Aspects of pattern recognition specially adapted for signal processing
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04L 5/0048 Allocation of pilot signals, i.e. of signals known to the receiver
• CPC Class Codes: H04W 72/0453 Resources in frequency domain, e.g. a carrier in FDMA

Abstract

The method is applied to a terminal device, the terminal device stores training sample data, and the training sample data includes a correlation spectrum characteristic vector of a reflected signal of a sounding reference signal (SRS) and a corresponding user gesture identifier. The method includes: transmitting, by the terminal device, a first sounding reference signal (SRS); receiving, by the terminal device, a multipath reflected signal that is of the first sounding reference signal (SRS) and that is reflected from a gesture-making object, and performing a related operation on the reflected signal and a signal template corresponding to the first sounding reference signal (SRS), to obtain a correlation spectrum characteristic vector of the reflected signal; and matching, by the terminal device, the correlation spectrum characteristic vector of the reflected signal against the training sample data, to recognize an input gesture.

Claims

1. A gesture recognition method, applied to a terminal device for transmitting a mobile communications network signal, wherein the terminal device stores training sample data, and the training sample data comprises a correlation spectrum characteristic vector of a reflected signal of a sounding reference signal (SRS) and a gesture identifier corresponding to the characteristic vector;

and

the method comprises;

transmitting, by the terminal device, a first SRS;

receiving, by the terminal device, a multipath first reflected signal that is of the first SRS and that is reflected from a gesture-making object, and performing a related operation on the first reflected signal and a signal template corresponding to the first SRS, to obtain a correlation spectrum characteristic vector of the first reflected signal; and

matching, by the terminal device, the correlation spectrum characteristic vector of the first reflected signal against the training sample data, to recognize a gesture input by the gesture-making object.

2. The method according to claim 1, wherein

the training sample data is pre-stored in the terminal device;

or

the training sample data is obtained from a network device by the terminal device.

3. The method according to claim 1, wherein the method further comprises:

transmitting, by the terminal device, a second SRS;

receiving, by the terminal device, a multipath second reflected signal that is of the second SRS and that is reflected from the gesture-making object, and performing a related operation on the second reflected signal and a signal template corresponding to the second SRS, to obtain a correlation spectrum characteristic vector of the second reflected signal; and

using, by the terminal device, the correlation spectrum characteristic vector of the second reflected signal and a gesture identifier corresponding to the characteristic vector as training sample data of the gesture input by the gesture-making object, and storing the training sample data in the terminal device.

4. The method according to claim 3, wherein

further using, by the terminal device, the correlation spectrum characteristic vector of the second reflected signal and a corresponding user gesture identifier as the training sample data, and sending the training sample data to the network device.

5. The method according to claim 1, wherein

the related operation comprises:

filtering out a reflected signal, wherein a distance between the reflected signal and the terminal device exceeds a specified distance when reflection occurs.

6. The method according to claim 1, wherein the method further comprises:

determining, by the terminal device according to an SRS set pre-stored in the terminal device, an SRS used for gesture recognition;

or

receiving, by the terminal device, information that is about an SRS set and that is sent by the network device; and

determining, by the terminal device according to the received information about the SRS set, an SRS used for gesture recognition.

7. The method according to claim 6, wherein

the SRS set comprises a parameter value section corresponding to at least one SRS, and the parameter value section comprises any one or more of the following:

a transmit interval, a transmit bandwidth, a transmit carrier frequency, or a transmit power of the SRS;

or

the SRS set comprises a parameter value corresponding to at least one SRS, and the parameter value belongs to a parameter value section.

8. The method according to claim 7, wherein

the parameter value section corresponding to the SRS comprises any one or more of the following:

the transmit interval is less than or equal to 10 milliseconds;

the transmit bandwidth is greater than or equal to 100 MHz;

the transmit carrier frequency is greater than or equal to 10 GHz;

or the transmit power is less than or equal to 0 dBm.

9. A terminal device, applied to a mobile communications system, wherein the terminal device comprises a storage, a transmitter, a receiver, and a processer, wherein

the storage is configured to store a database, wherein the database stores training sample data, and the training sample data comprises a correlation spectrum characteristic vector of a reflected signal of a sounding reference signal (SRS) and a gesture identifier corresponding to the characteristic vector;

the transmitter is configured to transmit a first SRS that is determined by the processer and that is used for gesture recognition;

the receiver is configured to receive a multipath reflected signal that is of the first SRS and that is reflected from a gesture-making object; and

the processer is configured to;

determine the first SRS used for gesture recognition, and perform a related operation on the reflected signal received by the receiver and a signal template corresponding to the first SRS, to obtain a correlation spectrum characteristic vector of the first reflected signal; and

match the correlation spectrum characteristic vector against the training sample data in the database, to recognize a gesture input by the gesture-making object.

10. The terminal device according to claim 9, wherein

the training sample data is pre-stored in the storage;

or

the training sample data is obtained from a network device by the terminal device by using the receiver, and is stored in the database of the storage.

11. The terminal device according to claim 9, wherein

the transmitter is further configured to transmit a second SRS that is determined by the processer and that is used for gesture recognition;

the receiver is further configured to receive a multipath second reflected signal that is of the second SRS and that is reflected from the gesture-making object; and

the processer is configured to;

determine the second SRS used for gesture recognition, and perform a related operation on the second reflected signal received by the receiver and a signal template corresponding to the second SRS, to obtain a correlation spectrum characteristic vector of the second reflected signals; and

use the correlation spectrum characteristic vector and a corresponding user gesture identifier as training sample data of the gesture input by the gesture-making object, and store the training sample data in the storage.

12. The terminal device according to claim 11, wherein

the transmitter further uses the correlation spectrum characteristic vector of the second reflected signal and a corresponding user gesture identifier as the training sample data, and sends the training sample data to the network device.

13. The terminal device according to claim 9, wherein

that the processer performs a related operation comprises:

filtering out a reflected signal, wherein a distance between the reflected signal and the terminal device exceeds a specified distance when reflection occurs.

14. The terminal device according to claim 9, wherein

the storage pre-stores an SRS set;

and

the processer determines, according to the SRS set, an SRS used for gesture recognition;

or

the receiver receives information that is about an SRS set and that is sent by the network device; and

the processer determines, according to the information that is about the SRS set and that is received by the receiver, an SRS used for gesture recognition.

15. The terminal device according to claim 14, wherein

the SRS set comprises a parameter value section corresponding to at least one SRS, and the parameter value section comprises any one or more of the following:

a transmit interval, a transmit bandwidth, a transmit carrier frequency, or a transmit power of the SRS;

or

the SRS set comprises a parameter value corresponding to at least one SRS, and the parameter value belongs to a parameter value section.

16. The terminal device according to claim 15, wherein

the parameter value section corresponding to the SRS comprises any one or more of the following:

the transmit interval is less than or equal to 10 milliseconds;

the transmit bandwidth is greater than or equal to 100 MHz;

the transmit carrier frequency is greater than or equal to 10 GHz;

or the transmit power is less than or equal to 0 dBm.

17. A network device, applied to a mobile communications system, wherein the network device comprises a transmitter and a processer, wherein

the processer generates an SRS set used for gesture recognition, and transmits information about the SRS set to the transmitter;

and

the transmitter is configured to transmit the information about the SRS set generated by the processer to a terminal device;

wherein

the SRS set comprises a parameter value section corresponding to at least one SRS, and the parameter value section comprises any one or more of the following;

a transmit interval is less than or equal to 10 milliseconds;

a transmit bandwidth is greater than or equal to 100 MHz;

a transmit carrier frequency is greater than or equal to 10 GHz;

or a transmit power is less than or equal to 0 dBm;

or

the SRS set comprises a parameter value corresponding to at least one SRS, and the parameter value belongs to a parameter value section.