Method and Apparatus for Identifying a Gesture Based Upon Fusion of Multiple Sensor Signals
2 Assignments
0 Petitions
Accused Products
Abstract
A method, apparatus and computer program product are provided to permit improve gesture recognition based on fusion of different types of sensor signals. In the context of a method, a series of image frames and a sequence of radar signals are received. The method determines an evaluation score for the series of image frames that is indicative of a gesture. This determination of the evaluation score may be based on the motion blocks in an image area and the shift of the motion blocks between image frames. The method also determines an evaluation score for the sequence of radar signals that is indicative of the gesture. This determination of the evaluation score may be based upon the sign distribution in the sequence and the intensity distribution in the sequence. The method weighs each of the evaluation scores and fuses the evaluation scores, following the weighting, to identify the gesture.
-
Citations
41 Claims
-
1-22. -22. (canceled)
-
23. A method comprising:
-
receiving a series of image frames; receiving a sequence of radar signals; determining an evaluation score for the series of image frames that is indicative of a gesture, wherein determining the evaluation score comprises determining the evaluation score based upon motion blocks in an image area and a shift of motion blocks between image frames; determining an evaluation score for the sequence of radar signals that is indicative of the gesture, wherein determining the evaluation score comprises determining the evaluation score based upon sign distribution in the sequence and intensity distribution in the sequence; weighting each of the evaluation scores; and fusing the evaluation scores, following the weighting, to identify the gesture. - View Dependent Claims (24, 25, 26, 27, 28, 29)
-
-
30. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus to:
-
receive a series of image frames; receive a sequence of radar signals; determine an evaluation score for the series of image frames that is indicative of a gesture by determining the evaluation score based upon motion blocks in an image area and a shift of motion blocks between image frames; determine an evaluation score for the sequence of radar signals that is indicative of the gesture by determining the evaluation score based upon sign distribution in the sequence and intensity distribution in the sequence; weight each of the evaluation scores; and fuse the evaluation scores, following the weighting, to identify the gesture. - View Dependent Claims (31, 32, 33, 34, 35, 36, 37)
-
-
38. A computer program product comprising at least one computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program instructions configured to:
-
receive a series of image frames; receive a sequence of radar signals; determine an evaluation score for the series of image frames that is indicative of a gesture by determining the evaluation score based upon motion blocks in an image area and a shift of motion blocks between image frames; determine an evaluation score for the sequence of radar signals that is indicative of the gesture by determining the evaluation score based upon sign distribution in the sequence and intensity distribution in the sequence; weight each of the evaluation scores; and fuse the evaluation scores, following the weighting, to identify the gesture. - View Dependent Claims (39, 40, 41)
-
Specification