Gesture Component with Gesture Library
First Claim
1. A method of controlling operation of a computing device by radar-based gesture detection, the method comprising:
- receiving, by the computing device, raw data representing radar signals that have been reflected off an object;
transforming, by the computing device, the raw data of the radar signals into one or more different representations that represent information about the object;
extracting, by the computing device, three-dimensional feature information about the object from the transformed raw data of the radar signals;
recognizing, by the computing device, a three-dimensional gesture performed by the object, the recognizing based on a comparison of the extracted feature information about the object from the radar signals with a library of gestures maintained by the computing device;
recognizing, by the computing device, an operation that corresponds to the three-dimensional gesture using the library of gestures; and
exposing, by the computing device, an indication of the operation for receipt by at least one application executed by the computing device to cause the at least one application to control performance of the operation.
2 Assignments
0 Petitions
Accused Products
Abstract
A gesture component with a gesture library is described. The gesture component is configured to expose operations for execution by application of a computing device based on detected gestures. In one example, an input is detected using a three dimensional object detection system of a gesture component of the computing device. A gesture is recognized by the gesture component based on the detected input through comparison with a library of gestures maintained by the gesture component. An operation is then recognized that corresponds to the gesture by the gesture component using the library of gestures. The operation is exposed by the gesture component via an application programming interface to at least one application executed by the computing device to control performance of the operation by the at least one application.
39 Citations
20 Claims
-
1. A method of controlling operation of a computing device by radar-based gesture detection, the method comprising:
-
receiving, by the computing device, raw data representing radar signals that have been reflected off an object; transforming, by the computing device, the raw data of the radar signals into one or more different representations that represent information about the object; extracting, by the computing device, three-dimensional feature information about the object from the transformed raw data of the radar signals; recognizing, by the computing device, a three-dimensional gesture performed by the object, the recognizing based on a comparison of the extracted feature information about the object from the radar signals with a library of gestures maintained by the computing device; recognizing, by the computing device, an operation that corresponds to the three-dimensional gesture using the library of gestures; and exposing, by the computing device, an indication of the operation for receipt by at least one application executed by the computing device to cause the at least one application to control performance of the operation. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computing device comprising:
-
a processing system; an application maintained in computer-readable storage media and executable by the processing system to perform a plurality of operations; and a gesture component implemented at least partially in hardware, the gesture component configured to; receive raw data representing radar signals that have been reflected by an object in three-dimensional space; transform the raw data of the radar signals into a different representation that represents information about the object; extract three-dimensional feature information about the object from the transformed raw data of the radar signals; maintain a library of gestures corresponding to the operations; compare the three-dimensional feature information about the object from the transformed raw data of the radar signals with the library of gestures; recognize a gesture performed by the object and a corresponding operation based on the comparison; and expose an indication of the corresponding operation that corresponds to the recognized gesture for receipt by the application to cause the application to control performance of the corresponding operation. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A method performed by a computing device of exposing an operation for an application from radar-based gesture detection, the method comprising:
-
transmitting, by the computing device, a plurality of outgoing radio frequency radar signals; capturing, by the computing device, incoming radio frequency radar signals generated by the outgoing radio frequency radar signals reflecting off a user; exposing, by the computing device, the operation to the application based on the captured incoming radio frequency radar signals, the operation exposed by; transforming raw data corresponding to the captured incoming radio frequency radar signals into a different representation that represents information about a portion of the user; extracting three-dimensional feature information about the portion of the user; comparing the three-dimensional feature information about the portion of the user with a library of gestures maintained by the computing device; recognizing a gesture performed by the portion of the user and the operation based on the comparison, the operation corresponding to the recognized gesture; and exposing the operation that corresponds to the recognized gesture to the application such that the application can control performance of the operation. - View Dependent Claims (18, 19, 20)
-
Specification