Gesture component with gesture library
First Claim
1. A method of controlling operation of a computing device based on gesture detection, the method comprising:
- detecting, by a three-dimensional object detection module of a gesture component of the computing device, an input based on received radar signals that have been reflected off of an object;
transforming, by the gesture component, raw data of the radar signals into one or more different representations that represent shape information about the object;
extracting, by the gesture component, three-dimensional feature information about the object from the transformed raw data of the radar signals;
recognizing, by the gesture component, a three-dimensional gesture performed by the object, the recognizing based on a comparison of the extracted feature information about the object from the radar signals with a library of gestures maintained by the gesture component;
recognizing, by the gesture component, an operation that corresponds to the three-dimensional gesture using the library of gestures; and
exposing, by the gesture component, an indication of the operation by the gesture component via an application programming interface for receipt by at least one application executed by the computing device to cause the at least one application to control performance of the operation.
2 Assignments
0 Petitions
Accused Products
Abstract
A gesture component with a gesture library is described. The gesture component is configured to expose operations for execution by application of a computing device based on detected gestures. In one example, an input is detected using a three dimensional object detection system of a gesture component of the computing device. A gesture is recognized by the gesture component based on the detected input through comparison with a library of gestures maintained by the gesture component. An operation is then recognized that corresponds to the gesture by the gesture component using the library of gestures. The operation is exposed by the gesture component via an application programming interface to at least one application executed by the computing device to control performance of the operation by the at least one application.
587 Citations
20 Claims
-
1. A method of controlling operation of a computing device based on gesture detection, the method comprising:
-
detecting, by a three-dimensional object detection module of a gesture component of the computing device, an input based on received radar signals that have been reflected off of an object; transforming, by the gesture component, raw data of the radar signals into one or more different representations that represent shape information about the object; extracting, by the gesture component, three-dimensional feature information about the object from the transformed raw data of the radar signals; recognizing, by the gesture component, a three-dimensional gesture performed by the object, the recognizing based on a comparison of the extracted feature information about the object from the radar signals with a library of gestures maintained by the gesture component; recognizing, by the gesture component, an operation that corresponds to the three-dimensional gesture using the library of gestures; and exposing, by the gesture component, an indication of the operation by the gesture component via an application programming interface for receipt by at least one application executed by the computing device to cause the at least one application to control performance of the operation. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computing device comprising:
-
a processing system; an application maintained in computer-readable storage media and executable by the processing system to perform a plurality of operations; and a gesture component implemented at least partially in hardware, the gesture component including; a three-dimensional object detection module configured to detect an input involving orientation or movement of an object in three-dimensional space, the detection based on received radar signals that have been reflected by the object; and a gesture module configured to; maintain a library of gestures; transform raw data corresponding to the radar signals into one or more different representations that represent shape information about the object; extract three-dimensional feature information about the object from the transformed raw data of the radar signals; compare the three-dimensional feature information about the object from the transformed raw data of the radar signals with the library of gestures; recognize a gesture performed by the object based on the comparison; and expose an indication of at least one said operation that corresponds to the recognized gesture via an application programming interface for receipt by at least one application to cause the at least one application to control performance of the at least one said operation. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A method of controlling operation of a computing device based on gesture detection, the method comprising:
-
transmitting a plurality of outgoing radio frequency radar signals by a gesture component; capturing incoming radio frequency radar signals generated by the plurality of outgoing radio frequency radar signals as reflecting off a user; generating an input by the gesture component from the captured incoming radio frequency radar signals, the input generated by; transforming raw data corresponding to the incoming radio frequency radar signals into one or more different representations that represent shape information about one or more portions of the user; extracting three-dimensional feature information about the one or more portions of the user; comparing the three-dimensional feature information about the one or more portions of the user with a library of gestures maintained by the gesture component; recognizing a gesture performed by the one or more portions of the user based on the comparison; and exposing an indication of at least one operation that corresponds to the recognized gesture by the gesture component via an application programming interface for receipt by at least one application executed by the computing device to cause the at least one application to control performance of the at least one operation. - View Dependent Claims (18, 19, 20)
-
Specification