GESTURE RECOGNIZER SYSTEM ARCHITECTURE
First Claim
1. A method for providing gesture input to a plurality of applications, comprising:
- receiving data indicative of a user motion or pose, the data being captured by a camera;
determining a result of processing the data, the result comprising a three-dimensional model of at least part of the user;
sending the result to a first gesture filter of a first application of the plurality of applications, the first application being configured to process the result with the first gesture filter to determine a first output indicative of whether the result is indicative of the user performing a gesture represented by the first gesture filter; and
sending the result to a second gesture filter of a second application of the plurality of applications, the second application being configured to process the result with the second gesture filter to determine a second output indicative of whether the result is indicative of the user performing a gesture represented by the second gesture filter.
3 Assignments
0 Petitions
Accused Products
Abstract
Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.
21 Citations
20 Claims
-
1. A method for providing gesture input to a plurality of applications, comprising:
-
receiving data indicative of a user motion or pose, the data being captured by a camera; determining a result of processing the data, the result comprising a three-dimensional model of at least part of the user; sending the result to a first gesture filter of a first application of the plurality of applications, the first application being configured to process the result with the first gesture filter to determine a first output indicative of whether the result is indicative of the user performing a gesture represented by the first gesture filter; and sending the result to a second gesture filter of a second application of the plurality of applications, the second application being configured to process the result with the second gesture filter to determine a second output indicative of whether the result is indicative of the user performing a gesture represented by the second gesture filter. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system for providing gesture input to a plurality of applications, comprising:
-
a processor; and a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, when executed on the processor, cause the system to at least; receive data indicative of a user motion or pose, the data being captured by a camera; determine a result of processing the data, the result comprising a three-dimensional model of at least part of the user; send the result to a first gesture filter of a first application of the plurality of applications, the first application being configured to process the result with the first gesture filter to determine a first output indicative of whether the result is indicative of the user performing a gesture represented by the first gesture filter; and send the result to a second gesture filter of a second application of the plurality of applications, the second application being configured to process the result with the second gesture filter to determine a second output indicative of whether the result is indicative of the user performing a gesture represented by the second gesture filter. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. A computer-readable storage medium for providing gesture input to a plurality of applications bearing computer-readable instructions, that when executed on a computer, cause operations comprising:
-
receiving data indicative of a user motion or pose, the data being captured by a camera; determining a result of processing the data, the result comprising a three-dimensional model of at least part of the user; sending the result to a first gesture filter of a first application of the plurality of applications, the first application being configured to process the result with the first gesture filter to determine a first output indicative of whether the result is indicative of the user performing a gesture represented by the first gesture filter; and sending the result to a second gesture filter of a second application of the plurality of applications, the second application being configured to process the result with the second gesture filter to determine a second output indicative of whether the result is indicative of the user performing a gesture represented by the second gesture filter.
-
Specification