SKELETAL JOINT RECOGNITION AND TRACKING SYSTEM
First Claim
Patent Images
1. A method of gesture recognition, comprising:
- a) segmenting a field of view of a scene into a plurality of zones;
b) defining one or more recognizable gestures for a specified zone of the plurality of zones;
c) receiving position information from a user in the scene, the user having a first body part and second body part;
d) recognizing a gesture from the first body part where the first body part has performed a recognizable gesture in the specified zone;
e) ignoring a gesture performed by the second body part where the second body part has not performed a recognizable gesture in the specified zone; and
f) performing an action associated with the gesture from the first body part recognized in said step d).
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method are disclosed for recognizing and tracking a user'"'"'s skeletal joints with a NUI system and further, for recognizing and tracking only some skeletal joints, such as for example a user'"'"'s upper body. The system may include a limb identification engine which may use various methods to evaluate, identify and track positions of body parts of one or more users in a scene. In examples, further processing efficiency may be achieved by segmenting the field of view in smaller zones, and focusing on one zone at a time. Moreover, each zone may have its own set of predefined gestures which are recognized.
-
Citations
20 Claims
-
1. A method of gesture recognition, comprising:
-
a) segmenting a field of view of a scene into a plurality of zones; b) defining one or more recognizable gestures for a specified zone of the plurality of zones; c) receiving position information from a user in the scene, the user having a first body part and second body part; d) recognizing a gesture from the first body part where the first body part has performed a recognizable gesture in the specified zone; e) ignoring a gesture performed by the second body part where the second body part has not performed a recognizable gesture in the specified zone; and f) performing an action associated with the gesture from the first body part recognized in said step d). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method of recognizing and tracking body parts of a target, comprising:
-
a) obtaining body part proposals from a stateless body part proposal system receiving position information from a scene, wherein the stateless body part proposal system comprises body part locations without reference to prior frames of the scene; b) obtaining body part proposals from a stateful body part proposal system, wherein the stateful body part proposal system comprises body part locations with reference to prior frames of the scene; c) reconciling the candidate body parts into whole or partial targets by a resolution system; d) segmenting a field of view of the scene into at least one zone smaller than the field of view of the scene; and e) determining whether a body part reconciled into a whole or partial target in said step c) has performed a recognized gesture in the at least one zone. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer-readable storage medium capable of programming a processor to perform a method of recognizing and tracking body parts of a user having at least limited use of at least one immobilized body part, the method comprising:
-
a) receiving an indication from the user of the identity of the at least one immobilized body part; b) identifying a first group of joints of the user, the joints not included within the at least one immobilized body part; c) identifying positions of joints in the first group of joints; and d) performing an action based on positions of the joints identified in said step c). - View Dependent Claims (18, 19, 20)
-
Specification