Isolate extraneous motions

• US 9,519,828 B2
• Filed: 12/22/2014
• Issued: 12/13/2016
• Est. Priority Date: 05/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Snook, Gregory Nelson, Markovic, Relja, Latta, Stephen Gilchrist, Geisner, Kevin
• Primary Examiner(s): Akhavannik, Hadi
• Application Number:
  US14/579,207
• Publication Number:
  US 20150110354A1
• Time in Patent Office: 722 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: G06F 2203/012 Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A system may receive image data and capture motion with respect to a target in a physical space and recognize a gesture from the captured motion. It may be desirable to isolate aspects of captured motion to differentiate random and extraneous motions. For example, a gesture may comprise motion of a user'"'"'s right arm, and it may be desirable to isolate the motion of the user'"'"'s right arm and exclude an interpretation of any other motion. Thus, the isolated aspect may be the focus of the received data for gesture recognition. Alternately, the isolated aspects may be an aspect of the captured motion that is removed from consideration when identifying a gesture from the captured motion. For example, gesture filters may be modified to correspond to the user'"'"'s natural lean to eliminate the effect the lean has on the registry of a motion with a gesture filter.

Claims

1. A method for applying a filter representing an intended gesture comprising:

adjusting base information representing the intended gesture

receiving data captured by a camera, wherein the data is representative of a user'"'"'s motion in a physical space;

predicting the intended gesture from the data;

selecting a first portion of the data that is applicable to the intended gesture; and

applying the filter representing the intended gesture to the first portion of the data and determining an output from base information representing the intended gesture, wherein the filter comprises the base information representing the intended gesture, and wherein the base information is adjusted to a recurring feature in a history of data representative of the user'"'"'s motion.

2. The method of claim 1, further comprising applying a plurality of filters to the data, wherein the intended gesture is a gesture corresponding to at least one of the plurality of filters having base information that corresponds to the data.

3. The method of claim 2, further comprising generating a model of the user from the data, wherein the model maps to the first portion of the data that is applicable to the intended gesture and comprises a pre-authored animation that represents a second portion of the data that is not applicable to the intended gesture.

4. The method of claim 1, wherein selecting the first portion of the data that is applicable to the intended gesture comprises selecting a portion of the data that corresponds to a volume of interest.

5. The method of claim 1, wherein a second portion of the data that is not applicable to the intended gesture corresponds to an extraneous motion in the physical space.

6. The method of claim 5, wherein the extraneous motion is a motion of at least one of a second user, an extraneous body part, or an object in the physical space.

7. The method of claim 5, wherein the extraneous motion is a motion in a volume of interest.

8. The method of claim 5, wherein the output is indicative of a failure of the data to register with the filter representing the intended gesture.

9. The method of claim 5, wherein the output is a recognition of the intended gesture from the first portion of the data.

10. The method of claim 9, further comprising aborting gesture recognition of the intended gesture when the first portion of the data deviates from the base information in the filter.

11. A system for applying a filter representing an intended gesture comprising:

memory having stored therein computer-executable instructions;

one or more processors operable to execute the computer-executable instructions, wherein the computer-executable instructions comprise instructions for;

receiving data captured by a camera, wherein the data is representative of a user'"'"'s motion in a physical space;

predicting the intended gesture from the data;

selecting a first portion of the data that is applicable to the intended gesture; and

applying the filter representing the intended gesture to the first portion of the data and determining an output from base information representing the intended gesture, wherein the filter comprises the base information representing the intended gesture, and wherein the base information is adjusted to a recurring feature in a history of data representative of the user'"'"'s motion.

12. The system of claim 11, wherein the computer-executable instructions further comprise instructions for applying a plurality of filters to the data, wherein the intended gesture is a gesture corresponding to at least one of the plurality of filters having base information that corresponds to the data.

13. The system of claim 12, wherein the computer-executable instructions further comprise instructions for generating a model of the user from the data, wherein the model maps to the first portion of the data that is applicable to the intended gesture and comprises a pre-authored animation that represents a second portion of the data that is not applicable to the intended gesture.

14. The system of claim 11, wherein selecting the first portion of the data that is applicable to the intended gesture comprises selecting a portion of the data that corresponds to a volume of interest.

15. A computer-readable storage device that is not a signal and that has stored thereon computer-executable instructions comprising instructions for:

receiving data captured by a camera, wherein the data is representative of a user'"'"'s motion in a physical space;

predicting an intended gesture from the data;

selecting a first portion of the data that is applicable to the intended gesture; and

applying a filter representing the intended gesture to the first portion of the data and determining an output from base information representing the intended gesture, wherein the filter comprises the base information representing the intended gesture, and wherein the base information is adjusted to a recurring feature in a history of data representative of the user'"'"'s motion.

16. The computer-readable storage device of claim 15, wherein the computer-executable instructions further comprise instructions for applying a plurality of filters to the data, wherein the intended gesture is a gesture corresponding to at least one of the plurality of filters having base information that corresponds to the data.

17. The computer-readable storage device of claim 16, wherein the computer-executable instructions further comprise instructions for generating a model of the user from the data, wherein the model maps to the first portion of the data that is applicable to the intended gesture and comprises a pre-authored animation that represents a second portion of the data that is not applicable to the intended gesture.

18. The computer-readable storage device of claim 15, wherein selecting the first portion of the data that is applicable to the intended gesture comprises selecting a portion of the data that corresponds to a volume of interest.