Isolate extraneous motions

• US 8,942,428 B2
• Filed: 05/29/2009
• Issued: 01/27/2015
• Est. Priority Date: 05/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Snook, Gregory Nelson, Markovic, Relja, Latta, Stephen Gilchrist, Geisner, Kevin
• Primary Examiner(s): Akhavannik, Hadi
• Assistant Examiner(s): RASHIDIAN, MOHAMMAD M
• Application Number:
  US12/475,302
• Publication Number:
  US 20100278393A1
• Time in Patent Office: 2,069 Days
• Field of Search: 382/100, 382103-107, 382/118, 382/159, 382170-173, 382/181, 382/190, 382/195, 382/203, 382209-210, 382/226, 382/228, 382/241, 382/66, 382276-278, 382/285, 463/5, 463/8, 463 36- 37, 345/143, 345/156, 345/158, 345418-419, 345473-474, 345/629, 356/614, 356/616, 348 42- 43, 348/48, 348 77- 78, 348/169, 348/208.14, 701/24, 715/700, 715/702, 715/863
• US Class Current: 382/107
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: G06F 2203/012 Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A system may receive image data and capture motion with respect to a target in a physical space and recognize a gesture from the captured motion. It may be desirable to isolate aspects of captured motion to differentiate random and extraneous motions. For example, a gesture may comprise motion of a user'"'"'s right arm, and it may be desirable to isolate the motion of the user'"'"'s right arm and exclude an interpretation of any other motion. Thus, the isolated aspect may be the focus of the received data for gesture recognition. Alternately, the isolated aspects may be an aspect of the captured motion that is removed from consideration when identifying a gesture from the captured motion. For example, gesture filters may be modified to correspond to the user'"'"'s natural lean to eliminate the effect the lean has on the registry of a motion with a gesture filter.

Claims

1. A method comprising:

receiving data representative of a user'"'"'s captured motion;

collecting a history of the data representative of the user'"'"'s captured motion;

identifying a physical characteristic of the user in the history of the data representative of the user'"'"'s captured motion;

analyzing the received data with base information representing a gesture to produce an output corresponding to whether the received data corresponds to the gesture;

performing a first adjustment to the base information representing the gesture to correspond to the physical characteristic of the user to form first adjusted base information; and

performing a second adjustment to the base information representing the gesture to correspond to a physical characteristic of a different user to form second adjusted base information that is different from the first adjusted base information.

2. The method of claim 1, wherein performing the first adjustment to the base information comprises setting at least one parameter of a filter associated with the gesture to correspond to the physical characteristic of the user.

3. The method of claim 1, further comprising predicting an intended gesture from the received data using a filter associated with the intended gesture.

4. The method of claim 1, wherein the first adjusted base information indicates that the received data representative of the user'"'"'s captured motion corresponds to the gesture.

5. The method of claim 1, wherein the physical characteristic of the user comprises at least one of the user'"'"'s posture or the user'"'"'s size.

6. The method of claim 5, wherein adjusting the base information to correspond to the physical characteristic of the user comprises setting at least one parameter of a filter associated with the gesture to correspond to the at least one of the user'"'"'s posture or the user'"'"'s size.

7. The method of claim 1, further comprising adjusting at least one property of a virtual object to correspond to the physical characteristic of the user.

8. The method of claim 7, wherein the physical characteristic of the user comprises the user'"'"'s size and adjusting the at least one property of the virtual object to correspond to the physical characteristic of the user comprises scaling dimensions of the virtual object to correspond to the user'"'"'s size.

9. The method of claim 1, wherein a filter associated with the gesture is a first filter and is complementary with at least one other filter, the method further comprising adjusting base information of the at least one other filter determined from the first adjustment.

10. The method of claim 9, wherein, prior to performing the first adjustment, the received data registers with the first filter, and wherein after performing the first adjustment and adjusting the base information of the at least one other filter, the received data registers with the at least one other filter.

11. A system comprising:

memory having stored therein computer-executable instructions;

one or more processors operable to execute the computer-executable instructions, and wherein the computer-executable instructions comprise instructions for;

receiving data representative of a user'"'"'s captured motion;

collecting a history of the data representative of the user'"'"'s captured motion;

identifying a physical characteristic of the user in the history of the data representative of the user'"'"'s captured motion;

analyzing the received data with base information representing a gesture to produce an output corresponding to whether the received data corresponds to the gesture;

performing a first adjustment to the base information representing the gesture to correspond to the physical characteristic of the user to form first adjusted base information; and

performing a second adjustment to the base information representing the gesture to correspond to a physical characteristic of a different user to form second adjusted base information that is different from the first adjusted base information.

12. The system of claim 11, wherein performing the first adjustment to the base information comprises setting at least one parameter of a filter associated with the gesture to correspond to the physical characteristic of the user.

13. The system of claim 11, wherein the computer-executable instructions further comprise instructions for predicting an intended gesture from the received data using a filter associated with the intended gesture.

14. The system of claim 11, wherein the first adjusted base information indicates that the received data representative of the user'"'"'s captured motion corresponds to the gesture.

15. The system of claim 11, wherein the physical characteristic of the user comprises at least one of the user'"'"'s posture or the user'"'"'s size.

16. The system of claim 15, wherein adjusting the base information to correspond to the physical characteristic of the user comprises setting at least one parameter of a filter associated with the gesture to correspond to the at least one of the user'"'"'s posture or the user'"'"'s size.

17. A computer-readable storage device having stored thereon computer-executable instructions comprising instructions for:

receiving data representative of a user'"'"'s captured motion;

collecting a history of the data representative of the user'"'"'s captured motion;

identifying a physical characteristic of the user in the history of the data representative of the user'"'"'s captured motion;

analyzing the received data with base information representing a gesture to produce an output corresponding to whether the received data corresponds to the gesture;

performing a first adjustment to the base information representing the gesture to correspond to the physical characteristic of the user to form first adjusted base information; and

performing a second adjustment to the base information representing the gesture to correspond to a physical characteristic of a different user to form second adjusted base information that is different from the first adjusted base information.

18. The computer-readable storage device of claim 17, wherein performing the first adjustment to the base information comprises setting at least one parameter of a filter associated with the gesture to correspond to the physical characteristic of the user.

19. The computer-readable storage device of claim 17, wherein the computer-executable instructions further comprise instructions for predicting an intended gesture from the received data using a filter associated with the intended gesture.

20. The computer-readable storage device of claim 17, wherein the first adjusted base information indicates that the received data representative of the user'"'"'s captured motion corresponds to the gesture.

21. The computer-readable storage device of claim 17, wherein the physical characteristic of the user comprises at least one of the user'"'"'s posture or the user'"'"'s size.