SYSTEMS AND METHODS FOR TRACKING A MODEL

• US 20110234589A1
• Filed: 06/09/2011
• Published: 09/29/2011
• Est. Priority Date: 10/07/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lee, Johnny Chung, Peeper, Craig, Stachniak, Simon Piotr, Leyvand, Tommer
• Granted Patent: US 8,325,984 B2
• Time in Patent Office: Days
• US Class Current: 345/424
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06T 7/579 from motion
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: H04N 13/20 Image signal generators

Abstract

An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A model may be adjusted based on a location or position of one or more extremities estimated or determined for a human target in the grid of voxels. The model may also be adjusted based on a default location or position of the model in a default pose such as a T-pose, a DaVinci pose, and/or a natural pose.

Claims

1-20. -20. (canceled)

21. A method for tracking a user comprising:

generating a grid of voxels based on a depth image;

identifying an estimated location or position of one or more extremities of the user in the grid of voxels; and

adjusting a model based on the estimated location or position of one or more extremities.

22. The method of claim 21 further comprising mapping the model to an on screen avatar.

23. The method of claim 21 further comprising providing the model to a gesture library.

26. The method of claim 21, further comprising determining whether the estimated location or position is valid.

30. The method of claim 21, further comprising magnetizing the model to one or more of the voxels in the grid of voxels.

31. The method of claim 21, further comprising determining whether a pose associated with the model is valid.

32. The method of claim 21, further comprising refining the model based on the received depth image.

33. The method of claim 21, further comprising downsampling the pixels in the depth image to generate the grid of voxels.

34. A computer readable storage medium for tracking a user, the computer readable storage medium having stored thereon computer executable instructions comprising:

generating a grid of voxels based on a depth image;

identifying an estimated location or position of one or more extremities of the user in the grid of voxels; and

adjusting a model based on the estimated location or position of one or more extremities.

35. The computer readable storage medium of claim 34 wherein the instructions further comprise mapping the model to an on screen avatar.

36. The computer readable storage medium of claim 34 wherein the instructions further comprise providing the model to a gesture library.

37. The computer readable storage medium of claim 34, wherein the model comprises a skeletal model having joints and bones.

38. The computer readable storage medium of claim 37, wherein adjusting the model comprises adjusting a joint of the skeletal model to the estimated location or position.

39. The computer readable storage medium of claim 34, wherein the instructions further comprise determining whether the estimated location or position is valid.

40. A system for tracking a user comprising:

memory having stored therein computer executable instructions;

a processor that executes the computer executable instructions comprising;

generating a grid of voxels based on a depth image;

identifying an estimated location or position of one or more extremities of the user in the grid of voxels; and

adjusting a model based on the estimated location or position of one or more extremities.