Body scan

• US 8,294,767 B2
• Filed: 01/30/2009
• Issued: 10/23/2012
• Est. Priority Date: 01/30/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mathe, Zsolt, Marais, Charles Claudius, Geiss, Ryan Michael
• Primary Examiner(s): BAYARD, DJENANE M
• Application Number:
  US12/363,542
• Publication Number:
  US 20100194872A1
• Time in Patent Office: 1,362 Days
• Field of Search: 348/153, 348/154, 348/144, 348/151, 348/155, 348/156
• US Class Current: 348/154
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A depth image of a scene may be received, observed, or captured by a device. The depth image may then be analyzed to determine whether the depth image includes a human target. For example, the depth image may include one or more targets including a human target and non-human targets. Each of the targets may be flood filled and compared to a pattern to determine whether the target may be a human target. If one or more of the targets in the depth image includes a human target, the human target may be scanned. A skeletal model of the human target may then be generated based on the scan.

Claims

1. A computer-readable storage medium excluding signals having stored thereon computer executable instructions for scanning a target in a captured scene, the computer executable instructions comprising instructions for:

receiving a depth image of the scene, wherein the depth image includes the target;

comparing the target with a pattern to determine that the target matches the pattern;

scanning the target based on the comparison that determines that the target matches the pattern;

generating a model of the target based on the scan; and

providing the model to a computing system, wherein the computing system tracks one or more movements of the model, and wherein the computing system is controlled based on the tracked one or more movements.

2. The computer-readable medium of claim 1, wherein the pattern includes a machine representation of a predetermined body model associated with a human.

3. The computer-readable medium of claim 1, wherein the instructions for comparing the target with the pattern to determine whether the target matches the pattern further comprise instructions for calculating a confidence value that indicates an accuracy to which the target in the depth image corresponds to the pattern.

4. The computer-readable medium of claim 3, wherein the confidence value of the target is used to determine whether the depth image includes a human target.

5. The computer-readable medium of claim 1, wherein the instructions for scanning the target further comprise instructions for:

removing an area of the depth image not matching the target;

creating a bitmask of the target; and

scanning the bitmask to determine various body parts of the target.

6. The computer-readable medium of claim 1, wherein the model comprises a skeletal model.

7. A computer-implemented method of scanning a target in a captured scene comprising:

receiving a depth image of the scene, wherein the depth image includes the target;

comparing the target with a pattern to determine that the target matches the pattern;

scanning the target based on the comparison that determines that the target matches the pattern;

generating a model of the target based on the scan; and

providing the model to a computing system, wherein the computing system tracks one or more movements of the model, and wherein the computing system is controlled based on the tracked one or more movements.

8. The method of claim 7, wherein the pattern includes a machine representation of a predetermined body model associated with a human.

9. The method of claim 7, wherein comparing the target with the pattern to determine whether the target matches the pattern comprises calculating a confidence value that indicates an accuracy to which the target in the depth image corresponds to the pattern.

10. The method of claim 9, wherein the confidence value of the target is used to determine whether the depth image includes a human target.

11. The method of claim 7, wherein scanning the target comprises:

removing an area of the depth image not matching the target;

creating a bitmask of the target; and

scanning the bitmask to determine various body parts of the target.

12. The method of claim 7, wherein the model comprises a skeletal model.

13. A system for scanning a target in a captured scene comprising:

a processor that executes computer executable instructions; and

memory having stored therein the computer executable instructions comprising;

receiving a depth image of the scene, wherein the depth image includes the target;

comparing the target with a pattern to determine that the target matches the pattern;

scanning the target based on the comparison that determines that the target matches the pattern;

generating a model of the target based on the scan; and

providing the model to a computing system, wherein the computing system tracks one or more movements of the model, and wherein the computing system is controlled based on the tracked one or more movements.

14. The system of claim 13, wherein the pattern includes a machine representation of a predetermined body model associated with a human.

15. The system of claim 13, wherein the instructions for comparing the target with the pattern to determine whether the target matches the pattern further comprise instructions for calculating a confidence value that indicates an accuracy to which the target in the depth image corresponds to the pattern.

16. The system of claim 15, wherein the confidence value of the target is used to determine whether the depth image includes a human target.

17. The system of claim 13, wherein the instructions for scanning the target further comprise instructions for:

removing an area of the depth image not matching the target;

creating a bitmask of the target; and

scanning the bitmask to determine various body parts of the target.

18. The system of claim 13, wherein the model comprises a skeletal model.