Visualizing Depth

• US 20110109617A1
• Filed: 11/12/2009
• Published: 05/12/2011
• Est. Priority Date: 11/12/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Geisner, Kevin, Markovic, Relja, Snook, Gregory Nelson, Latta, Stephen Gilchrist
• Application Number:
  US12/617,012
• Publication Number:
  US 20110109617A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes

Abstract

An image such as a depth image of a scene may be received, observed, or captured by a device. The image may then be analyzed to identify one or more targets within the scene. When a target is identified, vertices may be generated. A mesh model may then be created by drawing lines that may connect the vertices. Additionally, a depth value may also be calculated for each vertex. The depth values of the vertices may then be used to extrude the mesh model such that the mesh model may represent the target in the three-dimensional virtual world. A colorization scheme, a texture, lighting effects, or the like, may be also applied to the mesh model to convey the depth the virtual object may have in the virtual world.

Claims

1. A method for conveying a visual sense of depth, the method comprising:

receiving a depth image of a scene;

determining depth values for one or more targets in the scene; and

rendering a visual depiction of the one or more targets in the scene according to a visualization scheme, the visualization scheme using the depth values determined for the one or more targets.

2. The method of claim 1 further comprising grouping depth image pixels that are of the same relative depth to define boundary pixels.

3. The method of claim 2 further comprising analyzing the boundary pixels to identify the one or more targets in the scene.

4. The method of claim 1, wherein the visualization scheme comprises a colorization scheme that represents a distance between the one or more targets and a user.

5. The method of claim 1, wherein rendering the visual depiction of the one or more targets further comprises:

generating a virtual model for at least one of the one or more targets; and

coloring the virtual model according to a colorization scheme, the colorization scheme representing a distance between the one or more targets and a user.

6. The method of claim 1 further comprising:

receiving an RGB image of the one or more targets in the scene; and

applying the RGB image to the one or more targets in the scene.

7. The method of claim 6, wherein the rendering the visual depiction of the one or more targets in the scene comprises modifying the RGB image with a colorization scheme that represents a distance between the one or more targets and a user.

8. The method of claim 1 further comprising:

selecting a first target and a second target from the one or more targets in the scene;

generating a first cursor for the first target;

generating a second cursor for the second target; and

rendering the first cursor and the second cursor according to the visualization scheme.

9. A system for conveying a sense of depth, the system comprising:

a processor, the processor for executing computer executable instructions, the computer executable instructions comprising instructions for;

receiving a depth image of a scene;

identifying a target within the scene;

generating vertices that correspond to the target based on the depth image; and

generating a mesh model to represent the target using the vertices.

10. The system of claim 9, wherein the computer executable instructions for generating the vertices comprises:

grouping pixels grouping pixels in the depth image that are of the same relative depth to create boundary pixels;

defining the vertices of the mesh model according to the boundary pixels;

11. The system of claim 9, wherein the computer executable instructions for generating the mesh model using the vertices comprises using vectors to connect the vertices.

12. The system of claim 9, wherein the computer executable instructions further comprise using depth data from the depth image to modify the mesh model.

13. The system of claim 9, wherein the computer executable instructions further comprise:

determining depth data for the target from the depth image; and

extruding the mesh model by moving the vertices based on the depth data.

14. The system of claim 9, wherein the computer executable instructions further comprise rendering the mesh model according a visualization scheme, the visualization scheme using depth values determined for the target.

15. A computer-readable storage medium having stored thereon computer executable instructions for conveying a sense of depth in a three-dimensional virtual world, the computer executable instructions comprising instructions for:

identifying a target within a depth image of a scene;

generating vertices that correspond to the target identified within the scene; and

rendering a visual depiction of the target according to a visualization scheme, the visualization scheme using the vertices.

16. The computer-readable storage medium of claim 15, wherein the computer executable instructions for rending the visual depiction of the target comprise generating a mesh model using the vertices.

17. The computer-readable storage medium of claim 15, wherein the visualization scheme comprises a colorization scheme that represents a distance between the target and a user.

18. The computer-readable storage medium of claim 15, wherein the computer executable instructions further comprising:

receiving an RGB image of the target; and

applying the RGB image to the target.

19. The computer-readable storage medium of claim 15, wherein generating the vertices comprises grouping pixels in the depth image that are of the same relative depth.

20. The computer-readable storage medium of claim 15, wherein the computer executable instructions further comprise:

generating an orientation cursor for the target, the orientation cursor conveying an orientation of the target; and

rendering the orientation cursor according to the visual scheme.