Depth cursor and depth management in images

• US 9,390,519 B2
• Filed: 04/13/2015
• Issued: 07/12/2016
• Est. Priority Date: 10/21/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Lynch, James
• Primary Examiner(s): CHOW, JEFFREY J
• Application Number:
  US14/684,909
• Publication Number:
  US 20150325039A1
• Time in Patent Office: 456 Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 7/543 from line drawings
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

One or more systems, devices, and/or methods for illustrating depth are disclosed. For example, a method includes receiving a depthmap generated from an optical distancing system. The depthmap includes depth data for each of a plurality of points, which are correlated to pixels of an image. Data indicative of a location on the image is received. Depth data correlated with the first point is compared to depth data correlated with pixels at surrounding points in the image. If the depth data correlated with the first point indicate a lesser distance from a viewer perspective of the image than the depth data of a pixel at the surrounding points in the image, the pixel is changed to a predetermined value. The comparison may be repeated at other pixels and a depth illustration may be drawn that relates the depth of the received location to other objects in the image.

Claims

1. A method comprising:

receiving a depthmap generated from an optical distancing system;

correlating a plurality of depth data in the depthmap to pixels of an image;

receiving a first selection of a first location in the image;

receiving a second selection of a second location in the image;

calculating, using a processor, a depth line from the first selection to the second selection using the depthmap; and

displaying the depth line on the image, wherein the depth line appears in front of at least one object in the image and behind at least one object in the image.

2. The method of claim 1, further comprising:

comparing points along the depth line to the pixels of the image correlated with the depth data.

3. The method of claim 2, further comprising:

displaying the depth line on the image for points of the depth line that are closer to a viewpoint of the image than the pixels of the image.

4. The method of claim 1, wherein the first selection is a user selection directly on the image, and the second selection is a reference location.

5. The method of claim 4, wherein the reference location is a predetermined reference point, a deepest point in the image, or a nearest point in the image.

6. The method of claim 1, further comprising:

calculating a distance for the depth line between the first selection and the second selection; and

providing the calculated distance to a user as an indication of whether the first selection is an intended selection.

7. The method of claim 1, wherein the optical distancing system includes a light detection and ranging device or a stereoscopic camera.

8. The method of claim 1, wherein displaying the depth line on the image further comprises:

changing the color of pixels of the depth line to a predetermined value if the depth value depth line at that pixel if the object of the image corresponds to a depth value less than the depth value of the depth line at the pixel.

9. The method of claim 1, further comprising:

determining the depth value of the depth line between the first selection and the second selection;

comparing the correlated depth data of each pixel location along the depth line with the depth value of the depth line;

displaying the depth line at pixel locations between the first selection and the second selection along the depth line when the correlated depth data of pixel locations along the depth line indicate a depth farther than the depth value of the depth line; and

displaying the pixel value of the image when the correlated depth data of pixel locations along the depth line indicate a depth closer than the depth value of the depth line.

10. The method of claim 6, further comprising:

providing a first depth cursor for display corresponding to the depth data associated with the current location of the first selection in the image; and

providing a second depth cursor for display corresponding to the depth data associated with the current location of the second location in the image.

11. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs;

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;

identifying a depthmap generated from an optical distancing system;

applying a plurality of depth data to the depthmap to pixels of an image;

receiving a first selection of a first location in the image;

calculating, using a processor, a depth illustration based on a comparison of the first selection to the pixels of the image correlated with the depth data; and

displaying the depth line on the image, wherein the depth line appears in front of at least one object in the image and behind at least one object in the image.

12. The apparatus of claim 11, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

receiving a second selection of a second location in the image, wherein the depth illustration is a depth line from the first selection to the second selection, and the comparison is between points along the depth line to the pixels of the image correlated with the depth data.

13. The apparatus of claim 12, wherein the first selection is a user selection directly on the image, and the second selection is a reference location.

14. The apparatus of claim 13, wherein the reference location is a predetermined reference point, a deepest point in the image, or a nearest point in the image.

15. The apparatus of claim 12, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

calculating a distance for the depth line between the first selection and the second selection; and

providing the calculated distance to a user as an indication of whether the first selection is an intended selection.

16. The apparatus of claim 15, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

providing a first depth cursor for display corresponding to the depth data associated with the current location of the first selection in the image; and

providing a second depth cursor for display corresponding to the depth data associated with the current location of the second location in the image.

17. The apparatus of claim 11, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

displaying the depth illustration on the image for points of the depth illustration that are closer to a perspective of the image than the pixels of the image.

18. The apparatus of claim 11, wherein the image includes a mixed visibility cursor including the depth illustration dependent on depth and another portion appears on top of the image.

19. A non-transitory computer readable medium including instructions that when executed are operable to:

receive a depthmap generated from an optical distancing system;

correlate a plurality of depth data in the depthmap to pixels of an image;

receive a first selection of a first location in the image correlated to a first depth;

receive a second selection of a second location in the image correlated to a second depth;

calculate, using a processor, a depth line from the first depth to the second depth using the depthmap; and

display the depth line on the image, wherein the depth line appears in front of at least one object in the image and behind at least one object in the image.

20. The non-transitory computer readable medium of claim 19, including instructions that when executed are operable to:

generate the depth line above the image for points of the depth line that are closer to a perspective of the image than the pixels of the image.