Image depth inference from semantic labels
First Claim
1. In a digital medium environment including one or more computing devices to control a determination of depth within an image, a method comprising:
- decomposing one of a plurality of semantically labeled regions of an image by the one or more computing devices into a plurality of segments formed as planes of the one semantically labeled region, the plurality of segments of the one semantically labeled region being generally perpendicular to a ground plane of the image;
inferring depth of at least one of the plurality of segments by the one or more computing devices based on a depth of a location of the ground plane that is contacted by the at least one of the plurality of segments; and
forming a depth map by the one or more computing devices that describes depth for the one semantically labeled region based at least in part on the inferred depths for the at least one of the plurality of segments.
2 Assignments
0 Petitions
Accused Products
Abstract
Image depth inference techniques and systems from semantic labels are described. In one or more implementations, a digital medium environment includes one or more computing devices to control a determination of depth within an image. Regions of the image are semantically labeled by the one or more computing devices. At least one of the semantically labeled regions is decomposed into a plurality of segments formed as planes generally perpendicular to a ground plane of the image. Depth of one or more of the plurality of segments is then inferred based on relationships of respective segments with respective locations of the ground plane of the image. A depth map is formed that describes depth for the at least one semantically labeled region based at least in part on the inferred depths for the one or more of the plurality of segments.
-
Citations
20 Claims
-
1. In a digital medium environment including one or more computing devices to control a determination of depth within an image, a method comprising:
-
decomposing one of a plurality of semantically labeled regions of an image by the one or more computing devices into a plurality of segments formed as planes of the one semantically labeled region, the plurality of segments of the one semantically labeled region being generally perpendicular to a ground plane of the image; inferring depth of at least one of the plurality of segments by the one or more computing devices based on a depth of a location of the ground plane that is contacted by the at least one of the plurality of segments; and forming a depth map by the one or more computing devices that describes depth for the one semantically labeled region based at least in part on the inferred depths for the at least one of the plurality of segments. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. In a digital medium environment including one or more computing devices to control a determination of depth within an image, a method comprising:
-
semantically labeling regions of the image by one or more computing devices; decomposing a single one of the semantically labeled regions by the one or more computing devices into a plurality of segments formed as vertical planes of the one semantically labeled region; jointly inferring depth by the one or more computing devices for the plurality of segments within the single one of the semantically labeled regions such that information is shared, one to another, for the plurality of segments as part of the inferring, the inferring based at least in part on a depth of a location of a ground plane that is contacted by a respective segment of the plurality of segments; and forming a depth map by the one or more computing devices that describes depth for the at least one semantically labeled region based at least in part on the inferred depths for the plurality of segments within the single one of the semantically labeled regions. - View Dependent Claims (14, 15)
-
-
16. In a digital medium environment having one or more computing devices to control a determination of depth within an image, a depth map system comprising:
-
a semantic labeling module implemented at least partially in hardware of the one or more computing devices to semantically label regions of the image; a depth inference module implemented at least partially in hardware of the one or more computing devices to decompose at least one of the semantically labeled regions into a plurality of segments formed as planes that are generally perpendicular to a ground plane and infer depth of each of the plurality of segments based on relationship of respective said segments with respective locations of the ground plane of the image by; determining a coordinate of a pixel of the respective said segments that connect with the respective location of the ground plane by the one or more computing devices; using a horizontal direction of the coordinate along with a depth gradient and depth offset computed based on the respective location to the ground plane to infer the depth of the pixel; and propagating the depth of the pixel for determination of depth of other pixels in the respective said segments by the one or more computing devices; and a depth map generation module implemented at least partially in hardware of the one or more computing devices to form a depth map that describes depth for the at least one semantically labeled region based at least in part on the inferred depths for the one or more of the plurality of segments. - View Dependent Claims (17, 18, 19, 20)
-
Specification