Depth map generation using bokeh detection
First Claim
1. A method for generating depth maps, the method comprising:
- receiving, by one or more computing devices having one or more processors, a set of image frames, each image frame of the set of image frames including pixels;
aligning, by the one or more computing devices, the set of image frames to provide flows of the pixels in the set of image frames;
for each pixel of each image frame of the set of image frames, determining, by the one or more computing devices, a vote value based at least in part on a voting scheme where each pixel of an image frames of the set of image frames votes for a corresponding pixel in another image frame of the set of image frames according to the flows;
identifying, by the one or more computing devices, any region of bokeh effect in each image frame of the set of image frames based at least in part the determined vote values;
adjusting, by the one or more computing devices, the alignment of the set of image frames based at least in part on the identified regions of bokeh effect; and
generating, by the one or more computing devices, a depth map based at least in part on the adjusted alignment.
2 Assignments
0 Petitions
Accused Products
Abstract
In one aspect, one or more computing devices receive a set of image frames. Each image frame includes pixels. The computing devices align image frames in order to identify flows of the pixels in the set of image frames. Regions of bokeh effect are identified in each image frame by measuring the sizes of areas of expansion across image frames using a set of assumptions and the identified flows. The computing devices adjust the alignment of the set of image frames based at least in part on the identified regions of bokeh effect. For each image frame, the computing devices generates an index map of focus values for each of the pixels that image frame using the improved alignment. A depth map is generated by the computing devices based at least in part on the index maps.
-
Citations
20 Claims
-
1. A method for generating depth maps, the method comprising:
-
receiving, by one or more computing devices having one or more processors, a set of image frames, each image frame of the set of image frames including pixels; aligning, by the one or more computing devices, the set of image frames to provide flows of the pixels in the set of image frames; for each pixel of each image frame of the set of image frames, determining, by the one or more computing devices, a vote value based at least in part on a voting scheme where each pixel of an image frames of the set of image frames votes for a corresponding pixel in another image frame of the set of image frames according to the flows; identifying, by the one or more computing devices, any region of bokeh effect in each image frame of the set of image frames based at least in part the determined vote values; adjusting, by the one or more computing devices, the alignment of the set of image frames based at least in part on the identified regions of bokeh effect; and generating, by the one or more computing devices, a depth map based at least in part on the adjusted alignment. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for generating depth maps, the system comprising one or more computing devices having one or more processors configured to:
-
receive a set of image frames, each image frame of the set of image frames including pixels; align by the one or more computing devices, the set of image frames to provide flows of the pixels in the set of image frames; for each pixel of each image frame of the set of image frames, determine a vote value based at least in part on a voting scheme where each pixel of an image frames of the set of image frames votes for a corresponding pixel in another image frame of the set of image frames according to the flows; identify any region of bokeh effect in each image frame of the set of image frames based at least in part the determined vote values; adjust the alignment of the set of image frames based at least in part on the identified regions of bokeh effect; and generate a depth map based at least in part on the adjusted alignment. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory, tangible computer-readable recording medium storing instructions, the instructions, when executed by one or more processors, cause the one or more processors to perform a method for generating depth maps, the method comprising:
-
receiving a set of image frames, each image frame of the set of image frames including pixels; aligning the set of image frames to provide flows of the pixels in the set of image frames; for each pixel of each image frame of the set of image frames, determining a vote value based at least in part on a voting scheme where each pixel of an image frames of the set of image frames votes for a corresponding pixel in another image frame of the set of image frames according to the flows; identifying any region of bokeh effect in each image frame of the set of image frames based at least in part on the determined vote values; adjusting the alignment of the set of image frames based at least in part on the identified regions of bokeh effect; and generating a depth map based at least in part on the adjusted alignment. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification