Depth estimation based on global motion and optical flow
First Claim
1. A method comprising:
- determining, via an image processing module of a computing device for a two-dimensional (2D) view of a video presentation, an optical flow for at least one frame of the 2D view, wherein the optical flow is a representation of an apparent motion of object brightness patterns in a visual plane caused by relative motion between an observer of the 2D view and objects of the 2D view;
estimating, by the image processing module and based on the determined optical flow, global motion for the at least one frame;
adjusting, by the image processing module, the optical flow based on the estimated global motion to create a global motion-adjusted optical flow for the at least one frame; and
generating, by the image processing module, a depth map for the 2D view of the video presentation based on the global motion-adjusted optical flow.
1 Assignment
0 Petitions
Accused Products
Abstract
This disclosure describes techniques for estimating a depth of image objects for a two-dimensional (2D) view of a video presentation. For example, an initial indication of depth (e.g., an optical flow) may be determined for a 2D view. The initial indication of depth may be used to estimate global motion, e.g., motion of an observer (e.g., camera), of the 2D view. The initial indication of depth may be modified based on the estimation of global motion to create a global motion-adjusted indication of depth. The global motion-adjusted depth indication may be used to create a depth map for the 2D view, which may be used to generate an alternative view of the video presentation that may be used to display a three-dimensional (3D) video presentation.
-
Citations
47 Claims
-
1. A method comprising:
-
determining, via an image processing module of a computing device for a two-dimensional (2D) view of a video presentation, an optical flow for at least one frame of the 2D view, wherein the optical flow is a representation of an apparent motion of object brightness patterns in a visual plane caused by relative motion between an observer of the 2D view and objects of the 2D view; estimating, by the image processing module and based on the determined optical flow, global motion for the at least one frame; adjusting, by the image processing module, the optical flow based on the estimated global motion to create a global motion-adjusted optical flow for the at least one frame; and generating, by the image processing module, a depth map for the 2D view of the video presentation based on the global motion-adjusted optical flow. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 44)
-
-
12. An apparatus comprising one or more processors configured to:
-
determine, for a two-dimensional (2D) view of a video presentation, an optical flow for at least one frame of the 2D video presentation, wherein the optical flow is a representation of an apparent motion of object brightness patterns in a visual plane caused by relative motion between an observer of the 2D view and objects of the 2D view; estimate, based on the determined optical flow, global motion for the at least one frame; adjust the optical flow based on the estimated global motion to create a global motion-adjusted optical flow for the at least one frame; and generate a depth map for the 2D view of the video presentation based on the global motion-adjusted optical flow. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 45)
-
-
23. A non-transitory computer-readable storage medium comprising instructions that upon execution cause one or more processors to:
-
determine, for a two-dimensional (2D) view of a video presentation, an optical flow for at least one frame of the 2D video presentation, wherein the optical flow is a representation of an apparent motion of object brightness patterns in a visual plane caused by relative motion between an observer of the 2D view and objects of the 2D view; estimate, based on the optical flow, global motion for the at least one frame; adjust the optical flow based on the estimated global motion to create a global motion adjusted optical flow for the at least one frame; and generate a depth map for the 2D view of the video presentation based on the global motion-adjusted optical flow. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 46)
-
-
34. A device, comprising:
-
means for determining, for a two-dimensional (2D) view of a video presentation, an optical flow for at least one frame of the 2D video presentation, wherein the optical flow is a representation of an apparent motion of object brightness patterns in a visual plane caused by relative motion between an observer of the 2D view and objects of the 2D view; means for estimating, based on the optical flow, global motion for the at least one frame; means for adjusting the optical flow based on the estimated global motion to create a global motion-adjusted optical flow for the at least one frame; and means for generating a depth map for the 2D view of the video presentation based on the global motion-adjusted optical flow. - View Dependent Claims (35, 36, 37, 38, 39, 40, 41, 42, 43, 47)
-
Specification