2D to 3D video conversion
First Claim
1. A computer-implemented method for real-time 2D to 3D video conversion, comprising:
- receiving a decoded 2D video frame having an original resolution;
downscaling the decoded 2D video frame into an associated 2D video frame having a lower resolution;
segmenting objects present in the downscaled 2D video frame into background objects and foreground objects;
generating a background depth map and a foreground depth map for the downscaled 2D video frame based on the segmented background and foreground objects;
deriving a frame depth map in the original resolution based on the background depth map and the foreground depth map; and
providing a 3D video frame for display at a real-time playback rate, wherein the 3D video frame is generated in the original resolution based on the frame depth map.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for real-time 2D to 3D video conversion includes receiving a decoded 2D video frame having an original resolution, downscaling the decoded 2D video frame into an associated 2D video frame having a lower resolution, and segmenting objects present in the downscaled 2D video frame into background objects and foreground objects. The method also includes generating a background depth map and a foreground depth map for the downscaled 2D video frame based on the segmented background and foreground objects, and deriving a frame depth map in the original resolution based on the background depth map and the foreground depth map. The method further includes providing a 3D video frame for display at a real-time playback rate. The 3D video frame is generated in the original resolution based on the frame depth map.
-
Citations
34 Claims
-
1. A computer-implemented method for real-time 2D to 3D video conversion, comprising:
-
receiving a decoded 2D video frame having an original resolution; downscaling the decoded 2D video frame into an associated 2D video frame having a lower resolution; segmenting objects present in the downscaled 2D video frame into background objects and foreground objects; generating a background depth map and a foreground depth map for the downscaled 2D video frame based on the segmented background and foreground objects; deriving a frame depth map in the original resolution based on the background depth map and the foreground depth map; and providing a 3D video frame for display at a real-time playback rate, wherein the 3D video frame is generated in the original resolution based on the frame depth map. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A 2D-to-3D video converter coupled to receive a decoded 2D video frame having an original resolution, the 2D-to-3D video converter comprising:
-
a downscaler to downscale the decoded 2D video frame into an associated 2D video frame having a lower resolution; a scene object analyzer to segment objects present in the downscaled 2D video frame into background objects and foreground objects; a first depth map generator to generate a background depth map and a foreground depth map for the downscaled 2D video frame based on the segmented background and foreground objects; a second depth map generator to derive a frame depth map in the original resolution based on the background depth map and the foreground depth map; and a rendering engine to provide a 3D video frame for display at a real-time playback rate on a user device, wherein the 3D video frame is generated in the original resolution based on the frame depth map. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A computer readable medium storing instructions that, when executed, cause a computer to perform a method for real-time 2D to 3D video conversion, the method comprising:
-
receiving a decoded 2D video frame having an original resolution; downscaling the decoded 2D video frame into an associated 2D video frame having a lower resolution; segmenting objects present in the downscaled 2D video frame into background objects and foreground objects; generating a background depth map and a foreground depth map for the downscaled 2D video frame based on the segmented background and foreground objects; deriving a frame depth map in the original resolution based on the background depth map and the foreground depth map; and providing a 3D video frame for display at a real-time playback rate, wherein the 3D video frame is generated in the original resolution based on the frame depth map.
-
Specification