METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR CREATING THREE-DIMENSIONAL VIDEO SEQUENCES
First Claim
1. A method for creating a three-dimensional video sequence of a scene, the method comprising:
- using at least one processor and memory for;
receiving a two-dimensional video sequence of a scene, the two-dimensional video sequence including a plurality of frames;
selecting a target frame from among the plurality of frames;
selecting a first subset of frames, N, from among the plurality of frames that are associated with the target frame, representative of a targeted stereo displacement of the capture device from the target frame position;
analyzing the first subset of frames to identify two images for use in forming a stereoscopic pair of frames with a predetermined spatial difference;
identifying and classifying static and moving objects between the stereoscopic pair of frames;
extracting depth data of static objects in the stereoscopic pair of frames;
selecting a second subset of frames, n, from among the plurality of frames that are associated with the target frame, representative of a stereo displacement that is substantially smaller than the displacement represented by N;
utilizing the second subset of frames to calculate depth of moving objects;
combining the depth values of static and moving objects based on an absolute depth of static objects and the relative depth of moving objects; and
generating a three-dimensional video frame consisting of the target frame and a depth-generated view corresponding to the target frame based on the depth data.
0 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for creating three-dimensional video sequences of a scene are disclosed. An example method can include receiving multiple frames of a scene. The method may include selecting a target frame from among the multiple frames; selecting a first subset of frames, N, from among the multiple frames that are associated with the target frame that is representative of a large stereo baseline; and analyzing the first frame subset to identify two images for forming a stereoscopic pair of frames. Further, the method includes extracting depth data of static objects in the stereoscopic pair. The method includes selecting a second subset of frames that are associated with the target frame that is representative of a smaller stereo baseline than that represented by N; and utilizing the second frame subset to calculate depth of moving objects. The method includes generating a three-dimensional video frame based on the depth data.
-
Citations
20 Claims
-
1. A method for creating a three-dimensional video sequence of a scene, the method comprising:
-
using at least one processor and memory for; receiving a two-dimensional video sequence of a scene, the two-dimensional video sequence including a plurality of frames; selecting a target frame from among the plurality of frames; selecting a first subset of frames, N, from among the plurality of frames that are associated with the target frame, representative of a targeted stereo displacement of the capture device from the target frame position; analyzing the first subset of frames to identify two images for use in forming a stereoscopic pair of frames with a predetermined spatial difference; identifying and classifying static and moving objects between the stereoscopic pair of frames; extracting depth data of static objects in the stereoscopic pair of frames; selecting a second subset of frames, n, from among the plurality of frames that are associated with the target frame, representative of a stereo displacement that is substantially smaller than the displacement represented by N; utilizing the second subset of frames to calculate depth of moving objects; combining the depth values of static and moving objects based on an absolute depth of static objects and the relative depth of moving objects; and generating a three-dimensional video frame consisting of the target frame and a depth-generated view corresponding to the target frame based on the depth data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A system for creating a three-dimensional video sequence of a scene, the system comprising:
-
a memory having stored therein computer program code; a computer processor that executes the computer program code; a video generator configured to; receive a two-dimensional video sequence of a scene, the two-dimensional video sequence including a plurality of frames; select a target frame from among the plurality of frames; select a first subset of frames, N, from among the plurality of frames that are associated with the target frame, representative of a targeted stereo displacement of the capture device from the target frame position; analyze the first subset of frames to identify two images for use in forming a stereoscopic pair of frames with a predetermined spatial difference; extract depth data of static objects in the stereoscopic pair of frames; select a second subset of frames, n, from among the plurality of frames that are associated with the target frame, representative of a stereo displacement that is substantially smaller than the displacement represented by N; utilize the second subset of frames to calculate depth of moving objects; combine the depth values of static and moving objects based on the absolute depth of static objects and the relative depth of moving objects; and generate a three-dimensional video frame consisting of the target frame and a depth-generated view corresponding to the target frame based on the depth data. - View Dependent Claims (20)
-
Specification