System and method for processing video images
First Claim
1. A method for processing a video sequence, comprising:
- defining graphical data associated with an object in multiple frames of said video sequence;
associating a three dimensional model with said object;
defining transforms experienced by said object between said multiple frames;
generating texture map data for a first frame of said multiple frames, wherein said generating (i) identifies a first portion of said three dimensional model visible according to a camera position associated with said first frame, (ii) includes defined graphical data associated with said first frame within texture map data for said first portion, (iii) identifies a second portion of said three dimensional model that is not visible according to a camera position associated with said first frame, (iv) processes defined graphical data associated with at least a second frame of said multiple frames according to the defined transforms experienced by said object between said first frame and said at least second frame, and (v) includes said processed graphical data within texture map data for said second portion.
2 Assignments
0 Petitions
Accused Products
Abstract
Some representative embodiments are directed to creating a “virtual world” by processing a series of two dimensional images to generate a representation of the physical world depicted in the series of images. The virtual world representation includes models of objects that specify the locations of the objects within the virtual world, the geometries of the objects, the dimensions of the objects, the surface representation of the objects, and/or other relevant information. By developing the virtual world representation, a number of image processing effects may be applied such as generation of stereoscopic images, object insertion, object removal, object translation, and/or other object manipulation operations.
69 Citations
24 Claims
-
1. A method for processing a video sequence, comprising:
-
defining graphical data associated with an object in multiple frames of said video sequence;
associating a three dimensional model with said object;
defining transforms experienced by said object between said multiple frames;
generating texture map data for a first frame of said multiple frames, wherein said generating (i) identifies a first portion of said three dimensional model visible according to a camera position associated with said first frame, (ii) includes defined graphical data associated with said first frame within texture map data for said first portion, (iii) identifies a second portion of said three dimensional model that is not visible according to a camera position associated with said first frame, (iv) processes defined graphical data associated with at least a second frame of said multiple frames according to the defined transforms experienced by said object between said first frame and said at least second frame, and (v) includes said processed graphical data within texture map data for said second portion. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A system for processing a video sequence, comprising:
-
a plurality of object models representing objects in said video sequence using three dimensional elements;
a plurality of transform data structures defining transforms experienced by said objects between said multiple frames;
a texture map generation algorithm for generating texture map data, wherein said algorithm, for each of said object models and for each of said multiple frames, is operable to (i) identify a first portion of a respective object model that is visible according to a camera position of a current frame of said multiple frames;
(ii) identify a second portion of said respective object model that is not visible according to said camera position;
(iii) include graphical data from said current frame in texture map data for said first portion for said current frame;
(iv) process graphical data from at least one frame other than said current frame according to a transform data structure; and
(v) include said processed graphical data in texture map data for said second portion. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
Specification