System and method for rapid image sequence depth enhancement with augmented computer-generated elements
DCFirst Claim
1. A system configured to modify a set of time ordered digital images comprising a computer configured to:
- associate a first mask with a motion object in a first image;
copy said first mask to create a second mask associated with a second image;
import a computer-generated element associated with said first image;
obtain a depth data for said computer-generated element for said first image;
move said second mask to a location of said motion object in said second image;
reshape said second mask to fit said motion object in said second image;
import a computer-generated element associated with said second image;
obtain a depth data for said computer-generated element for said second image;
set at least one depth parameter associated with said first mask;
apply said at least one depth parameter to said second image;
generate a first pair of images for left eye viewing and right eye viewing respectively for said first image;
generate a second pair of images for left eye viewing and right eye viewing respectively for said second image.
8 Assignments
Litigations
0 Petitions
Accused Products
Abstract
Motion picture scenes to be colorized/depth enhanced (2D->3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects in a series of images may be partially or fully realistically drawn or rendered and applied to the occluded areas of the background and then automatically applied throughout the images to generate of minimal artifact or artifact-free secondary viewpoints when translating foreground objects horizontally during 2D->3D conversion.
-
Citations
20 Claims
-
1. A system configured to modify a set of time ordered digital images comprising a computer configured to:
-
associate a first mask with a motion object in a first image; copy said first mask to create a second mask associated with a second image; import a computer-generated element associated with said first image; obtain a depth data for said computer-generated element for said first image; move said second mask to a location of said motion object in said second image; reshape said second mask to fit said motion object in said second image; import a computer-generated element associated with said second image; obtain a depth data for said computer-generated element for said second image; set at least one depth parameter associated with said first mask; apply said at least one depth parameter to said second image; generate a first pair of images for left eye viewing and right eye viewing respectively for said first image; generate a second pair of images for left eye viewing and right eye viewing respectively for said second image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system configured to modify a set of time ordered digital images comprising:
-
a visual reference database; a computer coupled with said visual reference database wherein said computer is configured to create a mask based on bimodal thresholding at a mask location; import a computer-generated element associated with a first image and obtain said computer-generated element mask edge; adjust a mask shape of said mask by a weighted sliding scale for luminance and pattern wherein said mask shape is adjusted to match a border of an adjacent computer-generated element mask edge; and
,enter said mask location and said mask shape into said visual reference database coupled with said computer. - View Dependent Claims (11)
-
-
12. A system configured to modify a set of time ordered digital images comprising a computer configured to:
-
copy a first mask associated with a first mask location related to a first image to a second mask associated with a second mask location related to a second image; search via gradient descent within a bounding box around said second mask location in said second image for a pattern of luminance contained within said first mask in said first image or up to any computer-generated element mask edge; and
,adjust said second mask location in said second image. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. A method for modifying a set of time ordered digital images comprising:
-
associating a first mask with a motion object in a first image; copying said first mask to create a second mask associated with a second image; importing a computer-generated element associated with said first image; obtaining a depth for said computer-generated element for said first image; moving said second mask to a location of said motion object in said second image; reshaping said second mask to fit said motion object in said second image; importing a computer-generated element associated with said second image; obtaining a depth for said computer-generated element for said second image; setting at least one depth parameter associated with said first mask; applying said at least one depth parameter to said second image; generating a first pair of images for left eye viewing and right eye viewing respectively for said first image using a computer; generating a second pair of images for left eye viewing and right eye viewing respectively for said second image using said computer. - View Dependent Claims (19, 20)
-
Specification