System and method for infinite synthetic image generation from multi-directional structured image array
First Claim
1. A method for interpolating images of an object from a multi-directional structured image array, the method to be performed by a computing device, the method comprising:
- obtaining a plurality of images corresponding to a light field using a camera, wherein each image in the plurality of images contains at least a portion of overlapping subject matter with another image, the subject matter including an object;
determining first, second, and third images in the plurality of images, the first, second, and third images being the closest three images in the plurality of images to a desired image location in the light field;
identify a first set of candidate transformations between the first image and the second image, wherein identifying the first set of candidate transformations includes applying an interpolation weight value of c1/d1 to transformation candidates, wherein d1 represents the distance between the first image and the second image, and wherein c1 represents the distance of the desired image location along d1;
identify a second set of candidate transformations between the first image and the third image, wherein identifying the second set of candidate transformations includes applying an interpolation weight value of c2/d2 to transformation candidates, wherein d2 represents the distance between the first image and the third image, and wherein c2 represents the distance of the desired image location along d2; and
for each pixel location in the desired image location in the light field;
calculate a first best pixel value using the first set of candidate transformations;
calculate a second best pixel value using the second set of candidate transformations;
blend the first and second best pixel values to form an interpolated pixel.
1 Assignment
0 Petitions
Accused Products
Abstract
This present disclosure relates to systems and processes for interpolating images of an object from a multi-directional structured image array. In particular embodiments, a plurality of images corresponding to a light field is obtained using a camera. Each image contains at least a portion of overlapping subject matter with another image. First, second, and third images are determined, which are the closest three images in the plurality of images to a desired image location in the light field. A first set of candidate transformations is identified between the first and second images, and a second set of candidate transformations is identified between the first and third images. For each pixel location in the desired image location, first and second best pixel values are calculated using the first and second set of candidate transformations, respectively, and the first and second best pixel values are blended to form an interpolated pixel.
51 Citations
20 Claims
-
1. A method for interpolating images of an object from a multi-directional structured image array, the method to be performed by a computing device, the method comprising:
-
obtaining a plurality of images corresponding to a light field using a camera, wherein each image in the plurality of images contains at least a portion of overlapping subject matter with another image, the subject matter including an object; determining first, second, and third images in the plurality of images, the first, second, and third images being the closest three images in the plurality of images to a desired image location in the light field; identify a first set of candidate transformations between the first image and the second image, wherein identifying the first set of candidate transformations includes applying an interpolation weight value of c1/d1 to transformation candidates, wherein d1 represents the distance between the first image and the second image, and wherein c1 represents the distance of the desired image location along d1; identify a second set of candidate transformations between the first image and the third image, wherein identifying the second set of candidate transformations includes applying an interpolation weight value of c2/d2 to transformation candidates, wherein d2 represents the distance between the first image and the third image, and wherein c2 represents the distance of the desired image location along d2; and for each pixel location in the desired image location in the light field; calculate a first best pixel value using the first set of candidate transformations; calculate a second best pixel value using the second set of candidate transformations; blend the first and second best pixel values to form an interpolated pixel. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for interpolating images of an object from a multi-directional structured image array, the system comprising:
-
a camera for obtaining a plurality of images corresponding to a light field, wherein each image in the plurality of images contains at least a portion of overlapping subject matter with another image, the subject matter including an object; a processor, and memory storing one or more programs configured for execution by the processor, the one or more programs comprising instructions for; obtaining a plurality of images using a camera in a light field, wherein each image in the plurality of images contains at least a portion of overlapping subject matter with another image, the subject matter including an object; determining first, second, and third images in the plurality of images, the first, second, and third images being the closest three images in the plurality of images to a desired image location in the light field; identify a first set of candidate transformations between the first image and the second image, wherein identifying the first set of candidate transformations includes applying an interpolation weight value of c1/d1 to transformation candidates, wherein d1 represents the distance between the first image and the second image, and wherein c1 represents the distance of the desired image location along d1; identify a second set of candidate transformations between the first image and the third image, wherein identifying the second set of candidate transformations includes applying an interpolation weight value of c2/d2 to transformation candidates, wherein d2 represents the distance between the first image and the third image, and wherein c2 represents the distance of the desired image location along d2; for each pixel location in the desired image location in the light field; calculate a first best pixel value using the first set of candidate transformations; calculate a second best pixel value using the second set of candidate transformations; blend the first and second best pixel values to form an interpolated pixel. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:
-
obtaining a plurality of images corresponding to a light field using a camera, wherein each image in the plurality of images contains at least a portion of overlapping subject matter with another image, the subject matter including an object; determining first, second, and third images in the plurality of images, the first, second, and third images being the closest three images in the plurality of images to a desired image location in the light field; identify a first set of candidate transformations between the first image and the second image, wherein identifying the first set of candidate transformations includes applying an interpolation weight value of c1/d1 to transformation candidates, wherein d1 represents the distance between the first image and the second image, and wherein c1 represents the distance of the desired image location along d1; identify a second set of candidate transformations between the first image and the third image, wherein identifying the second set of candidate transformations includes applying an interpolation weight value of c2/d2 to transformation candidates, wherein d2 represents the distance between the first image and the third image, and wherein c2 represents the distance of the desired image location along d2; and for each pixel location in the desired image location in the light field; calculate a first best pixel value using the first set of candidate transformations; calculate a second best pixel value using the second set of candidate transformations; blend the first and second best pixel values to form an interpolated pixel. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification