Image stitching for three-dimensional video
First Claim
1. A method comprising:
- receiving a plurality of images from a plurality of cameras, wherein the plurality of cameras comprises a first camera having a first orientation and a second camera having a second orientation, wherein the plurality of images comprises a first image from the first camera and a second image from the second camera;
detecting a plurality of feature points within the first and second images;
determining one or more pairs of corresponding feature points located within a region of overlap between the first and second images, wherein the pairs of corresponding feature points comprise a respective one of the feature points from each of the first and second images;
spatially adjusting one or more pixels of the first or second image based on a calculated offset between each pair of the corresponding feature points, wherein at least some of the one or more pixels are in the region of overlap;
comparing, prior to combining the first and second images, a portion of the first or second image containing the spatially adjusted one or more pixels with a third image containing the region of overlap, wherein the third image is taken by a third camera having the same orientation as either the first or the second camera;
either;
spatially adjusting, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, at least one pixel within the portion;
orconfirming, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, the accuracy of the spatial adjustment made to the one or more pixels of the first or second image; and
combining the first and second images as spatially adjusted into a merged image.
1 Assignment
0 Petitions
Accused Products
Abstract
In one embodiment, a method includes receiving multiple images from multiple cameras, where the multiple cameras include a first camera having a first orientation and a second camera having a second orientation, and the multiple images include a first image from the first camera and a second image from the second camera. The method also includes detecting multiple feature points within the first and second images. The method further includes determining one or more pairs of corresponding feature points located within a region of overlap between the first and second images, where the pairs of corresponding feature points include a respective one of the feature points from each of the first and second images. The method also includes spatially adjusting the first or second image based on a calculated offset between each pair of corresponding feature points.
181 Citations
31 Claims
-
1. A method comprising:
-
receiving a plurality of images from a plurality of cameras, wherein the plurality of cameras comprises a first camera having a first orientation and a second camera having a second orientation, wherein the plurality of images comprises a first image from the first camera and a second image from the second camera; detecting a plurality of feature points within the first and second images; determining one or more pairs of corresponding feature points located within a region of overlap between the first and second images, wherein the pairs of corresponding feature points comprise a respective one of the feature points from each of the first and second images; spatially adjusting one or more pixels of the first or second image based on a calculated offset between each pair of the corresponding feature points, wherein at least some of the one or more pixels are in the region of overlap; comparing, prior to combining the first and second images, a portion of the first or second image containing the spatially adjusted one or more pixels with a third image containing the region of overlap, wherein the third image is taken by a third camera having the same orientation as either the first or the second camera; either; spatially adjusting, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, at least one pixel within the portion;
orconfirming, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, the accuracy of the spatial adjustment made to the one or more pixels of the first or second image; and combining the first and second images as spatially adjusted into a merged image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. One or more non-transitory computer-readable storage media embodying instructions that are operable when executed to:
-
receive a plurality of images from a plurality of cameras, wherein the plurality of cameras comprise a first camera having a first orientation and a second camera having a second orientation, wherein the plurality of images comprises a first image from the first camera and a second image from the second camera; detect a plurality of feature points within the first and second images; determine one or more pairs of corresponding feature points located within a region of overlap between the first and second images, wherein the pairs of corresponding feature points comprise a respective one of the feature points from each of the first and second images; spatially adjust one or more pixels of the first or second image based on a calculated offset between each pair of the corresponding feature points; compare, prior to combining the first and second images, a portion of the first or second image containing the spatially adjusted one or more pixels with a third image containing the region of overlap, wherein the third image is taken by a third camera having the same orientation as either the first or the second camera; either; spatially adjust, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, at least one pixel within the portion;
orconfirm, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, the accuracy of the spatial adjustment made to the one or more pixels of the first or second image; and combine the first and second images as spatially adjusted into a merged image. - View Dependent Claims (21, 22, 23, 24, 25, 26)
-
-
27. An apparatus comprising:
-
one or more non-transitory computer-readable storage media embodying instructions; and one or more processors coupled to the storage media and configured to execute the instructions to; receive a plurality of images from a plurality of cameras, wherein the plurality of cameras comprise a first camera having a first orientation and a second camera having a second orientation, wherein the plurality of images comprises a first image from the first camera and a second image from the second camera; detect a plurality of feature points within the first and second images; determine one or more pairs of corresponding feature points located within a region of overlap between the first and second images, wherein the pairs of corresponding feature points comprise a respective one of the feature points from each of the first and second images; spatially adjust one or more pixels of the first or second image based on a calculated offset between each pair of the corresponding feature points; compare, prior to combining the first and second images, a portion of the first or second image containing the spatially adjusted one or more pixels with a third image containing the region of overlap, wherein the third image is taken by a third camera having the same orientation as either the first or the second camera; either; spatially adjust, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, at least one pixel within the portion;
orconfirm, based on the comparison of the portion of the first or second image containing the spatially adjusted one or more pixels with the third image, the accuracy of the spatial adjustment made to the one or more pixels of the first or second image; and combine the first and second images as spatially adjusted into a merged image. - View Dependent Claims (28, 29, 30, 31)
-
Specification