Augmenting multi-view image data with synthetic objects using IMU and image data
First Claim
1. A method comprising:
- receiving a selection of an anchor location for a synthetic object to be placed within a multi-view image;
computing movements between a reference image and a target image using visual tracking information associated with the multi-view image;
generating a first synthetic image corresponding to a target view associated with the target image, wherein the first synthetic image is generated by placing the synthetic object at the anchor location using visual tracking information associated with the anchor location in the multi-view image and orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, wherein the anchor location includes three-dimensional coordinates corresponding to 2D coordinates specified in the reference image along with a depth perpendicular to the plane of the reference image, the depth being triangulated, wherein generating the first synthetic image includes scaling the triangulated depth based on scale changes in the multi-view image; and
overlaying the first synthetic image on the target image to generate an augmented image from target view of the target image.
0 Assignments
0 Petitions
Accused Products
Abstract
Provided are mechanisms and processes for augmenting multi-view image data with synthetic objects using inertial measurement unit (IMU) and image data. In one example, a process includes receiving a selection of an anchor location in a reference image for a synthetic object to be placed within a multi-view image. Movements between the reference image and a target image are computed using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and an estimate of the camera'"'"'s intrinsic parameters. A first synthetic image is then generated by placing the synthetic object at the anchor location using visual tracking information in the multi-view image, orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, and projecting the synthetic object along a ray into a target view associated with the target image. The first synthetic image is overlaid on the target image to generate an augmented image from the target view.
19 Citations
20 Claims
-
1. A method comprising:
-
receiving a selection of an anchor location for a synthetic object to be placed within a multi-view image; computing movements between a reference image and a target image using visual tracking information associated with the multi-view image; generating a first synthetic image corresponding to a target view associated with the target image, wherein the first synthetic image is generated by placing the synthetic object at the anchor location using visual tracking information associated with the anchor location in the multi-view image and orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, wherein the anchor location includes three-dimensional coordinates corresponding to 2D coordinates specified in the reference image along with a depth perpendicular to the plane of the reference image, the depth being triangulated, wherein generating the first synthetic image includes scaling the triangulated depth based on scale changes in the multi-view image; and overlaying the first synthetic image on the target image to generate an augmented image from target view of the target image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A non-transitory computer readable medium comprising:
-
receiving a selection of an anchor location for a synthetic object to be placed within a multi-view image; computing movements between a reference image and a target image using visual tracking information associated with the multi-view image; generating a first synthetic image corresponding to a target view associated with the target image, wherein the first synthetic image is generated by placing the synthetic object at the anchor location using visual tracking information associated with the anchor location in the multi-view image and orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, wherein the anchor location includes three-dimensional coordinates corresponding to 2D coordinates specified in the reference image along with a depth perpendicular to the plane of the reference image, the depth being triangulated, wherein generating the first synthetic image includes scaling the triangulated depth based on scale changes in the multi-view image; and overlaying the first synthetic image on the target image to generate an augmented image from target view of the target image. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A system comprising:
-
a processor; and memory, wherein the memory stores instructions for; receiving a selection of an anchor location for a synthetic object to be placed within a multi-view image; computing movements between a reference image and a target image using visual tracking information associated with the multi-view image; generating a first synthetic image corresponding to a target view associated with the target image, wherein the first synthetic image is generated by placing the synthetic object at the anchor location using visual tracking information associated with the anchor location in the multi-view image and orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, wherein the anchor location includes three-dimensional coordinates corresponding to 2D coordinates specified in the reference image along with a depth perpendicular to the plane of the reference image, the depth being triangulated, wherein generating the first synthetic image includes scaling the triangulated depth based on scale changes in the multi-view image; and overlaying the first synthetic image on the target image to generate an augmented image from target view of the target image.
-
Specification