ONLINE REFERENCE GENERATION AND TRACKING FOR MULTI-USER AUGMENTED REALITY
First Claim
1. A method comprising:
- capturing at least two images of a planar object;
determining a first pose, comprising a position and an orientation, of a first mobile platform with respect to the planar object using the at least two images;
warping an image of the planar object captured by the first mobile platform using the orientation of the first mobile platform with respect to the planar object to produce a reference image of a front view of the planar object; and
determining a second pose of a second mobile platform with respect to the planar object using a second image of the planar object captured by the second mobile platform and the reference image.
1 Assignment
0 Petitions
Accused Products
Abstract
A multi-user augmented reality (AR) system operates without a previously acquired common reference by generating a reference image on the fly. The reference image is produced by capturing at least two images of a planar object and using the images to determine a pose (position and orientation) of a first mobile platform with respect to the planar object. Based on the orientation of the mobile platform, an image of the planar object, which may be one of the initial images or a subsequently captured image, is warped to produce the reference image of a front view of the planar object. The reference image may be produced by the mobile platform or by, e.g., a server. Other mobile platforms may determine their pose with respect to the planar object using the reference image to perform a multi-user augmented reality application.
-
Citations
45 Claims
-
1. A method comprising:
-
capturing at least two images of a planar object; determining a first pose, comprising a position and an orientation, of a first mobile platform with respect to the planar object using the at least two images; warping an image of the planar object captured by the first mobile platform using the orientation of the first mobile platform with respect to the planar object to produce a reference image of a front view of the planar object; and determining a second pose of a second mobile platform with respect to the planar object using a second image of the planar object captured by the second mobile platform and the reference image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. An apparatus comprising:
-
an interface for receiving at least two images to be processed, the at least two images containing different views of a planar object, wherein at least one of the at least two images is captured by a first camera; a data transmitting interface; a processor connected to the interface for receiving at least two images to be processed and the data transmitting interface; memory connected to the processor; and software held in the memory and configured to cause the processor to analyze the at least two images of the planar object and to determine a pose, comprising a position and an orientation, of the first camera with respect to the planar object using the at least two images, to warp an image of the planar object using the orientation to produce a reference image of a front view of the planar object, to transmit the reference image to a mobile platform with a second camera via the data transmitting interface to perform a multi-user augmented reality application using the reference image. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32)
-
-
33. A mobile platform comprising:
-
a camera; a wireless transceiver; a processor connected to the camera and the wireless transceiver; memory connected to the processor; a display connected to the memory; and software held in the memory and configured to cause the processor to analyze at least two captured images of a planar object and to determine a pose, comprising a position and an orientation, of the mobile platform with respect to the planar object using the at least two captured images, to warp an image of the planar object using the orientation to produce a reference image of a front view of the planar object, to transmit the reference image to at least one other mobile platform, and to perform a multi-user augmented reality application with the at least one other mobile platform using the reference image and that is displayed on the display.
-
-
34. A system comprising:
-
means for capturing at least two images of a planar object; means for determining a pose, comprising a position and an orientation, of a first mobile platform with respect to the planar object using the at least two images; means for warping an image of the planar object using the orientation of the first mobile platform with respect to the planar object to produce a reference image of a front view of the planar object; and means for determining a second pose of a second mobile platform with respect to the planar object using a second image of the planar object captured by the second mobile platform and the reference image. - View Dependent Claims (35, 36, 37, 38, 39, 40, 41, 42)
-
-
43. A computer-readable medium including program code stored thereon, comprising:
-
program code to analyze at least two images of a planar object to determine a pose, comprising a position and an orientation, of a camera that captured at least one of the at least two images with respect to the planar object; program code to warp an image of the planar object using the orientation to produce a reference image of a front view of the planar object; program code to transmit the reference image; and program code to perform a multi-user augmented reality application using the reference image. - View Dependent Claims (44, 45)
-
Specification