ONLINE REFERENCE GENERATION AND TRACKING FOR MULTI-USER AUGMENTED REALITY

• US 20150193935A1
• Filed: 03/19/2015
• Published: 07/09/2015
• Est. Priority Date: 09/09/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Jiang, Bolan, Swaminathan, Ashwin, Spindola, Serafin Diaz, Ahuja, Dheeraj, Sweet, Charles Wheeler III, Choudhury, Prasun
• Granted Patent: US 9,558,557 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

A multi-user augmented reality (AR) system operates without a previously acquired common reference by generating a reference image on the fly. The reference image is produced by capturing at least two images of a planar object and using the images to determine a pose (position and orientation) of a first mobile platform with respect to the planar object. Based on the orientation of the mobile platform, an image of the planar object, which may be one of the initial images or a subsequently captured image, is warped to produce the reference image of a front view of the planar object. The reference image may be produced by the mobile platform or by, e.g., a server. Other mobile platforms may determine their pose with respect to the planar object using the reference image to perform a multi-user augmented reality application.

Claims

1. A method comprising:

capturing at least two images of a planar object;

determining a first pose, comprising a position and an orientation, of a first mobile platform with respect to the planar object using the at least two images;

warping an image of the planar object captured by the first mobile platform using the orientation of the first mobile platform with respect to the planar object to produce a reference image of a front view of the planar object; and

determining a second pose of a second mobile platform with respect to the planar object using a second image of the planar object captured by the second mobile platform and the reference image.