IMAGE BASED TRACKING IN AUGMENTED REALITY SYSTEMS

• US 20180089904A1
• Filed: 12/04/2017
• Published: 03/29/2018
• Est. Priority Date: 10/30/2015
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Jurgenson, Nathan, Luo, Linjie, Rodriguez, II, Jonathan M., Sheth, Rahul Bhupendra, Li, Jia, Lv, Xutao
• Granted Patent: US 10,102,680 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 2201/07 Target detection

Abstract

Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.

Claims

1. A method for determining a device location comprising:

determining, using a first positioning system, a first position estimate for the device;

accessing, based on the first position estimate, a set of structure facade data describing one or more structure facades associated with the first position estimate;

capturing, by an image sensor of the device, a first image of an environment;

identifying, using the set of structure facade data, a first structure facade portion of the first image of the environment, wherein the first structure faç

ade portion matches first structure faç

ade data of the set of structure faç

ade data; and

calculating, based at least in part on the first structure facade portion of the first image of the environment, a second position estimate of the device.