Systems and methods for three dimensional environmental modeling

• US 9,965,837 B1
• Filed: 12/02/2016
• Issued: 05/08/2018
• Est. Priority Date: 12/03/2015
• Status: Active Grant

• Current Assignee: Echosense LLC
• Original Assignee: Quasar Blu, LLC
• Inventors: Thomas, Mark
• Primary Examiner(s): Ahmed, Samir
• Application Number:
  US15/367,923
• Time in Patent Office: 522 Days
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

A system, according to various embodiments, receives images such as videos and photographs from one or more portable computing devices associated with one or more individuals while the portable computing devices are in a particular position within a particular location at a particular time. The system determines a virtual position within a 3-D representation of the particular location that generally corresponds to the particular position and combines the images with the 3-D representation to generate an enhanced 3-D representation of the particular location. The system may create one or more avatars to help users better understand how people will look and move within the space. Users may then login to an enhanced 3-D representation application to view a recreation of the activity at a particular time at a particular location.

Claims

1. A system for generating an enhanced representation of a particular location, the system comprising:

a. at least one processor; and

b. memory, wherein the computer system is adapted for;

i. receiving a first image from a first portable computing device associated with a first individual taken while the first portable computing device is in a first position within a particular location at a first time;

ii. receiving a second image from a second portable computing device associated with a second individual taken while the second portable computing device is in a second position within the particular location at a second time;

iii. determining a first virtual position within a 3-D representation of the particular location that generally corresponds to the first position;

iv. determining a second virtual position within the 3-D representation of the particular location that generally corresponds to the second position;

v. after receiving the first and second image, combining the first image, the second image, and the 3-D representation so that the first position of the first image generally corresponds to the first virtual position within the 3-D representation and the second position of the second image generally corresponds to the second virtual position within the 3-D representation; and

vi. at least partially in response to combining the first image, the second image, and the 3-D representation, generating an enhanced representation of the particular location that includes the first image, the second image, and the 3-D representation of the particular location.