LOCAL POSITIONING SYSTEM FOR AUGMENTED REALITY APPLICATIONS

• US 20170256097A1
• Filed: 03/02/2017
• Published: 09/07/2017
• Est. Priority Date: 03/07/2016
• Status: Abandoned Application

• Current Assignee: F3 & Associates, Inc.
• Original Assignee: F3 & Associates, Inc.
• Inventors: Finn, Sean, Horbatiuk, Eric, Ferreira, Michael
• Application Number:
  US15/448,434
• Publication Number:
  US 20170256097A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06F 30/20 Design optimisation, verification or simulation optimisation, verification or simulation of circuit designs G06F30/30
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

Embodiments of the invention are directed to methods and systems for using local positioning beacons to create precise augmented reality images. Embodiments of the invention are also directed to providing different types of augmented reality images to different types of devices and/or individuals.

Claims

1. A method comprising:

surveying a real environment including existing physical elements, with one or more targets positioned at one or more control points in the real environment to determine coordinates of the one or more control points in relation to a real-world coordinate system;

importing the coordinates of the one or more surveyed control points into a 3D modeling computer;

generating, using the 3D modeling computer, a 3D digital model including the existing physical elements in relation to the real-world coordinate system;

generating, using the 3D modeling computer, a 3D digital model including a future physical element;

incorporating, using the 3D modeling computer, the 3D digital model including the future physical element at a location within or proximate the 3D digital model including the existing physical elements, such that the future physical element is associated with a future physical element location in the real-world coordinate system;

storing a data file comprising the 3D digital model including the future physical element and future physical element location data;

placing a plurality of beacon devices at a plurality of beacon device locations in the real environment;

surveying the plurality of beacon devices, with a target positioned at each beacon device, to determine coordinates of the plurality of beacon devices in relation to the real-world coordinate system; and

storing the coordinates of the plurality of beacon devices in a database,

wherein a mobile device position of a mobile device is determined based on communications between the plurality of beacon devices and the mobile device,

wherein, when the determined mobile device position is within a predetermined region associated with the future physical element, an augmented reality image based on the data file is displayed at the mobile device, the augmented reality image comprising a real view of the real environment seen through the camera of the mobile device in real-time overlaid with the 3D digital model including the future physical element at the future physical element location.

2. The method of claim 1, further comprising:

providing the data file and the coordinates of the plurality of beacon devices to the mobile device.

3. The method of claim 1, wherein the determined mobile device position has at least ⅛

^th of an inch accuracy, and wherein the future physical element is displayed at the future physical element location in the augment reality image with at least ⅛

^th of an inch accuracy.

4. The method of claim 1, further comprising:

receiving, at the mobile device, a plurality of signals from the plurality of beacon devices;

determining a position of the mobile device in the real-world coordinate system based on the plurality of received signals and the coordinates of the plurality of beacon devices; and

providing, on a display screen of the mobile device, an augmented reality image comprising a real view of the real environment seen through the camera of the mobile device in real-time overlaid with the 3D digital model including the future physical element at the future physical element location.

5. The method of claim 1, wherein the future physical element is a first future physical element, wherein the mobile device is a first mobile device associated with a first category, wherein the data file is a first data file, and wherein the method further comprises:

associating the first future physical element with the first category, wherein the first data file further includes a first category indicator, and wherein the augmented reality image based on the first data file was displayed at the first mobile device because the first mobile device is associated with the first category;

generating, using the 3D modeling computer, a 3D digital model including a second future physical element;

incorporating, using the 3D modeling computer, the 3D digital model including the second future physical element at a second location within or proximate the 3D digital model including the existing physical elements, such that the second future physical element is associated with a second future physical element location in the real-world coordinate system;

associating the second future physical element with a second category; and

storing a second data file comprising the 3D digital model including the second future physical element and second future physical element location data;

wherein a second mobile device position of a second mobile device is determined based on communications between the plurality of beacon devices and the second mobile device,

wherein, when the determined second mobile device position is within a predetermined region associated with the second future physical element, a second augmented reality image based on the second data file is displayed at the second mobile device, the second augmented reality image comprising a real view of the real environment seen through the camera of the second mobile device in real-time overlaid with the 3D digital model including the second future physical element at the second future physical element location.

6. A method comprising:

receiving, by a mobile device, a plurality of signals from a plurality of beacon devices;

determining a position of the mobile device in a real-world coordinate system based on the plurality of received signals;

capturing, using a camera of the mobile device, an image of a real environment including one or more existing physical elements; and

providing, on a display screen of the mobile device, an augmented reality image comprising a real view of the real environment seen through the camera of the mobile device in real-time overlaid with a 3D digital model including a future physical element at a future physical element location in the real-world coordinate system.

7. The method of claim 6, further comprising:

receiving coordinates associated with the plurality of beacon devices in the real-world coordinate system, the coordinates having been obtained with surveying equipment,

wherein the position of the mobile device is determined further based on the received coordinates of the plurality of the beacon devices.

8. The method of claim 6, further comprising:

retrieving, by the mobile device, a data file based on the determined mobile device position, the data file comprising the 3D digital model including the future physical element and future physical element location data.

9. The method of claim 6, wherein the determined mobile device position has at least ⅛

^th of an inch accuracy, and wherein the future physical element is displayed at the future physical element location in the augment reality image with at least ⅛

^th of an inch accuracy.

10. The method of claim 6, wherein the mobile device position is determined using triangulation.

11. A method comprising:

surveying a real environment including existing physical elements, with one or more targets positioned at one or more control points in the real environment to determine coordinates of the one or more control points in relation to a real-world coordinate system;

importing the coordinates of the one or more surveyed control points into a 3D modeling computer;

generating, using the 3D modeling computer, a 3D digital model including the existing physical elements in relation to the real-world coordinate system;

generating, using the 3D modeling computer, a first 3D digital model including a first future physical element;

incorporating, using the 3D modeling computer, the first 3D digital model including the first future physical element at a first location within or proximate the 3D digital model including the existing physical elements, such that the first future physical element is associated with a first future physical element location in the real-world coordinate system;

associating the first future physical element with a first category;

storing a first data file comprising the first 3D digital model including the first future physical element, first future physical element location data, and a first category indicator;

generating, using the 3D modeling computer, a second 3D digital model including a second future physical element;

incorporating, using the 3D modeling computer, the second 3D digital model including the second future physical element at a second location within or proximate the 3D digital model including the existing physical elements, such that the second future physical element is associated with a second future physical element location in the real-world coordinate system;

associating the second future physical element with a second category; and

storing a second data file comprising the second 3D digital model including the second future physical element, second future physical element location data, and a second category indicator,

wherein a first mobile device position of a first mobile device associated with the first category is determined based on communications between a plurality of beacon devices and the first mobile device,

wherein, when the determined first mobile device position is within a predetermined region associated with the first future physical element, an augmented reality image based on the first data file is displayed at the first mobile device, the augmented reality image comprising a real view of the real environment seen through the camera of the first mobile device in real-time overlaid with the first 3D digital model including the first future physical element at the first future physical element location,

wherein a second mobile device position of a second mobile device associated with the second category is determined based on communications between the plurality of beacon devices and the second mobile device, and

wherein, when the determined second mobile device position is within a predetermined region associated with the second future physical element, an augmented reality image based on the second data file is displayed at the second mobile device, the augmented reality image comprising a real view of the real environment seen through the camera of the second mobile device in real-time overlaid with the second 3D digital model including the second future physical element at the second future physical element location.

12. The method of claim 11, wherein the first category is associated with a first profession, and wherein the second category is associated with a second profession.

13. The method of claim 12, wherein the first profession is one of a plumber, an electrician, a construction worker, a welder, a manager, a maintenance worker, or a painter.

14. The method of claim 11, wherein the first category is associated with a first set of mobile devices, and wherein the second category is associated with a second set of mobile devices.

15. The method of claim 11, wherein each mobile device in the first set of mobile devices includes a first type of physical marking, and wherein each mobile device in the second set of mobile devices includes a second type of physical marking.

16. A method comprising:

capturing, using a camera of a first mobile device, an image of a real environment including one or more existing physical elements, wherein the first mobile device is associated with a first category;

retrieving, by the first mobile device, a first data file comprising a first 3D digital model including a first future physical element and first future physical element location data that identifies a first location in a real-world coordinate system, wherein the first data file is associated with the first category;

providing, on a display screen of the first mobile device, a first augmented reality image comprising a real view of the real environment seen through the camera of the first mobile device in real-time, overlaid with the first 3D digital model including the first future physical element at the first future physical element location;

capturing, using a camera of a second mobile device, an image of the real environment including the one or more existing physical elements, wherein the second mobile device is associated with a second category;

retrieving, by the second mobile device, a second data file comprising a second 3D digital model including a second future physical element and second future physical element location data that identifies a second location in the real-world coordinate system, wherein the second data file is associated with the second category; and

providing, on a display screen of the second mobile device, a second augmented reality image comprising a real view of the real environment seen through the camera of the second mobile device in real-time, overlaid with the second 3D digital model including the second future physical element at the second future physical element location.

17. The method of claim 16, wherein the first category is associated with a first profession, and wherein the second category is associated with a second profession.

18. The method of claim 17, wherein the first profession is one of a plumber, an electrician, a construction worker, a welder, a manager, a maintenance worker, or a painter.

19. The method of claim 16, wherein the first category is associated with a first set of mobile devices, and wherein the second category is associated with a second set of mobile devices.

20. The method of claim 16, wherein each mobile device in the first set of mobile devices includes a first type of physical marking, and wherein each mobile device in the second set of mobile devices includes a second type of physical marking.