Visualization of 3-D GPR data in augmented reality

• US 9,715,008 B1
• Filed: 03/20/2013
• Issued: 07/25/2017
• Est. Priority Date: 03/20/2013
• Status: Active Grant

• Current Assignee: Bentley Systems Incorporated
• Original Assignee: Bentley Systems Incorporated
• Inventors: Ct, Stphane, Gervais, Renaud
• Primary Examiner(s): WINDRICH, MARCUS E
• Application Number:
  US13/847,909
• Time in Patent Office: 1,588 Days
• Field of Search: 342 22, 342 27, 342191
• CPC Class Codes: G01S 13/885 for ground probing prospecting or detecting using electromagnetic waves G01V3/12
• CPC Class Codes: G01S 7/20 Stereoscopic displays; Three-dimensional displays; Pseudo-three-dimensional displays

Abstract

In one embodiment, an augmented reality application generates an augmented reality view that displays three-dimensional (3-D) ground penetrating radar (GPR) data on boundary surfaces of a virtual excavation. The augmented reality application calculates an intersection of the one or more boundary surfaces of the virtual excavation and the 3-D GPR data, and extracts data items of the 3-D GPR data that intersect the one or more boundary surfaces of the virtual excavation. The augmented reality application then projects two-dimensional (2-D) images based on the extracted data items onto the one or more boundary surfaces of the virtual excavation to show subsurface features in the augmented reality view that can be manipulated (e.g., moved, rotated, scaled, have its depth changed, etc) by a user.

Claims

1. A method, comprising:

displaying an augmented reality view on a display screen of an electronic device;

creating a virtual excavation in a surface shown in the augmented reality view, the virtual excavation having a plurality of boundary surfaces that are defined by positions in three-dimensional (3-D) space of a 3-D model;

calculating, by the electronic device, an intersection of positions of the plurality of boundary surfaces of the virtual excavation in the 3-D space of the 3-D model and 3-D ground penetrating radar (GPR) data that has been indexed in the 3-D space of the 3-D model;

extracting, by the electronic device, data items of the 3-D GPR data that intersect the plurality of boundary surfaces of the virtual excavation to create a plurality of data sets, each data set corresponding to a respective one of the boundary surfaces of the virtual excavation; and

for each data set, projecting a two-dimensional (2-D) image based on the extracted 3-D GPR data items of the data set onto the corresponding boundary surface of the virtual excavation in the augmented reality view, the 2-D image including colors or shading to show subsurface features determined from the extracted 3-D GPR data items.

2. The method of claim 1, wherein the 3-D model is a 3-D model of the physical environment, and the augmented reality view is based on a view of a physical environment captured by a camera and the 3-D model of the physical environment.

3. The method of claim 2, further comprising:

anchoring the 3-D model of the physical environment to the view of the physical environment, such that each portion of the view of physical environment corresponds to a position within 3-D space of the 3-D model of the physical environment.

4. The method of claim 2, further comprising:

showing one or more elements of the 3-D model of the physical environment within the virtual excavation in the augmented reality view.

5. The method of claim 2, wherein the view of the physical environment is a panoramic view.

6. The method of claim 1, further comprising:

manipulating the plurality of boundary surfaces of the virtual excavation in response to user input.

7. The method of claim 6, wherein the manipulating comprises moving the virtual excavation within the augmented reality view.

8. The method of claim 6, wherein the manipulating comprises scaling the virtual excavation within the augmented reality view.

9. The method of claim 6, wherein the manipulating comprises changing a depth of the virtual excavation within the augmented reality view.

10. The method of claim 1, wherein the surface is ground.

19. The method of claim 1, wherein the virtual excavation has a bottom boundary surface and side boundary surfaces, while being open to the top, and the plurality of boundary surfaces includes at least the side boundary surfaces.

20. The method of claim 19, wherein the plurality of boundary surfaces further include the bottom boundary surface.

11. An apparatus, comprising:

a display screen;

a processor; and

a memory coupled to the processor and configured to store instructions for an augmented reality application that are executable on the processor, the instructions for the augmented reality application, when executed, operable to;

display an augmented reality view on the display screen,

create a virtual excavation in a surface shown in the augmented reality view, the virtual excavation having a plurality of boundary surfaces that are defined by positions in three-dimensional (3-D) space of a 3-D model,

calculate an intersection of positions of the plurality of boundary surfaces of the virtual excavation in the 3-D space of the 3-D model and three-dimensional (3-D) ground penetrating radar (GPR) data that has been indexed in the 3-D space of the 3-D model,

extract data items of the 3-D GPR data that intersect the plurality of boundary surfaces of the virtual excavation to create a plurality of data sets, each data set corresponding to a respective one of the boundary surfaces of the virtual excavation, and

for each data set, project a two-dimensional (2-D) image based on the extracted 3-D GPR data items of the data set onto the corresponding boundary surface of the virtual excavation in the augmented reality view, the 2-D image including colors or shading to show subsurface features from the extracted 3-D GPR data items.

12. The apparatus of claim 11, wherein the 3-D model is a 3-D model of the physical environment, and the augmented reality view is based on a view of a physical environment captured by a camera and the 3-D model of the physical environment.

13. The apparatus of claim 12, wherein the instructions for the augmented reality application, when executed, are further operable to:

anchor the 3-D model of the physical environment to the view of the physical environment, such that each portion of the view of physical environment corresponds to a position within 3-D space of the 3-D model of the physical environment.

14. A non-transitory computer-readable medium that includes instructions executable on a processor, the instructions, when executed, operable to:

display an augmented reality view;

create a virtual excavation in a surface shown in the augmented reality view, the virtual excavation having a plurality of boundary surfaces that are defined by positions in three-dimensional (3-D) space of a 3-D model;

calculate an intersection of positions of the plurality of boundary surfaces of the virtual excavation in the 3-D space of the 3-D model and penetrating radar data descriptive of subsurface features that has been indexed in the 3-D space of the 3-D model;

extract data items of the penetrating radar data descriptive of subsurface features that intersect the plurality of boundary surfaces of the virtual excavation to create data sets, each data set corresponding to a respective one of the boundary surfaces of the virtual excavation; and

for each data set, project an image based on the extracted penetrating radar data items of the data set onto the corresponding boundary surface of the virtual excavation in the augmented reality view, the image including colors or shading to show one or more subsurface features determined from the extracted penetrating radar data items.

15. The non-transitory computer-readable medium of claim 14, wherein the 3-D model is a 3-D model of the physical environment, and the augmented reality view is based on a view of a physical environment captured by a camera and the 3-D model of the physical environment.

16. The non-transitory computer-readable medium of claim 15, wherein the instructions, when executed, are further operable to:

show one or more elements of the 3-D model of the physical environment within the virtual excavation in the augmented reality view.

17. The non-transitory computer-readable medium of claim 15, wherein the instructions, when executed, are further operable to:

manipulate the plurality of boundary surfaces of the virtual excavation in response to user input.

18. The non-transitory computer-readable medium of claim 15, wherein the surface is ground.