System and method for measuring geometric change in a subterranean structure

• US 10,580,156 B2
• Filed: 09/25/2017
• Issued: 03/03/2020
• Est. Priority Date: 09/23/2016
• Status: Active Grant

• Current Assignee: Mine Vision Systems, Inc.
• Original Assignee: Mine Vision Systems, Inc.
• Inventors: Baker, L. Douglas, Thayer, Scott M., Lucey, Paul G., Roberts, Damien G.
• Primary Examiner(s): Hsieh, Ping Y
• Application Number:
  US15/714,484
• Publication Number:
  US 20180089852A1
• Time in Patent Office: 890 Days
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A system for measuring geometric change in a subterranean structure. The system includes an apparatus communicably couplable to a computing system. The apparatus is couplable to a mobile platform and includes a sensor configured to acquire data representative of a geometry of the subterranean structure and/or a camera configured to capture images of an interior of the subterranean structure, and a processing circuit. The computing system includes at least one processor, a 3D generator module configured to generate a digital three-dimensional model of the subterranean structure, an anchor module configured to define a plurality of digital anchors associated with the subterranean structure; a movement determination module configured to determine a movement of at least one of the digital anchors, and a movement classification module configured to determine a type of movement within the subterranean structure based on the determined movement of the at least one of the digital anchors.

Claims

1. A system for measuring geometric change in a subterranean structure, the system comprising:

an apparatus couplable to a mobile platform, wherein the apparatus comprises;

at least one of the following;

a sensor configured to acquire data representative of a geometry of the subterranean structure; and

a camera configured to capture images of an interior of the subterranean structure; and

a processing circuit communicably couplable to at least one of the following;

the sensor; and

the camera; and

a computing system communicably couplable to the apparatus, wherein the computing system comprises;

at least one processor;

a 3D generator module communicably couplable to the at least one processor, wherein the 3D generator module is configured to generate a digital three-dimensional model of the subterranean structure;

an anchor module communicably couplable to the at least one processor, wherein the anchor module is configured to define a plurality of digital anchors associated with the subterranean structure;

a movement determination module communicably couplable to the at least one processor, wherein the movement determination module is configured to determine a movement of at least one of the digital anchors; and

a movement classification module communicably couplable to the at least one processor, wherein the movement classification module is configured to determine a type of movement within the subterranean structure based on the determined movement of the at least one of the digital anchors, wherein the type of movement comprises at least one of the following;

convergence;

subsidence;

movement along a fault line;

cross-sectional movement;

longitudinal movement; and

hidden movement.

2. The system of claim 1, wherein the subterranean structure comprises one of the following:

a mine;

a tunnel;

a cave;

a bunker; and

a conduit.

3. The system of claim 1, wherein the sensor comprises one of the following:

a laser rangefinder;

a radar module;

an ultrasonic ranging module; and

a sonar module.

4. The system of claim 1, wherein the camera comprises one of the following:

a single lens camera;

a stereo camera; and

a structured light three-dimensional scanner.

5. The system of claim 1, wherein the apparatus further comprises at least one of the following:

a plurality of sensors; and

a plurality of cameras.

6. The system of claim 1, wherein the processing circuit is configured to time stamp at least one of the following:

data acquired by the sensor; and

images captured by the camera.

7. The system of claim 6, wherein the processing circuit is further configured to determine an ego-motion estimate of the camera.

8. The system of claim 7, wherein the determined ego motion estimate comprises an incremental estimate and a multi-frame estimate.

9. The system of claim 7, wherein the processing circuit is further configured to perform bundle adjustment on the determined ego-motion estimate.

10. The system of claim 1, wherein the processing circuit is further configured to dynamically control adjustment of at least one of the following:

the sensor; and

the camera.

11. The system of claim 1, wherein the apparatus further comprises a memory device.

12. The system of claim 1, wherein at least one of the plurality of digital anchors comprises an oriented X, Y, Z point in a three-dimensional coordinate system.

13. The system of claim 1, wherein the at least one of the plurality of digital anchors further comprises at least one of the following:

an image feature;

a geometric feature;

a topological feature; and

a symbolic figure.

14. The system of claim 1, wherein the movement determined by the movement determination module comprises:

a distance the at least one of the digital anchors has moved over time relative to the digital three-dimensional model of the subterranean structure; and

an angle the at least one of the digital anchors has moved over time relative to a reference.

15. An apparatus for measuring geometric change in a subterranean structure, the apparatus comprising:

at least one of the following;

a sensor configured to acquire data representative of a geometry of the subterranean structure while the sensor is moving through the subterranean structure; and

a camera configured to capture images of an interior of the subterranean structure while the camera is moving through the subterranean structure; and

a processor configured to;

generate digital three-dimensional models of the subterranean structure based on at least one of the following;

data acquired by the sensor; and

images captured by the camera;

define a plurality of digital anchors associated with the subterranean structure;

determine a movement of at least one of the plurality of digital anchors relative to the digital three-dimensional models of the subterranean, wherein the at least one of the plurality of digital anchors comprises an oriented X, Y, Z point in a three-dimensional coordinate system; and

determine a type of movement within the subterranean structure based on the determined movement of the at least one of the plurality of digital anchors, wherein the type of movement comprises at least one of the following;

convergence;

subsidence;

movement along a fault line;

cross-sectional movement;

longitudinal movement; and

hidden movement.

16. The apparatus of claim 15, wherein the at least one of the plurality of digital anchors comprises a feature vector.

17. The apparatus of claim 15, wherein the movement determined by the movement determination module comprises:

a distance the at least one of the digital anchors has moved over time relative to the digital three-dimensional model of the subterranean structure; and

an angle the at least one of the digital anchors has moved over time relative to a reference.

18. A system for measuring geometric change in a subterranean structure over time, the system comprising:

an apparatus couplable to a mobile platform, wherein the mobile platform is configured to move through the subterranean structure at different times, wherein the apparatus comprises;

at least one of the following;

at least one sensor, wherein the at least one sensor is configured to acquire data representative of a geometry of the subterranean structure while the mobile platform is moving through the subterranean structure;

at least one camera configured to capture a plurality of images of an interior of the subterranean structure while the mobile platform is moving through the subterranean structure; and

one or more processors; and

one or more modules configured to;

generate a plurality of digital three-dimensional models of the subterranean structure, wherein each of the plurality of digital three-dimensional models are generated at different times; and

generate a plurality of digital anchors associated with the subterranean structure, wherein at least two of the plurality of digital anchors comprises an oriented X, Y, Z point in a three-dimensional coordinate system;

define at least one group comprising the at least two of the plurality of digital anchors;

determine a movement of the at least two of the plurality of anchors relative to each other; and

determine a type of movement within the subterranean structure based the determined movement of the at least two digital anchors, wherein the type of movement comprises at least one of the following;

convergence;

subsidence;

movement along a fault line;

cross-sectional movement;

longitudinal movement; and

hidden movement.

19. The system of claim 18, wherein the at least two of the plurality of digital anchors comprise different feature vectors.

20. The system of claim 18, wherein the movement determined by the processor comprises at least one of the following:

a distance one of the at least two of the plurality of digital anchors has moved over time relative to at least one of the subsequent digital three-dimensional models of the subterranean structure; and

an angle one of the at least two of the plurality of digital anchors has moved over time relative to a reference.