Assisted 3D change detection

• US 10,260,875 B2
• Filed: 06/14/2017
• Issued: 04/16/2019
• Est. Priority Date: 03/01/2012
• Status: Active Grant

• Current Assignee: Trimble Inc.
• Original Assignee: Trimble Inc.
• Inventors: Schoner, Bernd, Ahern, Brian
• Primary Examiner(s): Marshall, Christle I
• Application Number:
  US15/622,487
• Publication Number:
  US 20170284800A1
• Time in Patent Office: 671 Days
• Field of Search: None
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 15/002 Active optical surveying means optical plumbing G01C15/105
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06K 7/10297 arrangements for handling protocols designed for non-contact record carriers such as RFIDs NFCs, e.g. ISO/IEC 14443 and 18092 cryptographic protocols H04L9/00; network security protocols H04L63/00; real-time communication protocols in data switching networks H04L65/00; network protocols for data switching network services H04L67/00
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: H04N 1/00342 with a radio frequency tag transmitter or receiver storage of additional information in an RFID tag attached to an image bearing paper sheet H04N1/32138
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3205 of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3225 of data relating to an image, a page or a document

Abstract

An imaging tool creates a first image of a scene and a second image of the scene taken after the first image. An RF tag reader receives data from an RF tag associated with the scene. A 3D representation of a change in the scene is created based on the first image, the second image, and the data from the RF tag.

Claims

1. A method of constructing a 3D representation, the method comprising:

obtaining a first image, wherein the first image includes at least a portion of a scene and an optical marker;

obtaining a second image, wherein;

the second image includes the portion of the scene and the optical marker; and

the second image is generated later in time compared to the first image;

receiving data from a radio frequency (RF) tag associated with the scene, wherein the data includes a 3D coordinate of the optical marker; and

constructing the 3D representation of a change in the scene using the first image, the second image, and the 3D coordinate of the optical marker.

2. The method of claim 1 wherein:

obtaining the second image comprises obtaining the second image using an imaging tool; and

receiving the data comprises receiving the data using an RF tag reader integrated with the imaging tool.

3. The method of claim 1 wherein the scene comprises a plurality of objects.

4. The method of claim 3 wherein the change in the scene includes an addition or removal of one or more objects in the scene.

5. The method of claim 1 wherein receiving the data comprises receiving the data from two or more RF tags.

6. The method of claim 1 wherein the change is caused by an addition, removal, or movement of one or more building elements.

7. The method of claim 1 wherein the data includes a three-dimensional model of the scene.

8. The method of claim 1 wherein the optical marker is mounted on an object in the scene.

9. A system for constructing a 3D representation, the system comprising:

an imaging tool operable to;

acquire a first image, wherein the first image includes at least a portion of a scene and an optical marker; and

acquire a second image, wherein;

the second image includes the portion of the scene and the optical marker; and

the second image is generated later in time compared to the first image;

a radio frequency (RF) tag reader operable to extract data from an RF tag associated with the scene, wherein the data includes a 3D coordinate of the optical marker; and

a processor operable to construct a 3D representation of a change in the scene using the first image, the second image, and the 3D coordinate of the optical marker.

10. The system of claim 9 further comprising the RF tag.

11. The system of claim 9 wherein:

the scene comprises a plurality of objects; and

the change in the scene includes an addition to, or removal of one or more of, the plurality of objects.

12. The system of claim 9 further comprising two or more RF tags associated with the scene.

13. The system of claim 9 wherein the change is caused by an addition, removal, or movement of one or more building elements.

14. The system of claim 9 wherein the data includes a three-dimensional model of an object in the scene.

15. The system of claim 9 wherein the optical marker is mounted on an object in the scene.

16. A memory device having instructions that when executed cause one or more processors to:

acquire a first image of at least a portion of a scene and an optical marker;

acquire a second image, wherein;

the second image includes the portion of the scene and the optical marker; and

the second image is generated later in time compared to the first image;

receive data from a radio frequency (RF) tag associated with the scene, wherein the data includes a 3D coordinate of the optical marker; and

construct a 3D representation of a change in the scene using the first image, the second image, and the 3D coordinate of the optical marker.

17. The memory device as recited in claim 16 wherein:

the scene comprises a plurality of objects; and

the change in the scene includes an addition to, or removal of one or more of, the plurality of objects.

18. The memory device as recited in claim 16 wherein the change is caused by an addition, removal, or movement of one or more building elements.

19. The memory device as recited in claim 16, wherein the data includes a three-dimensional model of an object in the scene.

20. The memory device as recited in claim 16 wherein the optical marker is mounted on an object in the scene.