Integrated imaging and RFID system for virtual 3D scene construction

• US 9,033,219 B2
• Filed: 02/03/2014
• Issued: 05/19/2015
• Est. Priority Date: 03/01/2012
• Status: Active Grant

• Current Assignee: Trimble Navigation Limited (Trimble Inc.)
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Schoner, Bernd, Ahern, Brian
• Primary Examiner(s): Marshall, Christle I
• Application Number:
  US14/171,100
• Publication Number:
  US 20140144981A1
• Time in Patent Office: 470 Days
• Field of Search: 235/375
• US Class Current: 235/375
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 15/002 Active optical surveying means optical plumbing G01C15/105
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06K 7/10297 arrangements for handling protocols designed for non-contact record carriers such as RFIDs NFCs, e.g. ISO/IEC 14443 and 18092 cryptographic protocols H04L9/00; network security protocols H04L63/00; real-time communication protocols in data switching networks H04L65/00; network protocols for data switching network services H04L67/00
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: H04N 1/00342 with a radio frequency tag transmitter or receiver storage of additional information in an RFID tag attached to an image bearing paper sheet H04N1/32138
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3205 of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3225 of data relating to an image, a page or a document

Abstract

A method includes acquiring imaging data of a scene using an imaging tool. The method also includes processing the imaging data to create a three-dimensional representation of the scene and extracting radio frequency identification (RFID) data stored in an RFID tag. The method further includes using the RFID data for placing an object in the scene that is not yet part of the scene.

Claims

1. A method comprising:

acquiring imaging data of a scene using an imaging tool;

processing the imaging data to create a three-dimensional representation of the scene;

extracting radio frequency identification (RFID) data stored in an RFID tag; and

using the RFID data for placing an object in the scene that is not yet part of the scene, wherein the RFID data comprises information that indicates how the object is to be placed in the scene.

2. The method of claim 1 further comprising associating the RFID data with the imaging data to indicate the position in the scene within the three-dimensional representation of the scene.

3. The method of claim 1 wherein two or more objects are identified by two or more RFID tags.

4. The method of claim 1 wherein acquiring imaging data and detecting the RFID tag are performed concurrently.

5. The method of claim 1 wherein the object is visualized within the three-dimensional representation of the scene.

6. The method of claim 1 wherein the imaging tool comprises a triangulation laser scanner.

7. The method of claim 1 wherein the RFID data includes a reference to a computer-aided design (CAD) model of a second object, wherein:

the second object is within in the scene; and

the first object is to replace the second object.

8. A system comprising:

an imaging tool operable to acquire imaging data of a scene, wherein the imaging data is processed to create a three-dimensional representation of the scene;

a model representing a desired transformation of the scene; and

an RFID reader operable to extract RFID data stored in one or more RFID tag(s), wherein;

the RFID data stored in one or more RFID tag(s) is associated with the scene or one or more objects within the scene; and

the RFID data is used in making the desired transformation of the scene.

9. The system of claim 8 further comprising information that the desired transformation of the scene was performed.

10. The system of claim 8 wherein the imaging tool comprises a laser scanner using a time-of-flight laser rangefinder.

11. The system of claim 8 wherein a position or orientation of an object is visualized within the three-dimensional representation of the scene.

12. The system of claim 8 wherein one or more images of objects are overlaid on the three-dimensional representation of the scene prior to transformation.

13. The system of claim 8 wherein images of one or more objects are overlaid on the three-dimensional representation of the scene after transformation occurs.

14. The system of claim 8 wherein the one or more objects are equipment.

15. The system of claim 8 wherein the one or more objects are building materials.

16. The system of claim 8 wherein the one or more objects are utilities.

17. The system of claim 8 wherein a person or machine is provided specific details about the desired transformation.

18. The system of claim 17 wherein the specific details about the desired transformation is a positioning of an object in the three-dimensional representation of the scene.