UNTOUCHED 3D MEASUREMENT WITH RANGE IMAGING

• US 20130308013A1
• Filed: 05/18/2012
• Published: 11/21/2013
• Est. Priority Date: 05/18/2012
• Status: Abandoned Application

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: LI, Jingquan, WANG, Ynjiun Paul, DELOGE, Stephen Patrick
• Application Number:
  US13/475,336
• Publication Number:
  US 20130308013A1
• Time in Patent Office: Days
• US Class Current: 348/231.3
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G01S 17/894 3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
• CPC Class Codes: G01S 7/4813 Housing arrangements
• CPC Class Codes: G01S 7/51 Display arrangements
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

A user terminal contains an input/output mechanism, an image capture device used to capture an image of a scene, a range imaging image capture device used to create a depth map of the scene, a processor that combine the image and the depth map into a model of the scene, a memory that stores the depth map and the image, and a display that displays the model. Utilizing this system, a user is able to view, measure, and calculate 3D data representing real world data, including but not limited to position, distance, location, and orientation of objects viewed in the display. The retrieves this information by making inputs into the terminal, including, in an embodiment of the invention, touch inputs selecting images on a touch screen.

Claims

1. A user terminal comprising:

an input/output mechanism;

an image capture device, wherein said image capture device is configured to capture an image of a scene upon receipt of a pre-defined input from said input/output mechanism;

a range imaging image capture device, wherein said image capture device is configured to create a depth map of said scene upon receipt of said pre-defined input from said input/output mechanism;

a processor, wherein said processor is configured, in response to said image capture and said depth map creation, to combine said image and said depth map into a model of said scene;

a memory, wherein said memory is configured to store said depth map and said image; and

a display wherein said display is configured to display said model.

2. The user terminal of claim 1, wherein said model displayed on said display as at least one of:

a 2D view, a depth map view, a 3D rendering/with texture, or augmented view.

3. The user terminal of claim 1, wherein said range imaging image capture device is provided by one of:

a structured light camera or a time of flight camera.

4. The user terminal of claim 1, wherein said depth map is created utilizing one of:

stereo triangulation, sheet of light triangulation, structured light, time-of-flight, interferometry, or coded Aperture.

5. The user terminal of claim 1, wherein said input/output mechanism comprises a touchscreen on said display.

6. The user terminal of claim 1, wherein said a image capture device comprises a digital camera.

7. The user terminal of claim 1, wherein said input/output mechanism is further configured to receive input identifying a first portion of said model;

wherein said processor is further configured, responsive to receiving said input identifying said first portion of said model to retrieve a first plurality of information corresponding to said first portion from said data in said memory; and

wherein said display is further configured to display said first plurality of information.

8. The user terminal of claim 7, wherein said first portion is an object and said first plurality of information contains at least one of:

the volume of said object, the surface area of said object, the distance from said object to said image capture device, the distance of said object from a second object, the surface curvature of said object.

9. The user terminal of claim 7, wherein said first portion is a point and said plurality of information contains at least one of:

the coordinates of said point, the distance from said point to said image capture device.

10. The user terminal of claim 7, wherein said display is further configured to display a color value corresponding to said first portion.

11. The user terminal of claim 7, wherein said input/output mechanism is further configured to receive a second input identifying a second portion of said model;

wherein said processor is further configured, responsive to receiving said second input identifying said second portion of said model to retrieve a second plurality of information corresponding to said second portion from said data in said memory;

wherein said display is further configured to display said second plurality of information; and

wherein said display is further configured to display a distance between said first portion and said second portion in said scene.

12. The user terminal of claim 11, wherein said input/output mechanism is further configured to display an angle between said first portion and said second portion in said scene.

13. A method for displaying an image by a user terminal comprising a microprocessor, a memory, an image capture device, a range imaging capture device, a display, an input device, said method comprising:

said user terminal capturing an image of a scene;

said user terminal creating a depth map of said scene;

said user terminal retaining said image and said depth map;

said user terminal combining said image and said depth map into a model;

said user terminal displaying said model.

14. The method of claim 13, further comprising:

said user terminal receiving input identifying a first portion of said model;

said user terminal retrieving data relating to said first portion from said depth map;

said user terminal displaying said data.

15. The method of claim 13, wherein said model is at least one of:

a 2D view, a depth map view, a 3D rendering/with texture, or augmented view.

16. The method of claim 13, wherein said depth map is creating using one of:

stereo triangulation, sheet of light triangulation, structured light, time-of-flight, interferometry, or coded Aperture.

17. The method of claim 14, wherein said first portion is an object and said data contains at least one of:

the volume of said object, the surface area of said object, the distance from said object to said image capture device, the distance of said object from a second object, the surface curvature of said object.

18. The method of claim 14 wherein said first portion is a point and said data contains at least one of:

the coordinates of said point, or the distance from said point to said image capture device.

19. The method of claim 14, further comprising:

said user terminal displaying a color value corresponding to said first portion.

20. The method of claim 14, further comprising:

said user terminal receiving a second input identifying a second portion of said model;

said user terminal retrieving second data relating to said second portion from said depth map;

said user terminal displaying said second data; and

said user terminal displaying a distance between said first portion and said second portion in said scene.