Method and apparatus for displaying a calculated geometric entity within one or more 3D rangefinder data sets

• US 7,974,461 B2
• Filed: 02/09/2006
• Issued: 07/05/2011
• Est. Priority Date: 02/11/2005
• Status: Active Grant

• Current Assignee: Uatc, LLC (Uber Technologies, Inc.)
• Original Assignee: DeltaSphere, Inc.
• Inventors: Holloway, Richard L., Elgin, Benjamin C., Helser, Aron T., England, James N.
• Primary Examiner(s): Tucker, Wesley
• Assistant Examiner(s): Woldemariam, Aklilu K
• Application Number:
  US11/351,245
• Publication Number:
  US 20060182314A1
• Time in Patent Office: 1,972 Days
• Field of Search: 382/190, 382/106, 382/154, 382/280, 715/851, 345/419, 345/424, 356/4.01, 356/601, 700/182
• US Class Current: 382/154
• CPC Class Codes: G01C 15/002 Active optical surveying means optical plumbing G01C15/105
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering

Abstract

A method, computer program product, and apparatus for displaying a calculated geometric entity within at least one 3D range data set obtained using a 3D rangefinder device. At least a first 3D range data set is provided. Each 3D range data set is displayed as at least one displayed image. A calculated geometric entity selected from the group consisting of a vector, a surface, and a volume, is specified. The calculated geometric entity may be displayed merged within at least one displayed image.

Claims

1. A method for displaying a calculated geometric entity within at least one 3D range data set, comprising:

at a computer processor for rendering 3D range data as a displayed image;

representing a provided first 3D range data set as at least one displayed image;

specifying a calculated geometric entity for representing a non-physical entity comprising;

a calculated trajectory or path of motion,

a calculated origin of a trajectory or path of motion,

a calculated region of fluid flow,

a calculated swept volume,

a calculated projection of light or shadow,

a calculated position of a light source,

a calculated sight line,

calculated trajectories of explosion debris,

a calculated intersection with any of the above, or

a calculated normal vector to any of the above; and

displaying the calculated geometric entity merged within said at least one displayed image, wherein the first 3D range data set represents physical objects and wherein the calculated geometric entity represents something other than the physical objects represented by the first 3D range data set.

2. The method of claim 1, wherein displaying the calculated geometric entity comprises displaying the calculated geometric entity as at least one of a calculated 2D or 3D vector, a calculated surface, a calculated volume, a bullet trajectory, a blood spatter trajectory, an explosion debris trajectory, a trajectory of some object, a sight line, and combinations thereof.

3. The method of claim 1, wherein specifying at least some part of the calculated geometric entity is provided from the group consisting of manually entering the calculated geometric entity, entering the calculated geometric entity from a computer file, automatically entering the calculated geometric entity, and combinations thereof.

4. The method of claim 3, wherein specifying at least part of the calculated geometric entity comprises inputting selected from the group consisting of inputting the length of a line perpendicular to a specified point on a specified surface, inputting the orientation of a line at a specified point on a specified surface, inputting the diameter of a circle positioned with a specified center, inputting the direction of a bullet trajectory based on internal measurements, inputting the direction of blood spatter based on external measurements, inputting the direction of blood spatter based on internal measurements, inputting the direction of a bullet trajectory based on external measurements, inputting the direction of explosion debris based on internal measurements, inputting the direction of explosion debris based on external measurements, inputting the direction of a sight line based on internal or external measurements, and combinations of the above.

5. The method of claim 1, further comprising the steps of providing at least a second displayed image from the first 3D range data set wherein the at least second displayed image comprises a display format different than the display format of the said at least one displayed image;

and representing the at least second displayed image.

6. The method of claim 5, wherein displaying the calculated geometric entity comprises displaying the calculated geometric entity merged within at least two displayed images.

7. The method of claim 1, further comprising the steps of providing at least a second 3D range data set;

and representing the at least second 3D range data set as at least a second displayed image.

8. The method of claim 7, wherein displaying the calculated geometric entity comprises the step of displaying the calculated geometric entity merged within at least one of the displayed images.

9. The method of claim 7, wherein where the second 3D range data set may be obtained from the group consisting of being obtained by the same 3D rangefinder device as the first 3D range data set but obtained from a different 3D location, being obtained by the same 3D rangefinder device as the first 3D range data set from the same 3D location but obtained at a different resolution, being obtained by the same 3D rangefinder device as the first 3D range data set from the same 3D location but obtained at a different time, being obtained by a different 3D rangefinder device as the first 3D range data set and obtained at the same 3D location, being obtained by a different 3D rangefinder device as the first 3D range data set and obtained from a different 3D location, and being obtained by a different 3D rangefinder device as the first 3D range data set and obtained at a different time.

10. The method of claim 1, wherein at least the first 3D range data set is provided by a 3D rangefinder device selected from the group consisting of a scanning laser rangefinder using time of flight range measurement principles, a scanning laser rangefinder using phase comparison range measurement principles, a scanning laser rangefinder using any other range measurement principles, an imaging laser rangefinder range camera using time of flight range measurement principles, an imaging laser rangefinder range camera using phase comparison range measurement principles, an imaging laser rangefinder range camera using any other range measurement principles, a triangulation rangefinder, a stereo image rangefinder, a multiple image rangefinder, any other device that acquires a multiplicity of range data points simultaneously, and any other device that acquires a multiplicity of range data points over a period of time and combinations of the above.

11. The method of claim 1, wherein said at least one displayed image comprises a 2D image selected from the group consisting of a 2D range image comprising range values from the 3D rangefinder device converted to monochrome, a 2D range image comprising range values from the 3D rangefinder device converted to false color, a 2D reflectance image comprising intensity values of the rangefinding signal reflected from a physical surface and thereafter received by the 3D rangefinder device converted to monochrome, a 2D reflectance image comprising intensity values of the rangefinding signal reflected from a physical surface and thereafter received by the 3D rangefinder device converted to false color, a 2D registered color image comprising a color camera image previously registered with 3D range data, a 2D registered color image wherein the image is acquired from the same perspective as the 3D range data set, a 2D registered color image wherein the image is acquired from a different perspective than the 3D range data set, a 2D registered color image wherein the image is acquired with the same resolution as the 3D range data set, a 2D registered color image wherein the image is acquired with different resolution from the 3D range data set, a 2D image displayed in spherical projection format, a 2D image displayed in any other 3D-to-2D projection format, and a 2D registered monochrome image comprising a monochrome camera image previously registered with 3D range data.

12. The method of claim 1, wherein said at least one displayed image comprises a 3D image selected from the group consisting of a 3D point display, a 3D point display in orthogonal projection, a 3D point display in perspective projection, a 3D polygonal mesh, a 3D polygonal mesh in orthogonal projection, a 3D polygonal mesh in perspective projection, a 3D surface geometry display, a 3D surface geometry display in orthogonal projection, and a 3D surface geometry display in perspective projection.

13. The method of claim 1, implemented in a computer processor executing a suitable computer software program product therein.

14. The method of claim 1, implemented in a suitable computer software program product embodied on computer readable tangible media.

23. The method of claim 1 wherein representing a provided first 3D range data set as at least one displayed image comprises representing, as at, least one displayed image, a first 3D range data set that was obtained using a 3D rangefinder device.

15. A non-transitory computer readable medium having stored thereon computer-executable instructions that when executed by the processor of a computer perform steps comprising:

representing a first 3D range data set as at least one displayed image;

specifying a calculated geometric entity for representing a non-physical entity comprising;

a calculated trajectory or path of motion,

a calculated origin of a trajectory or path of motion,

a calculated region of fluid flow,

a calculated swept volume,

a calculated projection of light or shadow,

a calculated position of a light source,

a calculated sight line,

calculated trajectories of explosion debris,

a calculated intersection with any of the above, or

a calculated normal vector to any of the above; and

displaying the calculated geometric entity merged within said at least one displayed image, wherein the first 3D range data set represents physical objects and wherein the calculated geometric entity represents something other than the physical objects represented by the first 3D range data set.

16. The non-transitory computer readable medium of claim 15, wherein displaying the calculated geometric entity comprises displaying the calculated geometric entity as at least one of a calculated 2D or 3D vector, a calculated surface, a calculated volume, a bullet trajectory, a blood spatter trajectory, an explosion debris trajectory, a trajectory of some object, a sight line, and combinations thereof.

17. The non-transitory computer readable medium of claim 15, further comprising the steps of providing at least a second displayed image from the first 3D range data set wherein the at least second displayed image comprises a display format different than the display format of the said at least one displayed image;

and representing the at least second displayed image.

18. The non-transitory computer readable medium of claim 15, further comprising the steps of providing at least a second 3D range data set;

and representing the at least second 3D range data set as at least a second displayed image.

19. An apparatus for displaying a calculated geometric entity within at least one 3D range data set, comprising:

at least one computer processor;

a computer program product executing within the at least one computer processor, wherein the computer program product further comprises at least the following software modules therein;

a first software module for providing a first 3D range data set;

a second software module for representing the first 3D range data set;

a third software module for specifying a calculated geometric entity for representing a non-physical entity comprising;

a calculated trajectory or path of motion,

a calculated origin of a trajectory or path of motion,

a calculated region of fluid flow,

a calculated swept volume,

a calculated projection of light or shadow,

a calculated position of a light source,

a calculated sight line,

calculated trajectories of explosion debris,

a calculated intersection with any of the above, or

a calculated normal vector to any of the above,

wherein the first 3D range data set represents physical objects and wherein the calculated geometric entity represents something other than the physical objects represented by the first 3D range data set; and

a fourth software module for displaying the calculated geometric entity merged within said at least one displayed image.

20. The apparatus of claim 19, wherein displaying the calculated geometric entity comprises displaying the calculated geometric entity as at least one of a calculated 2D or 3D vector, a calculated surface, a calculated volume, a bullet trajectory, a blood spatter trajectory, an explosion debris trajectory, a trajectory of some object, a sight line, and combinations thereof.

21. The apparatus of claim 19, further comprising the steps of providing at least a second displayed image from the first 3D range data set wherein the at least second displayed image comprises a display format different than the display format of the said at least one displayed image;

and representing the at least second displayed image.

22. The apparatus of claim 19, further comprising the steps of providing at least a second 3D range data set;

and representing the at least second 3D range data set as at least a second displayed image.

24. The apparatus of claim 19 wherein the first 3D range data set comprises a 3D range data set that was obtained using a 3D rangefinder device.