SURFACE DETECTION IN IMAGES BASED ON SPATIAL DATA

• US 20110200249A1
• Filed: 02/17/2010
• Published: 08/18/2011
• Est. Priority Date: 02/17/2010
• Status: Abandoned Application

• Current Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Smith, Anthony O'Neil, Minear, Kathleen
• Application Number:
  US12/706,990
• Publication Number:
  US 20110200249A1
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/143 involving probabilistic approaches, e.g. Markov random field [MRF] modelling

Abstract

A system and method are provided for detecting surfaces in image data based on spatial data. The method includes obtaining an empirical probability density function (PDF) for the spatial data, where the spatial data includes a plurality of three-dimensional (3-D) point cloud data points associated with a plurality of default color space values. The method also includes generating a globally smooth estimated PDF based on the empirical PDF and a kernel smoothing technique, ascertaining one or more threshold elevation values for at least one mode in the estimated PDF, and tagging one or more portions of plurality of 3-D point cloud data points corresponding to the at least one mode based on the threshold elevation values.

Claims

1. A method for detecting surfaces in image data based on spatial data, comprising:

obtaining spatial data representing one or more surfaces of objects in a scene, said spatial data comprising a plurality of three-dimensional (3-D) point cloud data points;

obtaining an empirical probability density function (PDF) for said spatial data;

generating a globally smooth estimated PDF based on said empirical PDF and a kernel smoothing technique;

ascertaining one or more threshold elevation values for at least one mode in said estimated PDF;

tagging one or more portions of said plurality of 3-D point cloud data points corresponding to said at least one mode based on said threshold elevation values; and

generating a display of said surfaces using at least a portion of said spatial data using one or more color space values, wherein at least one of said portion of said spatial data and said color space values for said portion of said spatial data are selected based on said tagging.

2. The method of claim 1, wherein said obtaining further comprises producing a histogram of elevation values for said spatial data.

3. The method of claim 1, wherein said generating further comprises selecting a kernel function for said kernel smoothing technique to comprise a Gaussian PDF.

4. The method of claim 3, wherein said selecting further comprises selecting a standard deviation for said Gaussian PDF to comprise at least 0.5.

5. The method of claim 1, wherein said generating further comprises iteratively determining a smoothing parameter for a kernel function for said kernel smoothing technique.

6. The method of claim 1, wherein said ascertaining further comprises:

computing a derivative PDF based on said estimated PDF;

identifying a local maxima and a local minima pair associated with said at least one mode in said derivative PDF; and

if said derivative PDF comprises a first zero crossing at an elevation value greater than an elevation value for said local minima, selecting said first zero crossing as an upper one of said threshold elevation values.

7. The method of claim 6, wherein said ascertaining further comprises:

selecting a maximum elevation in said derivative PDF as an upper one of said threshold elevation values if said derivative PDF fails to comprise at least one zero crossing at an elevation value greater than said elevation value for said local minima.

8. The method of claim 6, wherein said ascertaining further comprises:

if said derivative PDF comprises a second zero crossing at an elevation value less than an elevation value for said local maxima, selecting said second zero crossing as a lower one of said threshold elevation values.

9. The method of claim 8, wherein said ascertaining further comprises:

if said derivative PDF fails to comprise at least one zero crossing at an elevation value greater than an elevation value for said local maxima, selecting a lower one of said threshold elevation values to comprise a minimum elevation in said derivative PDF.

10. The method of claim 1, wherein said plurality of 3-D point cloud data points are associated with a plurality of default color space values, and wherein said tagged portions of said plurality of 3-D point cloud data points are displayed using one or more alternate color space values associated with said at least one mode.

11. The method of claim 10, wherein one or more other portions of said plurality of 3-D point cloud data points are displayed using said plurality of default color space values.

12. A system for detecting surfaces in image data based on spatial data, comprising:

a storage element for receiving spatial data representing one or more surfaces of objects in a scene, said spatial data comprising a plurality of three-dimensional (3-D) point cloud data points associated with one or more default color space values; and

a processing element communicatively coupled to said storage element, said processing element configured for obtaining an empirical probability density function (PDF) based on said spatial data, generating a globally smooth estimated PDF based on said empirical PDF and a kernel smoothing technique, ascertaining one or more threshold elevation values for at least one mode in said estimated PDF, tagging one or more portions of said spatial data corresponding to said at least one mode based on said threshold elevation values, and modifying at least a portion of said default color space values based on said tagging for use in generating a display of said surfaces using said spatial data.

13. The system of claim 12, wherein said processing element is further configured during said obtaining for producing a histogram of elevation values for said spatial data.

14. The system of claim 12, wherein said processing element is further configured during said generating for selecting a kernel function for said kernel smoothing technique to comprise a Gaussian PDF.

15. The system of claim 14, wherein said processing element is further configured during said selecting for selecting a standard deviation for said Gaussian PDF to comprise at least 0.5.

16. The system of claim 12, wherein said processing element is further configured during said generating for iteratively determining a smoothing parameter for a kernel function for said kernel smoothing technique.

17. The system of claim 12, wherein said processing element is further configured during said ascertaining for computing a derivative PDF based on said estimated PDF, identifying a local maxima and a local minima pair associated with said at least one mode in said derivative PDF, and selecting as an upper one of said threshold elevation values a first zero crossing at an elevation value greater than an elevation value for said local minima.

18. The system of claim 17, wherein processing element is further configured during said ascertaining for selecting a maximum elevation in said derivative PDF as an upper one of said threshold elevation values if said derivative PDF fails to comprise at least one zero crossing at an elevation value greater than said elevation value for said local minima.

19. The system of claim 17, wherein said processing element is further configured during said ascertaining for selecting as a lower one of said threshold elevation values a second zero crossing at an elevation value lower than an elevation value for said local maxima.

20. The system of claim 19, wherein said processing element is further configured during said ascertaining for selecting a lower one of said threshold elevation values to comprise an minimum elevation in said derivative PDF if said derivative PDF fails to comprises at least one zero crossing at an elevation value greater than an elevation value for said local maxima.

21. The system of claim 12, further comprising a display element communicatively coupled to said processing element, wherein said processing element is further configured for generating signals to cause said display element to display at least said tagged portions of said spatial data.

22. The method of claim 21, wherein one or more other portions of said spatial data are displayed using said plurality of default color space values.